https://outreach.ou.edu/Educational-Services Parent Page: Educational Services id: 32087 Active Page: Identify Data Collection Methodsid:32133

Program Evaluation KnowledgeBase

This KnowledgeBase archive includes content and external links that were accurate and relevant as of September 30, 2019.

The Program Evaluation KnowledgeBase is an online resource aiding education professionals in understanding the basics of project evaluation in order to properly assess projects and programs. It is organized around three elements to assist educators with their program evaluation.

Task 2: Identify Data Collection Methods

Guideline:  The evaluation questions determine what data is collected and impact how the data is collected. The collection methods should focus on the project's needs. When identifying what methods to use, be sure to consider resources needed to do so, responsiveness to program participants, their creditability and whether the resulting information will be useful to the evaluation process.

Resources

Checklists

Data Collection Checklists - Collecting Data

This checklist provides guidance in organizing data collection efforts.


Possible Project-Level Evaluation Activities

This worksheet from the W.K. Kellogg Foundation Evaluation Handbook lists possible evaluation activities for each project stage from planning to policy.

Guidelines

Conducting a Comprehensive Needs Assessment

This tool from the U.S. Department of Education's An Idea Book for Planning is useful for managing the data collected during the needs assessment. It consists of two parts—Data Sources Matrix and Data Collection and Analysis Plan.

"The Data Sources Matrix helps organize needs assessment data collection by identifying information sources and methods of data collection. In the matrix, fill specific sources of information you already have on hand from the school profile (e.g., student achievement data, results from a parent survey with results that are pertinent to the planning effort), so you do not duplicate efforts. Then, list any additional information the team decides to collect. Examine each focus area to make sure that there are data describing the status of major aspects of the priority focus areas."

"The Data Collection and Analysis Plan prioritizes the "focus areas" for which data will be collected and it lays out the data collection and analysis plans. First, define the team's key questions, the data collection methods (i.e., surveys, interviews, focus groups, shadowing, etc.), instruments to be used by analysis subcommittee members, and summarize the plans for analysis. List two to three "focus areas" the team plans to study in order of highest (#1) to lowest priority for data gathering. Respond to the questions for each focus area."

Implementing Schoolwide Programs - Presentation

Practical Tips

Advantages and Drawbacks of Various Data Collection Procedures

This chart compares the pros and cons of eight data collection methods.

References

Overview of Data Collection Procedures

This document provides an overview of six data collection techniques that can be useful in profiling the school.


Overview of Qualitative Methods and Analytic Techniques

This link is to Part II Chapter 3 of the National Science Foundation's User-Friendly Handbook for Mixed Method Evaluations addressing common qualitative methods used in project evaluations.

The contents of this website were developed under a grant from the U.S. Department of Education and are intended for general reference purposes only. However, those contents do not necessarily represent the policy of the U.S. Department of Education or the Center, and you should not assume endorsement by the Federal Government. Some resources on this site require Adobe Acrobat Reader. This website archive includes content and external links that were accurate and relevant as of September 30, 2019.