Evaluation provides a systematic method to study a program, practice, intervention, or initiative to understand how well it achieves its goals. Evaluations help determine what works well and what could be improved in a program or initiative. Program evaluations can be used to:
- Demonstrate impact to funders
- Suggest improvements for continued efforts
- Seek support for continuing the program
- Gather information on the approach that can be shared with others
- Help determine if an approach would be appropriate to replicate in other locations with similar needs
An evaluation plan outlines the evaluation approach, including the focus of the evaluation (such as an activity, intervention, program, or policy), evaluation design, evaluation research questions, data collection methods, evaluation activities, stakeholders that should be engaged, timeline, performance measures, key milestones, and costs.
It is important to establish an evaluation plan before the program starts to make sure that the evaluation research questions, measures, and methods align with the evaluation's goals. When developing an evaluation plan, rural communities may consider the following questions:
- What are the goals of the program?
- What are the evaluation research questions that need to be answered?
- Who are the key stakeholders in the program?
- What types of resources and inputs are necessary to implement the program?
- What structures and processes are in place to implement the program?
- What activities are conducted by the program?
- What are the anticipated outputs of the program?
- What are the anticipated outcomes of the program?
- What contextual factors may affect the program?
- What are the barriers or challenges to implementing the program?
- Is there a return on investment for the program?
Developing evaluation research questions is an important part of evaluation planning. Guidance on the process for developing evaluation questions is available from the Centers for Disease Control and Prevention.
The topic guide on Conducting Rural Health Research, Needs Assessment, and Program Evaluation provides important context for rural communities. For evaluation considerations for specific types of programs, see:
Resources to Learn More
The Community Tool Box: Chapter 36 - Section 5. Developing an Evaluation Plan
Website
Highlights four key steps to consider when developing an evaluation plan, and includes examples and other resources to help in the development.
Organization(s): University of Kansas Work Group for Community Health and Development
Project Evaluation Plan Guide
Document
Provides an overview of evaluation plan components for rural health networks.
Organization(s): Rural Health Innovations, a subsidiary of the National Rural Health Resource Center
Date: 12/2017
Tools to Evaluate Your Coalition
Document
A series of four publications describing how to build coalitions and evaluate their effectiveness at various stages of development.
Author(s): Topaloff, A., Enderton, A., & Bregendahl, C.
Organization(s): Iowa State University Extension and Outreach
Date: 12/2015
Guide to Evaluating Collective Impact
Website
Provides leaders of collective impact initiatives a framework for measuring and evaluating the effectiveness and impact of their programs and projects. Includes a 90-minute webinar to supplement the guide.
Author(s): Preskill, H., Parkhurst, M., & Juster, J.S.
Organization(s): FSG
FAQs
Appropriateness, effectiveness, and efficiency
Three broad categories of key evaluation questions are often used to assess whether the program is appropriate, effective and efficient .
How to evaluate a CHW program? ›
Even with limited data, it may be possible to evaluate the following:
- Opportunities for quality improvement.
- Effectiveness of processes and activities.
- Achievement of program objectives.
- Potential for program sustainability.
- Effects of the CHW program on outcomes such as healthcare access and quality.
Types of evaluations
Conducting certain evaluations, like outcome evaluations, is difficult when a program is too new because program elements, strategies or procedures often still are being adjusted and finalized.
What four points should I consider or include in an evaluation plan? ›
There are four main steps to developing an evaluation plan:
- Clarifying program objectives and goals.
- Developing evaluation questions.
- Developing evaluation methods.
- Setting up a timeline for evaluation activities.
Some sample questions are:
- What are the outputs, outcomes, objectives, and goals of the project?
- Are outcomes, objectives, and goals achieved?
- Are the project/program services/activities beneficial to the target population?
- Do they have negative effects?
Examples of Evaluation Questions
Were participants satisfied with the delivery of the program? How do staff, community partners and referring agencies feel about the program? How did participants find out about the program? How many children/youth and/or families completed the program?
What are the five basic techniques of program evaluation in the community? ›
Evaluation can be classified into five types by intended use: formative, process, summative, outcome, and impact. Formative evaluation provides information to guide program improvement, whereas process evaluation determines whether a program is delivered as intended to the targeted recipients (Rossi et al., 2004).
How do you evaluate a program effectiveness in healthcare? ›
You can tailor each step to meet your needs.
- Engage Stakeholders. ...
- Describe the Program. ...
- Focus the Evaluation Design. ...
- Gather Credible Evidence. ...
- Justify Conclusions. ...
- Ensure Use and Share Lessons Learned.
Trust, respect, and dignity for all human beings are core values among CHWs, and these public health workers are central to efforts to address clinical and community integration and the social determinants of health.
What is program evaluation in simple terms? ›
Program evaluation is a systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency.
- 1 Formative evaluation. Formative evaluation is a type of program evaluation that focuses on improving the design and implementation of a program before it is completed. ...
- 2 Summative evaluation. ...
- 3 Process evaluation. ...
- 4 Outcome evaluation. ...
- 5 Impact evaluation. ...
- 6 Developmental evaluation. ...
- 7 Here's what else to consider.
Prerequisites for High Quality Evaluations
- Define your program (the logic model)
- Draft actionable research questions.
- Determine how to measure progress.
- Decide on a research design and analysis.
- Select whom to study (sample)
- Select data collection strategies.
- Weigh the tradeoffs of an internal or an external evaluation.
determine and prioritize key evaluation questions, pretest data collection instruments, facilitate data collection, implement evaluation activities, increase credibility of analysis and interpretation of evaluation information, and ensure evaluation results are used.
What are the three main evaluation goals? ›
This article discusses the relationships between the three main goals of evaluation (to learn, measure and understand) and the various types of evidence (evidence of presence, of difference-making, of mechanism) which are produced and/or used in the evaluation process.
What is an evaluation checklist? ›
Evaluation checklists are tools for assessing a product or service against a set of principles, best practices, or specific criteria (Brykczynski, 1999). From: Credible Checklists and Quality Questionnaires, 2013.
What are the three types of evaluation questions? ›
- Descriptive Questions. Represent “what is” • Like a snapshot. ...
- Normative (Comparative) Questions. Is what is what should be? • Often use monitoring data. ...
- Cause and Effect Questions. Identify if results have been achieved due to the intervention. • Seek to determine what difference the.
Evaluating Sources to Answer a Research Question
- How well does the source answer the research question?
- Is the information provided by an expert?
- Is the source valid?
- Is there a variety of sources?
This article discusses the relationships between the three main goals of evaluation (to learn, measure and understand) and the various types of evidence (evidence of presence, of difference-making, of mechanism) which are produced and/or used in the evaluation process.
What are the 3 common types of program evaluations? ›
- 1 Formative evaluation. Formative evaluation is a type of program evaluation that focuses on improving the design and implementation of a program before it is completed. ...
- 2 Summative evaluation. ...
- 3 Process evaluation. ...
- 4 Outcome evaluation. ...
- 5 Impact evaluation. ...
- 6 Developmental evaluation. ...
- 7 Here's what else to consider.
