Bonus section model forms, program theory, and unexpected behavior. Program logic often specifies the inputs and components. Learn and apply program evaluation approaches to social programs. A logic model is a graphic depiction road map that presents the shared relationships among the resources, activities, outputs, outcomes, and impact for your program. The reason logic models can help is that the process of developing a model forces us to make assump tions explicit about how the program will work. The threeday training institute on program evaluation and costbenefit analysis will enable participants to. Conduct a sensitivity analysis and a risk analysis. Logic analysis, is an evaluation that allows us to test the plausibility of a programs theory using available scientific knowledgeeither scientific evidence or expert knowledge brousselle and. Logic analysis, a specific type of program theory evaluation based on scientific knowledge, can help identify either the critical conditions for achieving desired outcomes or alternative interventions for that purpose. Development of a logic model to guide evaluations of the asca. Summer stats camp program evaluation, cost benefit analysis. Program theory program logic logic model theory of action model of change conceptual map outcome. There are a number of options when it comes to using software to help create a logic model.
While they can be in a narrative form, logic model usually take form in a graphical depiction of the ifthen causal relationships between the various elements leading to the outcome. Logic models help evaluators identify the critical questions to be. It depicts the relationship between your programs activities and its intended effects. In this assignment, you will explore the programs background, history, purpose, and theory. Program theory evaluation, which has grown in use over the past 10 years, assesses whether a program is designed in such a way that it can achieve its intended outcomes. Imagine you are evaluating a professional development program. Concrete things that are invested in the program these are the core aspects of a program that allow the program to actually be implemented. The process of developing the model is an opportunity to chart the course. This article describes a particular type of program theory evaluationlogic analysisthat allows us to test the plausibility of a programs theory using scientific. Increases understanding about program guides program evaluation design and methodology leads to improved planning and management. Logic modeling is a thought process program evaluators have found to be useful for at least forty years and has become increasingly popular with program managers during the last decade.
A logic model presents a plausible and sensible model of how the program will work under certain environmental conditions to solve identified problems. A program logic model is a schematic representation that describes how a program. Program theory and the evaluation of a program s theory have gained interest in the evaluation field. This is the program theory or rationale aspect of a logic model. In this article, we outline the principles of logic analysis and its roots. This article describes a particular type of program theory evaluationlogic analysisthat allows us to test the plausibility of a programs theory using scientific knowledge. Logic analysis is a type of program theory evaluation that uses scientific knowledge to evaluate the validity of the interventions theory and identify promising alternatives to achieve the. A logic model also can help us communicate more clearly with our colleagues and peers about the internal workings of the program. Analysis for your final project, you will conduct an evaluation for a social program of your choosing.
Logic models, theory of change and program evaluation youtube. It might tell you that attendance at the after school program is an intermediate outcome. Training on project monitoring and evaluation with data. Logic model for a senior walking program inputs activities outputs outcomes impact number of sites that participate. How to develop a program logic for planning and evaluation. Program evaluation for effective professional development. Logic modeling a diagram of the theory of how a program is supposed to worka. Logic models have been used to evaluate policy programs, plan projects, and allocate resources. Theory of cause and effect is the underlying logic or theoretical support for the program. Develop programme theory theory of change better evaluation. Theory based approaches to evaluation use an explicit theory of change to draw conclusions about whether and how an intervention contributed to observed results. The purpose of a logic model is to show how a program works and to draw out the relationships between resources, activities and outcomes lawton et al. Presenters provided guidance on how to determine the. Additional resources developing evaluation questions.
This article describes a particular type of program theory evaluation logic analysis that allows us to test the plausibility of a program s theory using scientific knowledge. Toolkit december 2018 formative evaluation toolkit. The use of logic models for program planning became widespread, the capacity of the cooperative extension system to conduct meaningful program evaluation has increased markedly, and data for. The logic model was characterized initially by program evaluators as a tool for identifying performance measures. Is the program working the way it was intended to work. Program theory ultimately should rely on all three sources. Program theory and logic models 1 wilder research, august 2009 wilder research. Logic modeling can enhance a practitioners ability to plan, design, implement, analyze, and generate knowledge. A program logic model is a schematic representation that describes how a program is. The figure shows one of many ways to construct a logic model, but there are a varitey of other formats that can be used to achieve the same goal. Developing and optimising the use of logic models in.
This article describes a particular type of program theory evaluationlogic. Program evaluation, costbenefit analysis statistics training. Evaluation theory, design and methods tei the evaluators. Logic models are typically used in theory based evaluation, which is designed to explicitly articulate the underlying theory of change which shapes a transformation programme.
The logic model is both a tool for program planning helping you see if your program will lead to your desired outcomes and also for evaluation making it easier to see what. Evaluation is a relatively new field that has emerged from a diverse array of applied social sciences. Theory based approaches are a logic of enquiry, which complement and can be used in combination with most of the evaluation designs and data collection techniques outlined in. Novice logic modelers may want to have copies of the basic logic model template in front of them and follow along. Uses, limitations, links to methodology and data jonathan a. What is good program theory in international development. What is evaluation use the program theory or logic model to come up with evaluation questions does the program have a positive outcome.
A clear logic model illustrates the purpose and content of your program and makes it easier to develop meaningful evaluation questions from a variety of program vantage points. Logic model, program logic, programme logic, causal model, results chain, intervention logic, toc a programme theory explains how an intervention a project, a programme, a policy, a strategy is understood to contribute to a chain of results that produce the intended or actual impacts. Program theory and logic models evaluation resources from wilder research. A logic model would tell you that the after school program is an activity and improved reading scores is an outcome. A logic model is a toplevel depiction the flow of materials and processes to produce the results desired by the organization or program. Logic modeling is a systematic approach to enabling highquality program evaluation through processes designed to result in pictorial representations of the theory of action of a program frechtling, 2007. Program evaluation program evaluation is a systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency. Comparative logic modeling is used here on human immunodeficiency virus hiv policy statements from the department of. The third phase of the logic analysis is the evaluation of the program theory. In this blog, we show you how to develop a watertight program theory and program logic. Read moreabout toco lucidchart an cloudbased flow chart maker with a number of usual features. Logic modeling methods in program evaluation is an important resource for anyone who wants to have a better understanding of the application of the logic model. Educators can be more confident when choosing an appropriate evaluation model if they first consider the models theoretical basis against their program s complexity and their own evaluation needs. Since that time, the tool has been adapted to program planning, as well.
Impact evaluation of natural resource management research programs. In both the public and private sectors, stakeholders often want to know whether the programs they are funding, implementing, voting for. Between good intentions and great results lies a program theory not just a list of tasks but a vision of what needs to happen, and how. They are often used to help design effective programs, and other times as a means to explain how a program is. What are the implications for program implementation and evaluation.
While many additional resources exist, this compilation provides an array of materials that will be useful to the practitioner who may not have formal training in program evaluation. Jan 06, 2019 logic models, theory of change and program evaluation. It is easy to measure the amount of money spent on a program, but this is a poor indicator of outcomes. Multiple terms have been integrated into discussions of program theory development and evaluation including. Logic analysis is a type of program theory evaluation that uses scientific knowledge to evaluate the validity of the interventions theory and identify promising alternatives to achieve the desired effects. The following discussion of logic model weaknesses is intended to help agencies assess their current use of logic models and decide if moving in another direction makes more. Toco theory of change online toco is webbased software no download required that you can use to design and edit and store your theory of change, learn the concepts of theory of change, and capture your outcomes, indicators, rationales and assumptions in an interactive graphical environment. Journal articles that provide evaluation theory and research on methodologies as well as real world examples of evaluation in practice are also included. Nov 24, 2016 some distinctions my perspective theory of change logic model articulates the ultimate big picture outcome e. Dec 18, 2018 a logic model is a graphic depiction road map that presents the shared relationships among the resources, activities, outputs, outcomes, and impact for your program. Furthermore, the intervention was carefully developed in order to fit to the setting 45, however evaluating programs anchored in an ecological approach is a.
It is now commonplace to use research, program theory, and logic models in evaluation practice. The fiveday training institute on program evaluation and costbenefit analysis will enable participants to. All human service programs are designed to make a difference in the lives of people or to improve our society. Generic program logic model and logic model developed for the depart of labors chief evaluation office study of veteran and nonveteran job seekers analysis by evaluation type. The other two major sources of program theory are substantive academic theory and empirical data i. Reductionism, system theory, and most recently complexity theory have inspired the development of models commonly applied in evaluation studies today. Case management programs for frequent users of healthcare services are. Logic models are hypothesized descriptions of the chain of causes and effects see causality leading to an outcome of interest e.
Those readers with more experience and familiarity may. All human service programs are designed to make a difference. A program theory is similar in concept to logic models, which have become increasingly popular in human services programs over the past several years. This article describes a particular type of program theory evaluationlogic analysis that allows us to test the plausibility of a program s theory using scientific knowledge. Purposeful program theory shows how to develop, represent, and use program theory thoughtfully. Summative evaluation is conducted later, once the program has reached full implementation exhibit 1. The logic model is often used in government or notforprofit organizations, where the mission and vision are not aimed at achieving a financial benefit. It depicts the relationship between your program s activities and its intended effects. If you decide to use a different program for your final project, thats okay. This document provides an overview of the components of a logic model, examples of logic model designs, and describes the use of logic models in program planning and evaluation. Understand how to monitor program progress and fidelity. Now widely used in government and notforprofit organizations, program theory provides a coherent picture of how change occurs and how to improve performance.
Logic modeling surfaces and summarizes the explicit and implicit logic of how a program operates to produce. However, this closely relates to the purposes and uses of program theory in design and evaluation, a point that i will take up in subsequent blogs. It explains why the program ought to work, why it can succeed where other attempts have failed. It is a conscious process that creates an explicit understanding of the challenges ahead, the resources available, and the timetable in which to hit the target. The previous section showed how to engage stakeholders and generate shared understanding of how your professional learning programs work by creating program descriptions, logic models, and a program theory.
The benefits of having a program theory put simply, program theory is the way that you articulate the why and the what of your program. From logic models to program and policy evaluation 1. Purposeful program theory shows how to develop, represent, and use program theory thoughtfully and. Evaluation theory gives me helpful ideas for practice 3. Program evaluation is a systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency. This resource guide discusses program theory and logic models. Evaluation theory and practice american university online. Toc software, there are a number of options when it comes to using software to help create a logic model. Learn more about logic models and the key steps to developing a useful logic model on. Logic model, program logic, programme logic, causal model, results chain. Logic models for program design, implementation, and.
Formative evaluation is typically conducted on an early version of a program, while the program is still being developed and improved scriven, 1997. The model can be very useful to organize planning and analysis when designing the organization and its programs or when designing outcomesbased evaluations of programs. The purpose of formative evaluation is to provide feedback to program directors and staff about. Between good intentions and great results lies a program theorynot just a list of tasks but a vision of what needs to happen, and how. Pdf the logic model for program planning and evaluation. Although it is practiceoriented, there has been a proliferation of research on evaluation theory to prescribe underlying frameworks of evidencebased practice. We illustrate two types of logic analysis with two actual evaluation cases. Mar 05, 2015 in this workshop webinar, participants were reintroduced to logic models, specifically as a tool in developing a program or policy evaluation. Program theory and logic models university of new mexico. Traditionally, government programs were described only in terms of their budgets. Program evaluation models and related theories 3 in this guide, we first briefly define program evaluation, discuss reasons for conducting educational program evaluation, and outline some theoretical bases for evaluation models. Logic models help us to think through our plans for the program. Two key features of a program that should be detailed here, as they can dictate program success or failure are program theory of cause and effect and theory of implementation.
Guidelines and framework for designing basic logic model. By defining the problem or opportunity and showing how intervention activities will respond to it, a logic model makes the program planners assumptions explicit. Evaluating complex interventions requires an understanding of the programs logic of action. Five steps of program planning the logic model and how to apply it to a program evaluation planning based on the logic model importance for strategic management answer your questions about logic models and evaluation next steps 4. Example of a logic model for an educator evaluation system theory of action d1 references and resources ref1 participant workbook introduction to workshop 3 session i. Logic models have been used for at least 30 years and are recommended in official evaluation guidance hm treasury, 2011 as a method to support robust evaluation.