However, because program evaluation builds on many other disciplines e. It involves collecting and analyzing information about a program s activities, characteristics, and outcomes. Components of program theory for funnel and rogers p. A wealth of approaches and an untapped potential marielle riche european commissioni have w e got closer t o ident if yi ng the ge nerati ve mechani sms that produce an outcom e f or th e lagging regi ons of t he.
Theory provides a broad road map that helps explain the dynamics of health behavior, identify effective interventions, select. We then focus on several commonly used program evaluation models in the context of those theoretical bases. Building a theory of change with solid theoretical foundations and. The evaluation module has been organized by the specific health topics listed above, and for each one, potential measures for the following four main outcome categories of interest to employers and employees have been developed. What you will learn from these sessions session 1 become familiar with the 6 steps of the cdc evaluation framework learn to identify and engage important stakeholders step 1 session 2 develop a simple logic model step 2 learn to focus the evaluation step 3 session 3 learn to select appropriate data collection methods for your. Table 1 lists those themes, which i have sorted into three categories. Evaluation of four different learning theories and models. Special issue designing and using program evaluation as a tool for reform margaret e.
Ross auburn university the auburn university educational leadership team and its k12 practitioner and community partners collaboratively developed a comprehensive, ongoing evaluation plan to assess a newly implemented fieldbased graduate program. This paper attempts to discuss a basic model for the evaluation of educational systems and instructional programs. Reductionism, system theory, and most recently complexity theory have inspired the development of models commonly applied in evaluation studies today. Intrinsic motivation is the innate, natural propensity to engage ones interests and exercise ones capacities, and in so doing, to seek and conquer optimal challenges. All human service programs are designed to make a difference in the lives of people or to improve our society. The first learning theory to be researched in the 19xxx, based on the work of pavlov and skinner, is known as the behaviourist theory. A comprehensive guide this engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from. Program theory and the evaluation of a program s theory have gained interest in the evaluation field. Integrating theory and practice was solving two thirds of my evaluation doubts. This section should delineate the criteria for evaluation prioritization and include a discussion of feasibility and efficiency. Now in its second edition, evaluation theory, models, and applications is the vital text on evaluation models, perfect for classroom use as a textbook, and as a professional evaluation reference.
A theory based evaluation of a program is one in which the selection of program features to evaluate is determined by an explicit conceptualization of the program in terms of a theory, a theory which attempts to explain how the program produces the desired effects. On the theoretical level, policy makers may acknowledge that evaluations should be an integral part of the policymaking process. If youre looking for a free download links of program evaluation theory and practice pdf, epub, docx and torrent then this site is not for you. In 1972, carol weiss described the value of having any program evaluation rooted in good theory 1972. Lipsey 1993 identified six elements of a program theory consisting of problem definition, mediating processes, expected output, exogenous factors, critical inputs, and implementation issues. Clarify the meaning of specific evaluation approaches and models. Program theory in evaluation is formulated in many different ways and applied for a variety of purposes.
Download program evaluation theory and practice pdf ebook. The evaluation is designed to test the theory to see if it holds true. Relevance of the better parenting program to the country goals 64 5. No single understanding of the term is widely accepted. Building a culturally responsive independent consulting practice. Identifies evaluation indicators and performance measures, data sources. Applying a theory of change approach to the evaluation of. Initially inspired by the work of michael scriven 1967, the valuing branch firmly establishes the vital role of the evaluator in valuing. Program evaluation models and related theories 3 in this guide, we first briefly define program evaluation, discuss reasons for conducting educational program evaluation, and outline some theoretical bases for evaluation models. Effective program evaluation is a systematic way to improve and account for public health actions by involving procedures that are useful, feasible, ethical, and accurate.
Consider, for example, an industrial assistance program where the government gives grants on a. Theory connotes a body of knowledge that organizes, categorizes, describes, predicts, explains, and otherwise aids in understanding and controlling a topic p. Evaluation theory, models, and applications, 2nd edition. Two halves of the same body by adeyemo adetogun read more. A programme theory explains how an intervention a project, a programme, a policy, a strategy is understood to contribute to a chain of results that produce the intended or actual impacts.
The leading text that covers both the theory and practice of evaluation in one engaging volume has now been revised and updated with additional evaluation approaches such as mixed methods and principlesfocused evaluation and new methods such as technologically based strategies. Save up to 80% by choosing the etextbook option for isbn. Evaluation theory gives me helpful ideas for practice 3. The program theory is vital in the theorybased evaluation. Through a careful blend of theory, research, and practice, the author presents a testing model that is specifically tailored to the concerns of language education programs and which can be adapted to different contexts and updated as teaching and learning situations evolve. Program evaluation theory and practice, first edition 1st. This article describes a particular type of program theory evaluation logic analysisthat allows us to test the plausibility of a program s theory using scientific knowledge. First, there are issues related to the theory and structure of the program, the program s rationale and possible alternatives.
The book begins with an overview of the evaluation field and program evaluation standards, and proceeds to cover the most widely used evaluation approaches. Program evaluation theory and practice, first edition a comprehensive guide 1st edition by donna m. Betterevaluation is an international collaboration to improve evaluation theory and practice by sharing information about evaluation options methods, strategies. What is evaluation back to determining the evaluation question. Growing and nurturing your evaluation business when your independent consultancy becomes an employer. A new explanatory model for policy analysis and evaluation.
If it does, the task of the evaluator is to produce a plausible case, with evidence, that shows what has. Theory based stakeholder evaluation tse, instead of fusing the theories of different stakeholders into a single unified theory, keeps the program theories of diverse stakeholder groups separate from each other and from the program theory embedded in the institutionalized intervention itself. It can include positive impacts which are beneficial and negative impacts which are detrimental. Identifying the elements of a program theory is an important step. Ifau theorybased evaluation of the curriculum lgr 11 3. A theorybased evaluation is usually based on an explicit theory of change or logic model that explains the theory of a development intervention. This approach to evaluation focuses on theoretical rather than methodological issues. These differ from a traditional educational approach because the technology introduces a whole raft of extra variables that do not exist in a conventional lectureroomclassroom situation. Kirkpatricks model of learning evaluation has been used for more than 50 years. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for conducting large and smallscale evaluations. Program theory in evaluation can be developed before a program is implemented or after the. A theory based evaluation is usually based on an explicit theory of change or logic modelthat explains the theory of a development intervention. Useful theory of change models john mayne ottawa, ontario abstract.
Although it is practiceoriented, there has been a proliferation of research on evaluation theory to prescribe underlying frameworks of evidencebased practice. This handbook provides a framework for thinking about evaluation as a relevant and useful program tool. This article provides a quick overview of 4 evaluation models youll find most useful. Theorybased approaches are a logic of enquiry, which complement and can be used in combination with most of the evaluation designs and data collection techniques outlined in. Request pdf program evaluation theory and practice. They are often used to help design effective programs, and other times as a means to explain how a program is understood to contribute to its intended or observed outcomes. Alkin, marvin c woolley, dale a model for educational. This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. This guide describes experimental and quasiexperimental models, kirkpatricks fourlevel model, the logic model, and the. An introduction to program theory social solutions. Although theories of change are frequently discussed in the evaluation literature and there is general agreement on what a theory of change is conceptually, there is actually little agreement beyond the big picture of just what a theory.
An account is offered of the evolution of this persuasion, through the works of chen. This article describes a particular type of program theory evaluationlogic analysisthat allows us to test the plausibility of a programs theory using scientific knowledge. Evaluation is a relatively new field that has emerged from a diverse array of applied social sciences. An evaluation theory tree deals with obtaining generalizability, or knowledge construction, as shadish, cook, and leviton 1991 refer to it.
The book features examples of small and largescale evaluations from a range of fields, many with reflective. Evaluation is the systematic process of delineating, obtaining, reporting, and applying descriptive and. Wilson phd and a great selection of related books, art and collectibles available now at. Evaluation is a process that critically examines a program. A theorydriven evaluation perspective on mixed methods. Evaluation theory as a concept components of a meaningful evaluation theory alkins evaluation theory tree sample evaluation theories program theory that brings theory to life in evaluations 10 the concept of evaluation theory and so we begin. Program evaluation theory and practice download ebook. Theorybased approaches to evaluation use an explicit theory of change to draw conclusions about whether and how an intervention contributed to observed results.
Third, evaluation theory is who we are in the sense that theory has defined the themes of the majority of aea conferences. The basic idea is to use the program s rationale or theory as the basis of an evaluation to understand the program s development and impact smith, 1994, p. The cdcs introduction to program evaluation for public health programs defines program evaluation as the systemic collection of information about the activities, characteristics and outcomes of programs to make judgments about the program, improve program effectiveness, andor inform decisions about future program development. Understand the underlying principles and practice applications of. Program theory explains why a program is expected to work and a logic model. Sample outline for a program theory q if a certain set of resources such as staff, equipment, materials are available, then the program can provide a certain set of activities or services to participants. In simple terms, a program theory is the assumption that your program s design, activities, and execution will lead to the achievement of the outcomes you intend for your clients. It is a practical, nonprescriptive tool, designed to. One way to do this is for the evaluator and program people to develop a very good description of. The challenges to evaluating plans and planning are discussed, including the reliance on ex ante evaluations, a lack of outcome evaluation methodologies. The postpositivist paradigm and the methods branch. The evaluation guidance so far has been general guidance that can apply to any outcome. Chen university of alabama at birmingham the purpose of this article is to discuss the conceptual framework and strategies used in theorydriven evaluations in relation to mixed methods research and to explore the opportunities and challenges emerging from theorydriven.
Theory based approaches to evaluation use an explicit theory of change to draw conclusions about whether and how an intervention contributed to observed results. Theorybased programme development and evaluation in. It was written primarily for project directors who have direct responsibility for the ongoing evaluation of w. Program theory evaluation, which has grown in use over the past 10 years, assesses whether a program is designed in such a way that it can achieve its intended outcomes. New directions for evaluation wiley online library.
Jan 20, 2016 there are dozens of learning evaluation models currently in practice. From the point of view of evaluation methods, two groups of evaluation issues can be usefully distinguished. The basic idea is to use the programs rationale or theory as the basis of an evaluation to understand the programs development and impact smith, 1994, p. My area of concentration is in program evaluation with a focus on science technology engineering and math stem fields.
Evaluation theory for strategic communication is grounded in and derived from theory of change and program theory, which were developed in the 1970s and 1980s in the field of public administration. Theorybased evaluations have helped open the black box of programmes. Definition a theory of change is a structured approach used in the design and evaluation of social programs to explore change and how it happens. Apr 15, 2008 a comprehensive description of a programme using the six essential elements of sidani and bradens model of programme theory 7 clarifies what the programme is about and allows for development of pertinent questions that can be addressed within the programme development and evaluation cycle. It maps the logical chain of how program inputs achieve changes in outcomes. Evaluation theory, design and methods tei the evaluators. I am encouraged by some of the recent work that has been done along these lines to develop criteria for.
Multiple terms have been integrated into discussions of program theory development and evaluation including. Nov 10, 2018 hi, i am sara vaca independent evaluator and saturdays contributor to this blog. The framework for evaluation in public health 1 guides public health professionals in their use of program evaluation. Download limit exceeded you have exceeded your daily download allowance. This resource guide discusses program theory and logic models. This chapter provides an overview of evaluation approaches for educational technology.
Program theory and logic models evaluation resources from wilder research. Historical and contemporary evaluation paradigms, branches, theories, and approaches. Educators can be more confident when choosing an appropriate evaluation model if they first consider the models theoretical basis against their program s complexity and their own evaluation needs. Well go into logic models in an upcoming evaluation tip sheet. Special issue designing and using program evaluation as a. Furthermore, the wellknown writers in the field of evaluation theory did not receive their formal education in a program designed to produce professional evaluators, although these have been in existence since the late 1970s. This report presents and describes an evaluation project of the most recent swedish curriculum reform, curriculum for the compulsory school, preschool class and the recreation centrelgr 11. Evaluation is the systematic process of delineating, obtaining, reporting, and applying descriptive and judgmental information about some objects merit, worth. Deci and ryan 1985 as a subtheory within sdt that had the aim of specifying factors that explain. All human service programs are designed to make a difference in the lives of people or to. Wilson was program director of the international development program. Q if participants receive these services, then they experience specific changes in their knowledge, attitudes, or skills. How do such theories of change assist cci stakeholders. The assumptions leading to the development of a comprehensive definition of evaluation and the definition itself will.
A program theory is similar in concept to logic models, which have become increasingly popular in human services programs over the past several years. Applying program theorydriven approach to design and. Theories that inform educational program evaluation models 4. Some of this, of course, can be attributed to the relative newness of the profession. Program evaluation theory and practice, first edition. This description helps to identify how the program should lead to the.
Evaluation theory, models, and applications daniel l. Theorybased evaluation and types of complexity ulg. Its purpose is to make judgments about a program, to improve its effectiveness, andor to inform programming decisions patton, 1987. Program theory and logic models 1 wilder research, august 2009 wilder research. In behaviourist theory learning is a mechanical process of habit formation, by means of frequent reinforcement of a stimuli response sequence, this can be thought of as conditioning. Theory based approaches are a logic of enquiry, which complement and can be used in combination with most of the evaluation designs and data collection techniques outlined in.
A clear and concise program theory lays out a logical description of why the activities you provide will lead to the results or benefits you intend. A theorydriven evaluation perspective on mixed methods research huey t. Click download or read online button to get program evaluation theory and practice book now. This site is like a library, use search box in the widget to get ebook that you want. Evaluation theory and practice american university online.
275 1499 1122 249 1501 855 960 260 1013 929 285 1366 59 1486 1277 909 793 205 1104 746 1322 881 623 1184 527 755 1165 459 12 50 245 210 405 1444 280