This description helps to identify how the program should lead to the. Furthermore, the wellknown writers in the field of evaluation theory did not receive their formal education in a program designed to produce professional evaluators, although these have been in existence since the late 1970s. In simple terms, a program theory is the assumption that your program s design, activities, and execution will lead to the achievement of the outcomes you intend for your clients. Evaluation theory, models, and applications, 2nd edition. This article describes a particular type of program theory evaluationlogic analysisthat allows us to test the plausibility of a programs theory using scientific knowledge. Program evaluation theory and practice, first edition 1st. A programme theory explains how an intervention a project, a programme, a policy, a strategy is understood to contribute to a chain of results that produce the intended or actual impacts. The framework for evaluation in public health 1 guides public health professionals in their use of program evaluation. The cdcs introduction to program evaluation for public health programs defines program evaluation as the systemic collection of information about the activities, characteristics and outcomes of programs to make judgments about the program, improve program effectiveness, andor inform decisions about future program development. Nov 10, 2018 hi, i am sara vaca independent evaluator and saturdays contributor to this blog.
Theorybased approaches to evaluation use an explicit theory of change to draw conclusions about whether and how an intervention contributed to observed results. A theorybased evaluation is usually based on an explicit theory of change or logic model that explains the theory of a development intervention. Alkin, marvin c woolley, dale a model for educational. It can include positive impacts which are beneficial and negative impacts which are detrimental. Theorybased evaluations have helped open the black box of programmes. The first learning theory to be researched in the 19xxx, based on the work of pavlov and skinner, is known as the behaviourist theory. Growing and nurturing your evaluation business when your independent consultancy becomes an employer. Evaluation is a relatively new field that has emerged from a diverse array of applied social sciences. Wilson phd and a great selection of related books, art and collectibles available now at. Chen university of alabama at birmingham the purpose of this article is to discuss the conceptual framework and strategies used in theorydriven evaluations in relation to mixed methods research and to explore the opportunities and challenges emerging from theorydriven.
Program theory and logic models evaluation resources from wilder research. A new explanatory model for policy analysis and evaluation. I am encouraged by some of the recent work that has been done along these lines to develop criteria for. Components of program theory for funnel and rogers p. Program evaluation theory and practice, first edition a comprehensive guide 1st edition by donna m. Evaluation theory, design and methods tei the evaluators. Request pdf program evaluation theory and practice. This article provides a quick overview of 4 evaluation models youll find most useful. Betterevaluation is an international collaboration to improve evaluation theory and practice by sharing information about evaluation options methods, strategies. Historical and contemporary evaluation paradigms, branches, theories, and approaches. A clear and concise program theory lays out a logical description of why the activities you provide will lead to the results or benefits you intend.
A program theory is similar in concept to logic models, which have become increasingly popular in human services programs over the past several years. Clarify the meaning of specific evaluation approaches and models. This approach to evaluation focuses on theoretical rather than methodological issues. The challenges to evaluating plans and planning are discussed, including the reliance on ex ante evaluations, a lack of outcome evaluation methodologies. Theory connotes a body of knowledge that organizes, categorizes, describes, predicts, explains, and otherwise aids in understanding and controlling a topic p. Evaluation theory as a concept components of a meaningful evaluation theory alkins evaluation theory tree sample evaluation theories program theory that brings theory to life in evaluations 10 the concept of evaluation theory and so we begin.
It is a practical, nonprescriptive tool, designed to. Sample outline for a program theory q if a certain set of resources such as staff, equipment, materials are available, then the program can provide a certain set of activities or services to participants. This report presents and describes an evaluation project of the most recent swedish curriculum reform, curriculum for the compulsory school, preschool class and the recreation centrelgr 11. It was written primarily for project directors who have direct responsibility for the ongoing evaluation of w. A theory based evaluation is usually based on an explicit theory of change or logic modelthat explains the theory of a development intervention. This chapter provides an overview of evaluation approaches for educational technology. Program theory explains why a program is expected to work and a logic model. Evaluation theory gives me helpful ideas for practice 3. Relevance of the better parenting program to the country goals 64 5. Useful theory of change models john mayne ottawa, ontario abstract. This site is like a library, use search box in the widget to get ebook that you want. The assumptions leading to the development of a comprehensive definition of evaluation and the definition itself will.
Evaluation is the systematic process of delineating, obtaining, reporting, and applying descriptive and judgmental information about some objects merit, worth. Identifies evaluation indicators and performance measures, data sources. This article describes a particular type of program theory evaluation logic analysisthat allows us to test the plausibility of a program s theory using scientific knowledge. What you will learn from these sessions session 1 become familiar with the 6 steps of the cdc evaluation framework learn to identify and engage important stakeholders step 1 session 2 develop a simple logic model step 2 learn to focus the evaluation step 3 session 3 learn to select appropriate data collection methods for your. On the theoretical level, policy makers may acknowledge that evaluations should be an integral part of the policymaking process. The book begins with an overview of the evaluation field and program evaluation standards, and proceeds to cover the most widely used evaluation approaches. The basic idea is to use the programs rationale or theory as the basis of an evaluation to understand the programs development and impact smith, 1994, p. Educators can be more confident when choosing an appropriate evaluation model if they first consider the models theoretical basis against their program s complexity and their own evaluation needs. Reductionism, system theory, and most recently complexity theory have inspired the development of models commonly applied in evaluation studies today. Applying program theorydriven approach to design and. Understand the underlying principles and practice applications of.
This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. Table 1 lists those themes, which i have sorted into three categories. Planning a assessing a assessing a assessing a program new program developing program stablemature program that has ended. This section should delineate the criteria for evaluation prioritization and include a discussion of feasibility and efficiency. It involves collecting and analyzing information about a program s activities, characteristics, and outcomes.
Evaluation theory, models, and applications daniel l. They are often used to help design effective programs, and other times as a means to explain how a program is understood to contribute to its intended or observed outcomes. Program theory and logic models 1 wilder research, august 2009 wilder research. Effective program evaluation is a systematic way to improve and account for public health actions by involving procedures that are useful, feasible, ethical, and accurate. We then focus on several commonly used program evaluation models in the context of those theoretical bases. However, because program evaluation builds on many other disciplines e. Program theory in evaluation can be developed before a program is implemented or after the. If youre looking for a free download links of program evaluation theory and practice pdf, epub, docx and torrent then this site is not for you. Lipsey 1993 identified six elements of a program theory consisting of problem definition, mediating processes, expected output, exogenous factors, critical inputs, and implementation issues.
Theory based approaches are a logic of enquiry, which complement and can be used in combination with most of the evaluation designs and data collection techniques outlined in. Ross auburn university the auburn university educational leadership team and its k12 practitioner and community partners collaboratively developed a comprehensive, ongoing evaluation plan to assess a newly implemented fieldbased graduate program. Applying a theory of change approach to the evaluation of. Ifau theorybased evaluation of the curriculum lgr 11 3. The evaluation guidance so far has been general guidance that can apply to any outcome. Download program evaluation theory and practice pdf ebook. Although theories of change are frequently discussed in the evaluation literature and there is general agreement on what a theory of change is conceptually, there is actually little agreement beyond the big picture of just what a theory. Building a theory of change with solid theoretical foundations and. Building a culturally responsive independent consulting practice. From the point of view of evaluation methods, two groups of evaluation issues can be usefully distinguished. No single understanding of the term is widely accepted. An evaluation theory tree deals with obtaining generalizability, or knowledge construction, as shadish, cook, and leviton 1991 refer to it. This paper attempts to discuss a basic model for the evaluation of educational systems and instructional programs.
In simple terms, a logic model is a picture of your theory a drawing that. Theory provides a broad road map that helps explain the dynamics of health behavior, identify effective interventions, select. Program theory in evaluation is formulated in many different ways and applied for a variety of purposes. A theorydriven evaluation perspective on mixed methods. The evaluation is designed to test the theory to see if it holds true. The leading text that covers both the theory and practice of evaluation in one engaging volume has now been revised and updated with additional evaluation approaches such as mixed methods and principlesfocused evaluation and new methods such as technologically based strategies. All human service programs are designed to make a difference in the lives of people or to. All human service programs are designed to make a difference in the lives of people or to improve our society. Through a careful blend of theory, research, and practice, the author presents a testing model that is specifically tailored to the concerns of language education programs and which can be adapted to different contexts and updated as teaching and learning situations evolve. A theorydriven evaluation perspective on mixed methods research huey t. The evaluation module has been organized by the specific health topics listed above, and for each one, potential measures for the following four main outcome categories of interest to employers and employees have been developed. What is evaluation back to determining the evaluation question. Theorybased evaluation and types of complexity ulg. Theory based stakeholder evaluation tse, instead of fusing the theories of different stakeholders into a single unified theory, keeps the program theories of diverse stakeholder groups separate from each other and from the program theory embedded in the institutionalized intervention itself.
Evaluation theory for strategic communication is grounded in and derived from theory of change and program theory, which were developed in the 1970s and 1980s in the field of public administration. Consider, for example, an industrial assistance program where the government gives grants on a. Some of this, of course, can be attributed to the relative newness of the profession. Definition a theory of change is a structured approach used in the design and evaluation of social programs to explore change and how it happens. Save up to 80% by choosing the etextbook option for isbn. Third, evaluation theory is who we are in the sense that theory has defined the themes of the majority of aea conferences. Integrating theory and practice was solving two thirds of my evaluation doubts.
Download limit exceeded you have exceeded your daily download allowance. A theory based evaluation of a program is one in which the selection of program features to evaluate is determined by an explicit conceptualization of the program in terms of a theory, a theory which attempts to explain how the program produces the desired effects. Evaluation of four different learning theories and models. It maps the logical chain of how program inputs achieve changes in outcomes. This handbook provides a framework for thinking about evaluation as a relevant and useful program tool. Although it is practiceoriented, there has been a proliferation of research on evaluation theory to prescribe underlying frameworks of evidencebased practice. Program evaluation models and related theories 3 in this guide, we first briefly define program evaluation, discuss reasons for conducting educational program evaluation, and outline some theoretical bases for evaluation models.
In 1972, carol weiss described the value of having any program evaluation rooted in good theory 1972. If it does, the task of the evaluator is to produce a plausible case, with evidence, that shows what has. Well go into logic models in an upcoming evaluation tip sheet. New directions for evaluation wiley online library.
These differ from a traditional educational approach because the technology introduces a whole raft of extra variables that do not exist in a conventional lectureroomclassroom situation. Program evaluation models and related theories amee guide. Apr 15, 2008 a comprehensive description of a programme using the six essential elements of sidani and bradens model of programme theory 7 clarifies what the programme is about and allows for development of pertinent questions that can be addressed within the programme development and evaluation cycle. Now in its second edition, evaluation theory, models, and applications is the vital text on evaluation models, perfect for classroom use as a textbook, and as a professional evaluation reference. Evaluation is the systematic process of delineating, obtaining, reporting, and applying descriptive and. The book features examples of small and largescale evaluations from a range of fields, many with reflective.
A wealth of approaches and an untapped potential marielle riche european commissioni have w e got closer t o ident if yi ng the ge nerati ve mechani sms that produce an outcom e f or th e lagging regi ons of t he. Click download or read online button to get program evaluation theory and practice book now. A comprehensive guide this engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from. The postpositivist paradigm and the methods branch. The basic idea is to use the program s rationale or theory as the basis of an evaluation to understand the program s development and impact smith, 1994, p. An account is offered of the evolution of this persuasion, through the works of chen. Kirkpatricks model of learning evaluation has been used for more than 50 years. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for conducting large and smallscale evaluations.
Intrinsic motivation is the innate, natural propensity to engage ones interests and exercise ones capacities, and in so doing, to seek and conquer optimal challenges. It is now commonplace to use research, program theory, and logic models in evaluation practice. My area of concentration is in program evaluation with a focus on science technology engineering and math stem fields. This resource guide discusses program theory and logic models. Q if participants receive these services, then they experience specific changes in their knowledge, attitudes, or skills. Theory based approaches to evaluation use an explicit theory of change to draw conclusions about whether and how an intervention contributed to observed results. One way to do this is for the evaluator and program people to develop a very good description of. Its purpose is to make judgments about a program, to improve its effectiveness, andor to inform programming decisions patton, 1987. An introduction to program theory social solutions. Evaluation theory and practice american university online. The program theory is vital in the theorybased evaluation. Two halves of the same body by adeyemo adetogun read more. Theorybased programme development and evaluation in.
First, there are issues related to the theory and structure of the program, the program s rationale and possible alternatives. Multiple terms have been integrated into discussions of program theory development and evaluation including. Program evaluation theory and practice download ebook. This guide describes experimental and quasiexperimental models, kirkpatricks fourlevel model, the logic model, and the. How do such theories of change assist cci stakeholders.
Identifying the elements of a program theory is an important step. Special issue designing and using program evaluation as a tool for reform margaret e. Program theory evaluation, which has grown in use over the past 10 years, assesses whether a program is designed in such a way that it can achieve its intended outcomes. Theories that inform educational program evaluation models 4. Stakes 1974 analysis of nine program evaluation approaches provided a useful application of advance organizers the types of variables used to determine information requirements for ascertaining different types of program evaluations. Program theory and the evaluation of a program s theory have gained interest in the evaluation field. Program evaluation theory and practice, first edition. Wilson was program director of the international development program. Deci and ryan 1985 as a subtheory within sdt that had the aim of specifying factors that explain. Special issue designing and using program evaluation as a. Theorybased approaches are a logic of enquiry, which complement and can be used in combination with most of the evaluation designs and data collection techniques outlined in.
633 720 54 29 449 26 425 467 653 70 1506 627 139 1311 989 1038 133 507 1004 1403 199 379 813 1423 973 933 72 963 962 374 1491 1392 1040 729