PRAISE FOR THIS BOOK Thisisanexcellentandaccessibleresourceforbothstudentsandpractitionersofprogram evaluation. The chapter on ‘Using Mixed Methods in Evaluation’ alone is worth the investment in this book. —Debra Bartelli, University of Memphis This text fills a much needed gap by providing an accessible resource for students taking program evaluation for the first time. —Shane R. Brady, University of Oklahoma Thecomprehensivenessofthetextisitsgreateststrength.Ithitsalltherightkeys.Ithasan easy readability and an excellent mix of text, graphics, teaching tools. —Nancy G. Calleja, University of Detroit Mercy With a focus on the practical aspects of evaluation, this textbook also integrates very relevant, and frequently overlooked, theoretical and conceptual frameworks that are extremely valuable for evaluators. —Sebastian Galindo, University of Florida This book provides students with real-life relatable examples of program evaluation. It’s an interesting read, and a must-use in the classroom! —Heather Lenz, Case Western Reserve University A very interesting and practical introduction to program evaluation. The authors have provided sound arguments for conducting evaluations and a strong introduction to essential considerations in carrying through evaluations for the betterment of the agency, stakeholders, and society as a whole. —Ted L. Miller, University of Tennessee at Chattanooga This is a thorough guide to conducting evaluation that addresses both concepts and practice.Itprovidesacomprehensiveviewofallthatevaluationentailsanddeliversthat content in a way that is very consumable to readers… well worth keeping beyond the class. —Richard S. Mohn, University of Southern Mississippi Thisisanexcellentguideforanyoneinterestedinconductingorlearningaboutprogram evaluation. It looks at evaluation through new lens, recognizing the importance of diversity, the connection of local issues with global issues, and presents the material in a clear, easy-to-follow, and digestible manner. —Sandra Schrouder, Barry University, Miami, FL Gail Vallance Barrington and Beverly Triana-Tremain have written the quintessential book on evaluation for students new to the science and those who need an updating. —Randy Schultz, California State University, Bakersfield This text offers a comprehensive yet practical introduction to program evaluation. The authors integrate new approaches, classic frameworks, and practical tools that students can use to design evaluation studies. —Denna Wheeler, Oklahoma State University Evaluation Time A Practical Guide for Evaluation Gail Vallance Barrington Barrington Research Group, Inc. Beverly Triana-Tremain FORINFORMATION: Copyright©2023bySAGEPublications,Inc. SAGEPublications,Inc. Allrightsreserved.ExceptaspermittedbyU.S.copyrightlaw,nopartof 2455TellerRoad thisworkmaybereproducedordistributedinanyformorbyany ThousandOaks,California91320 means,orstoredinadatabaseorretrievalsystem,withoutpermission E-mail:[email protected] inwritingfromthepublisher. Allthird-partytrademarksreferencedordepictedhereinareincluded SAGEPublicationsLtd. solelyforthepurposeofillustrationandarethepropertyoftheir 1Oliver’sYard respectiveowners.Referencetothesetrademarksinnowayindicates 55CityRoad anyrelationshipwith,orendorsementby,thetrademarkowner. London,EC1Y1SP PrintedintheUnitedStatesofAmerica UnitedKingdom LibraryofCongressCataloging-in-PublicationData SAGEPublicationsIndiaPvt.Ltd. Names:Barrington,GailVallance,1945-author.|Triana-Tremain, B1/I1MohanCooperativeIndustrialArea Beverly,author. MathuraRoad,NewDelhi110044 Title:Evaluationtime:apracticalguideforevaluation/GailVallance India Barrington,BeverlyTriana-Tremain. Identifiers:LCCN2022013364|ISBN9781544339504(paperback)| SAGEPublicationsAsia-PacificPte.Ltd. ISBN9781544339511(adobepdf)|ISBN9781544339481(epub)| 18CrossStreet#10-10/11/12 ISBN9781544339498(epub) ChinaSquareCentral Subjects:LCSH:Evaluation. Singapore048423 Classification:LCCH62.B3392022|DDC001.4/2–dc23/eng/ 20220528 LCrecordavailableathttps://lccn.loc.gov/2022013364 Thisbookisprintedonacid-freepaper. AcquisitionsEditor:HelenSalmon ProductAssociate:AudraBacon ProductionEditor:Vijayakumar CopyEditor:ChristobelColleenHopman Typesetter:TNQTechnologies Proofreader:BennyWillyStephen Indexer:TNQTechnologies CoverDesigner:GailBuschman MarketingManager:VictoriaVelasquez 222324252610987654321 Thankyou,BruceandWil,foryourboundlesslove,humor,andsupport.Thanksalsotomymanystudentsacross the years for teaching me how to teach. ; Gail Idedicatethis bookto myfourboys! Jack,myhusband,andmythreesons,Hunter,Hayden, andHolden.How luckyIamtotakemylife’sjourneywithyou.Tomymother,Iappreciateyoursteadfastsupportandyour“digin there and do it” attitude since the beginning. ; Bev BRIEF CONTENTS Preface xxi Acknowledgments xxv About the Authors xxvii PART I • FUNDAMENTALS OF EVALUATION 1 Chapter 1 • The Scope of Evaluation 3 Chapter 2 • How Evaluators Think 35 Chapter 3 • Program Logic 79 PART II • EVALUATION AND THE PROGRAM LIFE CYCLE 115 Chapter 4 • Pre- and Early Program Evaluation 117 Chapter 5 • Mid-Cycle Program Evaluation 155 Chapter 6 • End-of-Cycle Program Evaluation 203 PART III • EVALUATION METHODS 243 Chapter 7 • Using Quantitative Methods in Evaluation 245 Chapter 8 • Using Qualitative Methods in Evaluation 285 Chapter 9 • Using Mixed Methods in Evaluation 331 PART IV • COMMUNICATING ABOUT EVALUATION 373 Chapter 10 • The Evaluation Plan 375 Chapter 11 • Communication, Reporting, and Use 421 Chapter 12 • Evaluation Context and the Evaluator’s New Stance 467 Glossary 523 References 531 Index 561 DETAILED CONTENTS Preface xxi Acknowledgments xxv About the Authors xxvii PART I • FUNDAMENTALS OF EVALUATION 1 Chapter 1 • The Scope of Evaluation 3 LearningObjectives 3 Introduction 5 WhatIs Evaluation? 6 WhyDo Evaluation? 9 ToDetermineMerit,Worth,andSignificance 10 ToGainanUnderstandingofHowProgramsWorkandtheDifference TheyCanMaketoStakeholders 11 ToImproveQualityofLife 12 ToPursueSocialJusticeandaMoreEquitableWorld 12 ResearchandEvaluation 14 EvaluationandResearchAreMutuallyExclusive 14 EvaluationRequiresResearchbutResearchDoesNotRequireEvaluation 15 EvaluationandResearchShareSimilarities 16 Spotlighton Equity:TheGraduate EducationDiversity (GEDI)Program: APipelineof EmergingEvaluators ofColor andThose Underrepresented andUnderservedin theField of Evaluation 17 ABriefHistory ofEvaluation 18 TheThreePillars ofEvaluation 21 TheGuidingPrinciples 21 TheProgramEvaluationStandards 24 TheProfessionalCompetencies 27 EducationandTraining 28 Professionalization 29 ExpertCorner: Dr.Jean King 31 KeyTerms 32 TheMainIdeas 32 Critical ThinkingQuestions 32 StudentChallenges 33 AdditionalReadings andResources 33