Evaluation Time: A Practical Guide for Evaluation

609 Pages·2022·8.745 MB·English

by  Gail V. Barrington, Beverly F. Triana-Tremain

PRAISE FOR THIS BOOK
Thisisanexcellentandaccessibleresourceforbothstudentsandpractitionersofprogram
evaluation. The chapter on ‘Using Mixed Methods in Evaluation’ alone is worth the
investment in this book.
—Debra Bartelli, University of Memphis
This text fills a much needed gap by providing an accessible resource for students taking
program evaluation for the first time.
—Shane R. Brady, University of Oklahoma
Thecomprehensivenessofthetextisitsgreateststrength.Ithitsalltherightkeys.Ithasan
easy readability and an excellent mix of text, graphics, teaching tools.
—Nancy G. Calleja, University of Detroit Mercy
With a focus on the practical aspects of evaluation, this textbook also integrates very
relevant, and frequently overlooked, theoretical and conceptual frameworks that are
extremely valuable for evaluators.
—Sebastian Galindo, University of Florida
This book provides students with real-life relatable examples of program evaluation. It’s
an interesting read, and a must-use in the classroom!
—Heather Lenz, Case Western Reserve University
A very interesting and practical introduction to program evaluation. The authors have
provided sound arguments for conducting evaluations and a strong introduction to
essential considerations in carrying through evaluations for the betterment of the
agency, stakeholders, and society as a whole.
—Ted L. Miller, University of Tennessee at Chattanooga
This is a thorough guide to conducting evaluation that addresses both concepts and
practice.Itprovidesacomprehensiveviewofallthatevaluationentailsanddeliversthat
content in a way that is very consumable to readers… well worth keeping beyond the
class.
—Richard S. Mohn, University of Southern Mississippi
Thisisanexcellentguideforanyoneinterestedinconductingorlearningaboutprogram
evaluation. It looks at evaluation through new lens, recognizing the importance of
diversity, the connection of local issues with global issues, and presents the material in
a clear, easy-to-follow, and digestible manner.
—Sandra Schrouder, Barry University, Miami, FL
Gail Vallance Barrington and Beverly Triana-Tremain have written the quintessential
book on evaluation for students new to the science and those who need an updating.
—Randy Schultz, California State University, Bakersfield
This text offers a comprehensive yet practical introduction to program evaluation. The
authors integrate new approaches, classic frameworks, and practical tools that students
can use to design evaluation studies.
—Denna Wheeler, Oklahoma State University
Evaluation Time
A Practical Guide for Evaluation
Gail Vallance Barrington
Barrington Research Group, Inc.
Beverly Triana-Tremain
FORINFORMATION: Copyright©2023bySAGEPublications,Inc.
SAGEPublications,Inc.
Allrightsreserved.ExceptaspermittedbyU.S.copyrightlaw,nopartof
2455TellerRoad
thisworkmaybereproducedordistributedinanyformorbyany
ThousandOaks,California91320 means,orstoredinadatabaseorretrievalsystem,withoutpermission
E-mail:[e-mail] inwritingfromthepublisher.
Allthird-partytrademarksreferencedordepictedhereinareincluded
SAGEPublicationsLtd.
solelyforthepurposeofillustrationandarethepropertyoftheir
1Oliver’sYard respectiveowners.Referencetothesetrademarksinnowayindicates
55CityRoad anyrelationshipwith,orendorsementby,thetrademarkowner.
London,EC1Y1SP PrintedintheUnitedStatesofAmerica
UnitedKingdom
LibraryofCongressCataloging-in-PublicationData
SAGEPublicationsIndiaPvt.Ltd. Names:Barrington,GailVallance,1945-author.|Triana-Tremain,
B1/I1MohanCooperativeIndustrialArea Beverly,author.
MathuraRoad,NewDelhi110044 Title:Evaluationtime:apracticalguideforevaluation/GailVallance
India Barrington,BeverlyTriana-Tremain.
Identifiers:LCCN2022013364|ISBN9781544339504(paperback)|
SAGEPublicationsAsia-PacificPte.Ltd.
ISBN9781544339511(adobepdf)|ISBN9781544339481(epub)|
18CrossStreet#10-10/11/12 ISBN9781544339498(epub)
ChinaSquareCentral
Subjects:LCSH:Evaluation.
Singapore048423
Classification:LCCH62.B3392022|DDC001.4/2–dc23/eng/
20220528
LCrecordavailableathttps://lccn.loc.gov/2022013364
Thisbookisprintedonacid-freepaper.
AcquisitionsEditor:HelenSalmon
ProductAssociate:AudraBacon
ProductionEditor:Vijayakumar
CopyEditor:ChristobelColleenHopman
Typesetter:TNQTechnologies
Proofreader:BennyWillyStephen
Indexer:TNQTechnologies
CoverDesigner:GailBuschman
MarketingManager:VictoriaVelasquez 222324252610987654321
Thankyou,BruceandWil,foryourboundlesslove,humor,andsupport.Thanksalsotomymanystudentsacross
the years for teaching me how to teach. ; Gail
Idedicatethis bookto myfourboys! Jack,myhusband,andmythreesons,Hunter,Hayden, andHolden.How
luckyIamtotakemylife’sjourneywithyou.Tomymother,Iappreciateyoursteadfastsupportandyour“digin
there and do it” attitude since the beginning. ; Bev

BRIEF CONTENTS
Preface xxi
Acknowledgments xxv
About the Authors xxvii
PART I • FUNDAMENTALS OF EVALUATION 1
Chapter 1 • The Scope of Evaluation 3
Chapter 2 • How Evaluators Think 35
Chapter 3 • Program Logic 79
PART II • EVALUATION AND THE PROGRAM LIFE CYCLE 115
Chapter 4 • Pre- and Early Program Evaluation 117
Chapter 5 • Mid-Cycle Program Evaluation 155
Chapter 6 • End-of-Cycle Program Evaluation 203
PART III • EVALUATION METHODS 243
Chapter 7 • Using Quantitative Methods in Evaluation 245
Chapter 8 • Using Qualitative Methods in Evaluation 285
Chapter 9 • Using Mixed Methods in Evaluation 331
PART IV • COMMUNICATING ABOUT EVALUATION 373
Chapter 10 • The Evaluation Plan 375
Chapter 11 • Communication, Reporting, and Use 421
Chapter 12 • Evaluation Context and the Evaluator’s New Stance 467
Glossary 523
References 531
Index 561

DETAILED CONTENTS
Preface xxi
Acknowledgments xxv
About the Authors xxvii
PART I • FUNDAMENTALS OF EVALUATION 1
Chapter 1 • The Scope of Evaluation 3
LearningObjectives 3
Introduction 5
WhatIs Evaluation? 6
WhyDo Evaluation? 9
ToDetermineMerit,Worth,andSignificance 10
ToGainanUnderstandingofHowProgramsWorkandtheDifference
TheyCanMaketoStakeholders 11
ToImproveQualityofLife 12
ToPursueSocialJusticeandaMoreEquitableWorld 12
ResearchandEvaluation 14
EvaluationandResearchAreMutuallyExclusive 14
EvaluationRequiresResearchbutResearchDoesNotRequireEvaluation 15
EvaluationandResearchShareSimilarities 16
Spotlighton Equity:TheGraduate EducationDiversity (GEDI)Program:
APipelineof EmergingEvaluators ofColor andThose Underrepresented
andUnderservedin theField of Evaluation 17
ABriefHistory ofEvaluation 18
TheThreePillars ofEvaluation 21
TheGuidingPrinciples 21
TheProgramEvaluationStandards 24
TheProfessionalCompetencies 27
EducationandTraining 28
Professionalization 29
ExpertCorner: Dr.Jean King 31
KeyTerms 32
TheMainIdeas 32
Critical ThinkingQuestions 32
StudentChallenges 33
AdditionalReadings andResources 33