War Stories from the Drug Survey TheprimarydatadriverbehindUSdrugpolicyistheNationalSurvey onDrugUseandHealth.Thisinsiderhistorytracestheevolutionofthe survey and how the survey has interacted with the political and social climate of the country, from its origins during the Vietnam War to its role in the war on drugs. The book includes firsthand accounts that explain how the data were used and misused by political leaders, why changesweremadeinthesurveydesign,andwhatchallengesresearch- ers faced in communicating statistical principles to policymakers and leaders. It also makes recommendations for managing survey data collection and reporting in the context of political pressures and tech- nologicaladvances. Surveyresearchstudentsandpractitionerswilllearnpracticallessons about questionnaire design, mode effects, sampling, nonresponse, weighting,editing,imputation,statisticalsignificance,andconfidential- ity.Thebookalsoincludescommon-languageexplanationsofkeyterms andprocessestohelpdatausersunderstandthepointofviewofsurvey statisticians. joseph gfroerer wasresponsibleforanalysisandsupervisionofthe NationalSurveyonDrugUseandHealthformorethanthreedecades asastatisticianattheNationalInstituteonDrugAbuse(NIDA)andthe Substance Abuse and Mental Health Services Administration (SAMHSA).Awidelyrecognizedexpertinmethodsforsubstanceuse surveys,heauthoreddozensofpeer-reviewedjournalarticlesandbook chapters and hundreds of government reports on survey methodology andsubstanceuseepidemiology.AmemberoftheAmericanStatistical Association for more than thirty-five years, he has received numerous awards from NIDA, SAMHSA, the White House, and the American PublicHealthAssociationforhisworkonthesurvey. War Stories from the Drug Survey How Culture, Politics, and Statistics Shaped the National Survey on Drug Use and Health Joseph Gfroerer USDepartmentofHealthandHumanServices(retired) UniversityPrintingHouse,CambridgeCB28BS,UnitedKingdom OneLibertyPlaza,20thFloor,NewYork,NY10006,USA 477WilliamstownRoad,PortMelbourne,VIC3207,Australia 314–321,3rdFloor,Plot3,SplendorForum,JasolaDistrictCentre, NewDelhi–110025,India 79AnsonRoad,#06–04/06,Singapore079906 CambridgeUniversityPressispartoftheUniversityofCambridge. ItfurtherstheUniversity’smissionbydisseminatingknowledgeinthepursuitof education,learning,andresearchatthehighestinternationallevelsofexcellence. www.cambridge.org Informationonthistitle:www.cambridge.org/9781107122703 DOI:10.1017/9781316388563 JosephGfroerer©2019 Thispublicationisincopyright.Subjecttostatutoryexception andtotheprovisionsofrelevantcollectivelicensingagreements, noreproductionofanypartmaytakeplacewithoutthewritten permissionofCambridgeUniversityPress. Firstpublished2019 PrintedandboundinGreatBritainbyClaysLtd,ElcografS.p.A. AcataloguerecordforthispublicationisavailablefromtheBritishLibrary. LibraryofCongressCataloging-in-PublicationData Names:Gfroerer,JosephC.,1954-author. Title:Warstoriesfromthedrugsurvey:howculture,politics,andstatistics shapedthenationalsurveyondruguseandhealth/JosephGfroerer. Description:1Edition.|NewYork:CambridgeUniversityPress,2018. Identifiers:LCCN2018026583|ISBN9781107122703(hardback)| ISBN9781107553453(paperback) Subjects:LCSH:NationalSurveyonDrugUseandHealth(U.S.)| Healthsurveys–UnitedStates.|Drugcontrol–UnitedStates.| BISAC:SOCIALSCIENCE/Statistics. Classification:LCCHV5825.G482018|DDC362.290973–dc23 LCrecordavailableathttps://lccn.loc.gov/2018026583 ISBN978-1-107-12270-3Hardback CambridgeUniversityPresshasnoresponsibilityforthepersistenceoraccuracy ofURLsforexternalorthird-partyinternetwebsitesreferredtointhispublication anddoesnotguaranteethatanycontentonsuchwebsitesis,orwillremain, accurateorappropriate. For Sue and Rachel Contents Listof Figures page xi Listof Tables xii Preface xiii Acknowledgments xv Listof Acronyms xvii Introduction 1 OtherHistoriesofGovernmentSurveys 6 WhoShouldReadthisBook 6 1 President NixonLaunches the War on Drugs 8 DrugUsePriortothe1960s 9 LinksbetweentheVietnamWarandtheWaronDrugs 10 TheDrugWarBegins 13 DesignoftheFirstNationalDrugSurvey 15 FirstCommissionReport 19 SecondNationalSurvey 21 2 TheSurvey Continues,As Illicit Drug Use Peaks 26 1974Survey:PublicExperiencewithPsychoactiveSubstances 27 1976Survey:NonmedicalUseofPsychoactiveSubstances 32 1977and1979NationalSurveysonDrugAbuse(NSDA) 34 EstimatingthePrevalenceofHeroinUse 36 TheDrugWar’sImpactonDrugAbuse 38 Wrap-Up for Chapters 1 and 2 45 3 Cocaine and New Directions for theSurvey 49 PresidentReagan’sDrugWar 49 1982NationalSurveyonDrugAbuse 51 ConsolidationofNationalDrugAbuseDataSystems 54 1985NationalHouseholdSurveyonDrugAbuse(NHSDA) 55 1988NationalHouseholdSurveyonDrugAbuse 61 Cocaine,Crack,andtheDrugCzar 65 Releaseofthe1988NHSDAResults 67 vii viii Contents 4 The White HouseNeeds Data and aBiggerSurvey 71 ANationalDrugIndex 72 HHSRespondstotheNewRequirements 73 ONDCPGetsInvolved 75 TheFirstNationalDrugControlStrategy 77 ONDCPTellsNIDAtoIncreasetheSampleSize 79 NIDARespondstoONDCP’sDemands 81 AddressingSurveyMethodologyConcerns 84 ONDCPPushesforState-LevelEstimates 86 5 Criticism, Correction, and Communication 91 OtherStudiesChallengeNHSDAEstimates 91 FinalDesignforthe1990Survey 94 Releaseof1990ResultsbyPresidentBush 94 The1991NHSDA 97 CompetingDrugControlStrategies 99 ControversyoverRevisionofaKeyCocaineIndicator 100 Pre-ElectionDataCorrection 102 NHSDAMethodologicalResearch 106 NIDAandItsGranteesContinuetoOpposetheLargeSample 110 Wrap-Upfor Chapters3, 4,and 5 113 6 The Survey Moves to SAMHSA 116 TheCreationofSAMHSAandtheOfficeofAppliedStudies 116 BuildingOAS 118 NewLeadersandShiftingPoliciesintheDrugWar 120 1992NHSDA:BuildingaConsistentTimetableandStatisticalIntegrity 121 7 Rising YouthDrug Usein the 1990s 126 1993NHSDA 126 1994NHSDA:TrackingTrendsduringaSurveyRedesign 128 AttacksonClinton’sDrugPolicy 130 AdministrationResponsestotheIncreasesinYouthDrugUse 132 1995NHSDA:CreatingaBridgetothePast 132 Pre-ReleaseControlsandaLeakofthe1995SurveyFindings 134 StatesLegalizeMedicalUseofMarijuana 138 1996NHSDA 139 1997NHSDA:ExpandedSamplesinCaliforniaandArizona 140 1998NHSDA 141 8 Better Sample, Better Analysis, but Not Always 144 StateandMetropolitanAreaEstimates 144 MiamiSuccess,ThankstoAndrew 145 NewDataforHIV-AIDSResearch 147 HowManyPeopleNeedTreatmentforaSubstance AbuseProblem 149 ToPredicttheFuture,YouMustUnderstandthePast 151 Wrap-Upfor Chapters6, 7,and 8 155