The Oxford Handbook of P O L L I N G A N D S U RV E Y M E T H O D S The Oxford Handbook of POLLING AND SURVEY METHODS Edited by LONNA RAE ATKESON and R. MICHAEL ALVAREZ 1 3 Oxford University Press is a department of the University of Oxford. It furthers the University’s objective of excellence in research, scholarship, and education by publishing worldwide. Oxford is a registered trade mark of Oxford University Press in the UK and certain other countries. Published in the United States of America by Oxford University Press 198 Madison Avenue, New York, NY 10016, United States of America. © Oxford University Press 2018 All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, without the prior permission in writing of Oxford University Press, or as expressly permitted by law, by license, or under terms agreed with the appropriate reproduction rights organization. Inquiries concerning reproduction outside the scope of the above should be sent to the Rights Department, Oxford University Press, at the address above. You must not circulate this work in any other form and you must impose this same condition on any acquirer. Library of Congress Cataloging-in-Publication Data Names: Atkeson, Lonna Rae, 1965– editor. | Alvarez, R. Michael, 1964– editor. Title: The Oxford handbook of polling and survey methods / edited by Lonna Rae Atkeson and R. Michael Alvarez. Description: New York : Oxford University Press, [2018] Identifiers: LCCN 2018008316 | ISBN 9780190213299 (Hard Cover) | ISBN 9780190213305 (updf) | ISBN 9780190903824 (epub) Subjects: LCSH: Public opinion polls. | Social surveys. Classification: LCC HM1236 .O945 2018 | DDC 303.3/8—dc23 LC record available at https://lccn.loc.gov/2018008316 1 3 5 7 9 8 6 4 2 Printed by Sheridan Books, Inc., United States of America Contents Contributors ix Introduction to Polling and Survey Methods 1 Lonna Rae Atkeson and R. Michael Alvarez PART I SURVEY DESIGN 1. Total Survey Error 13 Herbert F. Weisberg 2. Longitudinal Surveys: Issues and Opportunities 28 D. Sunshine Hillygus and Steven A. Snell 3. Mixing Survey Modes and Its Implications 53 Lonna Rae Atkeson and Alex N. Adams 4. Taking the Study of Political Behavior Online 76 Stephen Ansolabehere and Brian F. Schaffner 5. Sampling for Studying Context: Traditional Surveys and New Directions 97 James G. Gimpel 6. Questionnaire Science 113 Daniel L. Oberski PART II DATA COLLECTION 7. Exit Polling Today and What the Future May Hold 141 Anthony M. Salvanto 8. Sampling Hard- to- Locate Populations: Lessons from Sampling Internally Displaced Persons (IDPs) 155 Prakash Adhikari and Lisa A. Bryant vi Contents 9. Reaching Beyond Low-H anging Fruit: Surveying Low-I ncidence Populations 181 Justin A. Berry, Youssef Chouhoud, and Jane Junn 10. Improving the Quality of Survey Data Using CAPI Systems in Developing Countries 207 Mitchell A. Seligson and Daniel E. Moreno Morales 11. Survey Research in the Arab World 220 Lindsay J. Benstead 12. The Language- Opinion Connection 249 Efrén O. Pérez PART III ANALYSIS AND PRESENTATION 13. Issues in Polling Methodologies: Inference and Uncertainty 275 Jeff Gill and Jonathan Homola 14. Causal Inference with Complex Survey Designs: Generating Population Estimates Using Survey Weights 299 Ines Levin and Betsy Sinclair 15. Aggregating Survey Data to Estimate Subnational Public Opinion 316 Paul Brace 16. Latent Constructs in Public Opinion 338 Christopher Warshaw 17. Measuring Group Consciousness: Actions Speak Louder Than Words 363 Kim Proctor 18. Cross-N ational Surveys and the Comparative Study of Electoral Systems: When Country/E lections Become Cases 388 Jeffrey A. Karp and Jack Vowles 19. Graphical Visualization of Polling Results 410 Susanna Makela, Yajuan Si, and Andrew Gelman 20. Graphical Displays for Public Opinion Research 439 Saundra K. Schneider and William G. Jacoby Contents vii PART IV NEW FRONTIERS 21. Survey Experiments: Managing the Methodological Costs and Benefits 483 Yanna Krupnikov and Blake Findley 22. Using Qualitative Methods in a Quantitative Survey Research Agenda 505 Kinsey Gimbel and Jocelyn Newsome 23. Integration of Contextual Data: Opportunities and Challenges 533 Armando Razo 24. Measuring Public Opinion with Social Media Data 555 Marko Klašnja, Pablo Barberá, Nicholas Beauchamp, Jonathan Nagler, and Joshua A. Tucker 25. Expert Surveys as a Measurement Tool: Challenges and New Frontiers 583 Cherie D. Maestas 26. The Rise of Poll Aggregation and Election Forecasting 609 Natalie Jackson Index 633 Contributors Alex N. Adams is a PhD student in the Department of Political Science at the University of New Mexico. His research interests focus on political psychology and survey methodology. Prakash Adhikari is an Associate Professor of Political Science at Central Michigan University. His research and teaching interests lie at the intersection of comparative pol- itics and international relations, with specific focus on civil war, forced migration, and transitional justice. R. Michael Alvarez is a Professor in the Division of Humanities and Social Sciences at the California Institute of Technology. His primary research interests are public opinion and voting behavior, election technology and administration, electoral politics, and sta- tistical and computer modeling. Stephen Ansolabehere is the Frank G. Thompson Professor of Government at Harvard University where he studies elections, democracy, and the mass media. He is a Principal Investigator of the Cooperative Congressional Election Study, and his principal areas are electoral politics, representation, and public opinion. Lonna Rae Atkeson is a Professor and Regents Lecturer in the Department of Political Science at the University of New Mexico where she directs the Institute for Social Research and the Center for the Study of Voting, Elections and Democracy. Her primary interests are the areas of survey methodology, election science and administration, and political behavior. Pablo Barberá is an Assistant Professor of Computational Social Science in the Methodology Department at the London School of Economics. His primary areas of re- search include social media and politics, computational social science, and comparative electoral behavior and political representation. Nicholas Beauchamp is an Assistant Professor of Political Science at Northeastern University. He specializes in U.S. politics (political behavior, campaigns, opinion, polit- ical psychology, and social media) and political methodology (quantitative text analysis, machine learning, Bayesian methods, agent- based models, and networks). Lindsay J. Benstead is an Associate Professor of Political Science in the Mark O. Hatfield School of Government and Interim Director of the Middle East Studies Center (MESC) at Portland State University, Contributing Scholar in the Women’s Rights in the Middle