Interviewer Effects from a Total Survey Error Perspective

361 Pages·36.776 MB·English

by  Kristen Olson

Interviewer Effects from a
Total Survey Error Perspective
Statistics in the Social and Behavioral Sciences Series
Multilevel Modelling Using Mplus
Holmes Finch and Jocelyn Bolin
Applied Survey Data Analysis, Second Edition
Steven G. Heeringa, Brady T. West, and Patricia A. Berglund
Adaptive Survey Design
Barry Schouten, Andy Peytchev, and James Wagner
Handbook of Item Response Theory, Volume One: Models
Wim J. van der Linden
Handbook of Item Response Theory, Volume Two: Statistical Tools
Wim J. van der Linden
Handbook of Item Response Theory, Volume Three: Applications
Wim J. van der Linden
Bayesian Demographic Estimation and Forecasting
John Bryant and Junni L. Zhang
Multivariate Analysis in the Behavioral Sciences, Second Edition
Kimmo Vehkalahti and Brian S. Everitt
Analysis of Integrated Data
Li-Chun Zhang and Raymond L. Chambers, Editors
Multilevel Modeling Using R, Second Edition
W. Holmes Finch, Joselyn E. Bolin, and Ken Kelley
Modelling Spatial and Spatial-Temporal Data: A Bayesian Approach
Robert Haining and Guangquan Li
Measurement Models for Psychological Attributes
Klaas Sijtsma and Andries van der Ark
Handbook of Automated Scoring: Theory into Practice
Duanli Yan, André A. Rupp, and Peter W. Foltz
Interviewer Effects from a Total Survey Error Perspective
Kristen Olson, Jolene D. Smyth, Jennifer Dykema, Allyson L. Holbrook, Frauke Kreuter, Brady T. West
For more information about this series, please visit: https://www.crcpress.com/go/ssbs
Interviewer Effects from a
Total Survey Error Perspective
Edited by
Kristen Olson, Jolene D. Smyth,
Jennifer Dykema, Allyson L. Holbrook,
Frauke Kreuter, and Brady T. West
6000 Broken Sound Parkway NW,
Suite 300, Boca Raton, FL 33487
© 2020 by Taylor & Francis Group, LLC
CRC Press is an imprint of Taylor & Francis Group, an Informa business
No claim to original U.S. Government works
International Standard Book Number-13: 978-0-367-89631-7(Hardback)
This book contains information obtained from authentic and highly regarded sources. Reasonable efforts have been
made to publish reliable data and information, but the author and publisher cannot assume responsibility for the
validity of all materials or the consequences of their use. The authors and publishers have attempted to trace the copy-
right holders of all material reproduced in this publication and apologize to copyright holders if permission to publish
in this form has not been obtained. If any copyright material has not been acknowledged please write and let us know
so we may rectify in any future reprint.
Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, transmitted, or
utilized in any form by any electronic, mechanical, or other means, now known or hereafter invented, including pho-
tocopying, microflming, and recording, or in any information storage or retrieval system, without written permission
from the publishers.
For permission to photocopy or use material electronically from this work, please access www.copyright.com (http://
www.copyright.com/) or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood Drive, Danvers, MA
01923, 978-750-8400. CCC is a not-for-proft organization that provides licenses and registration for a variety of users.
For organizations that have been granted a photocopy license by the CCC, a separate system of payment has been
arranged.
Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are used only for
identifcation and explanation without intent to infringe.
Visit the Taylor & Francis Web site at
http://www.taylorandfrancis.com
and the CRC Press Web site at
http://www.crcpress.com
To those who taught us about, and inspired our work on, interviewers, including
Charlie Cannell
Don Dillman
Jack Fowler
Bob Groves
Paul Lavrakas
Jim Lepkowski
Jon Krosnick
Lois Oksenberg
Nora Cate Schaeffer
Rainer Schnell

Contents
Preface ..............................................................................................................................................xi
Contributors ................................................................................................................................. xiii
About the Editors ....................................................................................................................... xvii
Section I History and Overview
1 The Past, Present, and Future of Research on Interviewer Effects ..............................3
Kristen Olson, Jolene D. Smyth, Jennifer Dykema,
Allyson L. Holbrook, Frauke Kreuter, and Brady T. West
2 The Legacy of Charles Cannell .......................................................................................... 17
Peter V. Miller and Nancy A. Mathiowetz
Section II Training Interviewers
3 General Interviewing Techniques: Developing Evidence-based Practices for
Standardized Interviewing ................................................................................................33
Nora Cate Schaeffer, Jennifer Dykema, Steve M. Coombs, Rob K. Schultz, Lisa Holland
and Margaret L. Hudson
4 How to Conduct Effective Interviewer Training: A Meta-Analysis and
Systematic Review ................................................................................................................ 47
Jessica Daikeler and Michael Bosnjak
Section III M anaging and Monitoring
Interviewers and the Survey Process
5 Exploring the Mind of the Interviewer: Findings from Research with
Interviewers to Improve the Survey Process ..................................................................63
Robin Kaplan and Erica Yu
6 Behavior Change Techniques for Reducing Interviewer Contributions to
Total Survey Error ................................................................................................................77
Brad Edwards, Hanyu Sun, and Ryan Hubbard
7 Statistical Identifcation of Fraudulent Interviews in Surveys: Improving
Interviewer Controls ............................................................................................................ 91
Silvia Schwanhäuser, Joseph W. Sakshaug, Yuliya Kosyakova, and Frauke Kreuter
vii
viii Contents
8 Examining the Utility of Interviewer Observations on the Survey Response
Process ................................................................................................................................... 107
Brady T. West, Ting Yan, Frauke Kreuter, Michael Josten, and Heather Schroeder
Section IV Interviewer Effects and Interview Context and Mode
9 Why Do Interviewers Vary in Achieving Interview Privacy and Does Privacy
Matter? .................................................................................................................................. 123
Zeina N. Mneimneh, Julie A. de Jong, and Yasmin A. Altwaijri
10 Unintended Interviewer Bias in a Community-Based Participatory Research
Randomized Control Trial among American Indian Youth ...................................... 137
Patrick Habecker and Jerreed Ivanich
11 Virtual Interviewers, Social Identities, and Survey Measurement Error ............... 149
Frederick G. Conrad, Michael F. Schober, Daniel Nielsen, and Heidi Reichert
12 Differences in Interaction Quantity and Conversational Flow in CAPI and
CATI Interviews ................................................................................................................. 165
Yfke Ongena and Marieke Haan
13 Interacting with Interviewers in Text and Voice Interviews on Smartphones ..... 179
Michael F. Schober, Frederick G. Conrad, Christopher Antoun, Alison W. Bowers,
Andrew L. Hupp, and H. Yanna Yan
Section V Interviewers and Nonresponse
14 Explaining Interviewer Effects on Survey Unit Nonresponse: A Cross-
Survey Analysis .................................................................................................................. 193
Daniela Ackermann-Piek, Julie M. Korbmacher, and Ulrich Krieger
15 Comparing Two Methods for Managing Telephone Interview Cases .................... 207
Jamie Wescott
16 Investigating the Use of Nurse Paradata in Understanding Nonresponse to
Biological Data Collection ................................................................................................ 221
Fiona Pashazadeh, Alexandru Cernat, and Joseph W. Sakshaug
Section VI Interview Pace and Behaviors
17 Exploring the Antecedents and Consequences of Interviewer Reading Speed
(IRS) at the Question Level. .............................................................................................. 237
Allyson L. Holbrook, Timothy P. Johnson, Evgenia Kapousouz, and Young Ik Cho
Contents ix
18 Response Times as an Indicator of Data Quality: Associations with
Question, Interviewer, and Respondent Characteristics in a Health
Survey of Diverse Respondents ......................................................................................253
Dana Garbarski, Jennifer Dykema, Nora Cate Schaeffer, and Dorothy Farrar Edwards
19 Accuracy and Utility of Using Paradata to Detect Question-Reading
Deviations ............................................................................................................................ 267
Jennifer Kelley
20 What Do Interviewers Learn?: Changes in Interview Length and Interviewer
Behaviors over the Field Period ....................................................................................... 279
Kristen Olson and Jolene D. Smyth
Section VII Estimating Interviewer Effects
21 Modeling Interviewer Effects in the National Health Interview Survey ............... 295
James Dahlhamer, Benjamin Zablotsky, Carla Zelaya, and Aaron Maitland
22 A Comparison of Different Approaches to Examining Whether Interviewer
Effects Tend to Vary Across Different Subgroups of Respondents ........................ 311
Geert Loosveldt and Celine Wuyts
23 Designing Studies for Comparing Interviewer Variance in Two Groups of
Survey Interviewers ........................................................................................................... 323
Brady T. West
Index .............................................................................................................................................335