BIG DATA IN PSYCHOLOGICAL RESEARCH BIG DATA IN PSYCHOLOGICAL RESEARCH EDITED BY SANG EUN WOO, LOUIS TAY, AND ROBERT W. PROCTOR Copyright © 2020 by the American Psychological Association. All rights reserved. Except as permitted under the United States Copyright Act of 1976, no part of this publication may be reproduced or distributed in any form or by any means, including, but not limited to, the process of scanning and digitization, or stored in a database or retrieval system, without the prior written permission of the publisher. The opinions and statements published are the responsibility of the authors, and such opinions and statements do not necessarily represent the policies of the American Psychological Association. Published by American Psychological Association 750 First Street, NE Washington, DC 20002 https://www.apa.org Order Department https://www.apa.org/pubs/books [email protected] In the U.K., Europe, Africa, and the Middle East, copies may be ordered from Eurospan https://www.eurospanbookstore.com/apa [email protected] Typeset in Meridien and Ortodoxa by Circle Graphics, Inc., Reisterstown, MD Printer: Sheridan Books, Chelsea, MI Cover Designer: Beth Schlenoff, Bethesda, MD Library of Congress Cataloging-in-Publication Data Names: Woo, Sang Eun, editor. | Tay, Louis (Psychologist) editor. | Proctor, Robert W., editor. Title: Big data in psychological research / edited by Sang Eun Woo, Louis Tay, and Robert W. Proctor. Description: Washington : American Psychological Association, 2020. | Includes bibliographical references and index. Identifiers: LCCN 2019054296 (print) | LCCN 2019054297 (ebook) | ISBN 9781433831676 (hardcover) | ISBN 9781433832338 (ebook) Subjects: LCSH: Psychology—Research—Data processing. | Psychology—Research—Methodology. Classification: LCC BF76.6.I57 B54 2020 (print) | LCC BF76.6.I57 (ebook) | DDC 150.72—dc23 LC record available at https://lccn.loc.gov/2019054296 LC ebook record available at https://lccn.loc.gov/2019054297 http://dx.doi.org/10.1037/0000193-000 Printed in the United States of America 10 9 8 7 6 5 4 3 2 1 CONTENTS Contributors vii Introduction 3 Sang Eun Woo, Louis Tay, and Robert W. Proctor I. BACKGROUND AND OVERVIEW 13 1. Big Data Science: A Philosophy of Science Perspective 15 Brian D. Haig 2. From Small-Scale Experiments to Big Data: Challenges and Opportunities for Experimental Psychologists 35 Robert W. Proctor and Aiping Xiong 3. Big Data for Enhancing Measurement Quality 59 Sang Eun Woo, Louis Tay, Andrew T. Jebb, Michael T. Ford, and Margaret L. Kern II. INNOVATIONS IN LARGE-SCALE DATA COLLECTION AND ANALYSIS TECHNIQUES 87 4. Internet Search and Page View Behavior Scores: Validity and Usefulness as Indicators of Psychological States 89 Michael T. Ford 5. Observing Human Behavior Through Worldwide Network Cameras 109 Sara Aghajanzadeh, Andrew T. Jebb, Yifan Li, Yung-Hsiang Lu, and George K. Thiruvathukal 6. Wearable Cameras, Machine Vision, and Big Data Analytics: Insights Into People and the Places They Go 125 Andrew B. Blake, Daniel I. Lee, Roberto De La Rosa, and Ryne A. Sherman v vi Contents 7. Human-Guided Visual Analytics for Big Data 145 Morteza Karimzadeh, Jieqiong Zhao, Guizhen Wang, Luke S. Snyder, and David S. Ebert 8. Text Mining: A Field of Opportunities 179 Padmini Srinivasan III. APPLICATIONS 201 9. Big Data in the Science of Learning 203 Sidney K. D’Mello 10. Big Data in Social Psychology 227 Ivan Hernandez 11. Big Data in Health Care Delivery 255 Mohammad Adibuzzaman and Paul M. Griffin 12. The Continued Importance of Theory: Lessons From Big Data Approaches to Language and Cognition 277 Brendan T. Johns, Randall K. Jamieson, and Michael N. Jones 13. Big Data in Developmental Psychology 297 Kevin J. Grimm, Gabriela Stegmann, Ross Jacobucci, and Sarfaraz Serang 14. Applying Principles of Big Data to the Workplace and Talent Analytics 319 Q. Chelsea Song, Mengqiao Liu, Chen Tang, and Laura F. Long IV. RECOMMENDATIONS FOR RESPONSIBLE AND RIGOROUS USE OF BIG DATA 345 15. The Belmont Report in the Age of Big Data: Ethics at the Intersection of Psychological Science and Data Science 347 Alexandra Paxton 16. Promoting Robust and Reliable Big Data Research in Psychology 373 Joshua A. Strauss and James A. Grand 17. Privacy and Cybersecurity Challenges, Opportunities, and Recommendations: Personnel Selection in an Era of Online Application Systems and Big Data 393 Talya N. Bauer, Donald M. Truxillo, Mark P. Jones, and Grant Brady 18. Privacy Enhancing Techniques for Security 411 Elisa Bertino V. CONCLUDING REMARKS 425 19. Future Research Directions for Big Data in Psychology 427 Frederick L. Oswald Index 443 About the Editors 467 CONTRIBUTORS Mohammad Adibuzzaman, PhD, Regenstrief Center for Healthcare Engineering, Purdue University, West Lafayette, IN Sara Aghajanzadeh, MSc candidate, Purdue University, West Lafayette, IN Talya N. Bauer, PhD, School of Business Administration, Portland State University, Portland, OR Elisa Bertino, PhD, Department of Computer Science, Purdue University, West Lafayette, IN Andrew B. Blake, doctoral candidate, Department of Management, Texas Tech University, Lubbock Grant Brady, PhD, School of Business, Portland State University, Portland, OR Roberto De La Rosa, doctoral candidate, Department of Experimental Psychology, Texas Tech University, Lubbock Sidney K. D’Mello, PhD, Institute of Cognitive Science, Department of Computer Science, University of Colorado, Boulder David S. Ebert, PhD, Electrical and Computer Engineering, Purdue University, West Lafayette, IN Michael T. Ford, PhD, Department of Management, University of Alabama, Tuscaloosa James A. Grand, PhD, Department of Psychology, University of Maryland, College Park Paul M. Griffin, PhD, Regenstrief Center for Healthcare Engineering, Purdue University, West Lafayette, IN Kevin J. Grimm, PhD, Department of Psychology, Arizona State University, Tempe vii viii Contributors Brian D. Haig, PhD, School of Psychology, Speech and Hearing, University of Canterbury, Christchurch, New Zealand Ivan Hernandez, PhD, Department of Psychology, Virginia Tech, Blacksburg Ross Jacobucci, PhD, Department of Psychology, University of Notre Dame, Notre Dame, IN Randall K. Jamieson, PhD, Department of Psychology, University of Manitoba, Winnipeg, Canada Andrew T. Jebb, MA, Department of Psychological Sciences, Purdue University, West Lafayette, IN Brendan T. Johns, PhD, Department of Psychology, McGill University, Montreal, Quebec, Canada Mark P. Jones, DPhil, Department of Computer Science, Portland State University, Portland, OR Michael N. Jones, PhD, Cognitive Science Program, Indiana University, Bloomington Morteza Karimzadeh, PhD, Department of Geography, University of Colorado, Boulder Margaret L. Kern, PhD, Graduate School for Education, University of Melbourne, Melbourne, Australia Daniel I. Lee, MA, Social/Personality Psychology, University of California, Riverside Yifan Li, MSc, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN Mengqiao Liu, PhD, Development Dimensions International, Pittsburgh, PA Laura F. Long, Department of Psychological Sciences and Department of Statistics, Purdue University, West Lafayette, IN Yung-Hsiang Lu, PhD, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN Frederick L. Oswald, PhD, Department of Psychological Sciences, Rice University, Houston, TX Alexandra Paxton, PhD, Department of Psychological Sciences, Center for the Ecological Study of Perception and Action, University of Connecticut, Storrs Robert W. Proctor, PhD, Department of Psychological Sciences, Purdue University, West Lafayette, IN Sarfaraz Serang, PhD, Department of Psychology, Utah State University, Logan Ryne A. Sherman, PhD, Hogan Assessment Systems, Tulsa, OK Luke S. Snyder, Purdue University, West Lafayette, IN Q. Chelsea Song, PhD, Department of Psychological Sciences, Purdue University, West Lafayette, IN Padmini Srinivasan, PhD, Department of Computer Science, University of Iowa, Iowa City Gabriela Stegmann, PhD, Department of Psychology, Arizona State University, Tempe Contributors ix Joshua A. Strauss, BA, Department of Psychology, University of Maryland, College Park Chen Tang, School of Labor and Employment Relations, University of Illinois at Urbana-Champaign, Champaign Louis Tay, PhD, Department of Psychological Sciences, Purdue University, West Lafayette, IN George K. Thiruvathukal, PhD, Department of Computer Science, Loyola University, Chicago, IL, and Argonne National Laboratory, Argonne, IL Donald M. Truxillo, PhD, Department of Work and Employment Studies, Kemmy Business School, University of Limerick, Limerick, Ireland Guizhen Wang, Electrical and Computer Engineering, Purdue University, West Lafayette, IN Sang Eun Woo, PhD, Department of Psychological Sciences, Purdue University, West Lafayette, IN Aiping Xiong, PhD, College of Information Sciences and Technology, The Pennsylvania State University, University Park Jieqiong Zhao, MS, Electrical and Computer Engineering, Purdue University, West Lafayette, IN