Psychometrics and Psychological Assessment: Principles and Applications

486 Pages·2017·12.268 MB·English

by  Carina Coulacoglou, Donald H. Saklofske

Title page
Psychometrics and
Psychological Assessment
Page left intentionally blank
Psychometrics and
Psychological Assessment
Principles and Applications
Carina Coulacoglou
Donald H. Saklofske
Copyright
Academic Press is an imprint of Elsevier
125 London Wall, London EC2Y 5AS, United Kingdom
525 B Street, Suite 1800, San Diego, CA 92101-4495, United States
50 Hampshire Street, 5th Floor, Cambridge, MA 02139, United States
The Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, United Kingdom
Copyright © 2017 Elsevier Inc. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photo-
copying, recording, or any information storage and retrieval system, without permission in writing from the publisher. Details on how
to seek permission, further information about the Publisher’s permissions policies and our arrangements with organizations such as the
Copyright Clearance Center and the Copyright Licensing Agency, can be found at our website: www.elsevier.com/permissions.
This book and the individual contributions contained in it are protected under copyright by the Publisher (other than as may be noted
herein).
Notices
Knowledge and best practice in this field are constantly changing. As new research and experience broaden our understanding, changes
in research methods, professional practices, or medical treatment may become necessary.
Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information, methods,
compounds, or experiments described herein. In using such information or methods they should be mindful of their own safety and the
safety of others, including parties for whom they have a professional responsibility.
To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors, assume any liability for any injury and/or
damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods,
products, instructions, or ideas contained in the material herein.
Library of Congress Cataloging-in-Publication Data
A catalog record for this book is available from the Library of Congress
British Library Cataloguing-in-Publication Data
A catalogue record for this book is available from the British Library
ISBN: 978-0-12-802219-1
For information on all Academic Press publications visit our website at
https://www.elsevier.com/books-and-journals
Publisher: Nikki Levy
Acquisition Editor: Nikki Levy
Editorial Project Manager: Barbara Makinster
Production Project Manager: Caroline Johnson
Designer: Matthew Limbert
Typeset by Thomson Digital
TABLE OF CONTENT
Contents
Preface xiii Summary 19
References 20
2. Classical Test Theory, Generalizability
Part I
Theory, and Item Response Perspectives
Psychometric Foundations
on Reliability
of Test Construction and
Psychological Assessment Basic Concepts of Reliability 27
Sources of Unreliability 28
Reliability Estimation in a Multilevel
1. R ecent Advances in Psychological
Confirmatory Factor Analysis Framework 28
Assessment and Test Construction
Single-Level Reliability Estimation Using
Milestones in Psychological Assessment Structural Equation Modeling 29
in the 20th Century 3 Alpha (α) 29
Advances in Psychological Assessment Composite Reliability 29
in the 21st Century 4 Maximal Reliability 29
Advances in Reliability 4 Multilevel Reliability 29
Advances in Validity 4 Reliability Generalization 30
Advances in Latent Variable Measures 6 Classical Test Theory and the Rasch Model 30
Advances in Theory of Mind 6 Generalizability Theory (GT) 31
Advances in Temperament and Personality 6 Examining and Validating Test Dimensionality 32
Advances in Parenting Research 7 Item Response Theory 33
Advances in Psychopathology 8 MIRT Models 33
Advances in Taxonomies and Measures 8 An Extended Multidimensional IRT Formulation
Advances in Violence Risk Assessment 9 for the Linear Item Factor Analysis Model 34
Advances in Mental Illness and Violence 10 Advantages of IRT 34
Advances in Suicide Research 10 IRT Models 35
Test Usage 10 Empirical Studies Using IRT 36
Test Construction 11 Developments and Types of Reliability 36
Data Collection and Administration 11 Internal Consistency 37
Nomothetic Versus Idiographic Approaches Consistency in Scoring 38
to the Analysis of Clinical Data 13 Summary 40
Types of Tests 14 References 40
Maximum Performance Tests 14
Typical Performance Tests 15
3. Validity
Test Domain 16
Using Focus Groups and Rasch Item Response Historical and Theoretical Developments
Theory to Improve Response Format 17 of Validity 45
Psychometric Properties 18 Assessing Measurement Invariance 47
Measurement Invariance 18 Construct Validity and Messick’s Unified
Tests of Aspects of Measurement Invariance 18 Approach 47
Tests of Aspects of Structural Invariance 19 Models Against the Unitary Conceptualization
Bias in Psychological Assessment 19 of Validity 48
v
vi Contents
Types of Evidence-Based Validity 52 Potential Causes of Measurement Noninvariance 79
Validity Evidence Based on Consequences Considerations When Testing Measurement
for Testing 52 Invariance 79
Validity Evidence Based on Test Content 54 Assessing Model Fit 79
Face Validity 55 Assessing Measurement Invariance of Scales 80
Validity Evidence Based on Associations Assessing MI/DIF with Multiple Groups Models 80
with Other Variables 55 Key Concepts in Network Analysis 80
Empirical Applications of the Validity Network Analysis and Psychopathology 81
with Other Variables 56 Summary 82
Validity Evidence Based on Internal Structure 57 References 82
Factor Analysis 58
Interpretations and Naming of Factors 59
Empirical Applications of Internal Structure Part II
Validity 59 Metacognitive, Cognitive, Social
Validity Evidence Based on Response Processes 60
Cognitive, Memory, and Behavioral
The Special Case of Cultural Validity 62
Implications of Neurodevelopmental
Summary 63
References 63 Disorders
4. A dvances in Latent Variable 5. Executive Function, Theory of Mind,
Measurement Modeling and Adaptive Behavior
Latent Variable Mixture Modeling 67 Executive Function 91
Growth Mixture Modeling: A General The Assessment of Executive Function 93
Framework 68 Cognitive Flexibility and Set Shifting 94
Latent Growth Curve Models 68 Measures of Cognitive Flexibility/Set Shifting 94
Latent Change Score Models 69 Response Inhibition 95
Growth Mixture Models 69 Working Memory 95
The Unique Means GMM: The Latent Class Comprehensive Measures of Executive Function 97
Growth Model 69 Empirical Research on Executive Function 99
The Unique Means Shared Variance GMM 70 Theory of Mind and Mindblindness Theory 101
The Unique Means, Variances, The Relationship Between Theory of Mind
and Patterns GMM 70 and Relational Frame Theory 102
Latent Class Analysis 70 Developmental Functions of ToM 102
LCA for Developmental Research 71 ToM Across the Life Span Advancement 103
Studying Personality Longitudinally: Different The Reciprocal Relationship Between Executive
Conceptions of Change 71 Functions and Theory of Mind 106
Multitrait-Multimethod Analysis The Assessment of ToM 106
in Longitudinal Research 72 ASD and ToM 109
Longitudinal CFA-MTMM Models 72 ToM as a Severity Index in ASD 109
Exploratory Factor Analysis and ToM Assessment Measures for ASD Disorders 110
Confirmatory Factor Analysis 73 Historical Background of Adaptive Behavior 111
Exploratory Structural Equation Modeling 73 Meanings of Intelligence and Adaptive Behavior 112
Applying Bifactor Statistical Indices in the Adaptive Behavior, Executive Function,
Evaluation of Psychological Measures 74 and ASD 113
An Integrative Framework to Investigate Sources Measures of Adaptive Behavior 114
of Construct-Related Multidimensionality 75 Adaptive Behavioral Assessment System,
Factor Mixture Models 75 2nd Edition 114
Factor Mixture Models in Examining the Latent Scales of Independent Behavior–Revised 114
Structure of Personality Disorders 76 Vineland Adaptive Behavior Scales,
Mediation Analysis in Clinical Psychology 77 2nd Edition (VABS-II) 115
Mediation Models for Longitudinal Data 78 The Diagnostic Adaptive Behavior
Testing Measurement Invariance 78 Scale (DABS) 115
Comparing Latent Factor Means and Structural Behavior Assessment System for Children 115
Coefficients 79 Performance Measures 116
Contents vii
Empirical Studies 116 Models and Measures of Temperament 160
Conceptual Reasoning, Problem Solving, Traditional Models of Temperament 161
and Adaptive Ability in ASD 116 The Behavioral Styles Approach 161
Association Between ADHD and ASD 117 The Criterial Approach 161
Comparison of Adaptive Behavior Measures The Emotion Regulation Model 161
for Children with HFASDs 117 The Tridimensional Temperament Model 163
Longitudinal Studies of Adaptive Behavior The Neurobiological Developmental
and Executive Functions in ASD 118 Approach 163
Adaptive Functioning and IQ Kagan’s Behavioral Inhibition Model 166
in Schizophrenia Spectrum Disorders 118 Contemporary Models of Temperament 167
Summary 118 Regulative Theory of Temperament 167
References 119 Akiskal Affective Temperaments Model 167
Functional Ensemble of Temperament
Model 168
6. Metacognition, Empathy,
Temperament and Culture 169
and Cognitive Biases Temperament and Psychopathology 170
in Schizophrenia and OCD Attachment, Temperament, and Personality
Disorders 171
Metacognition and Social Cognition 131
Depression, Temperament, and Cognition 171
The Interplay Between Social Cognition
Temperament/Character Traits of ODD
and Schizophrenia 132
and ADHD 173
Metacognitive Models and Assessment
Temperament and Parenting Practices
Measures in OCD 133
and ADHD 173
Empathy 135
Temperament and Autism Spectrum
The Neuroscience of Empathy 136
Disorders 174
Measures of Empathy 137
Temperament and its Relation
Cognitive Biases 137
to Schizophrenia 174
Cognitive Biases as Departures from
Temperament, Coping, and Resilience 175
Normative Models of Rationality 137
Summary 176
Types and Patterns of Cognitive Biases 138
References 176
Theoretical Models of Delusions and
Cognitive Biases in Psychotic Disorders 138
8. The Assessment of Family, Parenting,
Hostile Attributional Bias 140
and Child Outcomes
Attributional Style or Bias 140
Cognitive Processes in OCD 141
The Significance of Family Context 187
Cognitive Biases in OCD 142
Family Assessment Models and Their
Attentional Bias in Euthymic BD 143
Measures 188
Cognitive Bias and Metacognitive Training
Process Model 188
in Schizophrenia 143
McMaster Model 189
Summary 146
Circumplex Model of Marital and Family
References 146
Systems 189
Beavers System Model of Family Functioning 190
Darlington Family Assessment System 190
The Assessment of Parenting 191
Part III
Advances in Parenting Research 191
Temperament, Personality
A Historical Overview of Parenting
and Their Clinical Implications Dimensions 192
Parenting Styles and Behaviors 192
7. T he Role of Temperament in Affective Dimensions of Parenting 193
Aspects of Parenting 194
Development and Psychopathology
Dyadic Interactions Between
Temperament and Personality in Childhood 157 Parent and Child 194
Basic Temperament Traits and Types 158 Parental Stress and Maternal Depression 199
The Relationship Between Temperament Family Resilience 199
and the Big Five Factors 159 Positive Adaptation in Children and Families 201
viii Contents
Methods of Family Assessment 202 Personality and Resilience 248
Observational Procedures 202 Measures of Resilience 250
Interviews, Self-Reports, and Other Report The Role of Humor in Coping and Adaptation 251
Inventories 202 Summary 252
Measures of Parenting Behavior 203 References 252
Marital Inventories 204
Measures of Dyadic Interactions 205 10. Measures of Personality
Measures for Predicting Child Abuse 205
Personality Assessment 267
The Assessment of Externalizing
Self-Report Inventories 268
and Internalizing Problems 208
The Big Five in Personality Questionnaires 268
Measures for Assessing Externalizing Behavior 208
The Sixteen Personality Factor Questionnaire
Internalizing Problems 211
Fifth Edition 269
Measures 212
The Myers–Briggs Type Indicator 269
Summary 213
Multidimensional Personality Questionnaire 270
References 213
Severity Indices of Personality Problems 271
Cross-Cultural Measures 272
9. Perspectives and Advances The Cross-Cultural (Chinese) Personality
in Personality Assessment Inventory 272
Multicultural Personality Questionnaire 273
Recent Advances in Personality Research 223
Sources of Bias in Testing 274
Integrating Personality, Intelligence,
Respondent Bias 274
and Cognitive Abilities 224
Examiner Bias 275
The Cognitive Implications of Personality
Researcher Bias 275
and Related Models 225
Performance-Based Tests 276
The Situation Construal Model 226
Rorschach Inkblot Method: New Interpretation
Causes and Evaluation Models of Personality
Systems, Developments in Psychometric
Stability and Change 227
Properties, and Criticisms 277
Stability and Social Personality Models 229
Thematic Apperception Test and the
Continuity and Stability of Personality Traits
SCORS-G Assessment System 279
Across the Life-Span 229
The Fairy Tale Test: A Novel Personality Test
Intraindividual Change in Personality
for Children 280
Stability 231
Summary 283
Subjective Age and Personality Development 232
References 283
The Five-Factor Model—A Landmark
in Personality Trait Models 232
Part IV
Origins and Descriptions of the FFM 232
Criticisms of the Big Five 235 Developments in the Domains
Alternative Personality Trait Models 236 of Psychopathology, Psychiatric
Personality and Culture 238
Taxonomies and Assessment
Cross-Cultural Variability in Levels
of Clinical Disorders
of Personality Traits 239
Cultural Issues Regarding Relatedness
and Self-Definitions 239 11. Advances in Theoretical, Developmental,
Etic and Emic Approaches 240 and Cross-Cultural Perspectives
When Personality Goes Astray: From
of Psychopathology
Personality to Personality Disorders 242
Models of Psychopathology and Theoretical Developments, Modifications,
Personality Traits 243 and Accomplishments in Psychopathology 293
Hierarchical Models of Personality and Emotion Regulation and Psychopathology 294
Psychopathology 244 The Temporal Dynamics of Emotions 294
The General Factor of Personality 245 The Process Model of Emotion Regulation 295
Etiological Models of Personality and Distress Tolerance and Emotion (Dys)Regulation 296
Psychopathology 245 Metaanalytic Studies of Emotion Regulation 296
Two-Polarities Models of Personality Cognitive Emotion Regulation 296
Development 247 Cognitive Emotion Regulation Across Cultures 298
Contents ix
The Psychopathology of Intellectual Disabilities 300 Alternative Models For Psychiatric Taxonomies 350
The Assessment for Dual Diagnosis 300 DSM-5 Alternative Personality Disorder Model
Developmental Behavior Checklist 300 Traits Using Item-Response Theory Analysis 350
Diagnostic Assessment for the Severely Research Domains Criteria Project 351
Handicapped 300 The Psychodynamic Diagnostic Manual
Nisonger Child Behavior Rating Form 301 Version 2 353
Psychiatric Assessment Schedule for Adults A Psychodynamic or Structural Model
with a Developmental Disorder 301 of Psychopathology 355
Psychopathology Instrument for Adults Cognitive-Affective Processing System 356
with Mental Retardation 301 A Network Approach to Environmental Impact
Reiss Screen for Maladaptive Behavior 302 in Psychotic Disorders 357
Developmental Psychopathology 302 General Psychopathology Factor (p Factor) 359
Advances in Mental Health Issues in Infancy 303 Developments in Clinical Assessment 360
Recent Achievements in Developmental Interviews 361
Psychopathology 307 The Diagnostic Interview Schedule
Assessment Methods of Infants and Preschoolers 309 for Children 361
Exploring the Psychosis Continuum 313 Computerized Diagnostic Interview
Childhood Adversities and Psychosis: The Schedule for Children 362
Traumagenic Neurodevelopmental Model 314 The Structured Clinical Interview for DSM-5 362
Existential Anxiety and Unusual Subjective The Diagnostic Interview for DSM-IV
Experience 314 Personality Disorders 364
Death Anxiety as a Transdiagnostic Construct 314 The Structured Interview for DSM-IV
Existential Anxiety and the Phenomenon Personality Disorders 364
of Psychotic-Like Experiences 315 Self-Report Assessment 364
Recent Advances in Schizophrenia Spectrum Minnesota Multiphasic Personality
Disorders and Other Psychotic Disorders 317 Inventory-2 Restructured Form 364
The Neurological Substrate of Psychiatric Millon Clinical Multiaxial Inventory 365
Disorders 317 The Personality Assessment Inventory 365
The Role of Schizotypy in the Schizophrenia The Shedler–Westen Assessment Procedure 366
Spectrum Disorder 318 Dimensional Assessment of Personality
Personality Disorders and Schizotypal Traits Pathology: Basic Questionnaire,
in Daily Life 318 Short Form, and DAPP-90 367
Cognitive Assessment in Schizophrenia 319 The Schedule for Nonadaptive and
Cross-Cultural Perspectives and Advances Adaptive Personality and SNAP Youth 368
in Mental Illness 320 The Personality Inventory for the DSM-5 369
The Cultural Context of Psychopathology 320 The Child Problematic Traits Inventory 369
The Role of Culture in the Development The Personality Psychopathology Five 370
of Specific Disorders 322 Summary 371
Coping and Psychopathology 323 References 371
Models of Coping 323
Coping Strategies 324
Part V
Resilience and Self-Compassion 324
Aggression and Violence: Efforts
Summary 325
References 326 to Predict their Outcomes
12. Psychiatric Taxonomies and 13. Theoretical Perspectives of Criminal
Corresponding Measures Behaviors and Developmental
Criminology
Traditional Psychiatric Taxonomies
and Alternative Perspectives 343 Introduction 383
A Historical Review on the Metastructure Antisocial Thinking, Attitudes and Criminal
of Mental Disorders 343 Thinking 384
DSM—Recent Evaluations, Criticisms, Theories of Criminal Behavior 385
and Proposals 346 Biological and Trait Theories 385
Psychiatric Diagnosis Across Cultures 349 Personality Theories of Criminal Behavior 386