Problems and Solutions in Human Assessment: Honoring Douglas N. Jackson at Seventy

372 Pages·2000·13.523 MB·English

by  Samuel Messick (auth.), Richard D. Goffin, Edward Helmes (eds.)

PROBLEMS AND SOLUTIONS IN
HUMAN ASSESSMENT
Honoring Douglas N. Jackson at Seventy
PROBLEMS AND SOLUTIONS IN
HUMAN ASSESSMENT
Honoring Douglas N. Jackson at Seventy
edited by
Richard D. Goffin
University of Western Ontario
Edward Helmes
Edith Cowan University
SPRINGER SCIENCE+BUSINESS MEDIA, LLC
Library of Congress Cataloging-in-Publication Data
Problems and solutions in human assessment: honoring Douglas N. Jackson at seventyl
edited by Richard D. Goffin, Edward Helmes.
p.cm.
Includes bibliographical references and indexes.
ISBN 978-1-4613-6978-3 ISBN 978-1-4615-4397-8 (eBook)
DOI 10.1007/978-1-4615-4397-8
1. Personality assessment. 1. Jackson, Douglas Northrop, 1929- II. Goffin, Richard D.,
1956-III. Helmes, Edward, 1949-
BF'698.4 .P666 2000
155.2'8--dc21
00-022209
Copyright © 2000 Springer Science+Business Media New York
Origina11y published by Kluwer Academic Publishers in 2000
Softcover reprint ofthe hardcover Ist edition 2000
AH rights reserved. No part of this publication may be reproduced, stored in a
retrieval system or transmitted in any form or by any means, mechanical, photo
copying, recording, or otherwise, without the prior written permission of the publisher,
Springer Science+Business Media, LLC
Printed on acid-free paper.
CONTENTS
List of Figures lX
List of Tables Xl
Authors xiii
Foreword xix
Preface XXl
SECTION I. Conceptual and Methodological Influences in the
Assessment of Individual Differences 1
1. Consequences of Test Interpretation and Use: The Fusion of
Validity and Values in Psychological Assessment 3
Samuel Messick
Educational Testing Service
2. The Role of Social Desirability in the Assessment of Personality
Constructs 21
Edward Helmes
Edith Cowan University
3. Construct Explication through Factor or Component Analysis:
A Review and Evaluation of Alternative Procedures for
Determining the Number of Factors or Components 41
Wayne F. Velicer, Cheryl A. Eaton, and Joseph L. Fava
University of Rhode Island
4. Improved Standard Errors of Standardized Parameters in
Covariance Structure Models: Implications for Construct
Explication. 73
Mortaza Jamshidian
University of Central Florida
and Peter M. Bentler
University of California, Los Angeles
vi Problems and Solutions in Human Assessment
SECTION II. Construct-Oriented Assessment
Within the Domain of Personality
95
5. AppDcation of the Construct Heuristic to the Screening of
Psychopathology: The Holden Psychological Screening
Inventory (HPSI) 97
Ronald R. Holden
Queen's University
6. Construct VaUdity and the Search for Cross-Cultural
Consistencies in PenonaUty 123
Sampo V. Paunonen
The University of Western Ontario
7. The Challenge of Construct VaDdity in the Assessment of
Psychopathology 141
Leslie C. Morey
Texas A&M University
8. Individual Differences and Scientific Productivity 173
J. Philippe Rushton
The University of Western Ontario
9. Recent Studies of Intelligence and PenonaDty using Jackson's
Multidimensional Aptitude Battery and PenonaDty Research
Form 195
Philip A. Vernon
The University of Western Ontario
Contents Vll
SECTION III. Construct-Oriented Assessment
of Individual Differences in Industrial!
Organizational Psychology 213
10. The Assessment of PersonaUty Constructs in Industrial
Organizational Psychology 215
Mitchell G. Rothstein and Richard D. Goffm
The University of Western Ontario
11. Predicting Job Performance using PersonaUty Constructs:
Are Personality Tests Created Equal? 249
Richard D. Goffin, Mitchell G. Rothstein
The University of Western Ontario
and Norman G. Johnston
Private Practice, Toronto
12. What Constructs UnderUe Measures of Honesty or
Integrity? 265
Kevin R. Murphy
Colorado State University
13. Construct VaUdation in Organizational Behavior Research:
The Case of Organizational Commitment 285
Natalie J. Allen and John P. Meyer
The University of Western Ontario
14. The Construct of Goal Commitment: Measurement and
Relationships with Task Performance 315
Gerard H. Seijts
University of Manitoba,
and Gary P. Latham
University of Toronto
15. A Perspective 333
Douglas N. Jackson
The University of Western Ontario
Author and Subject Index 345
LIST OF FIGURES
Chapter 3
1. An illustration oft he Parallel Analysis Procedure (Random Generation, 100
Matrices; M = 3, P = 24, N = 75, CS = .60). 50
2. An Illustration of the MAP Procedure (Trace of the Squared Partial
Correlation Matrix; M = 3, P = 24, N = 75, CS = .60). 54
3. The number ofc ases (out of a possible 270) where each of the ten methods
produced a legitimate estimate ofM. 63
4. The mean deviation from the correct value of M for each of the ten
methods. 64
5. The percent of cases where each of the ten methods produced an exactly
accurate estimate ofM. 64
6. The standard deviation of the estimates produced by each of the ten
methods. 65
Chapter 4
1. Absolute relative bias for the delta (D) method, and quadratic
approximation (Q) method for Examples I, 2, and 3 with sample sizes
N = 75, 150, and 500. 84
2. Absolute relative bias for the ordinary bootstrap (B), bootstrap with
delta control function (BD), and bootstrap with regression control
function (BR) for Examples 1,2, and 3 with sample sized N = 75, ISO,
and 500. The size of the bootstrap sample in each case is b = 250. 86
3. Log efficiencies of the bootstrap-delta (BD) method, and the
lO
bootstrap-regression (BR) method relative to the ordinary bootstrap (B)
for Examples 1,2, and 3 with sample sizes N = 75, 150, and 500. The
size of the bootstrap sample in each case is b = 250. 88
4. Absolute relative bias for the ordinary bootstrap (B), bootstrap with
delta control function (BD), and bootstrap with regression control
function (BR) for examples 1, 2, and 3 with sample sizes N = 75, 150,
and 500. The size of the bootstrap sample in each case is b = 50. 90
Chapter 5
1. Domain of psychopathology based on factor analysis of Jackson's Basic
Personlity Inventory. 103
2. Varimax-rotated canonical loadings ofHPSI and Q-SAD scales. 116
3. Varimax-rotated canonical loadings ofHPSI andBSI scales. 118
Chapter 6
I. A hierarchical model of personality organization. 124
x Problems and Solutions in Hwnan Assessment
Chapter 7
I. An example of the relationship between the severity of psychopathology
represented by an item and its utility in making different diagnostic
distinctions. 153
Chapter 8
I. Plot of mean factor pattern coefficients of personality traits on
dimensions of research productivity and teaching effectiveness,
averaged across two studies. Only those traits with absolute values of
>0.30 on either factor in both studies are shown (Based on data in
Rushton, Murray & Paunonen, 1983). 182
2. Factor plot of dimensions derived from multimethod factor analysis:
Factor I - Technically-Oriented Achievement versus Social
Recognition, and Factor IV - Practical (Based on data in Seiss &
Jackson, 1970). 184
3. Jackson Vocational Interest Survey profile of 276 male chemists. 185
4. Second-order achievement factors: Competitive acquisitiveness and
concern for excellence. (After Jackson, Ahmed, & Heapy, 1976) 189
LIST OF TABLES
Chapter 2
I. Examples ofltems from Jackson's Social Desirability Scale Item Pool 30
Chapter 3
I. A Comparison of Nine Alternative Methods on Three Evaluative Criteria 43
2. Swnmary of Alternative Procedures for hnplementing the MAP Procedure 58
Chapter 5
I. Steps in the Construction of the Holden Psychological Screening
Inventory (lIPSI) 104
2. HPSI Scale Internal Consistency Reliability (Coefficient Alpha) 109
3. Congruence ofHPSI Item Factor Loading Matrices Orthogonally Rotated
to Target Matrix Based on Scoring Key 110
4. Convergent Validities (Zero-order Correlations) for the HPSI Scale of
Psychiatric Symptomatology III
5. Convergent Validities (Zero-order Correlations) for the HPSI Scale of
Social Symptomatology 112
6. Convergent Validities (Zero-order Correlations) for the HPSI Scale of
Depression 113
7. Varimax-Rotated Factor Loadings for HPSI, MMPI-2, and BPI Scales 114
8. Varimax-Rotated Factor Loadings for HPSI and BPI Scales 115
Chapter 7
I. The 22 Full Scales of the P AI. 146
2. P AI Subscales and their Descriptions. 148
3. A Sample of Instruments Used in the Validation of the P AI to Date. 166
Chapter 8
I. Frequencies and Cumulative Percentage for the Distribution of Citations
of and Publications by Faculty Members at the Top 100 British,
Canadian, and American Graduate Department of Psychology 175
2. Split-halfreliabilities of peer and student ratings of personality computed
across professor targets for each of 29 personality traits (decimals
omitted). 179
3. Weber's Types of Leadership Styles 187
Chapter II
I. Convergence ofPRF and 16PF Scales 258
2. Hierarchical Regressions 259
Chapter 12
I. Dimensions Often Reported in Analyses of Integrity Tests 269
2. Examples oflntegrity Tests 270
Chapter 14
I. Hollenbeck, Williams and Klein's (1989) goal commitment items. 319
THE AUTHORS
NATALIE J. ALLEN received her PhD. (Psychology) in 1985 from the University of
Western Ontario where she is an Associate Professor in the Department of Psychology.
For several years, her research has dealt with the conceptualization and measurement of
employee commitment to organizations, the development of employee commitment, and
its behavioral consequences. More recent research focuses on work teams and, in
particular, the composition of teams and issues of alignment between organizations and
their teams. Her work appears in the Journal ofA pplied Psychology, Evaluation and
Program Planning, the Journal of Vocational Behavior, and the Academy of
Management Journal. She is the co-author, with John Meyer, of a recently published
book entitled Commitment in the Workplace: Theory, Research and Application (Sage,
1997).
PETER M. BENTLER, working under Douglas Jackson, received his PhD. in Clinical
Psychology from Stanford University in 1964. He spent a postdoctoral year at the
Educational Testing Service, working under Samuel Messick. Since that time he has been
at the University of California, Los Angeles, where he is now Professor and Chair of
Psychology as well as Professor of Statistics. He has published widely in personality and
applied social psychology, especially on drug use and abuse, and on psychometrics and
multivariate analysis, especially on structural equation modeling. He is author of the EQS
Structural Equations Program. He has been an elected president of the Society of
Multivariate Experimental Psychology, the Psychometric Society, and the Division of
Evaluation, Measurement and Statistics of the American Psychological Association. He
also received the latter's Distinguished Scientific Contributions Award.
CHERYL A. EATON is currently a data analyst at the Center for Alcohol and Addiction
Studies at Brown University. She has provided the data management and statistical
analysis support for numerous NIH funded grants on the assessment and treatment of
addictive behaviors over the past 15 years. She earned her M. A. in Experimental
Psychology at the University of Rhode Island.
JOSEPH 1. F AVA is a Research Professor at the Cancer Prevention Research Center at the
University of Rhode Island. He received his Ph.D. in Quantitative Psychology in 1990
from the University of Rhode Island. He specializes in applied measure development and
multivariate statistical techniques used in measure development, including component
analysis, factor analysis, and structural equation modeling. He is Co-principal Investigator
on several National Cancer Institute research grants that intervene on behavioral risks for
cancer. His publications have appeared in both methodological and health-oriented
journals. He is a member of Divisions 5, 38, and 50 of the American Psychological
Association, the Society of Behavioral Medicine, the American Statistical Association, the
Psychometric Society, and the National Cancer Institute Information Associates Program.