Advances in Computer-Based Human Assessment PDF
Preview Advances in Computer-Based Human Assessment
ADVANCESINCOMPUTER-BASEDHUMANASSESSMENT THEORYANDDECISIONLIBRARY GeneralEditors:W. LeinfellnerandG. Eberlein SeriesA:PhilosophyandMethodologyoftheSocialSciences Editors:W.Leinfellner(TechnicalUniversityofVienna) G.Eberlein(TechnicalUniversityofMunich) SeriesB:MathematicalandStatisticalMethods Editor:H.Skala(UniversityofPaderbom) SeriesC:GameTheory,MathematicalProgrammingand OperationsResearch Editor:S.H.Tijs(UniversityofNijmegen) Series D: System Theory, Knowledge Engineering and Problem Solving SERIES D: SYSTEMTHEORY,KNOWLEDGEENGINEERINGAND PROBLEMSOLVING Volume7 EditorialBoard G. Feichtinger (Vienna), H. T. Nguyen (Las Cruces), N. B. Nicolau (Palma de Mallorca),O.Opitz(Augsburg),H.J.Skala(Paderbom),M.Sugeno(Yokohama). Scope This series focuses on the design and description of organisations and systems with application to the social sciences. Formal treatment of the subjects is encouraged. Systems theory, information systems, system analysis, interrelated structures, program systems and expert systems are considered to be a theme within the series. The fundamental basics of such concepts including computational and algorithmic aspects andtheinvestigationoftheempiricalbehaviourofsystemsandorganisationswillbean essential part ofthis library. The study ofproblems related to the interface ofsystems andorganisationstotheirenvironmentissupported.Interdisciplinaryconsiderationsare welcome.Thepublicationofrecentandoriginalresultswillbefavoured. Fora listoftitlespublishedinthisseries,seefinal page. ADVANCES IN COMPUTER-BASED HUMAN ASSESSMENT edited by PETER L. DANN, SIDNEY H. IRVINE and JANET M. COLLIS Human Assessment Laboratory, Department of Psychology Polytechnic South West, Plymouth, United Kingdom SPRINGER SCIENCE+BUSINESS MEDIA, B.V. ISBN 978-94-010-5467-6 ISBN 978-94-011-3322-7 (eBook) DOI 10.1007/978-94-011-3322-7 Printed on acid-free paper AII Rights Reserved © 1991 Springer ScÎence+BusÎness Media Dordrecht Origina11y published by Kluwer Academic Publishers in 1991 Softcover reprint of the hardcover 1s t edition 1991 No part of the material protected by this copyright notice may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording or by any information storage and retrieval system, without written permission from the copyright owner. To the memory ofKen Corkindale TABLEOFCONTENTS Advancesin computer-based humanassessment: Introductionand overview PeterL. Dann, SidneyH IrvineandJanetM. Collis ix Part 1 A Review Challengesofcomputer-basedhumanassessment: Areview SidneyH IrvineandPeterL. Dann 3 Part2 Operational Issues Newdirections in intelligent cognitive systems 1. Graham Beaumont 29 Measuresofthirty cognitive tasks: Analysis ofreliabilities, intercorrelations and correlationswith aptitude batteryscores BenA. FairbankJr., William C. Tirre andNancyS.Anderson 51 Speed ofcognitive processing: Cross-cultural findings onstructure and relation to intelligence, tempo, temperament and brainfunction JohnM. Verster 103 Validationofthe MICROPATbatteryofpilot aptitude tests D. Bartram andH CA. Dale 149 Microcomputer-basedpsychological assessment: Anadvance in helping severelyphysicallydisabled people Sarah L. Wilson 171 Analysinglearningstrategies through microcomputer-based problem solving tasks Gordon M. Mills 189 viii Confrontingcomputermodels ofchildren'sword problemsolvingwith empirical data ErikDe CorteandLieven Verschaffel 205 An approach to the use ofcomputers ininstructional testing M. Fe"aris .............. 219 Theconstructionand use ofacomputer-basedlearningprocesstest L. DeLeeuw, H. Van Daalen and1.1. Beishuizen .............. 237 Part3 Theoretical Issues Item bias and individual differences JaniceDowdScheuneman .............. 259 Conceptual implications ofitem bias Ype H. Poortinga .............. 279 Findingthe biasingtrait(s) GideonMellenbergh andFrank G. Kok .............. 291 Evaluationofthe plot method for identifyingpotentiallybiased test items RonaldK Hambleton andJane Rogers .............. 307 Latent class representation ofsystematicpatterns in test responses JamesA. Paulson .............. 331 An information-processingapproach to item equivalence MartinJ. Ippel .............. 377 Group differences instructured tests FonsJ.R van de Vijver .............. 397 References .............. 421 Advances in Computer-Based Human Assessment INTRODUCTION AND OVERVIEW In this book our contributors have defined comtemporary approaches to computer based testing, many of them sharply empirical, and each from a special knowledge base. Part 1 shows how computers have aided enquiry into the nature of learning and abilities. Part 2, emphasising test construction methods, provides an understanding of how computers have changed not just the technology of testing, but the theory of test responses. There are four basic issues considered here: i) what has been learned during the transfer of existing paper and pencil tests (PPTs) to machines; ii) what has been learned about systems in the transfer; iii) what has happened to individual differences theory as a result of introducing 'experimental' paradigms that are computer based; and iv) what have been the consequences of using Item-Response Theory (IRT) for modelling test performance. In the first chapter we address each of these issues in turn, knowing that our contributors provide more detail. Our aim is to fashion a key to understanding the origins, directions and goals of computer based research in human performance and cognition. It has been some time from the conception of this book to its production. During this period many developments in the field of computer based testing have taken place and these are well represented in the chapters of this volume. We would like to thank the contributors for their considerable effort, advice and patience during this time. We also gratefully acknowledge the contributions of Steve Newstead for his helpful comments on an early draft; and of Jane Evans, for typing the manuscript with care and concern. Finally we dedicate this volume to Ken Corkindale who was an inspiration, a good friend and a much valued colleague. Peter L. Dann Sidney H. Irvine Janet M. Collis Human Assessment Laboratory Polytechnic South West Plymouth, U.K. ix Computer Based .Assessment 10 = II I Part 1 RReview CHALLENGES OF COMPUTER-BASED HUMAN ASSESSMENT Sidney H. Irvine and Peter L. Dann Plymouth Polytechnic, U.K. We aim this chapter at the general reader who requires a broad view of the large number of computer-based studies that are available in the literature. A review of all the published work is beyond our scope. Instead, we concentrate on useful case studies that provide constructs for the student and the professional worker who needs background to foster some confidence in understanding what has happened recently and some portent of what might happen in the future. A rough division into cognition and motivation (including personality assessment) in sectors that· call for it, completes the organisation of the chapter. A summary ends it. TRANSFER OF PENCIL AND PAPER TESTS (PPTs) TO MACHINES A number of primary sources speak obliquely to this question by demonstrating the successful transfer of PPTs to computer control. Without doing any of these a gross injustice, one can conclude that the theories implicit in the construction of the original tests have been maintained in the machine version. This is at once a compliment and a limitation: a compliment to robust systems limited by the theory in the initial paper and pencil test. Two criteria for the verification of test validity are commonly invoked: first that the means of the tests are invariant across PPTS and computer-based tests (CSTs); and second that the 3 P.L.Dannetal.(eds.):AdvancesinComputer-BasedHumanAssessment,3-25. ©1991KluwerAcademicPublishers.
The list of books you might like
