Handbook on Measurement, Assessment, and Evaluation in Higher Education PDF
Preview Handbook on Measurement, Assessment, and Evaluation in Higher Education
p.i HANDBOOK ON MEASUREMENT, ASSESSMENT, AND EVALUATION IN HIGHER EDUCATION Increased demands for colleges and universities to engage in outcomes assessment for accountability purposes have accelerated the need to bridge the gap between higher education practice and advances in the fields of measurement, assessment, and evaluation. This research handbook provides higher education administrators, student affairs personnel, institutional researchers, and faculty with an integrated volume of theory, method, and application. Bringing together terminology, analytical perspectives, and methodological advances, this second edition facilitates informed decision-making while connecting the latest thinking in these methodological areas with actual practice in higher education. In this valuable resource, well-known scholars present a detailed understanding of contemporary theories and practices, with guidance on how to apply these ideas for the benefit of students and institutions. Charles Secolsky is on the faculty at Rockland Community College and County College of Morris, USA. D. Brian Denison is Institutional Research Analyst in the Director of Studies’ Office for Champlain Regional College, Quebec, Canada. 2 p.iii HANDBOOK ON MEASUREMENT, ASSESSMENT, AND EVALUATION IN HIGHER EDUCATION SECOND EDITION Edited by Charles Secolsky and D. Brian Denison 3 p.iv Second edition published 2018 by Routledge 711 Third Avenue, New York, NY 10017 and by Routledge 2 Park Square, Milton Park, Abingdon, Oxon, OX14 4RN Routledge is an imprint of the Taylor & Francis Group, an informa business © 2018 Taylor & Francis The right of Charles Secolsky and D. Brian Denison to be identified as the authors of the editorial material, and of the authors for their individual chapters, has been asserted in accordance with sections 77 and 78 of the Copyright, Designs and Patents Act 1988. All rights reserved. No part of this book may be reprinted or reproduced or utilised in any form or by any electronic, mechanical, or other means, now known or hereafter invented, including photocopying and recording, or in any information storage or retrieval system, without permission in writing from the publishers. Trademark notice: Product or corporate names may be trademarks or registered trademarks, and are used only for identification and explanation without intent to infringe. First edition published by Routledge 2012 Library of Congress Cataloging-in-Publication Data Names: Secolsky, Charles, editor. | Denison, D. Brian, editor. Title: Handbook on measurement, assessment, and evaluation in higher education / [edited] by Charles Secolsky and D. Brian Denison. Description: Second edition. | New York, NY : Routledge, 2017. Identifiers: LCCN 2017006184| ISBN 9781138892149 (hardback) | ISBN 9781138892156 (pbk.) | ISBN 9781315709307 (ebook) | ISBN 9781317485520 (mobipocket/kindle) Subjects: LCSH: Education, Higher—Evaluation—Handbooks, manuals, etc. | Educational tests and measurements —Handbooks, manuals, etc. Classification: LCC LB2331.62 .H36 2017 | DDC 378—dc23 LC record available at https://lccn.loc.gov/2017006184 ISBN: 978-1-138-89214-9 (hbk) ISBN: 978-1-138-89215-6 (pbk) ISBN: 978-1-315-70930-7 (ebk) Typeset in Bembo by Swales & Willis Ltd, Exeter, Devon, UK 4 p.v To Anna and Stephanie for their love, to Maurice and Kikumi Tatsuoka for their passion for inquiry, to Robert Linn for instilling in me an appreciation for the field of educational measurement, and to Robert Stake for sustained intellectual support. (CS) To Gohar, for always being there; and to Josée and Sue, for their friendship and support in the DSO. (DBD) 5 p.vii CONTENTS List of Figures List of Tables Foreword Edward J. Yaw Preface: Improving Institutional Decision-Making through Educational Measurement, Assessment, and Evaluation Charles Secolsky and D. Brian Denison Acknowledgments List of Acronyms PART I Measurement, Assessment, and Evaluation in Higher Education: Past, Present, and Future Introduction to Part I 1 The Failure of Higher Education to Follow the Standards It Has Established in Methodology and Evaluation Michael Scriven 2 On Measurement in Educational Assessment Robert J. Mislevy PART II Assessment and Evaluation in Higher Education Introduction to Part II 3 Assessing the Quality of a University, Particularly Its Teaching Robert E. Stake, Gloria Contreras, and Isabel Arbesú p.viii 4 Validity Issues in Measuring Student Success 6 Dwight L. Smith III 5 Course-Embedded Assessment: Aligning Pedagogical Practices to Enhance Student Learning Kathryne Drezek McConnell and Peter E. Doolittle 6 Implementing Undergraduate Student Learning Outcomes Assessment at the Program and Institutional Levels Thomas Judd and Bruce Keith 7 The Perennial Challenges of Accountability James C. Palmer 8 Talking about Data: The Faculty Discourse on Practice, Student Learning, and Evaluative Processes William H. Rickards 9 Benchmarking in Community Colleges Lou A. Guthrie and Jeffrey A. Seybert 10 Mixed Methods Specialists in Action: Linking Mixed Methods Research to Learning and Classroom Assessment Delwyn L. Harnisch, John W. Creswell, and Timothy C. Guetterman PART III Theoretical Foundations of Educational Measurement Introduction to Part III 11 The Validation of Tests in Higher Education Kurt F. Geisinger, Leslie R. Hawley, and Carina McCormick 12 Reliability Bruce Thompson and Tammi Vacha-Haase 13 Using Classical Test Theory in Higher Education David A. G. Berg, Elizabeth Schaughency, Jacques van der Meer, and Jeffrey K. Smith 14 Item Response Theory in Measurement, Assessment, and Evaluation for Higher Education Steven J. Osterlind and Ze Wang 15 Generalizability Theory in Assessment Contexts Noreen M. Webb, Richard J. Shavelson, and Jeffrey T. Steedle 7 p.ix PART IV Testing and Assessment: Implications for Decision-Making Introduction to Part IV 16 Scaling, Norming, and Equating Michael J. Kolen and Amy B. Hendrickson 17 Setting and Validating Cut Scores for Tests Mary J. Pitoniak and Deanna L. Morgan 18 College Placement Testing of Entering Students Deanna L. Morgan 19 Admissions Testing in College and Graduate Education Rebecca Zwick 20 Closing the Accommodation Gap: New Thinking on Accessibility and Accommodations for Secondary and Postsecondary Students with Disabilities Manju Banerjee and Martha L. Thurlow PART V Test Construction and Development Introduction to Part V 21 Evidence-Centered Design and Postsecondary Assessment Geneva D. Haertel and Reina Fujii 22 Building Content and Statistical Test Specifications Tawnya Knupp and Deborah J. Harris 23 Item Analysis for Classroom Assessments in Higher Education Jerome C. Clauser and Ronald K. Hambleton 24 Computer-Based Testing in Higher Education Robert P. Dolan and Kelly S. Burling PART VI Statistical Approaches in Higher Education Measurement, Assessment, and Evaluation Introduction to Part VI 8 25 Issues in the Analysis of Change D. Betsy McCoach and Karen E. Rambo-Hernandez p.x 26 Multilevel Linear Modeling in Higher Education Contexts Ying Lu, Sharon L. Weinberg, and Marc A. Scott 27 Statistical Modeling in Educational Research Ze Wang and Steven J. Osterlind 28 An Introduction to Bayesian Statistics with Applications for Higher Education Assessment Guili Zhang and Hongming Wang PART VII Approaches to Evaluation in Higher Education Introduction to Part VII Thomas E. Grayson 29 Program Evaluation, Performance Measures, and Evaluability Assessment in Higher Education Thomas E. Grayson 30 Naturalistic Evaluation David A. Erlandson 31 Responsive Evaluation Kelly E. Godfrey and Doreen B. Finkelstein 32 Case Studies Edith J. Cisneros-Cohernour 33 Survey Use in Academic Contexts: Considerations and Guidelines Daphna Harel and Ellen Wentland 34 Empowerment Evaluation: Linking Theories, Principles, and Concepts to Practical Steps David M. Fetterman PART VIII Approaches to Assessment in Higher Education Introduction to Part VIII 9 35 Rubric Development Linda Suskie 36 New Learning About Learning: An Introduction to ePortfolio Assessment Susan Kahn p.xi 37 The Role of Faculty Grading Processes in Program and General-Education Assessment Barbara E. Walvoord 38 Postsecondary Writing Assessment Peggy O’Neill and Sandra Murphy 39 Testing and Evaluation of English-Language Learners in Higher Education Young Yee Kim, James Hart, Jamal Abedi, and Alan Vanneman 40 Evaluation and Assessment in an Online Setting: The Case of Asynchronous Online Discussion Amir Hedayati Mehdiabadi and Wenhao David Huang PART IX Issues in Assessment and Evaluation in Higher Education Introduction to Part IX 41 Cognitive Flexibility Theory and the Assessment of 21st-Century Skills Rand J. Spiro, Hannah A. Klautke, Cui Cheng, and Aric Gaunt 42 Reporting Assessment Results in Higher Education April L. Zenisky and Jerold S. Laguilles 43 Presenting Learning Outcomes Assessment Results to Foster Use Staci J. Provezis and Natasha A. Jankowski 44 Revisiting Reliability and Validity in Higher Education Research and Program Evaluation Margaret D. LeCompte and Dorothy E. Aguilera-Black Bear 45 Assessment of Learning Outcomes in Higher Education: International Comparisons and Perspectives Olga Zlatkin-Troitschanskaia, Richard J. Shavelson, and Hans Anand Pant 46 Ethical Assessment and Institutional Advancement: Connecting Good Practice with 10
The list of books you might like
