Research on PISA Manfred Prenzel (cid:129) Mareike Kobarg Katrin Schöps (cid:129) Silke Rönnebeck Editors Research on PISA Research Outcomes of the PISA Research Conference 2009 Editors Manfred Prenzel Mareike Kobarg School of Education Leibniz Institute for Science Technische Universität München and Mathematics Education München, Germany IPN, Kiel, Germany Katrin Schöps Silke Rönnebeck Leibniz Institute for Science Leibniz Institute for Science and Mathematics Education and Mathematics Education IPN, Kiel, Germany IPN, Kiel, Germany ISBN 978-94-007-4457-8 ISBN 978-94-007-4458-5 (eBook) DOI 10.1007/978-94-007-4458-5 Springer Dordrecht Heidelberg New York London Library of Congress Control Number: 2012938229 © Springer Science+Business Media Dordrecht 2013 This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, speci fi cally the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on micro fi lms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Exempted from this legal reservation are brief excerpts in connection with reviews or scholarly analysis or material supplied speci fi cally for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Duplication of this publication or parts thereof is permitted only under the provisions of the Copyright Law of the Publisher’s location, in its current version, and permission for use must always be obtained from Springer. Permissions for use may be obtained through RightsLink at the Copyright Clearance Center. Violations are liable to prosecution under the respective Copyright Law. The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a speci fi c statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. While the advice and information in this book are believed to be true and accurate at the date of publication, neither the authors nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made. The publisher makes no warranty, express or implied, with respect to the material contained herein. Printed on acid-free paper Springer is part of Springer Science+Business Media (www.springer.com) Acknowledgements This book summarizes central outcomes of the PISA Research Conference 2009 in Kiel, Germany. We would like to thank the Norwegian Ministry of Education and Research who supported the preparation of the conference as well as the German Federal Ministry of Education and Research for their generous contribution to the conference itself. Furthermore we would like to thank Barbara Drechsel, Katrin Gutzmann and Gráinne Newcombe for organizing the conference that lead to this book, our reviewers Claus H. Carstensen, Inger Marie Dalehefte, Barbara Drechsel, Timo Ehmke, Aiso Heinze, Nina Jude, Olaf Köller, Michael Leucht, Alexander Robitzsch, Christine Sälzer, Kerstin Schütte, Päivi Taskinen and Jörg Wittwer for their helpful comments on different chapters, Cornelia Gerigk for proofreading a number of chapters and Verena Hane and Emmanuel Kaiser for editing and redrawing the fi gures in this book. v Contents Introduction: Research on PISA, with PISA, and for PISA ....................... xiii Manfred Prenzel Part I Content Related Research Introduction: Content Related Research on PISA .............................. 2 Werner Blum 1 Implications of PISA Outcomes for Science Curriculum Reform in the Netherlands ............................................... 7 Harrie M.C. Eijkelhof, Johanna H. Kordes, and Elwin R. Savelsbergh 2 Using Mathematical Competencies to Predict Item Difficulty in PISA: A MEG Study ................................................ 23 Ross Turner, John Dossey, Werner Blum, and Mogens Niss 3 PISA Mathematics in Germany: Extending the Conceptual Framework to Enable a More Differentiated Assessment .................. 39 Michael Neubrand Part II Methodological Research Introduction: Methodological Research in Large-Scale International Assessments ............................................ 52 Mark Wilson 4 Modeling Reciprocal Determinism in PISA ......................................... 57 Trevor Williams and Kitty Williams 5 The Measurement of Translation Error in PISA-2006 Items: An Application of the Theory of Test Translation Error .................... 71 Guillermo Solano-Flores, Luis Ángel Contreras-Niño, and Eduardo Backhoff vii viii Contents 6 PISA Student Nonresponse Adjustment Procedures ........................... 87 Keith Rust, Sheila Krawchuk, and Christian Monseur 7 Reporting Differentiated Literacy Results in PISA by Using Multidimensional Adaptive Testing....................................... 103 Andreas Frey, Nicki-Nils Seitz, and Ulf Kröhne Part III Context Related Research Introduction: Context Related Research on PISA .............................. 122 Eckhard Klieme 8 More Hours Do Not Necessarily Pay Off. The Effect of Learning Time on Student Performance at Different School Types in Switzerland .................................................................. 129 Domenico Angelone and Urs Moser 9 The Anatomy of Inequalities in Educational Achievements: An International Investigation Using PISA Data ................................. 145 Tarek Mostafa Part IV Research on Trends in PISA Introduction: What Are Trends and Why Are They Important for PISA? ............................................. 160 Matthias von Davier 10 An Investigation of Australian OECD PISA Trend Results ................ 165 Daniel Urbach 11 Success Despite the Odds? Outcomes for Low-Performing Students in Australia ........................................... 181 Sue Thomson and Kylie Hillman 12 Linking PISA Competencies over Three Cycles – Results from Germany ............................................................ 199 Claus H. Carstensen About the Authors ........................................................................................... 215 Contributors Domenico Angelone Institute for Educational Evaluation, Associated Institute of the University of Zurich , Zürich , Switzerland Eduardo Backhoff Institute for Educational Research and Development , University of Baja California , Ensenada , BC , Mexico Werner Blum University of Kassel, Institute for Mathematics , Kassel , Germany Claus H. Carstensen Institute of Psychology , University of Bamberg , Bamberg , Germany Luis Angel Contreras-Niño Instituto de Investigación y Desarrollo Educativo , University of Baja California , Mexico, Ensenada , BC , Mexico Matthias von Davier Research & Development Division , Educational Testing Service , Princeton , NJ , USA John Dossey Department of Mathematics (Emeritus), Illinois State University , Tucson , USA Harrie Eijkelhof Freudenthal Institute for Science and Mathematics Education , Utrecht University , U trecht , The Netherlands Andreas Frey Institute of Educational Science , Friedrich-Schiller-University Jena , Jena , Germany Kylie Hillman Educational Monitoring and Research , Australian Council for Educational Research (ACER) , Camberwell , Australia Eckhard Klieme German Institute for International Educational Research (DIPF) , Frankfurt am Main , Germany Mareike Kobarg Leibniz-Institute for Science and Mathematics Education (IPN) , Kiel , Germany ix