6 1 0 2 r e b m e c e D 1 2 9 3 : 2 0 t a ] l o o p r e v i L f o y t i s r e v i n U [ y b d e d a o l n w o D Privacy, Due Process and the Computational Turn 6 1 0 2 r e b m Privacy, Due Process and the Computational Turn: The philosophy of law meets the e c philosophy of technology engages with the rapidly developing computational e D aspects of our world, including data mining, behavioural advertising, govern- 1 ment, profi ling for intelligence, customer relationship management, smart 2 9 search engines, personalised news feeds and soon,in order to consider their 3 : implications for the assumptions on which our legal framework has been 2 0 built. The contributions to this volume focus on the issue of privacy, which is t a often equated with data privacy and data security, location privacy, anonymity, ] l pseudonymity, unobservability and unlinkability. Here, however, the extent o o to which predictive and other types of data analytics operate in ways that may p er or may not violate privacy is rigorously taken up, both technologically and v i legally, in order to open up new possibilities for considering, and contesting, L f how we are increasingly being correlated and categorised. o y it Mireille Hildebrandt holds the Chair of Smart Environments, Data s er Protection and the Rule of Law at the Institute for Computer and Information v i Sciences (ICIS) at Radboud University Nijmegen, and is Associate Professor n U of Jurisprudence at the Erasmus School of Law, Erasmus University Rotterdam. [ y She is a senior researcher at the Centre for Law, Science, Technology and b d Society (LSTS), Vrije Universiteit Brussel. e d a Katja de Vries is based in the interdisciplinary Center for Law, Science, o nl Technology and Society (LSTS) at the Vrije Universiteit Brussel (VUB). w o D Thispageintentionallyleftblank 6 1 0 2 r e b m e c e D 1 2 9 3 : 2 0 t a ] l o o p r e v i L f o y t i s r e v i n U [ y b d e d a o l n w o D Privacy, Due Process and the Computational Turn 6 1 0 2 r e The philosophy of law meets the b m e philosophy of technology c e D 1 2 9 3 : 2 0 t a ] Edited by l o o p Mireille Hildebrandt and r e v Li Katja de Vries f o y t i s r e v i n U [ y b d e d a o l n w o D First published 2013 by Routledge 2 Park Square, Milton Park, Abingdon, Oxon OX14 4RN Simultaneously published in the USA and Canada by Routledge 711 Third Avenue, New York, NY 10017 A Glasshouse Book Routledge is an imprint of the Taylor & Francis Group, an informa business © 2013 Mireille Hildebrandt and Katja de Vries 6 1 The right of Mireille Hildebrandt and Katja de Vries 0 as authors of this work, and the individual chapter contributors for their 2 r chapters, has been asserted by them in accordance with sections 77 and e 78 of the Copyright, Designs and Patents Act 1988. b m All rights reserved. No part of this book may be reprinted or reproduced e or utilised in any form or by any electronic, mechanical, or other means, c e now known or hereafter invented, including photocopying and recording, D or in any information storage or retrieval system, without permission in 1 writing from the publishers. 2 9 Trademark notice: Product or corporate names may be trademarks or 3 registered trademarks, and are used only for identifi cation and : 2 explanation without intent to infringe. 0 at British Library Cataloguing in Publication Data ] A catalogue record for this book is available from the British Library l o o Library of Congress Cataloging in Publication Data p r A catalog record for this book has been requested e v Li ISBN 978-0-415-64481-5 (hbk) f ISBN 978-0-203-42764-4 (ebk) o y Typeset in Garamond by t si Cenveo Publisher Services r e v i n U [ y b d e d a o l n w o D Contents 6 1 0 2 r e b m Acknowledgements vii e c N otes on Contributors ix e D Preface xiii 1 2 9 3 Introduction Privacy, due process and the computational : 2 0 turn at a glance: pointers for the hurried reader 1 t ] a KATJA DE VRIES AND MIREILLE HILDEBRANDT l o o p 1 Privacy, due process and the computational turn: r e a parable and a fifirst analysis 9 v i L KATJA DE VRIES f o y t si PART 1 r e Data science 39 v i n U [ 2 A machine learning view on profifi ling 41 y b MARTIJN VAN OTTERLO d e d a o PART 2 l n Anticipating machines 65 w o D 3 Abducing personal data, destroying privacy: diagnosing profifiles through artefactual mediators 67 LORENZO MAGNANI 4 Prediction, pre-emption, presumption: the path of law after the computational turn 91 IAN KERR vi Contents 5 Digital prophecies and web intelligence 121 ELENA ESPOSITO 6 The end(s) of critique: data behaviourism versus due process 143 ANTOINETTE ROUVROY 6 PART 3 1 0 Resistance & solutions 169 2 r e b 7 Political and ethical perspectives on data obfuscation 171 m e FINN BRUNTON AND HELEN NISSENBAUM c e D 1 8 On decision transparency, or how to enhance 2 data protection after the computational turn 196 9 3 : BERT-JAAP KOOPS 2 0 at 9 Profifi le transparency by design? Re-enabling ] l double contingency 221 o o p MIREILLE HILDEBRANDT r e v i L f Index 247 o y t i s r e v i n U [ y b d e d a o l n w o D Acknowledgements 6 1 0 2 r e b m This volume developed from the Philosophers’ Reading Panel on Privacy and e c Due Process after the Computational Turn, organised by the present editors, e D together with Solon Barocas from New York University. The Reading Panel – 1 a real treat for those keen on trenchant but careful and responsive reflflection – 2 9 took place on 26 January 2011. It was the second of its kind: the fi rst took 3 : place in January 2009 and resulted in the fi rst volume in the series of the 2 0 Philosophy of Law Meets the Philosophy of Technology, entitled L aw, Human t a Agency and Autonomic Computing , also published by Routledge, in 2011. We ] l especially thank Antoinette Rouvroy, who co-edited the fi rst volume and con- o o tributed with a captivating chapter in the present volume. We would like to p er extend our gratitude and appreciation for all who participated in the Reading v i Panel, providing a fi rst draft of their papers well in advance to enable a high L f level of discussion, and for working with us on the chapters of this volume: o y Finn Brunton, Elena Esposito, Ian Kerr, Lorenzo Magnani, Helen Nissenbaum, it Martijn van Otterlo and Antoinette Rouvroy. We are indebted to Bert-Jaap s r e Koops, whose cutting-edge questions during the discussion prompted our v i invitation to contribute to the volume, though he is neither a philosopher nor n U a data scientist. [ y W e would like to credit Solon Barocas for his enthusiastic initiatives and b d interventions in the process of organising the Reading Panel. He proposed to e invite a data scientist to keep us, the philosophers of law and technology, d oa down to earth – or, in this case – close to the intricate operations of machine l n learning. His acuity in understanding the inner workings and unprecedented w o implications of profi ling technologies has been of enormous value for this D project. His contributions have been awesome, to use one of his own favourite phrases. The Philosophers’ Reading Panel formed a part of the larger annual inter- national Conference on Computing, Privacy and Data Protection 2011 (CPDP11) in Brussels. We thank the organisers of the larger Conference, LSTS, CRID, TILT, INRA and Fraunhofer Institute,1 and express our special thanks to Paul de Hert, Serge Gutwirth, Rocco Bellanova and Rosamunde van Brakel of LSTS for enabling the synergy of a reading panel that practises viii Acknowledgements ‘slow thinking’, with the main programme of the larger Conference, which entails a hectic succession of highly informative presentations on the intersec- tion of law and computer science with regard to privacy and data protection. Grietje Gorus and Katrijn de Marez provided professional logistical support for all participants. The Reading Panel was also part and parcel of the fi ve-year research project on ‘Law and Autonomic Computing: Mutual Transformations’ that was funded by the Vrije Universiteit Brussel, of which Mireille Hildebrandt was 6 co-author and co-ordinator, together with Serge Gutwirth (director of LSTS), 1 Paul de Hert (initiator of the CPDP Conferences) and Laurent de Sutter 0 2 (researcher at LSTS). r e We admire the professional patience and stamina of Routledge’s editorial b m assistant, Melanie Fortmann-Brown, who helped us through the editing e c process from its very beginning and, last but not least, we are once again e D immensely grateful to Colin Perrin for his trust, enthusiasm and support in 1 getting this second volume published by Routledge. 2 9 3 : 2 Note 0 t a 1 The Center for Law, Science, Technology and Society (LSTS), Vrije Universiteit l] Brussels. Centre de Recherche d’Informatique et Droit (CRID), Université de o o Namur. The Tilburg Institute for Law, Technology and Society (TILT), University p r of Tilburg. Institut national de recherche en informatique et en automatique e v (INRIA), Paris. Fraunhofer Gesellschaft. i L f o y t i s r e v i n U [ y b d e d a o l n w o D Notes on Contributors 6 1 0 2 r e b m Finn Brunton is an Assistant Professor of Information at the School of e c Information at the University of Michigan. He was trained in the history e D of science, receiving a PhD from the Centre for Modern Thought at the 1 University of Aberdeen. Subsequently he worked extensively on issues of 2 9 privacy and security online as a postdoctoral researcher with Helen 3 : Nissenbaum at NYU. He now focuses on technological adaptation and 2 0 misuse, writing on topics including digital anonymity and currency, the his- t a tory of experimental and obsolete media, and Wikileaks; his fifirst book, Spam: ] l A Shadow History of the Internet (MIT Press) will be out in March 2013. o o p Katja de Vries is a PhD student at the Centre for Law, Science, Technology, r e v and Society (Vrije Universiteit Brussel). Her PhD research is focused on the i L collisions and interactions between legal and technological modes of think- f o ing. More in particular she studies probablistic understandings of rational- y ity and equality, and the differences and continuities between their t i rs functioning within advanced data technologies and within the legal seman- e v tics of privacy, data protection and antidiscrimination law. De vries pub- i n lishes on a wide range of topics such as technology-mediated identity U [ construction; Foucault’s technologies of the self; Ambient Intelligence; the y b continuity between cybernetics and current algorithmic personalization d technologies; the case law, practices and political debates with regard to e d online searches and data retention; the role of proportionality in privacy a o l law; enlightened ways of relating to digital spaces like Second Life; legal n w semiotics and Latour’s empirical-philosophical way of studying the mode o D of enunciation of law. She is a member of the European “Living in Surveillance Societies”-network. De Varies studied at Sciences Po in Paris, obtained three masters degrees with distinction at Leiden University (Civil Law, Cognitive Psychology and Philosophy) and graduated at Oxford University (Magister Juris). Elena Esposito teaches Sociology of Communication at the University of Modena-Reggio Emilia in the Facoltà di Scienze della Comunicazione e dell’Economia. She graduated in Philosophy in Italy with Umberto Eco