The Secret World This page intentionally left blank chr istopher a ndr ew The Secret World A History of Intelligence New Haven and London The Henry L. Stimson Lectures at the Whitney and Betty MacMillan Center for International and Area Studies at Yale. First published 2018 in the United States by Yale University Press and in the United Kingdom by Penguin Books Ltd., London. Copyright © 2018 by Christopher Andrew. All rights reserved. This book may not be reproduced, in whole or in part, including illustrations, in any form (beyond that copying permitted by Sections 107 and 108 of the U.S. Copyright Law and except by reviewers for the public press), without written permission from the publishers. Yale University Press books may be purchased in quantity for educational, business, or promotional use. For information, please e-mail [email protected] (U.S. office) or [email protected] (U.K. office). Set in 10.2/13.5 pt Sabon LT Std Typeset by Jouve (UK), Milton Keynes Printed in the United States of America. Library of Congress Control Number: 2018947154 ISBN 978-0-300-23844-0 (hardcover : alk. paper) This paper meets the requirements of ANSI/NISO Z39.48-1992 (Permanence of Paper). 10 9 8 7 6 5 4 3 2 1 To Ben, Emily, Joe, Katy, Louis, Sam and Tommy This page intentionally left blank Contents List of Illustrations ix Introduction: The Lost History of Global Intelligence 1 1 In the Beginning: Spies of the Bible and Ancient Egypt from Moses to the Last Supper 13 2 Intelligence Operations in Ancient Greece: Myth and Reality from Odysseus to Alexander the Great 27 3 Intelligence and Divination in the Roman Republic 40 4 The Art of War and the Arthashastra: How China and India Took an Early Lead over Greece and Rome 54 5 The Roman Empire and the Untermenschen 70 6 Muhammad and the Rise of Islamic Intelligence 86 7 Inquisitions and Counter- Subversion 100 8 Renaissance Venice and the Rise of Western Intelligence 118 9 Ivan the Terrible and the Origins of Russian State Security 141 10 Elizabeth I, Walsingham and the Rise of English Intelligence 158 11 The Decline of Early Stuart and Spanish Intelligence, and the Rise of the French Cabinet Noir 191 12 Intelligence and Regime Change in Britain: From the Civil War to the Popish Plot 214 13 Intelligence in the Era of the Sun King 242 14 Codebreakers and Spies in Ancien Régime Europe: From the Hanoverian Succession to the Seven Years War 269 15 Intelligence and American Independence 292 16 The French Revolution and the Revolutionary Wars 312 17 The Napoleonic Wars 339 18 Intelligence and C ounter- Revolution. Part I: From the Congress of Vienna to the 1848 Revolutions 363 19 Intelligence and C ounter- Revolution. Part II: From 1848 to the Death of Karl Marx 386 viii Contents 20 The Telegraph, M id- Century Wars and the ‘Great Game’ 402 21 ‘The Golden Age of Assassination’: Anarchists, Revolutionaries and the Black Hand, 1880– 1 914 425 22 The Great Powers and Foreign Intelligence, 1890– 1909 449 23 Intelligence and the Coming of the First World War 472 24 The First World War. Part I: From the Outbreak of War to the Zimmermann Telegram 497 25 The First World War. Part 2: From American Intervention to Allied Victory 543 26 SIGINT and HUMINT between the Wars 573 27 The ‘Big Three’ and Second World War Intelligence 603 28 Intelligence and the Victory of the Grand Alliance 637 29 The Cold War and the Intelligence Superpowers 669 30 ‘Holy Terror’: From the Cold War to 9/11 701 Conclusion: T wenty- First- Century Intelligence in Long- T erm Perspective 731 Bibliography 761 Abbreviations Used in the Notes and References 819 Notes 821 Acknowledgements 876 Index 879 List of Illustrations Integrated Illustrations p. 168 A ldegonde’s solution of Don Juan of Austria’s cipher. (TNA 106/1 document 58 f.144) p. 178 T he Babington postscript and cipher, 1586. (TNA SP12/193/54) p. 180 Forged addition to the Babington postscript and cipher, 1586. (TNA SP12/193/54) p. 182 L etter from Pompeo Pellegrini to Jacopo Manucci, 1587. (TNA SP 94/2 part 2 f82) p. 194 The Monteagle letter, 1605. (Paul Fearn/Alamy) p. 197 Letter from Philip III to the 7th Duke of Medina Sidonia, 1609. (John D Rockefeller Library, Williamsburg, VA) p. 215 Mercurius Aulicus, 1645. (Copyright © British Library Board/Bridgeman Images) p. 217 T itle page of ‘The Kings Cabinet opened’, 1645. (Copyright © British Library Board/Bridgeman Images) p. 232 T he death warrant of Charles I. (Shelfmark: HL/PO/JO/10/297A) p. 301 W ashington’s letter to Colonel Elias Dayton, 1777. (Beinecke Rare Book and Manuscript Library, Yale University, CT) pp. 350–51 The Great Paris Cipher, c. 1812. (TNA WO 37/9) p. 451 A wanted notice for Winston Churchill, South Africa. 1899. (PA Archive) p. 474 Frontispiece and title page of William le Queux’s Spies of the Kaiser, Hurst & Blackett, 1909. p. 538 P art of the Zimmermann telegram as decrypted by Room 40, 1917. p. 540 ‘Germany seeks an alliance against us’. Headline from The New York Times, 1917. p. 546 G erman conditions accepted by Lenin and others on boarding a sealed train in Zurich, 1917. p. 554 MI5 New Year card by Eric Holt-Wilson and Byam Shaw, 1918. (Service Archives) p. 658 The GARBO network, the largest network of bogus agents in intelligence history. (TNA WO 208/4374) p. 686 J ohn Walker’s map of a clandestine drop point for the KGB. (Copyright © Naval Institute Heritage Group) p. 733 Mossad logo.