Computer Organization and Design: The Hardware Software Interface [RISC-V Edition]

1049 Pages·2017·29.84 MB·English

by  John L. Hennessy, David A. Patterson

In Praise of Computer Organization and Design: Te Hardware/
Sofware Interface
“Textbook selection is ofen a frustrating act of compromise—pedagogy, content
coverage, quality of exposition, level of rigor, cost. Computer Organization and
Design is the rare book that hits all the right notes across the board, without
compromise. It is not only the premier computer organization textbook, it is a
shining example of what all computer science textbooks could and should be.”
—Michael Goldweber, Xavier University
“I have been using Computer Organization and Design for years, from the very frst
edition. Tis new edition is yet another outstanding improvement on an already
classic text. Te evolution from desktop computing to mobile computing to Big
Data brings new coverage of embedded processors such as the ARM, new material
on how sofware and hardware interact to increase performance, and cloud
computing. All this without sacrifcing the fundamentals.”
—Ed Harcourt, St. Lawrence University
“To Millennials: Computer Organization and Design is the computer architecture
book you should keep on your (virtual) bookshelf. Te book is both old and new,
because it develops venerable principles—Moore’s Law, abstraction, common case
fast, redundancy, memory hierarchies, parallelism, and pipelining—but illustrates
them with contemporary designs.”
—Mark D. Hill, University of Wisconsin-Madison
“Te new edition of Computer Organization and Design keeps pace with advances
in emerging embedded and many-core (GPU) systems, where tablets and
smartphones will/are quickly becoming our new desktops. Tis text acknowledges
these changes, but continues to provide a rich foundation of the fundamentals
in computer organization and design which will be needed for the designers of
hardware and sofware that power this new class of devices and systems.”
—Dave Kaeli, Northeastern University
“Computer Organization and Design provides more than an introduction to computer
architecture. It prepares the reader for the changes necessary to meet the ever-
increasing performance needs of mobile systems and big data processing at a time
that difculties in semiconductor scaling are making all systems power constrained.
In this new era for computing, hardware and sofware must be co-designed and
system-level architecture is as critical as component-level optimizations.”
—Christos Kozyrakis, Stanford University
“Patterson and Hennessy brilliantly address the issues in ever-changing computer
hardware architectures, emphasizing on interactions among hardware and sofware
components at various abstraction levels. By interspersing I/O and parallelism concepts
with a variety of mechanisms in hardware and sofware throughout the book, the new
edition achieves an excellent holistic presentation of computer architecture for the post-
PC era. Tis book is an essential guide to hardware and sofware professionals facing
energy efciency and parallelization challenges in Tablet PC to Cloud computing.”
—Jae C. Oh, Syracuse University
This page intentionally left blank
R I S C - V E D I T I O N
Computer Organization and Design
T H E H A R D W A R E / S O F T W A R E I N T E R F A C E
David A. Patterson is the Pardee Professor of Computer Science, Emeritus at the
University of California at Berkeley, which he joined afer graduating from UCLA in
1977. His teaching has been honored by the Distinguished Teaching Award from the
University of California, the Karlstrom Award from ACM, and the Mulligan Education
Medal and Undergraduate Teaching Award from IEEE. Patterson received the IEEE
Technical Achievement Award and the ACM Eckert-Mauchly Award for contributions
to RISC, and he shared the IEEE Johnson Information Storage Award for contributions
to RAID. He also shared the IEEE John von Neumann Medal and the C & C Prize
with John Hennessy. Like his coauthor, Patterson is a Fellow of the American Academy
of Arts and Sciences, the Computer History Museum, ACM, and IEEE, and he was
elected to the National Academy of Engineering, the National Academy of Sciences,
and the Silicon Valley Engineering Hall of Fame. He served on the Information
Technology Advisory Committee to the US President, as chair of the CS division in the
Berkeley EECS department, as chair of the Computing Research Association, and as
President of ACM. Tis record led to Distinguished Service Awards from ACM, CRA,
and SIGARCH.
At Berkeley, Patterson led the design and implementation of RISC I, likely the frst
VLSI reduced instruction set computer, and the foundation of the commercial SPARC
architecture. He was a leader of the Redundant Arrays of Inexpensive Disks (RAID) project,
which led to dependable storage systems from many companies. He was also involved in the
Network of Workstations (NOW) project, which led to cluster technology used by Internet
companies and later to cloud computing. Tese projects earned four dissertation awards
from ACM. His current research projects are Algorithm-Machine-People and Algorithms
and Specializers for Provably Optimal Implementations with Resilience and Efciency. Te
AMP Lab is developing scalable machine learning algorithms, warehouse-scale-computer-
friendly programming models, and crowd-sourcing tools to gain valuable insights quickly
from big data in the cloud. Te ASPIRE Lab uses deep hardware and sofware co-tuning
to achieve the highest possible performance and energy efciency for mobile and rack
computing systems.
John L. Hennessy is a Professor of Electrical Engineering and Computer Science at
Stanford University, where he has been a member of the faculty since 1977 and was,
from 2000 to 2016, its tenth President. Hennessy is a Fellow of the IEEE and ACM; a
member of the National Academy of Engineering, the National Academy of Science,
and the American Philosophical Society; and a Fellow of the American Academy of
Arts and Sciences. Among his many awards are the 2001 Eckert-Mauchly Award for
his contributions to RISC technology, the 2001 Seymour Cray Computer Engineering
Award, and the 2000 John von Neumann Award, which he shared with David Patterson.
He has also received seven honorary doctorates.
In 1981, he started the MIPS project at Stanford with a handful of graduate students.
Afer completing the project in 1984, he took a leave from the university to cofound
MIPS Computer Systems (now MIPS Technologies), which developed one of the frst
commercial RISC microprocessors. As of 2006, over 2 billion MIPS microprocessors have
been shipped in devices ranging from video games and palmtop computers to laser printers
and network switches. Hennessy subsequently led the DASH (Director Architecture
for Shared Memory) project, which prototyped the frst scalable cache coherent
multiprocessor; many of the key ideas have been adopted in modern multiprocessors.
In addition to his technical activities and university responsibilities, he has continued to
work with numerous start-ups, both as an early-stage advisor and an investor.
R I S C - V E D I T I O N
Computer Organization and Design
T H E H A R D W A R E / S O F T W A R E I N T E R F A C E
David A. Patterson
University of California, Berkeley
John L. Hennessy
Stanford University
RISC-V updates and contributions by
Andrew S. Waterman Matthew Farrens Kevin Lim
SiFive, Inc. University of California, Davis Hewlett-Packard
Yunsup Lee David Kaeli Eric Love
SiFive, Inc. Northeastern University University of California,
Berkeley
Additional contributions by
Perry Alexander Nicole Kaiyan John Nickolls
Te University of Kansas University of Adelaide NVIDIA
Peter J. Ashenden David Kirk John Y. Oliver
Ashenden Designs Pty Ltd NVIDIA Cal Poly, San Luis Obispo
Jason D. Bakos Zachary Kurmas Milos Prvulovic
University of South Carolina Grand Valley State University Georgia Tech
Javier Diaz Bruguera James R. Larus Partha Ranganathan
Universidade de Santiago de Compostela School of Computer and Google
Communications Science at EPFL
Jichuan Chang Mark Smotherman
Google Jacob Leverich Clemson University
Stanford University
Morgan Kaufmann is an imprint of Elsevier
50 Hampshire Street, 5th Floor, Cambridge, MA 02139, United States
Copyright © 2018 Elsevier Inc. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including
photocopying, recording, or any information storage and retrieval system, without permission in writing from the publisher. Details on how
to seek permission, further information about the Publisher’s permissions policies and our arrangements with organizations such as the
Copyright Clearance Center and the Copyright Licensing Agency, can be found at our website: www.elsevier.com/permissions.
Tis book and the individual contributions contained in it are protected under copyright by the Publisher (other than as may be noted
herein).
Notices
Knowledge and best practice in this feld are constantly changing. As new research and experience broaden our understanding, changes in
research methods, professional practices, or medical treatment may become necessary.
Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information, methods,
compounds, or experiments described herein. In using such information or methods they should be mindful of their own safety and the
safety of others, including parties for whom they have a professional responsibility.
To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors, assume any liability for any injury and/
or damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods,
products, instructions, or ideas contained in the material herein.
RISC-V and the RISC-V logo are registered trademarks managed by the RISC-V Foundation, used under permission of the RISC-V
Foundation. All rights reserved.
Tis publication is independent of the RISC-V Foundation, which is not afliated with the publisher and the RISC-V Foundation does not
authorize, sponsor, endorse or otherwise approve this publication.
All material relating to ARM® technology has been reproduced with permission from ARM Limited, and should only be used for education
purposes. All ARM-based models shown or referred to in the text must not be used, reproduced or distributed for commercial purposes, and
in no event shall purchasing this textbook be construed as granting you or any third party, expressly or by implication, estoppel or otherwise,
a license to use any other ARM technology or know how. Materials provided by ARM are copyright © ARM Limited (or its af liates).
British Library Cataloguing-in-Publication Data
A catalogue record for this book is available from the British Library
Library of Congress Cataloging-in-Publication Data
A catalog record for this book is available from the Library of Congress
ISBN: 978-0-12-812275-4
For Information on all Morgan Kaufmann publications
visit our website at https://www.elsevier.com/books-and-journals
Publisher: Katey Birtcher
Acquisition Editor: Steve Merken
Development Editor: Nate McFadden
Production Project Manager: Lisa Jones
Designer: Victoria Pearson Esser
Typeset by MPS Limited, Chennai, India
To Linda,
who has been, is, and always will be the love of my life
A C K N O W L E D G M E N T S
Figures 1.7, 1.8 Courtesy of iFixit (www.ifxit.com). Figure 1.10.4 Courtesy of Cray Inc.
Figure 1.9 Courtesy of Chipworks (www.chipworks.com). Figure 1.10.5 Courtesy of Apple Computer, Inc.
Figure 1.13 Courtesy of Intel. Figure 1.10.6 Courtesy of the Computer History Museum.
Figures 1.10.1, 1.10.2, 4.15.2 Courtesy of the Charles Babbage Figures 5.17.1, 5.17.2 Courtesy of Museum of Science, Boston.
Institute, University of Minnesota Libraries, Minneapolis.
Figure 5.17.4 Courtesy of MIPS Technologies, Inc.
Figures 1.10.3, 4.15.1, 4.15.3, 5.12.3, 6.14.2 Courtesy of IBM.
Figure 6.15.1 Courtesy of NASA Ames Research Center.
Contents
Preface xv
C H A P T E R S
1 Computer Abstractions and Technology 2
1.1 Introduction 3
1.2 Eight Great Ideas in Computer Architecture 11
1.3 Below Your Program 13
1.4 Under the Covers 16
1.5 Technologies for Building Processors and Memory 24
1.6 Performance 28
1.7 Te Power Wall 40
1.8 Te Sea Change: Te Switch from Uniprocessors to Multiprocessors 43
1.9 Real Stuf: Benchmarking the Intel Core i7 46
1.10 Fallacies and Pitfalls 49
1.11 Concluding Remarks 52
1.12 Historical Perspective and Further Reading 54
1.13 Exercises 54
2 Instructions: Language of the Computer 60
2.1 Introduction 62
2.2 Operations of the Computer Hardware 63
2.3 Operands of the Computer Hardware 67
2.4 Signed and Unsigned Numbers 74
2.5 Representing Instructions in the Computer 81
2.6 Logical Operations 89
2.7 Instructions for Making Decisions 92
2.8 Supporting Procedures in Computer Hardware 98
2.9 Communicating with People 108
2.10 RISC-V Addressing for Wide Immediates and Addresses 113
2.11 Parallelism and Instructions: Synchronization 121
2.12 Translating and Starting a Program 124
2.13 A C Sort Example to Put it All Together 133
2.14 Arrays versus Pointers 141
2.15 Advanced Material: Compiling C and Interpreting Java 144