The Practice of Cloud System Administration: Designing and Operating Large Distributed Systems

622 Pages·2014·5.98 MB·English

by  Thomas A. Limoncelli

About This eBook
ePUB is an open, industry-standard format for eBooks. However, support of
ePUB and its many features varies across reading devices and applications. Use
your device or app settings to customize the presentation to your liking. Settings
that you can customize often include font, font size, single or double column,
landscape or portrait mode, and figures that you can click or tap to enlarge. For
additional information about the settings and features on your reading device or
app, visit the device manufacturer’s Web site.
Many titles include programming code or configuration examples. To
optimize the presentation of these elements, view the eBook in single-column,
landscape mode and adjust the font size to the smallest setting. In addition to
presenting code and configurations in the reflowable text format, we have
included images of the code that mimic the presentation found in the print book;
therefore, where the reflowable format may compromise the presentation of the
code listing, you will see a “Click here to view code image” link. Click the link
to view the print-fidelity code image. To return to the previous page viewed,
click the Back button on your device or app.
The Practice of Cloud System
Administration
Designing and Operating Large Distributed Systems
Volume 2
Thomas A. Limoncelli
Strata R. Chalup
Christina J. Hogan
Upper Saddle River, NJ • Boston • Indianapolis • San Francisco
New York • Toronto • Montreal • London • Munich • Paris • Madrid
Capetown • Sydney • Tokyo • Singapore • Mexico City
Many of the designations used by manufacturers and sellers to distinguish their
products are claimed as trademarks. Where those designations appear in this
book, and the publisher was aware of a trademark claim, the designations have
been printed with initial capital letters or in all capitals.
The authors and publisher have taken care in the preparation of this book, but
make no expressed or implied warranty of any kind and assume no responsibility
for errors or omissions. No liability is assumed for incidental or consequential
damages in connection with or arising out of the use of the information or
programs contained herein.
For information about buying this title in bulk quantities, or for special sales
opportunities (which may include electronic versions; custom cover designs; and
content particular to your business, training goals, marketing focus, or branding
interests), please contact our corporate sales department at
[email protected] or [phone].
For government sales inquiries, please contact
[email protected].
For questions about sales outside the United States, please contact
[email protected].
Visit us on the Web: informit.com/aw
Library of Congress Cataloging-in-Publication Data
Limoncelli, Tom.
The practice of cloud system administration : designing and operating large
distributed systems /
Thomas A. Limoncelli, Strata R. Chalup, Christina J. Hogan.
volumes cm
Includes bibliographical references and index.
ISBN-13: 978-0-321-94318-7 (volume 2 : paperback)
ISBN-10: 0-321-94318-X (volume 2 : paperback)
1. Computer networks—Management. 2. Computer systems. 3. Cloud
computing. 4. Electronic data
processing—Distributed processing. I. Chalup, Strata R. II. Hogan, Christina J.
III. Title.
TK5105.5.L529 2015
004.67’82068—dc23 2014024033
Copyright © 2015 Thomas A. Limoncelli, Virtual.NET Inc., Christina J. Lear
née Hogan
All rights reserved. Printed in the United States of America. This publication is
protected by copyright, and permission must be obtained from the publisher
prior to any prohibited reproduction, storage in a retrieval system, or
transmission in any form or by any means, electronic, mechanical,
photocopying, recording, or likewise. To obtain permission to use material from
this work, please submit a written request to Pearson Education, Inc.,
Permissions Department, One Lake Street, Upper Saddle River, New Jersey
07458, or you may fax your request to [phone].
ISBN-13: 978-0-321-94318-7
ISBN-10: 0-321-94318-X
Text printed in the United States on recycled paper at RR Donnelley in
Crawfordsville, Indiana.
First printing, September 2014
Contents at a Glance
Contents
Preface
About the Authors
Introduction
Part I Design: Building It
Chapter 1 Designing in a Distributed World
Chapter 2 Designing for Operations
Chapter 3 Selecting a Service Platform
Chapter 4 Application Architectures
Chapter 5 Design Patterns for Scaling
Chapter 6 Design Patterns for Resiliency
Part II Operations: Running It
Chapter 7 Operations in a Distributed World
Chapter 8 DevOps Culture
Chapter 9 Service Delivery: The Build Phase
Chapter 10 Service Delivery: The Deployment Phase
Chapter 11 Upgrading Live Services
Chapter 12 Automation
Chapter 13 Design Documents
Chapter 14 Oncall
Chapter 15 Disaster Preparedness
Chapter 16 Monitoring Fundamentals
Chapter 17 Monitoring Architecture and Practice
Chapter 18 Capacity Planning
Chapter 19 Creating KPIs
Chapter 20 Operational Excellence
Epilogue
Part III Appendices
Appendix A Assessments
Appendix B The Origins and Future of Distributed Computing and Clouds
Appendix C Scaling Terminology and Concepts
Appendix D Templates and Examples
Appendix E Recommended Reading
Bibliography
Index
Contents
Preface
About the Authors
Introduction
Part I Design: Building It
1 Designing in a Distributed World
1.1 Visibility at Scale
1.2 The Importance of Simplicity
1.3 Composition
1.3.1 Load Balancer with Multiple Backend Replicas
1.3.2 Server with Multiple Backends
1.3.3 Server Tree
1.4 Distributed State
1.5 The CAP Principle
1.5.1 Consistency
1.5.2 Availability
1.5.3 Partition Tolerance
1.6 Loosely Coupled Systems
1.7 Speed
1.8 Summary
Exercises
2 Designing for Operations
2.1 Operational Requirements
2.1.1 Configuration
2.1.2 Startup and Shutdown
2.1.3 Queue Draining
2.1.4 Software Upgrades
2.1.5 Backups and Restores
2.1.6 Redundancy
2.1.7 Replicated Databases
2.1.8 Hot Swaps
2.1.9 Toggles for Individual Features
2.1.10 Graceful Degradation
2.1.11 Access Controls and Rate Limits
2.1.12 Data Import Controls
2.1.13 Monitoring
2.1.14 Auditing
2.1.15 Debug Instrumentation
2.1.16 Exception Collection
2.1.17 Documentation for Operations
2.2 Implementing Design for Operations
2.2.1 Build Features in from the Beginning
2.2.2 Request Features as They Are Identified
2.2.3 Write the Features Yourself
2.2.4 Work with a Third-Party Vendor
2.3 Improving the Model
2.4 Summary
Exercises
3 Selecting a Service Platform
3.1 Level of Service Abstraction
3.1.1 Infrastructure as a Service
3.1.2 Platform as a Service
3.1.3 Software as a Service
3.2 Type of Machine
3.2.1 Physical Machines
3.2.2 Virtual Machines
3.2.3 Containers
3.3 Level of Resource Sharing
3.3.1 Compliance
3.3.2 Privacy
3.3.3 Cost
3.3.4 Control
3.4 Colocation
3.5 Selection Strategies
3.6 Summary
Exercises
4 Application Architectures
4.1 Single-Machine Web Server
4.2 Three-Tier Web Service
4.2.1 Load Balancer Types
4.2.2 Load Balancing Methods
4.2.3 Load Balancing with Shared State
4.2.4 User Identity
4.2.5 Scaling
4.3 Four-Tier Web Service
4.3.1 Frontends
4.3.2 Application Servers
4.3.3 Configuration Options
4.4 Reverse Proxy Service
4.5 Cloud-Scale Service
4.5.1 Global Load Balancer
4.5.2 Global Load Balancing Methods
4.5.3 Global Load Balancing with User-Specific Data
4.5.4 Internal Backbone
4.6 Message Bus Architectures
4.6.1 Message Bus Designs
4.6.2 Message Bus Reliability
4.6.3 Example 1: Link-Shortening Site
4.6.4 Example 2: Employee Human Resources Data Updates