Mesos in Action

410 Pages·2016·5.6 MB·English

by  Roger Ignazio

Mesos in Action
Roger Ignazio
Copyright
For online information and ordering of this and other Manning books, please
visit www.manning.com. The publisher offers discounts on this book when
ordered in quantity. For more information, please contact
Special Sales Department
Manning Publications Co.
20 Baldwin Road
PO Box 761
Shelter Island, NY 11964
Email: [email protected]
©2016 by Manning Publications Co. All rights reserved.
No part of this publication may be reproduced, stored in a retrieval system, or
transmitted, in any form or by means electronic, mechanical, photocopying, or
otherwise, without prior written permission of the publisher.
Many of the designations used by manufacturers and sellers to distinguish their
products are claimed as trademarks. Where those designations appear in the
book, and Manning Publications was aware of a trademark claim, the
designations have been printed in initial caps or all caps.
Recognizing the importance of preserving what has been written, it is
Manning’s policy to have the books we publish printed on acid-free paper, and
we exert our best efforts to that end. Recognizing also our responsibility to
conserve the resources of our planet, Manning books are printed on paper that is
at least 15 percent recycled and processed without the use of elemental chlorine.
Manning Publications
Co.20 Baldwin Road
PO Box 761
Shelter Island, NY 11964
Development editor: Cynthia Kane
Technical development editor: Jerry Kuch
Copyeditor: Sharon Wilkey
Proofreader: Melody Dolab
Technical proofreaders: Chris Schaefer, Yogesh Poojari
Typesetter: Dennis Dalinnik
Cover designer: Marija Tudor
ISBN: 9781617292927
Printed in the United States of America
1 2 3 4 5 6 7 8 9 10 – EBM – 21 20 19 18 17 16
Dedication
For Sarah
Brief Table of Contents
Copyright
Brief Table of Contents
Table of Contents
Foreword
Preface
Acknowledgements
About this Book
About the Author
About the Cover Illustration
1. Hello, Mesos
Chapter 1. Introducing Mesos
Chapter 2. Managing datacenter resources with Mesos
2. Core Mesos
Chapter 3. Setting up Mesos
Chapter 4. Mesos fundamentals
Chapter 5. Logging and debugging
Chapter 6. Mesos in production
3. Running on Mesos
Chapter 7. Deploying applications with Marathon
Chapter 8. Managing scheduled tasks with Chronos
Chapter 9. Deploying applications and managing scheduled tasks with
Aurora
Chapter 10. Developing a framework
Appendix A. Case study: Mesosphere DCOS, an enterprise Mesos
distribution
Appendix B. List of Mesos frameworks and tools
Index
List of Figures
List of Tables
List of Listings
Table of Contents
Copyright
Brief Table of Contents
Table of Contents
Foreword
Preface
Acknowledgements
About this Book
About the Author
About the Cover Illustration
1. Hello, Mesos
Chapter 1. Introducing Mesos
1.1. Meet Mesos
1.1.1. Understanding how it works
1.1.2. Comparing virtual machines and containers
1.1.3. Knowing when (and why) to use Mesos
1.2. Why we need to rethink the datacenter
1.2.1. Partitioning of resources
1.2.2. Deploying applications
1.3. The Mesos distributed architecture
1.3.1. Masters
1.3.2. Slaves
1.3.3. Frameworks
1.4. Summary
Chapter 2. Managing datacenter resources with Mesos
2.1. A brief introduction to Spark
2.1.1. Spark on a standalone cluster
2.1.2. Spark on Mesos
2.2. Running a Spark job on Mesos
2.2.1. Finding prime numbers in a set
2.2.2. Getting and packaging up the code
2.2.3. Submitting the job
2.2.4. Observing the output
2.3. Exploring further
2.3.1. Mesos UI
2.3.2. Spark UI
2.4. Summary
2. Core Mesos
Chapter 3. Setting up Mesos
3.1. Deploying Mesos
3.1.1. Mesos cluster components
3.1.2. Considerations for a development environment
3.1.3. Considerations for a production environment
3.2. Installing Mesos and ZooKeeper
3.2.1. Installing from packages
3.2.2. Compiling and installing from source
3.3. Configuring Mesos and ZooKeeper
3.3.1. ZooKeeper configuration
3.3.2. Mesos configuration
3.4. Installing and configuring Docker
3.4.1. Installation
3.4.2. Configuration
3.4.3. Configuring Mesos slaves for Docker
3.5. Upgrading Mesos
3.5.1. Upgrading Mesos masters
3.5.2. Upgrading Mesos slaves
3.6. Summary
Chapter 4. Mesos fundamentals
4.1. Scheduling and allocating datacenter resources
4.1.1. Understanding resource scheduling
4.1.2. Understanding resource allocation
4.1.3. Customizing Mesos slave resources and attributes
4.2. Isolating resources with containers
4.2.1. Isolating and monitoring CPU, memory, and disk
4.2.2. Network monitoring and rate limiting
4.3. Understanding fault tolerance and high availability
4.3.1. Fault tolerance
4.3.2. High availability
4.3.3. Handling failures and upgrades
4.4. Summary
Chapter 5. Logging and debugging
5.1. Understanding and configuring Mesos logging