Applied OpenStack Design Patterns: Design solutions for production-ready infrastructure with OpenStack components

130 Pages·2016·2.84 MB·English

by  Uchit Vyas (auth.)

Applied
OpenStack
Design Patterns
Design solutions for production-ready
infrastructure with OpenStack components
—
First Edition
—
Uchit Vyas
Applied OpenStack
Design Patterns
Design solutions for production-ready
infrastructure with OpenStack components
First Edition
Uchit Vyas
Applied OpenStack Design Patterns
Uchit Vyas
Ahmedabad, Gujarat
India
ISBN-13 (pbk): 978-1-4842-2453-3 ISBN-13 (electronic): 978-1-4842-2454-0
DOI 10.1007/978-1-4842-2454-0
Library of Congress Control Number: 2016962448
Copyright © 2016 by Uchit Vyas
This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the
material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation,
broadcasting, reproduction on microfilms or in any other physical way, and transmission or information
storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now
known or hereafter developed.
Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with
every occurrence of a trademarked name, logo, or image we use the names, logos, and images only in an
editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the trademark.
The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are
not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to
proprietary rights.
While the advice and information in this book are believed to be true and accurate at the date of publication,
neither the authors nor the editors nor the publisher can accept any legal responsibility for any errors or
omissions that may be made. The publisher makes no warranty, express or implied, with respect to the
material contained herein.
Managing Director: Welmoed Spahr
Lead Editor: Nikhil Karkal
Technical Reviewer: Bharath Thriuveedula
Editorial Board: Steve Anglin, Pramila Balan, Laura Berendson, Aaron Black, Louise Corrigan,
Jonathan Gennick, Robert Hutchinson, Celestin Suresh John, Nikhil Karkal, James Markham,
Susan McDermott, Matthew Moodie, Natalie Pao, Gwenan Spearing
Coordinating Editor: Prachi Mehta
Copy Editor: Karen Jameson
Compositor: SPi Global
Indexer: SPi Global
Artist: SPi Global
Distributed to the book trade worldwide by Springer Science+Business Media New York, 233 Spring Street,
6th Floor, New York, NY 10013. Phone 1-800-SPRINGER, fax [phone], e-mail orders-ny@springer-
sbm.com, or visit www.springeronline.com. Apress Media, LLC is a California LLC and the sole member
(owner) is Springer Science + Business Media Finance Inc (SSBM Finance Inc). SSBM Finance Inc is a
Delaware corporation.
For information on translations, please e-mail [email protected], or visit www.apress.com.
Apress and friends of ED books may be purchased in bulk for academic, corporate, or promotional use.
eBook versions and licenses are also available for most titles. For more information, reference our Special
Bulk Sales–eBook Licensing web page at www.apress.com/bulk-sales.
Any source code or other supplementary materials referenced by the author in this text are available to
readers at www.apress.com. For detailed information about how to locate your book’s source code, go to
www.apress.com/source-code/. Readers can also access source code at SpringerLink in the Supplementary
Material section for each chapter.
Printed on acid-free paper
Contents at a Glance
About the Author �����������������������������������������������������������������������������������������������������xi
About the Technical Reviewer �������������������������������������������������������������������������������xiii
Acknowledgments ���������������������������������������������������������������������������������������������������xv
Introduction �����������������������������������������������������������������������������������������������������������xvii
■ Chapter 1: Designing Your First Cloud with OpenStack �����������������������������������������1
■ Chapter 2: Reference Architecture ����������������������������������������������������������������������19
■ Chapter 3: OpenStack Deployment ����������������������������������������������������������������������31
■ Chapter 4: Deploying Multi-Node Cluster ������������������������������������������������������������51
■ Chapter 5: Nova Architecture and Deployment ���������������������������������������������������65
■ Chapter 6: Exploring through Neutron �����������������������������������������������������������������79
■ Chapter 7: Classifying OpenStack Storage ����������������������������������������������������������91
■ Chapter 8: HA in OpenStack ������������������������������������������������������������������������������103
Index ���������������������������������������������������������������������������������������������������������������������119
iii
Contents
About the Author �����������������������������������������������������������������������������������������������������xi
About the Technical Reviewer �������������������������������������������������������������������������������xiii
Acknowledgments ���������������������������������������������������������������������������������������������������xv
Introduction �����������������������������������������������������������������������������������������������������������xvii
■ Chapter 1: Designing Your First Cloud with OpenStack �����������������������������������������1
1.1 Keystone .................................................................................................................3
1.2 Swift ........................................................................................................................4
1.3 Glance .....................................................................................................................4
1.4 Cinder ......................................................................................................................4
1.5 Nova ........................................................................................................................5
1.5.1 nova-api .....................................................................................................................................6
1.5.2 nova-compute ............................................................................................................................6
1.5.3 nova-volume ...............................................................................................................................6
1.5.4 nova-network .............................................................................................................................6
1.5.5 nova-scheduler ...........................................................................................................................6
1.6 Queue ......................................................................................................................6
1.7 Database .................................................................................................................7
1.8 Neutron ...................................................................................................................7
1.9 Horizon ....................................................................................................................8
1.10 Shared File Systems .............................................................................................8
1.11 T elemetry ..............................................................................................................9
1.12 Bare Metal .............................................................................................................9
v
■ Contents
1.13 Orchestration .........................................................................................................9
1.14 A Sample Architecture Setup ..............................................................................10
1.14.1 T he Conceptual Model Design ................................................................................................10
1.14.2 T he Logical Model Design.......................................................................................................10
1.14.3 Storage Layout .......................................................................................................................11
1.14.4 Networking .............................................................................................................................12
1.14.5 T he Physical Model Design .....................................................................................................12
1.15 Summary .............................................................................................................17
■ Chapter 2: Reference Architecture ����������������������������������������������������������������������19
2.1 O perational Contemplations ..................................................................................19
2.1.1 Backing Up and Practicality ......................................................................................................20
2.1.2 Failover .....................................................................................................................................20
2.1.3 Monitoring ................................................................................................................................20
2.1.4 Capacity Arrangement (Storage Design) ..................................................................................20
2.1.5 Architecture Considerations .....................................................................................................21
2.1.6 Choosing Storage Equipment ...................................................................................................23
2.1.7 Choice of Applications ..............................................................................................................25
2.1.8 OpenStack parts .......................................................................................................................26
2.1.9 Supplemental parts ..................................................................................................................27
2.1.10 Real-time example .................................................................................................................28
■ Chapter 3: OpenStack Deployment ����������������������������������������������������������������������31
3.1 OpenStack in the Venture Server-Farm .................................................................32
3.2 Why Does Speed Make a Difference? ...................................................................32
3.3 Uptime of APIs and Versatile Controlling Part .......................................................33
3.3.1 OpenStack API Uptime and Accessibility ..................................................................................33
3.3.2 Platform Controller Throughput ................................................................................................33
3.3.3 A PI Uptime and Scaling Controller Plane ..................................................................................33
3.4 Powerful Administration and Security Models ......................................................34
3.4.1 Powerful Administration ...........................................................................................................34
3.4.2 Security ....................................................................................................................................35
3.4.3 Cloud Administration and Security ...........................................................................................35
vi
■ Contents
3.5 Open Engineering of Platform Design ...................................................................36
3.5.1 Lock-in Happens, Especially with Big Business Items .............................................................36
3.6 Cloud Interoperability ............................................................................................37
3.6.1 A Hybrid Cloud Procedure .........................................................................................................37
3.7 V ersatile and Flexible Engineering Design ............................................................39
3.7.1 OpenStack Default Networking Administration Bust ................................................................39
3.7.2 Contingent upon OpenStack Neutron NOT for the Weak of Heart .............................................40
3.8 W orldwide Backing and Administration Services ..................................................40
3.8.1 Train Your IT Army to Be the New Cloud Enablers ....................................................................41
3.8.2 Cloud Bolster Model .................................................................................................................41
3.8.3 W orldwide Service Conveyance ...............................................................................................41
3.9 Mechanization/Automation ...................................................................................42
3.9.1 DevOps Basically ......................................................................................................................42
3.9.2 DevOps and Cloud – Everybody Can Code................................................................................42
3.9.3 DevOpsifying OpenStack ..........................................................................................................43
3.10 Deploying OpenStack Using Automation .............................................................45
3.10.1 T he Chef and Chef-Based Deployments .................................................................................45
■ Chapter 4: Deploying Multi-Node Cluster ������������������������������������������������������������51
4.1 Hilter Kilter Clustering ...........................................................................................52
4.2 Symmetric Clustering ............................................................................................52
4.3 Divide and Rule .....................................................................................................52
4.3.1 The OpenStack Cloud Controller ...............................................................................................52
4.3.2 Nova-Conductor ........................................................................................................................53
4.3.3 Nova-Schedular ........................................................................................................................53
4.3.4 Nova-APIs .................................................................................................................................53
4.3.5 Network Administration ............................................................................................................54
4.3.6 Image Administration ...............................................................................................................54
4.3.7 The Horizon Choice ...................................................................................................................54
4.3.8 Getting Ready for the Message Queue .....................................................................................54
4.3.9 Controller Consideration ...........................................................................................................55
vii
■ Contents
4.3.10 Compute Consideration ..........................................................................................................55
4.3.11 Overcommitment Contemplations ..........................................................................................55
4.3.12 Selecting the Virtual Machine Monitor (VMM) ........................................................................56
4.3.13 RAM and CPU Power Consideration .......................................................................................56
4.4 Sample Cluster Deployment ..................................................................................57
4.4.1 Introducing Galera Cluster for MySQL ......................................................................................58
4.4.2 Setting Up HAproxy...................................................................................................................59
4.5 Everything Can Be Failed ......................................................................................62
4.5.1 Move Down with Backup Manager ...........................................................................................62
■ Chapter 5: Nova Architecture and Deployment ���������������������������������������������������65
5.1 Nova Design Engineering ......................................................................................65
5.1.1 Nova-API ...................................................................................................................................67
5.1.2 Nova-Scheduler ........................................................................................................................67
5.1.3 Compute Worker Daemon .........................................................................................................68
5.1.4 Volume Worker Daemon ...........................................................................................................69
5.1.5 Network Worker Domain ..........................................................................................................69
5.1.6 Queue .......................................................................................................................................70
5.1.7 Database ..................................................................................................................................70
5.2 Nova Deployment Phases ......................................................................................71
5.2.1 Virtualization Innovation ...........................................................................................................73
5.2.2 Authentication ..........................................................................................................................73
5.2.3 Scheduler .................................................................................................................................73
5.2.4 API ............................................................................................................................................73
5.2.5 Volumes ....................................................................................................................................74
5.2.6 Image Administration ...............................................................................................................74
5.3 Setting Up Nova .....................................................................................................74
5.3.1 Nova with StackOps .................................................................................................................74
5.3.2 A lign with StackOps Requirements and Installations ...............................................................74
viii
■ Contents
■ Chapter 6: Exploring through Neutron �����������������������������������������������������������������79
6.1 Routing ..................................................................................................................80
6.1.1 Physical Server Threads ...........................................................................................................80
6.1.2 Bonding ....................................................................................................................................81
6.2 Load Balancing ......................................................................................................82
6.3 Firewall .................................................................................................................83
6.4 V PN ........................................................................................................................83
6.5 Neutron Pluggable Modules ..................................................................................84
6.5.1 Switching..................................................................................................................................84
6.5.2 Bridging ....................................................................................................................................85
6.6 OpenStack Stack ...................................................................................................89
6.6.1 HOT Clarified .............................................................................................................................90
■ Chapter 7: Classifying OpenStack Storage ����������������������������������������������������������91
7.1 Persistent vs. Nonpersistent .................................................................................91
7.1.1 Ephemeral Capacity ..................................................................................................................91
7.1.2 Persistent Capacity ...................................................................................................................91
7.1.3 It’s Object, Not NAS/SAN ..........................................................................................................92
7.2 Shift toward Swift .................................................................................................92
7.2.1 Design Implementation ............................................................................................................92
7.2.2 Start and Overlook ....................................................................................................................93
7.2.3 Physical Outline Contemplations ..............................................................................................93
7.2.4 Swift Equipment .......................................................................................................................95
7.2.5 Networking with Swift ..............................................................................................................96
7.2.6 Pulling Swift to System ............................................................................................................97
7.3 Shift toward Cinder ...............................................................................................97
7.4 Picking the Right Storage ......................................................................................98
7.4.1 Mixing Up the Storage as per Requirements ............................................................................98
7.4.2 Can Cinder Give Us Something More…? ..................................................................................98
7.4.3 The Cinder Scenario .................................................................................................................99
7.5 Discovering Ceph ................................................................................................100
ix
■ Contents
■ Chapter 8: HA in OpenStack ������������������������������������������������������������������������������103
8.1 HA under the Extension .......................................................................................103
8.1.1 HA Stages ...............................................................................................................................104
8.1.2 Mapping HA ............................................................................................................................105
8.1.3 HA Terminologies ....................................................................................................................106
8.1.4 Deep-Dive with HA .................................................................................................................106
Index ���������������������������������������������������������������������������������������������������������������������119
x