Front cover An introduction to z/VM Single System Image (SSI) and Live Guest Relocation (LGR) Learn about the business benefits of SSI and LGR Understand important concepts and planning Step through implementation and practical approaches Lydia Parziale Anthony Bongiorno Howard Charter Jo Johnston Volker Masen Clovis Pereira Sreehari Somasundaran Srivatsan Venkatesan ibm.com/redbooks International Technical Support Organization An introduction to z/VM Single System Image (SSI) and Live Guest Relocation (LGR) April 2012 SG24-8006-00 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. First Edition (April 2012) This edition applies to Version 6, Release 2, of z/VM. © Copyright International Business Machines Corporation 2012. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix The team who wrote this book . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix Now you can become a published author, too! . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi Comments welcome. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi Stay connected to IBM Redbooks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi Chapter 1. Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.1 Business benefits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 1.1.1 Simplified z/VM systems management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 1.1.2 Share system resources with high resource utilization . . . . . . . . . . . . . . . . . . . . . . 2 1.1.3 Non-disruptive maintenance and upgrades . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 1.1.4 Concurrent support for disparate environments . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1.2 Navigating the z/VM library . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1.2.1 z/VM V6R2.0 General Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1.2.2 z/VM V6R2.0 Installation Guide . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.2.3 z/VM V6R2.0 CP Planning and Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.2.4 z/VM V6R2.0 Getting Started with Linux on System z . . . . . . . . . . . . . . . . . . . . . . 4 1.2.5 z/VM V6R2.0 VMSES/E Introduction and Reference . . . . . . . . . . . . . . . . . . . . . . . 5 1.2.6 z/VM V6R2.0 Directory Maintenance Facility Commands Reference. . . . . . . . . . . 5 1.2.7 z/VM V6R2.0 Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 1.2.8 z/VM V6R2.0 CP Commands and Utilities Reference . . . . . . . . . . . . . . . . . . . . . . 6 1.2.9 z/VM V6R2.0 Migration Guide. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 Chapter 2. Single system image (SSI) overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2.1 Introduction to the z/VM single system image (SSI) clusters . . . . . . . . . . . . . . . . . . . . 10 2.2 Major attributes of the z/VM SSI cluster . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 2.2.1 z/VM installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 2.2.2 Changes to applying service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.2.3 Workload balancing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.2.4 Single configuration users and multiconfiguration users. . . . . . . . . . . . . . . . . . . . 11 2.2.5 DASD requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 2.2.6 Network requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 2.2.7 Equivalency identifiers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 2.2.8 MAC addresses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 2.2.9 New user IDs for z/VM 6.2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 2.2.10 Persistent data record. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 2.2.11 VMSSI considerations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 2.3 Planning considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 2.3.1 Logical partition (LPAR) planning considerations . . . . . . . . . . . . . . . . . . . . . . . . . 19 2.3.2 DASD planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 2.3.3 ISFC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 2.3.4 Non-SSI z/VM installation planning considerations. . . . . . . . . . . . . . . . . . . . . . . . 20 2.4 z/VM SSI cluster operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 2.4.1 SSI member states . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 2.4.2 SSI cluster modes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 © Copyright IBM Corp. 2012. All rights reserved. iii Chapter 3. Live guest relocation (LGR) overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 3.1 Introducing live guest relocation (LGR). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 3.2 Major attributes of live guest relocation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 3.2.1 Factors affecting relocation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 3.3 Supported configurations for relocation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 3.4 Memory and paging considerations for live guest relocation . . . . . . . . . . . . . . . . . . . . 26 3.5 Relocation domains. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 3.5.1 Characteristics of relocation domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 3.5.2 Steps for defining relocation domains. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 3.5.3 Steps for placing virtual servers into relocation domains . . . . . . . . . . . . . . . . . . . 31 3.6 Performing a relocation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 3.6.1 VMRELOCATE command. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 3.6.2 Performing the relocation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 3.7 Conditions that prevent a relocation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 Chapter 4. Scenario one: Creating a single system image cluster with four new z/VM members . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 4.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36 4.2 Setting up the SSI cluster . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36 4.2.1 Planning worksheet. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36 4.2.2 Hardware definition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 4.2.3 Defining the software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 4.2.4 Configuring the DASD. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 4.2.5 Configuring the network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40 4.2.6 Guests. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45 4.3 Installation process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45 4.3.1 Instplan command. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 4.3.2 INSTALL command. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 4.3.3 INSTSCID command. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 4.3.4 Configuring the system . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 4.3.5 Setting up the software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54 4.4 Relocation examples. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56 4.4.1 Live guest relocation for Linux on System z . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 4.5 Problems encountered . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 4.6 Lessons learned . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Chapter 5. Scenario two: Converting two existing stand-alone z/VM systems to a single system image cluster . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 5.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 5.1.1 Preparing and executing scenario two . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63 5.2 Setting up ITSOSSI5. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 5.2.1 Planning worksheet. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 5.2.2 Defining the hardware. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 5.2.3 Defining the software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 5.2.4 Installing the z/VM stand-alone client . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 5.2.5 Installing additional software products . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 5.3 Setting up ITSOSSI6. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 5.3.1 Defining the hardware. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 5.3.2 Defining the software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 5.3.3 Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 5.4 Converting ITSOSSI5 to a member of an SSI cluster . . . . . . . . . . . . . . . . . . . . . . . . . . 69 5.4.1 Setting RACF to use as a shared database . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69 5.4.2 Completing the conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 5.5 Creating an ITSOSSI6 system by cloning ITSOSSI5 . . . . . . . . . . . . . . . . . . . . . . . . . . 70 iv An introduction to z/VM Single System Image (SSI) and Live Guest Relocation (LGR) 5.5.1 Cloning ITSOSSI5. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 5.6 Suggestions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 5.7 Relocation examples. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 5.7.1 Live guest relocation of a z/VM guest . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 5.7.2 Relocating an SAP system in a typical System z setup . . . . . . . . . . . . . . . . . . . . 79 Appendix A. Frequently asked questions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87 A.1 Guests do not relocate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88 A.1.1 Linux with a DEVNO minidisk in use elsewhere . . . . . . . . . . . . . . . . . . . . . . . . . . 88 A.1.2 Linux with CMS mdisks defined . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89 A.1.3 Using a LINUX guest with V-Disk minidisk definition . . . . . . . . . . . . . . . . . . . . . . 90 A.1.4 Moving a CMS guest . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91 A.1.5 Using DEDICATE devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92 A.1.6 Live guest relocation of zLinux guests outside domains. . . . . . . . . . . . . . . . . . . . 97 A.1.7 Relocation exceeds MAXQUIESCE time . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98 A.1.8 Relocation exceeds available auxiliary paging space. . . . . . . . . . . . . . . . . . . . . . 99 A.1.9 Relocation exceeds available capacity of storage . . . . . . . . . . . . . . . . . . . . . . . 100 A.2 LPAR names are the same on separate CECs in the cluster . . . . . . . . . . . . . . . . . . . 101 A.3 Incorrect system name . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102 A.4 Recovery messages on the Linux console during relocation . . . . . . . . . . . . . . . . . . . 102 Appendix B. New and updated commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105 B.1 Single system image and live guest relocation commands . . . . . . . . . . . . . . . . . . . . 106 B.2 DIRMAINT commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107 B.2.1 Adding identities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107 B.2.2 Getting identities. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109 B.2.3 Using prototypes and batch functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109 B.3 VMSES commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111 Appendix C. Additional material . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113 Locating the web material . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113 Using the web material. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113 System requirements for downloading the web material . . . . . . . . . . . . . . . . . . . . . . . 113 Downloading and extracting the web material . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114 Related publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115 Other publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115 Online resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115 Help from IBM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115 Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117 Contents v vi An introduction to z/VM Single System Image (SSI) and Live Guest Relocation (LGR) Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service. IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to: IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A. The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice. Any references in this information to non-IBM websites are provided for convenience only and do not in any manner serve as an endorsement of those websites. The materials at those websites are not part of the materials for this IBM product and use of those websites is at your own risk. IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you. Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental. COPYRIGHT LICENSE: This information contains sample application programs in source language, which illustrate programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs. © Copyright IBM Corp. 2012. All rights reserved. vii Trademarks IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol (® or ™), indicating US registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both: AIX® MVS™ Tivoli® CICS® RACF® VTAM® DB2® Rational® WebSphere® ECKD™ Redbooks® z/OS® FICON® Redpapers™ z/VM® GDPS® Redbooks (logo) ® z/VSE® IBM® System z10® z10™ IMS™ System z® The following terms are trademarks of other companies: Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others. viii An introduction to z/VM Single System Image (SSI) and Live Guest Relocation (LGR)