Learning Cassandra for Administrators Optimize high-scale data by tuning and troubleshooting using Cassandra Vijay Parthasarathy BIRMINGHAM - MUMBAI Learning Cassandra for Administrators Copyright © 2013 Packt Publishing All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews. Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book. Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information. First published: November 2013 Production Reference: 1181113 Published by Packt Publishing Ltd. Livery Place 35 Livery Street Birmingham B3 2PB, UK. ISBN 978-1-78216-817-1 www.packtpub.com Cover Image by Faiz Fattohi ([email protected]) Credits Author Copy Editors Vijay Parthasarathy Alisha Aranha Dipti Kapadia Reviewers Sayanee Mukherjee Robert E. McFrazier Aditya Nair Brian O'Neill Kirti Pai Ricardo J. S. Teixeira Shambhavi Pai Lavina Pereira Acquisition Editors James Jones Indexers Grant Mizen Rekha Nair Tejal R. Soni Commissioning Editor Manasi Pandire Graphics Ronak Dhruv Technical Editors Abhinash Sahu Gaurav Thingalaya Dennis John Production Coordinator Manu Joseph Project Coordinator Suraj Bist Cover Work Manu Joseph Proofreader Paul Hindle About the Author Vijay Parthasarathy is an Apache Cassandra Committer who has helped multiple companies use Cassandra successfully; most notably, he was instrumental in Netflix's move into Cassandra. Vijay has multiple years of experience in software engineering and managing large project teams. He has also successfully architected, designed, and developed multiple large-scale distributed computing systems, distributed databases, and highly concurrent systems. I want to thank my wife, Narmadhadevi, and the rest of my family, who supported and encouraged me in spite of all the time it took me away from them. About the Reviewers Robert E. McFrazier is an open source developer, manager, trainer, and architect. Having started with web development, he was able to progress in his career in multiple roles including developer, trainer, build/release engineer, architect, and manager. He has been working primarily in PHP web development, but he also has experience in Java development, AWS cloud, message queues, Hadoop, Cassandra, and creating high-volume SOAP/REST API services. Robert has worked for many software companies including Nordstrom.com, InfoSpace, Clear, RealNetworks, and Arise Virtual Solutions. I'd like to thank my wife, Toni, and my son, Robbie, for being the inspiration to continue learning and growing. Brian O'Neill likes to describe himself as a father, husband, hacker, hiker, kayaker, fisherman, Big Data believer, innovator, and a distributed computing dreamer. Brian has been a technology leader for over 15 years. He has experience as an architect in a wide variety of settings, from startups to Fortune 500 companies. He believes in open source and contributes to numerous projects. He leads projects that extend Cassandra and integrate the database with full-text indexing engines, distributed processing frameworks, and analytics engines. He won the InfoWorld's Technology Leadership award in 2013. He has authored the Dzone reference card on Cassandra and was nominated as a DataStax Cassandra MVP in 2012. In the past, Brian has contributed to expert groups within the Java Community Process (JCP), and he has patents in artificial intelligence and context-based discovery. Brian is proud to hold a B.S. in C.S. from Brown University. Presently, Brian is the Chief Architect at Health Market Science (HMS), where he heads the development of their Big Data platform focused on data management and analysis for the Healthcare space. The platform is powered by Storm and Cassandra and delivers real-time data management and analytics as a service. Brian is currently co-authoring a book scheduled to be published in December 2013, Storm Blueprints for Distributed Computing, Packt Publishing. To my wife Lisa, it is in your sail's angelic wake that I find balance You lift me up and keep me from capsizing. I love you And to the silverback, for keeping my feet firmly on the ground While the greyback let me dream among the clouds To my sons, you are my inspiration, the wind at my back The stars wait for you. Without all of you, this ink would never have met this page. Ricardo J. S. Teixeira is a Portuguese computer engineer. He currently lives with his family in Vila do Conde, a quiet city by the Atlantic ocean. He is interested in how Big Data technologies can be used to solve common business problems. Ricardo reviewed this book while he was writing a thesis for his Master's degree on leveraging Big Data technologies (such as Storm and Cassandra) to acquire near real-time metrics for a large retail store chain. I would like to thank my parents, my brother, Milai, and Áurea for all the times they waited patiently while I was hunched over my laptop. www.PacktPub.com Support files, eBooks, discount offers and more You might want to visit www.PacktPub.com for support files and downloads related to your book. Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.PacktPub. com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at [email protected] for more details. At www.PacktPub.com, you can also read a collection of free technical articles, sign up for a range of free newsletters and receive exclusive discounts and offers on Packt books and eBooks. TM http://PacktLib.PacktPub.com Do you need instant solutions to your IT questions? PacktLib is Packt's online digital book library. Here, you can access, read and search across Packt's entire library of books. Why Subscribe? • Fully searchable across every book published by Packt • Copy and paste, print and bookmark content • On demand and accessible via web browser Free Access for Packt account holders If you have an account with Packt at www.PacktPub.com, you can use this to access PacktLib today and view nine entirely free books. Simply use your login credentials for immediate access. Table of Contents Preface 1 Chapter 1: Basic Concepts and Architecture 5 CAP theorem 5 BigTable / Log-structured data model 6 Column families 6 Keyspace 7 Sorted String Table (SSTable) 7 Memtable 7 Compaction 8 Partitioning and replication Dynamo style 8 Gossip protocol 8 Distributed hash table 9 Eventual consistency 10 Summary 10 Chapter 2: Installing Cassandra 11 Memory, CPU, and network requirements 11 Cassandra in-memory data structures 12 Index summary 12 Bloom filter 12 Compression metadata 12 SSDs versus spinning disks 13 Key cache 13 Row cache 14 Downloading/choosing binaries to install 14 Configuring cassandra-env.sh 14
Description: