Data Architecture: From Zen to Reality

442 Pages·2011·2.28 MB·English

by  Charles Tupper

Data Architecture
This page intentionally left blank
Data Architecture
From Zen to Reality
Charles D. Tupper
AMSTERDAM • BOSTON • HEIDELBERG • LONDON
NEW YORK • OXFORD • PARIS • SAN DIEGO
SAN FRANCISCO SINGAPORE • SYDNEY • TOKYO
Morgan Kaufmann Publishers is an imprint of Elsevier
Acquiring Editor: Jenifer Niles
Development Editor: David Bevans
Project Manager: Danielle S. Miller
Designer: Alisa Andreola
Morgan Kaufmann is an imprint of Elsevier
30 Corporate Drive, Suite 400, Burlington, MA 01803, USA
© 2011 Elsevier Inc. All rights reserved
No part of this publication may be reproduced or transmitted in any form or by any means, electronic
or mechanical, including photocopying, recording, or any information storage and retrieval system,
without permission in writing from the publisher. Details on how to seek permission, further
information about the Publisher’s permissions policies and our arrangements with organizations such
as the Copyright Clearance Center and the Copyright Licensing Agency, can be found at our
website: www.elsevier.com/permissions.
This book and the individual contributions contained in it are protected under copyright by the
Publisher (other than as may be noted herein).
Notices
Knowledge and best practice in this field are constantly changing. As new research and experience
broaden our understanding, changes in research methods or professional practices, may become necessary.
Practitioners and researchers must always rely on their own experience and knowledge in evaluating
and using any information or methods described herein. In using such information or methods they should be
mindful of their own safety and the safety of others, including parties for whom they have a professional responsibility.
To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors, assume
any liability for any injury and/or damage to persons or property as a matter of products liability,
negligence or otherwise, or from any use or operation of any methods, products, instructions, or
ideas contained in the material herein.
Library of Congress Cataloging-in-Publication Data
Tupper, Charles.
Data architecture : from zen to reality / Charles Tupper.
p. cm.
Includes bibliographical references and index.
ISBN 978-0-12-385126-0 (pbk.)
1. Data structures (Computer science) 2. Software architecture. I. Title.
QA76.9.D35T85 2011
005.12—dc22 2010049600
British Library Cataloguing-in-Publication Data
A catalogue record for this book is available from the British Library.
ISBN: 978-0-12-385126-0
Printed in the United States of America
11 12 13 14 15 10 9 8 7 6 5 4 3 2 1
For information on all MK publications visit our website at www.mkp.com
Dedications
I dedicate this book to Carol Ann Dawes, for her profound
friendship and endless belief in me; to my wife, who has unwav-
eringly supported me in this endeavor; and most of all, to my
friend and mentor, Richard Yevich (may you rest in peace),
for without his trust and faith in me, this would never have
happened.
Wherever you are, Richard, I hope you are smiling because,
yes, it’s finally done.
This page intentionally left blank
CONTENTS vii
CoNtENts
Preface .........................................................................................................xxi
sECtioN 1 thE PriNCiPLEs
Chapter 1 Understanding Architectural Principles ........................................3
Defining Architecture .....................................................................................3
Design Problems ............................................................................................6
Patterns and Pattern Usage ...........................................................................7
Concepts for Pattern Usage ..........................................................................8
Information Architecture ..............................................................................11
Structure Works! ..........................................................................................12
Problems in Architecture ............................................................................. 14
Architectural Solutions ................................................................................16
The “Form Follows Function” Concept ......................................................17
Guideline: Composition and Environment .................................................19
Guideline: Evolution .....................................................................................19
Guideline: Current and Future .....................................................................19
Data Policies (Governance), the Foundation Building Codes ..................21
Data Policy Principles ..................................................................................21
Chapter 2 Enterprise Architecture Frameworks and
Methodologies ........................................................................................................23
Architecture Frameworks ............................................................................23
Brief History of Enterprise Architecture .....................................................26
The Zachman Framework for Enterprise Architecture ..............................26
The Open Group Architecture Framework .................................................29
The Federal Enterprise Architecture ...........................................................33
Conclusions ..................................................................................................40
Enterprise Data Architectures .....................................................................41
Enterprise Models ........................................................................................42
The Enterprise Data Model .........................................................................43
The Importance of the Enterprise Data Model ..........................................44
Object Concepts: Types and Structures Within Databases .......................45
Inheritance ....................................................................................................45
viii Contents
Object Life Cycles ........................................................................................45
Relationships and Collections ....................................................................46
Object Frameworks ......................................................................................46
Object Framework Programming ...............................................................47
Pattern-Based Frameworks .........................................................................48
Architecture Patterns in Use .......................................................................48
U.S. Treasury Architecture Development Guidance ..................................49
TADG Pattern Content .................................................................................49
TADG Architecture Patterns ........................................................................50
IBM Patterns for e-Business ........................................................................50
Enterprise Data Model Implementation Methods .....................................53
Chapter 3 Enterprise-Level Data Architecture Practices ............................57
Enterprise-Level Architectures ....................................................................57
System Architectures ...................................................................................58
Enterprise Data Architectures .....................................................................58
Enterprise Technology Architectures ..........................................................58
Enterprise Architecture Terminology—Business Terms .............................59
The Enterprise Model ..................................................................................60
The Enterprise Data Architecture from a Development Perspective .......60
Subject Area Drivers ....................................................................................62
Naming and Object Standards ...................................................................63
Data Sharing ................................................................................................64
Data Dictionary–Metadata Repository .......................................................66
Domain Constraints in Corporate and Non-Corporate Data ....................67
Organizational Control Components .........................................................67
Data Administration .....................................................................................68
Database Administration .............................................................................68
Setting Up a Database Administration Group. ..........................................70
Repository Management Areas and Model Management .......................72
Chapter 4 Understanding Development Methodologies .............................75
Design Methods ...........................................................................................75
Why Do We Need Development Methodologies? ..................................... 76
The Beginnings ............................................................................................77
Structured Methods .....................................................................................77
Structured Programming ............................................................................79
Structured Design ........................................................................................79
Contents ix
Structured Analysis .....................................................................................80
Still Having Problems ..................................................................................81
Requirements Definitions ...........................................................................81
Problems with Structured Approaches ......................................................81
Personal Computers and the Age of Tools .................................................82
Engineering Concepts Applied ...................................................................83
Other Principles Utilized ..............................................................................84
The Birth of Information Engineering ........................................................84
Information Engineering as a Design Methodology .................................85
The Synergy of Tools and Information Engineering .................................87
Problems with Information Engineering ...................................................88
Implementing the Best of IE while Minimizing Expense ..........................89
sECtioN 2 thE ProBLEM
Chapter 5 Business Evolution ...........................................................................95
The Problem of Business Evolution ...........................................................95
Expansion and Function Separation ..........................................................96
Separate Function Communication............................................................96
Manual Data Redundancy ...........................................................................97
Data Planning and Process Planning .........................................................99
Corporate Architecture ..............................................................................100
Using Nolan’s Stages of Growth ...............................................................102
Problems with Older Organizations ..........................................................103
Business Today ............................................................................................104
When Will It End? ........................................................................................106
What Can We Do about It? .........................................................................107
Generic Subject Areas for Corporate Architectures .................................108
Corporate Information Groupings or Functional Areas ...........................110
Corporate Knowledge ................................................................................114
Chapter 6 Business organizations .................................................................117
Purpose and Mission of the Organization ................................................117
Ideology, Mission, and Purpose ................................................................118
Design with the Future of the Organization in Mind ...............................120
Generalize for Future Potential Directions ...............................................121
Organizational Structure ...........................................................................123
What Are the Basic Functions in an Organization? .................................124