Behind The Firewall, Big Data and the Hidden Web, Tom Jenkins, April 2012 OpenText Chairman ...

176 Pages·2012·12.55 MB·English

BIG DATA AND THE HIDDEN WEB:
The Path to Enterprise Information Management

This book is dedicaTed To
John shackleton
President and Chief Executive Officer
of Open Text Corporation 1998 - 2012
John’s strong leadership and focus on collaboration amongst all the participants,
from users to architects to software developers, systems integrators, and user
support has been a great benefit to the Enterprise Content Management industry.
John introduced many industry firsts in education, first-time integrations, and
above all the integration of content management information into ERP systems
and desktop GUIs. His contribution has positioned the industry for continued
growth into the future into even more integrated enterprise applications using all
aspects of business information.
Publishing information
Jenkins, Tom
Behind the Firewall. Big Data and the Hidden Web:
The Path to Enterprise Information Management
First Printing, April 2012
Printed in Canada
ISBN 978-0-9730662-9-6
$29.00 US
Published by: Open Text Corporation
275 Frank Tompa Drive, Waterloo, Ontario Canada N2L 0L1
519-888-7111
[email protected]
www.opentext.com
All rights reserved. Copyright © 2012 Open Text Corporation. No part of
this book may be reproduced or transmitted in any form or by any means,
electronic or mechanical, including photocopying, recording, scanning, or
by any information or retrieval system, without the express written consent
of Open Text Corporation. Open Text Corporation will seriously consider any
request to reproduce or use portions of this book, and would encourage any
party interested in doing so to contact: [email protected]. In
the event such consent is provided, Open Text Corporation will reserve the
right to review and approve the final form and manner in which the portion
of this book is reproduced and used.
Special thanks go to writers and editors: Jodi Szimanski,
Elizabeth Chestney-Hanson, and Doug Varley; editor Ian E. Wilson; librarian
Annie Bélanger; researcher Scott Stevens.
FOREWORD
What’s past is pROlOguE.
(William shakEspEaRE. The TempesT)
Our future is rooted in our past. To understand what lies ahead for A subsequent book, Managing Content in the Cloud, addresses the
OpenText and Enterprise Information Management (EIM), an appreciation future of information management. It provides a beginner’s guide to
of the last 20 years is required as the industry has grown, changed, understanding the Cloud and ECM and how to develop and manage
and continually re-invented itself. This book chronicles this tremendous enterprise applications. And that brings us to this book, Behind the
evolution, following content in its many forms that some 500 million Firewall, which outlines how Big Data and the Hidden Web (behind the
people, or about one third of Web users across the globe have created, firewall) was built by OpenText and other companies, and how and why
shared, stored, and managed over the past 20 years since the birth of the the core technologies were developed. The standards of today were built
modern Internet. As society is continually impacted by the combination on the infrastructures of the past. By understanding this past, we can see
of content and technology, the future implies a necessary agreement on that it provides signposts to many of the solutions to the challenges of
standards among enterprise users throughout the world. the future.
This book is as much about the future as it is about the past. Ten years
ago, we wrote the Enterprise Content Management (ECM) trilogy in which
we defined the ECM market, described technologies, and provided a
proven methodology for implementation. An encyclopedia of ECM, this
set of books consists of over 1,000 pages of information on all major
Tom Jenkins
aspects of ECM. Reading these books will give you the basic knowledge
Executive Chairman and Chief Strategy Officer,
needed to discuss ECM and its solutions, technologies, and bench-
Open Text Corporation
marking practices for successful deployment. This is a key base from
which to understand the future of Enterprise Information Management.
the
INTRODUCTION
AIpbdnttrBbOehaihkee OclbufOnrtrfeealpcatthrnchoaiwpuscodyhna sooeUeacuieoudse od hednmnntnnihmiT ngnoilnoeian e Tstgtierah t Ttststs e,doeTes ee i ldaea ,stxprciosf Hon.tnpxesdt o twsto li ft wit I coeNinlO ibuasm n S nashomIorugpsaauinnp hr ggymn tB pc rlt aseatedbaoa alehocoielcrO nbencsonudnete temocrrq adlh iTcO.ebiagans eonl zgeruseiuslyhsrbaeT mecadKa.exe.is ,m inilth stmbudt mne a pciiiiu eTeoostzdtn osaasenhsitbnarrnee hmoinr eainpeceanuttasynnaniiet sdtr pe errmo si d oesmprscoacladsCw n tuentchoaoph nna oo sessednr snmotai y.flrmstesntba uueasesfr osempFbt yregnr tp eiy 2mxovtiehais e gcaanosll,ii0rnff a terimbiavni.g dtoni n0rnyseadeltyyt eae ete.ei 0hdc, e e ciyci hn idtle.ttil aCet. lhinascoteti s v ln sho oalWg m To pepdfsdc sensmb,h nai loiuth eote oosyese saOipwstanocne fncmctrlhmta tup wtlievote oo piesenetmeo damrasam wnl asyrinwnleainarnpe vern,eoettT dtraeegnero ,ie see r tg in b dt sfo sx esg ,e t B“H F“iaCluu Trd“Wlnsouoh Tbreedmaohsmieefic ttmcal ru nrhcplrttdaraoee eu JiStyrrdtaretegoaeiy et tnsebiun ehratn k hy esannWnti ogccn-nOedeOhaews e wpI lm ennTd seeoo ko egp optnrslltoeoybgorne sT ,o,saik g a elAoGsfnneri exiuueec2ibo tsztchrst hiwsm aoc l tu0oitith.onoato isrHii otn ne eepo efyenadsfufYrn slo LalTfsti lveeoocn l.ya”sviarm dcoeie antnce nr h sJeatu rteeeaegsesnntsmgsierns,k rp igs aaEoinre ontnCCiuteslsrdovMtedo f mi eti-nd hnctswm uIoo ehcaincu ln dilntutsnetreid dienveobt eceninntoeohsrotd osta neam sokogtiv n rifeeoEEn dPnc nCra t uerttchtMah e sotmectirt hltsifioplairo aacoa mrnternbire sa ee sofne6cgoerar h0esrCan, n.m Stsoi”ciooutnoaerrlcatsnon ehbte,gten u t aygsathssti rMciiiu ensnc dA aofebddirnmseoeavsasssoap g.mtcnk”lrerit uaiaambcnngeteeacundegrt ,eea : r nsd, OPETNEX: TBuilding The Hidden Web WhfiwittinoioorBhnmiadowetukv eafndrrwaioerirathlLdte und rrnhaieo n mnna.l2we a hrdl g dTg,t0wakoe tee—hy ats hwt eeymiee nhoeboep ct ieoein ze.traa ri rhnff t a nrIFwnia’tsettbssiet ’n irh kse uoradeeda a ewrgsnaaewsc ptdicosn ev cnmraw oea,edbeie lsnnlnolalbs lseeo dtsoakhrwusisnpl be neaatd eooe solsesoe ’ nrd .ttlr unfa mlohoai po Wmottefa totohr evgttxhtpemudh e ehlaeew aisae rimomt xc Is oy ipanu“titt im pswhkehohtnsdteeeed it eeasedoer r sarpnaldtfbhnt a mhotpeeheoetsiierintoeonhwonta .r d sn iutgls4w nYs.io c n rno0ieowdeo abtdf tnb nnsyi lt tutt e ”httjhehhasuee—.eoae entidsnIn rr fn t syt
Martin White, EContent Magazine, USA $48.00 U.S.
Copyright © 2011 by Open Text Corporation. All rights reserved. Printed in Canada.
CONtENts
9 81 153
naVigating bEhinD thE firEWall ChaPtEr 3 glossary
How to Find your Way Through the Book Everyone Gets Connected
165
13 105
bibliograPhy
introDuCtion ChaPtEr 4
Our Future is Rooted in our Past Some Call it an Evolution
170
innoVator story bibliograPhy
19 133
ChaPtEr 1 ChaPtEr 5
171
Laying the Foundation The Path of the Future
inDEX
51 149
ChaPtEr 2 looKing to thE futurE
Connecting to the Internet By Mark Barrenechea
hOW thE hiDDEN WEb Was built
Web Operating Enterprise Information
Web 4.0
System Management
Customer Experience Enterprise Content Business Process
Web 3.0 Cloud/Mobile
Management Management Management
Digital Asset Content Lifecycle Transactional Content
Web 2.0 Web Social Networks
Management Management Management
Web Content Web Records
Web 1.0 Internet Email/Chat Archiving
Management Crawler Management
Document
Client/Server Connectivity Search Engine Workflow
Management
Pre-Web
Networking
Mainframe Data Capture Document Capture Digital Mailroom
Standards
ERA DATE PLATFORM TECHNOLOGIES
8 / behiNd The FiReW aLL
NaVigatiNg bEhiND thE FiREWall
hoW to finD your Way through thE booK
since the 1970s, there have been extraordinary innovations in the technology industry. The use of mainframe computers in large organizations initiated the trend
of using computers to help organizations work more efficiently. Early commercialization in the computing industry laid the groundwork for later developments in Web
technologies and the resulting proliferation of content in all formats, both within and outside of the enterprise.
The journey described in this book begins with these technologies, many of which were in development before openText existed. it winds its way through stories
about how technology impacted the enterprise, how the enterprise affected technology, and how consumers have brought technologies inside the firewall to
influence how they are used inside the enterprise. The journey is marked by eras and the evolution of Enterprise Information Management (EIM) is progressive; the
core technologies developed in each era are dependent on their predecessors.
1970s 1980s 1990s 2000s 2010s
IBM® Microsoft® SAP® Open Text Various
Clerical Personal Departmental Org. Compliance
Mobility
Productivity Productivity Productivity & Productivity
Email; Desktop
Data Processing ERP ECM EIM
Publishing
Computing Personal Ubiquitous Web as an
Mainframe LAN
Environment Computer Computing operating system
Eras of computing
The era that describes early technology development and the beginnings of EIM is called PRE-WEB. chapter 1 examines this era and the technologies that were
required in the 1970s and 1980s to automate systems in the enterprise, on-ramp content that only existed in paper format, and store, manage, and make this content
accessible for future use.
NaViGaTiNG behiNd The FiReW aLL / 9
Web Content Web Records
Web 1.0 Internet Email/Chat Archiving
Management Crawler Management
Document
Client/Server Connectivity Search Engine Workflow
Management
Pre-Web
Networking
Mainframe Data Capture Document Capture Digital Mailroom
Standards
WEb 1.0, introduced in chapter 2, covers the 1990s and mainstream use of the internet. it describes the tools that were needed to develop content for the internet
and to search the overwhelming proliferation of pages and information. Basic workflow technologies emerged over the Web as users wanted to perform repeatable
tasks and this evolved as efficiency tools inside the enterprise were created so the content and people could be brought together within a set of business rules.
With the millennium came WEb 2.0 and many of the Web 1.0 technologies converged and matured. chapter 3 follows how the Web evolved. With it, technology
emerged to manage not only digital assets, but interactivity behind the firewall that allowed knowledge workers to engage with others inside and outside their
organization. This enabled the conversations that led to online management of transactions through a lifecycle that connects people, processes, and content across
an organization.
Customer Experience Enterprise Content Business Process
Web 3.0 Cloud/Mobile
Management Management Management
Web 2.0 Web Digital Asset Social Networks Content Lifecycle Transactional Content
Management Management Management
WEb 3.0 is described in chapter 4, and this era bears witness to the revolutionary blend of mainframe and Web technologies to produce cloud computing. This, when
combined with mobile devices, not only improves customer experience, but gives both consumers and organizational users the ability to access applications and
content at any time, in any place. During this era, ECM becomes a required solution to help many organizations securely control the burgeoning amounts of content
behind the firewall. Organizations are impacted by the “Consumerization of IT” as users demand that applications have the ability to use their personal mobile
devices within a cloud computing environment and the need to securely manage content outside the firewall becomes apparent.
All of these technologies culminate in the final era, WEb 4.0, described in Chapter 5 of this book—Web Operating System and Enterprise Information Management.
Without cloud technology, mobile applications, or “apps”, and their associated content could not be accessed securely within the enterprise. And the secure
repositories of ECM have paved the way for the future development and management of enterprise applications. Chapter 5 examines the use of the Web as an
operating system, and mobile apps and Enterprise Information Management in detail.
10 / behiNd The FiReW aLL