Building Digital Libraries: Second Edition

265 Pages·2018·3.534 MB·English

by  Kyle Banerjee, Terry Reese Jr.

Building
Digital
Libraries
ALA Neal-Schuman purchases fund advocacy, awareness, and
accreditation programs for library professionals worldwide.
Building Digital Libraries
A How-To-Do-It Manual for Librarians®
SECOND EDITION
Kyle Banerjee and Terry Reese Jr.

Chicago 2019
KYLE BANERJEE has twenty years of library experience and extensive
systems knowledge. He has planned and written software to support library
systems migration since 1996. He is the coauthor of Building Digital Libraries
(2008) and Digital Libraries: Content and Systems (2006), and is the author
of numerous other publications.
TERRY REESE is the head of digital initiatives at the Ohio State University
Libraries. Over the past seventeen years, his research interests have centered
on the changing nature of library metadata and the ways in which this data
can be reused and transformed in different contexts. He is the author and
creator of MarcEdit, a cross-platform library metadata editing tool that
is designed to lower the technical barriers for users working with various
forms of library metadata, and is the coauthor of Building Digital Libraries
(2008), and is the author of numerous other publications.
© 2019 by the American Library Association
Extensive effort has gone into ensuring the reliability of the information in this
book; however, the publisher makes no warranty, express or implied, with respect
to the material contained herein.
ISBNs
978-0-8389-1635-3 (paper)
978-0-8389-1723-7 (PDF)
978-0-8389-1714-5 (ePub)
978-0-8389-1724-4 (Kindle)
Library of Congress Cataloging-in-Publication Data
Names: Banerjee, Kyle, author. | Reese, Terry, Jr., author.
Title: Building digital libraries : a how-to-do-it manual for librarians /Kyle
Banerjee, Terry Reese.
Description: Second edition. | Chicago : ALA Neal-Schuman, an imprint of the
American Library Association, 2019. | Series: How-to-do-it manuals for
librarians? | Includes bibliographical references.
Identifiers: LCCN 2018001090 | ISBN 9780838916353 (print : alk. paper) | ISBN
9780838917145 (epub) | ISBN 9780838917237 (pdf) | ISBN 9780838917244
(kindle : alk. paper)
Subjects: LCSH: Digital libraries.
Classification: LCC ZA4080 .R44 2018 | DDC 027—dc23
LC record available at https://lccn.loc.gov/2018001090
Composition by Dianne M. Rooney in the Minion Pro and Interstate typefaces.
This paper meets the requirements of ANSI/NISO Z39.48–1992
(Permanence of Paper).
Printed in the United States of America
23 22 21 20 19 5 4 3 2 1
Contents
ACKNOWLEDGMENTS xi
INTRODUCTION xiii
Chapter 1 Getting Started 1
Should You Build a Repository? 1
Selling the Project 6
Getting Your Repository off the Ground 10
Chapter 2 Choosing a Repository Architecture 13
Questions to Ask before Choosing an Architecture 13
Who Are the Users and What Do They Need? 14
What Types of Collections Will It Contain? 15
How Are Assets Acquired? 15
What Rights Management and Access Controls Do You Need? 16
How Does the Repository Handle Preservation? 17
How Will the Repository Be Managed? 19
Other High-Level Platform Decisions 19
Building the Requirements List 25
General 25
Metadata 25
Automation 26
Access Control 26
Resource and Data Management 26
v
Contents
Chapter 3 Acquiring, Processing, Classifying,
and Describing Digital Content 27
Planning Workflow 27
Collection Development 29
Acquiring Content 32
Object Requirements 33
Transform 33
Kick the Can down the Road 34
Outsourcing 35
Organizing Content and Assigning Metadata 36
Structuring Content 37
Crowd-Sourcing 40
Resource Identification 41
Setting Up Workflow 44
Batch Processes 44
Rights Management 45
Protecting the Integrity of Resources 46
Chapter 4 Preservation Planning 49
What Is Digital Preservation? 50
Preserving the Content and Context, Not the Medium 52
Why Preservation Doesn’t Happen 56
The Maturity Model 58
Preservation File Formats 59
Cloud-Based Digital Preservation Services 60
Summary 62
Chapter 5 General-Purpose Technologies Useful
for Digital Repositories 65
The Changing Face of Metadata 66
XML in Libraries 67
XHTML 68
XPath 70
vi
Contents
XForms 71
XSLT 71
XLink 71
XQuery 72
XPointer 72
XML Schema 72
Why Use XML-Based Metadata 79
XML Is Human-Readable 79
XML Offers a Quicker Cataloging Strategy 86
Multi-Formatted and Embedded Documents 88
Metadata Becomes “Smarter” 89
Metadata Becomes “Connected” 89
Not Just a Library Standard 98
JSON 98
Data Manipulation 104
Programming Languages 104
Programming Tools 105
Software Tools 106
Application Development 107
REST (Representational State Transfer) 107
SPARQL (SPARQL Protocol and RDF Query Language) 108
SRU (Search and Retrieval via URL) 108
Code Management 108
Future of Software Development 109
Mobile Application Development 110
Applications Continue to Become More Micro 110
Deeper Reliance on Interpreted Languages and JavaScript 110
Sharing Your Services 111
Summary 112
Chapter 6 Metadata Formats 115
Metadata Primitives 116
MARC 118
MARC21XML 122
Dublin Core 123
MODS 129
METS 132
IIIF 135
BIBFRAME 140
vii
Contents
Domain-Specific Metadata Formats 141
Embedded Metadata Formats 143
PCDM (Portland Common Data Model) 143
Semantic Web 144
Summary 150
Chapter 7 Sharing Data: Harvesting, Linking,
and Distribution 153
The Evolving Role of Libraries 154
Metadata Doesn’t Want to Be Free . . . If It Did,
It Would Be Easy 155
Linked Data 157
Sharing Metadata 160
XSLT 160
XQuery 165
Metadata Crosswalking 166
OAI-PMH 170
OAI-PMH Verbs 171
Facilitating Third-Party Indexing 179
Metadata Repurposing 180
The Oregon State University Electronic Theses Process 180
The Ohio State University Libraries: Automatic Data Transfer
of Digital Content between the Internet Archive and the HathiTrust 182
Summary 184
Chapter 8 Access Management 187
Copyright 187
Access Control Mechanisms 192
Lightweight Directory Access Protocol (LDAP) 193
Single Sign-On (SSO) 194
Central Authentication Service (CAS) 195
Security Assertion Markup Language (SAML) 195
Shibboleth 195
OpenID 196
OAuth and Social Media Authentication 196
Athens 197
Active Directory 197
viii
Contents
Internal Authentication 197
IP-Based Authentication 198
Vended Authentication 198
Implementing Access Control 199
Chapter 9 Thinking about Discovery 201
Unpacking Discovery? 202
Federated Search and Digital Libraries 204
Why Think about Discovery 205
Current Research 206
Searching Protocols 208
Z39.50 209
SRU/SRW 211
OpenSearch 216
Linking Protocols 219
OpenURL 220
DOI (Digital Object Identifiers) 221
Search Engine Support 223
Evaluating User Needs 223
Developmental Needs 224
User Needs 224
Summary 225
Chapter 10 Planning for the Future 227
Providing Information That People Need 227
Libraries’ New Roles 228
Learning from the Past 230
Adapting to Change 233
Consolidation and Specialization 235
The Shared Environment 236
Federated Vocabularies 240
Summary 241
INDEX 243
ix