Digital Video

450 Pages·2002·50.121 MB·English

by  Barry G. Haskell, Atul Puri, Arun N. Netravali (auth.)

KLUWER ACADEMIC PUBLISHERS
NEW YORK, BOSTON, DORDRECHT, LONDON, MOSCOW
eBookISBN: 0-306-46982-0
Print ISBN: 0-412-08411-2
©2002 Kluwer Academic Publishers
New York, Boston, Dordrecht, London, Moscow
All rights reserved
No part of this eBook may be reproduced or transmitted in any form or by any means, electronic,
mechanical, recording, or otherwise, without written consent from the Publisher
Created in the United States of America
Visit Kluwer Online at: http://www.kluweronline.com
and Kluwer's eBookstore at: http://www.ebooks.kluweronline.com
To our families
Ann, Paul, and Andrew
Diane
Chitra, Ilka, andRavi
CONTENTS
Dedication v
Preface xiii
Acknowledgments xiv
1 Introduction to Digital Multimedia, Compression,
and MPEG-2 1
1.1 The Digital Revolution 1
1.2 The Need for Compression 3
1.3 Considerations for Compression 4
1.4 Compression Technology 6
1.5 Videophone andCompact DiskStandards—H.320
and MPEG-1 9
1.6 The Digital Entertainment TV Standard—MPEG-2 9
1.7 Complexity/Cost 12
References 13
2 Anatomy of MPEG-2 14
2.1 MPEG-1 14
2.2 MPEG-2 16
2.2.1 MPEG-2 Systems 17
2.2.2 MPEG-2 Video 18
2.2.3 MPEG-2 Audio 21
2.2.4 MPEG-2 Conformance 22
2.2.5 Software 24
2.2.6 DSM-CC 24
2.2.7 MPEG-2 NBC Audio 26
2.2.8 10-bit video (cancelled!) 27
2.2.9 MPEG-2 RTI 27
2.2.10 MPEG-2 DSM-CC Conformance 28
vii
viii Contents
2.3 Summary 28
References 29
3 MPEG-2 Systems 32
3.1 Multiplexing 32
3.2 Synchronization 32
3.3 Elementary Streams 33
3.4 Programs and Nonelementary Streams 37
3.4.1 Program Streams 37
3.4.2 Transport Streams 40
3.4.3 Descriptors 50
3.5 PracticalSystemsDecoders 52
3.6 Practical Systems Encoders 53
3.7 Conclusion 54
References 54
4 Audio 55
4.1 Introduction 55
4.2 Audio Compression Fundamentals 56
4.3 MPEG-1 58
4.3.1 PsychoacousticModel 60
4.3.2 MPEG-1 Syntaxand Semantics 62
4.3.3 Layer I Coding 63
4.3.4 Intensity_Stereo Mode 64
4.3.5 Layer II Coding 64
4.3.6 Layer III 67
4.3.7 MS_Stereo Mode 69
4.4 MPEG-2 Audio 71
4.4.1 MPEG-2 Backward Compatible (BC) 71
4.4.2 Subband Groups 72
4.4.3 DynamicTransmissionChannelSwitching 72
4.4.4 Dynamic Crosstalk 72
4.4.5 Adaptive Multichannel Prediction 73
4.4.6 Phantom Codingof the Center Channel 73
4.4.7 MultilingualChannels 73
4.4.8 Syntax and Semantics of MPEG-2-BC Audio 73
4.4.9 MPEG-Non Backward Compatible (NBC) 78
References 79
5 Video Basics 80
5.1 Video Imaging 80
5.2 The human Visual System and Color TV 86
5.3 FromAnalogto DigitalVideo 91
5.4 Spatial Conversions 96
5.5 TemporalConversions 102
5.6 Mixing and Keying 106
5.7 Summary 107
References 108
Contents ix
6 Digital Compression: Fundamentals 110
6.1 Limitations of the Television Camera 110
6.2 Numerical Representation 110
6.3 Basic Compression Techniques 116
6.4 PredictiveCoding(DPCM) 117
6.5 Block Transform Coding 132
6.6 Hybrid Transform Coding 136
6.7 Vector Quantization 138
6.8 Motion Adaptive Interpolation 139
6.9 Incorporation of Perceptual Factors 140
References 145
7 Motion Compensation Modes in MPEG 146
7.1 Coding of Progressive Scanned Video 146
7.2 Coding of Interlaced Video 149
7.3 Choosing the Mode of Motion Compensation 154
7.4 Codingthe MotionVectors 154
References 155
8 MPEG-2 Video Coding and Compression 156
8.1 MPEG-2 Chrominance Sampling 156
8.2 Requirements of the MPEG-2 Video Standard 157
8.3 Main Profile Algorithm Overview 158
8.4 Overview of the MPEG-2 Video Stream Syntax 161
8.5 Typical Encoder Architecture 170
8.6 Typical Decoder Architecture 173
8.7 MPEG-2 Error Concealment 174
8.8 Performance of MPEG-2 175
References 181
9 MPEG-2 Scalability Techniques 183
9.1 ScalabilityBasics 184
9.2 Data Partitioning 185
9.3 SNR Scalability 190
9.4 SpatialScalability 197
9.5 Temporal Scalability 213
9.6 Hybrid Scalability 224
9.7 Scalability Summary 228
References 229
10 Video Stream Syntax and Semantics 230
10.1 Video Stream Syntax 230
10.2 Semanticsforthe SyntaxVariables 231
References 257
11 Requirements and Profiles 258
11.1 MPEG-2 Requirements 258
11.2 The Development Process 260
x Contents
11.3 BasicProfiles Hierarchy 261
11.4 BasicProfiles Interoperability 268
11.5 Basic Profiles VerificationTests 271
11.6 NewProfiles 274
11.7 NewProfiles Interoperability 276
11.8 Decoders andBitstream Compatibility 277
11.9 Summary 277
References 278
12 Digital Video Networks 280
12.1 CurrentMethodsofAccess1–5 282
12.2 New Broadband Wired Access Scenarios6–12 283
12.3 WiredAccessCompared 285
12.4 TerrestrialBroadcasting12 286
12.5 DirectBroadcastSatellites14 289
References 291
13 Interactive Television 292
13.1 Customer PremisesEquipment 294
13.2 InteractiveTelevision Servers 296
13.3 UserInterfaces10–12 302
13.4 Content Creation for ITV14–l9 304
References 306
14 High-DefinitionTelevision(HDTV) 307
14.1 Characteristics of HDTV 308
14.2 Problems of Current Analog TV 310
14.3 Grand Alliance HDTV System 311
14.4 Performance of MPEG-2 on HDTV Pictures 316
14.5 Evolution of HDTV 320
References 320
15 Three-Dimensional TV 322
15.1 Basics of 3D 323
15.2 Techniques for 3D Viewing 327
15.3 Stereoscopic Imaging and Display 334
15.4 Stereoscopic Geometry and HumanFactors 338
15.5 Video Compression for Stereoscopic 3DTV 344
15.6 Multiviewpoint Video 353
15.7 Summary 358
References 358
16 ProcessingArchitecture and Implementation 361
Dr. Horng-Dar Lin
16.1 MPEG Processing Requirements 361
16.2 Architectural Choices and Examples 362
16.3 Design Issues 366
16.4 Directions in MPEG Chip Development 367
Contents xi
16.5 Summary 367
References 368
17 MPEG-4 and the Future 369
17.1 H.263: The ITU-T Low-Bitrate Standard 370
17.2 Coding Advances 382
17.3 Introduction to MPEG-4 387
17.4 MPEG-4 Requirements 388
17.5 MPEG-4 Video 391
17.6 MPEG-4Audio 399
17.7 MPEG-4 Syntax Description Language (MSDL) 399
17.8 Synthetic and Natural Hybrid Coding (SNHC) 405
17.9 The Future 408
1 7 .1 0 Summary 410
References 410
AppendixA: Resource Guide 413
AppendixB: MPEG Committee 422
MPEG Membership List 423
Index 429
PREFACE
On November 11,1994 the ISO* Moving Picture an art that many vendors keep as a closely held
Experts Group, known as MPEG, approved the secret. Thus, in this book we can only outline the
Audio/Video digital compression standard known fundamentals of encoder design and algorithm
as MPEG-2. Two months later on January 27, optimization.
1995, the ITU-T† Rapporteurs Group on ATM We then launch into MPEG-2 applicationswith
Video approved the H.310 series of standards, chapters on digital video delivery media, interac-
which incorporates MPEG-2 into a coherent tive television, High-Definition Television
framework for two-way digital Audio/Video com- (HDTV), three dimensional stereoscopic television
munications. It is probably not an understatement and VLSI implementation architectures. We finish
to say that these standards represent one of the up with a progress report on MPEG-4, followed by
most versatile, and perhaps most complicated, an Appendix containing a resource guide of
communication standards ever written. MPEG Web sites.
In this book we first explore the history, funda- Although the basic framework has been estab-
mentals, and details of MPEG-2. The treatment lished, MPEG-2 continues to evolve and to be
includes most of the specifics needed to implement applied in a wide variety of applications ranging
an MPE1G-2 Decoder, including the syntax and from video conferencing to High-Definition Televi-
semantics of the coded bitstreams. However, sion. This only serves to reinforce the old adage
MPEG-2 Encoders are not specified by the standard. that the more useful a standard is, the morelikely it
Indeed the optimization of encoder parameters is is to be changed.
*International Organization for Standards.
†International Telecommunications Union—Telecommunications Sector.
xiii