ebook img

Digital Video PDF

450 Pages·2002·50.121 MB·English
Save to my drive
Quick download
Download
Most books are stored in the elastic cloud where traffic is expensive. For this reason, we have a limit on daily download.

Preview Digital Video

KLUWER ACADEMIC PUBLISHERS NEW YORK, BOSTON, DORDRECHT, LONDON, MOSCOW eBookISBN: 0-306-46982-0 Print ISBN: 0-412-08411-2 ©2002 Kluwer Academic Publishers New York, Boston, Dordrecht, London, Moscow All rights reserved No part of this eBook may be reproduced or transmitted in any form or by any means, electronic, mechanical, recording, or otherwise, without written consent from the Publisher Created in the United States of America Visit Kluwer Online at: http://www.kluweronline.com and Kluwer's eBookstore at: http://www.ebooks.kluweronline.com To our families Ann, Paul, and Andrew Diane Chitra, Ilka, andRavi CONTENTS Dedication v Preface xiii Acknowledgments xiv 1 Introduction to Digital Multimedia, Compression, and MPEG-2 1 1.1 The Digital Revolution 1 1.2 The Need for Compression 3 1.3 Considerations for Compression 4 1.4 Compression Technology 6 1.5 Videophone andCompact DiskStandards—H.320 and MPEG-1 9 1.6 The Digital Entertainment TV Standard—MPEG-2 9 1.7 Complexity/Cost 12 References 13 2 Anatomy of MPEG-2 14 2.1 MPEG-1 14 2.2 MPEG-2 16 2.2.1 MPEG-2 Systems 17 2.2.2 MPEG-2 Video 18 2.2.3 MPEG-2 Audio 21 2.2.4 MPEG-2 Conformance 22 2.2.5 Software 24 2.2.6 DSM-CC 24 2.2.7 MPEG-2 NBC Audio 26 2.2.8 10-bit video (cancelled!) 27 2.2.9 MPEG-2 RTI 27 2.2.10 MPEG-2 DSM-CC Conformance 28 vii viii Contents 2.3 Summary 28 References 29 3 MPEG-2 Systems 32 3.1 Multiplexing 32 3.2 Synchronization 32 3.3 Elementary Streams 33 3.4 Programs and Nonelementary Streams 37 3.4.1 Program Streams 37 3.4.2 Transport Streams 40 3.4.3 Descriptors 50 3.5 PracticalSystemsDecoders 52 3.6 Practical Systems Encoders 53 3.7 Conclusion 54 References 54 4 Audio 55 4.1 Introduction 55 4.2 Audio Compression Fundamentals 56 4.3 MPEG-1 58 4.3.1 PsychoacousticModel 60 4.3.2 MPEG-1 Syntaxand Semantics 62 4.3.3 Layer I Coding 63 4.3.4 Intensity_Stereo Mode 64 4.3.5 Layer II Coding 64 4.3.6 Layer III 67 4.3.7 MS_Stereo Mode 69 4.4 MPEG-2 Audio 71 4.4.1 MPEG-2 Backward Compatible (BC) 71 4.4.2 Subband Groups 72 4.4.3 DynamicTransmissionChannelSwitching 72 4.4.4 Dynamic Crosstalk 72 4.4.5 Adaptive Multichannel Prediction 73 4.4.6 Phantom Codingof the Center Channel 73 4.4.7 MultilingualChannels 73 4.4.8 Syntax and Semantics of MPEG-2-BC Audio 73 4.4.9 MPEG-Non Backward Compatible (NBC) 78 References 79 5 Video Basics 80 5.1 Video Imaging 80 5.2 The human Visual System and Color TV 86 5.3 FromAnalogto DigitalVideo 91 5.4 Spatial Conversions 96 5.5 TemporalConversions 102 5.6 Mixing and Keying 106 5.7 Summary 107 References 108 Contents ix 6 Digital Compression: Fundamentals 110 6.1 Limitations of the Television Camera 110 6.2 Numerical Representation 110 6.3 Basic Compression Techniques 116 6.4 PredictiveCoding(DPCM) 117 6.5 Block Transform Coding 132 6.6 Hybrid Transform Coding 136 6.7 Vector Quantization 138 6.8 Motion Adaptive Interpolation 139 6.9 Incorporation of Perceptual Factors 140 References 145 7 Motion Compensation Modes in MPEG 146 7.1 Coding of Progressive Scanned Video 146 7.2 Coding of Interlaced Video 149 7.3 Choosing the Mode of Motion Compensation 154 7.4 Codingthe MotionVectors 154 References 155 8 MPEG-2 Video Coding and Compression 156 8.1 MPEG-2 Chrominance Sampling 156 8.2 Requirements of the MPEG-2 Video Standard 157 8.3 Main Profile Algorithm Overview 158 8.4 Overview of the MPEG-2 Video Stream Syntax 161 8.5 Typical Encoder Architecture 170 8.6 Typical Decoder Architecture 173 8.7 MPEG-2 Error Concealment 174 8.8 Performance of MPEG-2 175 References 181 9 MPEG-2 Scalability Techniques 183 9.1 ScalabilityBasics 184 9.2 Data Partitioning 185 9.3 SNR Scalability 190 9.4 SpatialScalability 197 9.5 Temporal Scalability 213 9.6 Hybrid Scalability 224 9.7 Scalability Summary 228 References 229 10 Video Stream Syntax and Semantics 230 10.1 Video Stream Syntax 230 10.2 Semanticsforthe SyntaxVariables 231 References 257 11 Requirements and Profiles 258 11.1 MPEG-2 Requirements 258 11.2 The Development Process 260 x Contents 11.3 BasicProfiles Hierarchy 261 11.4 BasicProfiles Interoperability 268 11.5 Basic Profiles VerificationTests 271 11.6 NewProfiles 274 11.7 NewProfiles Interoperability 276 11.8 Decoders andBitstream Compatibility 277 11.9 Summary 277 References 278 12 Digital Video Networks 280 12.1 CurrentMethodsofAccess1–5 282 12.2 New Broadband Wired Access Scenarios6–12 283 12.3 WiredAccessCompared 285 12.4 TerrestrialBroadcasting12 286 12.5 DirectBroadcastSatellites14 289 References 291 13 Interactive Television 292 13.1 Customer PremisesEquipment 294 13.2 InteractiveTelevision Servers 296 13.3 UserInterfaces10–12 302 13.4 Content Creation for ITV14–l9 304 References 306 14 High-DefinitionTelevision(HDTV) 307 14.1 Characteristics of HDTV 308 14.2 Problems of Current Analog TV 310 14.3 Grand Alliance HDTV System 311 14.4 Performance of MPEG-2 on HDTV Pictures 316 14.5 Evolution of HDTV 320 References 320 15 Three-Dimensional TV 322 15.1 Basics of 3D 323 15.2 Techniques for 3D Viewing 327 15.3 Stereoscopic Imaging and Display 334 15.4 Stereoscopic Geometry and HumanFactors 338 15.5 Video Compression for Stereoscopic 3DTV 344 15.6 Multiviewpoint Video 353 15.7 Summary 358 References 358 16 ProcessingArchitecture and Implementation 361 Dr. Horng-Dar Lin 16.1 MPEG Processing Requirements 361 16.2 Architectural Choices and Examples 362 16.3 Design Issues 366 16.4 Directions in MPEG Chip Development 367 Contents xi 16.5 Summary 367 References 368 17 MPEG-4 and the Future 369 17.1 H.263: The ITU-T Low-Bitrate Standard 370 17.2 Coding Advances 382 17.3 Introduction to MPEG-4 387 17.4 MPEG-4 Requirements 388 17.5 MPEG-4 Video 391 17.6 MPEG-4Audio 399 17.7 MPEG-4 Syntax Description Language (MSDL) 399 17.8 Synthetic and Natural Hybrid Coding (SNHC) 405 17.9 The Future 408 1 7 .1 0 Summary 410 References 410 AppendixA: Resource Guide 413 AppendixB: MPEG Committee 422 MPEG Membership List 423 Index 429 PREFACE On November 11,1994 the ISO* Moving Picture an art that many vendors keep as a closely held Experts Group, known as MPEG, approved the secret. Thus, in this book we can only outline the Audio/Video digital compression standard known fundamentals of encoder design and algorithm as MPEG-2. Two months later on January 27, optimization. 1995, the ITU-T† Rapporteurs Group on ATM We then launch into MPEG-2 applicationswith Video approved the H.310 series of standards, chapters on digital video delivery media, interac- which incorporates MPEG-2 into a coherent tive television, High-Definition Television framework for two-way digital Audio/Video com- (HDTV), three dimensional stereoscopic television munications. It is probably not an understatement and VLSI implementation architectures. We finish to say that these standards represent one of the up with a progress report on MPEG-4, followed by most versatile, and perhaps most complicated, an Appendix containing a resource guide of communication standards ever written. MPEG Web sites. In this book we first explore the history, funda- Although the basic framework has been estab- mentals, and details of MPEG-2. The treatment lished, MPEG-2 continues to evolve and to be includes most of the specifics needed to implement applied in a wide variety of applications ranging an MPE1G-2 Decoder, including the syntax and from video conferencing to High-Definition Televi- semantics of the coded bitstreams. However, sion. This only serves to reinforce the old adage MPEG-2 Encoders are not specified by the standard. that the more useful a standard is, the morelikely it Indeed the optimization of encoder parameters is is to be changed. *International Organization for Standards. †International Telecommunications Union—Telecommunications Sector. xiii

See more

The list of books you might like

Most books are stored in the elastic cloud where traffic is expensive. For this reason, we have a limit on daily download.