Advances in Visual Data Compression and Communication: Meeting the Requirements of New Applications

516 Pages·2015·25.616 MB·English

by  Feng Wu

W Series in Multimedia Computing, Communication and Intelligence
Electrical Engineering / Image Processing
u Advances in Visual
Visual information is one of the richest and most bandwidth-consuming modes of
communication. To meet the requirements of emerging applications, powerful data
compression and transmission techniques are required to achieve highly efficient
Data Compression
communication, even in the presence of growing communication channels that
C
offer increased bandwidth.
o
Presenting the results of the author’s years of research on visual data compression and Communication
m
and transmission, Advances in Visual Data Compression and Communication:
Meeting the Requirements of New Applications provides a theoretical pA
and technical basis for advanced research on visual data compression and
r
d
communication. e Meeting the Requirements of New Applications
v
s
The book studies the drifting problem in scalable video coding, analyzes the sa
reasons causing the problem, and proposes various solutions to the problem. It in
o
explores the author’s Barbell-based lifting coding scheme that has been adopted c
n
as common software by MPEG. It also proposes a unified framework for deriving e
a directional transform from the nondirectional counterpart. The structure of the
s
a
framework and the statistic distribution of coefficients are similar to those of the
n
i
nondirectional transforms, which facilitates subsequent entropy coding.
n
d

Exploring the visual correlation that exists in media, the text extends the
V
C
current coding framework from different aspects, including advanced image
i
synthesis—from description and reconstruction to organizing correlated o
s
images as a pseudo sequence. It explains how to apply compressive sensing mu
to solve the data compression problem during transmission and covers novel
a
research on compressive sensor data gathering, random projection codes, and m
l
compressive modulation.
uD
For analog and digital transmission technologies, the book develops the pseudo- n
a
analog transmission for media and explores cutting-edge research on distributed
it
pseudo-analog transmission, denoising in pseudo-analog transmission, and ca
supporting MIMO. It concludes by considering emerging developments of a
information theory for future applications. t
i
o
n Feng Wu
K22985
6000 Broken Sound Parkway, NW
Suite 300, Boca Raton, FL 33487 ISBN: 978-1-4822-3413-8
711 Third Avenue 90000
New York, NY 10017
an informa business
2 Park Square, Milton Park
www.crcpress.com Abingdon, Oxon OX14 4RN, UK
9 781482 234138
www.auerbach-publications.com
K22985 cvr mech.indd 1 6/17/14 8:23 AM
(cid:105) (cid:105)
(cid:105) (cid:105)
Advances in Visual
Data Compression
and Communication
Meeting the Requirements
of New Applications
(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)
Multimedia Computing, Communication and Intelligence
Series Editors: Chang Wen Chen and Shiguo Lian
Advances in Visual Data Compression and Communication: Meeting the
Requirements of New Applications
Feng Wu
ISBN: 978-1-4822-3413-8
Effective Surveillance for Homeland Security: Balancing Technology and
Social Issues
Edited by Francesco Flammini, Roberto Setola, and Giorgio Franceschetti
ISBN: 978-1-4398-8324-2

Music Emotion Recognition
Yi-Hsuan Yang and Homer H. Chen
ISBN: 978-1-4398-5046-6
Optimal Resource Allocation for Distributed Video and Multimedia
Communications
Yifeng He, Ling Guan, and Wenwu Zhu
ISBN: 978-1-4398-7514-8

TV Content Analysis: Techniques and Applications
Edited by Yiannis Kompatsiaris, Bernard Merialdo, and Shiguo Lian
ISBN: 978-1-4398-5560-7
(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)
Advances in Visual
Data Compression
and Communication

Meeting the Requirements
of New Applications
Feng Wu
(cid:105) (cid:105)
(cid:105) (cid:105)
CRC Press
Taylor & Francis Group
6000 Broken Sound Parkway NW, Suite 300
Boca Raton, FL 33487-2742
© 2015 by Taylor & Francis Group, LLC
CRC Press is an imprint of Taylor & Francis Group, an Informa business
No claim to original U.S. Government works
Version Date: 20140501
International Standard Book Number-13: 978-1-4822-3415-2 (eBook - PDF)
This book contains information obtained from authentic and highly regarded sources. Reasonable efforts
have been made to publish reliable data and information, but the author and publisher cannot assume
responsibility for the validity of all materials or the consequences of their use. The authors and publishers
have attempted to trace the copyright holders of all material reproduced in this publication and apologize to
copyright holders if permission to publish in this form has not been obtained. If any copyright material has
not been acknowledged please write and let us know so we may rectify in any future reprint.
Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, transmit-
ted, or utilized in any form by any electronic, mechanical, or other means, now known or hereafter invented,
including photocopying, microfilming, and recording, or in any information storage or retrieval system,
without written permission from the publishers.
For permission to photocopy or use material electronically from this work, please access www.copyright.
com (http://www.copyright.com/) or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood
Drive, Danvers, MA 01923, 978-750-8400. CCC is a not-for-profit organization that provides licenses and
registration for a variety of users. For organizations that have been granted a photocopy license by the CCC,
a separate system of payment has been arranged.
Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are used
only for identification and explanation without intent to infringe.
Visit the Taylor & Francis Web site at
http://www.taylorandfrancis.com
and the CRC Press Web site at
http://www.crcpress.com
(cid:105) (cid:105)
(cid:105) (cid:105)

Tothe15yearsIspentwithMicrosoft
ResearchAsia.
(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)

(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)
Contents

Preface............................................................ xvii
Acknowledgments .................................................. xxv
Acronyms ......................................................... xxix
PartI BasisforCompressionandCommunication
1 InformationTheory ............................................ 3
1.1 Introduction ............................................... 3
1.2 SourceCoding............................................. 7
1.2.1 HuffmanCoding..................................... 8
1.2.2 ArithmeticCoding ................................... 8
1.2.3 RateDistortionTheory ............................... 11
1.3 ChannelCoding............................................ 14
1.3.1 Capacity............................................ 14
1.3.2 CodingTheorem..................................... 16
1.3.3 HammingCodes..................................... 17
1.4 JointSourceandChannelCoding ............................. 19
2 HybridVideoCoding........................................... 21
2.1 HybridCodingFramework................................... 21
2.2 TechnicalEvolution ........................................ 26
2.2.1 H.261.............................................. 26
2.2.2 MPEG-1 ........................................... 26
2.2.3 MPEG-2 ........................................... 27
2.2.4 MPEG-4 ........................................... 28
2.2.5 H.264/MPEG-4AVC................................. 28
2.2.6 HEVC ............................................. 30
2.2.7 PerformanceversusEncodingComplexity ............... 31
2.3 H.264Standard ............................................ 34
vii
(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)
viii Contents
2.3.1 MotionCompensation ................................ 34
2.3.2 IntraPrediction...................................... 36
2.3.3 TransformandQuantization ........................... 36
2.3.4 EntropyCoding ..................................... 37
2.3.5 DeblockingFiltering ................................. 38
2.3.6 RateDistortionOptimization .......................... 39
2.4 HEVCStandard............................................ 40
2.4.1 MotionCompensation ................................ 40
2.4.2 IntraPrediction...................................... 42
2.4.3 TransformandQuantization ........................... 43
2.4.4 SampleAdaptiveOffsetFilter.......................... 45
3 Communication................................................ 47
3.1 AnalogCommunication ..................................... 47

3.1.1 AnalogModulation .................................. 48
3.1.2 Multiplexing ........................................ 49
3.2 DigitalCommunication ..................................... 51
3.2.1 Low-DensityParity-Check(LDPC)Codes ............... 51
3.2.2 TurboCodes ........................................ 55
3.2.3 DigitalModulation................................... 60
PartII ScalableVideoCoding
4 ProgressiveFineGranularityScalable(PFGS)Coding ............. 65
4.1 Introduction ............................................... 65
4.2 FineGranularityScalableVideoCoding ....................... 66
4.3 BasicPFGSFramework ..................................... 69
4.3.1 BasicIdeastoBuildthePFGSFramework ............... 70
4.3.2 TheSimplifiedPFGSFramework....................... 72
4.4 ImprovementstothePFGSFramework ........................ 73
4.4.1 PotentialCodingInefficiencyDuetoTwoReferences...... 73
4.4.2 AMoreEfficientPFGSFramework..................... 76
4.5 ImplementationofthePFGSEncoderandDecoder .............. 79
4.6 ExperimentalResultsandAnalyses ........................... 82
4.7 SimulationofStreamingPFGSVideooverWirelessChannels ..... 85
4.8 Summary ................................................. 90
5 MotionThreadingfor3DWaveletCoding......................... 91
5.1 Introduction ............................................... 91
5.2 MotionThreading .......................................... 92
5.3 AdvancedMotionThreading ................................. 94
5.3.1 Lifting-BasedMotionThreading ....................... 94
5.3.2 Many-to-OneMappingandNon-ReferredPixels.......... 97
5.4 Multi-LayerMotionThreading ............................... 98
(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)
(cid:105) (cid:105)
Contents ix
5.5 CorrelatedMotionEstimationwithR-DOptimization ............ 101
5.5.1 DefinitionoftheModeTypes .......................... 102
5.5.2 R-DOptimizedModeDecision ........................ 104
5.6 ExperimentalResults ....................................... 105
5.6.1 CodingPerformanceComparison....................... 105
5.6.2 MacroblockModeDistribution......................... 106
5.7 Summary ................................................. 109
6 Barbell-LiftingBased3DWaveletCoding......................... 111
6.1 Introduction ............................................... 111
6.2 Barbell-LiftingCodingScheme............................... 112
6.2.1 BarbellLifting ...................................... 113
6.2.2 LayeredMotionCoding............................... 117
6.2.3 EntropyCodinginBrief .............................. 118

6.2.4 BaseLayerEmbedding ............................... 119
6.3 ComparisonswithSVC ..................................... 120
6.3.1 CodingFramework................................... 120
6.3.2 TemporalDecorrelation............................... 121
6.3.3 SpatialScalability.................................... 122
6.3.4 IntraPrediction...................................... 123
6.4 Advancesin3DWaveletVideoCoding ........................ 123
6.4.1 In-ScaleMCTF...................................... 123
6.4.2 SubbandAdaptiveMCTF ............................. 126
6.5 ExperimentalResults ....................................... 127
6.5.1 ComparisonwithMotionCompensatedEmbeddedZero
BlockCoding(MC-EZBC)............................ 127
6.5.2 Comparison with Scalable Video Coding (SVC) for
Signal-to-NoiseRatio(SNR)Scalability................. 129
6.5.3 ComparisonwithSVCforCombinedScalability.......... 130
6.6 Summary ................................................. 132
PartIII DirectionalTransforms
7 DirectionalWaveletTransform .................................. 135
7.1 Introduction ............................................... 135
7.2 2DWaveletTransformviaAdaptiveDirectionalLifting .......... 138
7.2.1 ADLStructure ...................................... 138
7.2.2 SubpixelInterpolation ................................ 143
7.3 R-DOptimizedSegmentationforADL ........................ 144
7.4 ExperimentalResultsandObservations ........................ 145
7.5 Summary ................................................. 152
(cid:105) (cid:105)
(cid:105) (cid:105)