Digital video quality: vision models and metrics

192 Pages·2005·2.901 MB·English

by  Stefan Winkler

Digital Video Quality
Vision Models and Metrics
Stefan Winkler
Genista Corporation, Montreux, Switzerland

Digital Video Quality

Digital Video Quality
Vision Models and Metrics
Stefan Winkler
Genista Corporation, Montreux, Switzerland
Copyright#2005 JohnWiley&SonsLtd,TheAtrium,SouthernGate,Chichester,
WestSussexPO198SQ,England
Telephone [phone]
Email(forordersandcustomerserviceenquiries):[email protected]
VisitourHomePageonwww.wiley.com
AllRightsReserved.Nopartofthispublicationmaybereproduced,storedinaretrievalsystem
ortransmittedinanyformorbyanymeans,electronic,mechanical,photocopying,recording,
scanningorotherwise,exceptunderthetermsoftheCopyright,DesignsandPatentsAct1988
orunderthetermsofalicenceissuedbytheCopyrightLicensingAgencyLtd,90Tottenham
CourtRoad,LondonW1T4LP,UK,withoutthepermissioninwritingofthePublisher.
RequeststothePublishershouldbeaddressedtothePermissionsDepartment,JohnWiley
&SonsLtd,TheAtrium,SouthernGate,Chichester,WestSussexPO198SQ,England,or
[email protected],orfaxedto([phone].
Designationsusedbycompaniestodistinguishtheirproductsareoftenclaimedastrademarks.
Allbrandnamesandproductnamesusedinthisbookaretradenames,servicemarks,trademarks
orregisteredtrademarksoftheirrespectiveowners.ThePublisherisnotassociatedwithany
productorvendormentionedinthisbook.
Thispublicationisdesignedtoprovideaccurateandauthoritativeinformationinregardtothe
subjectmattercovered.ItissoldontheunderstandingthatthePublisherisnotengagedinrendering
professionalservices.Ifprofessionaladviceorotherexpertassistanceisrequired,theservices
ofacompetentprofessionalshouldbesought.
OtherWileyEditorialOffices
JohnWiley&SonsInc.,111RiverStreet,Hoboken,NJ07030,USA
Jossey-Bass,989MarketStreet,SanFrancisco,CA94103-1741,USA
Wiley–VCHVerlagGmbH,Boschstr.12,D-69469Weinheim,Germany
JohnWiley&SonsAustraliaLtd,33ParkRoad,Milton,Queensland4064,Australia
JohnWiley&Sons(Asia)PteLtd,2ClementiLoop#02-01,JinXingDistripark,Singapore129809
JohnWiley&SonsCanadaLtd,22WorcesterRoad,Etobicoke,Ontario,CanadaM9W1L1
Wileyalsopublishesitsbooksinavarietyofelectronicformats.Somecontentthatappearsin
printmaynotbeavailableinelectronicbooks.
LibraryofCongressCataloging-in-PublicationData
Winkler,Stefan.
Digitalvideoquality:visionmodelsandmetrics/StefanWinkler.
p.cm.
Includesbibliographicalreferencesandindex.
ISBN0-470-02404-6
1. Digitalvideo. 2. Imageprocessing—Digitaltechniques. 3. Imaging
systems—Imagequality. I. Title.
TK6680.5.W55 2005
006.6096–dc22 2004061588
BritishLibraryCataloguinginPublicationData
AcataloguerecordforthisbookisavailablefromtheBritishLibrary
ISBN0-470-02404-6
Typesetin10.5/13ptTimesbyThomsonPress(India)Limited,NewDelhi
PrintedandboundinGreatBritainbyAntonyRoweLtd,Chippenham,Wiltshire
Thisbookisprintedonacid-freepaperresponsiblymanufacturedfromsustainableforestry
inwhichatleasttwotreesareplantedforeachoneusedforpaperproduction.
Contents
About the Author ix
Acknowledgements xi
Acronyms xiii
1 Introduction 1
1.1 Motivation 1
1.2 Outline 3
2 Vision 5
2.1 Eye 5
2.1.1 PhysicalPrinciples 5
2.1.2 OpticsoftheEye 7
2.1.3 OpticalQuality 8
2.1.4 EyeMovements 9
2.2 Retina 10
2.2.1 Photoreceptors 11
2.2.2 RetinalNeurons 14
2.3 VisualPathways 16
2.3.1 LateralGeniculate Nucleus 17
2.3.2 VisualCortex 18
2.4 SensitivitytoLight 20
2.4.1 LightAdaptation 20
2.4.2 ContrastSensitivity 20
2.5 ColorPerception 25
2.5.1 ColorMatching 25
2.5.2 OpponentColors 26
2.6 MaskingandAdaptation 28
2.6.1 SpatialMasking 28
2.6.2 TemporalMasking 30
2.6.3 PatternAdaptation 30
2.7 Multi-channelOrganization 31
2.7.1 SpatialMechanisms 31
2.7.2 TemporalMechanisms 32
2.8 Summary 33
vi CONTENTS
3 Video Quality 35
3.1 VideoCodingandCompression 36
3.1.1 ColorCoding 36
3.1.2 Interlacing 37
3.1.3 CompressionMethods 38
3.1.4 Standards 39
3.2 Artifacts 42
3.2.1 CompressionArtifacts 42
3.2.2 TransmissionErrors 45
3.2.3 OtherImpairments 47
3.3 VisualQuality 47
3.3.1 ViewingDistance 47
3.3.2 SubjectiveQualityFactors 48
3.3.3 TestingProcedures 51
3.4 QualityMetrics 54
3.4.1 Pixel-basedMetrics 54
3.4.2 Single-channelModels 56
3.4.3 Multi-channelModels 58
3.4.4 SpecializedMetrics 63
3.5 MetricEvaluation 64
3.5.1 Performance Attributes 64
3.5.2 MetricComparisons 66
3.5.3 VideoQualityExperts Group 66
3.5.4 LimitsofPrediction Performance 68
3.6 Summary 70
4 Models and Metrics 71
4.1 IsotropicContrast 72
4.1.1 ContrastDefinitions 72
4.1.2 In-phaseandQuadrature Mechanisms 73
4.1.3 IsotropicLocal Contrast 76
4.1.4 FilterDesign 80
4.2 Perceptual DistortionMetric 82
4.2.1 MetricDesign 82
4.2.2 ColorSpaceConversion 84
4.2.3 Perceptual Decomposition 86
4.2.4 ContrastGainControl 91
4.2.5 DetectionandPooling 94
4.2.6 Parameter Fitting 95
4.2.7 Demonstration 99
4.3 Summary 102
5 Metric Evaluation 103
5.1 StillImages 103
5.1.1 Test Images 103
5.1.2 SubjectiveExperiments 104
5.1.3 PredictionPerformance 107
CONTENTS vii
5.2 Video 108
5.2.1 Test Sequences 108
5.2.2 SubjectiveExperiments 109
5.2.3 PredictionPerformance 111
5.2.4 Discussion 115
5.3 ComponentAnalysis 117
5.3.1 DissectingthePDM 117
5.3.2 ColorSpace 118
5.3.3 Decomposition Filters 119
5.3.4 PoolingAlgorithm 120
5.4 Summary 123
6 Metric Extensions 125
6.1 BlockingArtifacts 125
6.1.1 Perceptual BlockingDistortionMetric 125
6.1.2 Test Sequences 127
6.1.3 SubjectiveExperiments 128
6.1.4 PredictionPerformance 129
6.2 ObjectSegmentation 129
6.2.1 Test Sequences 131
6.2.2 PredictionPerformance 131
6.3 ImageAppeal 133
6.3.1 Background 133
6.3.2 QuantifyingImageAppeal 134
6.3.3 ResultswithVQEGData 137
6.3.4 Test Sequences 139
6.3.5 SubjectiveExperiments 140
6.3.6 PDMPrediction Performance 144
6.3.7 PerformancewithImageAppealAttributes 145
6.4 Summary 148
7 Closing Remarks 149
7.1 Summary 149
7.2 Perspectives 151
Appendix: Color Space Conversions 155
References 157
Index 171