Quality of experience engineering for customer added value services : from evaluation to monitoring

288 Pages·2014·5.763 MB·English

by  Cuadra-Sanchez, Antonio, Mellouk, Abdelhamid

W672-Mellouk.qxp_Layout 1 27/05/2014 14:04 Page 1
NETWORKS AND TELECOMMUNICATIONS SERIES
The main objective of the book is to present state-of-the-art research AAE
nbd
results and experience reports in the area of quality monitoring for todeite
customer experience management, addressing topics which are niolhad b
currently important, such as service-aware future Internet architecture Cmy
for Quality of Experience (QoE) management on multimedia uaid
d M
applications. r
ae
In recent years, multimedia applications and services have experienced -Sallou
nk
a sudden growth. Today, video display is not limited to the traditional ch
areas of movies and television on TV sets, but these applications are e
z
accessed in different environments, with different devices and under
different conditions. In addition, the continuous emergence of new
services, along with increasing competition, is forcing network
operators and service providers to focus all their efforts on customer
satisfaction, although determining the QoE is not a trivial task. This
book addresses the QoE for improving customer perception when using
f
added value services offered by service providers, from evaluation to o Q
monitoring and other management processes. r u
C a
u li
s t
y
t
o
o
m f Quality of Experience

e E
r x
A p Engineering for
e
Abdelhamid Mellouk is Full Professor at the University of Paris-Est d
r
d i
C-VdM (UPEC) in France. Head of several executive national and e e Customer Added Value Services
international positions, he is the founder of the Network Control d n
Research activity at UPEC with extensive international academic and c
V e
industrial collaborations. His general area of research is in adaptive real- a
E
time control for high-speed new generation dynamic wired/wireless lu n From Evaluation to Monitoring
networks in order to maintain acceptable Quality of Service/Experience e g
i
for added-value services. S n
e e
Antonio Cuadra-Sanchez works as a research project manager and r e
technology advisor for QoS and QoE at Indra Sistemas, S.A. He has v r
i i
taught different courses on signaling protocols and networks (SS7, c n Edited by
e g
GSM, GPRS, UMTS, IMS and IPTV) in Telefonica R&D, Telefonica Spain s
and Americas.
Abdelhamid Mellouk
Antonio Cuadra-Sanchez
Z(7ib8e8-CBGHCD(
www.iste.co.uk

Quality of Experience Engineering for
Customer Added Value Services

Series Editor
Abdelhamid Mellouk
Quality of Experience
Engineering for Customer
Added Value Services
From Evaluation to Monitoring
Edited by
Abdelhamid Mellouk
Antonio Cuadra-Sanchez
Firstpublished2014inGreatBritainandtheUnitedStatesbyISTELtdandJohnWiley&Sons,Inc.
Apart from any fair dealing for the purposes of research or private study, or criticism or review, as
permittedundertheCopyright,DesignsandPatentsAct1988,thispublicationmayonlybereproduced,
storedortransmitted,inanyformorbyanymeans,withthepriorpermissioninwritingofthepublishers,
or in the case of reprographic reproduction in accordance with the terms and licenses issued by the
CLA. Enquiries concerning reproduction outside these terms should be sent to the publishers at the
undermentionedaddress:
ISTELtd JohnWiley&Sons,Inc.
27-37StGeorge’sRoad 111RiverStreet
LondonSW194EU Hoboken,NJ07030
UK USA
www.iste.co.uk www.wiley.com
©ISTELtd2014
TherightsofAbdelhamidMelloukandAntonioCuadra-Sancheztobeidentifiedastheauthorsofthis
workhavebeenassertedbytheminaccordancewiththeCopyright,DesignsandPatentsAct1988.
LibraryofCongressControlNumber: 2014938063
BritishLibraryCataloguing-in-PublicationData
ACIPrecordforthisbookisavailablefromtheBritishLibrary
ISBN978-1-84821-672-3
PrintedandboundinGreatBritainbyCPIGroup(UK)Ltd.,Croydon,SurreyCR04YY
Contents
PREFACE. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
AbdelhamidMELLOUK
CHAPTER1.CHALLENGESFORQUALITYOFEXPERIENCEENGINEERINGFOR
ADDEDVALUESERVICES. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
AbdelhamidMELLOUKandAntonioCUADRA-SANCHEZ
1.1.Introductionandchallenges. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2.Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
1.2.1.Chapter2:AnEcosystemforcustomerexperiencemanagement. . . . . . 2
1.2.2.Chapter3:MeasuringMPEGframelossratetoevaluatetheQoE
inIPTVservices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.2.3.Chapter4:EstimatingtheeffectofcontextontheQoEof
audiovisualservices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.2.4.Chapter5:IPTVmultiserviceQOEmanagementsystem. . . . . . . . . . 5
1.2.5.Chapter6:Highspeedmultimediaflowclassification. . . . . . . . . . . . 5
1.2.6.Chapter7:UserdrivenserverSelectionalgorithmforCDN
architecture. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.2.7.Chapter8:QoEapproachesforadaptivetransportofvideo
streamingmedia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
1.2.8.Chapter9:QoSandQoEeffectsofpacketlossesinmultimedia
videostreaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
1.2.9.Chapter10:AmodelforQoEestimationbasedonQoSparametersmonitoring
formultimediaconvergentservices(tripleplay) . . . . . . . . . . . . . . . . . . 8
1.2.10.Chapter11:Qualityofexperienceestimatorsinnetworks. . . . . . . . . 8
1.2.11.Chatper12:QoE-basednetworkselectionisheterogeneous
environments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
1.3.Conclusion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
vi QualityofExperienceEngineeringforCustomerAddedValueServices
CHAPTER2.ANECOSYSTEMFORCUSTOMEREXPERIENCEMANAGEMENT . . . . . . 11
AntonioCUADRA-SANCHEZ,MarCUTANDA-RODRIGUEZ,AndreasAURELIUS,
KjellBRUNNSTRÖM,JorgeE.LÓPEZDEVERGARA,MartinVARELA,
Jukka-PekkaLAULAJAINEN,AndersonMORAIS,AnaCAVALLI,
AbdelhamidMELLOUK,BriceAUGUSTINandIsmaelPEREZ-MATEOS
2.1.Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
2.2.Managingcustomerexperience. . . . . . . . . . . . . . . . . . . . . . . . . . . 12
2.2.1.Customerexperiencemanagement . . . . . . . . . . . . . . . . . . . . . . 12
2.2.2.Servicequalitymanagement. . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.3.Qualityofexperienceecosystem. . . . . . . . . . . . . . . . . . . . . . . . . . 15
2.3.1.QoEDatasources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
2.3.2.QoEmonitoringsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
2.3.3.QoEmanagementsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
2.4.IPNQSIS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
2.5.NOTTS. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
2.6.Conclusions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
2.7.Acknowledgments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
2.8.Bibliography. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
CHAPTER3.MEASURINGMPEGFRAMELOSSRATETOEVALUATETHEQUALITYOF
EXPERIENCEINIPTVSERVICES. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
DiegoHERNANDO-LOEDA,JorgeE.LÓPEZDEVERGARA,JavierARACIL,
DavidMADRIGALandFelipeMATA
3.1.Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
3.2.Relatedwork. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
3.3.Methoddescription . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
3.3.1.Videosetup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
3.3.2.Experimentdata. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
3.3.3.VQMgeneralmodel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
3.4.QoEpredictionmodels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
3.4.1.Packetlossratebasedmodel. . . . . . . . . . . . . . . . . . . . . . . . . . 37
3.4.2.MPEGframetypes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
3.4.3.MPEGframelossmodel. . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
3.5.Networkmonitoringtool . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
3.5.1.FlowMonitor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
3.5.2.CaptureAnalyzer. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
3.5.3.QoEEstimator. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
3.6.Performanceassessment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
3.6.1.AssessmentonIntel-basedPC. . . . . . . . . . . . . . . . . . . . . . . . . 45
3.6.2.AssessmentonanARM-baseddevice . . . . . . . . . . . . . . . . . . . . 47
3.7.Conclusionsandfuturework. . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
Contents vii
3.8.Acknowledgments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
3.9.Bibliography. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
CHAPTER4.ESTIMATINGTHEEFFECTOFCONTEXTONTHEQOEOF
AUDIOVISUALSERVICES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
ToniMÄKI,MartínVARELAandJukka-PekkaLAULAJAINEN
4.1.Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
4.2.Testcontent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
4.3.Subjectivetestsinlaboratory. . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
4.4.Subjectivetestsatexhibition . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
4.5.Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
4.6.Conclusionsandfurtherwork . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
4.7.Bibliography. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
CHAPTER5.IPTVMULTISERVICEQOEMANAGEMENTSYSTEM . . . . . . . . . . . . 73
AntonioCUADRA-SANCHEZ,MarCUTANDA-RODRIGUEZ,AlfredoPÉREZ-MONTERO,
EugenioROGLES,JesúsGUTIÉRREZand FernandoJAUREGUIZAR
5.1.Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
5.2.Stateoftheart . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
5.2.1.Videoqualitymetrics. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
5.2.2.Multimediaqualitymetrics. . . . . . . . . . . . . . . . . . . . . . . . . . . 78
5.2.3.MetricsforQoEmonitoringofvideoservices. . . . . . . . . . . . . . . . 79
5.3.MultiserviceIPTVprobe . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
5.3.1.ArchitectureoftheIPTVprobe . . . . . . . . . . . . . . . . . . . . . . . . 80
5.3.2.VideoqualitymetricsappliedintheIPTVprobe . . . . . . . . . . . . . . 82
5.4.QoEmanagementsystem. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85
5.4.1.RequirementsformonitoringandmanagementofQoE. . . . . . . . . . . 85
5.4.2.Configurationmanagement . . . . . . . . . . . . . . . . . . . . . . . . . . 87
5.4.3.Resultmanagement. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
5.5.Conclusions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90
5.6.Acknowledgments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90
5.7.Bibliography. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90
CHAPTER6.HIGHSPEEDMULTIMEDIAFLOWCLASSIFICATION. . . . . . . . . . . . . 93
RafaelLEIRAOSUNA,PedroGÓMEZNIETO,IvanGONZÁLEZandJorgeE.LÓPEZDEVERGARA
6.1.Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
6.2.Thearchitecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
6.2.1.IntelDPDK . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
6.2.2.DeeppacketinspectionoverGPU. . . . . . . . . . . . . . . . . . . . . . . 100
6.3.Validation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
6.3.1.Usedhardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
6.3.2.Usedtraffictraces. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
viii QualityofExperienceEngineeringforCustomerAddedValueServices
6.3.3.Obtainedresults. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
6.4.Conclusions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114
6.5.Acknowledgments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
6.6.Bibliography. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
CHAPTER7.USERDRIVENSERVERSELECTIONALGORITHMFOR
CDNARCHITECTURE. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119
Said HOCEINI,HaiAnhTRANandAbdelhamidMELLOUK
7.1.Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119
7.2.Multi-armedbanditformalization . . . . . . . . . . . . . . . . . . . . . . . . . 122
7.2.1.MABparadigm . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122
7.2.2.ApplicationsofMAB. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126
7.2.3.AlgorithmsforMAB. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128
7.3.Serverselectionschemes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133
7.4.OurproposalforQoE-basedserverselectionmethod . . . . . . . . . . . . . . 136
7.4.1.Proposedserverselectionscheme. . . . . . . . . . . . . . . . . . . . . . . 136
7.4.2.ProposedUCB1-basedserverselectionalgorithm. . . . . . . . . . . . . . 138
7.5.Experimentalresults. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139
7.5.1.Simulationresults. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140
7.6.Acknowledgments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146
7.7.Conclusion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 147
7.8.Bibliography. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 147
CHAPTER8.QOEAPPROACHESFORADAPTIVETRANSPORTOFVIDEO
STREAMINGMEDIA. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151
M.SajidMUSHTAQ,BriceAUGUSTINandAbdelhamidMELLOUK
8.1.Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151
8.2.Adaptivevideotransport . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
8.2.1.Background . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
8.2.2.Adaptivevideodeliverycomponents . . . . . . . . . . . . . . . . . . . . . 155
8.3.MicrosoftSmoothStreaming. . . . . . . . . . . . . . . . . . . . . . . . . . . . 156
8.4.AppleHTTPlivestreaming. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158
8.5.AdobeHTTPdynamicstreaming . . . . . . . . . . . . . . . . . . . . . . . . . 159
8.6.MPEG–dynamicadaptivestreamingoverHTTP. . . . . . . . . . . . . . . . . 159
8.7.Thegoalsofadaptivevideostreaming. . . . . . . . . . . . . . . . . . . . . . . 161
8.8.Qualitymetricsforvideostreaming . . . . . . . . . . . . . . . . . . . . . . . . 162
8.9.TheroleofTCPinadaptivevideostreaming . . . . . . . . . . . . . . . . . . . 163
8.10.Bibliography . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 168