AnalyticMethodsinSystemsandSoftwareTesting Analytic Methods in Systems and Software Testing Editedby RonS.Kenett KPA,IsraelandSamuelNeamanInstitute,Technion,Israel FabrizioRuggeri CNR-IMATI,Italy FrederickW.Faltin TheFaltinGroupandVirginiaTech,USA Thiseditionfirstpublished2018 ©2018JohnWiley&SonsLtd Allrightsreserved.Nopartofthispublicationmaybereproduced,storedinaretrievalsystem,or transmitted,inanyformorbyanymeans,electronic,mechanical,photocopying,recordingorotherwise, exceptaspermittedbylaw.Adviceonhowtoobtainpermissiontoreusematerialfromthistitleisavailable athttp://www.wiley.com/go/permissions. TherightofProfessorRonS.Kenett,DrFabrizioRuggeriandFrederickW.Faltintobeidentifiedasthe authorsoftheeditorialmaterialinthisworkhasbeenassertedinaccordancewithlaw. RegisteredOffice(s) JohnWiley&Sons,Inc.,111RiverStreet,Hoboken,NJ07030,USA JohnWiley&SonsLtd,TheAtrium,SouthernGate,Chichester,WestSussex,PO198SQ,UK EditorialOffice 9600GarsingtonRoad,Oxford,OX42DQ,UK Fordetailsofourglobaleditorialoffices,customerservices,andmoreinformationaboutWileyproducts visitusatwww.wiley.com. Wileyalsopublishesitsbooksinavarietyofelectronicformatsandbyprint-on-demand.Somecontentthat appearsinstandardprintversionsofthisbookmaynotbeavailableinotherformats. LimitofLiability/DisclaimerofWarranty Whilethepublisherandauthorshaveusedtheirbesteffortsinpreparingthiswork,theymakeno representationsorwarrantieswithrespecttotheaccuracyorcompletenessofthecontentsofthisworkand specificallydisclaimallwarranties,includingwithoutlimitationanyimpliedwarrantiesofmerchantabilityor fitnessforaparticularpurpose.Nowarrantymaybecreatedorextendedbysalesrepresentatives,written salesmaterialsorpromotionalstatementsforthiswork.Thefactthatanorganization,website,orproductis referredtointhisworkasacitationand/orpotentialsourceoffurtherinformationdoesnotmeanthatthe publisherandauthorsendorsetheinformationorservicestheorganization,website,orproductmayprovide orrecommendationsitmaymake.Thisworkissoldwiththeunderstandingthatthepublisherisnotengaged inrenderingprofessionalservices.Theadviceandstrategiescontainedhereinmaynotbesuitableforyour situation.Youshouldconsultwithaspecialistwhereappropriate.Further,readersshouldbeawarethat websiteslistedinthisworkmayhavechangedordisappearedbetweenwhenthisworkwaswrittenandwhen itisread.Neitherthepublishernorauthorsshallbeliableforanylossofprofitoranyothercommercial damages,includingbutnotlimitedtospecial,incidental,consequential,orotherdamages. LibraryofCongressCataloging-in-PublicationData Names:Kenett,Ron,editor.|Ruggeri,Fabrizio,editor.|Faltin,FrederickW.,editor. Title:Analyticmethodsinsystemsandsoftwaretesting/editedby,RonS.Kenett,KPA, Raanana,IsraelandNeamanInstitute,Technion,Haifa,Israel,FabrizioRuggeri,CNR-IMATI,IT, FrederickW.Faltin,TheFaltinGroup,USA. Description:1edition.|Hoboken,NJ,USA:Wiley,[2018]|Includesbibliographicalreferencesandindex.| Identifiers:LCCN2018008695(print)|LCCN2018017885(ebook)|ISBN9781119487364(pdf)| ISBN9781119487401(epub)|ISBN9781119271505(cloth) Subjects:LCSH:Computersoftware–Testing. Classification:LCCQA76.76.T48(ebook)|LCCQA76.76.T48A522018(print)|DDC005.1/4–dc23 LCrecordavailableathttps://lccn.loc.gov/2018008695 CoverdesignbyWiley Coverimage:©SergeyNivens/iStockphoto Setin10/12ptWarnockbySPiGlobal,Pondicherry,India 10 9 8 7 6 5 4 3 2 1 ToJonathan,Alma,Tomer,Yadin,Aviv,Gili,MatanandEden –RonS.Kenett ToAnna,GiacomoandLorenzo –FabrizioRuggeri ToDonna,Erin,TravisandMaddie –FrederickW.Faltin vii Contents ListofContributors ix Preface xv PartI TestingConceptsandMethods 1 1 RecentAdvancesinClassifyingRisk-BasedTestingApproaches 3 MichaelFelderer,JürgenGroßmann,andInaSchieferdecker 2 ImprovingSoftwareTestingwithCausalModeling 27 NormanFentonandMartinNeil 3 OptimalSoftwareTestingacrossVersionReleases 65 SimonP.WilsonandSeánÓRíordáin 4 IncrementalVerificationandCoverageAnalysisofStronglyDistributed Systems 81 ElenaV.RavveandZeevVolkovich 5 CombinatorialTesting:AnApproachtoSystemsandSoftwareTesting BasedonCoveringArrays 131 JosephMorgan 6 ConceptualAspectsinDevelopmentandTeachingofSystemandSoftware TestEngineering 159 DaniAlmog,RonS.Kenett,UriShafrir,andHadasChasidim PartII StatisticalModels 195 7 Non-homogeneousPoissonProcessModelsforSoftwareReliability 197 StevenE.Rigdon 8 BayesianGraphicalModelsforHigh-ComplexityTesting:Aspectsof Implementation 213 DavidWooff,MichaelGoldstein,andFrankCoolen 9 ModelsofSoftwareReliability 245 ShelemyahuZacks viii Contents 10 ImprovedEstimationofSystemReliabilitywithApplicationinSoftware Development 255 BeidiQiangandEdselA.Peña 11 DecisionModelsforSoftwareTesting 277 FabrizioRuggeriandRefikSoyer 12 ModelingandSimulationsinControlSoftwareDesign 287 JiriKoziorek,StepanOzana,VilemSrovnal,andTomasDocekal PartIII TestingInfrastructures 327 13 ATemperatureMonitoringInfrastructureandProcessforImprovingData CenterEnergyEfficiencywithResultsforaHighPerformanceComputing DataCenter 329 SarahE.Michalak,AmandaM.Bonnie,AndrewJ.Montoya,CurtisB.Storlie,WilliamN.Rust, LawrenceO.Ticknor,LauraA.Davey,ThomasE.MoxleyIII,andBrianJ.Reich 14 AgileTestingwithUserDatainCloudandEdgeComputing Environments 353 RonS.Kenett,AviHarel,andFabrizioRuggeri 15 AutomatedSoftwareTesting 373 XiaoxuDiao,ManuelRodriguez,BoyuanLi,andCarolSmidts 16 DynamicTestCaseSelectioninContinuousIntegration:TestResult AnalysisusingtheEiffelFramework 405 DanielStåhlandJanBosch 17 AnAutomatedRegressionTestingFrameworkforaHadoop-BasedEntity ResolutionSystem 415 DanielPullen,PeiWang,JoshuaR.Johnson,andJohnR.Talburt PartIV TestingApplications 439 18 TestingDefenseSystems 441 LauraJ.Freeman,ThomasJohnson,MatthewAvery,V.BramLillard,andJustaceClutter 19 ASearch-BasedApproachtoGeographicalDataGenerationforTesting Location-BasedServices 489 XiaoyingBai,KejiaHou,JunHuang,andMingliYu 20 AnalyticsinTestingCommunicationSystems 501 GilliShama 21 MeasuresintheSystemsIntegrationVerificationandValidationPhaseand AerospaceApplicationsFieldExperience 515 SaritAssarafandRonS.Kenett Index 537