Software Fault Detection and Correction: Modeling and Applications

117 Pages·2018·2.958 MB·English

by  Rui Peng, Yan-Fu Li, Yu Liu

SPRINGER BRIEFS IN COMPUTER SCIENCE
Rui Peng · Yan-Fu Li · Yu Liu
Software Fault
Detection and
Correction:
Modeling and
Applications
123
SpringerBriefs in Computer Science
Serieseditors
StanZdonik,BrownUniversity,Providence,RhodeIsland,USA
ShashiShekhar,UniversityofMinnesota,Minneapolis,Minnesota,USA
XindongWu,UniversityofVermont,Burlington,Vermont,USA
LakhmiC.Jain,UniversityofSouthAustralia,Adelaide,SouthAustralia,Australia
DavidPadua,UniversityofIllinoisUrbana-Champaign,Urbana,Illinois,USA
XueminShermanShen,UniversityofWaterloo,Waterloo,Ontario,Canada
BorkoFurht,FloridaAtlanticUniversity,BocaRaton,Florida,USA
V.S.Subrahmanian,UniversityofMaryland,CollegePark,Maryland,USA
MartialHebert,CarnegieMellonUniversity,Pittsburgh,Pennsylvania,USA
KatsushiIkeuchi,UniversityofTokyo,Tokyo,Japan
BrunoSiciliano,UniversitàdiNapoliFedericoII,Napoli,Italy
SushilJajodia,GeorgeMasonUniversity,Fairfax,Virginia,USA
NewtonLee,InstforEducationResandScholarships,LosAngeles,California,USA
SpringerBriefs present concise summaries of cutting-edge research and practical
applications across a wide spectrum of fields. Featuring compact volumes of 50 to
125pages,theseriescoversarangeofcontentfromprofessionaltoacademic.
Typicaltopicsmightinclude:
(cid:129) Atimelyreportofstate-of-theartanalyticaltechniques
(cid:129) A bridge between new research results, as published in journal articles, and a
contextualliteraturereview
(cid:129) Asnapshotofahotoremergingtopic
(cid:129) Anin-depthcasestudyorclinicalexample
(cid:129) A presentation of core concepts that students must understand in order to make
independentcontributions
Briefs allow authors to present their ideas and readers to absorb them with
minimal time investment. Briefs will be published as part of Springer’s eBook
collection, with millions of users worldwide. In addition, Briefs will be available
forindividualprintandelectronicpurchase.Briefsarecharacterizedbyfast,global
electronic dissemination, standard publishing contracts, easy-to-use manuscript
preparation and formatting guidelines, and expedited production schedules. We
aim for publication 8-12 weeks after acceptance. Both solicited and unsolicited
manuscriptsareconsideredforpublicationinthisseries.
Moreinformationaboutthisseriesathttp://www.springer.com/series/10028
(cid:129) (cid:129)
Rui Peng Yan-Fu Li Yu Liu
Software Fault Detection
and Correction: Modeling
and Applications
RuiPeng Yan-FuLi
DonlinksSchoolofEconomics DepartmentofIndustrial&SystemsEngineering
&Management TsinghuaUniversity
UniversityofScienceandTechnology Beijing,China
Beijing
Beijing,China
YuLiu
DepartmentofSystemsEngineering
andEngineeringManagement
CityUniversityofHongKong
HongKong,China
ISSN2191-5768 ISSN2191-5776 (electronic)
SpringerBriefsinComputerScience
ISBN978-981-13-1161-1 ISBN978-981-13-1162-8 (eBook)
https://doi.org/10.1007/978-981-13-1162-8
LibraryofCongressControlNumber:2018957277
©The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.2018
Thisworkissubjecttocopyright.AllrightsaresolelyandexclusivelylicensedbythePublisher,whether
thewholeorpartofthematerialisconcerned,specificallytherightsoftranslation,reprinting,reuseof
illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and
transmission or information storage and retrieval, electronic adaptation, computer software, or by
similarordissimilarmethodologynowknownorhereafterdeveloped.
Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication
doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant
protectivelawsandregulationsandthereforefreeforgeneraluse.
The publisher, the authors and the editors are safe to assume that the advice and information in this
bookarebelievedtobetrueandaccurateatthedateofpublication.Neitherthepublishernortheauthorsor
theeditorsgiveawarranty,expressorimplied,withrespecttothematerialcontainedhereinorforany
errorsoromissionsthatmayhavebeenmade.Thepublisherremainsneutralwithregardtojurisdictional
claimsinpublishedmapsandinstitutionalaffiliations.
ThisSpringerimprintispublishedbytheregisteredcompanySpringerNatureSingaporePteLtd.
The registered company address is: 152 Beach Road, #21-01/04 Gateway East, Singapore 189721,
Singapore
Preface
Softwareplaysanimportantroleinbotheverydaylifeandindustrialproductions.In
ordertoguaranteethereliabilityofsoftware,alongtestingprocessisusuallyneeded
before the software can be finally released to market. During the last few decades,
numerous software reliability growth models (SRGMs) have been proposed to
characterize the growth of software reliability during testing. These models are
veryimportantformanagement tomake related decisions, suchasdeterminingthe
optimalsoftwarereleasetimeconsideringbothsoftwarereliabilityandtotalcost.
The models typically can be classified as Markov models, nonhomogeneous
Poisson process models, data-driven models, and simulation-based models. These
models have been successfully applied into many software projects, especially the
NHPP models. However, most traditional models assume that faults can be imme-
diately removed upon detection and thus only construct the fault detection process
model.Inpractice,adetectedfaultneedstobereportedandverifiedbeforeitcanbe
finally corrected. Some researchers have tried to incorporate the debugging delay
into the software reliability modeling process and tried to construct several paired
modelsforbothfaultdetectionprocessandfaultcorrectionprocess.However,these
models fail to consider some more practical factors, such as the fault introduction
process,thetestingresourceallocationduringtesting,andthefaultdependency.
Inthisbook,fivedifferentworksonthemodelingofsoftwarefaultdetectionand
correctionprocessesareintroduced,withincorporationofdifferentfactors.Foreach
work, the parameter estimation method is introduced, and the applications of the
modelsproposedareillustratedbyrealdataset.Inparticular,theoptimalreleasetime
problem is studied for each work. Chapters 1 and 2 are written by Dr. Yan-Fu LI
and Dr. Rui PENG together. Chapters 3, 4, and 7 are written by Dr. Rui PENG.
Chapters 5 and 6 are written by Dr. Yu LIU and Dr. Rui PENG together. The
following people have also participated in the works included in this book:
Prof. Xiangbin Yan and his student Hui Qiu from the University of Science and
Technology Beijing, Dr. Qingqing Zhai from Shanghai University, and Chair
Professor Min Xie from the City University of Hong Kong. This book is partially
supportedbytheNationalNaturalScienceFoundationofChina(NSFC)undergrant
v
vi Preface
numbers 71531013 and 71671016. The valuable comments from anonymous
reviewersandtheassistanteditorJaneLiaredeeplyindebted.
Throughreadingthisbook,readersshouldbeabletocommandhowthesoftware
reliability is modeled, in particular, when both fault detection process and fault
correction process are of concern. To better understand the contents of this book,
readers are supposed to command the fundamentals of probability theory and
stochastic process. This book is especially used for researchers, practitioners, and
graduatestudentsinthefieldofsoftwareengineering.
Beijing,China RuiPeng
Beijing,China Yan-FuLi
HongKong,China YuLiu
Contents
1 Introduction. . . . . .. . . . .. . . . .. . . . . .. . . . .. . . . . .. . . . .. . . . . . 1
1.1 Reliability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 SoftwareReliability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
1.3 StructureoftheBook. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
References. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
2 ClassificationofModels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2.1 SoftwareReliabilityModels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2.2 NHPPModels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2.3 SimulationModels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.4 Data-DrivenModels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.5 MarkovModels. . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . 10
2.6 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
References. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3 TEFDependentSoftwareFDPandFCPModels. . . . . . . . . . . . . . . . 15
3.1 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
3.2 TheModelingProcess. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
3.2.1 FDPModel. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
3.2.2 FCPModel. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
3.2.3 SomeSpecificModels. . . . . . . . . . . . . . . . . . . . . . . . . . . 18
3.2.4 ASummaryofVariousTesting-EffortFunctions. . . . . . . . 22
3.3 ParameterEstimation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
3.4 IllustrativeExample. . .. . . . . . . . . . . . . . .. . . . . . . . . . . . . . . .. 25
3.4.1 DatasetDescription. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
3.4.2 SelecttheMostSuitableTEFforThisDataset. . . . . . . . . . 26
3.4.3 PerformanceAnalysis. . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
3.5 SoftwareReleasePolicies. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
3.5.1 SoftwareReleasePolicyBasedonReliabilityCriterion. . . . 27
3.5.2 SoftwareReleasePolicyBasedonCostCriterion. . . . . . . . 28
vii
viii Contents
3.5.3 SoftwareReleasePolicyBasedonMixedCriterion. . . . . . . 28
3.5.4 NumericalExamplesforSoftwareReleasePolicy. . . . . . . . 29
3.6 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
References. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
4 SoftwareReliabilityModelsConsideringFaultDependency. . . . . . . 33
4.1 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
4.2 TheModelingFramework. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
4.2.1 ModelingFDP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
L
4.2.2 ModelingFCP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
L
4.2.3 ModelingFDP andFCP . . . . . . . . . . . . . . . . . . . . . . . . 37
D D
4.2.4 CombinedModels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
4.2.5 SpecificModelsforDependentFDPandFCP. . . . . . . . . . 38
4.3 ParameterEstimation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
4.4 NumericalExample. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
4.4.1 DescriptionoftheDatasets. . . . . . . . . . . . . . . . . . . . . . . . 41
4.4.2 PerformanceAnalysis. . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
4.5 SoftwareReleasePolicy. . .. . . . . . .. . . . . . .. . . . . . . .. . . . . . . 44
4.5.1 SoftwareReleasePolicyBasedonReliabilityCriterion. . . . 45
4.5.2 SoftwareReleasePolicyBasedonCostCriterion. . . . . . . . 45
4.5.3 SoftwareReleasePolicyBasedonMixedCriterion. . . . . . . 47
4.5.4 NumericalExamples. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
4.6 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
References. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
5 GeneralOrderStatistics-BasedModel. . . . . . . . . . . . . . . . . . . . . . . . 53
5.1 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
5.2 ModelingFramework. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
5.2.1 ModelingFaultDetectionProcess. . . . . . . . . . . . . . . . . . . 55
5.2.2 ModelingFaultCorrectionProcess. . . . . . . . . . . . . . . . . . 57
5.3 ParameterEstimationwithWeightedLeast-SquareEstimation
Method. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . 59
5.4 SomeApplicationExamples. . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
5.4.1 ApplicationtoanExistingDataset. . . . . . . . . . . . . . . . . . . 62
5.4.2 PredictabilityComparison. . . . . . . . . . . . . . . . . . . . . . . . . 62
5.4.3 OptimalSoftwareReleaseTimeAnalysis. . . . . . . . . . . . . . 64
5.4.4 ApplicationtoaNewandRealDatasetwithUnequal
TimeInterval. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
5.4.5 PerformanceComparison. . . . . . . . . . . . . . . . . . . . . . . . . 68
5.4.6 OptimalSoftwareReleaseTimeAnalysis. . . . . . . . . . . . . . 70
5.5 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
References. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Contents ix
6 ReliabilityofMulti-releaseOpen-SourceSoftware. . . . . . . . . . . . . . . 75
6.1 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
6.2 ModelingFrameworkinFDPandFCPwith
SemigroupedTestData. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76
6.2.1 FaultCorrectionProcessModeling. . . . . . . . . . . . . . . . . . 76
6.2.2 FaultRemovingMatrix. . . . . . . . . . . . . . . . . . . . . . . . . . . 76
6.2.3 ModelingFDPandFCPBasedon
theFaultRemovingMatrix. . . . . . . . . . . . . . . . . . . . . . . . 77
6.2.4 ExtendedModelingFrameworkwithMultipleReleases. . . 80
6.3 ParameterEstimationandComparisonCriteria. . . . . . . . . . . . . . . 81
6.3.1 PointEstimation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
6.3.2 IntervalEstimation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82
6.3.3 ComparisonCriteria. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
6.4 IllustrativeExample. . .. . . . . . . . . . . . . . .. . . . . . . . . . . . . . . .. 84
6.4.1 DatasetDescription. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
6.4.2 ModelApplicationwithSingleReleasedSoftware. . . . . . . 84
6.4.3 ModelApplicationwithMultipleReleasedSoftware. . . . . . 89
6.5 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
References. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
7 FDPandFCPwithFourTypesofFaults. . . . . . . . . . . . . . . . . . . . . . 95
7.1 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
7.2 TheModelingProcess. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
7.2.1 FaultDetectionProcess. . . . . . . . . . . . . . . . . . . . . . . . . . . 97
7.2.2 FaultCorrectionProcess. . . . . . . . . . . . . . . . . . . . . . . . . . 98
7.2.3 SomeSpecialCases. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99
7.3 ParameterEstimation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
7.4 IllustrativeExamples. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
7.5 SoftwareReleasePolicies. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103
7.5.1 SoftwareReleasePolicyBasedonReliabilityCriterion. . . . 103
7.5.2 SoftwareReleasePolicyBasedonCostCriterion. . . . . . . . 104
7.5.3 SoftwareReleasePolicyBasedonMixedCriterion. . . . . . . 105
7.5.4 NumericalExamplesforSoftwareReleasePolicy. . . . . . . . 105
7.6 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
References. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106