TESTING AND MODELING WITH TDL Philip Makedonski, Gusztav Adamis, Martti Käärik, Finn Kristoffersen, Andreas Ulrich, Xavier Zeitoun Overview What is TDL? Why TDL? • Test Description Language Final draft ETSI ES 203 119-1 V1.2.0 (2015-04) • For users • Design, documentation, and representation of formal test • separate test specification from test implementation ETSI STANDARD descriptions • amenable to tool-supported verification Methods for Testing and Specification (MTS); • •StSacnednaarrdioi-sbeads eadt aEpTpSrIo abcyh TC MTS Part 1:T Ahbe sTterasct tD Seysnctraipxt aionnd LAasnsgoucaiagtee d(T SDeLm); antics •• afodcjuuss toanb lwe htaot sttoa kteehsto lvdse hrso w ETE TSESTI S SIIT ESAETETS N A I T DSNSTAEDSA RAN2DTRID D 0AES ER3DTIS ES1 21SI 09E 23-S30 1 32V1 1019.231-.11 9 1( 2-V0141169. -30V-.9121) .( 22V.0111 6.(2-2 00.911)6 (-20091) 6- 09) • STF 454 (2013) • For tool vendors ETSI STANDAMPRaeDrtTth P h4oa:ed MrMS tsT et 1eefrt:otuMTsPhT hArcthoahe o tTDbedrteuTdthe sse rhTsT3ost ese erfe:dtfdcoa i sosEsTnr crtTrti exg tp fTDePD Tosc Steaseeaitherosy nt ssrsDaT tnntdOctcin eeint 2 rnrLagbSssig:ipgxpa ejtcp Geit an trneaaiFciirongogpcnntaondiun itddpvrafi a omi e LhSnLcASgn aipdaaaScpes ntn etLap seSi g(cogaloecTp uinunSicfcDefai(agiyiiccMLfacgguniai)tacefeTatt;eitaa i c gSdi(o(txoTaTei) n oSn;tD D i(n (eoTL(LM mMnD)();ET; T aL( SxMnS)t;)tT)e ;i; cnS ss); i on) • STF 476 (2014) • universal standardised exchange format Wher!e does TDL fit in? • STF 492 (2015) • support for customers from different domains ! • reuse of and integration with existing tools • focus on core expertise, add value through interoperability Keyword-Driven Testing 3 X MBT Representation Generation F iEnTaSIl SdTrAaNEF fTtDi ESnETMAIP a S S RaeIFlTT D ErtSAditThTn TP S NSr4 Aoh aaIa : D deNSMr lfF MSIt sATtDdT e iAt 1REenAfrreEt:NoDatuThMasTPR hArD cfhoTtlDhae Sot tTbeA ddDe rtuTdEhe tsSRs reTr hs Tsoat3D ese 2rfeTetd:ffdo aIcis otsnsTE crr0tTrtES ig Eetx TfpDeD PTos c3SetaseeTIaterihSsyn ot s srs Da TntdtnOEctS1ci neeitn 2r nrbaSLgssi2gi:1pSgxIpj tcpaee Gi t atrn0n eaai9ciFEiron oggcpnntao23nidni ut-ddvpfariS ioa3em LhSLnc0 SAgn iaa1adpSa pc se 3ntn eL2tpaVeisS 1gog(caleco Tp1 u0niunSci1fc9Def.a iagiyi1i(ccf3cLaggMun1i-.aiact)ef0eatte1;T itaa i9 c gi1d((oSt(oxaTTei2 n)o n-StDD0 1V;i( n 4o1(eT(LL1M M59nmD()). -E;; T2T0L (aV-xMS4S.)n2t01;)))Te t ; ;. in S 1(c2sVs).0;0i 1o1 5.n(12-)00 .041)5 (-20041) 5-04) Rail Standards Visualisation ! Documentation ITS Interoperability Conformance 46 2 What is TDL? ETSI ES 203 119-1 • Test Description Language V1.3.1 (2016-09) • Design, documentation, and representation of formalised test ETSI STANDARD descriptions Methods for Testing and Specification (MTS); The Test Description Language (TDL); Part 1: Abstract Syntax and Associated Semantics • Scenario-based approach • Standardised at ETSI by TC MTS • STF 454 (2013) • STF 476 (2014) ! • STF 492 (2015) 3 What is TDL? ETSI ES 203 119-1 • Design, documentation, V1.3.1 (2016-09) representation? • ease development and review ETSI STANDARD • improve productivity and quality Methods for Testing and Specification (MTS); The Test Description Language (TDL); Part 1: Abstract Syntax and Associated Semantics • both industry and standardisation • reduce implementation details ! 4 MBT Workflow Manual Workflow System Requirements Specification Requirements Level Model TPLan TDL-TO Test Generator Test Design Level TDL Test Code Generator TTCN-3 (or Other Execution Language) Test Implementation Level Adaptation Executable Tests Test Execution Level 5 What is TDL? ETSI ES 203 119-1 • Scenario-based? V1.3.1 (2016-09) • describe interactions with a system • attach test objectives to scenarios ETSI STANDARD • derive and automate tests Methods for Testing and Specification (MTS); The Test Description Language (TDL); Part 1: Abstract Syntax and Associated Semantics • Reactive, distributed, real-time • common black-box testing concepts • domain adaptation • agile development ! 6 What is TDL? ETSI ES 203 119-1 • Standardised? V1.3.1 (2016-09) • canonical reference • stable documentation ETSI STANDARD • clear semantics Methods for Testing and Specification (MTS); The Test Description Language (TDL); Part 1: Abstract Syntax and Associated Semantics • interoperability and independence • updated with user needs • maintenance commitment ! 7 What is TDL? ETSI ES 203 119-1 • Contributions from: V1.3.1 (2016-09) • Siemens AG, Ericsson Hungary • Fraunhofer FOKUS, ETSI CTI ETSI STANDARD • CEA, University of Göttingen Methods for Testing and Specification (MTS); The Test Description Language (TDL); Part 1: Abstract Syntax and Associated Semantics • OU Elvior, Cinderella ApS • Guidance: • Steering Group, TC MTS ! 8 What is TDL? ETSI ES 203 119-2 V1.2.1 (2016-09) Part 2: GR Graphical ETSI STANDARD Syntax Methods for Testing and Specification (MTS); The Test Description Language (TDL); Part 2: Graphical Syntax ETSI ES 203 119-1 V1.3.1 (2016-09) ETSI ES 203 119-3 V1.2.1 (2016-09) Part 3: XF Part 1: MM Exchange ETSI STANDARD ETSI STANDARD Meta-Model Format Methods for Testing and Specification (MTS); Methods for Testing and Specification(MTS); The Test Description Language (TDL); The Test Description Language (TDL); and Semantics Part 1: Abstract Syntax and Associated Semantics Part 3: Exchange Format ETSI ES 203 119-4 V1.2.1 (2016-09) Part 4: TO Structured ETSI STANDARD Test Objective ! MetThhoed sT efosrt TDeesstcinrigp taionnd LSapnegcuifaicgaet i(oTnD (LM);T S); Specification Part 4: Stru ctured Test Objective Specification (Extension) 9 What is TDL? ETSI ES 203 119-1 V1.3.1 (2016-09) ETSI STANDARD MetThhoed sT efosrt TDeesstcinrigp taionnd LSapnegcuifaicgaet i(oTnD (LM);T S); Part 1: Abstract Syntax and Associated Semantics x a t n ! y s ETSI ES 203 119-2 V1.2.1 (2016-09) d e O R F ETSI STANDARD n T G X i MetThhoed sT efosPrta TDrtee s2st:ci nGrigrpa tapionhndic LSaapl neSgcyuinfaitcagaxet i(oTnD (LM);T S); f : : : e 4 2 3 d P P P - r L L L e D D D s ETSI ES 203 119-3 V1.2.1 (2016-09) T T T U ETSI STANDARD Methods for Testing and Specification(MTS); The Test Description Language (TDL); Part 3: Exchange Format TDL P1: MM ETSI ES 203 119-4 V1.2.1 (2016-09) ETSI STANDARD Methods for Testing and Specification (MTS); The Test Description Language (TDL); Part 4: Structured Test Objective Specification (Extension) 10
Description: