Protocol Test Systems IFIP - The International Federation for Information Processing IFIP was founded in 1960 under the auspices of UNESCO, following the First World Computer Congress held in Paris the previous year. An umbrella organization for societies working in information processing, IFIP's aim is two-fold: to support information processing within its member countries and to encourage technology transfer to developing nations. As its mission statement clearly states, IFIP's mission is to be the leading, truly international, apolitical organization which encourages and assists in the development, exploitation and application of information technology for the benefit of all people. IFIP is a non-profitmaking organization, run almost solely by 2500 volunteers. It operates through a number of technical committees, which organize events and publications. IFIP's events range from an intemational congress to local seminars, but the most important are: • the IFIP World Computer Congress, held every second year; • open conferences; • working conferences. The flagship event is the IFIP World Computer Congress, at which both invited and contributed papers are presented. Contributed papers are rigorously refereed and the rejection rate is high. As with the Congress, participation in the open conferences is open to all and papers may be invited or submitted. Again, submitted papers are stringently refereed. The working conferences are structured differently. They are usually run by a working group and attendance is small and by invitation only. Their purpose is to create an atmosphere conducive to innovation and development. Refereeing is less rigorous and papers are subjected to extensive group discussion. Publications arising from IFIP events vary. The papers presented at the IFIP World Computer Congress and at open conferences are published as conference proceedings, while the results of the working conferences are often published as collections of selected and edited papers. Any national society whose primary activity is in information may apply to become a full member of IFIP, although full membership is restricted to one society per country. Full members are entitled to vote at the annual General Assembly, National societies preferring a less committed involvement may apply for associate or corresponding membership. Associate members enjoy the same benefits as full members, but without voting rights. Corresponding members are not represented in IFIP bodies. Affiliated membership is open to non-national societies, and individual and honorary membership schemes are also offered. Protocol Test Systems 7th workshop 7th IFIP WG 6.1 international workshop on protocol text systems Edited by Tadanori Mizuno Shizuoka University Japan Teruo Higashino Osaka University Japan and Norio Shiratori Tohoku University Japan lunl SPRINGER-SCIENCE+BUSINESS MEDIA, B.v. First edition 1995 @ 1995 Springer Science+Business Media Dordrecht Originally published by Chapman & HalI in 1995 ISBN 978-1-4757-6310-2 ISBN 978-0-387-34883-4 (eBook) DOI 10.1007/978-0-387-34883-4 Apart from any fair dealing for ilie purposes of resean:h or private study, or crilicism or review, as permitted under ilie UK Copyright Desigus and Patents Act, 1988, lhis publication may not be reproduced, stored, Of ttansmilted, in any form or by any means, wiiliout ilie priOf permission in writing of tbe publisbers, or in ilie case of reprographic reproduction only in accordance wiili lhe terms of ilie licences issued by ilie Copyright Ucensing Agency in the UK, or in accordance wiili ilie terms of licences issued by ilie appropriale Reproduction Rights Organization oulside ilie UK. Enquiries conceming reproduction oulside ilie terms slated here should be sent 10 ilie publishers al ilie London address printed on this page. The publisher makes no represenlation, express or implied, wiili regard 10 ilie accuracy of ilie information contained in this hook and cannot accept any legal responsibility Of liability for any errors or omissions lbal may be made. A cata10gue record for thls book is available from the British Library @ Printed on pennanent acid-free text paper, manufactured in accordance with ANSIINISO Z39.48-1992 and ANSIINISO Z39.48-l984 (Pennanence of Paper). CONTENTS Preface ix Editors, General Co.-chairs, Programme Co-chairs Programme Committee, Local Arrangement, Corporate Sponsors x PART ONE 1 Open issues in confonnance test specification B. Baumgarten 3 2 OSI protocol testing system based on user friendly test scenario specification functions T. Kato, T. Ogishi, T. Hasegawa and K. Suzuki 19 3 TTCN test case correctness validation F. Kristoffersen and T. Walter 35 INVITED ADDRESS 1 53 4 Fault coverage of tests based on finite state models G. v. Bochmann, A. Petrenko and M. Yao 55 PART TWO 5 On transition time testing based on extended finite state machines S. Zhang and S.T. Chanson 79 6 Selecting test sequences for partially-specified nondeterministic finite state machines G. Luo, A. Petrenko and G. v. Bochmann 95 7 An optimal state identification method using a dynamic-programming based approach for protocol testing R.S. Lin and M.e. Yuang 111 PANEL SESSION 1 119 8 The present status of confonnance testing and interoperability testing Y. Yokoyama 121 PART THREE 123 9 Design and implementation of an interconnectability testing system -AICTS K. Takahashi, S. Suzuki, K. Sawai, M. Hatafuku, K. Gotoh and K. Kazama 125 vi Contents 10 Evaluation of some test generation tools on a real protocol example L. Boullier, B. Kelly, M. Phalippou, A. Rouger and N. Webster 141 11 Protocol validation tools as test case generators c.-J. Wang, L.-S. Koh and M.T. Liu 155 INVITED ADDRESS 2 171 12 Framework for formal methods in conformance testing D. Hogrefe 173 PART FOUR 191 13 Testing strategies for communicating FSMs A. Petrenko, N. Yevtushenko and R. Dssouli 193 14 A generalization ofthe multiple DID method oftest sequence selection for protocols represented in FSM T. Ramalingam, K. Thulasiraman and A. Das 209 15 Automatic generation of extended DID sequences for communication protocols in an EFSM model X. Li, T. Higashino, M. Higuchi and K. Taniguchi 225 PART FIVE 241 16 A new test sequence generation method for interoperability testing N. Okazaki, M.R. Park, K. Takahashi and N. Shiratori 243 17 How to observe interoperability at the service level of protocols C. Jard 259 18 Testing using telecommunications management R. C. van Wuijtswinkel and M.F. Witteman 271 PART SIX Short Paper Session 1 281 19 An implementation of CMIP/CMISE conformance testing system C.-S. Lu, H. Chien, W.-H. Tsai, w.-T. Chang, c.-s. Perng c.-T. Lin, K.-J. Cheng, K.-W. Peng and G. Tzeng 283 20 A conformance testing framework for applying test purposes J.H. Park, J.Y. Lee, 1.Y. Jung and J.P. Hong 291 21 Implementation of TTCN operational semantics in Estelle L. Hou, J.-P. Favreau and D. Tang 299 PART SEVEN Short Paper Session 2 307 22 An approach to TTCN-based test execution Y. Wang, J. Wu and R. Hao 309 23 Time oriented protocol testing simulator K. Dhta, N. Nakano, T. Watanabe and T. Mizuno 317 Contents vii 24 On the exploitation of parallelism in a test generation method for LOTOS-specifications V. Plesser 325 PANEL SESSION 2 333 25 Panel on some issues on testing theory and its application A.R. Cavalli 335 26 Some issues on testing theory and its application A.R. Cavalli and M. Phalippou 337 Index of contributors 346 Keyword index 347 PREFACE This is the Proceedings of the 7th IFIP WG6.1 International Workshop on Protocol Test Systems (IWPTS'94) which was held in Tokyo, Japan on November 8-10, 1994. After having been organized in Vancouver (Canada, 1988), Berlin (Germany, 1989), McLean (USA, 1990), Leidschendam (The Netherlands, 1991), Montreal (Canada, 1992) and Pau (France, 1993), this is the 7th international workshop. The aim of the workshop is to be a meeting point between research and industry and between theory and practice of the testing of data communication systems. The workshop consists of the presentations of reviewed and invited papers, tool demonstrations and panel sessions. All submitted papers have been reviewed by the members of the Program Committee and the following additional reviewers including: L. Andrey, N. Arakawa, D. Becam, L. Boullier, R. Dssouli, B. Forghani, M. Higuchi, L. Heerink, G. Huecas, M. Hunter, S. lisaku, Y. Kakuda, K. Kazama, L-S. Koh , R. Langerak, D. Lee, G. Leon, G. Luo, P. Maigron, M. Mori, A. Nakamura, S. Nightingale, K. Okada, K. Okano, N. Okazaki, A. Petrenko, M. Phalippou, A. Rennoch, F. Sato, Y. Sugito, D. Tang, D. Toggweiler, F. Vallo and J. Zhu. The Program Committee has selected excellent papers among them. This proceedings includes two invited papers, fifteen regular papers, six short papers, two panel reports and one panel paper which were presented in the workshop. Many people have contributed to the success of the workshop. We would like to express our thanks to all the PC members, reviewers and people participating in the local organization. We would like to express our appreciation to G. v. Bochmann (Univ. of Montreal) and D. Hogrefe (Univ. of Bern) for accepting our invitations to be the invited speakers. Special thanks go to A. R. Cavalli (INT, France), Y. Yokoyama (INTAP, Japan) for organizing the panels. Also our thanks go to K. Suzuki (KDD, Japan) and the staffs of Hotel STRADA for their kind local arrangements. Tadanori Mizuno Teruo Higashino Norio Shiratori Tokyo, Japan, November 1994 EDITORS Tadanori Mizuno (Shizuoka Univ., Japan, [email protected]) Teruo Higashino (Osaka Univ., Japan, [email protected]) Norio Shiratori (Tohoku Univ., Japan, [email protected]) GENERAL CO-CHAIRS Norio Shiratori (Tohoku Univ., Japan, [email protected]) Yoshihiko Yokoyama (INTAP, Japan, [email protected]) PROGRAM CO-CHAIRS Prof. Tadanori Mizuno Prof. Teruo Higashino Dept. of Computer Science Dept. of Info. and Compo Sci. Shizuoka University Osaka University 3-5-1 Johoku, Hamamatsu 432 Toyonaka, Osaka 560 Japan Japan Phone:+81-53-475-6103 Phone:+81-6-850-6607 Fax:+81-53-475-4595 Fax:+81-6-850-6609 Email: [email protected] Email: [email protected] PROGRAM COMMITTEE G. v. Bochmann (U. of Montreal, Canada), Ed. Brinksma (U. of Twente, Netherlands), R. Castanet (U. of Bordeaux, France), A. R. Cavalli (INT, France), S. T. Chanson (HongKong U. of Sci. Tech., HongKong), J.-P. Favreau (NIST, USA), R. Groz (CNET, France), Y. Hirakawa (NIT, Japan), D. Hogrefe (U. of Bern, Switzerland), G. J. Holzmann (AT&T, USA), J. Y. Lee (POSTECH, korea), M. T. Liu (Ohio U., USA), J. de Meer (GMD-FOKUS, Germany), K. Ohmaki (ETL, Japan), K. Parker (Austr. Telecom, Australia), J. Quemada (Tech. U. of Madlid, Spain), O. Rafiq (U. Pau, France), D. Rayner (NPL, U.K.), B. Sarikaya (Aizu U., Japan), K. Suzuki (KDD, Japan), J. Tretmans (GMD, Germany), H. Ural (U. of Ottawa, Canada), S. T. Vuong (U. of British Columbia, Canada), J. Wu (Tsing Hua U., China) LOCAL ARRANGEMENT Dr. Kenji Suzuki KDD R&D Labs., 2-1-15 Ohara Kamifukuoka-shi, Saitama 356, Japan Phone: +81-492-66-7360 Fax: +81-492-66-7510 Email: [email protected] CORPORATE SUPPORTERS Information Processing Society of Japan (!PSI) Interoperability Technology Association for Information Processing, Japan (INTAP) PART ONE