Lecture Notes in Computer Science 7403 CommencedPublicationin1973 FoundingandFormerSeriesEditors: GerhardGoos,JurisHartmanis,andJanvanLeeuwen EditorialBoard DavidHutchison LancasterUniversity,UK TakeoKanade CarnegieMellonUniversity,Pittsburgh,PA,USA JosefKittler UniversityofSurrey,Guildford,UK JonM.Kleinberg CornellUniversity,Ithaca,NY,USA AlfredKobsa UniversityofCalifornia,Irvine,CA,USA FriedemannMattern ETHZurich,Switzerland JohnC.Mitchell StanfordUniversity,CA,USA MoniNaor WeizmannInstituteofScience,Rehovot,Israel OscarNierstrasz UniversityofBern,Switzerland C.PanduRangan IndianInstituteofTechnology,Madras,India BernhardSteffen TUDortmundUniversity,Germany MadhuSudan MicrosoftResearch,Cambridge,MA,USA DemetriTerzopoulos UniversityofCalifornia,LosAngeles,CA,USA DougTygar UniversityofCalifornia,Berkeley,CA,USA GerhardWeikum MaxPlanckInstituteforInformatics,Saarbruecken,Germany Anna Esposito Antonietta M. Esposito Alessandro Vinciarelli Rüdiger Hoffmann Vincent C. Müller (Eds.) Cognitive Behavioural Systems COST 2102 International Training School Dresden, Germany, February 21-26, 2011 Revised Selected Papers 1 3 VolumeEditors AnnaEsposito SecondaUniversitàdegliStudidiNapoli IIASS,Napoli,Italy E-mail:[email protected] AntoniettaM.Esposito IstitutoNazionalediGeofisicaeVulcanologia SezionediNapoliOsservatorioVesuviano,Napoli,Italy E-mail:[email protected] AlessandroVinciarelli UniversityofGlasgow,SchoolofComputingScience,Glasgow,UK E-mail:[email protected] RüdigerHoffmann TechnischeUniversitätDresden InstitutfürAkustikundSprachkommunikation,Dresden,Germany E-mail:[email protected] VincentC.Müller AnatoliaCollege/ACT DepartmentofHumanitiesandSocialSciences,Pylaia,Greece E-mail:[email protected] ISSN0302-9743 e-ISSN1611-3349 ISBN978-3-642-34583-8 e-ISBN978-3-642-34584-5 DOI10.1007/978-3-642-34584-5 SpringerHeidelbergDordrechtLondonNewYork LibraryofCongressControlNumber:2012950318 CRSubjectClassification(1998):H.1.2,H.5.5,I.2.7,I.2.9-10,H.5.1-3,H.3.1,H.3.4, I.4.8,I.5.4,G.3,J.4,J.5 LNCSSublibrary:SL3–InformationSystemsandApplication,incl.Internet/Web andHCI ©Springer-VerlagBerlinHeidelberg2012 Thisworkissubjecttocopyright.Allrightsarereserved,whetherthewholeorpartofthematerialis concerned,specificallytherightsoftranslation,reprinting,re-useofillustrations,recitation,broadcasting, reproductiononmicrofilmsorinanyotherway,andstorageindatabanks.Duplicationofthispublication orpartsthereofispermittedonlyundertheprovisionsoftheGermanCopyrightLawofSeptember9,1965, initscurrentversion,andpermissionforusemustalwaysbeobtainedfromSpringer.Violationsareliable toprosecutionundertheGermanCopyrightLaw. Theuseofgeneraldescriptivenames,registerednames,trademarks,etc.inthispublicationdoesnotimply, evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevantprotectivelaws andregulationsandthereforefreeforgeneraluse. Typesetting:Camera-readybyauthor,dataconversionbyScientificPublishingServices,Chennai,India Printedonacid-freepaper SpringerispartofSpringerScience+BusinessMedia(www.springer.com) This book is dedicated to endings and to what is left behind Preface This volume brings together the advanced research results obtained by the European COST Action 2102 “Cross Modal Analysis of Verbal and Nonverbal Communication”,primarilydiscussedattheEUCogII-SSPNet-COST2102Inter- national Training School on “Cognitive BehaviouralSystems”, held in Dresden, Germany, February 21–26 2011 (www.ias.et.tu-dresden.de/ias/cost-2102/). TheschoolwasjointlysponsoredbytheEuropeanCooperationinScienceand Technology (COST, www.cost.eu) in the domain of Information and Communi- cation Technologies (ICT) for disseminating the advances of the research activ- ities developed within the COST Action 2102:“Cross-ModalAnalysis of Verbal and Nonverbal Communication” (cost2102.cs.stir.ac.uk); by the European Net- workofExcellenceonSocialSignalProcessing(SSPNet,www.sspnet.eu)andby the2ndEuropeanNetworkfortheAdvancementofArtificialCognitiveSystems, Interaction and Robotics (EUCogII, www.eucognition.org/). The main focus of the school was on Cognitive BehaviouralSystems. In pre- viousmeetings,EUCogII-SSPNet-COST2102focusedontheimportanceofdata processing for gaining enactive knowledge, as well as on the discovery of new processing possibilities that account for new data analysis approaches, coordi- nation of the data flow through synchronizationand temporal organizationand optimization of the extracted features. The next step will be to discover more natural and intuitive approaches for modelling and uncovering the wealth of information conveyedby humans during interaction for developing realistic and sociallybelievableagents.Thismovestheresearchfocustocognitivesystemsand models ofcognitiveprocesses.Ithas been shownthat cognitiveprocesses– such as inference, categorizationand memory – arenot independent of their physical instantiations. Individual choices, perception and actions emerge and are dy- namically affected/enhanced by the interaction between sensory-motor systems andtheinhabitedenvironment(includingthe organizational,culturalandphys- ical context). This interplay carries up instantiations of cognitive behavioural systems. How can these aspects be modelled in order to bring machine intelligence close to human expectations? Are existing paradigms sufficient or is more re- search needed on signals and data? How trustful, credible and satisfactory will emotionally-colouredmultimodalsystemsappeartotheenduser?Howwilltheir physical instantiation and appearance affect the human-machine interplay? The papers accepted in this volume were peer reviewed and include original contributions from early stage researchers. The volume presents new and orig- inal research results in the field of human-machine interaction inspired by cog- nitive behavioural human-human interaction features. The themes covered are cognitive and computational social information processing, emotional and so- cially believable Human-Computer Interaction (HCI) systems, behavioural and VIII Preface contextual analysis of interactions, embodiment, perception, linguistics, seman- tics and sentiment analysis in dialogues and interactions, and algorithmic and computational issues for the automatic recognition and synthesis of emotional states. The contents have been divided into two scientific sections according to a rough thematic classification. The first section, “Computational Issues in Cog- nitive Systems”, deals with models, algorithms, and heuristic strategies for the recognitionandsynthesisofbehaviouraldata.Thesecondsection,“Behavioural Issues in Cognitive Systems”, presents original studies that provide theoretical and behavioural analyses on linguistic and paralinguistic expressions, actions, body movements and activities in human interaction. The papers included in this book benefited from the lively interactions be- tween the many participants of the successful meeting in Dresden. Over 100 senior and junior researchers gathered for the event. The editors would like to thank the Management Board of the SSPNet and the ESF COST- ICT Programme for their support in the realization of the schoolandthepublicationofthisvolume.Acknowledgementsgoinparticularto the COST Science Officers, Giseppe Lugano, Matteo Razzanelli, and Aranzazu Sanchez, and the COST 2102 rapporteur, Guntar Balodis, for their constant help,guidanceandencouragement.Theeventowesitssuccesstomoreindividu- als than can be named, but notably the members of the Dresden LocalSteering Committee, who actively operated for the success of the event. Special appreci- ationgoestothe Presidentofthe InternationalInstitute forAdvancedScientific Studies (IIASS), and to the Dean and the Director of the Faculty and the De- partmentofPsychologyatthe SecondUniversityofNaplesformakingavailable people and resources for editing this volume. The editors are deeply indebted to the contributors for making this book a scientifically stimulating compilation of new and original ideas and to the members of the COST 2102 International Scientific Committee for their rigorous and invaluable scientific revisions, dedi- cation, and priceless selection process. July 2012 Anna Esposito Antonietta M. Esposito Alessandro Vinciarelli Ru¨diger Hoffmann Vincent C. Mu¨ller Organization International Steering Committee Anna Esposito Second University of Naples and IIASS, Italy Marcos Faundez-Zanuy University of Mataro, Barcelona, Spain Ru¨diger Hoffmann Technische Universta¨t Dresden (TUD), Germany Amir Hussain University of Stirling, UK Vincent Mu¨ller Anatolia College, Pylaia, Greece Alessandro Vinciarelli University of Glasgow, UK Local Steering Committee Lutz-Michael Alisch TUD, Theory of Educational Sciences and Research Methods Rainer Groh TUD, Media Design Ru¨diger Hoffmann TUD, System Theory and Speech Technology Klaus Kabitzsch TUD, Technical Information Management Systems Klaus Meißner TUD, Multimedia Technology Boris Velichovsky TUD, Engineering Psychology and Cognitive Ergonomics Gerhard Weber TUD, Human-Computer Interaction COST 2102 International Scientific Committee Alberto Abad INESC-ID Lisboa, Portugal Samer Al Moubayed Royal Institute of Technology, Sweden Uwe Altmann Friedrich-Schiller-University Jena, Germany Sigru´n Mar´ıa Ammendrup SchoolofComputerScience,Reykjavik,Iceland Hicham Atassi BrnoUniversityofTechnology,CzechRepublic Nikos Avouris University of Patras, Greece Martin Bachwerk Trinity College, Dublin, Ireland Ivana Baldasarre Second University of Naples, Italy Sandra Baldassarri ZaragozaUniversity, Spain Ruth Bahr University of South Florida, USA G´erardBailly GIPSA-lab, Grenoble, France Marena Balinova UniversityofAppliedSciences,Vienna,Austria Marian Bartlett University of California, San Diego, USA X Organization Dominik Bauer RWTH Aachen University, Germany Sieghard Beller Universita¨t Freiburg, Germany Sˇtefan Benˇuˇs Constantine the Philosopher University, Nitra, Slovak Republic Niels Ole Bernsen University of Southern Denmark, Denmark Jonas Beskow Royal Institute of Technology, Sweden Peter Birkholz RWTH Aachen University, Germany Horst Bishof Technical University Graz, Austria Jean-Francois Bonastre Universit´e d’Avignon, France Marek Boha´ˇc TechnicalUniversityofLiberec,CzechRepublic Elif Bozkurt Koc¸ University, Istanbul, Turkey Nikolaos Bourbakis ITRI, Wright State University, Dayton, USA Maja Bratani´c University of Zagreb, Croatia Antonio Calabrese Istituto di Cibernetica – CNR, Naples, Italy Erik Cambria University of Stirling, UK Paola Campadelli Universita` di Milano, Italy Nick Campbell University of Dublin, Ireland Valent´ın Carden˜oso Payo Universidad de Valladolid, Spain Nicoletta Caramelli Universita` di Bologna, Italy Antonio Castro-Fonseca Universidade de Coimbra, Portugal Aleksandra Cerekovic Faculty of Electrical Engineering , Croatia Peter Cerva TechnicalUniversityofLiberec,CzechRepublic Josef Chaloupka TechnicalUniversityofLiberec,CzechRepublic Mohamed Chetouani Universit´e Pierre et Marie Curie, France G´erardChollet CNRS URA-820, ENST, France Simone Cifani Universit`a Politecnica delle Marche, Italy Muzeyyen Ciyiltepe GulhaneAskeriTipAcademisi,Ankara,Turkey Anton Cizmar Technical University of Koˇsice, Slovakia David Cohen Universit´e Pierre et Marie Curie, Paris, France Nicholas Costen Manchester Metropolitan University, UK Francesca D’Olimpio Second University of Naples, Italy Vlado Deli´c University of Novi Sad, Serbia C´eline De Looze Trinity College, Dublin 2, Ireland Francesca D’Errico Universit`a di Roma 3, Italy Angiola Di Conza Second University of Naples, Italy Giuseppe Di Maio Second University of Naples, Italy Marion Dohen ICP, Grenoble, France Thierry Dutoit Facult´e Polytechnique de Mons, Belgium Laila Dybkjær University of Southern Denmark, Denmark Jens Edlund Royal Institute of Technology, Sweden Matthias Eichner Technische Universita¨t Dresden, Germany Organization XI Aly El-Bahrawy Ain Shams University, Cairo, Egypt Cig˘dem Ero˘glu Erdem Bahc¸e¸sehir University, Istanbul, Turkey Engin Erzin Koc¸ University, Istanbul, Turkey Anna Esposito Second University of Naples, Italy Antonietta M. Esposito Osservatorio Vesuviano Napoli, Italy Joan Fa`bregas Peinado Escola Universitaria de Mataro, Spain Sascha Fagel Technische Universita¨t Berlin, Germany Nikos Fakotakis University of Patras, Greece Manuela Farinosi University of Udine, Italy Marcos Fau´ndez-Zanuy Universidad Polit´ecnica de Catalun˜a, Spain Tibor Fegyo´ Budapest University of Technology and Economics, Hungary Fabrizio Ferrara University of Naples “Federico II”, Italy Dilek Fidan Ankara University, Turkey Leopoldina Fortunati Universita` di Udine, Italy Todor Ganchev University of Patras, Greece Carmen Garc´ıa-Mateo University of Vigo, Spain Vittorio Girotto Universita` IUAV di Venezia, Italy Augusto Gnisci Second University of Naples, Italy Milan Gnjatovi´c University of Novi Sad, Serbia Bjorn Granstrom Royal Institute of Technology, Sweden Marco Grassi Universit`a Politecnica delle Marche, Italy Maurice Grinberg New Bulgarian University, Bulgaria Jorge Gurlekian LIS CONICET, Buenos Aires, Argentina Mohand-Said Hacid Universit´e Claude Bernard Lyon 1, France Jaakko Hakulinen University of Tampere, Finland Ioannis Hatzilygeroudis University of Patras, Greece Immaculada Hernaez University of the Basque Country, Spain Javier Hernando Technical University of Catalonia, Spain Wolfgang Hess Universita¨t Bonn, Germany Dirk Heylen University of Twente, The Netherlands Daniel Hl´adek TechnicalUniversityofKoˇsice,SlovakRepublic Ru¨diger Hoffmann Technische Universita¨t Dresden, Germany Hendri Hondorp University of Twente, The Netherlands David House Royal Institute of Technology, Sweden Evgenia Hristova New Bulgarian University, Sofia, Bulgaria Stephan Hu¨bler Dresden University of Technology, Gremany Isabelle Hupont Aragon Institute of Technology, Zaragoza, Spain Amir Hussain University of Stirling, UK Viktor Imre Budapest University of Technology and Economics, Hungary XII Organization Ewa Jarmolowicz Adam Mickiewicz University, Poznan, Poland Kristiina Jokinen University of Helsinki, Finland Jozef Juh´ar Technical University Koˇsice,Slovak Republic Zdravko Kacic University of Maribor, Slovenia Bridget Kane Trinity College Dublin, Ireland Jim Kannampuzha RWTH Aachen University, Germany Maciej Karpinski Adam Mickiewicz University, Poznan, Poland Eric Keller Universit´e de Lausanne, Switzerland Adam Kendon University of Pennsylvania, USA Stefan Kopp University of Bielefeld, Germany Jacques Koreman University of Science and Technology, Norway Theodoros Kostoulas University of Patras, Greece Maria Koutsombogera Inst. for Language and Speech Processing, Greece Robert Krauss Columbia University, New York, USA Bernd Kro¨ger RWTH Aachen University, Germany Gernot Kubin Graz University of Technology, Austria Olga Kulyk University of Twente, The Netherlands Alida Labella Second University of Naples, Italy Emilian Lalev New Bulgarian University, Bulgaria Yiannis Laouris CyprusNeuroscienceandTechnologyInstitute, Cyprus Anne-Maria Laukkanen University of Tampere, Finland Am´elie Lelong GIPSA-lab, Grenoble, France Borge Lindberg Aalborg University, Denmark Saturnino Luz Trinity College Dublin, Ireland Wojciech Majewski Wroclaw University of Technology, Poland Pantelis Makris NeuroscienceandTechnologyInstitute,Cyprus Kenneth Manktelow University of Wolverhampton, UK Raffaele Martone Second University of Naples, Italy Rytis Maskeliunas Kaunas University of Technology, Lithuania Dominic Massaro University of California, Santa Cruz, USA Olimpia Matarazzo Second University of Naples, Italy Christoph Mayer Technische Universita¨t Mu¨nchen, Germany David McNeill University of Chicago, USA Jiˇr´ıMekyska BrnoUniversityofTechnology,CzechRepublic Nicola Melone Second University of Naples, Italy Katya Mihaylova University of National and World Economy, Sofia, Bulgaria P´eter Mihajlik Budapest University of Technology and Economics, Hungary Michal Miriloviˇc TechnicalUniversityofKoˇsice,SlovakRepublic