Eye Gaze in Intelligent User Interfaces: Gaze-based Analyses, Models and Applications

209 Pages·2013·5.76 MB·English

by  Yukiko I. Nakano (auth.)

Eye Gaze in Intelligent User Interfaces
Yukiko I. Nakano (cid:2) Cristina Conati (cid:2) Thomas Bader
Editors
Eye Gaze in
Intelligent User
Interfaces
Gaze-based Analyses, Models and
Applications
Editors
YukikoI.Nakano ThomasBader
DepartmentofComputerandInformation Research&Development
Science AGTInternational
SeikeiUniversity Darmstadt,Germany
Tokyo,Japan
CristinaConati
DepartmentofComputerScience
UniversityofBritishColumbia
Vancouver,BC,Canada
ISBN978-1-4471-4783-1 ISBN978-1-4471-4784-8(eBook)
DOI10.1007/978-1-4471-4784-8
SpringerLondonHeidelbergNewYorkDordrecht
LibraryofCongressControlNumber:2013930010
©Springer-VerlagLondon2013
Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpartof
thematerialisconcerned,specificallytherightsoftranslation,reprinting,reuseofillustrations,recitation,
broadcasting,reproductiononmicrofilmsorinanyotherphysicalway,andtransmissionorinformation
storageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilarmethodology
nowknownorhereafterdeveloped.Exemptedfromthislegalreservationarebriefexcerptsinconnection
with reviews or scholarly analysis or material supplied specifically for the purpose of being entered
and executed on a computer system, for exclusive use by the purchaser of the work. Duplication of
this publication or parts thereof is permitted only under the provisions of the Copyright Law of the
Publisher’slocation,initscurrentversion,andpermissionforusemustalwaysbeobtainedfromSpringer.
PermissionsforusemaybeobtainedthroughRightsLinkattheCopyrightClearanceCenter.Violations
areliabletoprosecutionundertherespectiveCopyrightLaw.
Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication
doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant
protectivelawsandregulationsandthereforefreeforgeneraluse.
Whiletheadviceandinformationinthisbookarebelievedtobetrueandaccurateatthedateofpub-
lication,neithertheauthorsnortheeditorsnorthepublishercanacceptanylegalresponsibilityforany
errorsoromissionsthatmaybemade.Thepublishermakesnowarranty,expressorimplied,withrespect
tothematerialcontainedherein.
Printedonacid-freepaper
SpringerispartofSpringerScience+BusinessMedia(www.springer.com)
Preface
Thisbookisanoutgrowthofthe2ndWorkshoponEyeGazeinIntelligentHuman
MachineInteractionatthe16thInternationalConferenceonIntelligentUserInter-
faces (IUI 2011), which was held at Palo Alto, California, USA on February 13,
2011. The first eye-gaze workshop was held at IUI 2010 in Hong Kong, and was
organizedbyDr.ElisabethAndréandDr.JoyceY.Chai.Followingthefirstwork-
shop,thisworkshophascontinuedtoexplorethisimportanttopicandcoversawider
range of topics, including eye-tracking technologies, analyses of human eye-gaze
behaviors, multimodal interpretation, gaze-based interactive IUIs, and presenting
gazebehaviors in humanoidinterfaces.Moreover,theworkshop aimedat creating
anetworkofresearcherswithdifferentbackgrounds,suchashumansensing,intel-
ligentuserinterface,multimodalprocessing,andcommunicationscience,whoare
interestedinexploringhowattentionalinformationcanbeappliedtonovelintelli-
gentuserinterfaces.
Theresearchareasandquestionstargetedintheworkshopareasfollows:
• TechnologiesforsensinghumanattentionalbehaviorsinIUI
• InterpretingattentionalbehaviorsascommunicativesignalsinIUI
• Gazemodelforgeneratingeye-gazebehaviorsbyconversationalhumanoids
• Analysisofhumanattentionalbehaviors
• Evaluationofgaze-basedIUI
Fromtheworkshoppresentation,wecarefullyselectedpapersthatsignificantly
contribute to the theme of this book and asked the authors to extend their origi-
nalworkpresentedattheworkshop.Inaddition,wehaveinvitedtwopaperssoas
to cover a wider range of topics for attention-aware interfaces: Chap. 5 by Marc-
Antoine Nussli, Patrick Jermann, Mirweis Sangin, and Pierre Dillenbourg, and
Chap.10byJensEdlund,SamerAlMoubayed,andJonasBeskow.
Thecollectedpapersareorganizedintothreesections:
PartI: GazeinHumanCommunication
PartII: Gaze-BasedCognitiveandCommunicativeStatusEstimation
PartIII: GazeAwarenessinHCI
v
vi Preface
PartIfocusesonanalyzinghumaneyegazebehaviorstorevealthecharacteris-
tics of human communication and cognition. Part II addresses the estimation and
predictionofthecognitivestateoftheusersusinggazeinformation.Finally,PartIII
presents novel gaze-aware interfaces that integrate eye-trackers as a system com-
ponent.Thispartprovidesinformationonthedirectionof futurehuman-computer
interactionanddiscussesissuestobeaddressedindesigninggaze-awareinteractive
interfaces.
We would like to thank the program committee members of the IUI 2011
workshop: Elisabeth André (University of Augsburg, Germany), Nikolaus Bee
(University of Augsburg, Germany), Justine Cassell (Carnegie Mellon University,
USA), Joyce Chai (Michigan State University, USA), Andrew Duchowski (Clem-
son University, USA), Jürgen Geisler (Fraunhofer IOSB, Germany), Patrick Jer-
mann(EcolePolytechniqueFederaledeLausanne(EPFL),Switzerland),Yoshinori
Kuno(SaitamaUniversity,Japan),KasiaMuldner(ArizonaStateUniversity,USA),
ToyoakiNishida(KyotoUniversity,Japan),CatherinePelachaud(TELECOMParis
Tech, France), Christopher Peters (Coventry University, UK), Shaolin Qu (Michi-
ganStateUniversity,USA),MatthiasRötting(UniversityofBerlin,Germany),and
Candy Sidner (Worcester Polytechnic Institute, USA). These individuals donated
theirprecioustimeandeffortinreviewingthepaperspresentedherein.
WealsowouldliketothankSMISensoMotoricInstrumentsGmbHforsupport-
ingtheworkshopandSpringerLondonfortheirsupportandcooperationinpublish-
ingthiscollection.
Tokyo,Japan YukikoI.Nakano
Vancouver,BC,Canada CristinaConati
Darmstadt,Germany ThomasBader
Contents
1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
YukikoI.Nakano
PartI GazeinHumanCommunication
2 HowEyeGazeFeedbackChangesParent-ChildJointAttentionin
SharedStorybookReading? . . . . . . . . . . . . . . . . . . . . . . . 9
JiaGuoandGaryFeng
3 SharedGazeinSituatedReferentialGrounding:AnEmpiricalStudy 23
ChangsongLiu,RuiFang,andJoyceY.Chai
4 AutomatedAnalysisofMutualGazeinHumanConversationalPairs 41
FrankBroz, HagenLehmann, ChrystopherL.Nehaniv, and
KerstinDautenhahn
PartII Gaze-BasedCognitiveandCommunicativeStatusEstimation
5 REGARD:RemoteGaze-AwareReferenceDetector . . . . . . . . . 63
Marc-AntoineNüssli, PatrickJermann, MirweisSangin, and
PierreDillenbourg
6 Effectiveness of Gaze-Based Engagement Estimation in
ConversationalAgents . . . . . . . . . . . . . . . . . . . . . . . . . . 85
RyoIshii,RyotaOoko,YukikoI.Nakano,andTokoakiNishida
7 AComputationalApproachforPredictionofProblem-Solving
BehaviorUsingSupportVectorMachinesandEye-TrackingData . . 111
RomanBednarik,ShahramEivazi,andHanaVrzakova
PartIII GazeAwarenessinHCI
8 GazingtheTextforFunandProfit . . . . . . . . . . . . . . . . . . . 137
RalfBiedert,GeorgBuscher,andAndreasDengel
vii
viii Contents
9 NaturalGazeBehaviorasInputModalityforHuman-Computer
Interaction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161
ThomasBaderandJürgenBeyerer
10 Co-presentorNot? . . . . . . . . . . . . . . . . . . . . . . . . . . . . 185
JensEdlund,SamerAlMoubayed,andJonasBeskow
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205
Contributors
SamerAlMoubayed KTHSpeech,MusicandHearing,Stockholm,Sweden
ThomasBader AGTGroup(R&D)GmbH,Darmstadt,Germany
RomanBednarik UniversityofEasternFinland,Joensuu,Finland
JonasBeskow KTHSpeech,MusicandHearing,Stockholm,Sweden
Jürgen Beyerer Fraunhofer Institute of Optronics, System Technologies and Im-
ageExploitationIOSB,Karlsruhe,Germany
Ralf Biedert German Research Center for Artificial Intelligence, Kaiserslautern,
Germany
FrankBroz ComputerScience,UniversityofHertfordshire,Hatfield,UK
GeorgBuscher MicrosoftBing,Redmond,WA,USA
JoyceY.Chai DepartmentofComputerScienceandEngineering,MichiganState
University,EastLansing,MI,USA
KerstinDautenhahn ComputerScience,UniversityofHertfordshire,Hatfield,UK
Andreas Dengel German Research Center for Artificial Intelligence, Kaiser-
slautern,Germany
PierreDillenbourg CRAFT,EPFL,Lausanne,Switzerland
JensEdlund KTHSpeech,MusicandHearing,Stockholm,Sweden
ShahramEivazi UniversityofEasternFinland,Joensuu,Finland
RuiFang DepartmentofComputerScienceandEngineering,MichiganStateUni-
versity,EastLansing,MI,USA
GaryFeng EducationalTestingService,Princeton,NJ,USA
JiaGuo DepartmentofPsychologyandNeuroscience,DukeUniversity,Durham,
NC,USA
ix
x Contributors
Ryo Ishii Department of Intelligence Science and Technology, Kyoto University,
Kyoto, Japan; Department of Computer and Information Science, Seikei Univer-
sity, Tokyo, Japan; NTT Communication Science Laboratories, NTT Corporation,
Kanagawa,Japan
PatrickJermann CRAFT,EPFL,Lausanne,Switzerland
HagenLehmann ComputerScience,UniversityofHertfordshire,Hatfield,UK
Changsong Liu Department of Computer Science and Engineering, Michigan
StateUniversity,EastLansing,MI,USA
YukikoI.Nakano DepartmentofComputerandInformationScience,SeikeiUni-
versity,Tokyo,Japan
ChrystopherL.Nehaniv ComputerScience,UniversityofHertfordshire,Hatfield,
UK
TokoakiNishida DepartmentofIntelligenceScienceandTechnology,KyotoUni-
versity,Kyoto,Japan
Marc-AntoineNüssli CRAFT,EPFL,Lausanne,Switzerland
RyotaOoko DepartmentofComputerandInformationScience,SeikeiUniversity,
Tokyo,Japan
MirweisSangin Sony,London,UK
HanaVrzakova UniversityofEasternFinland,Joensuu,Finland