Interpreting Motion: Grounded Representations for Spatial Language

177 Pages·2012·1.103 MB·

by  Inderjeet Mani, James Pustejovsky

Interpreting Motion
Explorations in Language and Space
SERIESEDITOR:EmileVanDerZee,UniversityofLincoln
PUBLISHED
1RepresentingDirectioninLanguageandSpace
EditedbyEmilevanderZeeandJonSlack
2FunctionalFeaturesinLanguageandSpace:InsightsfromPerception,
Categorization,andDevelopment
EditedbyLauraA.CarlsonandEmilevanderZee
3SpatialLanguageandDialogue
EditedbyKennyR.Coventry,ThoraTenbrink,andJohnA.Bateman
4TheSpatialFoundationsofCognitionandLanguage
EditedbyKellyS.Mix,LindaB.Smith,andMichaelGasser
5InterpretingMotion:GroundedRepresentationsforSpatialLanguage
InderjeetManiandJamesPustejovsky
Interpreting Motion
Grounded Representations
for Spatial Language
INDERJEET MANI
AND JAMES PUSTEJOVSKY
1
3
GreatClarendonStreet,OxfordOX26DP
OxfordUniversityPressisadepartmentoftheUniversityofOxford.
ItfurtherstheUniversity’sobjectiveofexcellenceinresearch,scholarship,
andeducationbypublishingworldwidein
Oxford NewYork
Auckland CapeTown DaresSalaam HongKong Karachi
KualaLumpur Madrid Melbourne MexicoCity Nairobi
NewDelhi Shanghai Taipei Toronto
Withofficesin
Argentina Austria Brazil Chile CzechRepublic France Greece
Guatemala Hungary Italy Japan Poland Portugal Singapore
SouthKorea Switzerland Thailand Turkey Ukraine Vietnam
OxfordisaregisteredtrademarkofOxfordUniversityPress
intheUKandincertainothercountries
PublishedintheUnitedStates
byOxfordUniversityPressInc.,NewYork
#InderjeetManiandJamesPustejovsky 2012
Themoralrightsoftheauthorhavebeenasserted
DatabaserightOxfordUniversityPress(maker)
Firstpublished2012
Allrightsreserved.Nopartofthispublicationmaybereproduced,
storedinaretrievalsystem,ortransmitted,inanyformorbyanymeans,
withoutthepriorpermissioninwritingofOxfordUniversityPress,
orasexpresslypermittedbylaw,orundertermsagreedwiththeappropriate
reprographicsrightsorganization.Enquiriesconcerningreproduction
outsidethescopeoftheaboveshouldbesenttotheRightsDepartment,
OxfordUniversityPress,attheaddressabove
Youmustnotcirculatethisbookinanyotherbindingorcover
andyoumustimposethesameconditiononanyacquirer
BritishLibraryCataloguinginPublicationData
Dataavailable
LibraryofCongressCataloginginPublicationData
Dataavailable
TypesetbySPIPublisherServices,Pondicherry,India
PrintedinGreatBritain
onacid-freepaperby
MPGBooksGroup,BodminandKing’sLynn
ISBN 978–0–19–960124–0
1 3 5 7 9 10 8 6 4 2
Preface
Thisbookwasconceivedalongwhileagoandwrittenoveraperiodofayearanda
half.ManiworkedfromChiangMaiandBangalore,whilePustejovskywasmainlyin
Boston. Mani wrote the odd-numbered chapters and part of Chapter 6, and Puste-
jovsky wrote and completed the even-numbered ones. Each author reviewed and
revisedtheother’sdrafts.
This works builds on earlier research by a set of scholars too numerous to name
hereindividually;thecitationswillhopefullymakethereaderawareofourconsider-
abledebtandgratitudetothem.Wearealsoindebtedtothehostsandparticipantsof
threeworkshopsforstimulatingdiscussionsandpointersintotheliterature:theMay
2008 Language International Conference on Language Resources and Evaluation
(LREC)workshoponMethodologiesandResourcesforProcessingSpatialLanguage,1
the March 2010 Dagstuhl Seminar on Spatial Representation and Reasoning in
Language,2andtheSeptember2010AirlieISO-SpaceWorkshop.3
Thanksarealsoduetotheauthors’familiesforthemanysacrificesmadeandfor
encouragementalongtheway.
InderjeetMani
JamesPustejovsky
1 http://www.sfbtr8.spatial-cognition.de/SpatialLREC
2 http://www.dagstuhl.de/en/program/calendar/semhp/?semnr=10131
3 http://sites.google.com/site/wikiisospace/airlie-workshop-2010
TThhiiss ppaaggee iinntteennttiioonnaallllyy lleefftt bbllaannkk
Contents
ListofFigures ix
ListofTables x
1 Introduction 1
1.1 Overview 1
1.2 Keyinsights 6
1.3 Desiderata 10
1.4 Theoreticalbackground 11
1.5 Caveats 26
1.6 Conclusion 28
2 Conceptsofmotioninlanguage 30
2.1 Introduction 30
2.2 Staticspatialdescriptions 31
2.3 Describingmotion 34
2.4 Refiningmannerofmotion 48
2.5 Conclusion 52
3 SpatialandTemporalOntology 53
3.1 Introduction 53
3.2 Topology 54
3.3 Topological inference 64
3.4 Orientation 66
3.5 Conclusion 76
4 TheRepresentationofMotion 78
4.1 Introduction 78
4.2 PreviousQSRmotionrepresentations 80
4.3 Dynamicintervaltemporallogic 90
4.4 Conclusion 108
5 SemanticAnnotation 109
5.1 Introduction 109
5.2 Annotationschemes 110
5.3 Annotationreliability 118
5.4 Automatictagging 119
viii Contents
5.5 Integrationwithformalreasoning 125
5.6 Conclusion 127
6 ApplicationsandProspects 128
6.1 Introduction 128
6.2 Applications 128
6.3 Summary 143
6.4 Conclusion:openissues 144
References 147
Index 161
List of Figures
1.1 Acceptabilityratings,rotation,andfunctionalinformation,from
Coventry(2003,p.60) 27
2.1 Manner-of-motionverbsintermsoftopologicalconstraintsin(73) 51
3.1 RCC-8calculusrelations 55
3.2 Convexhullofanisland,fromCohnetal.(1997,p.15) 57
3.3 Compositiontableforintervalcalculus,fromAllen(1983,p.836) 62
3.4 Inadequacyin2Dofintervalcalculusrelations 63
3.5 APairofdipolesorientedbyrlll 70
3.6 Extendeddipolerelations 70
3.7 OPRArelationA(7,1)Bform=2 72
3.8 CDCrelationNE:E:SE 74
3.9 CDCgridforGuuguYimithirr 74
3.10 AsubsetofbaserelationsinDCC 75
4.1 TransitionsbetweenRCC-8relations 81
4.2 Galton’sanalysisofenterusingRCC-8relations 82
4.3 Possiblelinguisticcorrelatesofsome9ICrelations 83
4.4 Directedline-regionexamples 84
4.5 Threeconfigurationscorrespondingtothesamedirected
line-regionrelations 84
4.6 Point-linemovementforenter 86
4.7 QTC relation(-,-) 87
B
4.8 The9QTC trajectoryrelations 88
B
4.9 Oneobjectovertakinganother 89
4.10 Tracingacompoundprogram 93
4.11 Directedmotion 97
4.12 Directedmotionleavingatrail 98
4.13 Pathverbinterpretation 101
4.14 Mannerverb+PathPP:biketoAguaAzul 102
4.15 Pathverb+MannerPP:leavebyfoot 103
4.16 Motionforslide 105
4.17 Motionforhop 106
6.1 Routegraph,fromPustejovskyetal.(2010) 129
6.2 Mapoftravelnarrative,fromPustejovskyandMoszkowicz(2011) 134
6.3 Spatialelementsinaphotograph 134