Advances in Computer Vision and Pattern Recognition Giovanni Maria Farinella Sebastiano Battiato Editors Roberto Cipolla Advanced Topics in Computer Vision Advances in Computer Vision and Pattern Recognition Forfurthervolumes: www.springer.com/series/4205 Giovanni Maria Farinella (cid:2) Sebastiano Battiato (cid:2) Roberto Cipolla Editors Advanced Topics in Computer Vision Editors Dr.GiovanniMariaFarinella Prof.RobertoCipolla DipartimentodiMatematicaeInformatica DepartmentofEngineering UniversitàdiCatania UniversityofCambridge Catania,Italy Cambridge,UK Prof.SebastianoBattiato DipartimentodiMatematicaeInformatica UniversitàdiCatania Catania,Italy SeriesEditors Prof.SameerSingh Dr.SingBingKang ResearchSchoolofInformatics InteractiveVisualMediaGroup LoughboroughUniversity MicrosoftResearch Loughborough,UK Redmond,WA,USA ISSN2191-6586 ISSN2191-6594(electronic) AdvancesinComputerVisionandPatternRecognition ISBN978-1-4471-5519-5 ISBN978-1-4471-5520-1(eBook) DOI10.1007/978-1-4471-5520-1 SpringerLondonHeidelbergNewYorkDordrecht LibraryofCongressControlNumber:2013950636 ©Springer-VerlagLondon2013 Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpartof thematerialisconcerned,specificallytherightsoftranslation,reprinting,reuseofillustrations,recitation, broadcasting,reproductiononmicrofilmsorinanyotherphysicalway,andtransmissionorinformation storageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilarmethodology nowknownorhereafterdeveloped.Exemptedfromthislegalreservationarebriefexcerptsinconnection with reviews or scholarly analysis or material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Duplication of this publication or parts thereof is permitted only under the provisions of the Copyright Law of the Publisher’slocation,initscurrentversion,andpermissionforusemustalwaysbeobtainedfromSpringer. PermissionsforusemaybeobtainedthroughRightsLinkattheCopyrightClearanceCenter.Violations areliabletoprosecutionundertherespectiveCopyrightLaw. Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant protectivelawsandregulationsandthereforefreeforgeneraluse. Whiletheadviceandinformationinthisbookarebelievedtobetrueandaccurateatthedateofpub- lication,neithertheauthorsnortheeditorsnorthepublishercanacceptanylegalresponsibilityforany errorsoromissionsthatmaybemade.Thepublishermakesnowarranty,expressorimplied,withrespect tothematerialcontainedherein. Printedonacid-freepaper SpringerispartofSpringerScience+BusinessMedia(www.springer.com) Preface Computer vision is the science and technology of making machines that see. It is concernedwiththetheory,designandimplementationofalgorithmsthatcanauto- maticallyprocessvisualdatatorecognizeobjects,trackandrecovertheirshapeand spatiallayout. Thiseditedvolumecontainsaselectionofarticlescoveringboththeoreticaland practicalaspectsofthethreemainareainComputerVision:Reconstruction,Regis- tration,andRecognition.Thebookprovidesboth,anin-depthoverviewofchalleng- ingareas,aswellasnoveladvancedalgorithmswhichexploitMachineLearningand PatternRecognitiontechniquestoinferthesemanticcontentofimagesandvideos. Thetopicscoveredbythechaptersincludevisualfeatureextraction,featurematch- ing,imageregistration,3Dreconstruction,objectdetectionandrecognition,human actionsrecognition,imagesegmentation,objecttracking,metriclearning,loopybe- liefpropagation,etc.Eachchaptercontainskeyreferencestotheexistingliterature. Theauthorsofthechaptershavebeenselectedamongthebeststudentswhoat- tendedtheInternationalComputerVisionSummerSchool(ICVSS)inthelastyears, and are co-authored by world renowned researchers in Computer Vision. ICVSS wasestablishedin2007toprovidebothanobjectiveandclearoverviewandanin- depthanalysisofthestate-of-the-artresearchinComputerVision.Thecoursesare deliveredbyexpertsinthefield,frombothacademiaandindustry,andcoverboth theoretical and practical aspects of real Computer Vision problems. The school is organized every year by University of Cambridge (Computer Vision and Robotics Group)andUniversityofCatania(ImageProcessingLab).Differenttopicsarecov- ered each year. A summary of the past Computer Vision Summer Schools can be foundat:http://www.dmi.unict.it/icvss. It is our hope that graduate students, young and senior researchers, and aca- demic/industrial professionals will find the book useful for understanding and re- viewingcurrentapproachesinComputerVision,therebycontinuingthemissionof theInternationalComputerVisionSummerSchool. Sicily,Italy GiovanniMariaFarinella June2013 SebastianoBattiato RobertoCipolla v Acknowledgements Wewouldliketotakethisopportunitytothankallcontributorsofthisbook,andall peopleinvolvedintheorganizationofICVSS. vii Contents 1 VisualFeatures—FromEarlyConceptstoModernComputerVision 1 MartinWeinmann 2 WhereNextinObjectRecognitionandhowmuchSupervision DoWeNeed? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 SandraEbertandBerntSchiele 3 RecognizingHumanActionsbyUsingEffectiveCodebooks andTracking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 LambertoBallan,LorenzoSeidenari,GiuseppeSerra,MarcoBertini, andAlbertoDelBimbo 4 Evaluating and Extending Trajectory Features for Activity Recognition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95 RossMessing,AtousaTorabi,AaronCourville,andChrisPal 5 Co-recognitionofImagesandVideos:UnsupervisedMatching ofIdenticalObjectPatternsandItsApplications . . . . . . . . . . 113 MinsuCho,YoungMinShin,andKyoungMuLee 6 StereoMatching—State-of-the-ArtandResearchChallenges . . . 143 MichaelBleyerandChristianBreiteneder 7 VisualLocalizationforMicroAerialVehiclesinUrbanOutdoor Environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 181 AndreasWendelandHorstBischof 8 MomentConstraintsinConvexOptimizationforSegmentation andTracking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215 MariaKlodt,FrankSteinbrücker,andDanielCremers 9 Large Scale Metric Learning for Distance-Based Image ClassificationonOpenEndedDataSets . . . . . . . . . . . . . . . 243 ThomasMensink,JakobVerbeek,FlorentPerronnin,and GabrielaCsurka ix x Contents 10 Top–DownBayesianInferenceofIndoorScenes . . . . . . . . . . . 277 LucaDelPeroandKobusBarnard 11 EfficientLoopyBeliefPropagationUsingtheFourColorTheorem 313 RaduTimofteandLucVanGool 12 Boostingk-NearestNeighborsClassification . . . . . . . . . . . . . 341 PaoloPiro,RichardNock,WafaBelHajAli,FrankNielsen,and MichelBarlaud 13 LearningObjectDetectorsinStationaryEnvironments. . . . . . . 377 PeterM.Roth,SabineSternig,andHorstBischof 14 VideoTemporalSuper-resolutionBasedonSelf-similarity . . . . . 411 MihokoShimano,TakahiroOkabe,ImariSato,andYoichiSato Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 431 Contributors Editors’Biographies GiovanniMariaFarinella GiovanniMariaFarinellaobtainedtheMasterdegreeinComputerScience(egregia cum laude) from University of Catania in 2004. He was awarded a Ph.D. degree (ComputerVision)in2008.HebecameAssociateMemberoftheComputerVision and Robotics Research Group at University of Cambridge in 2006. He joined the ImageProcessingLaboratory(IPLAB)attheDepartmentofMathematicsandCom- puterScience,UniversityofCataniain2008asContractResearcher.HeisContract Professor of Computer Vision at the School of Arts of Catania (since 2004) and Adjunct Professor of Computer Science at the University of Catania (since 2008). HisresearchinterestslieinthefieldsofComputerVision,PatternRecognitionand MachineLearning.Hehaseditedthreevolumesandco-authoredmorethan50pa- pers in international journals, conference proceedings and book chapters. He is a co-inventorof3internationalpatents.Dr.Farinellaalsoservesasareviewerandon the programme committee for major international journals and international con- ferences.Hehasparticipatedtoseveralinternationalandnationalresearchprojects. Dr. Farinella founded (in 2006) and currently directs the International Computer VisionSummerSchool(www.dmi.unict.it/icvss). SebastianoBattiato Sebastiano Battiato received his degree in computer science (summa cum laude) in1995fromUniversityofCataniaandhisPh.D.incomputerscienceandapplied mathematics from University of Naples in 1999. From 1999 to 2003 he was the leaderofthe“Imaging”teamatSTMicroelectronicsinCatania.HejoinedtheDe- partmentofMathematicsandComputerScienceattheUniversityofCataniaasas- sistantprofessorin2004andbecameassociateprofessorinthesamedepartmentin 2011.Hisresearchinterestsincludeimageenhancementandprocessing,imagecod- ing, camera imaging technology and multimedia forensics. He has edited 4 books xi xii Contributors and co-authored more than 150 papers in international journals, conference pro- ceedings and book chapters. He is a co-inventor of about 15 international patents, reviewerfor severalinternationaljournals,andhehasbeenregularlyamemberof numerousinternationalconferencecommittees.ProfessorBattiatohasparticipated inmanyinternationalandnationalresearchprojects.Chairofseveralinternational events(IWCV2012,ECCV2012,VISAPP2012-2013-2014,ICIAP2011,ACMMi- For2010-2011,SPIEEIDigitalPhotography2011-2012-2013,etc.).Heisanasso- ciate editor of the IEEE Transactions on Circuits and System for Video Technol- ogy and of the SPIE Journal of Electronic Imaging. Guest editor of the following special issues: “Emerging Methods for Color Image and Video Quality Enhance- ment”publishedonEURASIPJournalonImageandVideoProcessing(2010)and “MultimediainForensics,SecurityandIntelligence”publishedonIEEEMultime- diaMagazine(2012).Heistherecipientofthe2011BestAssociateEditorAwardof theIEEETransactionsonCircuitsandSystemsforVideoTechnology.Heisdirec- tor(andco-founder)oftheInternationalComputerVisionSummerSchool(ICVSS). HeisaseniormemberoftheIEEE. RobertoCipolla Roberto Cipolla obtained the B.A. degree (Engineering) from the University of Cambridgein1984andanM.S.E.(ElectricalEngineering)fromtheUniversityof Pennsylvaniain1985.From1985to1988hestudiedandworkedinJapanattheOs- aka University of Foreign Studies (Japanese Language) and Electrotechnical Lab- oratory.In1991,hewasawardedaD.Phil.(ComputerVision)fromtheUniversity ofOxfordandfrom1991–1992wasaToshibaFellowandengineerattheToshiba CorporationResearchandDevelopmentCentreinKawasaki,Japan.Hejoinedthe Department of Engineering, University of Cambridge in 1992 as a Lecturer and a FellowofJesusCollege.HebecameaReaderinInformationEngineeringin1997 andaProfessorin2000.HeisaFellowattheRoyalAcademyofEngineering(since 2010); also a Professor of Computer Vision at the Royal Academy of Arts, Lon- don(since2004)andDirectorofToshiba’sCambridgeResearchLaboratory(since 2007). His research interests are in computer vision and robotics and include the recovery of motion and 3D shape of visible surfaces from image sequences; ob- jectdetectionandrecognition;novelman–machineinterfacesusinghand,faceand bodygestures;real-timevisualtrackingforlocalizationandrobotguidance;appli- cationsofcomputervisioninmobilephones,visualinspectionandimage-retrieval andvideosearch.Hehasauthored3books,edited8volumesandco-authoredmore than 300 papers. Professor Cipolla founded (in 2006) and currently directs the In- ternationalComputerVisionSummerSchool.