FACE PROCESSING AdvancedModelingandMethods This Page Intentionally Left Blank FACE PROCESSING Advanced Modeling and Methods Editedby Wenyi Zhao VisionTechnologiesLab SarnoffCorportaion Princeton,NJ08540 Email:[email protected] and Rama Chellappa CenterforAutomationResearch UniversityofMaryland CollegePark,MD20740 Email:[email protected] AMSTERDAM • BOSTON • HEIDELBERG • LONDON NEWYORK • OXFORD • PARIS • SANDIEGO SANFRANCISCO • SINGAPORE • SYDNEY • TOKYO AcademicPressisanimprintofElsevier AcademicPressisanimprintofElsevier 30CorporateDrive,Suite400,Burlington,MA01803,USA 525BStreet,Suite1900,SanDiego,California92101-4495,USA 84Theobald’sRoad,LondonWC1X8RR,UK Thisbookisprintedonacid-freepaper. Copyright©2006,ElsevierInc.Allrightsreserved. Nopartofthispublicationmaybereproducedortransmittedinanyformorbyany means,electronicormechanical,includingphotocopy,recording,oranyinformation storageandretrievalsystem,withoutpermissioninwritingfromthepublisher. PermissionsmaybesoughtdirectlyfromElsevier’sScience&TechnologyRights DepartmentinOxford,UK:phone:(+44)1865843830,fax:(+44)1865853333, E-mail:[email protected] viatheElsevierhomepage(http://elsevier.com),byselecting“Support&Contact” then“CopyrightandPermission”andthen“ObtainingPermissions.” LibraryofCongressCataloging-in-PublicationData Applicationsubmitted BritishLibraryCataloguing-in-PublicationData AcataloguerecordforthisbookisavailablefromtheBritishLibrary. ISBN13:978-0-12-088452-0 ISBN10:0-12-088452-6 ForinformationonallAcademicPresspublications visitourWebsiteatwww.books.elsevier.com PrintedintheUnitedStatesofAmerica 05 06 07 08 09 10 9 8 7 6 5 4 3 2 1 DedicatedtoProfessorAzrielRosenfeld(1931–2004) This Page Intentionally Left Blank CONTENTS Contributors xi Preface xiii PART I THEBASICS 1 CHAPTER 1 AGuidedTourofFaceProcessing 3 (W.ZhaoandR.Chellappa) CHAPTER 2 EigenfacesandBeyond 55 (M.Turk) CHAPTER 3 IntroductiontotheStatisticalEvaluationof 87 Face-RecognitionAlgorithms (J.RossBeveridge,BruceA.Draper,GeofH.Givens, andWardFisher) PART II FACEMODELING 125 COMPUTATIONALASPECTS 125 CHAPTER 4 3DMorphableFaceModel,aUnifiedApproach 127 forAnalysisandSynthesisofImages (SamiRomdhani,Jean-SébastienPierrard, andThomasVetter) CHAPTER 5 Expression-InvariantThree-Dimensional 159 FaceRecognition (A.Bronstein,M.Bronstein,andR.Kimmel) CHAPTER 6 3DFaceModelingFromMonocularVideo 185 Sequences (A.Roy-ChowdhuryandR.Chellappa) CHAPTER 7 FaceModelingbyInformationMaximization 219 (MarianStewartBartlett,JavierR.Movellan, andTerrenceJ.Sejnowski) vii viii CONTENTS PSYCHOPHYSICALASPECTS 255 CHAPTER 8 FaceRecognitionbyHumans 257 (P.Sinha,BenjaminJ.Balas,YuriOstrovsky, RichardRussell) CHAPTER 9 PredictingHumanPerformanceforFaceRecognition 293 (A.O’Toole,F.Jiang,D.Roark,andH.Abdi) CHAPTER 10 SpatialDistributionofFaceandObject 321 RepresentationsintheHumanBrain (J.HaxbyandI.Gobbini) PART III ADVANCEDMETHODS 337 CHAPTER 11 OntheEffectofIlluminationandFaceRecognition 339 (JeffreyHoandDavidKriegman) CHAPTER 12 ModelingIlluminationVariationwith 385 SphericalHarmonics (R.Ramamoorthi) CHAPTER 13 AMultisubregion-BasedProbabilisticApproach 425 TowardPose-InvariantFaceRecognition (TakeoKanadeandAkihikoYamada) CHAPTER 14 MorphableModelsforTrainingaComponent-Based 439 Face-RecognitionSystem (BerndHeiseleandVolkerBlanz) CHAPTER 15 Model-BasedFaceModelingandTrackingWith 463 ApplicationtoVideoconferencing (ZhengyouZhang,ZichengLiu,andRuigangYang) CHAPTER 16 Asurveyof3DandMultimodal3D+2D 519 FaceRecognition (KevinW.Bowyer,KyongChang,and PatrickJ.Flynn) CHAPTER 17 BeyondOneStillImage:FaceRecognitionfrom 547 MultipleStillImagesorVideoSequence (S.ZhouandR.Chellappa) CONTENTS ix CHAPTER 18 SubsetModelingofFaceLocalizationError, 577 Occlusion,andExpression (AleixM.MartinezandYongbinZhang) CHAPTER 19 NearReal-timeRobustFaceandFacial-Feature 619 DetectionwithInformation-BasedMaximum Discrimination (AntonioJ.Colmenarez,ZiyouXiongy, andThomasS.Huang) CHAPTER 20 CurrentLandscapeofThermalInfrared 647 FaceRecognition (DiegoA.Socolinsky,LawrenceB.Wolff, AndreaSelinger,andChristopherK.Eveland) CHAPTER 21 MultimodalBiometrics:AugmentingFace 679 WithOtherCues (AnilK.Jain,KarthikNandakumar,UmutUludag, andXiaoguangLu) Index 707 Colorplatesectionbetweenpagenumbers336and337