Rick Riolo, Terence Soule and Bill Worzel (Eds.) Genetic Programming Theory and Practice VI Genetic and Evolutionary Computation Series Series Editors David E. Goldberg Consulting Editor IlliGAL, Dept. of General Engineering University of Illinois at Urbana-Champaign Urbana, IL 61801 USA Email: [email protected] John R. Koza Consulting Editor Medical Informatics Stanford University Stanford, CA 94305-5479 USA Email: [email protected] Selected titles from this series: Markus Brameier, Wolfgang Banzhaf Linear Genetic Programming, 2007 ISBN 978-0-387-31029-9 Nikolay Y. Nikolaev, Hitoshi Iba Adaptive Learning of Polynomial Networks, 2006 ISBN 978-0-387-31239-2 Tetsuya Higuchi, Yong Liu, Xin Yao Evolvable Hardware, 2006 ISBN 978-0-387-24386-3 David E. Goldberg The Design of Innovation: Lessons from and for Competent Genetic Algorithms, 2002 ISBN 978-1-4020-7098-3 John R. Koza, Martin A. Keane, Matthew J. Streeter, William Mydlowec, Jessen Yu, Guido Lanza Genetic Programming IV: Routine Human-Computer Machine Intelligence ISBN: 978-1-4020-7446-2 (hardcover), 2003; ISBN: 978-0-387-25067-0 (softcover), 2005 Carlos A. Coello Coello, David A. Van Veldhuizen, Gary B. Lamont Evolutionary Algorithms for Solving Multi-Objective Problems ISBN: 978-0-306-46762-2, 2002; ISBN 978-0-387-33254-3 (2nd Edition), 2007 Lee Spector Automatic Quantum Computer Programming: A Genetic Programming Approach ISBN: 978-1-4020-7894-1 (hardcover), 2004; ISBN 978-0-387-36496-4 (softcover), 2007 William B. Langdon Genetic Programming and Data Structures: Genetic Programming + Data Structures = Automatic Programming! 1998 ISBN: 978-0-7923-8135-8 For a complete listing of books in this series, go to http://www.springer.com Rick Riolo Terence Soule Bill Worzel (Eds.) Genetic Programming Theory and Practice VI Rick Riolo Terence Soule Center for the Study of Complex Systems Department of Computer Science 323 West Hall University of Idaho University of Michigan Janssen Engineering Building Ann Arbor, MI 48109 Moscow, ID 83844-1010 [email protected] [email protected] Bill Worzel Genetics Squared 401 W. Morgan Rd. Ann Arbor, MI 48108 [email protected] ISSN: 1932-0167 ISBN: 978-0-387-87622-1 e-ISBN: 978-0-387-87623-8 DOI: 10.1007/978-0-387-87623-8 Library of Congress Control Number: 2008936134 © 2009 Springer Science+Business Media, LLC All rights reserved. This work may not be translated or copied in whole or in part without the written permission of the publisher (Springer Science+Business Media, LLC, 233 Spring Street, New York, NY 10013, USA), except for brief excerpts in connection with reviews or scholarly analysis. Use in connection with any form of information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed is forbidden. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. Printed on acid-free paper springer.com Contents ContributingAuthors vii Preface xi Foreword xiii 1 GeneticProgramming: TheoryandPractice 1 TerenceSoule,RickL.RioloandUna-MayO’Reilly 2 APopulationBasedStudyofEvolutionaryDynamicsinGeneticProgramming 19 A.A.Almal,C.D.MacLeanandW.PWorzel 3 AnApplicationofInformationTheoreticSelectiontoEvolutionofModels 29 withContinuous-valuedInputs StuartW.CardandChilukuriK.Mohan 4 ParetoCooperative-CompetitiveGenetic Programming: A Classification 43 BenchmarkingStudy AndrewR.McIntyreandMalcolmI.Heywood 5 GeneticProgrammingwithHistoricallyAssessedHardness 61 JonKleinandLeeSpector 6 CrossoverandSamplingBiasesonNearlyUniformLandscapes 75 TerenceSoule 7 AnalysisoftheEffectsofElitismonBloatinLinearandTree-basedGenetic 91 Programming RiccardoPoli,NicholasF.McPheeandLeonardoVanneschi 8 Automated Extraction of Expert Domain Knowledge from Genetic Pro- 111 grammingSynthesisResults TrentMcConaghy,PieterPalmers,GeorgesGielenandMichielSteyaert vi GENETICPROGRAMMINGTHEORYANDPRACTICEVI 9 DoesComplexityMatter? ArtificialEvolution,ComputationalEvolution 125 andtheGeneticAnalysisofEpistasisinCommonHumanDiseases JasonH.Moore,CaseyS.Greene,PeterC.AndrewsandBillC.White 10 ExploitingTrustableModelsviaParetoGPforTargetedDataCollection 145 MarkKotanchek,GuidoSmitsandEkaterinaVladislavleva 11 Evolving Effective IncrementalSolvers for SAT with a Hyper-Heuristic 163 FrameworkBasedonGeneticProgramming MohamedBader-El-DenandRiccardoPoli 12 ConstrainedGeneticProgrammingtoMinimizeOverfittinginStockSelection 179 MinkyuKim,YingL.Becker,PengFeiandUna-MayO’Reilly 13 Co-EvolvingTradingStrategiestoAnalyzeBoundedRationalityinDouble 195 AuctionMarkets Shu-HengChen,Ren-JieZengandTinaYu 14 ProfilingSymbolicRegression-Classification 215 MichaelF.KornsandLoryfelNunez 15 AcceleratingGeneticProgrammingthroughGraphicsProcessingUnits 229 WolfgangBanzhaf,SimonHarding,WilliamB.LangdonandGarnettWilson 16 GeneticProgrammingforIncentive-BasedDesignwithinaCulturalAlgo- 249 rithmsFramework MostafaZ.Ali,RobertG.ReynoldsandXiangdongChe Index 269 Contributing Authors Mostafa Z. Aliis an Assistant Professor of Computer Science at Jordan Uni- versityofScienceandTechnology, Irbed,Jordan([email protected]). Arpit ArvindkumarAlmal is an evolutionary engineer at Genetics Squared, Inc.,acomputational discoverycompany([email protected]). PeterC.Andrewsisasoftwareengineer intheComputational GeneticsLab- oratoryatDartmouthMedicalSchool([email protected]). MohamedB.Bader-El-DenisaPhDcandidateintheDepartmentofComput- ingandElectronicSystemsatUniversityofEssex([email protected]). Wolfgang Banzhaf is a professor and chair of the Department of Computer Science at Memorial University of Newfoundland, St. John’s, NL, Canada ([email protected]). Ying Becker is Vice President, Head of Global Quantitative Active Equity Research,AdvancedResearchCenteratStateStreetGlobalAdvisors, Boston, MAUSA(Ying [email protected]). StuartW.CardisaPhDcandidateintheDepartmentofElectricalEngineering andComputerScienceatSyracuseUniversity([email protected]). XiangdongCheisaPhDcandidateintheDepartmentofofComputerScience atWayneStateUniversity,Detroit,MI,U.S.A(sean [email protected]). Shu-Heng Chen is a Professor of Economics at the National Chengchi Uni- versity,Taiwan([email protected]). Peng Fei is a senior quantitative research analyst for the Advanced Research Center at State Street Global Advisors (SSgA), the investment management armofStateStreetCorporation, Boston, MA(peng [email protected]). viii GENETICPROGRAMMINGTHEORYANDPRACTICEVI GeorgesGielenisaProfessorofElectricalEngineeringKatholiekeUniversiteit Leuven,Belgium([email protected]). CaseyS.Greeneisagraduate studentintheComputational GeneticsLabora- toryatDartmouthMedicalSchool([email protected]). Simon Harding is a postdoctoral fellow in the Department of Computer Sci- ence at Memorial University of Newfoundland, St. John’s, NL, Canada (si- [email protected]). MalcolmHeywoodisaProfessorofComputerScienceatDalhousieUniversity, Halifax,NS,Canada([email protected]). Minkyu Kim is a doctoral candidate in the Department of Electrical En- gineering and Computer Science at Massachusetts Institute of Technology ([email protected]). JonKleinisaSeniorResearchFellowatHampshireCollegeinAmherst,Mas- sachusetts (jk@artificial.com). Michael F. Korns is Chief Technology Officer at Investment Science Corpo- ration([email protected]). MarkE.KotanchekisChiefTechnologyOfficerofEvolvedAnalytics,adata modelingconsulting andsystemscompany([email protected]). W. B. Langdon is a Research Officer jointly in the Departments of Mathe- matical, Biological Sciences and Computing and Electronic Systems of the UniversityofEssex([email protected]). DuncanMacLeanisco-founderofGeneticsSquared,Inc.,acomputationaldis- coverycompanyworkinginthepharmaceuticalindustry([email protected]). TrentMcConaghyisChiefScientificOfficeratSolidoDesignAutomationInc., as well as PhD candidate at ESAT-MICAS, Katholieke Universiteit Leuven, Belgium(trent [email protected]). Andrew McIntyre is a Post Doctoral Researcher in the Faculty of Computer ScienceatDalhousieUniversity, Halifax,NS,Canada([email protected]). NicMcPheeisaProfessorofComputerScienceattheUniversityofMinnesota, Morris([email protected]). ContributingAuthors ix Chilukuri K. Mohan is Professor of Electrical Engineering and Computer ScienceatSyracuseUniversit([email protected]). Jason H. Moore is the Frank Lane Research Scholar in Computational Ge- netics and Associate Professor of Genetics at Dartmouth Medical School (Ja- [email protected]). Loryfel Nunez is a Research Scientist at Investment Science Corporation ([email protected]). Una-MayO’ReillyisaPrincipal Research Scientist intheComputerScience andArtificialIntelligenceLaboratoryatMassachusettsInstituteofTechnology ([email protected]). Pieter Palmers is a PhD candidate at the Microelectronics and Sen- sors (ESAT-MICAS) Lab at Katholieke Universiteit Leuven, Belgium ([email protected]). RiccardoPoliisaProfessorofComputerScienceintheDepartmentofComput- ingandElectronicSystemsoftheUniversityofEssex,UK([email protected]). RobertG.ReynoldsisaProfessor ofComputerScience atWayneStateUni- versity,Detroit,MI,U.S.A([email protected]). RickRioloisDirector oftheComputer LabandAssociate Research Scientist intheCenterfortheStudyofComplexSystemsattheUniversityofMichigan ([email protected]). Guido F. Smits is a Research and Development Leader in the New Products Group within the Core R&D Organization of the Dow Chemical Company ([email protected]). TerenceSouleisanAssociateProfessorofComputerScienceattheUniversity ofIdaho, Moscow,ID([email protected]). Lee Spector is a Professor of Computer Science in the School of Cog- nitive Science at Hampshire College in Amherst, Massachusetts (lspec- [email protected]). Michiel Steyaert is a Professor of Electrical Engineering Katholieke Univer- siteitLeuven,Belgium([email protected]). x GENETICPROGRAMMINGTHEORYANDPRACTICEVI Leonardo Vanneschi is an Assistant Professor of Computer Science at the UniversityofMilano-Bicocca, Milan,Italy([email protected]). Ekaterina Vladislavleva is a postdoctoral researcher in the Computer Arith- meticsandNumericalTechniquesGroupintheDepartmentofMathematicsand ComputerScience,AntwerpUniversity,Belgium([email protected]). BillC.WhiteisaSeniorProgrammerintheComputationalGeneticsLaboratory atDartmouthMedicalSchool([email protected]). Garnett Wilson is a postdoctoral fellow in the Department of Computer Sci- enceatMemorialUniversity ofNewfoundland, St. John’s, NL,Canada(gwil- [email protected]). BillWorzelistheChiefExecutiveOfficerandco–founderofGeneticsSquared, Inc., a computational discovery company working in the biotech industry to developmoleculardiagnostics ([email protected]). TinaYuisanAssociate Professor ofComputerScienceattheMemorial Uni- versityofNewfoundland, Canada([email protected]). Ren-JieZengisanAssistantResearchFellowattheAI-ECONResearchCen- ter,NationalChengchi University,Taiwan([email protected]).