Table Of ContentRick Riolo, Terence Soule and Bill Worzel (Eds.)
Genetic Programming Theory and Practice IV
Genetic and Evolutionary Computation Series
Series Editors
David E. Goldberg
Consulting Editor
IlliGAL, Dept. of General Engineering
University of Illinois at Urbana-Champaign
Urbana,IL 61801 USA
Email: deg@uiuc.edu
John R. Koza
Consulting Editor
Medical Informatics
Stanford University
Stanford, CA 94305-5479 USA
Email: john@johnkoza.com
Selected titles from this series:
Markus Brameier, Wolfgang Banzhaf
Linear Genetic Programming, 2007
ISBN 978-0-387-31029-9
Nikolay Y. Nikolaev, Hitoshi Iba
Adaptive Learning of Polynomial Networks^ 2006
ISBN 978-0-387-31239-2
Tetsuya Higuchi, Yong Liu, Xin Yao
Evolvable Hardware, 2006
ISBN 978-0-387-24386-3
David E. Goldberg
The Design of Innovation: Lessons from and for Competent Genetic Algorithms, 2002
ISBN 978-1-4020-7098-3
John R. Koza, Martin A. Keane, Matthew J. Streeter, William Mydlowec, Jessen Yu, Guido Lanza
Genetic Programming IV: Routine Human-Computer Machine Intelligence
ISBN: 978-1-4020-7446-2 (hardcover), 2003; ISBN: 978-0-387-25067-0 (softcover), 2005
Carlos A. Coello Coello, David A. Van Veldhuizen, Gary B. Lamont
Evolutionary Algorithms for Solving Multi-Objective Problems, 2002
ISBN: 978-0-306-46762-2
Lee Spector
Automatic Quantum Computer Programming: A Genetic Programming Approach
ISBN: 978-1-4020-7894-1 (hardcover), 2004; ISBN 978-0-387-36496-4 (softcover), 2007
William B. Langdon
Genetic Programming and Data Structures: Genetic Programming + Data Structures = Automatic
Programming! 1998
ISBN: 978-0-7923-8135-8
For a complete listing of books in this series, go to http://www.springer.com
Rick Riolo
Terence Soule
Bill Worzel
(Eds.)
Genetic Programming
Theory and Practice IV
springer
Rick Riolo
Center for the Study of Complex Systems
University of Michigan
Terence Soule
University of Idaho
Bill Worzel
Genetics Squared, Inc.
Library of Congress Control Number: 2006936674
ISBN-10: 0-387-33375-4 e-ISBN-10: 0-387-49650-5
ISBN-13: 978-0-387-33375-5 e-ISBN-13: 978-0-387-49650-4
© 2007 by Springer Science+Business Media, LLC
All rights reserved. This work may not be translated or copied in whole or in part
without the written permission of the publisher (Springer Science + Business
Media, LLC, 233 Spring Street, New York, NY 10013, USA), except for brief
excerpts in connection with reviews or scholarly analysis. Use in connection with
any form of information storage and retrieval, electronic adaptation, computer
software, or by similar or dissimilar methodology now known or hereafter
developed is forbidden.
The use in this publication of trade names, trademarks, service marks and similar
terms, even if they are not identified as such, is not to be taken as an expression
of opinion as to whether or not they are subject to proprietary rights.
Printed in the United States of America
987654321
springer.com
Contents
Contributing Authors ix
Preface xiii
Foreword xv
1
Genetic Programming: Theory and Practice 1
Terence Soule, Rick L Riolo and Bill Worzel
2
Genome-Wide Genetic Analysis Using Genetic Programming 11
Jason H. Moore and Bill C. White
3
Lifting the Curse of Dimensionality 29
W.P. Worzel, A. Almal and CD. Mac Lean
4
GP for Classifying Cancer Data and Controlling Humanoid Robots 41
Topon Kumar Paul and Hitoshi Iba
5
Boosting Improves Stability and Accuracy of Genetic Programming in 61
Biological Sequence Classification
Pal Saetrom, OlafRene Birkeland and Ola Sn0ve JK
6
Orthogonal Evolution of Teams: A Class of Algorithms for Evolving 79
Teams with Inversely Correlated Errors
Terence Soule and Pavankumarreddy Komireddy
7
Multidimensional Tags, Cooperative Populations, 97
and Genetic Programming
Lee Spector and Jon Klein
Coevolving Fitness Models for Accelerating Evolution 113
and Reducing Evaluations
Michael D. Schmidt and Hod Lipson
vi GENETIC PROGRAMMING THEORY AND PRACTICE IV
9
Multi-Domain Observations Concerning the Use of Genetic Programming 131
to Automatically Synthesize Human-Competitive Designs for Analog
Circuits, Optical Lens Systems, Controllers, Antennas, Mechanical Sys
tems, and Quantum Computing Circuits
John R. Koza, Sameer H. Al-Sakran and Lee W, Jones
10
Robust Pareto Front Genetic Programming Parameter Selection Based on 149
Design of Experiments and Industrial Data
Flor Castillo, Arthur Kordon and Guido Smits
11
Pursuing the Pareto Paradigm: Tournaments, Algorithm Variations and 167
Ordinal Optimization
Mark Kotanchek, Guido Smits and Ekaterina Vladislavleva
12
Applying Genetic Programming to Reservoir History Matching Problem 187
Tina Yu, Dave Wilkinson and Alexandre Castellini
13
Comparison of Robustness of Three Filter Design Strategies Using Genetic 203
Programming and Bond Graphs
Xiangdong Peng, Erik D, Goodman and Ronald C Rosenberg
14
Design of Posynomial Models for Mosfets: Symbolic Regression Using 219
Genetic Algorithms
Varun Aggarwal and Una-May O'Reilly
15
Phase Transitions in Genetic Programming Search 237
Jason M. Daida, Ricky Tang, Michael E. Samples and Matthew J, Byom
16
Efficient Markov Chain Model of Machine Code Program Execution and 257
Halting
Riccardo Poli and William B. Lang don
17
A Re-examination of a Real World Blood Flow Modeling Problem Using 279
Context-aware Crossover
Hammad Majeed and Conor Ryan
18
Large-Scale, Time-Constrained Symbolic Regression 299
Michael F. Korns
Contents vii
19
Stock Selection: An Innovative Application 315
of Genetic Programming Methodology
Ying L Becker, Peng Fei and Anna M, Lester
Index 335
Contributing Authors
Varun Aggarwal is a PhD student at Massachusetts Institute of Tech
nology in the Computer Science and Artificial Intelligence Laboratory.
(varun_ag@mit.edu).
Arpit Arvindkumar Almal is an evolutionary engineer at Genetics Squared,
Inc., a computational discovery company (aalmal@umich.edu).
Sameer H. Al-Sakran is a researcher at Genetic Programming, Inc. in Moun
tain View, CA (al-sakran@genetic-programming.com).
R. Muhammad Atif Azad is a Post Doctoral Researcher at the Biocomputing
and Developmental Systems Group in the Department of Computer Science
and Information Systems at University of Limerick, Ireland (atif.azad@ul.ie).
Ying Becker is Vice President, Advanced Research Center, State Street Global
Advisors, Boston, MA USA (YingJBecker@ssga.com).
Olaf Rene Birkeland is Chief Technology Officer at Interagon AS
(olaf .birkeland @ interagon.com).
Alexandre Castellini is a petroleum engineer in the Reservoir Simulation Con
sulting Team at Chevron Energy Technology Company, San Ramon, CA, USA
(ACastellini @ chevron.com).
Flor A. CastUlo is a Research Specialist in the Modeling Group within the
Engineering and Process Sciences R&D Organization of the Dow Chemical
Company (facastillo@dow.com).
Jason M. Daida is an Associate Research Scientist in the Space Physics Re
search Laboratory, Department of Atmospheric, Oceanic and Space Sciences,
and is affiliated with the Center for the Study of Complex Systems at the Uni
versity of Michigan, Ann Arbor (daida@umich.edu).
X GENETIC PROGRAMMING THEORY AND PRACTICE IV
Peng Fei is a quantitative research analyst for the advanced research center at
State Street Global Advisors (SSgA), the investment management arm of State
Street Corporation, Boston, MA (peng_fei@ssga.com).
Erik D. Goodman is Professor of Electrical and Computer Engineering and of
Mechanical Engineering at Michigan State University (goodman@egr.msu.edu).
Hitoshi Iba is Professor in the Department of Frontier Informatics at the Uni
versity of Tokyo, Japan (iba@iba.k.u-tokyo.ac.jp).
Lee W. Jones is a researcher at Genetic Programming, Inc. in Mountain View,
C A (lee @ genetic-programming .com).
Jon Klein is a Senior Research Fellow in the School of Cognitive Science at
Hampshire College in Amherst, Massachusetts, and a doctoral candidate in
Physical Resource Theory at Chalmers University of Technology and Goteborg
University in Goteborg, Sweden (jk@artificial.com).
Pavan Komireddy is a Software Engineer for Yahoo!, working in Burbank,
CA (pavan@yahoo-inc.com)
Arthur K. Kordon is a Research and Development Leader in the Modelling
Group within the Engineering and Process Sciences R&D Organization of the
Dow Chemical Company (akordon@dow.com).
Michael F. Korns is Chief Technology Officer at Investment Science Corpo
ration (mkoms@koms.com).
Mark E. Kotanchek is Chief Technology Officer of Evolved Analytics, a data
modeling consulting and systems company (mark@evolved-analytics.com).
John R. Koza is Consulting Professor at Stanford University in the Department
of Electrical Engineering (koza@stanford.edu).
William B. Langdon is Principal Research Officer in the Department of Com
puter Science of the University of Essex, UK (wlangdon@essex.ac.uk).
Anna Lester is a Vice President of the US Active Equity Group, State Street
Global Advisors, Boston, MA (AnnaXester@ssga.com).
Hod Lipson is an Assistant Professor at the School of Mechanical & Aerospace
Engineering and at the Faculty of Computing & Information Science at Comell
University, Ithaca NY, USA (hod.lipson@comell.edu).
Contributing Authors xi
Duncan MacLean is co-founder of Genetics Squared, Inc., a computational dis
covery company working in the pharmaceutical industry (dmaclean@acm.org).
Hammad Majeed is PhD Student in the Department of Computer Science and
Information Systems at University of Limerick, Ireland where he is a member
of Biocomputing and Developmental Systems Group (hammad.majeed@ul.ie).
Jason H. Moore is the Frank Lane Research Scholar in Computational Ge
netics and Associate Professor of Genetics at Dartmouth Medical School (Ja-
son.H.Moore@Dartmouth.edu).
Una-May O'Reilly is a Principal Research Scientist and leader of the EVO-
DesignOpt group at the Computer Science and Artificial Intelligence Laboratory
at the Massachusetts Institute of Technology (unamay@csail.mit.edu).
Topon Kumar Paul is a PhD student at the University of Tokyo in the De
partment of Frontier Informatics. His research includes applications of evo
lutionary computation methods to computational biology and bioinformatics
(topon@iba.k.u-tokyo.ac.jp).
Riccardo Poli is Professor of Computer Science at the University of Essex
(rpoli@essex.ac.uk).
Rick Riolo is Director of the Computer Lab and Associate Research Scientist
in the Center for the Study of Complex Systems at the University of Michigan
(rlriolo@umich.edu).
Ronald C. Rosenberg is Professor of Mechanical Engineering at Michigan
State University (roserber@egr.msu.edu).
Conor Ryan is Senior Lecturer in the Department of Computer Science and
Information Systems at University of Limerick, Ireland where he leads the
Biocomputing and Developmental Systems Group (conor.ryan@ul.ie).
Pal Saetrom is a Postdoctoral Fellow in the Department of Computer and Infor
mation Science at the Norwegian University of Science and Technology, and a
Research Scientist at Interagon AS (paal.saetrom@interagon.com).
Michael D. Schmidt is a Ph.D. student in the field of Computational Biology
at Cornell University, Ithaca NY, USA (mds47@comell.edu).