Do Smart Adaptive Systems Exist?: Best Practice for Selection and Combination of Intelligent Methods

368 Pages·2005·6.505 MB·English

by  B. Gabrys (auth.), Bogdan Gabrys, Kauko Leiviskä, Jens Strackeljan (eds.)

BogdanGabrys,KaukoLeiviska¨,JensStrackeljan(Eds.)
DoSmartAdaptiveSystemsExist?
StudiesinFuzzinessandSoftComputing,Volume173
Editor-in-chief
Prof.JanuszKacprzyk
SystemsResearchInstitute
PolishAcademyofSciences
ul.Newelska6
01-447Warsaw
Poland
E-mail:[e-mail]
Furthervolumeofthisseries Vol.165.A.F.Rocha,E.Massad,A.PereiraJr.
canbefoundonourhomepage: TheBrain:FromFuzzyArithmeticto
springeronline.com QuantumComputing,2005
ISBN3-540-21858-0
Vol.158.K.K.Dompere Vol.166.W.E.Hart,N.Krasnogor,
Cost-BenefitAnalysisandtheTheoryof J.E.Smith(Eds.)
FuzzyDecisions–Identificationand RecentAdvancesinMemeticAlgorithms,
MeasurementTheory,2004 2005
ISBN3-540-22154-9 ISBN3-540-22904-3
Vol.159.E.Damiani,L.C.Jain, Vol.167.Y.Jin(Ed.)
M.Madravia(Eds.) KnowledgeIncorporationinEvolutionary
SoftComputinginSoftwareEngineering, Computation,2005
2004 ISBN3-540-22902-7
ISBN3-540-22030-5 Vol.168.YapP.Tan,KimH.Yap,
Vol.160.K.K.Dompere LipoWang(Eds.)
Cost-BenefitAnalysisandtheTheoryof IntelligentMultimediaProcessingwithSoft
FuzzyDecisions–FuzzyValueTheory,2004 Computing,2005
ISBN3-540-22161-1 ISBN3-540-22902-7
Vol.161.N.Nedjah,L.deMacedo Vol.169.C.R.Bector,SureshChandra
Mourelle(Eds.) FuzzyMathematicalProgrammingand
EvolvableMachines,2005 FuzzyMatrixGames,2005
ISBN3-540-22905-1 ISBN3-540-23729-1
Vol.162.R.Khosla,N.Ichalkaranje,L.C.Jain Vol.170.MartinPelikan
DesignofIntelligentMulti-AgentSystems, HierarchicalBayesianOptimization
2005 Algorithm,2005
ISBN3-540-22913-2 ISBN3-540-23774-7
Vol.163.A.Ghosh,L.C.Jain(Eds.) Vol.171.JamesJ.Buckley
EvolutionaryComputationinDataMining, SimulatingFuzzySystems,2005
2005 ISBN3-540-24116-7
ISBN3-540-22370-3 Vol.172.PatriciaMelin,OscarCastillo
Vol.164.M.Nikravesh,L.A.Zadeh, HybridIntelligentSystemsforPattern
J.Kacprzyk(Eds.) RecognitionUsingSoftComputing,2005
SoftComputingforInformationProdessing ISBN3-540-24121-3
andAnalysis,2005 Vol.173.BogdanGabrys,KaukoLeiviska¨,
ISBN3-540-22930-2
JensStrackeljan(Eds.)
DoSmartAdaptiveSystemsExist?,2005
ISBN3-540-24077-2
Bogdan Gabrys
Kauko Leiviska¨
Jens Strackeljan (Eds.)
Do Smart
Adaptive Systems
Exist?
Best Practice
for Selection and Combination
of Intelligent Methods
123
BogdanGabrys JensStrackeljan
BournemouthUniversity Universita¨tMagdeburg
SchoolofDesign Institutfu¨rMechanik
Engineering&Computing Lehrstuhlfu¨rTechnischeDynamik
PooleHouse Universita¨tsplatz2,39106Magdeburg
TalbotCampus,FernBarrow Germany
Poole,BH125BB E-mail:[e-mail]-
U.K. magdeburg.de
E-mail:[e-mail]
KaukoLeiviska¨
UniversityOulu
DepartmentofProcessEngineering
ControlEngineeringLaboratory
P.O.Box4300,90014Oulu
Finland
E-mail:kauko.leiviska@oulu.fi
ISSNprintedition:1434-9922
ISSNelectronicedition:1860-0808
ISBN-10 3-540-24077-2SpringerBerlinHeidelbergNewYork
ISBN-13 978-3-540-24077-8SpringerBerlinHeidelbergNewYork
LibraryofCongressControlNumber:2004116662
Thisworkissubjecttocopyright.Allrightsarereserved,whetherthewholeorpartofthematerial
isconcerned,specificallytherightsoftranslation,reprinting,reuseofillustrations,recitation,
broadcasting,reproductiononmicrofilmorinanyotherway,andstorageindatabanks.Dupli-
cationofthispublicationorpartsthereofispermittedonlyundertheprovisionsoftheGerman
CopyrightLawofSeptember9,1965,initscurrentversion,andpermissionforusemustalwaysbe
obtainedfromSpringer.ViolationsareliableforprosecutionundertheGermanCopyrightLaw.
SpringerisapartofSpringerScience+BusinessMedia
springeronline.com
©Springer-VerlagBerlinHeidelberg2005
PrintedinTheNetherlands
Theuseofgeneraldescriptivenames,registerednames,trademarks,etc.inthispublicationdoes
notimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant
protectivelawsandregulationsandthereforefreeforgeneraluse.
Typesetting:bytheauthorsandTechBooksusingaSpringerLATEXmacropackage
Coverdesign:E.Kirchner,SpringerHeidelberg
Printedonacid-freepaper 89/3141/jl-543210
Preface
At first sight, the title of the present book may seem somewhat unusual,
since it ends with a question: Do Smart Adaptive Systems Exist? We have
deliberately chosen this form for the title, because the content of this book is
intendedtoelucidatetwodifferentaspects:Firstofall,wewishtodefinewhat
is meant by the term “Smart Adaptive Systems”. Furthermore, the question
askedinthetitlealsoimpliesthattheapplicationsdescribedmustbecritically
examined to determine whether they satisfy the requirements imposed on a
smartadaptivesystem.Manyreaderswillcertainlyhaveanintuitivenotionof
theconceptsassociatedwiththeterms“smart”and“adaptive”.Somereaders
willprobablyalsothinkofapplicationsfromtheirownfieldofworkwhichthey
consider to be both smart and adaptive.
Isthereanyneedforabookofthiskind?Isanattempttoprovideadefin-
itionoftermsandtodescribemethodsandapplicationsinthisfieldnecessary
at all? Two years ago, we answered this question with an unambiguous “yes”
and also started the book project for this reason. The starting point was the
result of joint activities among the authors in the EUNITE network, which
is dedicated to the topic of smart adaptive systems. EUNITE, the European
Network on Intelligent Technologies for Smart Adaptive Systems, was the
European Network of Excellence that started 2001 and ended mid of 2004.
It concerned with intelligent technologies, including neural networks, fuzzy
systems, methods from machine learning, and evolutionary computing, that
have recently lead to many successful industrial applications. Terms and defi-
nitions have been the subject of intensive discussions within the scope of this
network. These discussions were necessary because the existence of a gener-
ally accepted definition as a working basis is a prerequisite for joint activity
among the members of a network consisting of scientists and representatives
fromindustry.Findingsuchadefinitionprovedtobequitedifficult,especially
becauseof themultiplicity of highly personalopinions which could notbeex-
pressed in concise and conclusive form without contradiction. We hope that
thisbookwillprovideanideaoftheconsensuswhichhasbeenreachedwithin
EUNITE. Since alarge number of European expertsin the fields of computer
VI Preface
science, engineering and economic sciences, mathematics, biology, and medi-
cinewereactiveinthisnetwork,thesetermsalsohaveabroadinterdisciplinary
basis. Adaptivity is a highly essential property which has steadily gained im-
portance for solving current problems in the fields of process control, process
and condition monitoring, and finance. Standard solutions without adapta-
tion to match changing ambient conditions or customer groups, etc. are no
longercompetitivenowadays.Amongotherfactors,thisprogressisduetothe
availabilityofhighlyefficientsensorsatareasonablepriceduringrecentyears.
Thesesensorsfunctionasvitalinterfacesforperceptionoftheexternalworld.
Furthermore, current developments in the field of multimedia and use of the
internet require adaptations to match special user profiles. In this context,
the developments in designing of adaptive search engines may be cited as an
example.
In addition, this book has received the subtitle: “A Best Practice Guide-
line”.Weknowthatthedemandsimposedbythissubtitlearequiteexacting.
Best Practice – these two words imply no more and no less than a presen-
tation of the best-possible techniques available today for realising concrete
applications. Is there really nothing better than those methods which are
described in this book as examples of smart adaptive systems? We cannot
guarantee this with 100-percent certainty; nevertheless, we are sure that the
present book contains a very good collection of methods and applications. In
thecorrespondingchapters,theauthorshaveimplementedthe“bestpractice”
conceptwith the integration of sections entitled “Hints and Tips”. These sec-
tions can provide valuable suggestions to readers from the industrial field as
well as those from the research sector for solving typical problems of their
own. Moreover, a Best Practice Guideline is always referred to concrete fields
of application. Consequently, we have decided to subdivide the book into two
essentialparts.Thefirstpartisdevotedtomethodsforapplicationsandiscon-
centrated on the theoretical foundation which is necessary for understanding
adaptive methods within the field of intelligent methods. This part considers
both individual intelligent technologies (i.e. neural networks, fuzzy systems,
evolutionary algorithms and machine learning approaches) and hybrid meth-
ods(i.e.neuro-fuzzysystems,genetic-neuro-fuzzyapproachesetc.)thatarein
the focus of EUNITE. It discusses the areas where particular methods have
beenappliedandhowthemainfeaturesofparticularmethodsrespondtothe
need for adaptation.
In the second part, on the other hand, applications based on the methods
presentedinthefirstpartaredescribed.Itfocusesonapplicationsthatrequire
somedegreeofadaptation;itdescribesthewayfromapplicationstomethods,
while the previous part goes from methods to applications. Here authors’
experiences are reviewed with respect to the question of how to design an
application requiring adaptation and how to select tools for it. The book
can be read in two different ways: We recommend the classical procedure of
reading from cover to cover, since we consider this approach advantageous. If
the reader prefers, however, he can begin with the second part and then read
Preface VII
the necessary background information on special methods in the first part as
required.
We hope that our readers will find it a pleasure to read this book, and
thatthissubjectwillbeeverybitasfascinatingtothemasithasbeenforus.
January 2005 Jens Strackeljan
Kauko Leiviska¨
Bogdan Gabrys
Contents
1 Do Smart Adaptive Systems Exist? – Introduction
B. Gabrys....................................................... 1
2 Problem Definition – From Applications to Methods
K. Leiviska¨...................................................... 19
3 Data Preparation and Preprocessing
D. Pyle ......................................................... 27
Part I From Methods To Applications
4 Artificial Neural Networks
C. Fyfe ......................................................... 57
5 Machine Learning and Reinforcement Learning
M. van Someren and S. ten Hagen ................................. 81
6 Fuzzy Expert Systems
J.M. Garibaldi...................................................105
7 Learning Algorithms for Neuro-Fuzzy Systems
D.D. Nauck .....................................................133
8 Hybrid Intelligent Systems: Evolving Intelligence
in Hierarchical Layers
A. Abraham .....................................................159
9 Evolving Connectionist Systems
with Evolutionary Self-Optimisatio
N. Kasabov, Z. Chan, Q. Song, and D. Greer ......................181
X Contents
Part II From Applications To Methods
10 Monitoring
J. Strackeljan....................................................205
11 Examples of Smart Adaptive Systems
in Model-Based Diagnosis
K. Leiviska¨......................................................233
12 Design of Adaptive Fuzzy Controllers
K. Leiviska¨ and L. Yliniemi .......................................251
13 Optimal Design Synthesis
of Component-Based Systems
Using Intelligent Techniques
P.P. Angelov, Y. Zhang, and J.A. Wright...........................267
14 Intelligent Methods in Finance Applications:
From Questions to Solutions
M. Nelke........................................................285
15 Neuro-Fuzzy Systems for Explaining Data Sets
D.D. Nauck .....................................................305
16 Fuzzy Linguistic Data Summaries
as a Human Consistent, User Adaptable
Solution to Data Mining
J. Kacprzyk and S. Zadroz˙ny ......................................321
17 Adaptive Multimedia Retrieval:
From Data to User Interaction
A. Nu¨rnberger and M. Detyniecki ..................................341
1
Do Smart Adaptive Systems
Exist? – Introduction
B. Gabrys
Computational Intelligence Research Group, School of Design, Engineering and
Computing, Bournemouth University
[e-mail]
This chapter serves as an introduction to the book and especially to its first
part entitled “From methods to applications”. It begins with a description of
the motivations and driving forces behind the compilation of this book and
work within European Community concerned with smart adaptive systems
as the main theme of EUNITE Network of Excellence. This will be followed
by a short account of individual intelligent technologies within the scope of
EUNITEandtheirpotentialcombinationswhichareperceivedasgoodcandi-
dates for constructing systems with a degree of adaptiveness and intelligence.
Thechaptersinthefirstpartofthebookcoversomeoftheseintelligenttech-
nologies like artificial neural networks, fuzzy expert systems, machine and
reinforcement learning, evolutionary computing and various hybridizations in
more detail. As it has proved throughout the life span of EUNITE it was not
an easy task to agree on the definitions of what adaptive and smart systems
are and therefore some compromise have had to be reached. As a result the
definitions of three levels of adaptivity and some interpretations of the word
smart adopted within EUNITE are given first. We then look at more general
requirementsofintelligent(smart)adaptivesystemsofthefutureanddiscuss
some of the issues using the example of Evolutionary Connectionist Systems
(ECOS)framework.Withinthisgeneralframeworkandthescopeofthebook
in the remaining sections we then concentrate on short description of exist-
ing methods for adaptation and learning, issues to do with model selection
and combination and conflicting goals of having systems that can adapt to
new/changingenvironmentsandatthesametimehaveprovablestabilityand
robustness characteristics. The pointers to the relevant chapters discussing
the highlighted issues in much greater detail are provided throughout this
introductory chapter.
B.Gabrys:DoSmartAdaptiveSystemsExist?–Introduction,StudFuzz173,1–17(2005)
www.springerlink.com (cid:1)c Springer-VerlagBerlinHeidelberg2005