Preface Mathematics is playing an increasingly important role in the physical, biological and engineering sciences, provoking a blurring of boundaries between scientific disciplines and a resurgence of interest in the modern as well as the classical techniques of applied mathematics. Remarkable progress has been made recently in both theory and applications of all important areas of control theory. Modern automatic control theory covers such topics as the algebraic theory of linear systems (including controllability, observability, feedback equivalence, minimality of realization, frequency domain analysis and synthesis etc.), Lyapunov stability theory, input- output method, optimal control (maximum principle and dynamic programing), observers and dynamic feedback, robust control (in Hardy and Lebesgue spaces), delay-systems control, the control of infinite-dimensional systems (governed by models in partial differential equations), conflict and game situations, stochastic processes and effects, and many others. Some elegant applications of control theory are presently being implemented in aerospace, biomedical and industrial engineering, robotics, economics, power systems etc. The efficient implementation of the basic principles of control theory to different applications of special interest requires an interdisciplinary knowledge of advanced mathematical tools and such a combined expertise is hard to find. What is needed, therefore, is a textbook making these tools accessible to a wide variety of engineers, researchers and students. Many suitable texts exist (practically there are no textbooks) that tackle some of the areas of investigation mentioned above. Each of these books includes one or several appendices containing the minimal mathematical background that is required of a reader to actively work with this material. Usually it is a working knowledge of some mathematical tools such as the elements of linear algebra, linear differential equations, fourier analysis and, perhaps, some results from optimization theory, as well. In fact, there are no textbooks containing all (or almost all) of the mathematical knowledge required for suc- cessful studying and research within the control engineering community, It is important to emphasize that the mathematical tools for automatic control engineers are specific and significantly differ from those needed by people involved in fluid mechanics, electrical engineering etc. To our knowledge, no similar books or publications exist. The material in these books partially overlaps with several other books. However, the material covered in each book cannot be found in a single book (dealing with deterministic or stochastic systems). Nevertheless, some books may be considered as partially competitive. For example: (cid:12)9 Guillemin (1949) The Mathematics of Circuit Analysis: Extensions to the Mathematical Training of Electrical Engineers, John Wiley and Sons, Inc., New York. In fact this iivx iiivx ecaferP book is nicely written, but it is old, does not have anything on stochastic and is oriented only to electrical engineers. (cid:12)9 Modern Mathematics for the Engineer (1956), edited by E.F. Beckenbah, McGraw-Hill, New York. This is, in fact, a multi-author book containing chapters written by the best mathematicians of the second half of the last century such as N. Wiener, R. Bellman and others. There is no specific orientation to the automatic control community. (cid:12)9 Systkmes Automatisms (in French) (2001), Hermes-Science, Paris, five volumes. These are multi-authored books where each chapter is written by a specific author or authors. (cid:12)9 Hinrichsen & Pritchard (2005) Mathematical Systems Theory I: Modelling, State Space Analysis, Stability and Robustness, Texts in Applied Mathematics, Springer. This excel- lent book is written by mathematicians for mathematicians working with mathematical aspects of control theory. The wide community of automatic control engineers requires a book like this. The primary reason is that there exist no similar books, and, secondly, the mathematical tools are spread over many mathematical books written by mathematicians and the majority of them are unsuitable for the automatic control engineering community. This book was conceived as a hybrid monograph/textbook. I have attempted to make the development didactic. Most of the material comes from reasonably current periodic literature and a fair amount of the material (especially in Volume 2) is my own work. This book is practically self-contained since almost all lemmas and theorems within contain their detailed proofs. Here, it makes sense to remember the phrase of David Hilbert: "It is an error to believe that rigor in the proof is the enemy of simplicity. The very effort for rigor forces us to discover simpler methods of proof .... " Intended audience My teaching experience and developing research activities convinced me of the need for this sort of textbook. It should be useful for the average student yet also provide a depth and rigor challenging to the exceptional student and acceptable to the advanced scholar. It should comprise a basic course that is adequate for all students of automatic control engineering regardless of their ultimate speciality or research area. It is hoped that this book will provide enough incentive and motivation to new researchers, both from the "control community" and applied and computational mathematics, to work in the area. Generally speaking, this book is intended for students (undergraduate, postdoctoral, research) and practicing engineers as well as designers in different industries. It was written with two primary objectives in mind: (cid:12)9 to provide a list of references for researchers and engineers, helping them to find information required for their current scientific work, and (cid:12)9 to serve as a text in an advanced undergraduate or graduate level course in mathematics for automatic control engineering and related areas. The particular courses for which this book might be used as a text, supplementary text or reference book are as follows: ecaferP xix Volume 1 (cid:12)9 Introduction to automatic control theory, (cid:12)9 Linear and nonlinear control systems, (cid:12)9 Optimization, (cid:12)9 Control of robotic systems, (cid:12)9 Robust and adaptive control, (cid:12)9 Optimal control, Discrete-time and impulse systems, (cid:12)9 (cid:12)9 Sliding mode control, (cid:12)9 Theory of stability. Volume 2 (cid:12)9 Probability and stochastic processes in control theory, (cid:12)9 Signal and systems, (cid:12)9 Identification and parameters estimation, (cid:12)9 Adaptive stochastic control, (cid:12)9 Markov processes, (cid:12)9 Game theory, (cid:12)9 Machine learning, (cid:12)9 Intelligent systems, (cid:12)9 Design of manufacturing systems and operational research, (cid:12)9 Reliability, (cid:12)9 Signal processing (diagnosis, pattern recognition etc.). This book can also be used in several departments: electrical engineering and electronics, systems engineering, electrical and computer engineering, computer science, information science and intelligent systems, electronics and communications engineering, control engineering, systems science and industrial engineering, cybernetics, aerospace engineering, econometrics, mathematical economics, finance, quality control, applied and computational mathematics, and applied statistics and operational research, quality management, chemical engineering, mechanical engineering etc. The book is also ideal for self-study. It seems to be more or less evident that any book on advanced mathematical methods is predetermined to be incomplete. It will also be evident that I have selected for inclusion in the book a set of methods based on my own preferences, reflected by my own experience, from among a wide spectrum of modern mathematical approaches. Nevertheless, my intention is to provide a solid package of materials, making the book valuable for postgraduate students in automatic control, mechanical and electrical engineering, as well as for all engineers dealing with advance mathematical tools in their daily practice. As I intended to write a textbook and not a handbook, the bibliography is by no means complete. It comprises only those publications which I actually used. ecaferP xx stnemgdelwonkcA I have received invaluable assistance in many conversations with my friend and colleague Prof. Vladimir L. Kharitonov (CINVESTAV-IPN, Mexico). Special thanks are due to him for his direct contribution to the presentation of Chapter 20 concerning stability theory and for his thought-provoking criticism of many parts of the original manuscript. I am indebted to my friend Prof. Vadim .I Utkin (Ohio State University, USA) for being so efficient during my work with Chapters ,9 91 and 22 including the topics of theory of differential equations with discontinuous right-hand side and of sliding mode control. I also wish to thank my friend Prof. Kaddour Najim (Polytechnic Institute of Toulouse, France) for his initial impulse and suggestion to realize this project. Of course, I feel deep gratitude to my students over the years, without whose evident enjoyment and expressed appreciation the current work would not have been undertaken. Finally, I wish to acknowledge the editors at Elsevier for being so cooperative during the production process. Alexander .S Poznyak Mexico, 2007 Notations and Symbols R ~ the set of real numbers. C the set of complex numbers. C- := z{ 6 C IRez < }0 --the left open complex semi-plane. m an arbitrary field (a set) of all real or all complex numbers, i.e., ._ { R in the case of real numbers C in the case of complex numbers A - aiji,j=l m,n rectangular m x n matrix where aij denotes the elements of this table lying on the intersection of the ith row and jth column. ~t (cid:141)m ~ the set of all m x n matrices with real elements from R. C (cid:141)m -- the set of all m x n matrices with complex elements from C. (jl, j2 ..... jn) -- permutation of the numbers ,1 2 ..... n. t (j~, j2 ..... jn) a certain number of inversions associated with a given permutation (jl, j2 ..... jn). det A ~ the determinant of a square matrix A 6 R (cid:141)n A r m the transpose of the matrix A obtained by interchanging the rows and columns of A. --the conjugate of A, i.e. A "-lij IIi,j=l. m,n A* := (A)r the conjugate transpose of A. Mii the minor of a matrix A E R (cid:141)n equal to the determinant of a submatrix of A obtained by striking out the i th row and j th column. Aij :-- (-1) i+j Mij the cofactor (or/j-algebraic complement) of the element aij of the matrix A ~ N (cid:141)n VI,, -- the Vandermonde determinant. (il i2...ip)._ detai, j,f=i the minor of order p of A. A jl j2 jp ~i i2... ip the complementary minor equal to the determinant of a square A ( jl j2 jp ) ( c) matrix A resulting from the deletion of the listed rows and columns. CA il 2i ... ip il 2i ... ip the complementary cofactor where jl j2 jp "-- (- 1)s A jl j2 jp s = (il + 2i +'" + ip) + (jl + j2 +"" + jp) ixx xxii Notations and symbols rank A the minimal number I of linearly independent rows or columns of A E ~mxn. all 0 (cid:12)9 0 diag all, a22 ..... ann :-- 0a22 0 the diagonal matrix with the mentioned 0 ann elements. Inxn "-- diag ( 1, n)" 1 ..... 1 m the unit (or identity) matrix of the corresponding size. Ajij,i=~ adjA "- -- the adjoint (or adjugate) of a square matrix A E R n(cid:141) A-1 __ inverse to A. m! C / := -- the number of combinations containing i different numbers from i!(m-i)! the collection (1, 2 ..... m). Here accepted that 0! - .1 j the imaginary unite, j2 _ -1. A | B "-- aij Bi,j=l n,m E ~xmpxnq ~ the direct (tensor) Kronecker product of two matrices, may be of different sizes, i.e. A E R ,MT B E R p(cid:141) O, O~(cid:141) m zero matrices (sometimes with the indication of the size I x k) containing the elements equal to zero. M trA "- ~ aii m the trace of a quadratic matrix A E (~nxn (may be with complex i=1 elements). lel (a, b) "- a*b - ~ 6tibi ~ a scalar (inner) product of two vectors a E (~nxl and b 6 (~l(cid:141) i=1 which for real vectors a, b E R n becomes (a, b) "- arb - aibi. i=1 span {Xl, x2 ..... }~x "-- {x - OtlXl + 2XztO +... + kXktO " i~C E C, i - 1 ..... k} -- the set (a subspace) of all linear combinations of Xl, x2 ..... xk over C. 1 if i - j the Kronecker (delta-function) symbol. ji~( --" "O if i r j S (cid:127) - span {x~+l, x~+2 ..... Xn } ~ the orthogonal completion of a subspace S C C n where the vectors xk+j. (j - 1,..., n - k) are orthonormal. KerA - N'(A) "- {x E C" (cid:12)9 Ax - 0} ~ the kernel (or null space) of the linear transfor- mationA'C"~ > C m. ImA 7~(A) "- {y E C m " y - Ax, x E C }~ m the image (or range) of the linear - transformation A" cn ~ > C m. def A "- dim KerA ~ the dimension of the subspace KerA - N'(A). )r(~/ E (~ a right eigenvalue corresponding to a right eigenvector x of a matrix A, i.e., Ax -- ~(r~x. ~q.~ E C ~ a left eigenvalue corresponding to a left eigenvector x of a matrix A, i.e., x*A = )~q~x*. Notations and symbols xxiii rc (A) := {)~1, ~2 ..... }n~/ -- the spectrum (the set of all eigenvalues) of A. p (A) := max I)~/I -- the spectral radius of A. l 1 -- the H61der vector norm. i=1 IIx II "- max Ixil ~ the Chebyshev vector norm. c~ l0 -x if x<0" i -- the imaginary unit such that i 2 = -1. (cid:12)9 - a - ib forz - a + ib. e y + e -y e y _ e-y coshy --- ~ , sinhy "-- ~ . 2 2 A ~" B- means A is equivalent to B. U aC the union of sets Ca. otr aC the intersection of sets .~,C otE,A 13- A "- {x (cid:12)9 x E B, but x ~ A}. A c the complement of A. cl g "- s U s -- the closure of g where s is the set of all limit points of s 0s - cl s cl(X - s -- the boundary of the set s C 2'. int g "- g - Og m the set of all internal points of the set g. diam s "- sup d (x, y) -- the diameter of the set s x,y6s f ~ "R,a,b (of) ~ means that f is integrable in the Riemann sense with respect to fo on a,b. # (A) ~ the Lebesgue measure of the set A. f 6 21 (#) m means that f is integrable (or summable) on s in the Lebesgue sense with respect to the measure # on s f ~" g on s -- means that # ({x f (x) # g (x)} N s - 0. Notations and symbols xxv ess sup f "- inf c such that # ({xlf (x) > c}) - 0 the essential supremum of f cEIR (sometimes denoted also by "vrai max f"). ess inf f "= sup c such that # ({xlf (x) < c}) = 0 ~ the essential infimum of f cEIR (sometimes denoted also by "vrai min f"). (x - x0) the Dirac delta-function acting as f f (x)~ (x - Xo)dx - f (Xo) for any XCIR continuous function f" R -+ R. f+ (c) and f_' (c) the right- and left-hand side derivatives of f (x) in the point c. gu " R -+ IR- a convex downward (or simply convex) function. gn " R +-- R- a convex upward (or simply concave) function. Ac (a, b) ~ the arc length of a path C on a, b. f f (z)dz ~ the contour integral of the function f along C. C f f (z)dz - 0 the contour integral of the function f(z) around a closed path C. C 1 --" f f (z) dz the residue of the function f (z) at the singular point a resf (a) 2rri c within a contour C. O3( F (p)"- f f (t) K (t, p)dt- the integral transformation of f (t) via the kernel K (t, p). t=0 t (f (cid:12)9 g) "- f f (r) g (t - r)dr -- the convolution of two functions. r=0 2/ {f} the Laplace transformation of f. /2-1{F} the inverse Laplace transformation of F. 1 7 (~o) "- ,=fv_ f (t)e-i'~ ~ the Fourier transformation of f. Ca,b the space of continuous functions. C k a, b the space of k-times continuously differentiable functions. L p a, b 1( < p < CxD)m the Lebesgue space. pS l (G) ~ the Sobolev spaces. Hp (cid:141) RHp (cid:141) ~x Ai the convex hull of a set i-1 i=1 QcR". frO {x} -- arg min xlI -- llY ~ a projectional operator. yEQ A _B __ referred to as a state space realization. C DJ F (s)"-- F r (-s). Ac " L~ +-- L~' -- the Laurent (or multiplication) operator. FG (}~k) L- +-- H m 2 the Hankel operator. (cid:12)9 | "H~ ~ H~' --the Toeplitz operator. Fg (cid:12)9 L~ 0, )~xc +-- L~ 0, co) the time-domain Hankel operator.

Advanced Mathematical Tools for Automatic Control Engineers: Deterministic Techniques

Similar Advanced Mathematical Tools for Automatic Control Engineers: Deterministic Techniques