Numerical Analysis Using MATLAB® and Excel® Third Edition Steven T. Karris Orchard Publications www.orchardpublications.com Students and working professionals will Numerical Analysis find NNuummeerriiccaall AAnnaallyyssiiss UUssiinngg MMAATTLLAABB®® aanndd EExxcceell®®,, TThhiirrdd EEddiittiioonn, to be a concise Using MATLAB® and Excel® and easy-to-learn text. It provides com- plete, clear, and detailed explanations of Third Edition the principal numerical analysis methods and well known functions used in science and engineering. These are illustrated with many real-world examples. This text includes the following chapters and appendices: • Introduction to MATLAB • Root Approximations • Sinusoids and Complex Numbers • Matrices and Determinants • Review of Differential Equations • Fourier, Taylor, and Maclaurin Series • Finite Differences and Interpolation • Linear and Parabolic Regression • Solution of Differential Equations by Numerical Methods • Integration by Numerical Methods • Difference Equations • Partial Fraction Expansion • The Gamma and Beta Functions • Orthogonal Functions and Matrix Factorizations • Bessel, Legendre, and Chebyshev Polynomials • Optimization Methods • Difference Equations in Discrete-Time Systems • Introduction to Simulink • Ill-Conditioned Matrices Each chapter contains numerous practical applications supplemented with detailed instructions for using MATLAB and/or Excel to obtain quick solutions. Steven T. Karris is the president and founder of Orchard Publications, has undergraduate and graduate degrees in electrical engineering, and is a registered professional engineer in California and Florida. He has more than 35 years of professional engineering experience and more than 30 years of teaching experience as an adjunct professor, most recently at UC Berkeley, California. Orchard Publications Visit us on the Internet www.orchardpublications.com or email us: [email protected] ISBN-13: 978-11-9934404-004-11 ISBN-10: 1-9934404-004-77 $60.00 USA Numerical Analysis Using MATLAB® and Excel® Third Edition Steven T. Karris Orchard Publications www.orchardpublications.com Numerical Analysis Using MATLAB® and Excel®, Third Edition Copyright ” 2007 Orchard Publications. All rights reserved. Printed in the United States of America. No part of this publication may be reproduced or distributed in any form or by any means, or stored in a data base or retrieval system, without the prior written permission of the publisher. Direct all inquiries to Orchard Publications, [email protected] Product and corporate names are trademarks or registered trademarks of the Microsoft™ Corporation and The MathWorks™, Inc. They are used only for identification and explanation, without intent to infringe. Library of Congress Cataloging-in-Publication Data Library of Congress Control Number: 2007922100 Copyright TX 5-589-152 ISBN-13: 978-1-934404-04-1 ISBN-10: 1-934404-04-7 Disclaimer The author has made every effort to make this text as complete and accurate as possible, but no warranty is implied. The author and publisher shall have neither liability nor responsibility to any person or entity with respect to any loss or damages arising from the information contained in this text. Preface Numerical analysis is the branch of mathematics that is used to find approximations to difficult problems such as finding the roots of non−linear equations, integration involving complex expressions and solving differential equations for which analytical solutions do not exist. It is applied to a wide variety of disciplines such as business, all fields of engineering, computer science, education, geology, meteorology, and others. Years ago, high−speed computers did not exist, and if they did, the largest corporations could only afford them; consequently, the manual computation required lots of time and hard work. But now that computers have become indispensable for research work in science, engineering and other fields, numerical analysis has become a much easier and more pleasant task. This book is written primarily for students/readers who have a good background of high−school algebra, geometry, trigonometry, and the fundamentals of differential and integral calculus.* A prior knowledge of differential equations is desirable but not necessary; this topic is reviewed in Chapter 5. One can use Fortran, Pascal, C, or Visual Basic or even a spreadsheet to solve a difficult problem. It is the opinion of this author that the best applications programs for solving engineering problems are 1) MATLAB which is capable of performing advanced mathematical and engineering computations, and 2) the Microsoft Excel spreadsheet since the versatility offered by spreadsheets have revolutionized the personal computer industry. We will assume that the reader has no prior knowledge of MATLAB and limited familiarity with Excel. We intend to teach the student/reader how to use MATLAB via practical examples and for detailed explanations he/she will be referred to an Excel reference book or the MATLAB User’s Guide. The MATLAB commands, functions, and statements used in this text can be executed with either MATLAB Student Version 12 or later. Our discussions are based on a PC with Windows XP platforms but if you have another platform such as Macintosh, please refer to the appropriate sections of the MATLAB’s User Guide that also contains instructions for installation. MATLAB is an acronym for MATrix LABoratory and it is a very large computer application which is divided to several special application fields referred to as toolboxes. In this book we will be using the toolboxes furnished with the Student Edition of MATLAB. As of this writing, the latest release is MATLAB Student Version Release 14 and includes SIMULINK which is a * These topics are discussed in Mathematics for Business, Science, and Technology, Third Edition, ISBN 0−9709511− 0−8. This text includes probability and other advanced topics which are supplemented by many practical applications using Microsoft Excel and MATLAB. software package used for modeling, simulating, and analyzing dynamic systems. SIMULINK is not discussed in this text; the interested reader may refer to Introduction to Simulink with Engineering Applications, ISBN 0−9744239−7−1. Additional information including purchasing the software may be obtained from The MathWorks, Inc., 3 Apple Hill Drive, Natick, MA 01760−2098. Phone: 508 647−7000, Fax: 508 647−7001, e−mail: [email protected] and web site http://www.mathworks.com. The author makes no claim to originality of content or of treatment, but has taken care to present definitions, statements of physical laws, theorems, and problems. Chapter 1 is an introduction to MATLAB. The discussion is based on MATLAB Student Version 5 and it is also applicable to Version 6. Chapter 2 discusses root approximations by numerical methods. Chapter 3 is a review of sinusoids and complex numbers. Chapter 4 is an introduction to matrices and methods of solving simultaneous algebraic equations using Excel and MATLAB. Chapter 5 is an abbreviated, yet practical introduction to differential equations, state variables, state equations, eigenvalues and eigenvectors. Chapter 6 discusses the Taylor and Maclaurin series. Chapter 7 begins with finite differences and interpolation methods. It concludes with applications using MATLAB. Chapter 8 is an introduction to linear and parabolic regression. Chapters 9 and 10 discuss numerical methods for differentiation and integration respectively. Chapter 11 is a brief introduction to difference equations with a few practical applications. Chapters 12 is devoted to partial fraction expansion. Chapters 13, 14, and 15 discuss certain interesting functions that find wide application in science, engineering, and probability. This text concludes with Chapter 16 which discusses three popular optimization methods. New to the Third Edition This is an extensive revision of the first edition. The most notable changes are the inclusion of Fourier series, orthogonal functions and factorization methods, and the solutions to all end−of− chapter exercises. It is in response to many readers who expressed a desire to obtain the solutions in order to check their solutions to those of the author and thereby enhancing their knowledge. Another reason is that this text is written also for self−study by practicing engineers who need a review before taking more advanced courses such as digital image processing. The author has prepared more exercises and they are available with their solutions to those instructors who adopt this text for their class. Another change is the addition of a rather comprehensive summary at the end of each chapter. Hopefully, this will be a valuable aid to instructors for preparation of view foils for presenting the material to their class. The last major change is the improvement of the plots generated by the latest revisions of the MATLAB® Student Version, Release 14. Orchard Publications Fremont, California www.orchardpublications.com [email protected] Table of Contents 1 Introduction to MATLAB 1−1 1.1 Command Window.................................................................................................1−1 1.2 Roots of Polynomials...............................................................................................1−3 1.3 Polynomial Construction from Known Roots........................................................1−4 1.4 Evaluation of a Polynomial at Specified Values.....................................................1−5 1.5 Rational Polynomials..............................................................................................1−8 1.6 Using MATLAB to Make Plots..............................................................................1−9 1.7 Subplots.................................................................................................................1−18 1.8 Multiplication, Division and Exponentiation.......................................................1−19 1.9 Script and Function Files......................................................................................1−26 1.10 Display Formats....................................................................................................1−31 1.11 Summary...............................................................................................................1−33 1.12 Exercises................................................................................................................1−37 1.13 Solutions to End−of−Chapter Exercises...............................................................1−38 MATLAB Computations: Entire chapter 2 Root Approximations 2−1 2.1 Newton’s Method for Root Approximation...........................................................2−1 2.2 Approximations with Spreadsheets........................................................................2−7 2.3 The Bisection Method for Root Approximation.................................................2−19 2.4 Summary...............................................................................................................2−27 2.5 Exercises...............................................................................................................2−28 2.6 Solutions to End−of−Chapter Exercises...............................................................2−29 MATLAB Computations: Pages 2−2 through 2−7, 2−14, 2−21 through 2−23, 2−29 through 2−34 Excel Computations: Pages 2−8 through 2−19, 2−24 through 2−26 3 Sinusoids and Phasors 3−1 3.1 Alternating Voltages and Currents........................................................................3−1 3.2 Characteristics of Sinusoids....................................................................................3−2 3.3 Inverse Trigonometric Functions.........................................................................3−10 3.4 Phasors..................................................................................................................3−10 3.5 Addition and Subtraction of Phasors...................................................................3−11 3.6 Multiplication of Phasors......................................................................................3−12 3.7 Division of Phasors...............................................................................................3−13 Numerical Analysis Using MATLAB® and Excel®, Third Edition i Copyright © Orchard Publications 3.8 Exponential and Polar Forms of Phasors..............................................................3−13 3.9 Summary...............................................................................................................3−24 3.10 Exercises................................................................................................................3−27 3.11 Solutions to End−of−Chapter Exercises................................................................3−28 MATLAB Computations: Pages 3−15 through 3−23, 3−28 through 3−31 Simulink Modeling: Pages 3−16 through 3−23 4 Matrices and Determinants 4−1 4.1 Matrix Definition.....................................................................................................4−1 4.2 Matrix Operations...................................................................................................4−2 4.3 Special Forms of Matrices........................................................................................4−5 4.4 Determinants...........................................................................................................4−9 4.5 Minors and Cofactors............................................................................................4−13 4.6 Cramer’s Rule........................................................................................................4−18 4.7 Gaussian Elimination Method...............................................................................4−20 4.8 The Adjoint of a Matrix........................................................................................4−22 4.9 Singular and Non−Singular Matrices....................................................................4−22 4.10 The Inverse of a Matrix.........................................................................................4−23 4.11 Solution of Simultaneous Equations with Matrices..............................................4−25 4.12 Summary................................................................................................................4−32 4.13 Exercises................................................................................................................4−36 4.14 Solutions to End−of−Chapter Exercises................................................................4−38 MATLAB Computations: Pages 4−3, 4−5 through 4−8, 4−10, 4−12, 4−3, 4−5, 4−19 through 4−20, 4−24, 4−26, 4−28, 4−30, 4−38, 4−41, 4−43 Excel Computations: Pages 4−28 through 4−29, 4−42 through 4−43 5 Differential Equations, State Variables, and State Equations 5−1 5.1 Simple Differential Equations..................................................................................5−1 5.2 Classification............................................................................................................5−2 5.3 Solutions of Ordinary Differential Equations (ODE).............................................5−6 5.4 Solution of the Homogeneous ODE...................................................................... 5−8 5.5 Using the Method of Undetermined Coefficients for the Forced Response........ 5−10 5.6 Using the Method of Variation of Parameters for the Forced Response............. 5−20 5.7 Expressing Differential Equations in State Equation Form.................................. 5−24 5.8 Solution of Single State Equations....................................................................... 5−27 5.9 The State Transition Matrix................................................................................ 5−28 5.10 Computation of the State Transition Matrix...................................................... 5−30 5.11 Eigenvectors.......................................................................................................... 5−38 5.12 Summary.............................................................................................................. 5−42 ii Numerical Analysis Using MATLAB® and Excel®, Third Edition Copyright © Orchard Publications 5.13 Exercises............................................................................................................... 5−47 5.14 Solutions to End−of−Chapter Exercises............................................................... 5−49 MATLAB Computations: Pages 5−11, 5−13 through 5−14, 5−16 through 5−17, 5−19, 5−23, 5−33 through 5−35, 5−37, 5−49 through 5−53, 5−55 6 Fourier, Taylor, and Maclaurin Series 6−1 6.1 Wave Analysis........................................................................................................6−1 6.2 Evaluation of the Coefficients ...............................................................................6−2 6.3 Symmetry ...............................................................................................................6−7 6.4 Waveforms in Trigonometric Form of Fourier Series .........................................6−12 6.5 Alternate Forms of the Trigonometric Fourier Series .........................................6−25 6.6 The Exponential Form of the Fourier Series .......................................................6−29 6.7 Line Spectra .........................................................................................................6−33 6.8 Numerical Evaluation of Fourier Coefficients .....................................................6−36 6.9 Power Series Expansion of Functions ..................................................................6−40 6.10 Taylor and Maclaurin Series ................................................................................6−41 6.11 Summary ..............................................................................................................6−48 6.12 Exercises ..............................................................................................................6−51 6.13 Solutions to End−of−Chapter Exercises ..............................................................6−53 MATLAB Computations: Pages 6−35, 6−45, 6−58 through 6−61 Excel Computations: Pages 6−37 through 6−39 7 Finite Differences and Interpolation 7−1 7.1 Divided Differences ...............................................................................................7−1 7.2 Factorial Polynomials .............................................................................................7−6 7.3 Antidifferences ...................................................................................................7−12 7.4 Newton’s Divided Difference Interpolation Method .........................................7−15 7.5 Lagrange’s Interpolation Method ........................................................................7−17 7.6 Gregory−Newton Forward Interpolation Method ..............................................7−19 7.7 Gregory−Newton Backward Interpolation Method ...........................................7−21 7.8 Interpolation with MATLAB .............................................................................7−24 7.9 Summary .............................................................................................................7−39 7.10 Exercises .............................................................................................................7−44 7.11 Solutions to End−of−Chapter Exercises .............................................................7−45 MATLAB Computations: Pages 7−8 through 7−9, 7−13 through 7−15, 7−26 through 7−38, 7−45 through 7−46, 7−48, 7−50, 7−52 Excel Computations: Pages 7−17 through 7−19, 7−22 through 7−25, 7−49, 7−52 Numerical Analysis Using MATLAB® and Excel®, Third Edition iii Copyright © Orchard Publications 8 Linear and Parabolic Regression 8−1 8.1 Curve Fitting ..........................................................................................................8−1 8.2 Linear Regression ...................................................................................................8−2 8.3 Parabolic Regression ..............................................................................................8−7 8.4 Regression with Power Series Approximations ....................................................8−14 8.5 Summary ..............................................................................................................8−24 8.6 Exercises ...............................................................................................................8−26 8.7 Solutions to End−of−Chapter Exercises ...............................................................8−28 MATLAB Computations: Pages 8−11 through 8−14, 8−17 through 8−23, 8−30 through 8−34 Excel Computations: Pages 8−5 through 8−10, 8−15 through 8−19, 8−28 through 8−32 9 Solution of Differential Equations by Numerical Methods 9−1 9.1 Taylor Series Method ............................................................................................9−1 9.2 Runge−Kutta Method ............................................................................................9−5 9.3 Adams’ Method ...................................................................................................9−13 9.4 Milne’s Method ....................................................................................................9−15 9.5 Summary ..............................................................................................................9−17 9.6 Exercises ..............................................................................................................9−20 9.7 Solutions to End−of−Chapter Exercises ..............................................................9−21 MATLAB Computations: Pages 9−5, 9−9 through 9−12, 9−21 through 9−23 Excel Computations: Page 9−2, 9−14, 9−22 through 9−26 10 Integration by Numerical Methods 10−1 10.1 The Trapezoidal Rule ..........................................................................................10−1 10.2 Simpson’s Rule .....................................................................................................10−6 10.3 Summary ............................................................................................................10−14 10.4 Exercises ............................................................................................................10−15 10.5 Solution to End−of−Chapter Exercises ..............................................................10−16 MATLAB Computations: Pages 10−3 through 10−6, 10−9 through 10−13, 10−16, 10−18 through 10−21 Excel Computations: Pages 10−10, 10−19 through 10−21 11 Difference Equations 11−1 11.1 Introduction .........................................................................................................11−1 11.2 Definition, Solutions, and Applications ..............................................................11−1 11.3 Fibonacci Numbers ..............................................................................................11−7 iv Numerical Analysis Using MATLAB® and Excel®, Third Edition Copyright © Orchard Publications