Advances in Time Series Forecasting (Volume 2) Edited by Cagdas Hakan Aladag Department of Mechanical and Industrial Engineering, University of Toronto, Canada Department of Statistics, Hacettepe University, Turkey Advances in Time Series Forecasting Volume # 2 Editor: Cagdas Hakan Aladag ISSN (Online): 2543-280X ISSN (Print): 2543-2796 ISBN (Online): 978-1-68108-528-9 ISBN (Print): 978-1-68108-529-6 ©2017, Bentham eBooks Imprint. Published By Bentham Science Publishers – Sharjah, UAE. All Rights Reserved. BENTHAM SCIENCE PUBLISHERS LTD. End User License Agreement (for non-institutional, personal use) This is an agreement between you and Bentham Science Publishers Ltd. Please read this License Agreement carefully before using the ebook/echapter/ejournal (“Work”). Your use of the Work constitutes your agreement to the terms and conditions set forth in this License Agreement. If you do not agree to these terms and conditions then you should not use the Work. Bentham Science Publishers agrees to grant you a non-exclusive, non-transferable limited license to use the Work subject to and in accordance with the following terms and conditions. This License Agreement is for non-library, personal use only. For a library / institutional / multi user license in respect of the Work, please contact: [email protected]. Usage Rules: 1. All rights reserved: The Work is the subject of copyright and Bentham Science Publishers either owns the Work (and the copyright in it) or is licensed to distribute the Work. You shall not copy, reproduce, modify, remove, delete, augment, add to, publish, transmit, sell, resell, create derivative works from, or in any way exploit the Work or make the Work available for others to do any of the same, in any form or by any means, in whole or in part, in each case without the prior written permission of Bentham Science Publishers, unless stated otherwise in this License Agreement. 2. You may download a copy of the Work on one occasion to one personal computer (including tablet, laptop, desktop, or other such devices). You may make one back-up copy of the Work to avoid losing it. The following DRM (Digital Rights Management) policy may also be applicable to the Work at Bentham Science Publishers’ election, acting in its sole discretion: l 25 ‘copy’ commands can be executed every 7 days in respect of the Work. The text selected for copying cannot extend to more than a single page. Each time a text ‘copy’ command is executed, irrespective of whether the text selection is made from within one page or from separate pages, it will be considered as a separate / individual ‘copy’ command. l 25 pages only from the Work can be printed every 7 days. 3. The unauthorised use or distribution of copyrighted or other proprietary content is illegal and could subject you to liability for substantial money damages. You will be liable for any damage resulting from your misuse of the Work or any violation of this License Agreement, including any infringement by you of copyrights or proprietary rights. Disclaimer: Bentham Science Publishers does not guarantee that the information in the Work is error-free, or warrant that it will meet your requirements or that access to the Work will be uninterrupted or error-free. The Work is provided "as is" without warranty of any kind, either express or implied or statutory, including, without limitation, implied warranties of merchantability and fitness for a particular purpose. The entire risk as to the results and performance of the Work is assumed by you. No responsibility is assumed by Bentham Science Publishers, its staff, editors and/or authors for any injury and/or damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods, products instruction, advertisements or ideas contained in the Work. Limitation of Liability: In no event will Bentham Science Publishers, its staff, editors and/or authors, be liable for any damages, including, without limitation, special, incidental and/or consequential damages and/or damages for lost data and/or profits arising out of (whether directly or indirectly) the use or inability to use the Work. The entire liability of Bentham Science Publishers shall be limited to the amount actually paid by you for the Work. General: 1. Any dispute or claim arising out of or in connection with this License Agreement or the Work (including non-contractual disputes or claims) will be governed by and construed in accordance with the laws of the U.A.E. as applied in the Emirate of Dubai. Each party agrees that the courts of the Emirate of Dubai shall have exclusive jurisdiction to settle any dispute or claim arising out of or in connection with this License Agreement or the Work (including non-contractual disputes or claims). 2. Your rights under this License Agreement will automatically terminate without notice and without the need for a court order if at any point you breach any terms of this License Agreement. In no event will any delay or failure by Bentham Science Publishers in enforcing your compliance with this License Agreement constitute a waiver of any of its rights. 3. You acknowledge that you have read this License Agreement, and agree to be bound by its terms and conditions. To the extent that any other terms and conditions presented on any website of Bentham Science Publishers conflict with, or are inconsistent with, the terms and conditions set out in this License Agreement, you acknowledge that the terms and conditions set out in this License Agreement shall prevail. Bentham Science Publishers Ltd. Executive Suite Y - 2 PO Box 7917, Saif Zone Sharjah, U.A.E. Email: [email protected] CONTENTS PREFACE ................................................................................................................................................ i LIST OF CONTRIBUTORS .................................................................................................................. i(cid:76)(cid:76) CHAPTER 1 FUZZY TIME SERIES FORECASTING MODELS EVALUATION BASED ON A NOVEL DISTANCE MEASURE ...................................................................................................... 1 Cagdas Hakan Aladag (cid:68)(cid:81)(cid:71) I. Burhan Turksen INTRODUCTION .......................................................................................................................... 1 THE PROPOSED DISTANCE MEASURE AND THE SUGGESTED PERFORMANCE CRITERION ................................................................................................................................... 5 THE APPLICATION ..................................................................................................................... 10 CONCLUDING REMARKS ......................................................................................................... 19 CONFLICT OF INTEREST ......................................................................................................... 21 ACKNOWLEDGEMENTS ........................................................................................................... 21 REFERENCES ............................................................................................................................... 21 CHAPTER 2 A NEW FUZZY TIME SERIES FORECASTING MODEL WITH NEURAL NETWORK STRUCTURE .................................................................................................................... 24 Eren Bas (cid:68)(cid:81)(cid:71) Erol Egrioglu INTRODUCTION .......................................................................................................................... 24 PROPOSED METHOD ................................................................................................................. 26 APPLICATION .............................................................................................................................. 30 CONCLUSIONS AND DISCUSSIONS ........................................................................................ 32 CONFLICT OF INTEREST ......................................................................................................... 32 ACKNOWLEDGEMENTS ........................................................................................................... 33 REFERENCES ............................................................................................................................... 33 CHAPTER 3 TWO FACTORS HIGH ORDER NON SINGLETON TYPE-1 AND INTERVAL TYPE-2 FUZZY SYSTEMS FOR FORECASTING TIME SERIES WITH GENETIC ALGORITHM ......................................................................................................................................... 37 M.H. Fazel Zarandi, M. Yalinezhaad (cid:68)(cid:81)(cid:71) I.B. Turksen INTRODUCTION .......................................................................................................................... 37 Interval Type-2 Fuzzy Logic Sets and Systems ...................................................................... 40 Type-2 Fuzzy Logic Sets ........................................................................................................ 40 Non Singleton Interval Type-2 Fuzzy Logic Systems ............................................................ 42 Determination of Footprints of Uncertainty (Umf and Lmf) in Interval Type-2 Fuzzy Logic Sets .......................................................................................................................................... 43 Fundamental Concepts of Fuzzy Time Series ........................................................................ 45 Proposed Two Factors High Order Non Singletontype-1 and Interval Type-2 Fuzzy Time Series Systems ........................................................................................................................ 45 Tuning Method for Type-1 and Interval Type-2 FTSs with Genetic Algorithm .................... 48 Experimental Results by Temperature Prediction and TAIEX Forecasting ........................... 50 Temperature Prediction with Proposed Method ........................................................... 50 TAIEX Forecasting By Applying the Proposed Method with Genetic Algorithm ................. 61 GA Procedure .......................................................................................................................... 68 Selection and Pairing .............................................................................................................. 69 Crossover ................................................................................................................................ 69 Mutation and Reinsertion ........................................................................................................ 69 Termination Condition ............................................................................................................ 69 Type Reduction and Defuzzification ...................................................................................... 69 CONCLUSION AND FUTURE WORKS .................................................................................... 73 CONFLICT OF INTEREST ......................................................................................................... 73 ACKNOWLEDGEMENTS ........................................................................................................... 73 REFERENCES ............................................................................................................................... 73 CHAPTER 4 A NEW NEURAL NETWORK MODEL WITH DETERMINISTIC TREND AND SEASONALITY COMPONENTS FOR TIME SERIES FORECASTING ...................................... 76 Erol Egrioglu, Cagdas Hakan Aladag, Ufuk Yolcu, Eren Bas (cid:68)(cid:81)(cid:71) Ali Z. Dalar INTRODUCTION .......................................................................................................................... 76 CLASSICAL TIME SERIES FORECASTING MODELS ........................................................ 77 ARTIFICIAL NEURAL NETWORKS FOR FORECASTING TIME SERIES ..................... 80 A NEW ARTIFICIAL NEURAL NETWORK WITH DETERMINISTIC COMPONENTS 85 APPLICATIONS ............................................................................................................................ 89 CONCLUSION ............................................................................................................................... 91 CONFLICT OF INTEREST ......................................................................................................... 91 ACKNOWLEDGEMENTS ........................................................................................................... 92 REFERENCES ............................................................................................................................... 92 CHAPTER 5 A FUZZY TIME SERIES APPROACH BASED ON GENETIC ALGORITHM WITH SINGLE ANALYSIS PROCESS ............................................................................................... 93 Ozge Cagcag Yolcu INTRODUCTION .......................................................................................................................... 93 FUZZY TIME SERIES .................................................................................................................. 96 RELATED METHODS .................................................................................................................. 97 Genetic Algorithm (GA) ......................................................................................................... 97 Single Multiplicative Neuron Model ...................................................................................... 98 PROPOSED METHOD ................................................................................................................. 100 APPLICATIONS ............................................................................................................................ 104 CONCLUSION AND DISCUSSION ............................................................................................ 107 CONFLICT OF INTEREST ......................................................................................................... 107 ACKNOWLEDGEMENTS ........................................................................................................... 107 REFERENCES ............................................................................................................................... 107 CHAPTER 6 FORECASTING STOCK EXCHANGES WITH FUZZY TIME SERIES APPROACH BASED ON MARKOV CHAIN TRANSITION MATRIX ......................................... 111 Cagdas Hakan Aladag (cid:68)(cid:81)(cid:71) Hilal Guney INTRODUCTION .......................................................................................................................... 111 FUZZY TIME SERIES .................................................................................................................. 113 TSAUR ‘S FUZZY TIME SERIES MARKOV CHAIN MODEL ............................................. 114 THE IMPLEMENTATION ........................................................................................................... 117 CONCLUSION ............................................................................................................................... 124 CONFLICT OF INTEREST ......................................................................................................... 124 ACKNOWLEDGEMENTS ........................................................................................................... 124 REFERENCES ............................................................................................................................... 124 CHAPTER 7 A NEW HIGH ORDER MULTIVARIATE FUZZY TIME SERIES FORECASTING MODEL ...................................................................................................................... 127 Ufuk Yolcu INTRODUCTION .......................................................................................................................... 127 RELATED METHODOLOGY ..................................................................................................... 129 The Fuzzy C-Means (FCM) Clustering Method ..................................................................... 129 Single Multiplicative Neuron Model Artificial Neural Network (SMN-ANN) ..................... 130 Fuzzy Time Series ................................................................................................................... 131 THE PROPOSED METHOD ........................................................................................................ 133 APPLICATIONS ............................................................................................................................ 136 CONCLUSIONS AND DISCUSSION .......................................................................................... 140 CONFLICT OF INTEREST ......................................................................................................... 140 ACKNOWLEDGEMENTS ........................................................................................................... 141 REFERENCES ............................................................................................................................... 141 CHAPTER 8 FUZZY FUNCTIONS APPROACH FOR TIME SERIES FORECASTING ......... 144 Ali Z. Dalar, Erol Egrioglu, Ufuk Yolcu (cid:68)(cid:81)(cid:71) Cagdas Hakan Aladag INTRODUCTION .......................................................................................................................... 144 TYPE-1 FUZZY FUNCTIONS APPROACH .............................................................................. 146 IMPLEMENTATION .................................................................................................................... 148 Australian Beer Consumption Time Series ............................................................................. 148 Turkey Electricity Consumption Time Series ......................................................................... 151 CONCLUSIONS ............................................................................................................................. 153 CONFLICT OF INTEREST ......................................................................................................... 153 ACKNOWLEDGEMENTS ........................................................................................................... 153 REFERENCES ............................................................................................................................... 153 CHAPTER 9 RECURRENT ANFIS FOR TIME SERIES FORECASTING ................................. 156 Busenur Sarıca, Erol Eğrioğlu (cid:68)(cid:81)(cid:71) Barış Aşıkgil INTRODUCTION .......................................................................................................................... 156 RECURRENT ADAPTIVE NETWORK FUZZY INFERENCE SYSTEMS .......................... 157 APPLICATION .............................................................................................................................. 160 CONCLUSION ............................................................................................................................... 163 CONFLICT OF INTEREST ......................................................................................................... 163 ACKNOWLEDGEMENTS ........................................................................................................... 163 REFERENCES ............................................................................................................................... 163 CHAPTER 10 A HYBRID METHOD FOR FORECASTING OF FUZZY TIME SERIES ......... 165 Eren Bas INTRODUCTION .......................................................................................................................... 165 THE METHODS USED IN THIS STUDY .................................................................................. 166 Fuzzy Time Series ................................................................................................................... 166 Genetic Algorithm .................................................................................................................. 167 Differential Evolution Algorithm ........................................................................................... 167 PROPOSED METHOD ................................................................................................................. 168 APPLICATION .............................................................................................................................. 171 Analysis of Canadian Lynx Data ............................................................................................ 172 CONCLUSIONS ............................................................................................................................. 173 CONFLICT OF INTEREST ......................................................................................................... 173 ACKNOWLEDGEMENTS ........................................................................................................... 173 REFERENCES ............................................................................................................................... 173 SUBJECT INDEX .................................................................................................................................. (cid:20)(cid:26)(cid:26) i PREFACE Human interest in the future can be traced back to prehistoric times. People have always wanted to see what can happen in the future. The future is unknown and mysterious. People have always tried to solve the mystery of the future by using different ways for profit, fame, power or just curiosity sake. Today forecasting is a multibillion dollar industry. All economic publications publish many economic forecasting studies; political writers proclaim on political trends and forthcoming government policies; stockbrokers and financial experts predict stock market trends, when to buy, and what stocks to choose; and many other examples can be given which have application to other fields. Before making plans or making decisions, an estimate must be made of what conditions will exist over some future period. It is a well-known fact that there is uncertainty about the future. In order to predict to future by dealing with this uncertainty, forecasting is performed. At the present time, forecasting is a challenge which has to be overcome in many fields of application. Forecasting can be considered as a process of using various tools and techniques. Many methods for forecasting the future have been proposed in the literature over the past few decades because of the importance of this popular topic. One way to forecast the future is to use time series analysis. There have been many time series forecasting approaches in the literature. It is possible to divide these approaches into two subclasses which are conventional and advanced forecasting methods. Since conventional approaches such as Box-Jenkins methods has some restrictions such as some assumptions, they cannot always produce reliable forecasts for real world time series. Furthermore, conventional approaches cannot model some real world time series because of the specific characteristic of data. Advanced methods such as neural networks, fuzzy time series, or hybrid approaches have been recently used in many applications in order to deal with these restrictions arising from conventional methods and to get more reliable forecasts. Most of the time, these approaches have been competed to each other. On the other hand, it should be noted that these approaches are complementary rather than competitive. For example, hybrid approaches are very effective forecasting tools. And, these approaches sometimes combine conventional and advanced forecasting methods. The book intends to be a valuable source of recent knowledge about advanced time series forecasting techniques. New capable advanced forecasting frameworks are discussed and their applicability is shown. The book includes applications of some powerful recent forecasting approaches to real world time series. Besides recent advanced forecasting methods, new efficient forecasting methods are firstly introduced in the book. The readers can find useful information about advanced time series forecasting, as well as its application to real-life problems in various domains. I hope the materials covered in this book, provided by the respectful scholars in the field, motivate and accelerate future progress and introduce new branches off the time series forecasting. In Chapter 1, Aladag and Turksen have introduced a new performance measure by defining a novel distance measure to evaluate forecasting performance of fuzzy time series. Bas and Egrioglu, in Chapter 2, have suggested a novel fuzzy time series forecasting approach that has a network structure. In Chapter 3, Zarandi et al. has discussed some Type-1 and Type-2 fuzzy time series forecasting models. Chapter 4, by Egrioglu et al., introduce a new neural network model including deterministic trend and seasonality components. In Chapter 5, Yolcu has presented a fuzzy time series method based on genetic algorithms. Aladag and Guney, in Chapter 6, have applied a fuzzy time series forecasting model based on Markov chain transition matrix to stock exchanges. In Cahapter 7, Yolcu has proposed a new high order multivariate fuzzy time series forecasting model. Chapter 8, by Dalar et al., has discussed a ii framework for using fuzzy functions in fuzzy time series forecasting. Sarica et al., in Chapter 9, have introduced Recurrent ANFIS model for time series forecasting. In Chapter 10, Bas has proposed a hybrid forecasting approach which combines genetic algorithms, differential evolution algorithms, and fuzzy time series. The editor would also like to express his sincere thanks to all authors for their valuable contributions. The editor would also like to acknowledge valuable assistance from Shehzad Naqvi from Bentham Science Publishers. Dr. Cagdas Hakan Aladag Knowledge/Intelligence Systems Laboratory, Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, Canada Department of Statistics, Faculty of Science, Hacettepe University, Ankara, Turkey