Exploring the DataFlow Supercomputing Paradigm: Example Algorithms for Selected Applications

318 Pages·2019·11.99 MB·English

by  Veljko Milutinovic, Milos Kotlar

Computer Communications and Networks
Veljko Milutinovic
Milos Kotlar Editors
Exploring the
DataFlow
Supercomputing
Paradigm
Example Algorithms for Selected
Applications
Computer Communications and Networks
Series Editors
Jacek Rak, Department of Computer Communications, Faculty of Electronics,
Telecommunications and Informatics, Gdansk University of Technology,
Gdansk, Poland
A.J. Sammes, Cyber Security Centre, Faculty of Technology,
De Montfort University, Leicester, UK
Editorial Board Members
Burak Kantarci , School of Electrical Engineering and Computer Science,
University of Ottawa, Ottawa, ON, Canada
Eiji Oki, Graduate School of Informatics, Kyoto University, Kyoto, Japan
Adrian Popescu, Department of Computer Science and Engineering, Blekinge
Institute of Technology, Karlskrona, Sweden
Gangxiang Shen, School of Electronic and Information Engineering, Soochow
University, Suzhou, China
The Computer Communications and Networks series is a range of textbooks,
monographs and handbooks. It sets out to provide students, researchers, and
non-specialists alike with a sure grounding in current knowledge, together with
comprehensibleaccesstothelatestdevelopmentsincomputercommunicationsand
networking.
Emphasisisplacedonclearandexplanatorystylesthatsupportatutorialapproach,
so that even the most complex of topics is presented in a lucid and intelligible
manner.
More information about this series at http://www.springer.com/series/4198
Veljko Milutinovic Milos Kotlar
(cid:129)
Editors
Exploring the DataFlow
Supercomputing Paradigm
Example Algorithms for Selected
Applications
123
Editors
VeljkoMilutinovic MilosKotlar
Indiana University Schoolof Electrical Engineering
Bloomington,IN, USA University of Belgrade
Belgrade, Serbia
ISSN 1617-7975 ISSN 2197-8433 (electronic)
Computer Communications andNetworks
ISBN978-3-030-13802-8 ISBN978-3-030-13803-5 (eBook)
https://doi.org/10.1007/978-3-030-13803-5
LibraryofCongressControlNumber:2019931864
©SpringerNatureSwitzerlandAG2019
Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpart
of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations,
recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission
orinformationstorageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilar
methodologynowknownorhereafterdeveloped.
The use of general descriptive names, registered names, trademarks, service marks, etc. in this
publicationdoesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfrom
therelevantprotectivelawsandregulationsandthereforefreeforgeneraluse.
The publisher, the authors and the editors are safe to assume that the advice and information in this
book are believed to be true and accurate at the date of publication. Neither the publisher nor the
authorsortheeditorsgiveawarranty,expressorimplied,withrespecttothematerialcontainedhereinor
for any errors or omissions that may have been made. The publisher remains neutral with regard to
jurisdictionalclaimsinpublishedmapsandinstitutionalaffiliations.
ThisSpringerimprintispublishedbytheregisteredcompanySpringerNatureSwitzerlandAG
Theregisteredcompanyaddressis:Gewerbestrasse11,6330Cham,Switzerland
Preface
Instead of having here a traditional preface, we decided to ask some specific
questions and to answer them in a way that widens the dataflow horizons of
interested readers.
1. Why is this book different from others?
When it comes to mapping of algorithms onto the dataflow architecture, this book
contains algorithms not covered in previous books.
2. Where to find more algorithms?
When it comes to the mapping of algorithms onto the dataflow architecture, one
could find more algorithms in the previous books of the same publisher.
3. What Alibaba said about artificial intelligence?
In a recent public memo, Alibaba of China said that FPGAs (dataflow) is better
suited for artificial intelligence, compared to GPUs (control-flow).
4. What Intel said about artificial intelligence?
The recent claims of Intel state the same as above, meaning that the major ICT
businessesworldwideareunisoniconthegreatpotentialsofthedataflowparadigm.
5. Why is the programming model of this book corresponding to the pro-
gramming model of a future Intel chip?
TherecentIntel’spatentreflectstheprogrammingmodelusedindataflowmachines
ofMaxelerTechnologies,whichisusedinthisbook,andinthepastSpringerbooks
of the same editors.
6. Where the editors of this book used the related materials in their teaching
so far, worldwide?
The previous books of this publisher were used in official teaching and public
lecturesofoneorbotheditorsofthisbook;apartiallistofuniversities,companies,
research labs, and government institutions is a pretty long one: MIT, Harvard,
v
vi Preface
Boston, NEU, Dartmouth, University of Massachusetts at Amherst, USC, UCLA,
Columbia, NYU, Princeton, NJIT, CMU, Temple, Purdue, IU, UIUC, Michigan,
Wisconsin,Minnesota,FAU,FIU,Miami,CentralFlorida,UniversityofAlabama,
University of Kentucky, GeorgiaTech, Ohio State, Imperial, King’s, Manchester,
Huddersfield, Cambridge, Oxford, Dublin, Cork, Cardiff, Edinburgh, EPFL, ETH,
TUWIEN,UNIWIE,Graz,Linz,Karlsruhe,Stuttgart,Bonn,Frankfurt,Heidelberg,
Aachen, Darmstadt, Dortmund, KTH, Uppsala, Karlskrona, Karlstad, Napoli,
Salerno,Siena,Pisa,Barcelona,Madrid,Valencia,Oviedo,Ankara,Bogazici,Koc,
Istanbul, Technion, Haifa, Bersheba, Eilat, etc. Also at the World Bank in
WashingtonDC,IMF,theTelenorBankofNorway,theRaiffeisenBankofAustria,
Brookhaven National Laboratory, Lawrence Livermore National Laboratory,
IBM TJ Watson, HP Encore Labs, Intel Oregon, Qualcomm VP, NCR, RCA,
Fairchild, Honeywell, Yahoo NY, Google CA, Microsoft, Finsoft, ABB Zurich,
Oracle Zurich, and many other industrial labs, as well as at Tsinghua University,
Shandong, NIS of Singapore, NTU of Singapore, Tokyo, Sendai, Seoul, Pusan,
Sydney University of Technology, University of Sydney, Hobart, Auckland,
Toronto, Montreal, Durango, MontereyTech, Cuernavaca, UNAM, etc.
Bloomington, Indiana, USA Veljko Milutinovic
March 2019 Milos Kotlar
Contents
Part I Theoretical Issues
1 Method of Big-Graph Partitioning Using a Skeleton Graph . . . . . . 3
Iztok Savnik and Kiyoshi Nitta
2 On Cloud-Supported Web-Based Integrated Development
Environment for Programming DataFlow Architectures . . . . . . . . . 41
Nenad Korolija and Aleš Zamuda
Part II Applications in Mathematics
3 Minimization and Maximization of Functions:
Golden-Section Search in One Dimension . . . . . . . . . . . . . . . . . . . . 55
Dragana Pejic and Milos Arsic
4 Matrix-Based Algorithms for DataFlow Computer Architecture:
An Overview and Comparison. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Jurij Mihelič and Uroš Čibej
5 Application of Maxeler DataFlow Supercomputing to Spherical
Code Design. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133
Ivan Stanojević, Mladen Kovačević and Vojin Šenk
Part III Applications in Image Understanding, Biomedicine,
Physics Simulation, and Business
6 Face Recognition Using Maxeler DataFlow . . . . . . . . . . . . . . . . . . . 171
Tijana Sustersic, Aleksandra Vulovic, Nemanja Trifunovic,
Ivan Milankovic and Nenad Filipovic
7 Biomedical Images Processing Using Maxeler DataFlow
Engines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 197
Aleksandar S. Peulic, Ivan Milankovic, Nikola V. Mijailovic
and Nenad Filipovic
vii
viii Contents
8 An Overview of Selected DataFlow Applications in Physics
Simulations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 229
Nenad Korolija and Roman Trobec
9 Bitcoin Mining Using Maxeler DataFlow Computers. . . . . . . . . . . . 241
Rok Meden and Anton Kos
Index.... .... .... .... .... ..... .... .... .... .... .... ..... .... 313
Contributors
Milos Arsic Faculty of Mathematics, University of Belgrade, Belgrade, Serbia
Uroš Čibej Faculty of Computer and Information Science, University of
Ljubljana, Ljubljana, Slovenia
Nenad Filipovic Faculty of Engineering, University of Kragujevac, Kragujevac,
Serbia;
Research and Development Center for Bioengineering (BioIRC), Kragujevac,
Serbia
Nenad Korolija School of Electrical Engineering, University of Belgrade,
Belgrade, Serbia
Anton Kos Faculty of Electrical Engineering, University of Ljubljana, Ljubljana,
Slovenia
MladenKovačević DepartmentofElectricalandComputerEngineering,National
University of Singapore, Singapore, Singapore
RokMeden FacultyofElectricalEngineering,UniversityofLjubljana,Ljubljana,
Slovenia
Jurij Mihelič Faculty of Computer and Information Science, University of
Ljubljana, Ljubljana, Slovenia
Nikola V. Mijailovic Faculty of Engineering, University of Kragujevac,
Kragujevac, Serbia;
Research and Development Center for Bioengineering (BioIRC), Kragujevac,
Serbia
Ivan Milankovic Faculty of Engineering, University of Kragujevac, Kragujevac,
Serbia;
Research and Development Center for Bioengineering (BioIRC), Kragujevac,
Serbia
Kiyoshi Nitta Yahoo Japan Corporation, Tokyo, Japan
ix