ebook img

Parallel Iterative Algorithms: From Sequential to Grid Computing (Chapman and Hall/CRC Numerical Analy and Scient Comp. Series) PDF

225 Pages·2007·0.914 MB·English
Most books are stored in the elastic cloud where traffic is expensive. For this reason, we have a limit on daily download.

Preview Parallel Iterative Algorithms: From Sequential to Grid Computing (Chapman and Hall/CRC Numerical Analy and Scient Comp. Series)

Description:
This book addresses a kind of computing that has become common, in terms of physical resources, but that has been difficult to exploit properly. It's not cluster computing, where processors tend to be homogeneous and communications have low latency. It's not the "SETI at home" model, with extreme heterogeneity and long latencies. Instead, it's the Grid model: long latencies between heterogeneous subnets, but cluster-like speeds within the subnet. This creates unique demands, but also addresses a number of other two-level systems beyond those the authors discuss. Synchronous algorithms work well within clusters, where communication latency lies below the computation time of one step on each node, and where each node can be expected to run at roughly the same speed as each other. Such algorithms have a fair literature of their own, and are addressed only in the prepratory chapters. Grid communication is different. Processor speeds lie in the nanosecond range these days. Intra-cluster communications range up many microseconds, and intercluster latencies range from milliseconds to seconds. The network of networks is a different beast, and this book addresses that strange creature. These authors address algorithms that expect to iterate repeatedly and an unpredictable number of times between communication with neighboring sub-problems. In particular, the authors address iterative solution of sparse linear systems - perhaps a loss of generality, but not a loss of practical value. They present their approaches methodically and rigorously - expect to go through this book slowly, and maybe even go back to Strang once in a while. They also address the fact that distributed determination of convergence is at least as demanding as distributed agreements of many other kinds. As an interesting bonus, the asynchronous algorithms also grant some degree of fault tolerance in the presence of intermittent communication failure, such as packet loss due to network congestion. This book's strengths, for me at least, lie in two areas. The first is its emphasis on pseudocode for critical algorithms - not cut&paste material, but clearly illustrative. The second lies in its progression from cluster-scale synchronous algorithms to Grid-scale asynchronous ones. This can also describe hardware-accelerated nodes within a cluster: fast communication with the accelerator, but orders of magnitude slower and less predictable communication betwee accelerated nodes. The absolute time scales and distances differ, but the ratios of local to non-local communication time and computation time hold up well. Only the most dedicated readers will invest the time and effort needed to extract this book's value. Those readers, however, will be richly rewarded. -- wiredweird
See more

The list of books you might like

book image

Do Epic Shit

Ankur warikoo
·2021
·1.28 MB

book image

Atomic Habits James Clear

JAMES CLEAR
·6.4 MB

book image

Carillon, [Spring 2006]

Oglethorpe University
·2006
·1.9 MB

book image

Calculus with analytic geometry

Simon Plouffe
·931 Pages
·2001
·48.94 MB

book image

Meet the Masters

Max Euwe
·151 Pages
·1945
·29.056 MB

book image

Economics: A Primer for India

G. Omkarnath
·286 Pages
·2016
·65.136 MB

book image

Greek Government Gazette: Part 4, 2006 no. 465

The Government of the Hellenic Republic
·2006
·0.72 MB

book image

Greek Government Gazette: Part 4, 2006 no. 502

The Government of the Hellenic Republic
·2006
·0.99 MB

book image

Greek Government Gazette: Part 4, 2006 no. 579

The Government of the Hellenic Republic
·2006
·2.3 MB

book image

Greek Government Gazette: Part 4, 2006 no. 544

The Government of the Hellenic Republic
·2006
·0.91 MB

book image

Greek Government Gazette: Part 4, 2006 no. 539

The Government of the Hellenic Republic
·2006
·1.3 MB

book image

Greek Government Gazette: Part 4, 2006 no. 569

The Government of the Hellenic Republic
·2006
·0.28 MB

book image

The Age of Miracles (ARC)

Walker Karen Thompson
·221 Pages
·2016
·0.99 MB