𝔖 Scriptorium
✦   LIBER   ✦

πŸ“

High Performance Networks: From Supercomputing to Cloud Computing

✍ Scribed by Dennis Abts


Publisher
Morgan & Claypool Publishers
Year
2010
Tongue
English
Leaves
116
Series
Synthesis Lectures on Computer Architecture
Edition
1
Category
Library

⬇  Acquire This Volume

No coin nor oath required. For personal study only.

✦ Synopsis


Datacenter networks provide the communication substrate for large parallel computer systems that form the ecosystem for high performance computing (HPC) systems and modern Internet applications. The design of new datacenter networks is motivated by an array of applications ranging from communication intensive climatology, complex material simulations and molecular dynamics to such Internet applications as Web search, language translation, collaborative Internet applications, streaming video and voice-over-IP. For both Supercomputing and Cloud Computing the network enables distributed applications to communicate and interoperate in an orchestrated and efficient way. This book describes the design and engineering tradeoffs of datacenter networks. It describes interconnection networks from topology and network architecture to routing algorithms, and presents opportunities for taking advantage of the emerging technology trends that are influencing router microarchitecture. With the emergence of "many-core" processor chips, it is evident that we will also need "many-port" routing chips to provide a bandwidth-rich network to avoid the performance limiting effects of Amdahl's Law. We provide an overview of conventional topologies and their routing algorithms and show how technology, signaling rates and cost-effective optics are motivating new network topologies that scale up to millions of hosts. The book also provides detailed case studies of two high performance parallel computer systems and their networks. Table of Contents: Introduction / Background / Topology Basics / High-Radix Topologies / Routing / Scalable Switch Microarchitecture / System Packaging / Case Studies / Closing Remarks

✦ Table of Contents


Preface......Page 12
Acknowledgments......Page 14
Note to the Reader......Page 16
Introduction......Page 18
Beowulf: The Cluster is Born......Page 20
Overview of Parallel Programming Models......Page 21
Putting it all together......Page 22
Quality of Service (QoS) requirements......Page 23
Lossy flow control......Page 24
Lossless flow control......Page 25
Summary......Page 26
Technology trends......Page 30
Communication Stack......Page 33
Introduction......Page 36
Mesh, Torus, and Hypercubes......Page 37
k-ary n-cube tradeoffs......Page 39
Towards High-radix Topologies......Page 42
Pin Bandwidth......Page 43
Economical Optical Signaling......Page 46
Butterfly......Page 47
High-Radix Folded-Clos......Page 48
Dragonfly......Page 51
HyperX......Page 54
Routing Basics......Page 56
Deterministic Routing......Page 57
Non-minimal Routing......Page 58
Universal Global Adaptive Load-Balancing (UGAL)......Page 59
Indirect Adaptive Routing......Page 60
Routing Algorithm Examples......Page 61
Example 2: Flattened Butterfly......Page 62
Example 3: Dragonfly......Page 66
Router Microarchitecture Basics......Page 68
Scaling baseline microarchitecture to high radix......Page 69
Fully Buffered Crossbar......Page 71
Hierarchical Crossbar Architecture......Page 72
Cray YARC Router......Page 74
Mellanox InfiniScale IV......Page 76
Power delivery and cooling......Page 80
Topology and Packaging Locality......Page 85
BlackWidow Node Organization......Page 90
High-radix Folded-Clos Network......Page 91
System Packaging......Page 92
High-radix Fat-tree......Page 93
Packet Format......Page 94
Data-link Layer Protocol......Page 95
Cray XT Multiprocessor......Page 97
3-D torus......Page 98
Routing......Page 99
SeaStar Router Microarchitecture......Page 101
Summary......Page 105
Wire protocols......Page 108
Opportunities......Page 109
Bibliography......Page 110
Authors' Biographies......Page 116


πŸ“œ SIMILAR VOLUMES


Computing Networks: from cluster to clou
✍ Pascale Vicat?Blanc, Sebastien Soudan, Romaric Guillier, Brice Goglin(auth.) πŸ“‚ Library πŸ“… 2011 πŸ› Wiley-ISTE 🌐 English

β€œComputing Networks” explores the core of the new distributed computing infrastructures we are using today:Β  the networking systems of clusters, grids and clouds. It helps network designers and distributed-application developers and users to better understand the technologies, specificities, constra

Computing Networks: From Cluster to Clou
✍ Pascale Vicat-Blanc, Brice Goglin, Romaric Guillier, Sebastien Soudan πŸ“‚ Library πŸ“… 2011 πŸ› Wiley 🌐 English

Computing Networks explores the core of the new distributed computing infrastructures we are using today: the networking systems of clusters, grids and clouds. It helps network designers and distributed-application developers and users to better understand the technologies, specificities, constrain

Operating Systems For Supercomputers And
✍ Balazs Gerofi, Yutaka Ishikawa, Rolf Riesen, Robert W. Wisniewski πŸ“‚ Library πŸ“… 2019 πŸ› Springer 🌐 English

Few works are as timely and critical to the advancement of high performance computing than is this new up-to-date treatise on leading-edge directions of operating systems. It is a first-hand product of many of the leaders in this rapidly evolving field and possibly the most comprehensive. This new a

High-Performance Networks, Personal Comm
✍ Dimitris N. Chorafas (auth.) πŸ“‚ Library πŸ“… 1997 πŸ› Palgrave Macmillan UK 🌐 English

<p>Many professionals in the technology industry are seeking new solutions beyond the confines of the more traditional type software tools, network design solutions and distributed systems applications. The aim of this book is to provide for them a much needed upgrade of knowledge and skills by addr

Cloud, Grid and High Performance Computi
✍ Emmanuel Udoh πŸ“‚ Library πŸ“… 2011 πŸ› IGI Global snippet 🌐 English

Continuing to stretch the boundaries of computing and the types of problems computers can solve, high performance, cloud, grid computing have emerged to address increasingly advanced issues by combining resources. Cloud, Grid and High Performance Computing: Emerging Applications offers new and estab