[ACM Press the 2nd International Workshop - Bern, Switzerland (2012.04.10-2012.04.10)] Proceedings of the 2nd International Workshop on Cloud Computing Platforms - CloudCP '12 - Virtual InfiniBand clusters for HPC clouds

✍ Scribed by Hillenbrand, Marius; Mauch, Viktor; Stoess, Jan; Miller, Konrad; Bellosa, Frank

• Book ID: 121791503
• Publisher: ACM Press
• Year: 2012
• Weight: 376 KB
• Category: Article
• ISBN: 145031161X
• DOI: 10.1145/2168697.2168706

✦ Synopsis

High Performance Computing (HPC) employs fast interconnect technologies to provide low communication and synchronization latencies for tightly coupled parallel compute jobs. Contemporary HPC clusters have a fixed capacity and static runtime environments; they cannot elastically adapt to dynamic workloads, and provide a limited selection of applications, libraries, and system software. In contrast, a cloud model for HPC clusters promises more flexibility, as it provides elastic virtual clusters to be available on-demand. This is not possible with physically owned clusters.In this paper, we present an approach that makes it possible to use InfiniBand clusters for HPC cloud computing. We propose a performance-driven design of an HPC IaaS layer for InfiniBand, which provides throughput and latency-aware virtualization of nodes, networks, and network topologies, as well as an approach to an HPC-aware, multi-tenant cloud management system for elastic virtualized HPC compute clusters.