First experiences with large SAN storage and Linux

✍ Scribed by Jos van Wezel; Holger Marten; Bernhard Verstege; Axel Jaeger

• Book ID: 103854380
• Publisher: Elsevier Science
• Year: 2004
• Tongue: English
• Weight: 172 KB
• Volume: 534
• Category: Article
• ISSN: 0168-9002
• DOI: 10.1016/j.nima.2004.07.053

✦ Synopsis

The use of a storage area network (SAN) with Linux opens possibilities for scalable and affordable large data storage and poses a new challenge for cluster computing. The GridKa center uses a commercial parallel file system to create a highly available high-speed data storage using a combination of Fibre Channel (SAN) and Ethernet (LAN) to optimize between data throughput and costs. This article describes the design, implementation and optimizations of the GridKa storage solution which will offer over 400 TB online storage for 600 nodes. Presented are some throughput measurements of one of the largest Linux-based parallel storage systems in the world.