[ACM Press the 2nd international workshop - San Jose, California, USA (2011.06.08-2011.06.08)] Proceedings of the 2nd international workshop on Scientific cloud computing - ScienceCloud '11 - Cumulus
β Scribed by Bresnahan, John; Keahey, Kate; LaBissoniere, David; Freeman, Tim
- Book ID
- 118023334
- Publisher
- ACM Press
- Year
- 2011
- Weight
- 368 KB
- Volume
- 0
- Category
- Article
- ISBN
- 1450306993
No coin nor oath required. For personal study only.
β¦ Synopsis
Amazon's S3 protocol has emerged as the de facto interface for storage in the commercial data cloud. However, it is closed source and unavailable to the numerous science data centers all over the country. Just as Amazon's Simple Storage Service (S3) provides reliable data cloud access to commercial users, scientific data centers must provide their users with a similar level of service. Ideally scientific data centers could allow the use of the same clients and protocols that have proven effective to Amazon's users. But how well does the S3 REST interface compare with the data cloud transfer services used in today's computational centers? Does it have the features needed to support the scientific community? If not, can it be extended to include these features without loss of compatibility? Can it scale and distribute resources equally when presented with common scientific the usage patterns?We address these questions by presenting Cumulus, an open source implementation of the Amazon S3 REST API. It is packaged with the Nimbus IaaS toolkit and provides scalable and reliable access to scientific data. Its performance compares favorably with that of GridFTP and SCP, and we have added features necessary to support the econometrics important to the scientific community.
π SIMILAR VOLUMES
The recent increase in popularity of Storage-as-a-Service cloud solutions influences the way scientists are managing their data. More and more academic groups store and work on their data outside the university domain. Hence, data aggregation and metadata management is becoming increasingly importan