Pyramid: A large-scale array-oriented active storage system

Viet-Trung Tran (1) , Bogdan Nicolae (2) , Gabriel Antoniu (1) , Luc Bougé (1)

1 KerData - Scalable Storage for Clouds and Beyond
2 GRAND-LARGE - Global parallel and distributed computing

The recent explosion in data sizes manipulated by distributed scientific applications has prompted the need to develop specialized storage systems capable to deal with specific access patterns in a scalable fashion. In this context, a large class of applications focuses on parallel array processing: small parts of huge multi-dimensional arrays are concurrently accessed by a large number of clients, both for reading and writing. A specialized storage system that deals with such an access pattern faces several challenges at the level of data/metadata management. We introduce Pyramid, an active array-oriented storage system that addresses these challenges and shows promising results in our initial evaluation.

Domaines: Calcul parallèle, distribué et partagé [cs.DC]

Viet-Trung Tran, Bogdan Nicolae, Gabriel Antoniu, Luc Bougé. Pyramid: A large-scale array-oriented active storage system. LADIS 2011: The 5th Workshop on Large Scale Distributed Systems and Middleware, Sep 2011, Seattle, United States. ⟨inria-00627665⟩