Skip to Main content Skip to Navigation

Evaluation through Realistic Simulations of File Replication Strategies for Large Heterogeneous Distributed Systems

Anchen Chai 1, 2 Sorina Camarasu-Pop 3, 1 Tristan Glatard 4 Hugues Benoit-Cattin 1 Frederic Suter 2, 5, 6
1 Images et Modèles
CREATIS - Centre de Recherche en Acquisition et Traitement de l'Image pour la Santé
3 Service Informatique et développements
CREATIS - Centre de Recherche en Acquisition et Traitement de l'Image pour la Santé
6 AVALON - Algorithms and Software Architectures for Distributed and HPC Platforms
Inria Grenoble - Rhône-Alpes, LIP - Laboratoire de l'Informatique du Parallélisme
Abstract : File replication is widely used to reduce file transfer times and improve data availability in large distributed systems. Replication techniques are often evaluated through simulations, however, most simulation platform models are oversimplified, which questions the applicability of the findings to real systems. In this paper, we investigate how platform models influence the performance of file replication strategies on large heterogeneous distributed systems, based on common existing techniques such as prestaging and dynamic replication. The novelty of our study resides in our evaluation using a realistic simulator. We consider two platform models: a simple hierarchical model and a detailed model built from execution traces. Our results show that conclusions depend on the modeling of the platform and its capacity to capture the characteristics of the targeted production infrastructure. We also derive recommendations for the implementation of an optimized data management strategy in a scientific gateway for medical image analysis.
Document type :
Conference papers
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01887369
Contributor : Béatrice Rayet <>
Submitted on : Thursday, October 4, 2018 - 9:39:07 AM
Last modification on : Wednesday, November 20, 2019 - 2:41:36 AM

Identifiers

  • HAL Id : hal-01887369, version 1

Citation

Anchen Chai, Sorina Camarasu-Pop, Tristan Glatard, Hugues Benoit-Cattin, Frederic Suter. Evaluation through Realistic Simulations of File Replication Strategies for Large Heterogeneous Distributed Systems. Europar 2018 - 24th International European Conference on Parallel and Distributed Computing ; Workshop HeteroPar 2018, Aug 2018, Turin, Italy. in press. ⟨hal-01887369⟩

Share

Metrics

Record views

129