Dynamic Load-Balancing with Variable Number of Processors based on Graph Repartitioning

Clément Vuchener (1, 2) , Aurélien Esnard (1, 2)

1 LaBRI - Laboratoire Bordelais de Recherche en Informatique
2 HiePACS - High-End Parallel Algorithms for Challenging Numerical Simulations

Dynamic load balancing is an important step conditioning the performance of parallel adaptive codes whose load evolution is difficult to predict. Most of the studies which answer this problem perform well, but are limited to an initially fixed number of processors which is not modified at runtime. These approaches can be very inefficient, especially in terms of resource consumption. In this paper, we present a new graph repartitioning algorithm which accepts to dynamically change the number of processors, assuming the load is already balanced. Our algorithm minimizes both data communication and data migration overheads, while maintaining the computational load balanced. This algorithm is based on a theoretical result, that constructs optimal communication patterns with both a minimum migration volume and a minimum number of communications. An experimental study which compares our work against state-of-the-art approaches is presented.

Domaines: Calcul parallèle, distribué et partagé [cs.DC]

Clément Vuchener, Aurélien Esnard. Dynamic Load-Balancing with Variable Number of Processors based on Graph Repartitioning. IEEE International Conference on High Performance Computing (HiPC 2012), Dec 2012, Pune, India. pp.1-9, ⟨10.1109/HiPC.2012.6507501⟩. ⟨hal-00722731v2⟩