A batch scheduler with high level components

Nicolas Capit (1, 2) , Georges da Costa (2, 1) , Yiannis Georgiou (2, 1) , Guillaume Huard (2, 3) , Cyrille Martin (2) , Grégory Mounié (2, 3) , Pierre Neyron (2) , Olivier Richard (2, 1)

1 MESCAL - Middleware efficiently scalable
2 ID-IMAG - Informatique et Distribution
3 MOAIS - PrograMming and scheduling design fOr Applications in Interactive Simulation

In this article we present the design choices and the evaluation of a batch scheduler for large clusters, named OAR. This batch scheduler is based upon an original design that emphasizes on low software complexity by using high level tools. The global architecture is built upon the scripting language Perl and the relational database engine Mysql. The goal of the project OAR is to prove that it is possible today to build a complex system for ressource management using such tools without sacrificing efficiency and scalability. Currently, our system offers most of the important features implemented by other batch schedulers such as priority scheduling (by queues), reservations, backfilling and some global computing support. Despite the use of high level tools, our experiments show that our system has performances close to other systems. Furthermore, OAR is currently exploited for the management of 700 nodes (a metropolitan GRID) and has shown good efficiency and robustness.

Mots clés: batch schedulers; resources management; cluster exploitation; scalability; systems design

Domaines: Calcul parallèle, distribué et partagé [cs.DC]

Nicolas Capit, Georges da Costa, Yiannis Georgiou, Guillaume Huard, Cyrille Martin, et al.. A batch scheduler with high level components. Cluster computing and Grid 2005 (CCGrid05), 2005, Cardiff, United Kingdom. ⟨hal-00005106⟩