Acadoop, a lightweight MapReduce framework for education and prototyping

Zakaria Aarab (1) , Walid El Haimouti (1) , Hamza Idbenouakrim (1) , Aissam Ouinou (1) , Ayoub Ratbi (2) , Philippe Mauran (2, 3) , Alain Tchana (4)

1 UT - Université de Toulouse
2 IRIT-ACADIE - Assistance à la Certification d’Applications DIstribuées et Embarquées
3 Toulouse INP - Institut National Polytechnique (Toulouse)
4 IRIT-SEPIA - Système d’exploitation, systèmes répartis, de l’intergiciel à l’architecture

We present Acadoop, a lightweight MapReduce framework, which offers the main features of the Hadoop framework, and follows its architecture. The purpose of this lightening is mainly educational : it aims at enabling students to understand more easily the design of such frameworks, and to experiment with the behaviour of the applications that run on these frameworks. A further benefit of this lightening is that Acadoop provides a simple tool for prototyping and assessing scheduling policies for the MapReduce framework. We give a few simple examples of comparisons between scheduling policies, in order to illustrate Acadoop's possibilities with regard to both education and prototyping. In conclusion, we present the context in which Acadoop was developped, and present some lines for further improvement.

Mots clés: Hadoop; Scheduling; MapReduce; Project-based Learning; Electronic mail; Automobiles; Standards

Domaines: Informatique [cs]

Zakaria Aarab, Walid El Haimouti, Hamza Idbenouakrim, Aissam Ouinou, Ayoub Ratbi, et al.. Acadoop, a lightweight MapReduce framework for education and prototyping. 13th Conférence Internationale sur les NOuvelles TEchnologie de la REpartition (NOTERE 2016), Jul 2016, Paris, France. ⟨10.1109/NOTERE.2016.7745829⟩. ⟨hal-03165017⟩