DfAnalyzer

Daniel de Oliveira (1) , Vítor Silva (2) , Patrick Valduriez (3) , Marta Mattoso (2)

1 IC-UFF - Instituto de Computação [Niteroi-Rio de Janeiro]
2 COPPE-UFRJ - Instituto Alberto Luiz Coimbra de Pós-Graduação e Pesquisa de Engenharia
3 ZENITH - Scientific Data Management

DfAnalyzer is a tool for monitoring, debugging, steering, and analysis of dataflows while being generated by scientific applications. It works by capturing strategic domain data, registering provenance and execution data to enable queries at runtime. DfAnalyzer provides lightweight dataflow monitoring components to be invoked by high performance applications. It can be plugged in scripts, or Spark applications, in the same way users already plug visualization library components.

Mots clés: Data management; dataflow; monitoring; runtime analysis

Domaines: Base de données [cs.DB]; Calcul parallèle, distribué et partagé [cs.DC]

Daniel de Oliveira, Vítor Silva, Patrick Valduriez, Marta Mattoso. DfAnalyzer. 2018. ⟨hal-02094966⟩