Experience report: community-driven reviewing and validation of publications

Grigori Fursin (1) , Christophe Dubach (2)

1 POSTALE - Performance Optimization by Software Transformation and Algorithms & Librairies Enhancement
2 ICSA - Institute for Computing Systems Architecture School of Informatics - University of Edinburgh

In this report, we share our practical experience on crowdsourcing evaluation of research artifacts and reviewing of publications since 2008. We also briefly discuss encountered problems including reproducibility of experimental results and possible solutions.

Mots clés: crowdsourcing paper reviewing; collaborative artifact evaluation; reproducible research; software and hardware dependencies; community-driven journals; collective mind

Domaines: Bibliothèque électronique [cs.DL]; Environnements Informatiques pour l'Apprentissage Humain; Education; Sciences de l'information et de la communication

Grigori Fursin, Christophe Dubach. Experience report: community-driven reviewing and validation of publications. [Technical Report] 2014. ⟨hal-01006563⟩