Towards Benchmarks for Conceptual Graphs Tools

Jean-François Baget (1) , Olivier Carloni (2) , Michel Chein (3) , David Genest (4) , Alain Gutierrez (2) , Michel Leclère (3) , Marie-Laure Mugnier (3) , Eric Salvat (2) , Rallou Thomopoulos (3)

1 EXMO - Computer mediated exchange of structured knowledge
2 LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
3 GRAPHIK - Graphs for Inferences on Knowledge
4 LERIA - Laboratoire d'Etudes et de Recherche en Informatique d'Angers

This paper reports a collective reflection led in our team about conceptual graphs benchmarks. We tackle four issues for which agreement should be obtained before benchmarks can be built: what are the fragments of CGs considered? How is inforemation exchanged? What are the problems to be solved? What kind of tools properties are evaluated by the benchmarks? We define a basic building block built upon simple conceptual graphs. Finally we propose to provide a first benchmark adapted from an industrial case study. This benchmark is composed of very simpe structures and should allow to focus on interoperability issues.

Domaines: Intelligence artificielle [cs.AI]

Jean-François Baget, Olivier Carloni, Michel Chein, David Genest, Alain Gutierrez, et al.. Towards Benchmarks for Conceptual Graphs Tools. CS-TIW: Conceptual Structures Tool Interoperability Workshop, Jul 2006, Aalborg, Denmark. pp.72-86. ⟨lirmm-00112998⟩