A French Version of the FraCaS Test Suite

Une version française de la ressource FraCaS

Maxime Amblard (1, 2) , Clement Beysson (2, 1) , Philippe de Groote (1, 2) , Bruno Guillaume (1, 2) , Sylvain Pogodalla (1, 2)

1 SEMAGRAMME - Semantic Analysis of Natural Language
2 LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications

This paper presents a French version of the FraCaS test suite. This test suite, originally written in English, contains problems illustrating semantic inference in natural language. We describe linguistic choices we had to make when translating the FraCaS test suite in French, and discuss some of the issues that were raised by the translation. We also report an experiment we ran in order to test both the translation and the logical semantics underlying the problems of the test suite. This provides a way of checking formal semanticists' hypotheses against actual semantic capacity of speakers (in the present case, French speakers), and allow us to compare the results we obtained with the ones of similar experiments that have been conducted for other languages.

Mots clés: inference; semantics; French

Domaines: Linguistique; Informatique; Traitement du texte et du document; Intelligence artificielle [cs.AI]

Maxime Amblard, Clement Beysson, Philippe de Groote, Bruno Guillaume, Sylvain Pogodalla. A French Version of the FraCaS Test Suite. LREC 2020 - Language Resources and Evaluation Conference, May 2020, Marseille, France. pp.9. ⟨hal-02619239⟩