A test suite for inference involving adjectives - INRIA - Institut National de Recherche en Informatique et en Automatique Accéder directement au contenu
Communication Dans Un Congrès Année : 2008

A test suite for inference involving adjectives

Résumé

Recently, most of the research in NLP has concentrated on the creation of applications coping with textual entailment. However, there still exist very few resourses for the evaluation of such applications. We argue that the reason for this resides not only in the novelty of the research field but also and mainly in the difficulty of defining the linguistic phenomena which are responsible for inference. As the TSNLP project has shown test suites provide an optimal diagnostic and evaluation tools for NLP applications, as contrary to text corpora they provide a deep insight in the linguistic phenomena allowing control over the data. Thus in this paper, we present a test suite specifically developed for studying inference problems shown by English adjectives. The construction of the test suite is based on the deep linguistic analysis and following classification of entailment patterns of adjectives and follows the TSNLP guidelines on linguistic databases providing a clear coverage, systematic annotation of inference tasks, large reusability and simple maintenance. With the design of this test suite we aim at creating a resource supporting the evaluation of computational systems handling natural language inference and in particular at providing a benchmark against which to evaluate and compare existing semantic analysers.
Fichier principal
Vignette du fichier
lrec08Paper.pdf (77.4 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00337371 , version 1 (06-11-2008)

Identifiants

  • HAL Id : hal-00337371 , version 1

Citer

Marilisa Amoia, Claire Gardent. A test suite for inference involving adjectives. sixth international conference on Language Resources and Evaluation, Jun 2008, Marrakech, Morocco. pp.19-27. ⟨hal-00337371⟩
301 Consultations
202 Téléchargements

Partager

Gmail Facebook X LinkedIn More