Evaluation Metrics

Jovan Pehcevski (1) , Benjamin Piwowarski (2)

1 AxIS - Usage-centered design, analysis and improvement of information systems
2 Yahoo! Labs Latin America

An evaluation metric is used to evaluate the effectiveness of information retrieval systems and to justify theoretical and/or pragmatical developments of these systems. It consists of a set of measures that follow a common underlying evaluation methodology. There are many metrics that can be used to evaluate the effectiveness of semi-structured text (XML) retrieval systems. These metrics are based on different evaluation assumptions, incorporate different hypotheses of the expected user behaviour, and implement their own evaluation methodologies to handle the level of overlap among the XML information units.

Domaines: Recherche d'information [cs.IR]

Jovan Pehcevski, Benjamin Piwowarski. Evaluation Metrics. Ling Liu and M. Tamer Özsu. Encyclopedia of Database Systems, Springer-Verlag, 2007. ⟨inria-00174152⟩