Fine-grained Visual Faceted Search

Julien Champ (1, 2) , Alexis Joly (2) , Pierre Bonnet (3)

1 UMR AGAP - Amélioration génétique et adaptation des plantes méditerranéennes et tropicales
2 ZENITH - Scientific Data Management
3 UMR AMAP - Botanique et Modélisation de l'Architecture des Plantes et des Végétations

This paper presents an interactive information retrieval scheme extending classical faceted search with fine-grained visual facets. Consistent visual words are extracted offline by constructing a matching graph at the region image level and splitting the graph in relevant clusters. Visual and textual facets are then indexed in the same faceted search engine, all of them being dynamically reranked according to their filtering efficiency before being presented to the end-user. To enhance their interpretability, each facet value is illustrated by a representative picture automatically selected from the matching graph in an adaptive way.

Mots clés: Visual; Facet; Image; Browsing; Fine-grained; Plant; Species; Identification

Domaines: Multimédia [cs.MM]; Recherche d'information [cs.IR]

Julien Champ, Alexis Joly, Pierre Bonnet. Fine-grained Visual Faceted Search. MM: Conference on Multimedia, Nov 2014, Orlando, FL, United States. pp.721-722, ⟨10.1145/2647868.2654875⟩. ⟨hal-01088822⟩