Potential and limits of automated plant identification based on visual data, feedbacks from the development of Pl@ntNet initiative

Pierre Bonnet (1) , Alexis Joly (2) , Hervé Goëau (1) , Jean-Christophe Lombardo (2) , Antoine Affouard (1, 2) , Sen Wang (2) , Rémi Knaff (1) , Jean-François Molino (1) , Daniel Barthélémy (3)

1 UMR AMAP - Botanique et Modélisation de l'Architecture des Plantes et des Végétations
2 ZENITH - Scientific Data Management
3 UMR AMAP - BotAnique et BioinforMatique de l'Architecture des Plantes

Pl@ntNet is a free web and mobile platform dedicated to automated, image-based plant identification and to collaborative gathering of plant observations (http://identify.plantnet-project.org/). It relies on crowdsourcing approaches and machine learning techniques for data production, validation and enrichment. The initial version of the application, launched in 2013, covered 800 French native species. It now covers a large part of European flora (6,200 species) and has been extended to other floristic regions, such as the Mascarene Islands, the Guiana Shield and Maghreb. Through its iPhone and Android apps (> 3 million downloads and 10,000-50,000 daily users), Pl@ntNet gathers increasingly large amounts of botanical observations voluntarily contributed by an array of people who are often novice in plant identification. These observations are continually checked and amended (for identifications and image quality) by hundreds of amateur botanists, through Pl@ntNet’s collaborative web tools. We recently worked on several different datasets shared by national and international institutions (such as a visual dataset from Encyclopedia of Life), in the aim to improve efficiency and taxonomic coverage of Pl@ntNet application. This has allowed the adaptation of Pl@ntNet to several new floras, such as the North American flora, a part of the Caribbean and Hawaiian flora, and the Tropical Andes flora. We propose to present (i) recent developments dedicated to data aggregation and enrichment (notably the semi-automated plant image annotation), (ii) the limits of this approach, (iii) as well as the perspectives of improvements, based on both the users feedback, and on analyses of the data already collected. This emphasize on one side, the potential of new technologies for botanical and ecological activities, and on the other side, the capacity of multi-disciplinary projects to address societal needs at large scale

Mots clés: Plant identification; multimedia content analysis; mobile computing; Pl@ntNet

Mots clés: identification assistée par ordinateur

Domaines: Sciences du Vivant [q-bio]

Pierre Bonnet, Alexis Joly, Hervé Goëau, Jean-Christophe Lombardo, Antoine Affouard, et al.. Potential and limits of automated plant identification based on visual data, feedbacks from the development of Pl@ntNet initiative. Botany 2017, Jun 2017, Forth Worth, TX, United States. , 2017. ⟨hal-01837383⟩