Optimization for Active Learning-based Interactive Database Exploration

Enhui Huang (1, 2) , Liping Peng (3) , Luciano Di Palma (1, 2) , Ahmed Abdelkafi (1, 2) , Anna Liu (3) , Yanlei Diao (1, 2, 3)

1 CEDAR - Rich Data Analytics at Cloud Scale
2 LIX - Laboratoire d'informatique de l'École polytechnique [Palaiseau]
3 UMass Amherst - University of Massachusetts [Amherst]

There is an increasing gap between the fast growth of data and the limited human ability to comprehend data. Consequently, there has been a growing demand of data management tools that can bridge this gap and help the user retrieve high-value content from data more effectively. In this work, we aim to build interactive data exploration as a new database service, using an approach called "explore-by-example". In particular, we cast the explore-by-example problem in a principled "active learning" framework, and bring the properties of important classes of database queries to bear on the design of new algorithms and optimizations for active learning-based database exploration. These new techniques allow the database system to overcome fundamental limitations of traditional active learning, in particular, the slow convergence problem. Evaluation results using real-world datasets and user interest patterns show that our new system significantly outperforms state-of-the-art active learning techniques and data exploration systems in accuracy while achieving desired efficiency for interactive performance.

Domaines: Base de données [cs.DB]; Apprentissage [cs.LG]; Informatique [cs]

Enhui Huang, Liping Peng, Luciano Di Palma, Ahmed Abdelkafi, Anna Liu, et al.. Optimization for Active Learning-based Interactive Database Exploration. [Technical Report] Ecole Polytechnique; University of Massachusetts Amherst. 2018. ⟨hal-01870560⟩