Optimal transport for Domain adaptation

Nicolas Courty (1) , Rémi Flamary (2, 3) , Alain Rakotomamonjy (4) , Devis Tuia (5)

1 OBELIX - Environment observation with complex imagery
2 OCA - Observatoire de la Côte d'Azur
3 LAGRANGE - Joseph Louis LAGRANGE
4 LITIS - Laboratoire d'Informatique, de Traitement de l'Information et des Systèmes
5 LASIG - Laboratoire des Systèmes d'Information Géographique [Lausanne]

Domain adaptation from one data space (or domain) to the other is one of the most challenging tasks of modern data analytics. If the adaptation is done cor-rectly, models built on a specific data space become able to process data depicting the same semantic concepts (the classes), but observed by another observation system with its own specificities. In this paper, we propose an optimal transporta-tion model that aligns the representations in the source and target domains. We learn a transportation plan matching both PDFs and constrain labeled samples in the source domain to remain close during transport with a non convex group regularization. This way, we exploit at the same time the labeled information in the source (the same that will be used by the classifier after adaptation) and the unlabeled distributions observed in both domains. We propose an efficient majoration-minimization algorithm to solve the resultaing optimization problem and discuss its convergence. Numerical experiments of real data show the interest of the method, that outperforms state-of-the-art approaches.

Domaines: Machine Learning [stat.ML]; Traitement du signal et de l'image [eess.SP]

Nicolas Courty, Rémi Flamary, Alain Rakotomamonjy, Devis Tuia. Optimal transport for Domain adaptation. NIPS 2014, Workshop on Optimal Transport and Machine Learning, Dec 2014, Montréal, Canada. ⟨hal-01103073⟩