Radiometric confidence criterion for patch-based inpainting

Julien Fayer (1, 2) , Géraldine Morin (1, 3) , Simone Gasparini (1, 3) , Maxime Daisy (2) , Benjamin Coudrin (2)

1 IRIT-REVA - Real Expression Artificial Life
2 SAS Innersense
3 Toulouse INP - Institut National Polytechnique (Toulouse)

Diminished Reality (DR) consists in virtually removing objects from a captured scene, thus requiring a coherent filling of the areas originally hidden behind these objects. Indoor DR applications often exploit the planar geometry of the scene to apply an inpainting process on a perspectively undistorted view of the plane. In this paper we propose to integrate a novel, physic-based criterion into classical state-of-the-art inpainting algorithms in order to take into account the variations in image resolution of the undistorted view. The proposed inpainting process selects the patches and avoids the propagation of low-resolution data, i.e. patches corresponding to parts of the plane that are far from the camera or seen under an very skew angle. We illustrate the improvements of DR results on synthetic and real images.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Julien Fayer, Géraldine Morin, Simone Gasparini, Maxime Daisy, Benjamin Coudrin. Radiometric confidence criterion for patch-based inpainting. International Conference on Pattern Recognition (ICPR 2018), Aug 2018, Beijing, China. ⟨10.1109/ICPR.2018.8545350⟩. ⟨hal-01895288⟩