Incremental-LDI for Multi-View Coding

Vincent Jantet (1) , Luce Morin (2) , Christine Guillemot (1)

1 TEMICS - Digital image processing, modeling and communication
2 IETR - Institut d'Électronique et des Technologies du numéRique

This paper describes an Incremental algorithm for Layer Depth Image construction (I-LDI) from multi-view plus depth data sets. A solution to sampling artifacts is proposed, based on pixel interpolation (inpainting) restricted to isolated unknown pixels. A solution to ghosting artifacts is also proposed, based on a depth discontinuity detection, followed by a local foreground / background classification. We propose a formulation of warping equations which reduces time consumption, specifically for LDI warping. Tests on Breakdancers and Ballet MVD data sets show that extra layers in I-LDI contain only 10% of first layer pixels, compared to 50% for LDI. I-LDI Layers are also more compact, with a less spread pixel distribution, and thus easier to compress than LDI Visual rendering is of similar quality with I-LDI and LDI.

Mots clés: Video Coding; Virtual Reality; Multiview Video; Layered Depth Video; View Interpolation

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement des images [eess.IV]; Théorie de l'information [cs.IT]; Théorie de l'information et codage [math.IT]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Traitement du signal et de l'image [eess.SP]

Vincent Jantet, Luce Morin, Christine Guillemot. Incremental-LDI for Multi-View Coding. 3DTV-Conference 2009, The True Vison, Capture, Transmission and Display of 3D Video, May 2009, Postdam, Germany. pp.1--4. ⟨hal-00457630⟩