Scalable Light Field Compression Scheme Using Sparse Reconstruction and Restoration

Fatma Hawary (1, 2) , Christine Guillemot (2) , Dominique Thoreau (1) , Guillaume Boisson (1)

1 Technicolor R & I [Cesson Sévigné]
2 Sirocco - Analysis representation, compression and communication of visual data

This paper describes a light field scalable compression scheme based on the sparsity of the angular Fourier transform of the light field. A subset of sub-aperture images (or views) is compressed using HEVC as a base layer and transmitted to the decoder. An entire light field is reconstructed from this view subset using a method exploiting the sparsity of the light field in the continuous Fourier domain. The reconstructed light field is enhanced using a patch-based restoration method. Then, restored samples are used to predict original ones, in a SHVC-based SNR-scalable scheme. Experiments with different datasets show a significant bit rate reduction of up to 24% in favor of the proposed compression method compared with a direct encoding of all the views with HEVC. The impact of the compression on the quality of the all-in-focus images is also analyzed showing the advantage of the proposed scheme.

Mots clés: sparsity; Light field; compression; HEVC; SHVC

Domaines: Traitement du signal et de l'image [eess.SP]

Fatma Hawary, Christine Guillemot, Dominique Thoreau, Guillaume Boisson. Scalable Light Field Compression Scheme Using Sparse Reconstruction and Restoration. ICIP 2017 - IEEE International Conference on Image Processing, Sep 2017, Beijing, China. ⟨hal-01597536⟩