Depth-Aware Salient Object Detection and Segmentation via Multiscale Discriminative Saliency Fusion and Bootstrap Learning

Hangke Song (1) , Zhi Liu (1) , Huan Du (1) , Guangling Sun (1) , Olivier Le Meur (2) , Tongwei Ren (3)

1 School of Communication and Information Engineering [Shanghai]
2 Sirocco - Analysis representation, compression and communication of visual data
3 NJU - Nanjing University

This paper proposes a novel depth-aware salient object detection and segmentation framework via multiscale discriminative saliency fusion (MDSF) and bootstrap learning for RGBD images (RGB color images with corresponding Depth maps) and stereoscopic images. By exploiting low-level feature contrasts, mid-level feature weighted factors and high-level location priors, various saliency measures on four classes of features are calculated based on multiscale region segmentation. A random forest regressor is learned to perform the discriminative saliency fusion (DSF) and generate the DSF saliency map at each scale, and DSF saliency maps across multiple scales are combined to produce the MDSF saliency map. Furthermore, we propose an effective bootstrap learning-based salient object segmentation method, which is bootstrapped with samples based on the MDSF saliency map and learns multiple kernel support vector machines. Experimental results on two large datasets show how various categories of features contribute to the saliency detection performance and demonstrate that the proposed framework achieves the better performance on both saliency detection and salient object segmentation.

Domaines: Traitement du signal et de l'image [eess.SP]

Hangke Song, Zhi Liu, Huan Du, Guangling Sun, Olivier Le Meur, et al.. Depth-Aware Salient Object Detection and Segmentation via Multiscale Discriminative Saliency Fusion and Bootstrap Learning. IEEE Transactions on Image Processing, 2017, 26 (9), pp.4204 - 4216. ⟨10.1109/TIP.2017.2711277⟩. ⟨hal-01650409⟩