Improving Shadow Suppression for Illumination Robust Face Recognition

Abstract : —2D face analysis techniques, such as face landmarking, face recognition and face verification, are reasonably dependent on illumination conditions which are usually uncontrolled and unpredictable in the real world. The current massive data-driven approach, e.g., deep learning-based face recognition, requires a huge amount of labeled training face data that hardly cover the infinite lighting variations that can be encountered in real-life applications. An illumination robust preprocessing method thus remains a very interesting but also a significant challenge in reliable face analysis. In this paper we propose a novel model driven approach to improve lighting normalization of face images. Specifically, we propose to build the underlying reflectance model which characterizes interactions between skin surface, lighting source and camera sensor, and elaborate the formation of face color appearance. The proposed illumination processing pipeline enables generation of the Chromaticity Intrinsic Image (CII) in a log chromaticity space which is robust to illumination variations. Moreover, as an advantage over most prevailing methods, a photo-realistic color face image is subsequently reconstructed, which eliminates a wide variety of shadows whilst retaining the color information and identity details. Experimental results under different scenarios and using various face databases show the effectiveness of the proposed approach in dealing with lighting variations, including both soft and hard shadows, in face recognition.
Complete list of metadatas

Cited literature [42 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01704659
Contributor : Liming Chen <>
Submitted on : Thursday, February 8, 2018 - 4:00:37 PM
Last modification on : Wednesday, November 20, 2019 - 3:13:17 AM
Long-term archiving on: Wednesday, May 9, 2018 - 1:50:42 PM

File

LimingChen_Lighting_pami-final...
Files produced by the author(s)

Identifiers

Citation

Wuming Zhang, Xi Zhao, Jean-Marie Morvan, Liming Chen. Improving Shadow Suppression for Illumination Robust Face Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, inPress, ⟨10.1109/TPAMI.2018.2803179⟩. ⟨hal-01704659⟩

Share

Metrics

Record views

714

Files downloads

406