TY - GEN
T1 - Illumination-invariant face recognition with deep relit face images
AU - Le, Ha A.
AU - Kakadiaris, Ioannis A.
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/3/4
Y1 - 2019/3/4
N2 - Uncontrolled illumination is one of the most significant challenges in face recognition. The performance of state-of-the-art face recognition algorithms drops drastically when measured on datasets with large illumination variations. In this paper, we propose a deep face relighting algorithm and employ it as a data augmentation method to enrich training data with illumination variations. For an input image, the proposed face relighting as data augmentation (FRADA) approach first estimates its 3D morphable model coefficients and spherical harmonic lighting coefficients. Then, it extracts the face normals, face mask, face shading, and face albedo, and renders new face images under random lighting conditions following physically-based image formation theory. Qualitative results demonstrate that FRADA produces more realistic images than the state-of-the-art face relighting algorithm. Quantitative experiments confirm the effectiveness of our relighting approach for face recognition. We successfully enhance the robustness of face templates to illumination variations simply by training face recognition algorithms with our relit images.
AB - Uncontrolled illumination is one of the most significant challenges in face recognition. The performance of state-of-the-art face recognition algorithms drops drastically when measured on datasets with large illumination variations. In this paper, we propose a deep face relighting algorithm and employ it as a data augmentation method to enrich training data with illumination variations. For an input image, the proposed face relighting as data augmentation (FRADA) approach first estimates its 3D morphable model coefficients and spherical harmonic lighting coefficients. Then, it extracts the face normals, face mask, face shading, and face albedo, and renders new face images under random lighting conditions following physically-based image formation theory. Qualitative results demonstrate that FRADA produces more realistic images than the state-of-the-art face relighting algorithm. Quantitative experiments confirm the effectiveness of our relighting approach for face recognition. We successfully enhance the robustness of face templates to illumination variations simply by training face recognition algorithms with our relit images.
UR - http://www.scopus.com/inward/record.url?scp=85063582679&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85063582679&partnerID=8YFLogxK
U2 - 10.1109/WACV.2019.00232
DO - 10.1109/WACV.2019.00232
M3 - Conference contribution
AN - SCOPUS:85063582679
T3 - Proceedings - 2019 IEEE Winter Conference on Applications of Computer Vision, WACV 2019
SP - 2146
EP - 2155
BT - Proceedings - 2019 IEEE Winter Conference on Applications of Computer Vision, WACV 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 19th IEEE Winter Conference on Applications of Computer Vision, WACV 2019
Y2 - 7 January 2019 through 11 January 2019
ER -