Pose-robust face signature for multi-view face recognition

Pengfei Dou, Lingfeng Zhang, Yuhang Wu, Shishir K. Shah, Ioannis A. Kakadiaris

Research output: Chapter in Book/Report/Conference proceedingConference contribution

17 Scopus citations

Abstract

Despite the great progress achieved in unconstrained face recognition, pose variations still remain a challenging and unsolved practical issue. We propose a novel framework for multi-view face recognition based on extracting and matching pose-robust face signatures from 2D images. Specifically, we propose an efficient method for monocular 3D face reconstruction, which is used to lift the 2D facial appearance to a canonical texture space and estimate the self-occlusion. On the lifted facial texture we then extract various local features, which are further enhanced by the occlusion encodings computed on the self-occlusion mask, resulting in a pose-robust face signature, a novel feature representation of the original 2D facial image. Extensive experiments on two public datasets demonstrate that our method not only simplifies the matching of multi-view 2D facial images by circumventing the requirement for pose-adaptive classifiers, but also achieves superior performance.

Original languageEnglish (US)
Title of host publication2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems, BTAS 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479987764
DOIs
StatePublished - Dec 16 2015
Event7th IEEE International Conference on Biometrics Theory, Applications and Systems, BTAS 2015 - Arlington, United States
Duration: Sep 8 2015Sep 11 2015

Publication series

Name2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems, BTAS 2015

Conference

Conference7th IEEE International Conference on Biometrics Theory, Applications and Systems, BTAS 2015
Country/TerritoryUnited States
CityArlington
Period9/8/159/11/15

ASJC Scopus subject areas

  • Statistics and Probability
  • Computer Science Applications
  • Biomedical Engineering

Fingerprint

Dive into the research topics of 'Pose-robust face signature for multi-view face recognition'. Together they form a unique fingerprint.

Cite this