Publication

Single view facial hair 3D reconstruction

Conference Article

Conference

Iberian Conference on Pattern Recognition and Image Analysis (IbPRIA)

Edition

2019

Pages

423-436

Doc link

https://doi.org/10.1007/978-3-030-31332-6_37

File

Download the digital copy of the doc pdf document

Abstract

In this work, we introduce a novel energy-based framework that addresses the challenging problem of 3D reconstruction of facial hair from a single RGB image. To this end, we identify hair pixels over the image via texture analysis and then determine individual hair fibers that are modeled by means of a parametric hair model based on 3D helixes. We propose to minimize an energy composed of several terms, in order to adapt the hair parameters that better fit the image detections. The final hairs respond to the resulting fibers after a post-processing step where we encourage further realism. The resulting approach generates realistic facial hair fibers from solely an RGB image without assuming any training data nor user interaction. We provide an experimental evaluation on real-world pictures where several facial hair styles and image conditions are observed, showing consistent results and establishing a comparison with respect to competing approaches.

Categories

optimisation.

Author keywords

3D Vision, Shape Reconstruction, Facial Hair Modeling

Scientific reference

G. Rotger, F. Moreno-Noguer, F. Lumbreras and A. Agudo. Single view facial hair 3D reconstruction, 2019 Iberian Conference on Pattern Recognition and Image Analysis, 2019, Madrid, Spain, pp. 423-436.