Publication
SIDER: Single-image neural optimization for facial geometric detail recovery
Conference Article
Conference
International Conference on 3D Vision (3DV)
Edition
2021
Pages
815-824
Doc link
https://doi.org/10.1109/3DV53792.2021.00090
File
Authors
-
Chatziagapi, Aggelina
-
Athar, ShahRukh
-
Moreno Noguer, Francesc
-
Samaras, Dimitris
Projects associated
Abstract
In this work we present Sider, a method for high-fidelity detailed 3D face reconstruction from a single image that can be trained in an unsupervised manner. Our approach combines the best from classical statistical models and recent implicit neural representations. The former is used to obtain a coarse shape prior, and the latter provides high-frequency geometric detail, by only optimizing over a photometric loss computed w.r.t. the input image. A thorough quantitative and qualitative evaluation shows that Sider outperforms current state-of-the-art by a significant margin. A limitation of our current approach is that it still cannot handle details like hair or beards and accessories such as glasses. This is because the photometric loss for these regions would require sub-pixel accuracy. In the future, we will explore alternatives for addressing this type of high-frequency details.
Categories
computer vision.
Scientific reference
A. Chatziagapi, S. Athar, F. Moreno-Noguer and D. Samaras. SIDER: Single-image neural optimization for facial geometric detail recovery, 2021 International Conference on 3D Vision, 2021, London, UK (Virtual), pp. 815-824.
Follow us!