Publication
Detail-aware uncalibrated photometric stereo
Conference Article
Conference
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Edition
2023
Pages
1-5
Doc link
http://dx.doi.org/10.1109/ICASSP49357.2023.10094748
File
Abstract
Photometric stereo is the problem of jointly inferring the 3D reconstruction, reflectance, lighting and specularities of an object from a set of visual signals. Recently, some variational, uncalibrated, unsupervised and unified formulations have provided robust solutions to the problem while reducing the prior knowledge about the shape geometry or the lighting conditions. Unfortunately, these approaches cannot still produce solutions with an ample variety of details in the shape. That is mainly due to the non-convex and non-linear nature of the problem which requires the best initialization as possible. In this context, we propose a fully interpretable formulation that combines a physically-aware image formation model under perspective projection with a minimal detail-aware initialization and that it can handle general lighting. As a result, our formulation can consider multiple scenarios composed of unknown complex geometries and lighting patterns. Experimental results on challenging synthetic and real datasets show the effectiveness of our approach to capture more fine details, outperforming state-of-the-art techniques in terms of 3D reconstruction.
Categories
computer vision, optimisation.
Author keywords
Uncalibrated Photometric Stereo, Minimal Surfaces, Unsupervised Vision, Specular Materials.
Scientific reference
A. Agudo. Detail-aware uncalibrated photometric stereo, 2023 IEEE International Conference on Acoustics, Speech and Signal Processing, 2023, Rhodes Island, Greece, pp. 1-5.
Follow us!