Publication

Uncalibrated and unsupervised photometric stereo with piecewise regularizer

Conference Article

Conference

IEEE International Conference on Image Processing (ICIP)

Edition

2024

Pages

3471-3476

Doc link

http://dx.doi.org/10.1109/ICIP51287.2024.10647967

File

Download the digital copy of the doc pdf document

Abstract

Photometric stereo is a technique for recovering a rigid object's 3D shape, reflectance properties, lighting conditions, and specular highlights from multiple images captured under varying lighting conditions. Variational, uncalibrated, and unsupervised formulations have recently provided detailed and robust solutions to the problem, reducing the need for prior knowledge about shape geometry or lighting conditions. However, uncalibrated methods, especially when applied to real-world data, may be susceptible to noise and depth errors near boundaries or self-occlusions, stemming from missing or noisy data, surface orientation ambiguity, and calibration issues. In this paper, we introduce a novel piecewise depth regularizer to mitigate these errors, enhancing stability and improving robustness against initialization errors. We demonstrate the effectiveness of our approach through evaluations on both synthetic and real-world data, showcasing its promise in enhancing the accuracy and reliability of photometric stereo for practical applications.

Categories

computer vision.

Author keywords

Uncalibrated Photometric Stereo, Unsupervised Vision, Piecewise Regularizer, Specular Materials.

Scientific reference

A. Casanova and A. Agudo. Uncalibrated and unsupervised photometric stereo with piecewise regularizer, 2024 IEEE International Conference on Image Processing, 2024, Abu Dhabi, UAE, pp. 3471-3476.