Publication
NeRFscopy: Neural radiance fields for in-vivo time-varying tissues from endoscopy
Conference Article
Conference
IEEE International Symposium on Biomedical Imaging (ISBI)
Edition
2026
Pages
1-5
Doc link
http://dx.doi.org/10.1109/ISBI61048.2026.11515806
File
Authors
Projects associated
Abstract
Endoscopy is essential in medical imaging, used for diagnosis, prognosis and treatment. Developing a robust dynamic 3D reconstruction pipeline for endoscopic videos could enhance visualization, improve diagnostic accuracy, aid in treatment planning, and guide surgery procedures. However, challenges arise due to the deformable nature of the tissues, the use of monocular cameras, illumination changes, occlusions and unknown camera trajectories. Inspired by neural rendering, we introduce NeRFscopy, a self-supervised pipeline for novel view synthesis and 3D reconstruction of deformable endoscopic tissues from a monocular video. NeRFscopy includes a deformable model with a canonical radiance field and a time-dependent deformation field parameterized by SE(3) transformations. In addition, the color images are efficiently exploited by introducing sophisticated terms to learn a 3D implicit model without assuming any template or pre-trained model, solely from data. NeRFscopy achieves accurate results in terms of novel view synthesis, outperforming competing methods across various challenging endoscopy scenes.
Categories
computer vision, robots.
Author keywords
Neural rendering, Non-rigid tissues, Endoscopy, 3D scene understanding, Monocular Vision.
Scientific reference
L. Salort and A. Agudo. NeRFscopy: Neural radiance fields for in-vivo time-varying tissues from endoscopy, 2026 IEEE International Symposium on Biomedical Imaging, 2026, London, pp. 1-5.
Follow us!