Force-based representation for non-rigid shape and elastic model estimation

Journal Article (2018)


IEEE Transactions on Pattern Analysis and Machine Intelligence







Doc link


Download the digital copy of the doc pdf document


This paper addresses the problem of simultaneously recovering 3D shape, pose and the elastic model of a deformable object from only 2D point tracks in a monocular video. This is a severely under-constrained problem that has been typically addressed by enforcing the shape or the point trajectories to lie on low-rank dimensional spaces. We show that formulating the problem in terms of a low-rank force space that induces the deformation and introducing the elastic model as an additional unknown, allows for a better physical interpretation of the resulting priors and a more accurate representation of the actual object's behavior. In order to simultaneously estimate force, pose, and the elastic model of the object we use an expectation maximization strategy, where each of these parameters are successively learned by partial M-steps. Once the elastic model is learned, it can be transfered to similar objects to code its 3D deformation. Moreover, our approach can robustly deal with missing data, and encode both rigid and non-rigid points under the same formalism. We thoroughly validate the approach on Mocap and real sequences, showing more accurate 3D reconstructions than state-of-the-art, and additionally providing an estimate of the full elastic model with no a priori information.


computer vision, optimisation.

Author keywords

Non-Rigid Structure from Motion, 3D Reconstruction, Expectation Maximization, Elastic Model, Force Space

Scientific reference

A. Agudo and F. Moreno-Noguer. Force-based representation for non-rigid shape and elastic model estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(9): 2137-2150, 2018.