Skip to Main content Skip to Navigation

Contributions to the Bayesian Approach to Multi-View Stereo

Pau Gargallo I Piracés 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
Abstract : Multi-view stereo is the problem of recovering the shape of objects from multiple images taken from different but known camera positions. It is an inverse problem where we want to find the cause (the object) given the effect (the images). From a Bayesian perspective, the solution would be the reconstruction that best reproduces the input images while at the same time being plausible a priori. Taking this approach, in this thesis we develop generative models and methods for computing reconstructions that minimize the difference between the observed images and the images sythetized from the reconstruction.

Three models are presented. The first, represents the reconstructed scene by a set of depth maps. This gives high resolution results, but have problems at the objects boundaries. The second model represents the scene by a discreet occupancy grid, yielding to a combinatorial optimization problem, which is addressed through message passing techniques. The final model represents the scene by a smooth surface and the resulting optimization problem is solved via gradient descent surface evolution.

In either model, the main difficulty is to correctly take into account the occlusions. Modeling self-occlusions results in optimization problems that challenge current optimization techniques. In this respect, the main result of the thesis is the computation of the derivative of the reprojection error with respect to surface variations taking into account the visibility changes that occur while the surface moves. This enables the use of gradient descent techniques, and leads to surface evolutions that place the contour generators of the surface to their correct location in the images without the need of additional silhouettes or apparent contours constraints.
Document type :
Complete list of metadatas

Cited literature [187 references]  Display  Hide  Download
Contributor : Pau Gargallo I Piracés <>
Submitted on : Thursday, May 15, 2008 - 1:00:05 PM
Last modification on : Tuesday, November 24, 2020 - 4:36:03 PM
Long-term archiving on: : Friday, September 28, 2012 - 2:40:37 PM


  • HAL Id : tel-00279825, version 1



Pau Gargallo I Piracés. Contributions to the Bayesian Approach to Multi-View Stereo. Human-Computer Interaction [cs.HC]. Institut National Polytechnique de Grenoble - INPG, 2008. English. ⟨tel-00279825⟩



Record views


Files downloads