Volumetric tracking of 3D deformable shapes

Benjamin Allain 1, 2
2 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : In this thesis we propose algorithms for tracking 3D deformable shapes in motion from multiview video. Although series of reconstructed 3D shapes can be obtained by applying a static reconstruction algorithm to each temporal frame independently, such series do not represent motion. Instead, we want to provide a temporally coherent representation of the sequence of shapes resulting from temporal evolutions of a shape. Precisely, we want to represent the observed shape sequence as a 3D surface mesh whose vertices move in time but whose topology is constant.In contrast with most existing approaches, we propose to represent the motion of inner shape volumes, with the aim of better accounting for the volumetric nature of the observed object. We provide a fully volumetric approach to the fundamental problems of deformable shape tracking, which are the association between corresponding shape elements and the deformation model. In particular, we extend to a volumetric shape representation the EM-ICP tracking framework and the association-by-detection strategy.Furthermore, in order to better constrain the shape tracking problem, we propose a model for the temporal evolution of deformation. Our deformation model defines a shape space parametrized by variables that capture local deformation properties of the shape and whose values are automatically learned during the tracking process.We validate our tracking algorithms on several multiview video sequences with ground truth (silhouette and marker-based tracking). Our results are better or comparable to state of the art approaches.Finally, we show that volumetric tracking and the shape representation we choose can be leveraged for producing shape animations which combine captured and simulatated motion.
Document type :
Theses
Complete list of metadatas

Cited literature [158 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-01681320
Contributor : Abes Star <>
Submitted on : Friday, January 12, 2018 - 3:01:58 PM
Last modification on : Friday, August 17, 2018 - 1:12:30 AM

File

ALLAIN_2017_archivage.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-01681320, version 2

Collections

Citation

Benjamin Allain. Volumetric tracking of 3D deformable shapes. Computational Geometry [cs.CG]. Université Grenoble Alpes, 2017. English. ⟨NNT : 2017GREAM017⟩. ⟨tel-01681320v2⟩

Share

Metrics

Record views

364

Files downloads

452