Skip to Main content Skip to Navigation

Robust 3D Motion Tracking for Robotic-Assisted Beating Heart Surgery

Rogerio Richa 1
1 DEXTER - Conception et commande de robots pour la manipulation
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
Abstract : The past decades have witnessed the notable development of minimally invasive surgery (MIS). The benefits of this modality of surgery for patients are numerous, shortening convalescence, reducing trauma and surgery costs. In this context, robotic assistance aims to make the surgical act more intuitive and safer. In the domain of cardiac MIS, heartbeat and respiration represent two important sources of disturbances. Even though miniaturized versions of heart stabilizers have been conceived for the MIS scenario, residual motion is still considerable and has to be manually canceled by the surgeon. In this thesis, the focus is put on computer vision techniques for estimating the 3D motion of the heart relying solely on natural structures on the heart surface for active compensation of physiological motions. Two main contributions on the subject of motion compensation for robotized cardiac MIS are proposed. The first is a visual tracking method for estimating the 3D deformation of a region of interest on the heart surface. A thin-plate spline model is used for representing the heart surface deformations and a novel efficient parameterization for 3D tracking using stereo endoscopic images is proposed. The method is robust to illumination variations and large tissue deformations. The second contribution is a robust visual tracking method using motion prediction. A time-varying dual Fourier series for modeling the quasi-periodic beating heart motion is proposed. For estimating the parameters of the Fourier series, a probabilistic framework is based on the Extended Kalman filter (EKF) is used. The visual tracking method is integrated in the heart motion prediction framework, creating an unified framework for estimating the temporal motion and spatial deformation of the heart surface. Experimental results have shown the effectiveness of the proposed methods.
Complete list of metadatas

Cited literature [101 references]  Display  Hide  Download
Contributor : Rogério Richa <>
Submitted on : Sunday, November 13, 2011 - 1:16:21 AM
Last modification on : Friday, May 17, 2019 - 11:40:14 AM
Long-term archiving on: : Tuesday, February 14, 2012 - 2:20:43 AM


  • HAL Id : tel-00640517, version 1



Rogerio Richa. Robust 3D Motion Tracking for Robotic-Assisted Beating Heart Surgery. Automatic. Université Montpellier II - Sciences et Techniques du Languedoc, 2010. English. ⟨NNT : 2010MON20025⟩. ⟨tel-00640517⟩



Record views


Files downloads