Skip to Main content Skip to Navigation

Automatic guidance of robotized 2D ultrasound probes with visual servoing based on image moments.

Rafik Mebarki 1
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : This dissertation presents a new 2D ultrasound-based visual servoing method. The main goal is to automatically guide a robotized 2D ultrasound probe held by a medical robot in order to reach a desired cross-section ultrasound image of an object of interest. This method allows to control both the in-plane and out-of-plane motions of a 2D ultrasound probe. It makes direct use of the 2D ultrasound image in the visual servo scheme, where the feed-back visual features are combinations of image moments. To build the servo scheme, we develop the analytical form of the interaction matrix that relates the image moments time variation to the probe velocity. That modeling is theoretically verified on simple shapes like spherical and cylindrical objects. In order to be able to automatically position the 2D ultrasound probe with respect to an observed object, we propose six relevant independent visual features to control the 6 degrees of freedom of the robotic system. Then, the system is endowed with the capability of automatically interacting with objects without any prior information about their shape, 3D parameters, nor 3D location. To do so, we develop on-line estimation methods that identify the parameters involved in the built visual servo scheme. We conducted both simulation and experimental trials respectively on simulated volumetric objects, and on both objects and soft tissues immersed in a water-filled tank. Successful results have been obtained, which show the validity of the developed methods and their robustness to different errors and perturbations especially those inherent to the ultrasound modality. Keywords: Medical robotics, visual servoing, 2D ultrasound imaging, kinematics modeling, model-free servoing.
Document type :
Complete list of metadatas
Contributor : Rafik Mebarki <>
Submitted on : Tuesday, April 27, 2010 - 1:05:05 PM
Last modification on : Thursday, January 7, 2021 - 4:24:12 PM
Long-term archiving on: : Wednesday, November 30, 2016 - 5:16:00 PM


  • HAL Id : tel-00476718, version 2


Rafik Mebarki. Automatic guidance of robotized 2D ultrasound probes with visual servoing based on image moments.. Automatic. Université Européenne de Bretagne, 2010. English. ⟨tel-00476718v2⟩



Record views


Files downloads