Skip to Main content Skip to Navigation

Point process and graph cut applied to 2D and 3D object extraction

Ahmed Gamal Eldin 1 
1 ARIANA - Inverse problems in earth monitoring
CRISAM - Inria Sophia Antipolis - Méditerranée , Laboratoire I3S - SIS - Signal, Images et Systèmes
Abstract : The topic of this thesis is to develop a novel approach for 3D object detection from a 2D image. This approach takes into consideration the occlusions and the perspective effects. This work has been embedded in a marked point process framework, proved to be efficient for solving many challenging problems dealing with high resolution images. The accomplished work during the thesis can be presented in two parts.
First part: we propose a novel probabilistic approach to handle occlusions and perspective effects. The proposed method is based on 3D scene simulation on the GPU using OpenGL. It is an object based method embedded in a marked point process framework. We apply it for the size estimation of a penguin colony, where we model a penguin colony as an unknown number of 3D objects. The main idea of the proposed approach is to sample some candidate configurations consisting of 3D objects lying on the real plane. A Gibbs energy is define on the configuration space, which takes into account both prior and data information. The proposed configurations are projected onto the image plane, and the configurations are modified until convergence. To evaluate a proposed configuration, we measure the similarity between the projected image of the proposed configuration and the real image, by defining a data term and a prior term which penalize objects overlapping. We introduced modifications to the optimization algorithm to take into account new dependencies that exists in our 3D model.
Second part: we propose a new optimization method which we call "Multiple Births and Cut" (MBC). It combines the recently developed optimization algorithm Multiple Births and Deaths (MBD) and the Graph-Cut. MBD and MBC optimization methods are applied for the optimization of a marked point process. We compared the MBC to the MBD algorithms showing that the main advantage of our newly proposed algorithm is the reduction of the number of parameters, the speed of convergence and the quality of the obtained results. We validated our algorithm on the counting problem of flamingos in a colony.
Complete list of metadata

Cited literature [91 references]  Display  Hide  Download
Contributor : Ahmed Gamal Eldin Connect in order to contact the contributor
Submitted on : Wednesday, October 3, 2012 - 10:28:59 AM
Last modification on : Thursday, August 4, 2022 - 4:52:35 PM
Long-term archiving on: : Friday, January 4, 2013 - 3:57:01 AM


  • HAL Id : tel-00737988, version 1



Ahmed Gamal Eldin. Point process and graph cut applied to 2D and 3D object extraction. Image Processing [eess.IV]. Université Nice Sophia Antipolis, 2011. English. ⟨tel-00737988⟩



Record views


Files downloads