Skip to Main content Skip to Navigation

Contribution to wide angle visual perception for mobile robots and self driving cars

Abstract : This thesis presents a novel projection model for fisheye cameras, which is mathematically simple and yet shows a high precision when applied to real cameras. Geometric properties of the model have been analyzed using the concept of projection surface, introduced in this work. In particular, a closed-form inverse mapping and an implicit equation for straight line projection have been found. This fact has been used to develop a method of direct stereo correspondence on raw fisheye images via rasterization of implicit curve. This correspondence algorithm allows us to apply the Semi-Global Matching algorithm to get an accurate 3D reconstruction using fisheye stereo systems. All these elements have been shown to be applicable to a direct visual localization system with two different methods of image registration: direct photometric error minimization and mutual information maximization. Intrinsic and extrinsic calibration of a mobile robot with fisheye cameras has been considered and a toolbox for such a calibration has been developed.
Complete list of metadata

Cited literature [91 references]  Display  Hide  Download
Contributor : ABES STAR :  Contact
Submitted on : Wednesday, January 16, 2019 - 4:28:15 PM
Last modification on : Friday, August 5, 2022 - 2:54:51 PM


Version validated by the jury (STAR)


  • HAL Id : tel-01983700, version 1


Bogdan Khomutenko. Contribution to wide angle visual perception for mobile robots and self driving cars. Signal and Image processing. École centrale de Nantes, 2018. English. ⟨NNT : 2018ECDN0010⟩. ⟨tel-01983700⟩



Record views


Files downloads