Skip to Main content Skip to Navigation

Skyline : un marqueur pour la réalité augmentée sur mobile en contexte urbain

Abstract : The main objective of this thesis is to propose an approach that allows a user, moving in an urban environment, to visualize in augmented reality, using a smartphone, the impact of a construction project on the urban landscape, once thebuilding is completed. In particular, with the current attractivity for tower construc tion projects in major cities (London, Paris and Lyon in particular), it is becoming a very important issue for neighborhood users to be able to visualize the impact of aconstruction project on the skyline and to give an objective opinion on it. For geographers and neighborhood users, this innovative solution makes it possible to take the opposite view from architectural firms, which only offer very qualitative renderings of their construction projects, with a limited number of views, to the detriment of more objective visualizations. We do not necessarily propose a photo-realistic rendering, but rather a more exact geometric consistency of the scene, throughout the user’s movements. Visualizations at different positions and orientations correspond better to common use cases in neighborhoods. We propose an approach in which data from smartphone’s embedded instruments are merged to estimate a first user’s pose : the magnetic compass estimates the viewing direction; the GPS, gyroscope and accelerometer roughly evaluate the parameters of motion (three degrees of freedom in translation, and three degrees of freedom in rotation). This first estimated pose, associated with the 3D model of the city, allows, using the rendering supports (2D and 3D) of the devices, to generate a synthetic image of what the user theoretically visualizes at this position. Nevertheless, the unique use of these instruments to insert a synthetic object into the video stream gives the user a very unrealistic impression ofthe viewed scene : due to instrument’s data inaccuracies, synthetic objects appear to “hover” and "float" with the user’s movements. For this, the skyline is automatically extracted from real (acquired by the camera) and virtual (generated) images. A matching step between the two skylines allows to realign the virtual skyline onto the real one, allowing thus a real time insertion of the 3D object in the real-time video stream, and an improvement according to two criteria : precision and stability, giving with a much better immersion impression. In this matching step, several similarity metrics are proposed that are used in an optimization approach based on a gradient descent.
Document type :
Complete list of metadatas

Cited literature [84 references]  Display  Hide  Download
Contributor : Abes Star :  Contact
Submitted on : Friday, February 28, 2020 - 2:38:43 PM
Last modification on : Wednesday, July 8, 2020 - 12:42:12 PM
Long-term archiving on: : Friday, May 29, 2020 - 2:50:46 PM


Version validated by the jury (STAR)


  • HAL Id : tel-02459918, version 2


Mehdi Ayadi. Skyline : un marqueur pour la réalité augmentée sur mobile en contexte urbain. Modélisation et simulation. Université de Lyon; Université de Sfax (Tunisie), 2019. Français. ⟨NNT : 2019LYSE2051⟩. ⟨tel-02459918v2⟩



Record views


Files downloads