Skip to Main content Skip to Navigation

Algorithms and perceptual analysis for interactive free viewpoint image-based navigation

Gaurav Chaurasia 1
1 REVES - Rendering and virtual environments with sound
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : We present image-based rendering (IBR) approaches that allow free viewpoint walkthroughs of urban scenes using just a few photographs as input. Previous approaches depend upon 3D models which give artifacts as the quality of 3D model degrades. In this thesis, we propose image-based approximations to compensate for the lack of accurate 3D geometry. In the first project, we use discontinuous shape-preserving image warp guided by quasi-dense depth maps which gives far fewer rendering artifacts than previous approaches. We build upon this approach in the second project by developing a completely automated solution that is capable of handling more complex scenes. We oversegment input images into superpixels that capture all occlusion boundaries. We introduce depth synthesis to create approximate depth in very poorly reconstructed regions and compute shape-preserving warps on superpixels to synthesize the final result. We also compare our results to many recent approaches. We analyze IBR artifacts from a perceptual point of view. In the first study, we compare artifacts caused by blending multiple images with abrupt temporal transitions and develop guidelines for selecting the ideal tradeoff. We use vision science in another study to investigate perspective distortions and develop a quantitative model that predicts distortions as a function of capture and viewing parameters. We use guidelines from these experiments to motivate the design of our own IBR systems. We demonstrate the very first virtual reality system that uses IBR instead of traditional computer graphics. This drastically reduces the cost of modeling 3D scenes while producing highly realistic walkthroughs.
Document type :
Complete list of metadatas

Cited literature [110 references]  Display  Hide  Download
Contributor : Abes Star :  Contact
Submitted on : Tuesday, February 20, 2018 - 12:05:06 PM
Last modification on : Wednesday, February 21, 2018 - 1:12:52 AM
Long-term archiving on: : Monday, May 21, 2018 - 12:30:40 PM


Files produced by the author(s)


  • HAL Id : tel-00979913, version 2



Gaurav Chaurasia. Algorithms and perceptual analysis for interactive free viewpoint image-based navigation. Other [cs.OH]. Université Nice Sophia Antipolis, 2014. English. ⟨NNT : 2014NICE4005⟩. ⟨tel-00979913v2⟩



Record views


Files downloads