Skip to Main content Skip to Navigation
Theses

Layered Depth Images for Multi-View Coding

Vincent Jantet 1
1 TEMICS - Digital image processing, modeling and communication
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : This thesis presents an advanced framework for multi-view plus depth video processing and compression based on the concept of layered depth image (LDI). Several contributions are proposed for both depth-image based rendering and LDI construction and compression. The first contribution is a novel virtual view synthesis technique called Joint Projection Filling (JPF). This technique takes as input any image plus depth content and provides a virtual view in general position and performs image warping while detecting and filling cracks and other small disocclusions. A pixel confidence measure is introduced to avoid ghosting artifacts in the rendered views. For intermediate view interpolation, JPF is used in collaboration with a floating texture realignment technique. For virtual view extrapolation, JPF is combined with a novel full-Z depth aided inpainting technique. In order to efficiently encode the proposed LDI representation, a compression scheme based on MVC/AVC standard is adapted to exploit both temporal redundancies and inter-layer redundancies in the LDI sequence. An incremental construction scheme for the LDI is proposed, called I-LDI. This construction scheme reduces the completion rate of additional layers. An object-based layer organization of the LDI is then presented which ensures spatial consistency of each layer, and thus improves compression efficiency in comparison with a standard AVC/MVC scheme in rate-constrained context. Two rendering methods are finally proposed: the first one uses the JPF method, while the second one uses a 3D mesh for real-time rendering on an eight-views auto-stereoscopic display.
Document type :
Theses
Complete list of metadatas

Cited literature [2 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-00758301
Contributor : Vincent Jantet <>
Submitted on : Thursday, February 14, 2013 - 2:24:27 PM
Last modification on : Friday, July 10, 2020 - 4:27:07 PM
Long-term archiving on: : Saturday, April 1, 2017 - 11:55:32 PM

Identifiers

  • HAL Id : tel-00758301, version 2

Citation

Vincent Jantet. Layered Depth Images for Multi-View Coding. Multimedia [cs.MM]. Université Rennes 1, 2012. English. ⟨tel-00758301v2⟩

Share

Metrics

Record views

622

Files downloads

921