Skip to Main content Skip to Navigation

Video segmentation and multiple object tracking

Ratnesh Kumar 1
1 STARS - Spatio-Temporal Activity Recognition Systems
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : In this thesis we propose novel algorithms for video analysis. The first contribution of this thesis is in the domain of video segmentation wherein the objective is to obtain a dense and coherent spatio-temporal segmentation. We propose joining both spatial and temporal aspects of a video into a single notion Fiber. A fiber is a set of trajectories which are spatially connected by a mesh. Fibers are built by jointly assessing spatial and temporal aspects of the video. Compared to the state-of-the-art, a fiber based video segmentation presents advantages such as a natural spatio-temporal neighborhood accessor by a mesh, and temporal correspondences for most pixels in the video. Furthermore, this fiber-based segmentation is of quasi-linear complexity w.r.t. the number of pixels. The second contribution is in the realm of multiple object tracking. We proposed a tracking approach which utilizes cues from point tracks, kinematics of moving objects and global appearance of detections. Unification of all these cues is performed on a Conditional Random Field. Subsequently this model is optimized by a combination of message passing and an Iterated Conditional Modes (ICM) variant to infer object-trajectories. A third, minor, contribution relates to the development of suitable feature descriptor for appearance matching of persons. All of our proposed approaches achieve competitive and better results (both qualitatively and quantitatively) than state-of-the-art on open source datasets.
Complete list of metadatas

Cited literature [46 references]  Display  Hide  Download
Contributor : Abes Star :  Contact
Submitted on : Monday, March 30, 2015 - 5:37:05 PM
Last modification on : Thursday, September 27, 2018 - 1:18:27 AM
Document(s) archivé(s) le : Thursday, July 2, 2015 - 9:41:19 AM


Version validated by the jury (STAR)


  • HAL Id : tel-01137501, version 1



Ratnesh Kumar. Video segmentation and multiple object tracking. Other [cs.OH]. Université Nice Sophia Antipolis, 2014. English. ⟨NNT : 2014NICE4135⟩. ⟨tel-01137501⟩



Record views


Files downloads