Skip to Main content Skip to Navigation


Sandra Avila 1 
1 MLIA - Machine Learning and Information Access
LIP6 - Laboratoire d'Informatique de Paris 6
Abstract : In this dissertation, we have addressed the problem of representing images based on their visual information. Our aim is content-based concept detection in images and videos, with a novel representation that enriches the Bag-of-Words model. Relying on the quantization of highly discriminant local descriptors by a codebook, and the aggregation of those quantized descriptors into a single pooled feature vector, the Bag-of-Words model has emerged as the most promising approach for image classification. We propose BossaNova, a novel image representation which offers a more information-preserving pooling operation based on a distance-to-codeword distribution. The experimental evaluations on many challenging image classification benchmarks, such as ImageCLEF Photo Annotation, MIRFLICKR, PASCAL VOC and 15-Scenes, have shown the advantage of BossaNova when compared to traditional techniques, even without using complex combinations of different local descriptors. An extension of our approach has also been studied. It concerns the combination of BossaNova representation with another representation very competitive based on Fisher Vectors. The results consistently reaches other state-of-the-art representations in many datasets. It also experimentally demonstrate the complementarity of the two approaches. This study allowed us to achieve, in the competition ImageCLEF 2012 Flickr Photo Annotation Task, the 2nd among the 28 visual submissions. Finally, we have explored our BossaNova representation in the challenging real-world application of pornography detection. Once again, the results validated the relevance of our approach compared to standard techniques on a real application.
Complete list of metadata

Cited literature [315 references]  Display  Hide  Download
Contributor : Matthieu Cord Connect in order to contact the contributor
Submitted on : Wednesday, March 12, 2014 - 5:24:00 PM
Last modification on : Sunday, June 26, 2022 - 9:40:54 AM
Long-term archiving on: : Thursday, June 12, 2014 - 12:06:00 PM


  • HAL Id : tel-00958547, version 1


Sandra Avila. EXTENDED BAG-OF-WORDS FORMALISM FOR IMAGE CLASSIFICATION. Computer Vision and Pattern Recognition [cs.CV]. Université Pierre et Marie Curie - Paris VI, 2013. English. ⟨tel-00958547⟩



Record views


Files downloads