Designing interaction for browsing media collections (by similarity)

Abstract : Sound designers source sounds in massive and heavily tagged collections. When searching for media content, once queries are filtered by keywords, hundreds of items are left to be reviewed. How can we present these results efficiently? This doctoral work aims at improving the usability of browsers of media collections by blending techniques from multimedia information retrieval (MIR) and human-computer interaction (HCI). We produced an in-depth state-of-the-art on media browsers. We overviewed HCI and MIR techniques that support our work: organization by content-based similarity (MIR), information visualization and gestural interaction (HCI). We developed the MediaCycle framework for organization by content-based similarity and the DeviceCycle toolbox for rapid prototyping of gestural interaction, both facilitated the design of several media browsers. We evaluated the usability of some of our media browsers. Our main contribution is AudioMetro, an interactive visualization of sound collections. Sounds are represented by content-based glyphs, mapping perceptual sharpness (audio) to brightness and contour (visual). These glyphs are positioned in a starfield display using Student t-distributed Stochastic Neighbor Embedding (tSNE) for dimension reduction, then a proximity grid optimized for preserving direct neighbors. Known-item search evaluation shows that our technique significantly outperforms a grid of sounds represented by dots and ordered by filename.
Complete list of metadatas

https://tel.archives-ouvertes.fr/tel-01570858
Contributor : Christian Frisson <>
Submitted on : Tuesday, August 1, 2017 - 12:05:24 AM
Last modification on : Tuesday, February 12, 2019 - 12:06:03 PM

Licence


Distributed under a Creative Commons Attribution - ShareAlike 4.0 International License

Identifiers

  • HAL Id : tel-01570858, version 1

Collections

Citation

Christian Frisson. Designing interaction for browsing media collections (by similarity). Human-Computer Interaction [cs.HC]. Université de Mons; Université de Mons, Belgique, 2015. English. ⟨tel-01570858⟩

Share

Metrics

Record views

160

Files downloads

207