HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation

Authoring interactive media : a logical & temporal approach

Abstract : Interactive media design is a field which has been researched as soon as computers started showing audio-visual capabilities. A common research theme is the temporal specification of interactive media objects: how is it possible to create multimedia presentations whose schedule takes into account events external to the system.This problem is shared with another research field, which is interactive music and more precisely interactive scores. That is, musical works whose performance will evolve in time according to a given score.In both cases, it is necessary to specify the medias and musical data orchestrated by the system: this is the subject of the first part of this thesis, which presents a model tailored for the design of multimedia applications. This model allows to simplify distributed access and remote control questions, and solves documentation-related problems.Once this model has been defined, we construct by inspiration with well-known data-flow systems used in music programming, a computation structure able to control and orchestrate the applications defined previously, as well as handling audio-visual data input and output.Specifically, a notion of permanent environment is introduced in the data-flow model: it simplifies multiple use cases common when authoring interactive media and music, and improves performance when comparing to a purely node-based approach.Finally, a temporal graph structure is presented: it allows to score parts of the data graph in time. Especially, nodes of the data graph are studied in the context of both synchronous and delayed cases.A visual edition language is introduced to allow for authoring of interactive scores in a graphical model which unites the previously introduced elements.The temporal structure is then studied from the distribution point of view: we show in particular that it is possible to earn an additional expressive power by supposing a concurrent execution of specific objects of the temporal structure.Finally, we expose how the system is able to recreate multiple existing media systems: sequencers, live-loopers, patchers, as well as new multimedia behaviours.
Document type :
Complete list of metadata

Contributor : Abes Star :  Contact
Submitted on : Thursday, December 6, 2018 - 4:23:06 PM
Last modification on : Tuesday, January 4, 2022 - 5:36:06 AM
Long-term archiving on: : Thursday, March 7, 2019 - 2:11:10 PM


Version validated by the jury (STAR)


  • HAL Id : tel-01947309, version 1



Jean-Michael Celerier. Authoring interactive media : a logical & temporal approach. Computation and Language [cs.CL]. Université de Bordeaux, 2018. English. ⟨NNT : 2018BORD0037⟩. ⟨tel-01947309⟩



Record views


Files downloads