Authoring interactive media : a logical & temporal approach

Abstract : Interactive media design is a field which has been researched as soon as computers started showing audio-visual capabilities. A common research theme is the temporal specification of interactive media objects: how is it possible to create multimedia presentations whose schedule takes into account events external to the system.This problem is shared with another research field, which is interactive music and more precisely interactive scores. That is, musical works whose performance will evolve in time according to a given score.In both cases, it is necessary to specify the medias and musical data orchestrated by the system: this is the subject of the first part of this thesis, which presents a model tailored for the design of multimedia applications. This model allows to simplify distributed access and remote control questions, and solves documentation-related problems.Once this model has been defined, we construct by inspiration with well-known data-flow systems used in music programming, a computation structure able to control and orchestrate the applications defined previously, as well as handling audio-visual data input and output.Specifically, a notion of permanent environment is introduced in the data-flow model: it simplifies multiple use cases common when authoring interactive media and music, and improves performance when comparing to a purely node-based approach.Finally, a temporal graph structure is presented: it allows to score parts of the data graph in time. Especially, nodes of the data graph are studied in the context of both synchronous and delayed cases.A visual edition language is introduced to allow for authoring of interactive scores in a graphical model which unites the previously introduced elements.The temporal structure is then studied from the distribution point of view: we show in particular that it is possible to earn an additional expressive power by supposing a concurrent execution of specific objects of the temporal structure.Finally, we expose how the system is able to recreate multiple existing media systems: sequencers, live-loopers, patchers, as well as new multimedia behaviours.
Document type :
Theses
Complete list of metadatas

https://tel.archives-ouvertes.fr/tel-01947309
Contributor : Abes Star <>
Submitted on : Thursday, December 6, 2018 - 4:23:06 PM
Last modification on : Friday, January 18, 2019 - 11:50:21 AM
Long-term archiving on : Thursday, March 7, 2019 - 2:11:10 PM

File

CELERIER_JEAN-MICHAEL_2018.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-01947309, version 1

Citation

Jean-Michael Celerier. Authoring interactive media : a logical & temporal approach. Computation and Language [cs.CL]. Université de Bordeaux, 2018. English. ⟨NNT : 2018BORD0037⟩. ⟨tel-01947309⟩

Share

Metrics

Record views

146

Files downloads

227