Skip to Main content Skip to Navigation
Habilitation à diriger des recherches

Real-time Programming and Processing of Music Signals

Arshia Cont 1, 2 
1 MuTant - Synchronous Realtime Processing and Programming of Music Signals
IRCAM - Institut de Recherche et Coordination Acoustique/Musique, Inria Paris-Rocquencourt, UPMC - Université Pierre et Marie Curie - Paris 6, CNRS - Centre National de la Recherche Scientifique
Abstract : My research and supervision activities since my PhD defense in October 2008 lies at the intersection and union of real-time machine listening and real-time synchronous music computing, two disjoint literatures whose conjunction is more than obvious in interactive computer music practices and whose coupling has rarely been addressed. It aims at fostering research in each respective domain and providing tools to composers and artists to elevate their music-making and performance capabilities with computers to that of their human counterparts. The first aspect of any interactive music system is the act of machine listening or formally speaking, online music information retrieval. I attempted to focus my work on application-driven approaches such as real-time polyphonic pitch detection and real-time alignment techniques on one hand, and theoretical by attempting to address fundamental problems in representational frontends of such systems. Within the first aspect, we proposed two state-of-the-art approaches for the aforementioned application domains renown by their use by the artistic community and their recognition within the MIR community. The second aspect deals with the fundamental problem of quantification and qualification of information content as they arrive incrementally into a system using methods of information geometry. The second and more recent aspect of my work focuses on reactive synchronous programming coupled to machine listening systems or the formalization of reactions in interactive systems to artificial perceptions in real-time. Our approach is motivated by current practices in digital arts for authoring or programming and their real-time evaluation in interaction with a changing environment. The major incarnation of this approach is the Antescofo system and language, running publicly since 2009, which has established itself worldwide within the mixed music repertoire. Authoring of time and interaction and attempting to assure their correct and timely execution in real-time with human performers (through machine perception) pose challenging problems to computer science and system designers that will be the focus of my work in the years to come, under the auspice of Cyber-Physical Music Systems. Coupling of machine listening with computer languages requires augmenting current approaches with formal models of time, leveraging the dominating functional approach with reaction and execution requirements and a possible re-thinking of widely accepted audio processing methods and systems with regards to time.
Complete list of metadata

https://tel.archives-ouvertes.fr/tel-00829771
Contributor : Arshia Cont Connect in order to contact the contributor
Submitted on : Monday, June 3, 2013 - 4:53:44 PM
Last modification on : Tuesday, March 15, 2022 - 3:22:22 AM
Long-term archiving on: : Tuesday, April 4, 2017 - 3:52:11 PM

Identifiers

  • HAL Id : tel-00829771, version 1

Citation

Arshia Cont. Real-time Programming and Processing of Music Signals. Sound [cs.SD]. Université Pierre et Marie Curie - Paris VI, 2013. ⟨tel-00829771⟩

Share

Metrics

Record views

502

Files downloads

1676