Synthesis of Music Performances: Virtual Character Animation as a Controller of Sound Synthesis

Abstract : The last few decades have witnessed the emergence of a plethora of musical interfaces aiming at expanding musical performance experiences. The design of these interfaces generally emphasizes the expertise of musicians in managing heterogenous sensory informations (visual, sound and tactile). Such musical interfaces involve therefore the processing of these various sensory data for designing novel interaction modes. This thesis addresses more specifically the analysis, modeling and synthesis of percussion performances. We propose a system that realizes the synthesis of the visual and sound feedback of percussion performances in which a virtual percussionist controls sound synthe- sis processes. The analysis step of our work shows the importance of the fine control of mallet extremity trajectories by expert percussion performers playing timpani. It includes the collection of instrumental gesture data from several per- cussionists. We extract movement parameters from the recorded mallet extremity trajectories for different per- cussion playing variations. Such parameters are quan- titatively evaluated with respect to their ability to repre- sent the various playing variations under study. We then propose a system for synthesizing timpani performances involving the physical modeling of a vir- tual percussionist that interacts with sound synthesis processes. The physical framework includes a novel scheme for controlling the motion of the virtual percus- sionist solely by the specification of trajectories of mal- let tips. This control mode is shown to be consistent with the predominant control of mallet extremity pre- sented in the previous analysis step. The physical ap- proach is also used for allowing the virtual percussionist to interact with a physical model of a timpani. Finally, the proposed system is used in a musical performance perspective. A composition process based on gesture scores is proposed to achieve the synthesis of novel percussion performances. Such gesture scores are obtained by the assembly and articulation of gesture units available in the recorded data. This compositional approach is applied to the synthesis of several percussion exercises, and is informally evaluated by a percussion professor.
Document type :
Theses
Complete list of metadatas

https://tel.archives-ouvertes.fr/tel-00497292
Contributor : Alexandre Bouënard <>
Submitted on : Saturday, July 3, 2010 - 7:17:58 PM
Last modification on : Monday, December 24, 2018 - 5:35:08 PM
Long-term archiving on : Tuesday, October 23, 2012 - 9:40:09 AM

Identifiers

  • HAL Id : tel-00497292, version 1

Citation

Alexandre Bouënard. Synthesis of Music Performances: Virtual Character Animation as a Controller of Sound Synthesis. Modeling and Simulation. Université de Bretagne Sud; Université Européenne de Bretagne, 2009. English. ⟨tel-00497292⟩

Share

Metrics

Record views

325

Files downloads

421