Vokinesis : instrument de contrôle suprasegmental de la synthèse vocale

Abstract : This work belongs to the field of performative control of voice synthesis, and more precisely of real-time modification of pre-recorded voice signals. In a context where such systems were only capable of modifying parameters such as pitch, duration and voice quality, our work was carried around the question of performative modification of voice rhythm. One significant part of this thesis has been devoted to the development of Vokinesis, a program for performative modification of pre-recorded voice. It has been developed under 4 goals: to allow for voice rhythm control, to obtain a modular system, usable in public performances situations as well as for research applications. To achieve this development, a reflexion about the nature of voice rhythm and how it should be controlled has been carried out. It appeared that the basic inter-linguistic rhtyhmic unit is syllable-sized, but that syllabification rules are too language-dependant to provide a invariant inter-linguistic rhythmic pattern. We showed that accurate and expressive sequencing of vocal rhythm is performed by controlling the timing of two phases, which together form a rhythmic group: the rhythmic nucleus and the rhythmic link. We developed several rhythm control methods, tested with several control interfaces. An objective evaluation showed that one of our methods allows for very accurate control of rhythm. New strategies for voice pitch and quality control with a graphic tablet have been established. A reflexion about the pertinence of graphic tablets for pitch control, regarding the rise of new continuous musical interfaces, lead us to the conclusion that they best fit intonation control (speech), but that PMC (Polyphonic Multidimensional controllers) are better for melodic control (singing, or other instruments).The development of Vokinesis also required the implementation of the VoPTiQ (Voice Pitch, Time and Quality modification) signal processing method, which combines an adaptation of the RT-PSOLA algorithm and some specific filtering techniques for voice quality modulations. The use of Vokinesis as a musical instrument has been successfully evaluated in public representations of the Chorus Digitalis ensemble, for various singing styles (from pop to contemporary music). Its use for electro music has also been explored by interfacing the Ableton Live composition environnment with Vokinesis. Application perspectives are diverse: scientific studies (research in prosody, expressive speech, neurosciences), sound and music production, language learning and teaching, speech therapies.
Complete list of metadatas

Cited literature [146 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-01826621
Contributor : Abes Star <>
Submitted on : Friday, June 29, 2018 - 3:41:07 PM
Last modification on : Friday, May 17, 2019 - 3:55:54 AM

File

75280_DELALEZ_2017_diffusion.p...
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-01826621, version 1

Citation

Samuel Delalez. Vokinesis : instrument de contrôle suprasegmental de la synthèse vocale. Informatique et langage [cs.CL]. Université Paris-Saclay, 2017. Français. ⟨NNT : 2017SACLS458⟩. ⟨tel-01826621⟩

Share

Metrics

Record views

176

Files downloads

170