Automatic transcription and separation of the main melody in polyphonic music signals

Abstract : We propose to address the problem of melody extraction along with the monaural lead instrument and accompaniment separation problem. The first task is related to Music Information Retrieval (MIR), since it aims at indexing the audio music signals with their melody. The separation problem is related to Blind Audio Source Separation (BASS), as it aims at breaking an audio mixture into several source tracks. Leading instrument source separation and main melody extraction are addressed within a unified framework. The lead instrument is modelled thanks to a source/filter production model. Its signal is generated by two hidden states, the filter state and the source state. The proposed signal spectral model therefore explicitly uses pitches both to separate the lead instrument from the others and to transcribe the pitch sequence played by that instrument, the "main melody". This model gives rise to two alternative models, a Gaussian Scaled Mixture Model (GSMM) and the Instantaneous Mixture Model (IMM). The accompaniment is modelled with a more general spectral model. Five systems are proposed. Three systems detect the fundamental frequency sequence of the lead instrument, i.e. they estimate the main melody. A system returns a musical melody transcription and the last system separates the lead instrument from the accompaniment. The results in melody transcription and source separation are at the state of the art, as shown by our participations to international evaluation campaigns (MIREX'08, MIREX'09 and SiSEC'08). The proposed extension of previous source separation works using "MIR" knowledge is therefore a very successful combination.
Complete list of metadatas

Cited literature [6 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-00560018
Contributor : Jean-Louis Durrieu <>
Submitted on : Thursday, January 27, 2011 - 2:41:08 AM
Last modification on : Thursday, October 17, 2019 - 12:36:07 PM
Long-term archiving on : Tuesday, November 6, 2012 - 12:30:18 PM

Identifiers

  • HAL Id : tel-00560018, version 1

Citation

Jean-Louis Durrieu. Automatic transcription and separation of the main melody in polyphonic music signals. Signal and Image processing. Ecole nationale supérieure des telecommunications - ENST, 2010. English. ⟨tel-00560018⟩

Share

Metrics

Record views

493

Files downloads

305