ISCA Workshop on Statistical And Perceptual Audition Makuhari, Japan September 25, 2010

Musical Instrument Identification based on Harmonic Temporal Timbre Features

Jun Wu, Yu Kitano, Stanislaw Andrzej Raczynski, Shigeki Miyabe,, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama

The Graduate School of Information Science and Technology, University of Tokyo, Japan

The Music Instrument Identification research is an important and difficult problem in Music Information Retrieval (MIR). In this paper an algorithm based on flexible harmonic model is proposed to represent the pitch in music by Gaussian mixture structure. The proposed algorithm models each spectral envelope of underlying harmonic structure to approximate the real music and uses EM algorithm to estimate the parameters. Not only is it able to estimate the multipitch (F0) but it also takes the attack problem (a kind of inharmonic structure at the beginning of some pitches) into account. The proposed algorithm makes it possible to envisage the use of timbre features derived from both harmonic part and attack part. Musical instrument recognition is then carried out by using SVM classifier. Experiment shows high performance of the proposed algorithm for instrument identification task.

Full Paper

Bibliographic reference.  Wu, Jun / Kitano, Yu / Raczynski, Stanislaw Andrzej / Miyabe, Shigeki / , Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama / Nishimoto, Takuya / Ono, Nobutaka / Sagayama, Shigeki (2010): "Musical instrument identification based on harmonic temporal timbre features", In SAPA-2010, 7-12.