15th Annual Conference of the International Speech Communication Association

September 14-18, 2014

An Educational Platform to Capture, Visualize and Analyze Rare Singing

P. Chawah (1), S. K. Al Kork (2), T. Fux (1), Martine Adda-Decker (1), A. Amelot (1), N. Audibert (1), B. Denby (2), G. Dreyfus (3), A. Jaumard-Hakoun (2), C. Pillot-Loiseau (1), P. Roussel (3), M. Stone (4), Kele Xu (2), L. Crevier-Buchman (1)

(1) LPP (UMR 7018), France
(2) UPMC, France
(3) SIGMA (UMR 7084), France
(4) University of Maryland, USA

This paper presents an early version of an open extendable research and educational platform to support users in learning and mastering the different types of rare-singing. The platform is interfaced with a portable helmet to synchronously capture multiple signals during singing in a non-laboratory environment. Collected signals reflect articulatory movements and induced vibrations. The platform consists of four main modules: i) a capture and recording module, ii) a data replay (post processing) module, iii) an acoustic auto adaptation learning module, iv) and a 3D visualization sensory motor learning module. Our demo will focus on the first two modules. The system has been tested on two rare endangered singing musical styles, the Corsican “Cantu in Paghjella”, and the Byzantine hymns from Mount Athos, Greece. The versatility of the approach is further demonstrated by capturing a contemporary singing style known as “Human Beat Box.”

Full Paper

Bibliographic reference.  Chawah, P. / Kork, S. K. Al / Fux, T. / Adda-Decker, Martine / Amelot, A. / Audibert, N. / Denby, B. / Dreyfus, G. / Jaumard-Hakoun, A. / Pillot-Loiseau, C. / Roussel, P. / Stone, M. / Xu, Kele / Crevier-Buchman, L. (2014): "An educational platform to capture, visualize and analyze rare singing", In INTERSPEECH-2014, 2128-2129.