16th Annual Conference of the International Speech Communication Association

Dresden, Germany
September 6-10, 2015

A New Technique for Assessing Glottal Dynamics in Speech and Singing by Means of Optical-Flow Computation

Gustavo Andrade-Miranda (1), Nathalie Henrich Bernardoni (2), Juan Ignacio Godino-Llorente (1)

(1) Universidad Politécnica de Madrid, Spain
(2) GIPSA, France

The use of high-speed videoendoscopy (HSV) in combination with image-processing techniques is the most promising approach to investigate vocal-folds vibration and laryngeal dynamics in speech and singing. The current challenge is to provide facilitative and informative playbacks for clinical and research purposes. We present three new facilitative playbacks using an optical-flow framework (OF). Optical-flow techniques are widely used in the field of computer vision for tracking unidentified moving objects in video sequences. The application of OF computation to HSV images is investigated. The advantages, drawbacks, and the complementarity to existing methods are discussed. The method has been tested on a database of 60 HSV sequences which covers different voice qualities for spoken and sung vowels. The new data representations have been compared with commonly-used facilitative playbacks. They provide additional information on the temporal dynamics of glottal vibratory movements during glottal closing and opening phases.

Full Paper

Bibliographic reference.  Andrade-Miranda, Gustavo / Bernardoni, Nathalie Henrich / Godino-Llorente, Juan Ignacio (2015): "A new technique for assessing glottal dynamics in speech and singing by means of optical-flow computation", In INTERSPEECH-2015, 2182-2186.