10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

Eye Tracking for the Online Evaluation of Prosody in Speech Synthesis: Not So Fast!

Michael White, Rajakrishnan Rajkumar, Kiwako Ito, Shari R. Speer

Ohio State University, USA

This paper presents an eye-tracking experiment comparing the processing of different accent patterns in unit selection synthesis and human speech. The synthetic speech results failed to replicate the facilitative effect of contextually appropriate accent patterns found with human speech, while producing a more robust intonational garden-path effect with contextually inappropriate patterns, both of which could be due to processing delays seen with the synthetic speech. As the synthetic speech was of high quality, the results indicate that eye tracking holds promise as a highly sensitive and objective method for the online evaluation of prosody in speech synthesis.

Full Paper

Bibliographic reference.  White, Michael / Rajkumar, Rajakrishnan / Ito, Kiwako / Speer, Shari R. (2009): "Eye tracking for the online evaluation of prosody in speech synthesis: not so fast!", In INTERSPEECH-2009, 2523-2526.