Auditory-Visual Speech Processing (AVSP) 2010
Hakone, Kanagawa, Japan
Previous studies showed that the time-expanded speech signal and the cue of moving image of talkers face improve speech intelligibility. Sakamoto et al. (2008) investigated the detection thresholds of auditory-visual asynchrony for timeexpanded speech and a moving image of the talkers face. Their results showed that detection thresholds in longer words were higher than those for shorter words. However, it is not clear whether the results are associated with the difference of number of mora or whole word length of stimuli. In this study, we examined detection thresholds of auditory-visual asynchrony between time-expanded speech and moving image of the talkers face by using words that have different numbers of mora but the same duration. The results revealed that there is no significant difference in the detection thresholds between words with the smaller number of mora and words with longer number of mora. Thus, our results suggests that word length, not the number of mora, affects the detection thresholds between auditory and visual stimuli.
Index Terms: audio-visual asynchrony, detection rate, timeexpanded speech
Bibliographic reference. Miyazawa, Shiho / Tanaka, Akihiro / Sakamoto, Shuichi / Nishimoto, Takehiko (2010): "Effects of speech-rate conversion on asynchrony perception of audio-visual speech", In AVSP-2010, paper P16.