FAAVSP - The 1st Joint Conference on Facial Analysis, Animation, and
Auditory-Visual Speech Processing

Vienna, Austria
September 11-13, 2015

Delayed Auditory Feedback with Static and Dynamic Visual Feedback

Elizabeth Stelle (1), Caroline L. Smith (2), Eric Vatikiotis-Bateson (1)

(1) The University of British Columbia, Canada
(2) The University of New Mexico, USA

Visual speech information influences the accuracy and content of auditory speech perception, with both the static and dynamic components of the visual signal playing a role. However, less is known about the effect of visual information when it is presented as a source of speech production feedback. This paper presents results from a delayed auditory feedback paradigm which contrasted the presentation of static and dynamic visual feedback. Participants repeated short sentences in six conditions, and speech rate and speech errors were measured. Speech rate was reliably reduced when dynamic visual feedback was paired with delayed auditory feedback, and there was a weak effect for speech errors, which were reduced when dynamic visual feedback was paired with normal auditory feedback. Withincondition trends raise questions about adaptation to different types of feedback. Our results suggest that dynamic, but not static, visual feedback affects speech production. Even if the auditory and visual feedback are misaligned, it is important that temporal dynamics be present in both signals. Index Terms: speech production, visual feedback, delayed auditory feedback

Full Paper

Bibliographic reference.  Stelle, Elizabeth / Smith, Caroline L. / Vatikiotis-Bateson, Eric (2015): "Delayed auditory feedback with static and dynamic visual feedback", In FAAVSP-2015, 40-45.