AVSP 2003 - International Conference on Audio-Visual Speech Processing

September 4-7, 2003
St. Jorioz, France

Perception of Point Light Displays of Speech by Normal-Hearing Adults and Deaf Adults with Cochlear Implants

Tonya R. Bergeson (2), David B. Pisoni (1,2), Jeffrey T. Reynolds (1)

(1) Indiana University School of Medicine, Department of Otolaryngology, Indianapolis, IN, USA
(2) Department of Psychology, Indiana University, Bloomington, Indiana, USA

Normal-hearing (NH) adults display audiovisual enhancement when degraded auditory input (e.g., words, sentences) is paired with point -light displays (PLDs) of speech, which isolate the kinematic properties of a speakerís face [10]. Do deaf adults who use cochlear implants (CIs) benefit in the same way? Does feedback influence NH adultsí performance? In the present study, we investigated audiovisual (AV) word recognition using PLDs of speech in postlingually deaf adults with CIs and NH adults. Both groups displayed evidence of AV enhancement with PLDs. Moreover, NH participants Visual-alone performance improved over time with Auditory-alone and AV feedback. These results suggest that NH and CI adults were sensitive to the kinematic properties in speech represented in the PLDs, and they were able to use kinematics to improve their word recognition performance even with highly degraded visual displays of speech. In addition, NH adults were able to use temporal cues from Auditory-alone and AV feedback to improve their word recognition performance with point-light visual displays of speech.

Full Paper

Bibliographic reference.  Bergeson, Tonya R. / Pisoni, David B. / Reynolds, Jeffrey T. (2003): "Perception of point light displays of speech by normal-hearing adults and deaf adults with cochlear implants", In AVSP 2003, 55-60.