ISCA Archive AVSP 2001
ISCA Archive AVSP 2001

Speechreading essentials: signal, paralinguistic cues, and skill

Björn Lidestam, Björn Lyxell

An overview of some results from our own studies on speechreading is presented. Focus is on paralinguistic cues that assist in perception of the spoken signal. We elaborate on how the contextual, and especially the emotional cues are utilised in speechreading. We further discuss which skills are important in integrating paralinguistic cues and the linguistic signal in speechreading. As a basis for this overview, empirical data as well as hypotheses under scrutiny in a present design are discussed. Finally, some practical implications regarding synthetic faces as communicative aids are discussed: how the speech should be presented, incorporation of paralinguistic cues into the design, and how to match user and aid.

Cite as: Lidestam, B., Lyxell, B. (2001) Speechreading essentials: signal, paralinguistic cues, and skill. Proc. Auditory-Visual Speech Processing, 1-6

  author={Björn Lidestam and Björn Lyxell},
  title={{Speechreading essentials: signal, paralinguistic cues, and skill}},
  booktitle={Proc. Auditory-Visual Speech Processing},