Auditory-Visual Speech Processing
(AVSP 2001)

September 7-9, 2001
Aalborg, Denmark

Speechreading Essentials: Signal, Paralinguistic Cues, and Skill

Björn Lidestam, Björn Lyxell

Department of Behavioural Sciences, Linköping University, Linköping, Sweden

An overview of some results from our own studies on speechreading is presented. Focus is on paralinguistic cues that assist in perception of the spoken signal. We elaborate on how the contextual, and especially the emotional cues are utilised in speechreading. We further discuss which skills are important in integrating paralinguistic cues and the linguistic signal in speechreading. As a basis for this overview, empirical data as well as hypotheses under scrutiny in a present design are discussed. Finally, some practical implications regarding synthetic faces as communicative aids are discussed: how the speech should be presented, incorporation of paralinguistic cues into the design, and how to match user and aid.


Full Paper

Bibliographic reference.  Lidestam, Björn / Lyxell, Björn (2001): "Speechreading essentials: signal, paralinguistic cues, and skill", In AVSP-2001, 1-6.