Auditory-Visual Speech Processing (AVSP'99)

August 7-10, 1999
Santa Cruz, CA, USA

Developing a 3D-Agent for the August Dialogue System

Magnus Lundeberg, Jonas Beskow

Centre for Speech Technology, KTH, Stockholm, Sweden

In our continuing work with multimodal text-to-speech synthesis with high quality for speechreading, a new talking head has been developed with the purpose of acting as an interactive agent in a dialogue system, set up in a public exhibition area in downtown Stockholm. The new agent conforms to the same set of basic control parameters as our earlier faces, allowing us to control it using existing rules for visual speech synthesis. To add to the realism and believability of the dialogue system, the agent has been given a rich repertoire of extra-linguistic gestures and expressions, including emotional cues, turn-taking signals and prosodic cues such as punctuators and emphasizers. Studies of user reactions indicated that people have a positive attitude towards our new agent.

Full Paper

Bibliographic reference.  Lundeberg, Magnus / Beskow, Jonas (1999): "Developing a 3D-Agent For The August dialogue system", In AVSP-1999, paper #26.

Multimedia Files

Link Original Filename Description Format
(4513 KB)
lundeberg-lt.mpg August listening, thinking and answering 'Yes?' Video File: MPEG
(2485 KB)
lundeberg-regelbundna.mpg August reading a quotation of Strindberg. (Translation: Symmetrical works of art easily become dull just like symmetrical beauties; impeccable or flawless people are often unbearable.) Video File: MPEG