Auditory-Visual Speech Processing (AVSP'98)

December 4-6, 1998
Terrigal - Sydney, Australia

Real-time Talking Head Driven by Voice and its Application to Communication and Entertainment

Shigeo Morishima

Seikei University, (Japan)

Recently computer can make cyberspace to walk through by an interactive virtual reality technique. An avatar in cyberspace can bring us a virtual face-to-face communication environment. In this paper, we realize an avatar which has a real face in cyberspace and construct a multi-user communication system by voice transmission through network. Voice from microphone is transmitted and analyzed, then mouth shape and facial expression of avatar are synchronously estimated and synthesized on real time. and also we introduce an entertainment application of a real-time voice driven synthetic face. This project is named "Fifteen Seconds of Fame" which is an example of interactive movie.


Full Paper

Bibliographic reference.  Morishima, Shigeo (1998): "Real-time talking head driven by voice and its application to communication and entertainment", In AVSP-1998, 195-200.

Multimedia Files

Link Original Filename Description Format
av98_195_1.mpg (1333 KB) shigeoDemo1.mpg This file is Demonstration Movie File. (part 1) Video File: MPEG, 80 s
av98_195_2.mpg (1333 KB) shigeoDemo1.mpg This file is Demonstration Movie File. (part 2) Video File: MPEG, 20 s
av98_195_3.mpg (1333 KB) shigeoDemo1.mpg This file is Demonstration Movie File. (part 3) Video File: MPEG, 14 s