Auditory-Visual Speech Processing (AVSP'98) December 4-6, 1998 Terrigal - Sydney, Australia

Real-time Talking Head Driven by Voice and its Application to Communication and Entertainment

Shigeo Morishima

Seikei University, (Japan)

Recently computer can make cyberspace to walk through by an interactive virtual reality technique. An avatar in cyberspace can bring us a virtual face-to-face communication environment. In this paper, we realize an avatar which has a real face in cyberspace and construct a multi-user communication system by voice transmission through network. Voice from microphone is transmitted and analyzed, then mouth shape and facial expression of avatar are synchronously estimated and synthesized on real time. and also we introduce an entertainment application of a real-time voice driven synthetic face. This project is named "Fifteen Seconds of Fame" which is an example of interactive movie.

Full Paper

Bibliographic reference.  Morishima, Shigeo (1998): "Real-time talking head driven by voice and its application to communication and entertainment", In AVSP-1998, 195-200.

Multimedia Files