Sixth European Conference on Speech Communication and Technology

Budapest, Hungary
September 5-9, 1999

On-line Captioning of TV-Programs for the Hearing Impaired

Erik Harborg (1), Trym Holter (1), Magne Hallstein Johnsen (2), Torbjon Svendsen (2)

(1) SINTEF Telecom and Informatics, (2) Norwegian University of Science and Technology, Trondheim, Norway

A system for on-line generation of closed captions for broadcast of live TV-programs is described. During broadcast, a commentator formulates a possibly condensed, but semantically correct version of the original speech. These compressed phrases are recognized by a continuous speech recognizer, and the resulting captions are directly fed into the teletext system. This application will provide the hearing impaired with an option to read captions for live broadcast programs, i.e., when off-line captioning is not feasible. The main advantage in using a speech recognizer rather than a stenography-based system (e.g., Velotype) is the relaxed requirements for operator training. Also, the amount of text generated by a system based on stenography tends to be large, thus making it harder to read.

Full Paper (PDF)   Gnu-Zipped Postscript

Bibliographic reference.  Harborg, Erik / Holter, Trym / Johnsen, Magne Hallstein / Svendsen, Torbjon (1999): "On-line captioning of TV-programs for the hearing impaired", In EUROSPEECH'99, 567-570.