11th Annual Conference of the International Speech Communication Association

Makuhari, Chiba, Japan
September 26-30. 2010

Classroom Note-Taking System for Hearing Impaired Students Using Automatic Speech Recognition Adapted to Lectures

Tatsuya Kawahara, Norihiro Katsumaru, Yuya Akita, Shinsuke Mori

Kyoto University, Japan

We are developing a real-time lecture transcription system for hearing impaired students in university classrooms. The automatic speech recognition (ASR) system is adapted to individual lecture courses and lecturers, to enhance the recognition accuracy. The ASR results are selectively corrected by a human editor, through a dedicated interface, before presenting to the students. An efficient adaptation scheme of the ASR modules has been investigated in this work. The system was tested for a hearing-impaired student in a lecture course on civil engineering. Compared with the current manual note-taking scheme offered by two volunteers, the proposed system generated almost double amount of texts with one human editor.

Full Paper

Bibliographic reference.  Kawahara, Tatsuya / Katsumaru, Norihiro / Akita, Yuya / Mori, Shinsuke (2010): "Classroom note-taking system for hearing impaired students using automatic speech recognition adapted to lectures", In INTERSPEECH-2010, 626-629.