Third International Conference on Spoken Language Processing (ICSLP 94)
We investigate the effects of visually presented words and non-words on the auditory perception of phonemes. The subjects in our experiments heard four-mora Japanese words and non-words, in which the third mora was partially or totally obscured by noise. The subjects' task was to perceive the missing or degraded mora. Concurrent with the auditory presentation, a word or non-word written in Kana (the Japanese syllabary) or Kanji (Chinese characters) was presented visually. The results confirm that visually presented words and non-words influence phoneme perception in auditory words and non-words. In cases where there is more than one candidate for the perceived phoneme due to ambiguity of auditory processing, visual information is used to decide the most appropriate phoneme, if the visual and auditory stimuli are related to each other either phonologically or semantically. These results can be explained by a model of auditory and visual word perception.
Bibliographic reference. Kondo, Tadahisa / Kakehi, Kazuhiko (1994): "Effects of phonological and semantic information of kanji and kana characters on speech perception", In ICSLP-1994, 535-538.