8th International Conference on Spoken Language Processing

Jeju Island, Korea
October 4-8, 2004

Intertranscriber Reliability of Prosodic Labeling on Telephone Conversation Using ToBI

Tae-Jin Yoon, Sandra Chavarria, Jennifer Cole, Mark Hasegawa-Johnson

University of Illinois at Urbana-Champaign, USA

Two transcribers have labeled prosodic events independently on a subset of Switchboard corpus using adapted ToBI (TOnes and Break Indices) system. Transcriptions of two types of pitch accents (H* and L*), phrasal accents (H- and L-) and boundary tones (H% and L%) encoded independently by two transcribers are compared for intertranscriber reliability. Two commonly used methods of reliability measurement, 'transcriber-pair-word' comparison and the kappa statistic, are used for comparison with previous reports on the intertranscriber consistency. Comparison of the present results with those of previous reliability studies suggests that some higher agreement rates for this study may result from our adoption of fewer labeling distinctions in the transcription of pitch accent events. The results for phrase boundary labeling suggest that spontaneous speech of the type found in the Switchboard corpus is harder to code for the degree of disjuncture between prosodic domains than is read speech.

Full Paper

Bibliographic reference.  Yoon, Tae-Jin / Chavarria, Sandra / Cole, Jennifer / Hasegawa-Johnson, Mark (2004): "Intertranscriber reliability of prosodic labeling on telephone conversation using toBI", In INTERSPEECH-2004, 2729-2732.