INTERSPEECH 2004 - ICSLP
Two transcribers have labeled prosodic events independently on a subset of Switchboard corpus using adapted ToBI (TOnes and Break Indices) system. Transcriptions of two types of pitch accents (H* and L*), phrasal accents (H- and L-) and boundary tones (H% and L%) encoded independently by two transcribers are compared for intertranscriber reliability. Two commonly used methods of reliability measurement, 'transcriber-pair-word' comparison and the kappa statistic, are used for comparison with previous reports on the intertranscriber consistency. Comparison of the present results with those of previous reliability studies suggests that some higher agreement rates for this study may result from our adoption of fewer labeling distinctions in the transcription of pitch accent events. The results for phrase boundary labeling suggest that spontaneous speech of the type found in the Switchboard corpus is harder to code for the degree of disjuncture between prosodic domains than is read speech.
Bibliographic reference. Yoon, Tae-Jin / Chavarria, Sandra / Cole, Jennifer / Hasegawa-Johnson, Mark (2004): "Intertranscriber reliability of prosodic labeling on telephone conversation using toBI", In INTERSPEECH-2004, 2729-2732.