ISCA Archive Interspeech 2008
ISCA Archive Interspeech 2008

Detection of feeling through back-channels in spoken dialogue

Tatsuya Kawahara, Masayoshi Toyokura, Teruhisa Misu, Chiori Hori

We investigate the usage of back-channel information in the information navigation dialogue between an expert guide and a user. By back-channel feedback, we mean the user's verbal short response, which expresses his state of the mind during the dialogue. Its prototypical lexical entries include "hai" in Japanese and "yes" or "right" in English, however, we do not count explicit affirmative responses as back-channels.

Previously, there were several works[1, 2] which attempted to automatically generate back-channel responses for smooth communication between the user and the system. Recently, the back-channel information is included in the framework of dialogue act tagging in the game-playing dialogue[3] and meetings[4]. In the information navigation dialogue, in which an expert guide presents a list of recommendation spots, it is expected that the prosodic pattern of the back-channel conveys the para-linguistic information, that is, it suggests the positive/ negative feeling on the recommended candidate. We also presume that the human expert guide detects such feelings expressed via back-channels, and chooses to continue the explanation of the current topic if the user seems interested, or change the topic otherwise. Thus, we investigate the back-channel patterns observed in the Kyoto Tour Guide Dialog Corpus.

s N.Ward. Using prosodic clues to decide when to produce backchannel utterances. In Proc. ICSLP, pages 1728-1731, 1996. N.Kitaoka, M.Takeuchi, R.Nishimura, and S.Nakagawa. Response timing detection using prosodic and linguistic information for human-friendly spoken dialog systems. J. Japanese Society for Artificial Intelligence, 20(3):220-228, 2005. A.Gravano, S.Benus, J.Hirschberg, S.Mitchell, and I.Vovsha. Classification of discourse functions of affirmative words in spoken dialogue. In Proc. INTERSPEECH, pages 1613-1616, 2007. F.Yang, G.Tur, and E.Shriberg. Exploiting dialog act tagging and prosodic information for action item identification. In Proc. IEEE-ICASSP, pages 4941-4944, 2008.

Cite as: Kawahara, T., Toyokura, M., Misu, T., Hori, C. (2008) Detection of feeling through back-channels in spoken dialogue. Proc. Interspeech 2008, 1696

  author={Tatsuya Kawahara and Masayoshi Toyokura and Teruhisa Misu and Chiori Hori},
  title={{Detection of feeling through back-channels in spoken dialogue}},
  booktitle={Proc. Interspeech 2008},