Machine Listening in Multisource Environments (CHiME) 2011 Florence, Italy September 1, 2011

Designing Multimodal Acoustic Environment Corpus to Improve Speech Interaction in Living Room

Kenichi Shibata, Kengo Ikeya, Yuki Deguchi, Yoichi Takebayashi, Shigeyoshi Kitazawa, Shinya Kiriyama

Shizuoka University, Japan

We constructed a multimodal acoustic environment corpus for interaction design. The intelligent environment consists of a living room interacting with different users and adapting it to their preferences. We developed a speech interaction system to control electrical appliances in the living room, and to record and accumulate real-life interaction data to the corpus. The results of interaction analysis indicated that the constructed corpus was effective in investigating the actual conditions of real-life interaction using speech interfaces.

Index Terms. multimodal acoustic environment corpus, speech interaction design, situation understanding, user environment adaptation

Full Paper

Bibliographic reference.  Shibata, Kenichi / Ikeya, Kengo / Deguchi, Yuki / Takebayashi, Yoichi / Kitazawa, Shigeyoshi / Kiriyama, Shinya (2011): "Designing multimodal acoustic environment corpus to improve speech interaction in living room", In CHiME-2011, 51-52.