Auditory-Visual Speech Processing (AVSP) 2010
Hakone, Kanagawa, Japan
We have developed a multimodal speech behavior corpus in order to clarify fundamental features of speech interaction. We focused on child development because childrens thinking tends to be expressed in their behavior. Utilizing the corpus, we analyzed child development of situation understanding skills focused on attention-catching that has a role as a signal when communicating with other people. We formulated a hypothesis of the mental developmental process based on physical expression skills. The results of the multimodal analysis show that our method is an effective way of in-depth analysis of thinking process in attention-catching behavior.
Index Terms: multimodal analysis, speech behavior corpus, child development, attention-catching
Bibliographic reference. Ishikawa, Shogo / Kiriyama, Shinya / Takebayashi, Yoichi / Kitazawa, Shigeyoshi (2010): "The multimodal analysis for understanding child behavior focused on attention-catching", In AVSP-2010, paper P14.