We have developed a multimodal speech behavior corpus which includes metadata annotated from various viewpoints such as, utterances, actions, emotions and intention for analyzing behavioral factors of thinking processes from various perspectives in everyday life. Utilizing the corpus, we analyzed child development of situation understanding skills focused on "attention-catching" that has a role as a signal when communicating with other people. We formulated a hypothesis of the developmental process that there is a connection between physical expression skills and mental conditions such as utterances, gestures and the attention ability. The analysis results showed that the situation understanding skills follow the similar development, which is a change of object-centric to person-centric, despite the age of developmental change is different. Furthermore, the analysis results provided us with a more in-depth construction of the corpus.
Bibliographic reference. Ishikawa, Shogo / Kiriyama, Shinya / Takebayashi, Yoichi / Kitazawa, Shigeyoshi (2010): "How children acquire situation understanding skills?: a developmental analysis utilizing multimodal speech behavior corpus", In INTERSPEECH-2010, 1926-1929.