11th Annual Conference of the International Speech Communication Association

Makuhari, Chiba, Japan
September 26-30. 2010

Influence of Gestural Salience on the Interpretation of Spoken Requests

Gideon Kowadlo, Patrick Ye, Ingrid Zukerman

Monash University, Australia

We present a probabilistic, salience-based mechanism for the interpretation of pointing gestures together with spoken utterances. Our formulation models dependencies between spatial and temporal aspects of gestures and features of objects. The results from our corpus-based evaluation show that the incorporation of pointing information improves interpretation accuracy.

Full Paper

Bibliographic reference.  Kowadlo, Gideon / Ye, Patrick / Zukerman, Ingrid (2010): "Influence of gestural salience on the interpretation of spoken requests", In INTERSPEECH-2010, 2034-2037.