ISCA Archive Interspeech 2013
ISCA Archive Interspeech 2013

Interacting with robots via speech and gestures, an integrated architecture

Francesco Cutugno, Alberto Finzi, Michelangelo Fiore, Enrico Leone, Silvia Rossi

Effective human-robot communication is one of the main concerns in modern robotics. Involved systems should be very robust, allowing little chance for misunderstanding users commands. The main purpose of this work is to develop a general framework for multimodal human-robot communication, which allows users to interact with robots using speech and gestures, integrated into unique commands. The produced architecture relies on the definition of different modules separately analysing the low level inputs and presenting a further fusion module able to extract semantics from these multiple channels. In this paper, we introduce our general approach and provide a case study where gesture and speech modalities are combined.


doi: 10.21437/Interspeech.2013-587

Cite as: Cutugno, F., Finzi, A., Fiore, M., Leone, E., Rossi, S. (2013) Interacting with robots via speech and gestures, an integrated architecture. Proc. Interspeech 2013, 3727-3731, doi: 10.21437/Interspeech.2013-587

@inproceedings{cutugno13_interspeech,
  author={Francesco Cutugno and Alberto Finzi and Michelangelo Fiore and Enrico Leone and Silvia Rossi},
  title={{Interacting with robots via speech and gestures, an integrated architecture}},
  year=2013,
  booktitle={Proc. Interspeech 2013},
  pages={3727--3731},
  doi={10.21437/Interspeech.2013-587}
}