Talking to a system and oneself: A study from a speech-to-speech, machine translation mediated map task

Akira Hayakawa, Fasih Haider, Saturnino Luz, Loredana Cerrato, Nick Campbell


The results of a comparison between three different speech types — On-Talk, speaking to a computer, Off-Talk Self, speaking to oneself and Off-Talk Other speaking to another person — uttered by subjects in a collaborative interlingual task mediated by an automatic speech-to-speech translation system are reported here. The characteristics of the three speech types show significant differences in terms of speech rate (F 2, 2719 = 101.7; p < 2e-16), and for this reason a detection method was implemented to see if they could also be detected with good accuracy based on their acoustic and biological characteristics. Acoustic and biological measures provide good results in distinguish between On-Talk and Off-Talk, but have difficulty distinguishing the sub-criteria of Off-Talk: Self and Other.


DOI: 10.21437/SpeechProsody.2016-159

Cite as

Hayakawa, A., Haider, F., Luz, S., Cerrato, L., Campbell, N. (2016) Talking to a system and oneself: A study from a speech-to-speech, machine translation mediated map task. Proc. Speech Prosody 2016, 776-780.

Bibtex
@inproceedings{Hayakawa+2016,
author={Akira Hayakawa and Fasih Haider and Saturnino Luz and Loredana Cerrato and Nick Campbell},
title={Talking to a system and oneself: A study from a speech-to-speech, machine translation mediated map task},
year=2016,
booktitle={Speech Prosody 2016},
doi={10.21437/SpeechProsody.2016-159},
url={http://dx.doi.org/10.21437/SpeechProsody.2016-159},
pages={776--780}
}