Neural MultiVoice Models for Expressing Novel Personalities in Dialog

Shereen Oraby, Lena Reed, Sharath T.S., Shubhangi Tandon, Marilyn Walker


Natural language generators for task-oriented dialog should be able to vary the style of the output utterance while still effectively realizing the system dialog actions and their associated semantics. While the use of neural generation for training the response generation component of conversational agents promises to simplify the process of producing high quality responses in new domains, to our knowledge, there has been very little investigation of neural generators for task-oriented dialog that can vary their response style and we know of no experiments on models that can generate responses that are different in style from those seen during training, while still maintaining semantic fidelity to the input meaning representation. Here, we show that a model that is trained to achieve a single stylistic personality target can produce outputs that combine stylistic targets. We carefully evaluate the multivoice outputs for both semantic fidelity and for similarities to and differences from the linguistic features that characterize the original training style. We show that contrary to our predictions, the learned models do not always simply interpolate model parameters, but rather produce styles that are distinct and novel from the personalities they were trained on.


 DOI: 10.21437/Interspeech.2018-2174

Cite as: Oraby, S., Reed, L., T.S., S., Tandon, S., Walker, M. (2018) Neural MultiVoice Models for Expressing Novel Personalities in Dialog. Proc. Interspeech 2018, 3057-3061, DOI: 10.21437/Interspeech.2018-2174.


@inproceedings{Oraby2018,
  author={Shereen Oraby and Lena Reed and Sharath T.S. and Shubhangi Tandon and Marilyn Walker},
  title={Neural MultiVoice Models for Expressing Novel Personalities in Dialog},
  year=2018,
  booktitle={Proc. Interspeech 2018},
  pages={3057--3061},
  doi={10.21437/Interspeech.2018-2174},
  url={http://dx.doi.org/10.21437/Interspeech.2018-2174}
}