Much work remains to be done with subjective evaluations of speech-based and multimodal systems. In particular, user experience is still hard to evaluate. SUXES is an evaluation method for collecting subjective metrics with user experiments. It captures both user expectations and user experiences, making it possible to analyze the state of the application and its interaction methods, and compare results. We present the SUXES method with examples of user experiments with different applications and modalities.
Bibliographic reference. Turunen, Markku / Hakulinen, Jaakko / Melto, Aleksi / Heimonen, Tomi / Laivo, Tuuli / Hella, Juho (2009): "SUXES - user experience evaluation method for spoken and multimodal interaction", In INTERSPEECH-2009, 2567-2570.