The Multi-layered Speech/Sound Synthesis Control Language (MSCL) proposed herein facilitates the synthesizing of several speech modes such as nuance, mental state and emotion, and allows speech to be synchronized to other media easily. MSCL is a multi-layered linguistic system and encompasses three layers: and semantic level layer (The S-layer), interpretation level layer (The I-layer), and parameter level layer (The P-layer). This multi-level description system is convenient for both laymen and professional users. MSCL also encompasses many e ective prosodic feature control functions such as a time-varying pattern description function, absolute and relative control forms, and SDS(Speaker Dependent Scale). MSCL enables more natural and expressive synthetic speech than conventional TTS systems. Furthermore, research was conducted into mental state tendencies using a test that examined the perceptions of the subject's sensibility to the control of synthetic speech prosody. The results showed the relationships between prosodic control rules and non-verbal expressions. Duration control reflects information processing state in spoken dialogues. Sentence final pitch contour control reflects the reliability of the information. Pitch contour dynamic range control indicates the speaker's excitement. The pitch contour control from start to peak pitch contour indicates the speaker's requirement for attention. These relationships are of use for constructing semantic prosody control.
This paper describes these functions and the effective prosodic feature controls possible with MSCL.
Cite as: Mizuno, O., Nakajima, S. (1998) Synthetic speech/sound control language: MSCL. Proc. 3rd ESCA/COCOSDA Workshop on Speech Synthesis (SSW 3), 21-26
@inproceedings{mizuno98_ssw,
author={Osamu Mizuno and Shin'ya Nakajima},
title={{Synthetic speech/sound control language: MSCL}},
year=1998,
booktitle={Proc. 3rd ESCA/COCOSDA Workshop on Speech Synthesis (SSW 3)},
pages={21--26}
}