ISCA Archive ICSLP 2000
ISCA Archive ICSLP 2000

On the correlation between facial movements, tongue movements and speech acoustics

Jintao Jiang, Abeer Alwan, Lynne E. Bernstein, Patricia Keating, Ed Auer

This study is a first step in a large-scale study that aims at quantifying the relationship between external facial movements, tongue movements, and the acoustics of speech sounds. The database analyzed consisted of 69 CV syllables spoken by two males and two females; each utterance was repeated four times. A Qualysis (optical motion capture system) and an EMA (electromagnetic midsaggital articulography) system were used to characterize facial and tongue movements, respectively. Acoustic features were represented by linear spectral pairs (LSP). To quantify the correlation between them, a multilinear regression technique was applied. The results were analyzed in terms of vowel context, place of articulation, and individual articulatory (EMA or Optical) or acoustic (LSP) channel.


Cite as: Jiang, J., Alwan, A., Bernstein, L.E., Keating, P., Auer, E. (2000) On the correlation between facial movements, tongue movements and speech acoustics. Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000), vol. 1, 42-45

@inproceedings{jiang00_icslp,
  author={Jintao Jiang and Abeer Alwan and Lynne E. Bernstein and Patricia Keating and Ed Auer},
  title={{On the correlation between facial movements, tongue movements and speech acoustics}},
  year=2000,
  booktitle={Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000)},
  pages={vol. 1, 42-45}
}