Skip to main content

On the Relationship between Face Movements, Tongue Movements, and Speech Acoustics

Abstract

This study examines relationships between external face movements, tongue movements, and speech acoustics for consonant-vowel (CV) syllables and sentences spoken by two male and two female talkers with different visual intelligibility ratings. The questions addressed are how relationships among measures vary by syllable, whether talkers who are more intelligible produce greater optical evidence of tongue movements, and how the results for CVs compared to those for sentences. Results show that the prediction of one data stream from another is better for C/a/ syllables than C/i/ and C/u/ syllables. Across the different places of articulation, lingual places result in better predictions of one data stream from another than do bilabial and glottal places. Results vary from talker to talker; interestingly, high rated intelligibility do not result in high predictions. In general, predictions for CV syllables are better than those for sentences.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Jintao Jiang.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Jiang, J., Alwan, A., Keating, P.A. et al. On the Relationship between Face Movements, Tongue Movements, and Speech Acoustics. EURASIP J. Adv. Signal Process. 2002, 506945 (2002). https://doi.org/10.1155/S1110865702206046

Download citation

Keywords

  • articulatory movements
  • speech acoustics
  • qualisys
  • EMA
  • optical tracking
\