The face, sound and expressiveness of voice quality settings
DOI:
https://doi.org/10.36505/ExLing-2024/15/0005/000630Keywords:
voice quality, facial expression, multimodalityAbstract
In this paper, we investigate associations between vocal and facial gestures and meaning effects in utterances produced by an actor with labial, mandibular and tongue-tip phonetic settings of voice quality. The corpus comprises 12 videos. Each video refers to an utterance produced with a different voice quality setting. Four kinds of analysis were performed: a perceptual analysis of voice quality settings and prosodic features by
four experts on the use of the VPA system; an automatic analysis of facial AUs and related basic emotions, valence, and arousal states; an analysis of acoustic parameters extracted with the Prosody Descriptor Extractor Script; and a perceptual test to investigate 30 listeners’ judgements of semantic criteria based on their listening to the audio stimuli. The Exploratory multivariate statistical analysis was applied to correlate the quantitative and qualitative variables concerned.
References
Abelin, Å. 2008. Seeing glee but hearing fear? Emotional McGurk effect in Swedish. Proceedings of Speech Prosody. May 6, 9.
Banse, R., Scherer, K. R. 1994. Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, vol. 70, no. 3, pp. 614–636.
Barbosa, P. A. 2020. Prosody Descriptor Extractor (for Praat). [Online].
Boersma, P., Weenink, D. 2021. Praat: doing phonetics by computer. [Online].
Ekman, P., Friesen, W. V. 1971. Constants across cultures in the face and emotion. Journal of Personality and Social Psychology, vol. 17, no. 2, pp. 124–129.
Ekman, P., Friesen, W. V., Hager, J. C. 2002. Facial Action Coding System.
Fónagy, I. 2000. Languages within languages: an evolutive approach. John Benjamins.
Josse, J., Pagès, J., Husson, F. 2008. Testing the significance of the RV coefficient. Computational Statistics & Data Analysis, vol. 53, no. 1, pp. 82–91.
Laver, J., Mackenzie Beck, J. 2007. Vocal profile analysis scheme-VPAS. Queen Margareth University College-QMUC, Speech Science Research Centre, Edinburgh, Handout.
Madureira, S., Fontes, M.A.S. 2023. Multimodal impressions of voice quality settings: the role of vocal and visual symbolism. Frontiers in Communication, vol.8. [Online].
Downloads
Published
Issue
Section
License
Articles are published under the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
