Vocal and facial expressions and meaning effects in speech expressivity
DOI:
https://doi.org/10.36505/ExLing-2019/10/0020/000382Keywords:
verbal and non-verbal language, gestural prosody, multimodality, persuasion, speech expressivityAbstract
The objective of this work is to investigate the congruence between non-verbal and verbal cues in persuasive speech. The selected corpus comprises video excerpts in which artists from divergent political perspectives provide support to the minister of the Brazilian Supreme Federal Court. The research methodology comprises: annotation of the video excerpts; text analysis; automatic analysis of the speakers‘ facial expressions and emotions by means of the FaceReader; analysis of the vocal quality and prosodic settings by means of the VPA; acoustic analysis of the data by means of the ExpressionEvaluator (Barbosa, 2009); and multivariate statistical analysis, applying MFA in R, package FactorMinerR, to correlate qualitative and quantitative variables. Results indicate the interplay among facial and vocal prosodies and intended persuasiveness.
References
Barbosa, P. A. 2009. Detecting Changes in Speech Expressiveness in participants of a radio program. Proceedings of Interspeech, Brighton, UK, 1, 2155-2158.
Husson, F., Josse, J., Lê, S., Mazet, J. 2013. FactoMineR: Multivariate Exploratory Data Analysis and Data Mining with R (version 1.25) [R package].
Laver, J., Mackenzie-Beck J. 2007. Vocal Profile Analysis Scheme. Edinburgh: Queen Margareth University College, Speech Science Research Centre.
Madureira, S., Fontes, M.A.S. 2019. The analysis of facial and speech expressivity: tools and methods. In J.M. Lahoz-Bengoechea, R. Pérez Ramón (Eds.), Subsidia. Tools and resources for speech sciences (pp. 19–26). Málaga: Universidad de Málaga.
Downloads
Published
Issue
Section
License
Articles are published under the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
