Exploring the prosody of affective speech
DOI:
https://doi.org/10.36505/ExLing-2022/13/0019/000561Keywords:
Emotion, Synthesis, Prosody, Voice source, AffectAbstract
This paper introduces a research project on voice quality and affect expression. It explores affective prosody by investigating the relationship between voice source parameter changes and perceived affect. Firstly, it aims to examine the relative contribution of voice source shifts occurring globally across an utterance and shifts aligned to the prosodic structure of the utterance. Secondly, it aims to formulate a simple model for affect expression that could, in principle, be applied to text-to-speech synthesis systems for Irish (Gaelic) dialects. The analytic methods include voice source and intonation analysis of utterances produced to portray a range of emotions, as well as perception experiments with stimuli varying in terms of global versus local, structured source manipulations.
References
Praat 2020. Boersma, P., Weenink, D. Praat: Doing phonetics by computer, version 6.2.08.
Fant, G., Liljencrants, J., Lin, Q. 1985. A four-parameter model of glottal flow. STL-QPSR, 26(4), 1-13. Speech, Music and Hearing, Royal Institute of Technology, Stockholm.
Gobl, C., Ní Chasaide, A. 2003. The role of voice quality in communicating emotion, mood and attitude. Speech Communication, 40(1), 189-212.
Gobl, C., Ní Chasaide, A. 2010. Voice source variation and its communicative functions. In Hardcastle, W. J., Laver, J., Gibbon, F. E. (eds.), The Handbook of Phonetic Sciences (2nd ed.), 378-423. Oxford: Blackwell.
Juslin, P. N., Scherer, K. R. 2005. Vocal expression of affect. In Harrigan, J. A., Rosenthal, R., Scherer, K. R. (eds.), The New Handbook of Methods in Nonverbal Behaviour Research, 65-135. Oxford: Oxford University Press.
Laver, J. 1980. The Phonetic Description of Voice Quality. Cambridge: Cambridge University Press.
Murphy, A., Yanushevskaya, I., Ní Chasaide, A., Gobl, C. 2020. Testing the GlórCáil system in a speaker and affect voice transformation task. In Proceedings of the 10th International Conference on Speech Prosody, 950-954. Tokyo, Japan.
Murphy, A., Yanushevskaya, I., Ní Chasaide, A., Gobl, C. 2022. Affect expression: Global and local control of voice source parameters. In Speech Prosody 2022, 525-529. Lisbon, Portugal.
Ní Chasaide, A., Gobl, C., Monahan, P. 1992. A technique for analysing voice quality in pathological and normal speech. Journal of Clinical Speech and Language Studies, 2(1), 1-16.
Scherer, K. R. 2003. Vocal communication of emotion: A review of research paradigms. Speech Communication, 40(1), 227-256.
Downloads
Published
Issue
Section
License
Articles are published under the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.