Evaluation of a virtual speech cuer
DOI:
https://doi.org/10.36505/ExLing-2006/01/0029/000029Abstract
This paper presents the virtual speech cuer built in the context of the ARTUS project aiming at watermarking hand and face gestures of a virtual animated agent in a broadcasted audiovisual sequence. For deaf televiewers that master cued speech, the animated agent can be then incrusted - on demand and at the reception - in the original broadcast as an alternative to subtitling. The paper presents the multimodal textto-speech synthesis system and the first evaluation performed by deaf users.
References
Bernstein, L. E., M. E. Demorest and P. E. Tucker 2000. Speech perception without hearing. Perception & Psychophysics 62: 233-252.
Cornett, R. O. 1967. Cued Speech., American Annals of the Deaf 112: 3-13.
Cornett, R. O. 1982. Le Cued Speech. Aides manuelles à la lecture labiale et perspectives d'aides automatiques. F. Destombes. Paris, Centre scientifique IBMFrance.
Cornett, R. O. 1988. Cued Speech, manual complement to lipreading, for visual reception of spoken language. Principles, practice and prospects for automation. Acta Oto-Rhino-Laryngologica Belgica 42 (3): 375-384.
Gibert, G., G. Bailly, D. Beautemps, F. Elisei and R. Brun 2005. Analysis and synthesis of the 3D movements of the head, face and hand of a speaker using cued speech. Journal of Acoustical Society of America 118 (2): 1144-1153.
Leybaert, J. 2000. Phonology acquired through the eyes and spelling in deaf children. Journal of Experimental Child Psychology 75: 291-318.
Leybaert, J. 2003. The role of Cued Speech in language processing by deaf children: an overview. Auditory-Visual Speech Processing, St Jorioz - France: 179-186.
Nicholls, G. and D. Ling 1982. Cued Speech and the reception of spoken language. Journal of Speech and Hearing Research 25: 262-269.
Owens, E. and B. Blazek 1985. Visemes observed by hearing-impaired and normalhearing adult viewers. Journal of Speech and Hearing Research 28: 381-393.
Peckels, J. P. and M. Rossi 1973. Le test de diagnostic par paires minimales. Adaptation au francais du 'Diagnostic Rhyme Test' de W.D. Voiers.Revue d'Acoustique 27: 245-262.
Summerfield, Q. 1991. Visual perception of phonetic gestures. Modularity and the motor theory of speech perception. I. G. Mattingly and M. Studdert-Kennedy. Hillsdale, NJ, Lawrence Erlbaum Associates: 117-138.
Downloads
Published
Issue
Section
License
Copyright (c) 2006 Guillaume Gibert (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Articles are published under the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
