Facial Expressions for Sign Language Synthesis using FACSHuman and AZee - Laboratoire Interdisciplinaire des Sciences du Numérique
Conference Papers Year : 2024

Facial Expressions for Sign Language Synthesis using FACSHuman and AZee

Abstract

This paper presents an approach to synthesising facial expressions on signing avatars. We implement those generated by a recently proposed set of rules formalised in the AZee framework for French Sign Language. Our methodology combines computer vision, linguistic insights, and morph target animation to address the challenges posed by the synthesis of nuanced facial expressions, which are pivotal for conveying emotions and grammatical cues in Sign Language. By implementing a set of universally applicable morphs and incorporating these advancements into our animation system, we aim to improve the realism and expressiveness of signing avatars. Our findings suggest an enhancement in the synthesis of non-manual signals, which extends to multiple avatars. This work opens new avenues for future research, including the exploration of more sophisticated facial modelling techniques and the potential integration of facial motion capture data to refine the animation of facial expressions further.

Fichier principal
Vignette du fichier
2024.signlang-1.39.pdf (3.1 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04709105 , version 1 (25-09-2024)

Identifiers

  • HAL Id : hal-04709105 , version 1

Cite

Paritosh Sharma, Camille Challant, Michael Filhol. Facial Expressions for Sign Language Synthesis using FACSHuman and AZee. 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources, May 2024, Turin, Italy. ⟨hal-04709105⟩
0 View
0 Download

Share

More