Chinese Sign Language Animation System on Mobile Devices

Author(s):  
Jing Wang ◽  
Yanfeng Sun ◽  
Lichun Wang
2016 ◽  
Vol 21 (1) ◽  
pp. 116-129 ◽  
Author(s):  
Sarah Ebling

We present a parallel corpus of German/Swiss German Sign Language train announcements. The corpus is used in a statistical machine translation system that translates from German to Swiss German Sign Language. The output of the translation system is then passed on to an animation system, the result being a sign language avatar representation on a mobile phone. Building the parallel corpus consisted of four steps: translating the written German train announcements into Swiss German Sign Language glosses, signing the announcements in front of a camera on the basis of the gloss transcriptions, notating the signs in the video recordings in a form-based sign language notation system, and adding information about non-manual features. The resulting corpus contains 3,241 sentence pairs, which makes it a large parallel corpus involving sign language.


2018 ◽  
Vol 189 ◽  
pp. 03024
Author(s):  
Wentong Wang ◽  
Wenhui Zhang ◽  
Bin Sun

Mobile phones are now popular in current society for its portability and intelligence, but excluded from life of the hearing-impaired because sounds are unavailable for them. This paper provides a framework of speech based Chinese Sign Language (CSL) Animation System on Smart Phones, which combines speech recognition and sign language animation to make phones convenient for the hearing-impaired. This paper recognizes the Chinese speech into text first, and then proposes a HMMSVM model to judge interrogative expression from the speech and rewrites the plain text as mark-up text according to the rules of Chinese Sign Language Mark-up Language (CSLML) which provides signs for recording expressive context in the text, the corresponding animation is finally synthesized using key-frame technology. The prototype system based on the framework provided in this paper gives plausible Sign Language animation.


Author(s):  
Sindey Carolina Bernal Villamarin ◽  
Diego Alejandro Cantor Morales ◽  
Carlos Andres Avila Reyes ◽  
Christian Albeiro Sanchez

Sign in / Sign up

Export Citation Format

Share Document