scholarly journals Arabic and American Sign Languages Alphabet Recognition by Convolutional Neural Network

2021 ◽  
Vol 15 (4) ◽  
pp. 136-148
Author(s):  
Shroog Alshomrani ◽  
Lina Aljoudi ◽  
Muhammad Arif
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
American Sign ◽  
Sign Languages

Convolutional Neural Network Based American Sign Language Static Hand Gesture Recognition

2019 ◽  
Vol 10 (3) ◽  
pp. 60-73 ◽  
Author(s):  
Ravinder Ahuja ◽  
Daksh Jain ◽  
Deepanshu Sachdeva ◽  
Archit Garg ◽  
Chirag Rajput
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
American Sign Language ◽  
Sign Language ◽  
Automated System ◽  
World Health ◽  
American Sign ◽  
Hand Gestures ◽  
The World ◽  
Health Organization

Communicating through hand gestures with each other is simply called the language of signs. It is an acceptable language for communication among deaf and dumb people in this society. The society of the deaf and dumb admits a lot of obstacles in day to day life in communicating with their acquaintances. The most recent study done by the World Health Organization reports that very large section (around 360 million folks) present in the world have hearing loss, i.e. 5.3% of the earth's total population. This gives us a need for the invention of an automated system which converts hand gestures into meaningful words and sentences. The Convolutional Neural Network (CNN) is used on 24 hand signals of American Sign Language in order to enhance the ease of communication. OpenCV was used in order to follow up on further execution techniques like image preprocessing. The results demonstrated that CNN has an accuracy of 99.7% utilizing the database found on kaggle.com.

scholarly journals A Real-Time American Sign Language Recognition System using Convolutional Neural Network for Real Datasets

TEM Journal ◽  
2020 ◽  
pp. 937-943
Author(s):  
Rasha Amer Kadhim ◽  
Muntadher Khamees
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
American Sign Language ◽  
Real Time ◽  
Sign Language ◽  
Recognition System ◽  
High Accuracy ◽  
American Sign ◽  
Language Recognition ◽  
Sign Language Recognition

In this paper, a real-time ASL recognition system was built with a ConvNet algorithm using real colouring images from a PC camera. The model is the first ASL recognition model to categorize a total of 26 letters, including (J & Z), with two new classes for space and delete, which was explored with new datasets. It was built to contain a wide diversity of attributes like different lightings, skin tones, backgrounds, and a wide variety of situations. The experimental results achieved a high accuracy of about 98.53% for the training and 98.84% for the validation. As well, the system displayed a high accuracy for all the datasets when new test data, which had not been used in the training, were introduced.

scholarly journals Experimenting the Automatic Recognition of Non-Conventionalized Units in Sign Language

Algorithms ◽  
2020 ◽  
Vol 13 (12) ◽  
pp. 310
Author(s):  
Valentin Belissen ◽  
Annelies Braffort ◽  
Michèle Gouiffès
Keyword(s):  
Neural Network ◽  
Parallel Processing ◽  
Convolutional Neural Network ◽  
Sign Language ◽  
Performance Metrics ◽  
Automatic Recognition ◽  
Upper Body ◽  
Language Recognition ◽  
Sign Language Recognition ◽  
Sign Languages

Sign Languages (SLs) are visual–gestural languages that have developed naturally in deaf communities. They are based on the use of lexical signs, that is, conventionalized units, as well as highly iconic structures, i.e., when the form of an utterance and the meaning it carries are not independent. Although most research in automatic Sign Language Recognition (SLR) has focused on lexical signs, we wish to broaden this perspective and consider the recognition of non-conventionalized iconic and syntactic elements. We propose the use of corpora made by linguists like the finely and consistently annotated dialogue corpus Dicta-Sign-LSF-v2. We then redefined the problem of automatic SLR as the recognition of linguistic descriptors, with carefully thought out performance metrics. Moreover, we developed a compact and generalizable representation of signers in videos by parallel processing of the hands, face and upper body, then an adapted learning architecture based on a Recurrent Convolutional Neural Network (RCNN). Through a study focused on the recognition of four linguistic descriptors, we show the soundness of the proposed approach and pave the way for a wider understanding of Continuous Sign Language Recognition (CSLR).

Sign in / Sign up

Export Citation Format

Share Document