Sign Language Learning System with Image Sampling and Convolutional Neural Network

2017 ◽  
Author(s):  
Yangho Ji ◽  
Sunmok Kim ◽  
Ki-Baek Lee
Keyword(s):  
Neural Network ◽  
Language Learning ◽  
Convolutional Neural Network ◽  
Sign Language ◽  
Learning System ◽  
Image Sampling

scholarly journals 3D Avatar Approach for Continuous Sign Movement Using Speech/Text

2021 ◽  
Vol 11 (8) ◽  
pp. 3439
Author(s):  
Debashis Das Chakladar ◽  
Pradeep Kumar ◽  
Shubham Mandal ◽  
Partha Pratim Roy ◽  
Masakazu Iwamura ◽  
...  
Keyword(s):  
Language Learning ◽  
Sign Language ◽  
Language Processing ◽  
Hearing Impaired ◽  
Learning System ◽  
English Sentence ◽  
Impaired People ◽  
Indian Sign Language ◽  
Impaired Person ◽  
3D Avatar

Sign language is a visual language for communication used by hearing-impaired people with the help of hand and finger movements. Indian Sign Language (ISL) is a well-developed and standard way of communication for hearing-impaired people living in India. However, other people who use spoken language always face difficulty while communicating with a hearing-impaired person due to lack of sign language knowledge. In this study, we have developed a 3D avatar-based sign language learning system that converts the input speech/text into corresponding sign movements for ISL. The system consists of three modules. Initially, the input speech is converted into an English sentence. Then, that English sentence is converted into the corresponding ISL sentence using the Natural Language Processing (NLP) technique. Finally, the motion of the 3D avatar is defined based on the ISL sentence. The translation module achieves a 10.50 SER (Sign Error Rate) score.

scholarly journals AFibNet: an implementation of atrial fibrillation detection with convolutional neural network

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Bambang Tutuko ◽  
Siti Nurmaini ◽  
Alexander Edo Tondas ◽  
Muhammad Naufal Rachmatullah ◽  
Annisa Darmawahyuni ◽  
...  
Keyword(s):  
Neural Network ◽  
Atrial Fibrillation ◽  
Convolutional Neural Network ◽  
Learning System ◽  
Single Frequency ◽  
Feature Maps ◽  
Normal Sinus ◽  
Unseen Data ◽  
Specific Device ◽  
Model Formation

Abstract Background Generalization model capacity of deep learning (DL) approach for atrial fibrillation (AF) detection remains lacking. It can be seen from previous researches, the DL model formation used only a single frequency sampling of the specific device. Besides, each electrocardiogram (ECG) acquisition dataset produces a different length and sampling frequency to ensure sufficient precision of the R–R intervals to determine the heart rate variability (HRV). An accurate HRV is the gold standard for predicting the AF condition; therefore, a current challenge is to determine whether a DL approach can be used to analyze raw ECG data in a broad range of devices. This paper demonstrates powerful results for end-to-end implementation of AF detection based on a convolutional neural network (AFibNet). The method used a single learning system without considering the variety of signal lengths and frequency samplings. For implementation, the AFibNet is processed with a computational cloud-based DL approach. This study utilized a one-dimension convolutional neural networks (1D-CNNs) model for 11,842 subjects. It was trained and validated with 8232 records based on three datasets and tested with 3610 records based on eight datasets. The predicted results, when compared with the diagnosis results indicated by human practitioners, showed a 99.80% accuracy, sensitivity, and specificity. Result Meanwhile, when tested using unseen data, the AF detection reaches 98.94% accuracy, 98.97% sensitivity, and 98.97% specificity at a sample period of 0.02 seconds using the DL Cloud System. To improve the confidence of the AFibNet model, it also validated with 18 arrhythmias condition defined as Non-AF-class. Thus, the data is increased from 11,842 to 26,349 instances for three-class, i.e., Normal sinus (N), AF and Non-AF. The result found 96.36% accuracy, 93.65% sensitivity, and 96.92% specificity. Conclusion These findings demonstrate that the proposed approach can use unknown data to derive feature maps and reliably detect the AF periods. We have found that our cloud-DL system is suitable for practical deployment

A Modern Approach for Sign Language Interpretation Using Convolutional Neural Network

2019 ◽  
pp. 431-444 ◽  
Author(s):  
Pias Paul ◽  
Moh. Anwar-Ul-Azim Bhuiya ◽  
Md. Ayat Ullah ◽  
Molla Nazmus Saqib ◽  
Nabeel Mohammed ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Sign Language ◽  
Modern Approach ◽  
Language Interpretation
Sign in / Sign up

Export Citation Format

Share Document