scholarly journals A Novel Technique for Speech Recognition and Visualization Based Mobile Application to Support Two-Way Communication between Deaf-Mute and Normal Peoples

2018 ◽  
Vol 2018 ◽  
pp. 1-12 ◽  
Author(s):  
Kanwal Yousaf ◽  
Zahid Mehmood ◽  
Tanzila Saba ◽  
Amjad Rehman ◽  
Muhammad Rashid ◽  
...  
Keyword(s):  
Speech Recognition ◽  
Sign Language ◽  
Mobile Technology ◽  
Mobile Application ◽  
Technology Development ◽  
Normal Person ◽  
Mel Frequency Cepstral Coefficients ◽  
Face To Face ◽  
Analysis Of Results ◽  
Mobile Market

Mobile technology is very fast growing and incredible, yet there are not much technology development and improvement for Deaf-mute peoples. Existing mobile applications use sign language as the only option for communication with them. Before our article, no such application (app) that uses the disrupted speech of Deaf-mutes for the purpose of social connectivity exists in the mobile market. The proposed application, named as vocalizer to mute (V2M), uses automatic speech recognition (ASR) methodology to recognize the speech of Deaf-mute and convert it into a recognizable form of speech for a normal person. In this work mel frequency cepstral coefficients (MFCC) based features are extracted for each training and testing sample of Deaf-mute speech. The hidden Markov model toolkit (HTK) is used for the process of speech recognition. The application is also integrated with a 3D avatar for providing visualization support. The avatar is responsible for performing the sign language on behalf of a person with no awareness of Deaf-mute culture. The prototype application was piloted in social welfare institute for Deaf-mute children. Participants were 15 children aged between 7 and 13 years. The experimental results show the accuracy of the proposed application as 97.9%. The quantitative and qualitative analysis of results also revealed that face-to-face socialization of Deaf-mute is improved by the intervention of mobile technology. The participants also suggested that the proposed mobile application can act as a voice for them and they can socialize with friends and family by using this app.

PENERAPAN TEKNOLOGY SPEECH RECOGNITION UNTUK LATIHAN PRONUNCIATION BAHASA INGGRIS MELALUI METODE DICTATION DI PROGRAM STUDI MULTIMEDIA BROADCASTING POLITEKNIK ELEKTRONIKA NEGERI SURABAYA

2018 ◽  
Vol 3 (1) ◽  
Author(s):  
Aliv Faizal M ◽  
Akhmad Alimudin
Keyword(s):  
Student Achievement ◽  
Speech Recognition ◽  
Training Sequence ◽  
English Learning ◽  
Motivation To Learn ◽  
Study Program ◽  
Face To Face ◽  
Track Record ◽  
Speech Recognition Technology ◽  
English Pronunciation

English pronunciation has long been taught through the delivery of phonetic symbols to study the sound of each phoneme in English. In Multimedia Broadcasting study program at Surabaya State Electronics Polytechnic, pronunciation has long been delivered to the students through guidebooks in the form of phonetic symbols that teach basic sound pronunciation in English. English teachers practice the sound of each phoneme directly to thestudents. After going through various observations based on the track record of student achievement of this pronunciation material, I as a teacher as well as researcher found that my student achievement was less than the desired target. This was due to the limited source of English pronunciation learning where students only learned face-to-face in the classroom. Through the use of English learning media of pronunciation interactively using speech recognition technology, it was expected that Multimedia Broadcasting course students in Surabaya State Electronics Polytechnic could improve their English pronunciation ability. After students complete the English pronunciation training sequence using pronunciation application using speech recognition technology, the data from the interview stated that the students felt more confident and improved their pronunciation ability and also felt the increased motivation to learn English pronunciation using English pronunciation learning app using speech recognition technology.Keywords: English pronunciation, teaching, multimedia, speech recognition technology, and pronunciation app.

scholarly journals Environmental effects on reliability and accuracy of MFCC based voice recognition for industrial human-robot-interaction

2021 ◽  
pp. 095440542110144
Author(s):  
B Birch ◽  
CA Griffiths ◽  
A Morgan
Keyword(s):  
Speech Recognition ◽  
Voice Recognition ◽  
Human Robot Interaction ◽  
Hole Drilling ◽  
Time Warping ◽  
Mel Frequency Cepstral Coefficients ◽  
Robot Interaction ◽  
Extraction Algorithm ◽  
Dynamic Time ◽  
Manufacturing Environments

Collaborative robots are becoming increasingly important for advanced manufacturing processes. The purpose of this paper is to determine the capability of a novel Human-Robot-interface to be used for machine hole drilling. Using a developed voice activation system, environmental factors on speech recognition accuracy are considered. The research investigates the accuracy of a Mel Frequency Cepstral Coefficients-based feature extraction algorithm which uses Dynamic Time Warping to compare an utterance to a limited, user-dependent dictionary. The developed Speech Recognition method allows for Human-Robot-Interaction using a novel integration method between the voice recognition and robot. The system can be utilised in many manufacturing environments where robot motions can be coupled to voice inputs rather than using time consuming physical interfaces. However, there are limitations to uptake in industries where the volume of background machine noise is high.

scholarly journals Sentence Generation for Indian Sign Language Using NLP

Webology ◽  
2021 ◽  
Vol 18 (Special Issue 01) ◽  
pp. 196-210
Author(s):  
Dr.P. Golda Jeyasheeli ◽  
N. Indumathi
Keyword(s):  
Deep Learning ◽  
Natural Language Processing ◽  
Sign Language ◽  
Language Processing ◽  
Normal Person ◽  
Human Language ◽  
Android Application ◽  
Sentence Generation ◽  
Normal People ◽  
Indian Sign Language

Nowadays the interaction among deaf and mute people and normal people is difficult, because normal people scuffle to understand the sense of the gestures. The deaf and dumb people find problem in sentence formation and grammatical correction. To alleviate the issues faced by these people, an automatic sign language sentence generation approach is propounded. In this project, Natural Language Processing (NLP) based methods are used. NLP is a powerful tool for translation in the human language and also responsible for the formation of meaningful sentences from sign language symbols which is also understood by the normal person. In this system, both conventional NLP methods and Deep learning NLP methods are used for sentence generation. The efficiency of both the methods are compared. The generated sentence is displayed in the android application as an output. This system aims to connect the gap in the interaction among the deaf and dumb people and the normal people.

scholarly journals Effect of "Motivational Interviewing" and "Information, Motivation and Behavioral Skills” on Choosing Mode of Delivery in Pregnant Women: A Randomized Controlled Trial

2020 ◽  
Author(s):  
Mahboubeh Shirzad ◽  
Elham Shakibazadeh ◽  
Abbas Rahimi Foroushani ◽  
Mehrandokht Abedini ◽  
Hamid Poursharifi
Keyword(s):  
Cesarean Section ◽  
Motivational Interviewing ◽  
Pregnant Women ◽  
Self Efficacy ◽  
Mobile Application ◽  
Controlled Trial ◽  
Mode Of Delivery ◽  
Brief Interventions ◽  
Behavioral Skills ◽  
Face To Face

Abstract Background: Cesarean section is an important surgical procedure to save mothers and/or babies’ lives. Current trends show that the rate of Cesarean section is increasing dramatically over the years. The aims of this study were to compare the effects of "motivational interviewing" and "information, motivation and behavioral skills” model on choosing mode of delivery among pregnant women.Methods: In a four-armed, parallel-design randomized controlled trial, 120 women were randomly assigned to three brief interventions and one control groups. We recruited pregnant women referring to Ebnesina hospital, Tehran- Iran from 2019-2020. The intervention groups included: 1) motivational interviewing; 2) face-to-face information, motivation and behavioural skills model; and 3) information, motivation and behavioural skills model provided using a mobile application. The inclusion criteria were being literate, gestational age 24 to 32 weeks, being able to speak Persian, having no complications in the current pregnancy, having no indications for CS, and having enough time to participate in the study. The most important outcomes of the study included women’s intentions to undergo any mode of delivery, women’s self-efficacy in choosing the mode of delivery, and mode of delivery. Data were analyzed using descriptive statistics (mean, frequency and standard deviation), inferential statistics including independent t-test, paired t-test, Chi-squared and One-way ANOVA tests and logistic regression.Results: Following the interventions, significant differences were found in the mode of delivery (P < 0.05) and women’s self-efficacy and intention (P < 0.05). Women who had used the mobile application had more improvements in the self-efficacy and intention than the face-to-face intervention groups.Conclusions: Our study showed positive significant effects of various types of brief interventions to reduce unnecessary Cesarean section rate among the participant women. Providing the intervention using mobile application showed even better results. Our findings may contribute to a rise in normal vaginal delivery; and these simple, non-expensive, tailored to women, and culture-oriented brief interventions can be considered as appropriate strategies to reduce Cesarean section rate in local, national, and/or regional levels.Trial registration: This study has been registered in Iran Randomized Clinical Trial Center (IRCT20151208025431N7). Registered October 07, 2018.

scholarly journals Voice Controlled Vehicle Dashboard

2020 ◽  
Vol 9 (1) ◽  
pp. 1022-1027
Keyword(s):  
Speech Recognition ◽  
Speaker Recognition ◽  
Feature Matching ◽  
Heavy Traffic ◽  
Recognition Rate ◽  
Recognition System ◽  
Low Noise ◽  
Raspberry Pi ◽  
Mel Frequency Cepstral Coefficients ◽  
Power Spectral

Driving a vehicle or a car has become tedious job nowadays due to heavy traffic so focus on driving is utmost important. This makes a scope for automation in Automobiles in minimizing human intervention in controlling the dashboard functions such as Headlamps, Indicators, Power window, Wiper System, and to make it possible this is a small effort from this paper to make driving distraction free using Voice controlled dashboard. and system proposed in this paper works on speech commands from the user (Driver or Passenger). As Speech Recognition system acts Human machine Interface (HMI) in this system hence this system makes use of Speaker recognition and Speech recognition for recognizing the command and recognize whether the command is coming from authenticated user(Driver or Passenger). System performs Feature Extraction and extracts speech features such Mel Frequency Cepstral Coefficients(MFCC),Power Spectral Density(PSD),Pitch, Spectrogram. Then further for Feature matching system uses Vector Quantization Linde Buzo Gray(VQLBG) algorithm. This algorithm makes use of Euclidean distance for calculating the distance between test feature and codebook feature. Then based on speech command recognized controller (Raspberry Pi-3b) activates the device driver for motor, Solenoid valve depending on function. This system is mainly aimed to work in low noise environment as most speech recognition systems suffer when noise is introduced. When it comes to speech recognition acoustics of the room matters a lot as recognition rate differs depending on acoustics. when several testing and simulation trials were taken for testing, system has speech recognition rate of 76.13%. This system encourages Automation of vehicle dashboard and hence making driving Distraction Free.

scholarly journals Development of Prayer Mobile Application Software for The Hearing Impaired (Deaf) Based on Malaysian Sign Language

2021 ◽  
Vol 11 (6) ◽  
Author(s):  
Abdul Rahim Razalli ◽  
Nordin Mamat ◽  
Normah Razali ◽  
Mohd Hanafi Mohd Yasin ◽  
Modi Lakulu ◽  
...  
Keyword(s):  
Sign Language ◽  
Mobile Application ◽  
Hearing Impaired ◽  
Application Software

scholarly journals Mobile Technology as Part of Banks’ Business Model

2019 ◽  
Vol 1 (340) ◽  
pp. 73-90
Author(s):  
Monika Klimontowicz ◽  
Janina Harasim
Keyword(s):  
Competitive Advantage ◽  
Business Model ◽  
Mobile Technology ◽  
Business Models ◽  
Technology Development ◽  
Banking Market ◽  
Information And Communication ◽  
New Challenges ◽  
Further Development ◽  
Theoretical Considerations

During the last few decades, the banking market has changed significantly making banks face new challenges. Mobile technology development has had a powerful impact on all human activities including banking. Mobile technology has changed both the information and communication sharing, as well as customers’ market behaviour. All these changes should be taken into account in the process of searching for competitive advantage factors and designing banks’ business models. The purpose of the paper is to propose the framework for banks’ business model that incorporates using mobile technology and creating a competitive advantage. The foundation of this framework is based on theoretical considerations. The paper analyses contemporary business models used by banks, their value proposals and their relation to customers’ needs and expectations. The research highlights the routes for using mobile technology in the further development of banks’ business models from the perspective of the process of creating and delivering value for customers.

Using Mobile Technology to Engage Children With Nature

2016 ◽  
Vol 49 (9) ◽  
pp. 959-984 ◽  
Author(s):  
Maxine R. Crawford ◽  
Mark D. Holder ◽  
Brian P. O’Connor
Keyword(s):  
Environmental Education ◽  
Mobile Technology ◽  
Mobile Device ◽  
Mobile Application ◽  
Ecological Knowledge ◽  
Connectedness To Nature ◽  
Place Based Education ◽  
Connecting Children To Nature

The efficacy of a mobile application to increase connectedness to nature and impart flora/fauna/ecological knowledge was assessed in 747 children in three separate and distinctive parks: a wetland, a prairie grassland, and an indoor tropical garden. The mobile application was developed with place-based education in mind. At each park, children were randomly assigned to one of three groups. One group of children toured the park using an application on a mobile device with their chaperones, another group toured the park with an environmental educator and their chaperones, and a third group toured the parks with a paper map and their chaperones. Results showed that the mobile application was just as effective at connecting children to nature as more traditional ways of non-formal environmental education, but the mobile application offered additional benefits such as higher ratings of fun.

A Gesture-to-Speech Recognition Mobile Application Prototype

2021 ◽  
Vol 102 (10) ◽  
pp. e95
Author(s):  
Riyad Bin Rafiq ◽  
Syed Araib Karim ◽  
Annie Liu ◽  
Mark V. Albert
Keyword(s):  
Speech Recognition ◽  
Mobile Application

Balinese Kulkul Semantic Ontology: REST API Mobile Application Development

2021 ◽  
Vol 9 (4) ◽  
pp. 457
Author(s):  
I Putu Agus Wahyu Widiatmika ◽  
Cokorda Rai Adi Pramartha
Keyword(s):  
Web Service ◽  
Mobile Technology ◽  
Mobile Applications ◽  
Mobile Application ◽  
Word Of Mouth ◽  
Cultural Knowledge ◽  
Application Development ◽  
Technological Developments ◽  
Semantic Ontology ◽  
Rest Api

Kulkul is one of Bali's cultural heritage. Kulkul is used in Balinese society for communication when there is a danger, death, a ritual, and so on. The current phenomenon is that many Balinese people are only able to know and without knowing much knowledge about kulkul. It is because this knowledge is the only word of mouth, making it difficult for it to be collected, stored, retrieved, shared, and renewed. Current technological developments, especially mobile technology, allow the development of mobile applications on cultural knowledge with an ontology approach that will help provide an explicit explanation of this knowledge. In this study, the authors propose the application of a web service with a REST API architecture to help mobile applications integrate Balinese Kulkul Semantic Ontology. This study uses the prototyping method in developing the REST API. From the tests that have been done, it is found that the REST API has successfully received requests and responses which prove that the mobile application is well integrated.

Sign in / Sign up

Export Citation Format

Share Document