A Development of Multi-Language Interactive Device using Artificial Intelligence Technology for Visual Impairment Person

<p class="0abstract">The issue of lacking reference books in braille in most public building is crucial, especially public places like libraries, museum and others. The visual impairment or blind people is not getting the information like we normal vision do. Therefore, a multi languages reading device for visually impaired is built and designed to overcome the limitation of reference books in public places. Some research regarding current product available is done to develop a better reading device. This reading device is an improvement from previous project which only focuses on single language which is not suitable for public places. This reading device will take a picture of the book using 5MP Pi camera, Google Vision API will extract the text, and Google Translation API will detect the language and translated to desired language based on push buttons input by user. Google Text-to-Speech will convert the text to speech and the device will read out aloud in through audio output like speaker or headphones. A few testings have been made to test the functionality and accuracy of the reading device. The testings are functionality, performance test and usability test. The reading device passed most of the testing and get a score of 91.7/100 which is an excellent (A) rating<strong>.</strong></p>

ML Algorithm-Based Virtual Eye Guidance System

Object detection is used in almost every real-world application, including autonomous traversal, visual systems, and facial recognition, to name a few. The purpose of this study is to apply object detection algorithms to assist visually impaired people. It allows vision impaired people to be aware of their surroundings, enabling them to move freely. With promising findings, a prototype was developed on a Raspberry PI 3 using OpenCV libraries. This research looks at the many methods of detecting items with audio output using various object detection algorithms, such as a deep neural network for SSD constructed using the Caffe model. Along with vocal coaching, we've incorporated an emergency button to inform those nearby and a vibrator to alert deaf people to the obstruction in front of the camera.

Smart Glass for Visually Challenged Peoples to Read the Books using Raspberry Pi

The objective of this paper is to presents new design on assistive smart glasses for visually impaired. The objective is to assist in multiple daily tasks using the advantage of wearable design format. The proposed method is a camera based assistive text reading to help to blind in person in reading the text present on the text labels, printed notes and products in their own respective languages. It combines the concept of Optical Character Recognition (OCR), text to Speech Synthesizer (TTS) and translator in Raspberry pi. Optical character recognition (OCR) is the identification of printed characters using photoelectric devices and computer software. It converts images of typed, handwritten or printed text into machine encoded text from scanned document or from subtitle text superimposed on an image. Text-to-Speech conversion is a method that scans and reads any language letters and numbers that are in the image using OCR technique and then translates it into any desired language and at last it gives audio output of the translated text. The audio output is heard through the raspberry pi's audio jack using speakers or earphones.

An assistive model of obstacle detection based on deep learning: YOLOv3 for visually impaired people

<span>The World Health Organization (WHO) reported in 2019 that at least 2.2 billion people were visual-impairment or blindness. The main problem of living for visually impaired people have been facing difficulties in moving even indoor or outdoor situations. Therefore, their lives are not safe and harmful. In this paper, we propose</span><span>d</span><span> an assistive application model based on deep learning: YOLOv3 with a Darknet-53 base network for visually impaired people on a smartphone. The Pascal VOC2007 and Pascal VOC2012 were used for the training set and used Pascal VOC2007 test set for validation. The assistive model was installed on a smartphone with an eSpeak synthesizer which generates the audio output to the user. The experimental result showed a high speed and also high detection accuracy. The proposed application with the help of technology will be an effective way to assist visually impaired people to interact with the surrounding environment in their daily life.</span>

Multifunctional And Low Cost Braille Display

Braille Display is a device which helps the visually impaired to read a text file in Braille format and as well receive an audio output of the text file. It gives an option to the user whether to receive output in terms of braille or audio. Braille is a tactile writing language of raised dots using which blinds and visually impaired people read and write through touch. The pattern of raised dots can be read with the fingers by blinds. The number and arrangement of these dots forms alphabets, numbers and special characters. The braille output in Braille display is observed in Braille text popper device which is made up of a plate having holes. Solenoids are placed under each hole to raise or lower the braille pin which will emerge through perforations on the top plate to form a Braille dot. The perforations serve as guides for the pins and form six dots which is equivalent to one Braille cell. Raspberry Pi Microcontroller is used to convert the text file into Braille format and thus controls the corresponding solenoid present below each of the holes to either pop up or down the hole by sending signal values to solenoids. Thus the solenoids align themselves based on the input character from the text file . The blinds can feel the sense of touch of the Braille pins that are popped up and they recognize the character accordingly. This way, blinds can recognize character by character. At every iteration, three characters from text file comes out in braille in Braille text popper device. The next button would display next three characters and previous button would display previous three characters. If the user prefers to hear audio, then it would give audio output of the text file through ear phones. Thus, the device facilitates the user either to read the text in braille or to hear the text as audio making it multifunctional.

Transcript Anatomization with Multi-Linguistic and Speech Synthesis Features

Handwriting Detection is a process or potential of a computer program to collect and analyze comprehensible input that is written by hand from various types of media such as photographs, newspapers, paper reports etc. Handwritten Text Recognition is a sub-discipline of Pattern Recognition. Pattern Recognition is refers to the classification of datasets or objects into various categories or classes. Handwriting Recognition is the process of transforming a handwritten text in a specific language into its digitally expressible script represented by a set of icons known as letters or characters. Speech synthesis is the artificial production of human speech using Machine Learning based software and audio output based computer hardware. While there are many systems which convert normal language text in to speech, the aim of this paper is to study Optical Character Recognition with speech synthesis technology and to develop a cost effective user friendly image based offline text to speech conversion system using CRNN neural networks model and Hidden Markov Model. The automated interpretation of text that has been written by hand can be very useful in various instances where processing of great amounts of handwritten data is required, such as signature verification, analysis of various types of documents and recognition of amounts written on bank cheques by hand.

A Novel Dentary Bone Conduction Device Equipped with Laser Communication in DSP

In this study, we designed a dentary bone conduction system that transmits and receives audio by laser. The main objective of this research was to propose a complete hardware design method, including a laser audio transmitter and receiver and digital signal processor (DSP) based digital signal processing system. We also present a digital filter algorithm that can run on a DSP in real time. This experiment used the CMU ARCTIC databases’ human-voice reading audio as the standard audio. We used a piezoelectric sensor to measure the vibration signal of the bone conduction transducer (BCT) and separately calculated the signal-to-noise ratio (SNR) of the digitally filtered audio output and the unfiltered audio output using DSP. The SNR of the former was twice that of the latter, and the BCT output quality significantly improved. From the results, we can conclude that the dentary bone conduction system integrated with a DSP digital filter enhances sound quality.

STUDI EMPIRIS ALAT PERAGA PENERIMA FREKUENSI RADIO GRF-3300

ABSTRACT:In a wireless communication system, the transmitter and receiver are basic components that have a role in the telecommunications system. The receiving system serves to receive an information signal. The basic structure of a radio frequency receiver system, namely: antenna - low pass filter - low noise amplifier (LNA) - mixer - phase lock loop (PLL) - demodulator - audio output. This article describes an empirical study of the GRF-3300 Receiver RF Circuit Training System by presenting the results of system testing which are very easy to understand, including the workings and functions of the receiver system props and the basic modules used in the receiving system, so that it can be used help electrical engineering students, especially telecommunications engineering majors. From the test results, the RF Circuit Training System GRF-3300 receiver training kit produces a Total Harmonic Distortion test value of around 5% when an input signal of 1Vrms is given.ABSTRAK:Pada sistem komunikasi nirkabel, pemancar dan penerima merupakan komponen mendasar yang berperan dalam sistem telekomunikasi. Sistem penerima berfungsi untuk menerima suatu sinyal informasi. Struktur dasar sistem penerima frekuensi radio yaitu: antena – low pass filter – low noise amplifier (LNA) – mixer – phase lock loop (PLL) – demodulator – audio output. Dalam artikel ini menjelaskan tentang studi empiris Receiver RF Circuit Training System GRF-3300 dengan hasil pengujian yang mudah dimengerti, meliputi cara kerja dan fungsi pada alat peraga sistem penerima serta modul-modul struktur dasar yang digunakan dalam sistem penerima, sehingga dapat membantu mahasiwa teknik elektro khususnya jurusan teknik telekomunikasi. Dari hasil pengujian, alat peraga penerima RF Circuit Training System GRF-3300 menghasilkan nilai THD sekitar 5% pada sinyal masukan sebesar 1Vrms.

Real-Time Object Detection Using Yolo Algorithm for Blind People

Vision is one of the foremost necessary sense that human beings use to interact with the surrounding objects. There are more than 200 visually challenges people in this world and being visually challenged obstruct lots of daily activities. Hence it is very important for blind person to know what objects they are interacting with and understand their surroundings. In this project we have created a website, which help the blind people to identify different objects in the surrounding using YOLO V3 algorithm. This integrates different technologies to build a rich website which not only helps to recognize different object in the visually challenged persons surrounding in real time but also guides them through an audio output. YOLO (You Only Look at Once) algorithm is used for object detection and recognition. This algorithm gives very close accuracy for object detection in real time and studies have also proven the this algorithm is faster and better than other object detection algorithms.