scholarly journals Stereo Vision Based Sensory Substitution for the Visually Impaired

Sensors ◽  
2019 ◽  
Vol 19 (12) ◽  
pp. 2771 ◽  
Author(s):  
Simona Caraiman ◽  
Otilia Zvoristeanu ◽  
Adrian Burlacu ◽  
Paul Herghelegiu

The development of computer vision based systems dedicated to help visually impaired people to perceive the environment, to orientate and navigate has been the main research subject of many works in the recent years. A significant ensemble of resources has been employed to support the development of sensory substitution devices (SSDs) and electronic travel aids for the rehabilitation of the visually impaired. The Sound of Vision (SoV) project used a comprehensive approach to develop such an SSD, tackling all the challenging aspects that so far restrained the large scale adoption of such systems by the intended audience: Wearability, real-time operation, pervasiveness, usability, cost. This article is set to present the artificial vision based component of the SoV SSD that performs the scene reconstruction and segmentation in outdoor environments. In contrast with the indoor use case, where the system acquires depth input from a structured light camera, in outdoors SoV relies on stereo vision to detect the elements of interest and provide an audio and/or haptic representation of the environment to the user. Our stereo-based method is designed to work with wearable acquisition devices and still provide a real-time, reliable description of the scene in the context of unreliable depth input from the stereo correspondence and of the complex 6 DOF motion of the head-worn camera. We quantitatively evaluate our approach on a custom benchmarking dataset acquired with SoV cameras and provide the highlights of the usability evaluation with visually impaired users.

Electronics ◽  
2021 ◽  
Vol 10 (14) ◽  
pp. 1619
Author(s):  
Otilia Zvorișteanu ◽  
Simona Caraiman ◽  
Robert-Gabriel Lupu ◽  
Nicolae Alexandru Botezatu ◽  
Adrian Burlacu

For most visually impaired people, simple tasks such as understanding the environment or moving safely around it represent huge challenges. The Sound of Vision system was designed as a sensory substitution device, based on computer vision techniques, that encodes any environment in a naturalistic representation through audio and haptic feedback. The present paper presents a study on the usability of this system for visually impaired people in relevant environments. The aim of the study is to assess how well the system is able to help the perception and mobility of the visually impaired participants in real life environments and circumstances. The testing scenarios were devised to allow the assessment of the added value of the Sound of Vision system compared to traditional assistive instruments, such as the white cane. Various data were collected during the tests to allow for a better evaluation of the performance: system configuration, completion times, electro-dermal activity, video footage, user feedback. With minimal training, the system could be successfully used in outdoor environments to perform various perception and mobility tasks. The benefit of the Sound of Vision device compared to the white cane was confirmed by the participants and by the evaluation results to consist in: providing early feedback about static and dynamic objects, providing feedback about elevated objects, walls, negative obstacles (e.g., holes in the ground) and signs.


2020 ◽  
Vol 32 ◽  
pp. 03054
Author(s):  
Akshata Parab ◽  
Rashmi Nagare ◽  
Omkar Kolambekar ◽  
Parag Patil

Vision is one of the very essential human senses and it plays a major role in human perception about surrounding environment. But for people with visual impairment their definition of vision is different. Visually impaired people are often unaware of dangers in front of them, even in familiar environment. This study proposes a real time guiding system for visually impaired people for solving their navigation problem and to travel without any difficulty. This system will help the visually impaired people by detecting the objects and giving necessary information about that object. This information may include what the object is, its location, its precision, distance from the visually impaired etc. All these information will be conveyed to the person through audio commands so that they can navigate freely anywhere anytime with no or minimal assistance. Object detection is done using You Only Look Once (YOLO) algorithm. As the process of capturing the video/images and sending it to the main module has to be carried at greater speed, Graphics Processing Unit (GPU) is used. This will help in enhancing the overall speed of the system and will help the visually Impaired to get the maximum necessary instructions as quickly as possible. The process starts from capturing the real time video, sending it for analysis and processing and get the calculated results. The results obtained from analysis are conveyed to user by means of hearing aid. As a result by this system the blind or the visually impaired people can visualize the surrounding environment and travel freely from source to destination on their own.


2015 ◽  
Vol 24 (6) ◽  
pp. 1703-1711 ◽  
Author(s):  
Rosana Alves Dias ◽  
Filipe Serra Alves ◽  
Margaret Costa ◽  
Helder Fonseca ◽  
Jorge Cabral ◽  
...  

2018 ◽  
Author(s):  
J. I. Alvarez Claramunt ◽  
P. E. Bizzotto ◽  
F. Sapag ◽  
E. Ferrigno ◽  
J. L. Barros ◽  
...  

2017 ◽  
Vol 10 (2) ◽  
pp. 169-178 ◽  
Author(s):  
Shouhei Kidera ◽  
Luz Maria Neira ◽  
Barry D. Van Veen ◽  
Susan C. Hagness

Microwave ablation is widely recognized as a promising minimally invasive tool for treating cancer. Real-time monitoring of the dimensions of the ablation zone is indispensable for ensuring an effective and safe treatment. In this paper, we propose a microwave imaging algorithm for monitoring the evolution of the ablation zone. Our proposed algorithm determines the boundary of the ablation zone by exploiting the time difference of arrival (TDOA) between signals received before and during the ablation at external antennas surrounding the tissue, using the interstitial ablation antenna as the transmitter. A significant advantage of this method is that it requires few assumptions about the dielectric properties of the propagation media. Also the simplicity of the signal processing, wherein the TDOA is determined from a cross-correlation calculation, allows real-time monitoring and provides robust performance in the presence of noise. We investigate the performance of this approach for the application of breast tumor ablation. We use simulated array measurements obtained from finite-difference time-domain simulations of magnetic resonance imaging-derived numerical breast phantoms. The results demonstrate that our proposed method offers the potential to achieve millimeter-order accuracy and real-time operation in estimating the boundary of the ablation zone in heterogeneous and dispersive breast tissue.


2017 ◽  
Vol 5 (5) ◽  
pp. 320-325
Author(s):  
Ahmad T. Jaiad ◽  
Hamzah Sabr Ghayyib

Water is the most precious and valuable because it’s a basic need of all the human beings but, now a day water supply department are facing problem in real time operation this is because less amount of water in resources due to less rain fall. With increase in Population, urban residential areas have increased because of this reasons water has become a crucial problem which affects the problem of water distribution, interrupted water supply, water conservation, water consumption and also the water quality so, to overcome water supply related problems and make system efficient there is need of proper monitoring and controlling system. In this project, we are focusing on continuous and real time monitoring of water supply in IOT platform. Water supply with continuous monitoring makes a proper distribution so that, we can have a record of available amount of water in tanks, flow rate, abnormality in distribution line. Internet of things is nothing but the network of physical objects embedded with electronics, sensors, software, and network connectivity. Monitoring can be done from anywhere as central office. Using Adafruit as free sever data continuously pushed on cloud so we can see data in real time operation. Using different sensors with controller and raspberry pi as Mini computer can monitor data and also control operation from cloud with efficient client server communication.


Sign in / Sign up

Export Citation Format

Share Document