scholarly journals Cognitive and Affective Assessment of Navigation and Mobility Tasks for the Visually Impaired via Electroencephalography and Behavioral Signals

Sensors ◽  
2020 ◽  
Vol 20 (20) ◽  
pp. 5821
Author(s):  
Robert-Gabriel Lupu ◽  
Oana Mitruț ◽  
Andrei Stan ◽  
Florina Ungureanu ◽  
Kyriaki Kalimeri ◽  
...  

This paper presented the assessment of cognitive load (as an effective real-time index of task difficulty) and the level of brain activation during an experiment in which eight visually impaired subjects performed two types of tasks while using the white cane and the Sound of Vision assistive device with three types of sensory input—audio, haptic, and multimodal (audio and haptic simultaneously). The first task was to identify object properties and the second to navigate and avoid obstacles in both the virtual environment and real-world settings. The results showed that the haptic stimuli were less intuitive than the audio ones and that the navigation with the Sound of Vision device increased cognitive load and working memory. Visual cortex asymmetry was lower in the case of multimodal stimulation than in the case of separate stimulation (audio or haptic). There was no correlation between visual cortical activity and the number of collisions during navigation, regardless of the type of navigation or sensory input. The visual cortex was activated when using the device, but only for the late-blind users. For all the subjects, the navigation with the Sound of Vision device induced a low negative valence, in contrast with the white cane navigation.

2019 ◽  
Author(s):  
Yosef Singer ◽  
Ben D. B. Willmore ◽  
Andrew J. King ◽  
Nicol S. Harper

Visual neurons respond selectively to specific features that become increasingly complex in their form and dynamics from the eyes to the cortex. Retinal neurons prefer localized flashing spots of light, primary visual cortical (V1) neurons moving bars, and those in higher cortical areas, such as middle temporal (MT) cortex, favor complex features like moving textures. Whether there are general computational principles behind this diversity of response properties remains unclear. To date, no single normative model has been able to account for the hierarchy of tuning to dynamic inputs along the visual pathway. Here we show that hierarchical application of temporal prediction - representing features that efficiently predict future sensory input from past sensory input - can explain how neuronal tuning properties, particularly those relating to motion, change from retina to higher visual cortex. This suggests that the brain may not have evolved to efficiently represent all incoming information, as implied by some leading theories. Instead, the selective representation of sensory inputs that help in predicting the future may be a general neural coding principle, which when applied hierarchically extracts temporally-structured features that depend on increasingly high-level statistics of the sensory input.


2020 ◽  
Vol 132 (6) ◽  
pp. 2000-2007 ◽  
Author(s):  
Soroush Niketeghad ◽  
Abirami Muralidharan ◽  
Uday Patel ◽  
Jessy D. Dorn ◽  
Laura Bonelli ◽  
...  

Stimulation of primary visual cortices has the potential to restore some degree of vision to blind individuals. Developing safe and reliable visual cortical prostheses requires assessment of the long-term stability, feasibility, and safety of generating stimulation-evoked perceptions.A NeuroPace responsive neurostimulation system was implanted in a blind individual with an 8-year history of bare light perception, and stimulation-evoked phosphenes were evaluated over 19 months (41 test sessions). Electrical stimulation was delivered via two four-contact subdural electrode strips implanted over the right medial occipital cortex. Current and charge thresholds for eliciting visual perception (phosphenes) were measured, as were the shape, size, location, and intensity of the phosphenes. Adverse events were also assessed.Stimulation of all contacts resulted in phosphene perception. Phosphenes appeared completely or partially in the left hemifield. Stimulation of the electrodes below the calcarine sulcus elicited phosphenes in the superior hemifield and vice versa. Changing the stimulation parameters of frequency, pulse width, and burst duration affected current thresholds for eliciting phosphenes, and increasing the amplitude or frequency of stimulation resulted in brighter perceptions. While stimulation thresholds decreased between an average of 5% and 12% after 19 months, spatial mapping of phosphenes remained consistent over time. Although no serious adverse events were observed, the subject experienced mild headaches and dizziness in three instances, symptoms that did not persist for more than a few hours and for which no clinical intervention was required.Using an off-the-shelf neurostimulator, the authors were able to reliably generate phosphenes in different areas of the visual field over 19 months with no serious adverse events, providing preliminary proof of feasibility and safety to proceed with visual epicortical prosthetic clinical trials. Moreover, they systematically explored the relationship between stimulation parameters and phosphene thresholds and discovered the direct relation of perception thresholds based on primary visual cortex (V1) neuronal population excitation thresholds.


1984 ◽  
Vol 52 (5) ◽  
pp. 941-960 ◽  
Author(s):  
L. Tong ◽  
R. E. Kalil ◽  
P. D. Spear

Previous experiments have found that neurons in the cat's lateral suprasylvian (LS) visual area of cortex show functional compensation following removal of visual cortical areas 17, 18, and 19 on the day of birth. Correspondingly, an enhanced retino-thalamic pathway to LS cortex develops in these cats. The present experiments investigated the critical periods for these changes. Unilateral lesions of areas 17, 18, and 19 were made in cats ranging in age from 1 day postnatal to 26 wk. When the cats were adult, single-cell recordings were made from LS cortex ipsilateral to the lesion. In addition, transneuronal autoradiographic methods were used to trace the retino-thalamic projections to LS cortex in many of the same animals. Following lesions in 18- and 26-wk-old cats, there is a marked reduction in direction-selective LS cortex cells and an increase in cells that respond best to stationary flashing stimuli. These results are similar to those following visual cortex lesions in adult cats. In contrast, the percentages of cells with these properties are normal following lesions made from 1 day to 12 wk of age. Thus the critical period for development of direction selectivity and greater responses to moving than to stationary flashing stimuli in LS cortex following a visual cortex lesion ends between 12 and 18 wk of age. Following lesions in 26-wk-old cats, there is a decrease in the percentage of cells that respond to the ipsilateral eye, which is similar to results following visual cortex lesions in adult cats. However, ocular dominance is normal following lesions made from 1 day to 18 wk of age. Thus the critical period for development of responses to the ipsilateral eye following a lesion ends between 18 and 26 wk of age. Following visual cortex lesions in 2-, 4-, or 8-wk-old cats, about 30% of the LS cortex cells display orientation selectivity to elongated slits of light. In contrast, few or no cells display this property in normal adult cats, cats with lesions made on the day of birth, or cats with lesions made at 12 wk of age or later. Thus an anomalous property develops for many LS cells, and the critical period for this property begins later (between 1 day and 2 wk) and ends earlier (between 8 and 12 wk) than those for other properties.(ABSTRACT TRUNCATED AT 400 WORDS)


2020 ◽  
Author(s):  
Lukas Klimmasch ◽  
Johann Schneider ◽  
Alexander Lelais ◽  
Bertram E. Shi ◽  
Jochen Triesch

AbstractThe development of binocular vision is an active learning process comprising the development of disparity tuned neurons in visual cortex and the establishment of precise vergence control of the eyes. We present a computational model for the learning and self-calibration of active binocular vision based on the Active Efficient Coding framework, an extension of classic efficient coding ideas to active perception. Under normal rearing conditions, the model develops disparity tuned neurons and precise vergence control, allowing it to correctly interpret random dot stereogramms. Under altered rearing conditions modeled after neurophysiological experiments, the model qualitatively reproduces key experimental findings on changes in binocularity and disparity tuning. Furthermore, the model makes testable predictions regarding how altered rearing conditions impede the learning of precise vergence control. Finally, the model predicts a surprising new effect that impaired vergence control affects the statistics of orientation tuning in visual cortical neurons.


eLife ◽  
2021 ◽  
Vol 10 ◽  
Author(s):  
Behrad Noudoost ◽  
Kelsey Lynne Clark ◽  
Tirin Moore

Visually guided behavior relies on the integration of sensory input and information held in working memory (WM). Yet it remains unclear how this is accomplished at the level of neural circuits. We studied the direct visual cortical inputs to neurons within a visuomotor area of prefrontal cortex in behaving monkeys. We show that the efficacy of visual input to prefrontal cortex is gated by information held in WM. Surprisingly, visual input to prefrontal neurons was found to target those with both visual and motor properties, rather than preferentially targeting other visual neurons. Furthermore, activity evoked from visual cortex was larger in magnitude, more synchronous, and more rapid, when monkeys remembered locations that matched the location of visual input. These results indicate that WM directly influences the circuitry that transforms visual input into visually guided behavior.


2015 ◽  
Vol 10 (10) ◽  
pp. 1622 ◽  
Author(s):  
Wen-sheng Hou ◽  
Bing-bing Guo ◽  
Xiao-lin Zheng ◽  
Zhen-gang Lu ◽  
Xing Wang ◽  
...  

2018 ◽  
Vol 35 ◽  
Author(s):  
TAKAO K. HENSCH ◽  
ELIZABETH M. QUINLAN

AbstractThe shift in ocular dominance (OD) of binocular neurons induced by monocular deprivation is the canonical model of synaptic plasticity confined to a postnatal critical period. Developmental constraints on this plasticity not only lend stability to the mature visual cortical circuitry but also impede the ability to recover from amblyopia beyond an early window. Advances with mouse models utilizing the power of molecular, genetic, and imaging tools are beginning to unravel the circuit, cellular, and molecular mechanisms controlling the onset and closure of the critical periods of plasticity in the primary visual cortex (V1). Emerging evidence suggests that mechanisms enabling plasticity in juveniles are not simply lost with age but rather that plasticity is actively constrained by the developmental up-regulation of molecular ‘brakes’. Lifting these brakes enhances plasticity in the adult visual cortex, and can be harnessed to promote recovery from amblyopia. The reactivation of plasticity by experimental manipulations has revised the idea that robust OD plasticity is limited to early postnatal development. Here, we discuss recent insights into the neurobiology of the initiation and termination of critical periods and how our increasingly mechanistic understanding of these processes can be leveraged toward improved clinical treatment of adult amblyopia.


2022 ◽  
Author(s):  
Andrea Kóbor ◽  
Karolina Janacsek ◽  
Petra Hermann ◽  
Zsofia Zavecz ◽  
Vera Varga ◽  
...  

Previous research recognized that humans could extract statistical regularities of the environment to automatically predict upcoming events. However, it has remained unexplored how the brain encodes the distribution of statistical regularities if it continuously changes. To investigate this question, we devised an fMRI paradigm where participants (N = 32) completed a visual four-choice reaction time (RT) task consisting of statistical regularities. Two types of blocks involving the same perceptual elements alternated with one another throughout the task: While the distribution of statistical regularities was predictable in one block type, it was unpredictable in the other. Participants were unaware of the presence of statistical regularities and of their changing distribution across the subsequent task blocks. Based on the RT results, although statistical regularities were processed similarly in both the predictable and unpredictable blocks, participants acquired less statistical knowledge in the unpredictable as compared with the predictable blocks. Whole-brain random-effects analyses showed increased activity in the early visual cortex and decreased activity in the precuneus for the predictable as compared with the unpredictable blocks. Therefore, the actual predictability of statistical regularities is likely to be represented already at the early stages of visual cortical processing. However, decreased precuneus activity suggests that these representations are imperfectly updated to track the multiple shifts in predictability throughout the task. The results also highlight that the processing of statistical regularities in a changing environment could be habitual.


2022 ◽  
pp. 240-271
Author(s):  
Dmytro Zubov

Smart assistive devices for blind and visually impaired (B&VI) people are of high interest today since wearable IoT hardware became available for a wide range of users. In the first project, the Raspberry Pi 3 B board measures a distance to the nearest obstacle via ultrasonic sensor HC-SR04 and recognizes human faces by Pi camera, OpenCV library, and Adam Geitgey module. Objects are found by Bluetooth devices of classes 1-3 and iBeacons. Intelligent eHealth agents cooperate with one another in a smart city mesh network via MQTT and BLE protocols. In the second project, B&VIs are supported to play golf. Golf flagsticks have sound marking devices with a buzzer, NodeMcu Lua ESP8266 ESP-12 WiFi board, and WiFi remote control. In the third project, an assistive device supports the orientation of B&VIs by measuring the distance to obstacles via Arduino Uno and HC-SR04. The distance is pronounced through headphones. In the fourth project, the soft-/hardware complex uses Raspberry Pi 3 B and Bytereal iBeacon fingerprinting to uniquely identify the B&VI location at industrial facilities.


Sign in / Sign up

Export Citation Format

Share Document