scholarly journals Complexity Level Analysis Revisited: What Can 30 Years of Hindsight Tell Us about How the Brain Might Represent Visual Information?

2017 ◽  
Vol 8 ◽  
Author(s):  
John K. Tsotsos
Keyword(s):  
Visual Information ◽  
Complexity Level ◽  
The Brain ◽  
Level Analysis

scholarly journals Cross-Modal Effect of Presenting Visual and Force Feedback That Create the Illusion of Stair-Climbing

2021 ◽  
Vol 11 (7) ◽  
pp. 2987
Author(s):  
Takumi Okumura ◽  
Yuichi Kurita
Keyword(s):  
Visual Information ◽  
Force Feedback ◽  
Activity Level ◽  
Experimental Results ◽  
Stair Climbing ◽  
Mirror Therapy ◽  
Visual Condition ◽  
Stroke Patients ◽  
Head Mount Display ◽  
The Brain

Image therapy, which creates illusions with a mirror and a head mount display, assists movement relearning in stroke patients. Mirror therapy presents the movement of the unaffected limb in a mirror, creating the illusion of movement of the affected limb. As the visual information of images cannot create a fully immersive experience, we propose a cross-modal strategy that supplements the image with sensual information. By interacting with the stimuli received from multiple sensory organs, the brain complements missing senses, and the patient experiences a different sense of motion. Our system generates the sense of stair-climbing in a subject walking on a level floor. The force sensation is presented by a pneumatic gel muscle (PGM). Based on motion analysis in a human lower-limb model and the characteristics of the force exerted by the PGM, we set the appropriate air pressure of the PGM. The effectiveness of the proposed system was evaluated by surface electromyography and a questionnaire. The experimental results showed that by synchronizing the force sensation with visual information, we could match the motor and perceived sensations at the muscle-activity level, enhancing the sense of stair-climbing. The experimental results showed that the visual condition significantly improved the illusion intensity during stair-climbing.

scholarly journals Bio-Inspired Modality Fusion for Active Speaker Detection

2021 ◽  
Vol 11 (8) ◽  
pp. 3397
Author(s):  
Gustavo Assunção ◽  
Nuno Gonçalves ◽  
Paulo Menezes
Keyword(s):  
Superior Colliculus ◽  
Visual Information ◽  
Human Beings ◽  
Validation Process ◽  
Detection Approach ◽  
Wide Range ◽  
Speaker Detection ◽  
The One ◽  
The Brain ◽  
Fusion Ability

Human beings have developed fantastic abilities to integrate information from various sensory sources exploring their inherent complementarity. Perceptual capabilities are therefore heightened, enabling, for instance, the well-known "cocktail party" and McGurk effects, i.e., speech disambiguation from a panoply of sound signals. This fusion ability is also key in refining the perception of sound source location, as in distinguishing whose voice is being heard in a group conversation. Furthermore, neuroscience has successfully identified the superior colliculus region in the brain as the one responsible for this modality fusion, with a handful of biological models having been proposed to approach its underlying neurophysiological process. Deriving inspiration from one of these models, this paper presents a methodology for effectively fusing correlated auditory and visual information for active speaker detection. Such an ability can have a wide range of applications, from teleconferencing systems to social robotics. The detection approach initially routes auditory and visual information through two specialized neural network structures. The resulting embeddings are fused via a novel layer based on the superior colliculus, whose topological structure emulates spatial neuron cross-mapping of unimodal perceptual fields. The validation process employed two publicly available datasets, with achieved results confirming and greatly surpassing initial expectations.

Retinal input influences pace of neurogenesis but not cell-type configuration of the visual forebrain

2021 ◽  
Author(s):  
Shachar Sherman ◽  
Koichi Kawakami ◽  
Herwig Baier
Keyword(s):  
Visual Information ◽  
Visual Stimulation ◽  
Ganglion Cells ◽  
Neuronal Cell ◽  
Cell Types ◽  
Vertebrate Brain ◽  
Relative Contribution ◽  
Retinal Input ◽  
And Migration ◽  
The Brain

The brain is assembled during development by both innate and experience-dependent mechanisms1-7, but the relative contribution of these factors is poorly understood. Axons of retinal ganglion cells (RGCs) connect the eye to the brain, forming a bottleneck for the transmission of visual information to central visual areas. RGCs secrete molecules from their axons that control proliferation, differentiation and migration of downstream components7-9. Spontaneously generated waves of retinal activity, but also intense visual stimulation, can entrain responses of RGCs10 and central neurons11-16. Here we asked how the cellular composition of central targets is altered in a vertebrate brain that is depleted of retinal input throughout development. For this, we first established a molecular catalog17 and gene expression atlas18 of neuronal subpopulations in the retinorecipient areas of larval zebrafish. We then searched for changes in lakritz (atoh7-) mutants, in which RGCs do not form19. Although individual forebrain-expressed genes are dysregulated in lakritz mutants, the complete set of 77 putative neuronal cell types in thalamus, pretectum and tectum are present. While neurogenesis and differentiation trajectories are overall unaltered, a greater proportion of cells remain in an uncommitted progenitor stage in the mutant. Optogenetic stimulation of a pretectal area20,21 evokes a visual behavior in blind mutants indistinguishable from wildtype. Our analysis shows that, in this vertebrate visual system, neurons are produced more slowly, but specified and wired up in a proper configuration in the absence of any retinal signals.

scholarly journals Reconstructing feedback representations in ventral visual pathway with a generative adversarial autoencoder

2020 ◽  
Author(s):  
Haider Al-Tahan ◽  
Yalda Mohsenzadeh
Keyword(s):  
Neural Network ◽  
Visual Information ◽  
Visual Pathway ◽  
Functional Magnetic Resonance ◽  
Low Level ◽  
Ventral Visual Pathway ◽  
High Level ◽  
Feedback Connections ◽  
The Brain ◽  
Insight Into

AbstractWhile vision evokes a dense network of feedforward and feedback neural processes in the brain, visual processes are primarily modeled with feedforward hierarchical neural networks, leaving the computational role of feedback processes poorly understood. Here, we developed a generative autoencoder neural network model and adversarially trained it on a categorically diverse data set of images. We hypothesized that the feedback processes in the ventral visual pathway can be represented by reconstruction of the visual information performed by the generative model. We compared representational similarity of the activity patterns in the proposed model with temporal (magnetoencephalography) and spatial (functional magnetic resonance imaging) visual brain responses. The proposed generative model identified two segregated neural dynamics in the visual brain. A temporal hierarchy of processes transforming low level visual information into high level semantics in the feedforward sweep, and a temporally later dynamics of inverse processes reconstructing low level visual information from a high level latent representation in the feedback sweep. Our results append to previous studies on neural feedback processes by presenting a new insight into the algorithmic function and the information carried by the feedback processes in the ventral visual pathway.Author summaryIt has been shown that the ventral visual cortex consists of a dense network of regions with feedforward and feedback connections. The feedforward path processes visual inputs along a hierarchy of cortical areas that starts in early visual cortex (an area tuned to low level features e.g. edges/corners) and ends in inferior temporal cortex (an area that responds to higher level categorical contents e.g. faces/objects). Alternatively, the feedback connections modulate neuronal responses in this hierarchy by broadcasting information from higher to lower areas. In recent years, deep neural network models which are trained on object recognition tasks achieved human-level performance and showed similar activation patterns to the visual brain. In this work, we developed a generative neural network model that consists of encoding and decoding sub-networks. By comparing this computational model with the human brain temporal (magnetoencephalography) and spatial (functional magnetic resonance imaging) response patterns, we found that the encoder processes resemble the brain feedforward processing dynamics and the decoder shares similarity with the brain feedback processing dynamics. These results provide an algorithmic insight into the spatiotemporal dynamics of feedforward and feedback processes in biological vision.

scholarly journals A method for single-neuron chronic recording from the retina in awake mice

Science ◽  
2018 ◽  
Vol 360 (6396) ◽  
pp. 1447-1451 ◽  
Author(s):  
Guosong Hong ◽  
Tian-Ming Fu ◽  
Mu Qiao ◽  
Robert D. Viveros ◽  
Xiao Yang ◽  
...  
Keyword(s):  
Retinal Ganglion Cells ◽  
Visual Information ◽  
Single Neuron ◽  
Ganglion Cells ◽  
Ex Vivo ◽  
Neural Circuitry ◽  
Retinal Ganglion ◽  
Chronic Recording ◽  
The Brain

The retina, which processes visual information and sends it to the brain, is an excellent model for studying neural circuitry. It has been probed extensively ex vivo but has been refractory to chronic in vivo electrophysiology. We report a nonsurgical method to achieve chronically stable in vivo recordings from single retinal ganglion cells (RGCs) in awake mice. We developed a noncoaxial intravitreal injection scheme in which injected mesh electronics unrolls inside the eye and conformally coats the highly curved retina without compromising normal eye functions. The method allows 16-channel recordings from multiple types of RGCs with stable responses to visual stimuli for at least 2 weeks, and reveals circadian rhythms in RGC responses over multiple day/night cycles.

Difficult Turned Easy: Suggestion Renders a Challenging Visual Task Simple

2020 ◽  
pp. 095679762095485
Author(s):  
Mathieu Landry ◽  
Jason Da Silva Castanheira ◽  
Jérôme Sackur ◽  
Amir Raz
Keyword(s):  
Mental Imagery ◽  
Visual Information ◽  
Perceptual Experience ◽  
Sensory Input ◽  
Moving Objects ◽  
Visual Stimuli ◽  
Perceptual Information ◽  
Hypnotic Suggestion ◽  
Adult Participants ◽  
The Brain

Suggestions can cause some individuals to miss or disregard existing visual stimuli, but can they infuse sensory input with nonexistent information? Although several prominent theories of hypnotic suggestion propose that mental imagery can change our perceptual experience, data to support this stance remain sparse. The present study addressed this lacuna, showing how suggesting the presence of physically absent, yet critical, visual information transforms an otherwise difficult task into an easy one. Here, we show how adult participants who are highly susceptible to hypnotic suggestion successfully hallucinated visual occluders on top of moving objects. Our findings support the idea that, at least in some people, suggestions can add perceptual information to sensory input. This observation adds meaningful weight to theoretical, clinical, and applied aspects of the brain and psychological sciences.

The Biomechanical Response of Normal and Glaucoma Human Sclera

2010 ◽  
Author(s):  
Baptiste Coudrillier ◽  
Kristin M. Myers ◽  
Thao D. Nguyen
Keyword(s):  
Retinal Ganglion Cells ◽  
Material Properties ◽  
Visual Information ◽  
Ganglion Cells ◽  
Retinal Ganglion ◽  
Progressive Degeneration ◽  
Biomechanical Response ◽  
Elevated Intraocular Pressure ◽  
The Relationship ◽  
The Brain

By 2010, 60 million people will have glaucoma, the second leading cause of blindness worldwide [1]. The disease is characterized by a progressive degeneration of the retinal ganglion cells (RGC), a type of neuron that transmits visual information to the brain. It is well know that elevated intraocular pressure (IOP) is a risk factor in the damage to the RGCs [3–5], but the relationship between the mechanical properties of the ocular connective tissue and how it affects cellular function is not well characterized. The cornea and the sclera are collage-rich structures that comprise the outer load-bearing shell of the eye. Their preferentially aligned collagen lamellae provide mechanical strength to resist ocular expansion. Previous uniaxial tension studies suggest that altered viscoelastic material properties of the eye wall play a role in glaucomatous damage [6].

Characterization of Fiber Organization in Rat Corneo-Scleral Shells Using Small Angle Light Scattering

2010 ◽  
Author(s):  
C. Ross Ethier ◽  
Annegret Dahlmann ◽  
Sauparnika Vijay ◽  
Peng T. Khaw ◽  
Michaël J. A. Girard
Keyword(s):  
Visual Information ◽  
Structural Damage ◽  
Common Cause ◽  
Progressive Loss ◽  
Elevated Intraocular Pressure ◽  
Small Angle Light Scattering ◽  
The Brain ◽  
Fiber Organization ◽  
Lines Of Evidence

Glaucoma is the second most common cause of blindness worldwide. It is associated with structural damage and a progressive loss of nerve cells — which transmit visual information from the retina to the brain — within the optic nerve head (ONH) at the posterior eye. Glaucoma was once thought to occur only in eyes with elevated intraocular pressure (IOP) and, to date, lowering IOP is the only clinical treatment proven to be beneficial for slowing its progression. However, the success rate of such therapy is only about 50% and multiple lines of evidence now indicate that IOP is not the only important risk factor in the disease since glaucoma can develop at either normal or elevated IOP without distinct etiology.

Sign in / Sign up

Export Citation Format

Share Document