Biologically inspired self-motion estimation using the fusion of airspeed and optical flow

2006 ◽  
Author(s):  
A.J. Rutkowski ◽  
R.D. Quinn ◽  
M.A. Willis
Keyword(s):  
Motion Estimation ◽  
Optical Flow ◽  
Biologically Inspired ◽  
Self Motion

scholarly journals Neuromorphic Configurable Architecture for Robust Motion Estimation

2008 ◽  
Vol 2008 ◽  
pp. 1-9 ◽  
Author(s):  
Guillermo Botella ◽  
Manuel Rodríguez ◽  
Antonio García ◽  
Eduardo Ros
Keyword(s):  
Visual System ◽  
Motion Estimation ◽  
Optical Flow ◽  
Visual Motion ◽  
Specific Model ◽  
Biologically Inspired ◽  
Visual Motion Perception ◽  
Illumination Changes ◽  
And Performance ◽  
Application Fields

The robustness of the human visual system recovering motion estimation in almost any visual situation is enviable, performing enormous calculation tasks continuously, robustly, efficiently, and effortlessly. There is obviously a great deal we can learn from our own visual system. Currently, there are several optical flow algorithms, although none of them deals efficiently with noise, illumination changes, second-order motion, occlusions, and so on. The main contribution of this work is the efficient implementation of a biologically inspired motion algorithm that borrows nature templates as inspiration in the design of architectures and makes use of a specific model of human visual motion perception: Multichannel Gradient Model (McGM). This novel customizable architecture of a neuromorphic robust optical flow can be constructed with FPGA or ASIC device using properties of the cortical motion pathway, constituting a useful framework for building future complex bioinspired systems running in real time with high computational complexity. This work includes the resource usage and performance data, and the comparison with actual systems. This hardware has many application fields like object recognition, navigation, or tracking in difficult environments due to its bioinspired and robustness properties.

scholarly journals ARTFLOW: A Fast, Biologically Inspired Neural Network That Learns Optic Flow Templates for Self-Motion Estimation

Sensors ◽  
2021 ◽  
Vol 21 (24) ◽  
pp. 8217
Author(s):  
Oliver W. Layton
Keyword(s):  
Neural Network ◽  
Motion Estimation ◽  
Optic Flow ◽  
Hebbian Learning ◽  
Learning Algorithm ◽  
Feature Learning ◽  
Hierarchical Architecture ◽  
Biologically Inspired ◽  
Fuzzy Art ◽  
Self Motion

Most algorithms for steering, obstacle avoidance, and moving object detection rely on accurate self-motion estimation, a problem animals solve in real time as they navigate through diverse environments. One biological solution leverages optic flow, the changing pattern of motion experienced on the eye during self-motion. Here I present ARTFLOW, a biologically inspired neural network that learns patterns in optic flow to encode the observer’s self-motion. The network combines the fuzzy ART unsupervised learning algorithm with a hierarchical architecture based on the primate visual system. This design affords fast, local feature learning across parallel modules in each network layer. Simulations show that the network is capable of learning stable patterns from optic flow simulating self-motion through environments of varying complexity with only one epoch of training. ARTFLOW trains substantially faster and yields self-motion estimates that are far more accurate than a comparable network that relies on Hebbian learning. I show how ARTFLOW serves as a generative model to predict the optic flow that corresponds to neural activations distributed across the network.

scholarly journals Ego-Motion Estimation Using Recurrent Convolutional Neural Networks through Optical Flow Learning

Electronics ◽  
2021 ◽  
Vol 10 (3) ◽  
pp. 222
Author(s):  
Baigan Zhao ◽  
Yingping Huang ◽  
Hongjian Wei ◽  
Xing Hu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Motion Estimation ◽  
Optical Flow ◽  
Feature Representation ◽  
Sequential Learning ◽  
Navigation Systems ◽  
Motion State ◽  
Training Schemes ◽  
Sequential Images

Visual odometry (VO) refers to incremental estimation of the motion state of an agent (e.g., vehicle and robot) by using image information, and is a key component of modern localization and navigation systems. Addressing the monocular VO problem, this paper presents a novel end-to-end network for estimation of camera ego-motion. The network learns the latent subspace of optical flow (OF) and models sequential dynamics so that the motion estimation is constrained by the relations between sequential images. We compute the OF field of consecutive images and extract the latent OF representation in a self-encoding manner. A Recurrent Neural Network is then followed to examine the OF changes, i.e., to conduct sequential learning. The extracted sequential OF subspace is used to compute the regression of the 6-dimensional pose vector. We derive three models with different network structures and different training schemes: LS-CNN-VO, LS-AE-VO, and LS-RCNN-VO. Particularly, we separately train the encoder in an unsupervised manner. By this means, we avoid non-convergence during the training of the whole network and allow more generalized and effective feature representation. Substantial experiments have been conducted on KITTI and Malaga datasets, and the results demonstrate that our LS-RCNN-VO outperforms the existing learning-based VO approaches.

scholarly journals Does perceptual-motor recalibration of locomotion depend on perceived self motion or the magnitude of optical flow?

2010 ◽  
Vol 5 (8) ◽  
pp. 386-386
Author(s):  
W. B. Thompson ◽  
B. J. Mohler ◽  
S. H. Creem-Regehr
Keyword(s):  
Optical Flow ◽  
Self Motion

scholarly journals How multisensory neurons solve causal inference

2021 ◽  
Vol 118 (32) ◽  
pp. e2106235118
Author(s):  
Reuben Rideaux ◽  
Katherine R. Storrs ◽  
Guido Maiello ◽  
Andrew E. Welchman
Keyword(s):  
Motion Estimation ◽  
Causal Inference ◽  
Visual Motion ◽  
Temporal Area ◽  
Medial Superior Temporal ◽  
Electrophysiological Recordings ◽  
Visual Motion Cues ◽  
Integrated Or ◽  
Self Motion ◽  
The Brain

Sitting in a static railway carriage can produce illusory self-motion if the train on an adjoining track moves off. While our visual system registers motion, vestibular signals indicate that we are stationary. The brain is faced with a difficult challenge: is there a single cause of sensations (I am moving) or two causes (I am static, another train is moving)? If a single cause, integrating signals produces a more precise estimate of self-motion, but if not, one cue should be ignored. In many cases, this process of causal inference works without error, but how does the brain achieve it? Electrophysiological recordings show that the macaque medial superior temporal area contains many neurons that encode combinations of vestibular and visual motion cues. Some respond best to vestibular and visual motion in the same direction (“congruent” neurons), while others prefer opposing directions (“opposite” neurons). Congruent neurons could underlie cue integration, but the function of opposite neurons remains a puzzle. Here, we seek to explain this computational arrangement by training a neural network model to solve causal inference for motion estimation. Like biological systems, the model develops congruent and opposite units and recapitulates known behavioral and neurophysiological observations. We show that all units (both congruent and opposite) contribute to motion estimation. Importantly, however, it is the balance between their activity that distinguishes whether visual and vestibular cues should be integrated or separated. This explains the computational purpose of puzzling neural representations and shows how a relatively simple feedforward network can solve causal inference.

Sign in / Sign up

Export Citation Format

Share Document