A Hybrid Bio-inspired System: Hardware Spiking Neural Network Incorporating Hebbian Learning with Microprocessor Based Evolutionary Control Algorithm

2006 ◽  
Author(s):  
D. Allen ◽  
D.M. Halliday ◽  
A.M. Tyrrell
Keyword(s):  
Neural Network ◽  
Control Algorithm ◽  
Hebbian Learning ◽  
Spiking Neural Network ◽  
Evolutionary Control

scholarly journals Adaptive SNN for Anthropomorphic Finger Control

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2730
Author(s):  
Mircea Hulea ◽  
George Iulian Uleru ◽  
Constantin Florin Caruntu
Keyword(s):  
Neural Network ◽  
Hebbian Learning ◽  
Metacarpophalangeal Joint ◽  
Human Hand ◽  
Spiking Neural Network ◽  
Biological Plausibility ◽  
Learning Mechanisms ◽  
Joint Rotation ◽  
Control Units ◽  
Anthropomorphic Hands

Anthropomorphic hands that mimic the smoothness of human hand motions should be controlled by artificial units of high biological plausibility. Adaptability is among the characteristics of such control units, which provides the anthropomorphic hand with the ability to learn motions. This paper presents a simple structure of an adaptive spiking neural network implemented in analogue hardware that can be trained using Hebbian learning mechanisms to rotate the metacarpophalangeal joint of a robotic finger towards targeted angle intervals. Being bioinspired, the spiking neural network drives actuators made of shape memory alloy and receives feedback from neuromorphic sensors that convert the joint rotation angle and compression force into the spiking frequency. The adaptive SNN activates independent neural paths that correspond to angle intervals and learns in which of these intervals the rotation the finger rotation is stopped by an external force. Learning occurs when angle-specific neural paths are stimulated concurrently with the supraliminar stimulus that activates all the neurons that inhibit the SNN output stopping the finger. The results showed that after learning, the finger stopped in the angle interval in which the angle-specific neural path was active, without the activation of the supraliminar stimulus. The proposed concept can be used to implement control units for anthropomorphic robots that are able to learn motions unsupervised, based on principles of high biological plausibility.

Competitive STDP Learning of Overlapping Spatial Patterns

2015 ◽  
Vol 27 (8) ◽  
pp. 1673-1685 ◽  
Author(s):  
Dalius Krunglevicius
Keyword(s):  
Neural Network ◽  
Euclidean Distance ◽  
Hebbian Learning ◽  
Spike Timing ◽  
Spiking Neural Network ◽  
Size Dependent ◽  
Learning Rules ◽  
Pattern Size ◽  
Dependent Parameter ◽  
Simple Neural Network

Spike-timing-dependent plasticity (STDP) is a set of Hebbian learning rules firmly based on biological evidence. It has been demonstrated that one of the STDP learning rules is suited for learning spatiotemporal patterns. When multiple neurons are organized in a simple competitive spiking neural network, this network is capable of learning multiple distinct patterns. If patterns overlap significantly (i.e., patterns are mutually inclusive), however, competition would not preclude trained neuron’s responding to a new pattern and adjusting synaptic weights accordingly. This letter presents a simple neural network that combines vertical inhibition and Euclidean distance-dependent synaptic strength factor. This approach helps to solve the problem of pattern size-dependent parameter optimality and significantly reduces the probability of a neuron’s forgetting an already learned pattern. For demonstration purposes, the network was trained for the first ten letters of the Braille alphabet.

scholarly journals Hybrid memristor-CMOS neurons for in situ learning in fully hardware memristive spiking neural networks

2020 ◽  
Author(s):  
Xumeng Zhang ◽  
Jian Lu ◽  
Rui Wang ◽  
Jinsong Wei ◽  
Tuo Shi ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Hebbian Learning ◽  
Spiking Neurons ◽  
Spiking Neural Networks ◽  
Spiking Neural Network ◽  
Neuromorphic Computing ◽  
Efficient Data ◽  
Neuron Function

Abstract Spiking neural network, consisting of spiking neurons and plastic synapses, is a promising but relatively underdeveloped neural network for neuromorphic computing. Inspired by the human brain, it provides a unique solution for highly efficient data processing. Recently, memristor-based neurons and synapses are becoming intriguing candidates to build spiking neural networks in hardware, owing to the close resemblance between their device dynamics and the biological counterparts. However, the functionalities of memristor-based neurons are currently very limited, and a hardware demonstration of fully memristor-based spiking neural networks supporting in situ learning is very challenging. Here, a hybrid spiking neuron by combining the memristor with simple digital circuits is designed and implemented in hardware to enhance the neuron functions. The hybrid neuron with memristive dynamics not only realizes the basic leaky integrate-and-fire neuron function but also enables the in situ tuning of the connected synaptic weights. Finally, a fully hardware spiking neural network with the hybrid neurons and memristive synapses is experimentally demonstrated for the first time, with which in situ Hebbian learning is achieved. This work opens up a way towards the implementation of spiking neurons, supporting in situ learning for future neuromorphic computing systems.

Design of Intelligent Controller for Ship Motion with Input Saturation Based on Optimized Radial Basis Function Neural Network

2020 ◽  
Vol 13 ◽  
Author(s):  
Renqiang Wang ◽  
Qinrong Li ◽  
Shengze Miao ◽  
Keyin Miao ◽  
Hua Deng
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Sliding Mode Control ◽  
Intelligent Control ◽  
Control Algorithm ◽  
Sliding Mode ◽  
Rbf Neural Network ◽  
Input Saturation ◽  
Ship Motion ◽  
Mode Control

Abstract: The purpose of this paper was to design an intelligent controller of ship motion based on sliding mode control with a Radial Basis Function (RBF) neural network optimized by the genetic algorithm and expansion observer. First, the improved genetic algorithm based on the distributed genetic algorithm with adaptive fitness and adaptive mutation was used to automatically optimize the RBF neural network. Then, with the compensation designed by the RBF neural network, anti-saturation control was realized. Additionally, the intelligent control algorithm was introduced by Sliding Mode Control (SMC) with the stability theory. A comparative study of sliding mode control integrated with the RBF neural network and proportional–integral–derivative control combined with the fuzzy optimization model showed that the stabilization time of the intelligent control system was 43.75% faster and the average overshoot was reduced by 52% compared with the previous two attempts. Background: It was known that the Proportional-Integral-Derivative (PID) control and self-adaptation control cannot really solve the problems of frequent disturbance from external wind and waves, as well as the problems with ship nonlinearity and input saturation. So, the previous ship motion controller should be transformed by advanced intelligent technology, on the basis of referring to the latest relevant patent design methods. Objective: An intelligent controller of ship motion was designed based on optimized Radial Basis Function Neural Network (RBFNN) in the presence of non-linearity, uncertainty, and limited input. Methods: The previous ship motion controller was remodeled based on Sliding Mode Control (SMC) with RBFNN optimized by improved genetic algorithm and expansion observer. The intelligent control algorithm integrated with genetic neural network solved the problem of system model uncertainty, limited control input, and external interference. Distributed genetic with adaptive fitness and adaptive mutation method guaranteed the adequacy of search and the global optimal convergence results, which enhanced the approximation ability of RBFNN. With the compensation designed by the optimized RBFNN, it was realized anti-saturation control. The chattering caused by external disturbance in SMC controller was reduced by the expansion observer. Results: A comparative study with RBFNN-SMC control and fuzzy-PID control, the stabilization time of the intelligent control system was 43.75% faster, the average overshoot was reduced by 52%, compared to the previous two attempts. Conclusion: The intelligent control algorithm succeed in dealing with the problems of nonlinearity, uncertainty, input saturation, and external interference. The intelligent control algorithm can be applied into research and development ship steering system, which would be created a new patent.

scholarly journals Estimation of the influence of spiking neural network parameters on classification accuracy using a genetic algorithm

2018 ◽  
Vol 145 ◽  
pp. 488-494 ◽  
Author(s):  
Aleksandr Sboev ◽  
Alexey Serenko ◽  
Roman Rybka ◽  
Danila Vlasov ◽  
Andrey Filchenkov
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Classification Accuracy ◽  
Spiking Neural Network ◽  
Network Parameters

scholarly journals Radar Emitter Identification Based on Fully Connected Spiking Neural Network

2021 ◽  
Vol 1914 (1) ◽  
pp. 012036
Author(s):  
LI Wei ◽  
Zhu Wei-gang ◽  
Pang Hong-feng ◽  
Zhao Hong-yu
Keyword(s):  
Neural Network ◽  
Spiking Neural Network ◽  
Fully Connected

scholarly journals Spatial Memory in a Spiking Neural Network with Robot Embodiment

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2678
Author(s):  
Sergey A. Lobov ◽  
Alexey I. Zharinov ◽  
Valeri A. Makarov ◽  
Victor B. Kazantsev
Keyword(s):  
Neural Network ◽  
Spatial Memory ◽  
Internal Representation ◽  
Learning Curves ◽  
Global Network ◽  
Spiking Neural Network ◽  
Interference Phenomenon ◽  
Brain Functioning ◽  
Information Characteristics ◽  
Catastrophic Interference

Cognitive maps and spatial memory are fundamental paradigms of brain functioning. Here, we present a spiking neural network (SNN) capable of generating an internal representation of the external environment and implementing spatial memory. The SNN initially has a non-specific architecture, which is then shaped by Hebbian-type synaptic plasticity. The network receives stimuli at specific loci, while the memory retrieval operates as a functional SNN response in the form of population bursts. The SNN function is explored through its embodiment in a robot moving in an arena with safe and dangerous zones. We propose a measure of the global network memory using the synaptic vector field approach to validate results and calculate information characteristics, including learning curves. We show that after training, the SNN can effectively control the robot’s cognitive behavior, allowing it to avoid dangerous regions in the arena. However, the learning is not perfect. The robot eventually visits dangerous areas. Such behavior, also observed in animals, enables relearning in time-evolving environments. If a dangerous zone moves into another place, the SNN remaps positive and negative areas, allowing escaping the catastrophic interference phenomenon known for some AI architectures. Thus, the robot adapts to changing world.

scholarly journals Using a Low-Power Spiking Continuous Time Neuron (SCTN) for Sound Signal Processing

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1065
Author(s):  
Moshe Bensimon ◽  
Shlomo Greenberg ◽  
Moshe Haiut
Keyword(s):  
Neural Network ◽  
Network Structure ◽  
Analog Circuits ◽  
Continuous Time ◽  
Spiking Neurons ◽  
Spiking Neural Network ◽  
Sound Classification ◽  
Classification Framework ◽  
Neural Network Structure ◽  
Simple Analog

This work presents a new approach based on a spiking neural network for sound preprocessing and classification. The proposed approach is biologically inspired by the biological neuron’s characteristic using spiking neurons, and Spike-Timing-Dependent Plasticity (STDP)-based learning rule. We propose a biologically plausible sound classification framework that uses a Spiking Neural Network (SNN) for detecting the embedded frequencies contained within an acoustic signal. This work also demonstrates an efficient hardware implementation of the SNN network based on the low-power Spike Continuous Time Neuron (SCTN). The proposed sound classification framework suggests direct Pulse Density Modulation (PDM) interfacing of the acoustic sensor with the SCTN-based network avoiding the usage of costly digital-to-analog conversions. This paper presents a new connectivity approach applied to Spiking Neuron (SN)-based neural networks. We suggest considering the SCTN neuron as a basic building block in the design of programmable analog electronics circuits. Usually, a neuron is used as a repeated modular element in any neural network structure, and the connectivity between the neurons located at different layers is well defined. Thus, generating a modular Neural Network structure composed of several layers with full or partial connectivity. The proposed approach suggests controlling the behavior of the spiking neurons, and applying smart connectivity to enable the design of simple analog circuits based on SNN. Unlike existing NN-based solutions for which the preprocessing phase is carried out using analog circuits and analog-to-digital conversion, we suggest integrating the preprocessing phase into the network. This approach allows referring to the basic SCTN as an analog module enabling the design of simple analog circuits based on SNN with unique inter-connections between the neurons. The efficiency of the proposed approach is demonstrated by implementing SCTN-based resonators for sound feature extraction and classification. The proposed SCTN-based sound classification approach demonstrates a classification accuracy of 98.73% using the Real-World Computing Partnership (RWCP) database.

Sign in / Sign up

Export Citation Format

Share Document