Sequence learning and generation using a spiking neural network

2012 ◽  
Author(s):  
Fuyuko Watanabe ◽  
Robert H. Fujii
Keyword(s):  
Neural Network ◽  
Sequence Learning ◽  
Spiking Neural Network

scholarly journals Spiking Neural Network Learning Models for Spike Sequence Learning and Data Classification

2020 ◽  
pp. 1-17
Author(s):  
Moses Apambila Agebure ◽  
Edward Yellakuor Baagyere ◽  
Elkanah Olaosebikan Oyetunji
Keyword(s):  
Neural Network ◽  
Supervised Learning ◽  
Sequence Learning ◽  
Data Classification ◽  
Machine Learning Algorithms ◽  
Spiking Neural Network ◽  
Learning Models ◽  
Class Imbalance Problem ◽  
Extensive Evaluation ◽  
Spike Sequence

Supervised learning in Spiking Neural Network (SNN) is a hotbed for researchers due to the advantages temporal coded networks provide over that of rate-coded networks with respect to efficiency in information processing and transfer rates. Supervised learning in rate-coded networks though well established, it is difficult to directly apply such models to SNN due to difference in information coding schemes. In this paper, we seek to exploit the advantages of spiking neural networks for spike sequence learning in order to establish two (2) models; batch and sequential learning models for solving data classification tasks. The models are built using the least squares approach leveraging on its approximation abilities. The first set of experiments are on spikesequence learning in which an extensive evaluation of the model is performed using different inputoutput firing rates and learning periods. Results from these experiments show that the proposed model for spike sequence learning produced better performance than some existing models derived for spike sequence learning, particularly, at higher learning periods. The proposed models for data classification are also tested on some selected benchmark datasets most of which had imbalance class distributions and also on real-world road condition datasets for anomaly classification collected by the authors as part of a larger study. While the proposed models generalised very well to all datasets including those with the class imbalance problem where F1and Recall values above 0.90 were recorded, some well-know machine learning algorithms applied to the datasets yielded lower F1 and Recall values and in some cases recorded 0.0 Recall.

scholarly journals Estimation of the influence of spiking neural network parameters on classification accuracy using a genetic algorithm

2018 ◽  
Vol 145 ◽  
pp. 488-494 ◽  
Author(s):  
Aleksandr Sboev ◽  
Alexey Serenko ◽  
Roman Rybka ◽  
Danila Vlasov ◽  
Andrey Filchenkov
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Classification Accuracy ◽  
Spiking Neural Network ◽  
Network Parameters

scholarly journals Radar Emitter Identification Based on Fully Connected Spiking Neural Network

2021 ◽  
Vol 1914 (1) ◽  
pp. 012036
Author(s):  
LI Wei ◽  
Zhu Wei-gang ◽  
Pang Hong-feng ◽  
Zhao Hong-yu
Keyword(s):  
Neural Network ◽  
Spiking Neural Network ◽  
Fully Connected

scholarly journals Spatial Memory in a Spiking Neural Network with Robot Embodiment

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2678
Author(s):  
Sergey A. Lobov ◽  
Alexey I. Zharinov ◽  
Valeri A. Makarov ◽  
Victor B. Kazantsev
Keyword(s):  
Neural Network ◽  
Spatial Memory ◽  
Internal Representation ◽  
Learning Curves ◽  
Global Network ◽  
Spiking Neural Network ◽  
Interference Phenomenon ◽  
Brain Functioning ◽  
Information Characteristics ◽  
Catastrophic Interference

Cognitive maps and spatial memory are fundamental paradigms of brain functioning. Here, we present a spiking neural network (SNN) capable of generating an internal representation of the external environment and implementing spatial memory. The SNN initially has a non-specific architecture, which is then shaped by Hebbian-type synaptic plasticity. The network receives stimuli at specific loci, while the memory retrieval operates as a functional SNN response in the form of population bursts. The SNN function is explored through its embodiment in a robot moving in an arena with safe and dangerous zones. We propose a measure of the global network memory using the synaptic vector field approach to validate results and calculate information characteristics, including learning curves. We show that after training, the SNN can effectively control the robot’s cognitive behavior, allowing it to avoid dangerous regions in the arena. However, the learning is not perfect. The robot eventually visits dangerous areas. Such behavior, also observed in animals, enables relearning in time-evolving environments. If a dangerous zone moves into another place, the SNN remaps positive and negative areas, allowing escaping the catastrophic interference phenomenon known for some AI architectures. Thus, the robot adapts to changing world.

scholarly journals Using a Low-Power Spiking Continuous Time Neuron (SCTN) for Sound Signal Processing

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1065
Author(s):  
Moshe Bensimon ◽  
Shlomo Greenberg ◽  
Moshe Haiut
Keyword(s):  
Neural Network ◽  
Network Structure ◽  
Analog Circuits ◽  
Continuous Time ◽  
Spiking Neurons ◽  
Spiking Neural Network ◽  
Sound Classification ◽  
Classification Framework ◽  
Neural Network Structure ◽  
Simple Analog

This work presents a new approach based on a spiking neural network for sound preprocessing and classification. The proposed approach is biologically inspired by the biological neuron’s characteristic using spiking neurons, and Spike-Timing-Dependent Plasticity (STDP)-based learning rule. We propose a biologically plausible sound classification framework that uses a Spiking Neural Network (SNN) for detecting the embedded frequencies contained within an acoustic signal. This work also demonstrates an efficient hardware implementation of the SNN network based on the low-power Spike Continuous Time Neuron (SCTN). The proposed sound classification framework suggests direct Pulse Density Modulation (PDM) interfacing of the acoustic sensor with the SCTN-based network avoiding the usage of costly digital-to-analog conversions. This paper presents a new connectivity approach applied to Spiking Neuron (SN)-based neural networks. We suggest considering the SCTN neuron as a basic building block in the design of programmable analog electronics circuits. Usually, a neuron is used as a repeated modular element in any neural network structure, and the connectivity between the neurons located at different layers is well defined. Thus, generating a modular Neural Network structure composed of several layers with full or partial connectivity. The proposed approach suggests controlling the behavior of the spiking neurons, and applying smart connectivity to enable the design of simple analog circuits based on SNN. Unlike existing NN-based solutions for which the preprocessing phase is carried out using analog circuits and analog-to-digital conversion, we suggest integrating the preprocessing phase into the network. This approach allows referring to the basic SCTN as an analog module enabling the design of simple analog circuits based on SNN with unique inter-connections between the neurons. The efficiency of the proposed approach is demonstrated by implementing SCTN-based resonators for sound feature extraction and classification. The proposed SCTN-based sound classification approach demonstrates a classification accuracy of 98.73% using the Real-World Computing Partnership (RWCP) database.

Sign in / Sign up

Export Citation Format

Share Document