scholarly journals Emulating Cued Recall of Abstract Concepts via Regulated Activation Networks

2021 ◽  
Vol 11 (5) ◽  
pp. 2134
Author(s):  
Rahul Sharma ◽  
Bernardete Ribeiro ◽  
Alexandre Miguel Pinto ◽  
Amílcar Cardoso
Keyword(s):  
Computational Simulation ◽  
Back Propagation ◽  
Vital Role ◽  
Cued Recall ◽  
Abstract Concepts ◽  
Back Propagation Algorithm ◽  
Contextual Processing ◽  
Cognitive States ◽  
Recall Procedure ◽  
Recall Operation

Abstract concepts play a vital role in decision-making or recall operations because the associations among them are essential for contextual processing. Abstract concepts are complex and difficult to represent (conceptually, formally, or computationally), leading to difficulties in their comprehension and recall. This contribution reports the computational simulation of the cued recall of abstract concepts by exploiting their learned associations. The cued recall operation is realized via a novel geometric back-propagation algorithm that emulates the recall of abstract concepts learned through regulated activation network (RAN) modeling. During recall operation, another algorithm uniquely regulates the activation of concepts (nodes) by injecting excitatory, neutral, and inhibitory signals to other concepts of the same level. A Toy-data problem is considered to illustrate the RAN modeling and recall procedure. The results display how regulation enables contextual awareness among abstract nodes during the recall process. The MNIST dataset is used to show how recall operations retrieve intuitive and non-intuitive blends of abstract nodes. We show that every recall process converges to an optimal image. With more cues, better images are recalled, and every intermediate image obtained during the recall iterations corresponds to the varying cognitive states of the recognition procedure.

Construction of a deep sparse filtering network for rotating machinery fault diagnosis

2021 ◽  
pp. 095440702110148
Author(s):  
Chun Cheng ◽  
Wei Zou ◽  
Weiping Wang ◽  
Michael Pecht
Keyword(s):  
Fault Diagnosis ◽  
Back Propagation ◽  
Feature Learning ◽  
Back Propagation Neural Network ◽  
Rotating Machinery ◽  
Fine Tuning ◽  
Local Optimum ◽  
Back Propagation Algorithm ◽  
Intelligent Fault Diagnosis ◽  
Sparse Filtering

Deep neural networks (DNNs) have shown potential in intelligent fault diagnosis of rotating machinery. However, traditional DNNs such as the back-propagation neural network are highly sensitive to the initial weights and easily fall into the local optimum, which restricts the feature learning capability and diagnostic performance. To overcome the above problems, a deep sparse filtering network (DSFN) constructed by stacked sparse filtering is developed in this paper and applied to fault diagnosis. The developed DSFN is pre-trained by sparse filtering in an unsupervised way. The back-propagation algorithm is employed to optimize the DSFN after pre-training. Then, the DSFN-based intelligent fault diagnosis method is validated using two experiments. The results show that pre-training with sparse filtering and fine-tuning can help the DSFN search for the optimal network parameters, and the DSFN can learn discriminative features adaptively from rotating machinery datasets. Compared with classical methods, the developed diagnostic method can diagnose rotating machinery faults with higher accuracy using fewer training samples.

scholarly journals Two-Stage Water Jet Landing Point Prediction Model for Intelligent Water Shooting Robot

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2704
Author(s):  
Yunhan Lin ◽  
Wenlong Ji ◽  
Haowei He ◽  
Yaojie Chen
Keyword(s):  
Pitch Angle ◽  
Back Propagation ◽  
Water Jet ◽  
The State ◽  
Model Parameters ◽  
Propagation Time ◽  
Back Propagation Algorithm ◽  
Angle Error ◽  
Landing Point ◽  
Propagation Algorithm

In this paper, an intelligent water shooting robot system for situations of carrier shake and target movement is designed, which uses a 2 DOF (degree of freedom) robot as an actuator, a photoelectric camera to detect and track the desired target, and a gyroscope to keep the robot’s body stable when it is mounted on the motion carriers. Particularly, for the accurate shooting of the designed system, an online tuning model of the water jet landing point based on the back-propagation algorithm was proposed. The model has two stages. In the first stage, the polyfit function of Matlab is used to fit a model that satisfies the law of jet motion in ideal conditions without interference. In the second stage, the model uses the back-propagation algorithm to update the parameters online according to the visual feedback of the landing point position. The model established by this method can dynamically eliminate the interference of external factors and realize precise on-target shooting. The simulation results show that the model can dynamically adjust the parameters according to the state relationship between the landing point and the desired target, which keeps the predicted pitch angle error within 0.1°. In the test on the actual platform, when the landing point is 0.5 m away from the position of the desired target, the model only needs 0.3 s to adjust the water jet to hit the target. Compared to the state-of-the-art method, GA-BP (genetic algorithm-back-propagation), the proposed method’s predicted pitch angle error is within 0.1 degree with 1/4 model parameters, while costing 1/7 forward propagation time and 1/200 back-propagation calculation time.

scholarly journals Deep neural networks using a single neuron: folded-in-time architecture using feedback-modulated delay loops

2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Florian Stelzer ◽  
André Röhm ◽  
Raul Vicente ◽  
Ingo Fischer ◽  
Serhiy Yanchuk
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Neural Network ◽  
Single Neuron ◽  
Deep Neural Networks ◽  
Back Propagation ◽  
Local Network ◽  
Multiple Time ◽  
Learning Tools ◽  
Back Propagation Algorithm

AbstractDeep neural networks are among the most widely applied machine learning tools showing outstanding performance in a broad range of tasks. We present a method for folding a deep neural network of arbitrary size into a single neuron with multiple time-delayed feedback loops. This single-neuron deep neural network comprises only a single nonlinearity and appropriately adjusted modulations of the feedback signals. The network states emerge in time as a temporal unfolding of the neuron’s dynamics. By adjusting the feedback-modulation within the loops, we adapt the network’s connection weights. These connection weights are determined via a back-propagation algorithm, where both the delay-induced and local network connections must be taken into account. Our approach can fully represent standard Deep Neural Networks (DNN), encompasses sparse DNNs, and extends the DNN concept toward dynamical systems implementations. The new method, which we call Folded-in-time DNN (Fit-DNN), exhibits promising performance in a set of benchmark tasks.

scholarly journals Using Artificial Neural Networks in Predicting the Level of Stress among Military Conscripts

Mathematics ◽  
2021 ◽  
Vol 9 (6) ◽  
pp. 626
Author(s):  
Svajone Bekesiene ◽  
Rasa Smaliukiene ◽  
Ramute Vaicaitiene
Keyword(s):  
Neural Network ◽  
Transfer Functions ◽  
Back Propagation ◽  
Armed Forces ◽  
Activation Function ◽  
Optimal Number ◽  
Ann Model ◽  
Back Propagation Algorithm ◽  
Classification Rate ◽  
Artificial Neural

The present study aims to elucidate the main variables that increase the level of stress at the beginning of military conscription service using an artificial neural network (ANN)-based prediction model. Random sample data were obtained from one battalion of the Lithuanian Armed Forces, and a survey was conducted to generate data for the training and testing of the ANN models. Using nonlinearity in stress research, numerous ANN structures were constructed and verified to limit the optimal number of neurons, hidden layers, and transfer functions. The highest accuracy was obtained by the multilayer perceptron neural network (MLPNN) with a 6-2-2 partition. A standardized rescaling method was used for covariates. For the activation function, the hyperbolic tangent was used with 20 units in one hidden layer as well as the back-propagation algorithm. The best ANN model was determined as the model that showed the smallest cross-entropy error, the correct classification rate, and the area under the ROC curve. These findings show, with high precision, that cohesion in a team and adaptation to military routines are two critical elements that have the greatest impact on the stress level of conscripts.

COMPUTING AN ADAPTIVE MESH IN FLUID PROBLEMS USING NEURAL NETWORK AND GENETIC ALGORITHM WITH ADAPTIVE RELAXATION

2008 ◽  
Vol 17 (06) ◽  
pp. 1089-1108 ◽  
Author(s):  
NAMEER N. EL. EMAM ◽  
RASHEED ABDUL SHAHEED
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Numerical Experiments ◽  
Back Propagation ◽  
Adaptive Mesh ◽  
Learning System ◽  
Back Propagation Algorithm ◽  
Adaptive Smoothing ◽  
Different Types ◽  
Optimal Values

A method based on neural network with Back-Propagation Algorithm (BPA) and Adaptive Smoothing Errors (ASE), and a Genetic Algorithm (GA) employing a new concept named Adaptive Relaxation (GAAR) is presented in this paper to construct learning system that can find an Adaptive Mesh points (AM) in fluid problems. AM based on reallocation scheme is implemented on different types of two steps channels by using a three layer neural network with GA. Results of numerical experiments using Finite Element Method (FEM) are discussed. Such discussion is intended to validate the process and to demonstrate the performance of the proposed learning system on three types of two steps channels. It appears that training is fast enough and accurate due to the optimal values of weights by using a few numbers of patterns. Results confirm that the presented neural network with the proposed GA consistently finds better solutions than the conventional neural network.

Study on the Generalized Holo-Factors Mathematical Model of Dimension-Error and Shape-Error for Sheet Metal in Stamping Based on the Back Propagation (BP) Neural Network

2016 ◽  
Vol 138 (6) ◽  
Author(s):  
Lizhi Gu ◽  
Tianqing Zheng
Keyword(s):  
Neural Network ◽  
Mathematical Model ◽  
Sheet Metal ◽  
Bp Neural Network ◽  
Back Propagation ◽  
Shape Error ◽  
Back Propagation Algorithm ◽  
Minor Strain ◽  
Major Strain ◽  
Forming Precision

Precision improvement in sheet metal stamping has been the concern that the stamping researchers have engaged in. In order to improve the forming precision of sheet metal in stamping, this paper devoted to establish the generalized holo-factors mathematical model of dimension-error and shape-error for sheet metal in stamping based on BP neural network. Factors influencing the forming precision of stamping sheet metal were divided, altogether ten factors, and the generalized holo-factors mathematical model of dimension-error and shape-error for sheet metal in stamping was established using the back-propagation algorithm of error based on BP neural network. The undetermined coefficients of the model previously established were soluble according to the simulation data of sheet punching combined with the specific shape based on the BP neural network. With this mathematical model, the forecast data compared with the validate data could be obtained, so as to verify the fine practicability that the previously established mathematical model had, and then, it was shown that the generalized holo-factors mathematical model of size error and shape-error had fine practicality and versatility. Based on the generalized holo-factors mathematical model of error exemplified by the cylindrical parts, a group of process parameters could be selected, in which forming thickness was between 0.713 mm and 1.335 mm, major strain was between 0.085 and 0.519, and minor strain was between −0.596 and 0.319 from the generalized holo-factors mathematical model prediction, at the same time, the forming thickness, the major strain, and the minor strain were in good condition.

Research of the 3-DOF Helicopter System Based on Adaptive Inverse Control

2013 ◽  
Vol 389 ◽  
pp. 623-631 ◽  
Author(s):  
Xiu Yan Wang ◽  
Ying Wang ◽  
Zong Shuai Li
Keyword(s):  
Neural Network ◽  
Flight Control ◽  
Fuzzy Inference ◽  
Reference Model ◽  
Back Propagation ◽  
Back Propagation Algorithm ◽  
Actual System ◽  
Adaptive Inverse Control ◽  
Inverse Control ◽  
Network Connection

For the flight control problem occurred in 3-DOF Helicopter System, reference adaptive inverse control scheme based on Fuzzy Neural Network model is designed. Firstly, fuzzy inference process of identifier and controller is achieved by using the network structure. Meanwhile, the neural network connection weights are used to express parameters of fuzzy inference. Then, back-propagation algorithm is adopted to amend the network connection weights in order to automatically identify the fuzzy model and adjust its membership functions and parameters, so that the actual system output of adaptive inverse controller control which is adjusted can track the reference model output. Finally, the simulation result of 3-DOF Helicopter System based on the scheme shows that the method is effective and feasible.

AN ARTIFICIAL INTELLIGENT APPROACH TO TRAFFIC ACCIDENT ESTIMATION: MODEL DEVELOPMENT AND APPLICATION

Transport ◽  
2009 ◽  
Vol 24 (2) ◽  
pp. 135-142 ◽  
Author(s):  
Ali Payıdar Akgüngör ◽  
Erdem Doğan
Keyword(s):  
Genetic Algorithm ◽  
Model Development ◽  
Back Propagation ◽  
Linear Functions ◽  
Model Parameters ◽  
Ann Model ◽  
Back Propagation Algorithm ◽  
Estimation Model ◽  
Average Growth ◽  
Feed Forward Back Propagation

This study proposes an Artificial Neural Network (ANN) model and a Genetic Algorithm (GA) model to estimate the number of accidents (A), fatalities (F) and injuries (I) in Ankara, Turkey, utilizing the data obtained between 1986 and 2005. For model development, the number of vehicles (N), fatalities, injuries, accidents and population (P) were selected as model parameters. In the ANN model, the sigmoid and linear functions were used as activation functions with the feed forward‐back propagation algorithm. In the GA approach, two forms of genetic algorithm models including a linear and an exponential form of mathematical expressions were developed. The results of the GA model showed that the exponential model form was suitable to estimate the number of accidents and fatalities while the linear form was the most appropriate for predicting the number of injuries. The best fit model with the lowest mean absolute errors (MAE) between the observed and estimated values is selected for future estimations. The comparison of the model results indicated that the performance of the ANN model was better than that of the GA model. To investigate the performance of the ANN model for future estimations, a fifteen year period from 2006 to 2020 with two possible scenarios was employed. In the first scenario, the annual average growth rates of population and the number of vehicles are assumed to be 2.0 % and 7.5%, respectively. In the second scenario, the average number of vehicles per capita is assumed to reach 0.60, which represents approximately two and a half‐fold increase in fifteen years. The results obtained from both scenarios reveal the suitability of the current methods for road safety applications.

Test on Flood Prediction-Model Using Artificial Neural Network for ShiiLiAn Hydrologic Station on MinChiang,China

2010 ◽  
Vol 39 ◽  
pp. 555-561 ◽  
Author(s):  
Qing Hua Luan ◽  
Yao Cheng ◽  
Zha Xin Ima
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Flood Control ◽  
Back Propagation ◽  
Forecast Model ◽  
Flood Forecast ◽  
Back Propagation Algorithm ◽  
Nonlinear Method ◽  
Flood Prediction ◽  
Artificial Neural

The establishing of a precise simulation model for runoff prediction in river with several tributaries is the difficulty of flood forecast, which is also one of the difficulties in hydrologic research. Due to the theory of Artificial Neural Network, using Back Propagation algorithm, the flood forecast model for ShiLiAn hydrologic station in Minjiang River is constructed and validated in this study. Through test, the result shows that the forecast accuracy is satisfied for all check standards of flood forecast and then proves the feasibility of using nonlinear method for flood forecast. This study provides a new method and reference for flood control and water resources management in the local region.

Sign in / Sign up

Export Citation Format

Share Document