Multiscale BiLinear Recurrent Neural Network with an Adaptive Learning Algorithm

2006 ◽  
pp. 497-506 ◽  
Author(s):  
Byung-Jae Min ◽  
Chung Nguyen Tran ◽  
Dong-Chul Park
Keyword(s):  
Neural Network ◽  
Recurrent Neural Network ◽  
Adaptive Learning ◽  
Learning Algorithm

scholarly journals Developing an Individual Glucose Prediction Model Using Recurrent Neural Network

Sensors ◽  
2020 ◽  
Vol 20 (22) ◽  
pp. 6460
Author(s):  
Dae-Yeon Kim ◽  
Dong-Sik Choi ◽  
Jaeyun Kim ◽  
Sung Wan Chun ◽  
Hyo-Wook Gil ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Prediction Model ◽  
Glucose Level ◽  
Recurrent Neural Network ◽  
Learning Algorithm ◽  
Percentage Error ◽  
Glucose Prediction

In this study, we propose a personalized glucose prediction model using deep learning for hospitalized patients who experience Type-2 diabetes. We aim for our model to assist the medical personnel who check the blood glucose and control the amount of insulin doses. Herein, we employed a deep learning algorithm, especially a recurrent neural network (RNN), that consists of a sequence processing layer and a classification layer for the glucose prediction. We tested a simple RNN, gated recurrent unit (GRU), and long-short term memory (LSTM) and varied the architectures to determine the one with the best performance. For that, we collected data for a week using a continuous glucose monitoring device. Type-2 inpatients are usually experiencing bad health conditions and have a high variability of glucose level. However, there are few studies on the Type-2 glucose prediction model while many studies performed on Type-1 glucose prediction. This work has a contribution in that the proposed model exhibits a comparative performance to previous works on Type-1 patients. For 20 in-hospital patients, we achieved an average root mean squared error (RMSE) of 21.5 and an Mean absolute percentage error (MAPE) of 11.1%. The GRU with a single RNN layer and two dense layers was found to be sufficient to predict the glucose level. Moreover, to build a personalized model, at most, 50% of data are required for training.

Adaptive Learning Algorithm for Cerebellar Model Articulation Controller: Neural Network Based Hybrid-Type Controller—Part I

2000 ◽  
Author(s):  
Magdy Mohamed Abdelhameed ◽  
Sabri Cetinkunt
Keyword(s):  
Neural Network ◽  
Control System ◽  
Adaptive Learning ◽  
Learning Algorithm ◽  
Cerebellar Model Articulation Controller ◽  
Neural Network Learning ◽  
Network Learning ◽  
Hybrid Type ◽  
Cmac Neural Network ◽  
Learning Technique

Abstract Cerebellar model articulation controller (CMAC) is a useful neural network learning technique. It was developed two decades ago but yet lacks an adequate learning algorithm, especially when it is used in a hybrid- type controller. This work is intended to introduce a simulation study for examining the performance of a hybrid-type control system based on the conventional learning algorithm of CMAC neural network. This study showed that the control system is unstable. Then a new adaptive learning algorithm of a CMAC based hybrid- type controller is proposed. The main features of the proposed learning algorithm, as well as the effects of the newly introduced parameters of this algorithm have been studied extensively via simulation case studies. The simulation results showed that the proposed learning algorithm is a robust in stabilizing the control system. Also, this proposed learning algorithm preserved all the known advantages of the CMAC neural network. Part II of this work is dedicated to validate the effectiveness of the proposed CMAC learning algorithm experimentally.

Deep Learning Based Adaptive Recurrent Neural Network for Detection of Myocardial Infarction

2021 ◽  
Vol 11 (12) ◽  
pp. 3044-3053
Author(s):  
Rakesh Kumar Mahendran ◽  
V. Prabhu ◽  
V. Parthasarathy ◽  
A. Mary Judith
Keyword(s):  
Neural Network ◽  
Myocardial Infarction ◽  
Deep Learning ◽  
Recurrent Neural Network ◽  
Classification Accuracy ◽  
Learning Algorithm ◽  
Training Data ◽  
Discrete Wavelet ◽  
Ecg Signal ◽  
Detection Techniques

Myocardial infarction (MI) may precipitate severe health damage and lead to irreversible death of the heart muscle, the result of prolonged lack of oxygen if it is not treated in a timely manner. Lack of accurate and early detection techniques for this heart disease has reduced the efficiency of MI diagnosis. In this paper, the design, and implementation of an efficient deep learning algorithm called Adaptive Recurrent neural network (ARNN) is proposed for the MI detection. The main objective of the proposed work is the accurate identification of MI disease using ECG signals. ECG signal denoising has been performed using the Multi-Notch filter, which removes the specified noise frequency range. Discrete wavelet transform (DWT) is utilized for performing the feature extraction that decomposes the ECG signal into varied scales with waveletfiltering bank. After the extraction of specific QRS features, classification of the defected and normal ECG arrhythmic beat has been performed using the deep learning-based ARNN classifier. The MIT-BIH database has been used for testing and training data. The performance of the proposed algorithm is evaluated based on classification accuracy. Results that are attained include the classification accuracy of about 99.21%, 99% of sensitivity and 99.4% of specificity with PPV and NPV of about 99.4 and 99.01 values indicate the enhanced performance of our proposed work compared with the conventional LSTM-CAE and LSTM-CNN techniques.

Diagonal recurrent neural network observer-based adaptive control for unknown nonlinear systems

2020 ◽  
Vol 42 (15) ◽  
pp. 2833-2856
Author(s):  
Ahmed Elkenawy ◽  
Ahmad M El-Nagar ◽  
Mohammad El-Bardini ◽  
Nabila M El-Rabaie
Keyword(s):  
Neural Network ◽  
Optimal Control ◽  
Adaptive Control ◽  
Nonlinear Systems ◽  
Recurrent Neural Network ◽  
Learning Algorithm ◽  
Lyapunov Stability Theory ◽  
Adaptive Dynamic Programming ◽  
External Disturbances ◽  
System States

This paper proposes an observer-based adaptive control for unknown nonlinear systems using an adaptive dynamic programming (ADP) algorithm. First, a diagonal recurrent neural network (DRNN) observer is proposed to estimate the unknown dynamics of the nonlinear system states. The proposed neural network offers a simpler structure with deeper memory and guarantees the faster convergence. Second, a neural controller is constructed via ADP method using the observed states to get the optimal control. The optimal control law is determined based on the new structure of the critic network, which is performed using the DRNN. The learning algorithm for the proposed DRNN observer-based adaptive control is developed based on the Lyapunov stability theory. Simulation results and hardware-in-the-loop results indicate the robustness of the proposed ADP to respond the system uncertainties and external disturbances compared with other existing schemes.

An adaptive learning algorithm for a wavelet neural network

2005 ◽  
Vol 22 (5) ◽  
pp. 235-240 ◽  
Author(s):  
Yevgeniy Bodyanskiy ◽  
Nataliya Lamonova ◽  
Iryna Pliss ◽  
Olena Vynokurova
Keyword(s):  
Neural Network ◽  
Adaptive Learning ◽  
Learning Algorithm ◽  
Wavelet Neural Network

Relating the Slope of the Activation Function and the Learning Rate Within a Recurrent Neural Network

1999 ◽  
Vol 11 (5) ◽  
pp. 1069-1077 ◽  
Author(s):  
Danilo P. Mandic ◽  
Jonathon A. Chambers
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Recurrent Neural Network ◽  
Recurrent Neural Networks ◽  
Degrees Of Freedom ◽  
Learning Algorithm ◽  
Activation Function ◽  
Learning Rate ◽  
Optimization Task ◽  
Nonlinear Activation Function

A relationship between the learning rate η in the learning algorithm, and the slope β in the nonlinear activation function, for a class of recurrent neural networks (RNNs) trained by the real-time recurrent learning algorithm is provided. It is shown that an arbitrary RNN can be obtained via the referent RNN, with some deterministic rules imposed on its weights and the learning rate. Such relationships reduce the number of degrees of freedom when solving the nonlinear optimization task of finding the optimal RNN parameters.

Sign in / Sign up

Export Citation Format

Share Document