Classification performance using gated recurrent unit recurrent neural network on energy disaggregation

2016 ◽  
Author(s):  
Thi-Thu-Huong Le ◽  
Jihyun Kim ◽  
Howon Kim
Keyword(s):  
Neural Network ◽  
Recurrent Neural Network ◽  
Classification Performance ◽  
Energy Disaggregation ◽  
Gated Recurrent Unit

scholarly journals Complaint Classification using Word2Vec Model

2018 ◽  
Vol 7 (4.5) ◽  
pp. 402 ◽  
Author(s):  
Mohit Rathore ◽  
Dikshant Gupta ◽  
Dinabandhu Bhandari
Keyword(s):  
Neural Network ◽  
Recurrent Neural Network ◽  
Multi Layer Perceptron ◽  
Gated Recurrent Unit

Attempt has been made to develop a versatile, universal complaint grievance segregator by classifying orally acknowledged grievancesinto one of the predefined categories. The oral complaints are first converted to text and then each word is represented by a vector usingword2vec. Each grievance is represented by a single vector using Gated Recurrent Unit (GRU) that implements the hidden state of Recurrent Neural Network (RNN) model. The popular Multi-Layer Perceptron (MLP) has been used as the classifier to identify the categories. 

scholarly journals Multi-Quantile Recurrent Neural Network for Feeder-Level Probabilistic Energy Disaggregation Considering Roof-Top Solar Energy

2021 ◽  
Author(s):  
Xiao-Yu Zhang ◽  
Chris Watkins ◽  
Stefanie Kuenzel
Keyword(s):  
Neural Network ◽  
Solar Energy ◽  
Recurrent Neural Network ◽  
Regression Tree ◽  
Prediction Intervals ◽  
Gradient Boosting ◽  
Training Time ◽  
Light Gradient ◽  
Energy Disaggregation ◽  
Net Load

The purpose of feeder-level energy disaggregation is to decouple the net load measured at the feeder-head into various components. This technology is vital for power system utilities since increased visibility of controllable loads enables the realization of demand-side management strategies. However, energy disaggregation at the feeder level is difficult to realize since the high-penetration of embedded generation masks the actual demand and different loads are highly aggregated. In this paper, the solar energy at the grid supply point is separated from the net load at first via either an unsupervised upscaling method or the supervised gradient boosting regression tree (GBRT) method. To deal with the uncertainty of the load components, the probabilistic energy disaggregation models based on multi-quantile recurrent neural network model (multi-quantile long short-term memory (MQ-LSTM) model and multi-quantile gated recurrent unit (MQ-GRU) model) are proposed to disaggregate the demand load into controlled loads (TCLs), non-thermostatically controlled loads (non-TCLs), and non-controllable loads. A variety of relevant information, including feeder measurements, meteorological measurements, calendar information, is adopted as the input features of the model. Instead of providing point prediction, the probabilistic model estimates the conditional quantiles and provides prediction intervals. A comprehensive case study is implemented to compare the proposed model with other state-of-the-art models (multi-quantile convolutional neural network (MQ-CNN), quantile gradient boosting regression tree (Q-GBRT), Quantile Light gradient boosting machine (Q-LGB)) from training time, reliability, sharpness, and overall performance aspects. The result shows that the MQ-LSTM can estimate reliable and sharp Prediction Intervals for target load components. And it shows the best performance among all algorithms with the shortest training time. Finally, a transfer learning algorithm is proposed to overcome the difficulty to obtain enough training data, and the model is pre-trained via synthetic data generated from a public database and then tested on the local dataset. The result confirms that the proposed energy disaggregation model is transferable and can be applied to other feeders easily. <br>

scholarly journals De Novo Molecular Design of Caspase-6 Inhibitors by a GRU-Based Recurrent Neural Network Combined with a Transfer Learning Approach

2021 ◽  
Vol 14 (12) ◽  
pp. 1249
Author(s):  
Shuheng Huang ◽  
Hu Mei ◽  
Laichun Lu ◽  
Minyao Qiu ◽  
Xiaoqi Liang ◽  
...  
Keyword(s):  
Neural Network ◽  
Transfer Learning ◽  
Recurrent Neural Network ◽  
De Novo ◽  
Molecular Design ◽  
Generative Model ◽  
The Novel ◽  
De Novo Molecular Design ◽  
Caspase 6 ◽  
Gated Recurrent Unit

Due to their potential in the treatment of neurodegenerative diseases, caspase-6 inhibitors have attracted widespread attention. However, the existing caspase-6 inhibitors showed more or less inevitable deficiencies that restrict their clinical development and applications. Therefore, there is an urgent need to develop novel caspase-6 candidate inhibitors. Herein, a gated recurrent unit (GRU)-based recurrent neural network (RNN) combined with transfer learning was used to build a molecular generative model of caspase-6 inhibitors. The results showed that the GRU-based RNN model can accurately learn the SMILES grammars of about 2.4 million chemical molecules including ionic and isomeric compounds and can generate potential caspase-6 inhibitors after transfer learning of the known 433 caspase-6 inhibitors. Based on the novel molecules derived from the molecular generative model, an optimal logistic regression model and Surflex-dock were employed for predicting and ranking the inhibitory activities. According to the prediction results, three potential caspase-6 inhibitors with different scaffolds were selected as the promising candidates for further research. In general, this paper provides an efficient combinational strategy for de novo molecular design of caspase-6 inhibitors.

scholarly journals A Mixed Deep Recurrent Neural Network for MEMS Gyroscope Noise Suppressing

Electronics ◽  
2019 ◽  
Vol 8 (2) ◽  
pp. 181 ◽  
Author(s):  
Changhui Jiang ◽  
Yuwei Chen ◽  
Shuai Chen ◽  
Yuming Bo ◽  
Wei Li ◽  
...  
Keyword(s):  
Neural Network ◽  
Recurrent Neural Network ◽  
Inertial Measurement Unit ◽  
Short Term Memory ◽  
Inertial Navigation ◽  
Measurement Unit ◽  
Short Term ◽  
Inertial Measurement ◽  
Long Short Term Memory ◽  
Gated Recurrent Unit

Currently, positioning, navigation, and timing information is becoming more and more vital for both civil and military applications. Integration of the global navigation satellite system and /inertial navigation system is the most popular solution for various carriers or vehicle positioning. As is well-known, the global navigation satellite system positioning accuracy will degrade in signal challenging environments. Under this condition, the integration system will fade to a standalone inertial navigation system outputting navigation solutions. However, without outer aiding, positioning errors of the inertial navigation system diverge quickly due to the noise contained in the raw data of the inertial measurement unit. In particular, the micromechanics system inertial measurement unit experiences more complex errors due to the manufacturing technology. To improve the navigation accuracy of inertial navigation systems, one effective approach is to model the raw signal noise and suppress it. Commonly, an inertial measurement unit is composed of three gyroscopes and three accelerometers, among them, the gyroscopes play an important role in the accuracy of the inertial navigation system’s navigation solutions. Motivated by this problem, in this paper, an advanced deep recurrent neural network was employed and evaluated in noise modeling of a micromechanics system gyroscope. Specifically, a deep long short term memory recurrent neural network and a deep gated recurrent unit–recurrent neural network were combined together to construct a two-layer recurrent neural network for noise modeling. In this method, the gyroscope data were treated as a time series, and a real dataset from a micromechanics system inertial measurement unit was employed in the experiments. The results showed that, compared to the two-layer long short term memory, the three-axis attitude errors of the mixed long short term memory–gated recurrent unit decreased by 7.8%, 20.0%, and 5.1%. When compared with the two-layer gated recurrent unit, the proposed method showed 15.9%, 14.3%, and 10.5% improvement. These results supported a positive conclusion on the performance of designed method, specifically, the mixed deep recurrent neural networks outperformed than the two-layer gated recurrent unit and the two-layer long short term memory recurrent neural networks.

scholarly journals Exploring Three Recurrent Neural Network Architectures for Geomagnetic Predictions

2021 ◽  
Vol 8 ◽  
Author(s):  
Peter Wintoft ◽  
Magnus Wik
Keyword(s):  
Neural Network ◽  
Solar Wind ◽  
Recurrent Neural Network ◽  
Short Term Memory ◽  
Confidence Limits ◽  
Short Term ◽  
Term Memory ◽  
Dst Index ◽  
Long Short Term Memory ◽  
Gated Recurrent Unit

Three different recurrent neural network (RNN) architectures are studied for the prediction of geomagnetic activity. The RNNs studied are the Elman, gated recurrent unit (GRU), and long short-term memory (LSTM). The RNNs take solar wind data as inputs to predict the Dst index. The Dst index summarizes complex geomagnetic processes into a single time series. The models are trained and tested using five-fold cross-validation based on the hourly resolution OMNI dataset using data from the years 1995–2015. The inputs are solar wind plasma (particle density and speed), vector magnetic fields, time of year, and time of day. The RNNs are regularized using early stopping and dropout. We find that both the gated recurrent unit and long short-term memory models perform better than the Elman model; however, we see no significant difference in performance between GRU and LSTM. RNNs with dropout require more weights to reach the same validation error as networks without dropout. However, the gap between training error and validation error becomes smaller when dropout is applied, reducing over-fitting and improving generalization. Another advantage in using dropout is that it can be applied during prediction to provide confidence limits on the predictions. The confidence limits increase with increasing Dst magnitude: a consequence of the less populated input-target space for events with large Dst values, thereby increasing the uncertainty in the estimates. The best RNNs have test set RMSE of 8.8 nT, bias close to zero, and linear correlation of 0.90.

scholarly journals Multi-Quantile Recurrent Neural Network for Feeder-Level Probabilistic Energy Disaggregation Considering Roof-Top Solar Energy

2021 ◽  
Author(s):  
Xiao-Yu Zhang ◽  
Chris Watkins ◽  
Stefanie Kuenzel
Keyword(s):  
Neural Network ◽  
Solar Energy ◽  
Recurrent Neural Network ◽  
Regression Tree ◽  
Prediction Intervals ◽  
Gradient Boosting ◽  
Training Time ◽  
Light Gradient ◽  
Energy Disaggregation ◽  
Net Load

The purpose of feeder-level energy disaggregation is to decouple the net load measured at the feeder-head into various components. This technology is vital for power system utilities since increased visibility of controllable loads enables the realization of demand-side management strategies. However, energy disaggregation at the feeder level is difficult to realize since the high-penetration of embedded generation masks the actual demand and different loads are highly aggregated. In this paper, the solar energy at the grid supply point is separated from the net load at first via either an unsupervised upscaling method or the supervised gradient boosting regression tree (GBRT) method. To deal with the uncertainty of the load components, the probabilistic energy disaggregation models based on multi-quantile recurrent neural network model (multi-quantile long short-term memory (MQ-LSTM) model and multi-quantile gated recurrent unit (MQ-GRU) model) are proposed to disaggregate the demand load into controlled loads (TCLs), non-thermostatically controlled loads (non-TCLs), and non-controllable loads. A variety of relevant information, including feeder measurements, meteorological measurements, calendar information, is adopted as the input features of the model. Instead of providing point prediction, the probabilistic model estimates the conditional quantiles and provides prediction intervals. A comprehensive case study is implemented to compare the proposed model with other state-of-the-art models (multi-quantile convolutional neural network (MQ-CNN), quantile gradient boosting regression tree (Q-GBRT), Quantile Light gradient boosting machine (Q-LGB)) from training time, reliability, sharpness, and overall performance aspects. The result shows that the MQ-LSTM can estimate reliable and sharp Prediction Intervals for target load components. And it shows the best performance among all algorithms with the shortest training time. Finally, a transfer learning algorithm is proposed to overcome the difficulty to obtain enough training data, and the model is pre-trained via synthetic data generated from a public database and then tested on the local dataset. The result confirms that the proposed energy disaggregation model is transferable and can be applied to other feeders easily. <br>

scholarly journals Predicting machine failure using recurrent neural network-gated recurrent unit (RNN-GRU) through time series data

2021 ◽  
Vol 10 (2) ◽  
pp. 870-878
Author(s):  
Zainuddin Z. ◽  
P. Akhir E. A. ◽  
Hasan M. H.
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Recurrent Neural Network ◽  
Time Series Data ◽  
Short Term Memory ◽  
Learning Algorithm ◽  
The State ◽  
Series Data ◽  
Machine Failure ◽  
Gated Recurrent Unit

Time series data often involves big size environment that lead to high dimensionality problem. Many industries are generating time series data that continuously update each second. The arising of machine learning may help in managing the data. It can forecast future instance while handling large data issues. Forecasting is related to predicting task of an upcoming event to avoid any circumstances happen in current environment. It helps those sectors such as production to foresee the state of machine in line with saving the cost from sudden breakdown as unplanned machine failure can disrupt the operation and loss up to millions. Thus, this paper offers a deep learning algorithm named recurrent neural network-gated recurrent unit (RNN-GRU) to forecast the state of machines producing the time series data in an oil and gas sector. RNN-GRU is an affiliation of recurrent neural network (RNN) that can control consecutive data due to the existence of update and reset gates. The gates decided on the necessary information to be kept in the memory. RNN-GRU is a simpler structure of long short-term memory (RNN-LSTM) with 87% of accuracy on prediction.

scholarly journals Prediksi Permintaan Kargo pada Cargo Service Center Tangerang City Menggunakan Metode Gated Recurrent Unit

Repositor ◽  
2020 ◽  
Vol 2 (8) ◽  
Author(s):  
Rifky Ahmad Saputra
Keyword(s):  
Neural Network ◽  
Root Mean Square Error ◽  
Mean Square Error ◽  
Root Mean Square ◽  
Recurrent Neural Network ◽  
Mean Square ◽  
Service Center ◽  
Gated Recurrent Unit

Pada saat ini persaingan bisnis dalam bidang layanan kargo khususnya di Indonesia semakin ketat. Terdapat beberapa perusahaan layanan kargo di Indonesia, salah satunya yaitu Cargo Service Center Tangerang City. Untuk mengantisipasi persaingan bisnis tersebut, Cargo Service Center Tangerang City harus dapat menentukan strategi manajemen usaha, baik dalam jangka menengah maupun jangka panjang. Salah satunya hal yang dapat dilakukan yaitu prediksi permintaan kargo. Pada Cargo Service Center Tangerang City terdapat data transaksi kargo mulai dari Januari 2016 hingga Septermber 2019, oleh karena itu dilakukanlah penelitian yaitu mengimplementasikan metode Gated Recurrent Unit untuk melakukan prediksi permintaan kargo. metode Gated Recurrent Unit merupakan model pengembangan dari Recurrent Neural Network yang biasa digunakan untuk melakukan prediksi pada data sekuens. Pengujian model prediksi dalam penelitian ini dilakukan dengan mencari nilai Root Mean Square Error terkecil dari beberapa percobaan. Hasil dari penelitian ini menunjukkan bahwa model cukup baik dalam melakukan prediksi permintaan kargo, namun terdapat beberapa hasil prediksi metode Gated Recurrent Unit yang masih belum maksimal mendekati nilai aktual misalnya pada nilai aktual yang berada di titik puncak.

Prediction of Vaccination Side-Effects using Deep Learning

2021 ◽  
Author(s):  
Farhan Uz Zaman ◽  
Tanvinur Rahman Siam ◽  
Zulker Nayen
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Side Effects ◽  
Recurrent Neural Network ◽  
Side Effect ◽  
Viral Diseases ◽  
Serious Illness ◽  
Gated Recurrent Unit

Deep learning has been very successful in the field of research which includes predictions. In this paper, one such prediction is discussed which can help to implement safe vaccination. Vaccination is very important in order to fight viral diseases such as covid-19. However, people at times have to go through unwanted side effects of the vaccinations which might often cause serious illness. Therefore, modern techniques are to be utilised for safe implementations of vaccines. In this research, Gated Recurrent Unit, GRU, which is a form of Recurrent Neural Network is used to predict whether a particular vaccine will have any side effect on a particular patient. The extracted predictions might be used before deciding whether a vaccine should be injected to a particular person or not.

Sign in / Sign up

Export Citation Format

Share Document