scholarly journals An Improved Attention-Based Integrated Deep Neural Network for PM2.5 Concentration Prediction

2021 ◽  
Vol 11 (9) ◽  
pp. 4001
Author(s):  
Pengfei Shi ◽  
Xiaolong Fang ◽  
Jianjun Ni ◽  
Jinxiu Zhu
Keyword(s):  
Neural Network ◽  
Deep Neural Network ◽  
Two Phase ◽  
Prediction Result ◽  
Air Quality Prediction ◽  
Proposed Model ◽  
Network Method ◽  
Dual Stage ◽  
Concentration Prediction ◽  
Pm2.5 Concentration

The air quality prediction is a very important and challenging task, especially PM2.5 (particles with diameter less than 2.5 μm) concentration prediction. To improve the accuracy of the PM2.5 concentration prediction, an improved integrated deep neural network method based on attention mechanism is proposed in this paper. Firstly, the influence of exogenous series of other sites on the central site is considered to determine the best relevant site. Secondly, the data of all relevant sites are input into the improved dual-stage two-phase (DSTP) model, then the PM2.5 prediction result of each site is obtained. Finally, with the PM2.5 prediction result of each site, the attention-based layer predicts the PM2.5 concentration at the central site. The experimental results show that the proposed model is superior to most of the latest models.

An Effective Deep Neural Network Method for Prediction of Battery State at Cell and Module Level

2021 ◽  
pp. 2100048
Author(s):  
T. Nguyen-Thoi ◽  
Xujian Cui ◽  
Akhil Garg ◽  
Liang Gao ◽  
Tam T. Truong
Keyword(s):  
Neural Network ◽  
Deep Neural Network ◽  
Neural Network Method ◽  
Network Method

scholarly journals A DBN-Based Deep Neural Network Model with Multitask Learning for Online Air Quality Prediction

2019 ◽  
Vol 2019 ◽  
pp. 1-9 ◽  
Author(s):  
Jiangeng Li ◽  
Xingyang Shao ◽  
Rihui Sun
Keyword(s):  
Neural Network ◽  
Air Quality ◽  
Network Model ◽  
Neural Network Model ◽  
Prediction Accuracy ◽  
Deep Neural Network ◽  
Multitask Learning ◽  
Air Pollutant ◽  
Quality Prediction ◽  
Air Quality Prediction

To avoid the adverse effects of severe air pollution on human health, we need accurate real-time air quality prediction. In this paper, for the purpose of improve prediction accuracy of air pollutant concentration, a deep neural network model with multitask learning (MTL-DBN-DNN), pretrained by a deep belief network (DBN), is proposed for forecasting of nonlinear systems and tested on the forecast of air quality time series. MTL-DBN-DNN model can solve several related prediction tasks at the same time by using shared information contained in the training data of different tasks. In the model, DBN is used to learn feature representations. Each unit in the output layer is connected to only a subset of units in the last hidden layer of DBN. Such connection effectively avoids the problem that fully connected networks need to juggle the learning of each task while being trained, so that the trained networks cannot get optimal prediction accuracy for each task. The sliding window is used to take the recent data to dynamically adjust the parameters of the MTL-DBN-DNN model. The MTL-DBN-DNN model is evaluated with a dataset from Microsoft Research. Comparison with multiple baseline models shows that the proposed MTL-DBN-DNN achieve state-of-art performance on air pollutant concentration forecasting.

scholarly journals Deep Neural Network for Predicting Diabetic Retinopathy from Risk Factors

Mathematics ◽  
2020 ◽  
Vol 8 (9) ◽  
pp. 1620 ◽  
Author(s):  
Ganjar Alfian ◽  
Muhammad Syafrudin ◽  
Norma Latif Fitriyani ◽  
Muhammad Anshari ◽  
Pavel Stasa ◽  
...  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Risk Factors ◽  
Diabetic Retinopathy ◽  
Prediction Model ◽  
Deep Neural Network ◽  
Early Stage ◽  
Individual Risk ◽  
Proposed Model ◽  
Individual Risk Factors

Extracting information from individual risk factors provides an effective way to identify diabetes risk and associated complications, such as retinopathy, at an early stage. Deep learning and machine learning algorithms are being utilized to extract information from individual risk factors to improve early-stage diagnosis. This study proposes a deep neural network (DNN) combined with recursive feature elimination (RFE) to provide early prediction of diabetic retinopathy (DR) based on individual risk factors. The proposed model uses RFE to remove irrelevant features and DNN to classify the diseases. A publicly available dataset was utilized to predict DR during initial stages, for the proposed and several current best-practice models. The proposed model achieved 82.033% prediction accuracy, which was a significantly better performance than the current models. Thus, important risk factors for retinopathy can be successfully extracted using RFE. In addition, to evaluate the proposed prediction model robustness and generalization, we compared it with other machine learning models and datasets (nephropathy and hypertension–diabetes). The proposed prediction model will help improve early-stage retinopathy diagnosis based on individual risk factors.

Challenging the Recognition of Facial Expression via Deep Learning

2014 ◽  
Vol 571-572 ◽  
pp. 717-720
Author(s):  
De Kun Hu ◽  
Yong Hong Liu ◽  
Li Zhang ◽  
Gui Duo Duan
Keyword(s):  
Neural Network ◽  
Facial Expression ◽  
Gradient Descent ◽  
Deep Neural Network ◽  
Back Propagation ◽  
Stochastic Gradient Descent ◽  
Excellent Performance ◽  
Proposed Model ◽  
Input Layer ◽  
Fully Connected

A deep Neural Network model was trained to classify the facial expression in unconstrained images, which comprises nine layers, including input layer, convolutional layer, pooling layer, fully connected layers and output layer. In order to optimize the model, rectified linear units for the nonlinear transformation, weights sharing for reducing the complexity, “mean” and “max” pooling for subsample, “dropout” for sparsity are applied in the forward processing. With large amounts of hard training faces, the model was trained via back propagation method with stochastic gradient descent. The results of shows the proposed model achieves excellent performance.

scholarly journals Polytechnic Students’ Academic Performance Prediction Based On Using Deep Neural Network

2021 ◽  
pp. 1-11
Author(s):  
S. M. Abdullah Al Shuaeb ◽  
Shamsul Alam ◽  
Md. Mizanur Rahman ◽  
Md. Abdul Matin
Keyword(s):  
Neural Network ◽  
Academic Performance ◽  
Performance Prediction ◽  
Deep Neural Network ◽  
Huge Amount ◽  
Novel Technique ◽  
Student Academic Performance ◽  
Academic Activities ◽  
Proposed Model ◽  
Prediction Systems

Students’ academic achievement plays a significant role in the polytechnic institute. It is an important task for the technical student to achieve good results. It becomes more challenging by virtue of the huge amount of data in the polytechnic student databases. Recently, the lack of monitoring of academic activities and their performance has not been harnessed. This is not a good way to evaluate the academic performance of polytechnic students in Bangladesh at present. The study on existing academic prediction systems is still not enough for the polytechnic institutions. Consequently, we have proposed a novel technique to improve student academic performance. In this study, we have used the deep neural network for predicting students' academic final marks. The main objective of this paper is to improve students' results. This paper also explains how the prediction deep neural network model can be used to recognize the most vital attributes in a student's academic data namely midterm_marks, class_ test, attendance, assignment, and target_ marks. By using the proposed model, we can more effectively improve polytechnic student achievement and success.

Sign in / Sign up

Export Citation Format

Share Document