scholarly journals Predicting the Amount of Electric Power Transaction Using Deep Learning Methods

Energies ◽  
2020 ◽  
Vol 13 (24) ◽  
pp. 6649
Author(s):  
Gwiman Bak ◽  
Youngchul Bae
Keyword(s):  
Deep Learning ◽  
Electric Power ◽  
Short Term Memory ◽  
Fuzzy Inference ◽  
Learning Algorithms ◽  
High Accuracy ◽  
Support Vector ◽  
Inference System ◽  
Power Company ◽  
Starting Date

The most important thing to operate a power system is that the power supply should be close to the power demand. In order to predict the amount of electric power transaction (EPT), it is important to choose and decide the variable and its starting date. In this paper, variables that could be acquired one the starting day of prediction were chosen. This paper designated date, temperature and special day as variables to predict the amount of EPT of the Korea Electric Power company. This paper also used temperature data from a year ago to predict the next year. To do this, we proposed single deep learning algorithms and hybrid deep learning algorithms. The former included multi-layer perceptron (MLP), convolution neural network (CNN), long short-term memory (LSTM), gated recurrent unit (GRU), support vector machine regression (SVR), and adaptive network-based fuzzy inference system (ANFIS). The latter included LSTM + CNN and CNN + LSTM. We then confirmed the improvement of accuracy for prediction using pre-processed variables compared to original variables We also assigned two years of test data during 2017–2018 as variable data to measure high prediction accuracy. We then selected a high-accuracy algorithm after measuring root mean square error (RMSE) and mean absolute percent error (MAPE). Finally, we predicted the amount of EPT in 2018 and then measured the error for each proposed algorithm. With these acquired error data, we obtained a model for predicting the amount of EPT with a high accuracy.

scholarly journals PlncRNA-HDeep: plant long noncoding RNA prediction using hybrid deep learning based on two encoding styles

2021 ◽  
Vol 22 (S3) ◽  
Author(s):  
Jun Meng ◽  
Qiang Kang ◽  
Zheng Chang ◽  
Yushi Luan
Keyword(s):  
Deep Learning ◽  
Noncoding Rna ◽  
Nearest Neighbor ◽  
Short Term Memory ◽  
Biological Activities ◽  
Support Vector ◽  
Multiple Perspectives ◽  
K Nearest Neighbor ◽  
Rna Sequences ◽  
Deep Learning Model

Abstract Background Long noncoding RNAs (lncRNAs) play an important role in regulating biological activities and their prediction is significant for exploring biological processes. Long short-term memory (LSTM) and convolutional neural network (CNN) can automatically extract and learn the abstract information from the encoded RNA sequences to avoid complex feature engineering. An ensemble model learns the information from multiple perspectives and shows better performance than a single model. It is feasible and interesting that the RNA sequence is considered as sentence and image to train LSTM and CNN respectively, and then the trained models are hybridized to predict lncRNAs. Up to present, there are various predictors for lncRNAs, but few of them are proposed for plant. A reliable and powerful predictor for plant lncRNAs is necessary. Results To boost the performance of predicting lncRNAs, this paper proposes a hybrid deep learning model based on two encoding styles (PlncRNA-HDeep), which does not require prior knowledge and only uses RNA sequences to train the models for predicting plant lncRNAs. It not only learns the diversified information from RNA sequences encoded by p-nucleotide and one-hot encodings, but also takes advantages of lncRNA-LSTM proposed in our previous study and CNN. The parameters are adjusted and three hybrid strategies are tested to maximize its performance. Experiment results show that PlncRNA-HDeep is more effective than lncRNA-LSTM and CNN and obtains 97.9% sensitivity, 95.1% precision, 96.5% accuracy and 96.5% F1 score on Zea mays dataset which are better than those of several shallow machine learning methods (support vector machine, random forest, k-nearest neighbor, decision tree, naive Bayes and logistic regression) and some existing tools (CNCI, PLEK, CPC2, LncADeep and lncRNAnet). Conclusions PlncRNA-HDeep is feasible and obtains the credible predictive results. It may also provide valuable references for other related research.

scholarly journals Deep Learning Methods for Classification of Certain Abnormalities in Echocardiography

Electronics ◽  
2021 ◽  
Vol 10 (4) ◽  
pp. 495
Author(s):  
Imayanmosha Wahlang ◽  
Arnab Kumar Maji ◽  
Goutam Saha ◽  
Prasun Chakrabarti ◽  
Michal Jasinski ◽  
...  
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Support Vector ◽  
Variational Autoencoder ◽  
Different Types ◽  
Static Images ◽  
Long Short Term Memory ◽  
2D And 3D ◽  
Better Than

This article experiments with deep learning methodologies in echocardiogram (echo), a promising and vigorously researched technique in the preponderance field. This paper involves two different kinds of classification in the echo. Firstly, classification into normal (absence of abnormalities) or abnormal (presence of abnormalities) has been done, using 2D echo images, 3D Doppler images, and videographic images. Secondly, based on different types of regurgitation, namely, Mitral Regurgitation (MR), Aortic Regurgitation (AR), Tricuspid Regurgitation (TR), and a combination of the three types of regurgitation are classified using videographic echo images. Two deep-learning methodologies are used for these purposes, a Recurrent Neural Network (RNN) based methodology (Long Short Term Memory (LSTM)) and an Autoencoder based methodology (Variational AutoEncoder (VAE)). The use of videographic images distinguished this work from the existing work using SVM (Support Vector Machine) and also application of deep-learning methodologies is the first of many in this particular field. It was found that deep-learning methodologies perform better than SVM methodology in normal or abnormal classification. Overall, VAE performs better in 2D and 3D Doppler images (static images) while LSTM performs better in the case of videographic images.

A semiautomatic annotation approach for sentiment analysis

2021 ◽  
pp. 016555152110065
Author(s):  
Rahma Alahmary ◽  
Hmood Al-Dossari
Keyword(s):  
Deep Learning ◽  
Sentiment Analysis ◽  
Short Term Memory ◽  
Machine Learning Algorithms ◽  
Support Vector ◽  
Short Term ◽  
Term Memory ◽  
Annotation Process ◽  
Learning Classifiers ◽  
Long Short Term Memory

Sentiment analysis (SA) aims to extract users’ opinions automatically from their posts and comments. Almost all prior works have used machine learning algorithms. Recently, SA research has shown promising performance in using the deep learning approach. However, deep learning is greedy and requires large datasets to learn, so it takes more time for data annotation. In this research, we proposed a semiautomatic approach using Naïve Bayes (NB) to annotate a new dataset in order to reduce the human effort and time spent on the annotation process. We created a dataset for the purpose of training and testing the classifier by collecting Saudi dialect tweets. The dataset produced from the semiautomatic model was then used to train and test deep learning classifiers to perform Saudi dialect SA. The accuracy achieved by the NB classifier was 83%. The trained semiautomatic model was used to annotate the new dataset before it was fed into the deep learning classifiers. The three deep learning classifiers tested in this research were convolutional neural network (CNN), long short-term memory (LSTM) and bidirectional long short-term memory (Bi-LSTM). Support vector machine (SVM) was used as the baseline for comparison. Overall, the performance of the deep learning classifiers exceeded that of SVM. The results showed that CNN reported the highest performance. On one hand, the performance of Bi-LSTM was higher than that of LSTM and SVM, and, on the other hand, the performance of LSTM was higher than that of SVM. The proposed semiautomatic annotation approach is usable and promising to increase speed and save time and effort in the annotation process.

scholarly journals Comparative analysis of Kernel-based versus BFGS-ANN and deep learning methods in monthly reference evaporation estimation

2020 ◽  
Author(s):  
Mohammad Taghi Sattari ◽  
Halit Apaydin ◽  
Shahab Shamshirband ◽  
Amir Mosavi
Keyword(s):  
Deep Learning ◽  
Minimum Temperature ◽  
Meteorological Parameters ◽  
Short Term Memory ◽  
Sunshine Duration ◽  
Gaussian Process Regression ◽  
Support Vector ◽  
Ann Model ◽  
Learning Methods ◽  
Average Maximum

Abstract. Proper estimation of the reference evapotranspiration (ET0) amount is an indispensable matter for agricultural water management in the efficient use of water. The aim of study is to estimate the amount of ET0 with a different machine and deep learning methods by using minimum meteorological parameters in the Corum region which is an arid and semi-arid climate with an important agricultural center of Turkey. In this context, meteorological variables of average, maximum and minimum temperature, sunshine duration, wind speed, average, maximum, and minimum relative humidity are used as input data monthly. Two different kernel-based (Gaussian Process Regression (GPR) and Support Vector Regression (SVR)) methods, BFGS-ANN and Long short-term memory models were used to estimate ET0 amounts in 10 different combinations. According to the results obtained, all four methods used predicted ET0 amounts in acceptable accuracy and error levels. BFGS-ANN model showed higher success than the others. In kernel-based GPR and SVR methods, Pearson VII function-based universal kernel was the most successful kernel function. Besides, the scenario that is related to temperature in all scenarios used, including average temperature, maximum and minimum temperature, and sunshine duration gave the best results. The second-best scenario was the one that covers only the sunshine duration. In this case, the ANN (BFGS-ANN) model, which is optimized with the BFGS method that uses only the sunshine duration, can be estimated with the 0.971 correlation coefficient of ET0 without the need for other meteorological parameters.

scholarly journals Learners Demographics Classification on MOOCs During the COVID-19: Author Profiling via Deep Learning Based on Semantic and Syntactic Representations

2021 ◽  
Vol 6 ◽  
Author(s):  
Tahani Aljohani ◽  
Alexandra I. Cristea
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Prediction Models ◽  
Short Term Memory ◽  
Methodological Approach ◽  
High Accuracy ◽  
Directional Model ◽  
Textual Representations ◽  
The One

Massive Open Online Courses (MOOCs) have become universal learning resources, and the COVID-19 pandemic is rendering these platforms even more necessary. In this paper, we seek to improve Learner Profiling (LP), i.e. estimating the demographic characteristics of learners in MOOC platforms. We have focused on examining models which show promise elsewhere, but were never examined in the LP area (deep learning models) based on effective textual representations. As LP characteristics, we predict here the employment status of learners. We compare sequential and parallel ensemble deep learning architectures based on Convolutional Neural Networks and Recurrent Neural Networks, obtaining an average high accuracy of 96.3% for our best method. Next, we predict the gender of learners based on syntactic knowledge from the text. We compare different tree-structured Long-Short-Term Memory models (as state-of-the-art candidates) and provide our novel version of a Bi-directional composition function for existing architectures. In addition, we evaluate 18 different combinations of word-level encoding and sentence-level encoding functions. Based on these results, we show that our Bi-directional model outperforms all other models and the highest accuracy result among our models is the one based on the combination of FeedForward Neural Network and the Stack-augmented Parser-Interpreter Neural Network (82.60% prediction accuracy). We argue that our prediction models recommended for both demographics characteristics examined in this study can achieve high accuracy. This is additionally also the first time a sound methodological approach toward improving accuracy for learner demographics classification on MOOCs was proposed.

scholarly journals Modeling and predicting suspended sediment load under climate change conditions: a new hybridization strategy

2021 ◽  
Author(s):  
Saeed Farzin ◽  
Mahdi Valikhan Anaraki
Keyword(s):  
Climate Change ◽  
Suspended Sediment ◽  
General Circulation ◽  
Sediment Load ◽  
Fuzzy Inference ◽  
Circulation Model ◽  
Support Vector ◽  
Suspended Sediment Load ◽  
Inference System ◽  
New Strategy

Abstract In the present study, for the first time, a new strategy based on a combination of the hybrid least-squares support-vector machine (LS-SVM) and flower pollination optimization algorithm (FPA), average 24 general circulation model (GCM) output, and delta change factor method has been developed to achieve the impacts of climate change on runoff and suspended sediment load (SSL) in the Lighvan Basin in the period (2020–2099). Also, the results of modeling were compared to those of LS-SVM and adaptive neuro-fuzzy inference system (ANFIS) methods. The comparison of runoff and SSL modeling results showed that the LS-SVM-FPA algorithm had the best results and the ANFIS algorithm had the worst results. After the acceptable performance of the LS-SVM-FPA algorithm was proved, the algorithm was used to predict runoff and SSL under climate change conditions based on ensemble GCM outputs for periods (2020–2034, 2035–2049, 2070–2084, and 2085–2099) under three scenarios of RCP2.6, RCP4.5, and RCP8.5. The results showed a decrease in the runoff in all periods and scenarios, except for the two near periods under the RCP2.6 scenario for runoff. The predicted runoff and SSL time series also showed that the SSL values were lower than the average observation period, except for 2036–2039 (up to an 8% increase in 2038).

scholarly journals Deep Learning-Based Human Activity Real-Time Recognition for Pedestrian Navigation

Sensors ◽  
2020 ◽  
Vol 20 (9) ◽  
pp. 2574 ◽  
Author(s):  
Junhua Ye ◽  
Xin Li ◽  
Xiangdong Zhang ◽  
Qin Zhang ◽  
Wu Chen
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Real Time ◽  
Learning Algorithms ◽  
Support Vector ◽  
Classification Methods ◽  
Pedestrian Navigation ◽  
Mode Recognition ◽  
Posture Recognition ◽  
Motion Mode

Several pedestrian navigation solutions have been proposed to date, and most of them are based on smartphones. Real-time recognition of pedestrian mode and smartphone posture is a key issue in navigation. Traditional ML (Machine Learning) classification methods have drawbacks, such as insufficient recognition accuracy and poor timing. This paper presents a real-time recognition scheme for comprehensive human activities, and this scheme combines deep learning algorithms and MEMS (Micro-Electro-Mechanical System) sensors’ measurements. In this study, we performed four main experiments, namely pedestrian motion mode recognition, smartphone posture recognition, real-time comprehensive pedestrian activity recognition, and pedestrian navigation. In the procedure of recognition, we designed and trained deep learning models using LSTM (Long Short-Term Memory) and CNN (Convolutional Neural Network) networks based on Tensorflow framework. The accuracy of traditional ML classification methods was also used for comparison. Test results show that the accuracy of motion mode recognition was improved from 89.9 % , which was the highest accuracy and obtained by SVM (Support Vector Machine), to 90.74 % (LSTM) and 91.92 % (CNN); the accuracy of smartphone posture recognition was improved from 81.60 % , which is the highest accuracy and obtained by NN (Neural Network), to 93.69 % (LSTM) and 95.55 % (CNN). We give a model transformation procedure based on the trained CNN network model, and then obtain the converted . t f l i t e model, which can be run in Android devices for real-time recognition. Real-time recognition experiments were performed in multiple scenes, a recognition model trained by the CNN network was deployed in a Huawei Mate20 smartphone, and the five most used pedestrian activities were designed and verified. The overall accuracy was up to 89.39 % . Overall, the improvement of recognition capability based on deep learning algorithms was significant. Therefore, the solution was helpful to recognize comprehensive pedestrian activities during navigation. On the basis of the trained model, a navigation test was performed; mean bias was reduced by more than 1.1 m. Accordingly, the positioning accuracy was improved obviously, which is meaningful to apply DL in the area of pedestrian navigation to make improvements.

scholarly journals Using Machine Learning-Based Algorithms to Analyze Erosion Rates of a Watershed in Northern Taiwan

2020 ◽  
Vol 12 (5) ◽  
pp. 2022 ◽  
Author(s):  
Kieu Anh Nguyen ◽  
Walter Chen ◽  
Bor-Shiun Lin ◽  
Uma Seeboonruang
Keyword(s):  
Machine Learning ◽  
Random Forest ◽  
Fuzzy Inference ◽  
Absolute Error ◽  
Organic Content ◽  
Rank Test ◽  
Support Vector ◽  
Inference System ◽  
Erosion Rates ◽  
Northern Taiwan

This study continues a previous study with further analysis of watershed-scale erosion pin measurements. Three machine learning (ML) algorithms—Support Vector Machine (SVM), Adaptive Neuro-Fuzzy Inference System (ANFIS), and Artificial Neural Network (ANN)—were used to analyze depth of erosion of a watershed (Shihmen reservoir) in northern Taiwan. In addition to three previously used statistical indexes (Mean Absolute Error, Root Mean Square of Error, and R-squared), Nash–Sutcliffe Efficiency (NSE) was calculated to compare the predictive performances of the three models. To see if there was a statistical difference between the three models, the Wilcoxon signed-rank test was used. The research utilized 14 environmental attributes as the input predictors of the ML algorithms. They are distance to river, distance to road, type of slope, sub-watershed, slope direction, elevation, slope class, rainfall, epoch, lithology, and the amount of organic content, clay, sand, and silt in the soil. Additionally, measurements of a total of 550 erosion pins installed on 55 slopes were used as the target variable of the model prediction. The dataset was divided into a training set (70%) and a testing set (30%) using the stratified random sampling with sub-watershed as the stratification variable. The results showed that the ANFIS model outperforms the other two algorithms in predicting the erosion rates of the study area. The average RMSE of the test data is 2.05 mm/yr for ANFIS, compared to 2.36 mm/yr and 2.61 mm/yr for ANN and SVM, respectively. Finally, the results of this study (ANN, ANFIS, and SVM) were compared with the previous study (Random Forest, Decision Tree, and multiple regression). It was found that Random Forest remains the best predictive model, and ANFIS is the second-best among the six ML algorithms.

Thermal error modelling of motorised spindle in large-sized gear grinding machine

2017 ◽  
Vol 231 (5) ◽  
pp. 768-778 ◽  
Author(s):  
He Dai ◽  
Shilong Wang ◽  
Xin Xiong ◽  
Baocang Zhou ◽  
Shouli Sun ◽  
...  
Keyword(s):  
Support Vector Machine ◽  
Machine Tools ◽  
Fuzzy Inference ◽  
Thermal Error ◽  
Support Vector ◽  
Inference System ◽  
Thermal Errors ◽  
Gear Grinding ◽  
Neuro Fuzzy ◽  
Grinding Machine

Thermal errors are one of the most significant factors that influence the machining precision of machine tools. For large-sized gear grinding machine tools, thermal errors of beds, columns and rotary tables are decreased by their huge heat capacity. However, different from machine tools of normal sizes, thermal errors increase with greater power in motorised spindles. Thermal error compensation is generally considered as a relatively effective, convenient and cost-efficient approach in thermal error control and reduction. This article proposes two thermal error prediction models for motorised spindles based on an adaptive neuro-fuzzy inference system and support vector machine, respectively. In the adaptive neuro-fuzzy inference system–based model, the temperature values are divided into different groups using subtractive clustering. A hybrid learning scheme is adopted to adjust membership functions so as to learn from the input data. In the particle swarm optimisation support vector machine–based model, particle swarm optimisation is used to optimise the hyperparameters of the established model. Thermal balance experiments are conducted on a large-sized computer numerical control gear grinding machine tool to establish the prediction models. Comparative results show that the adaptive neuro-fuzzy inference system model has higher prediction accuracy (with residual errors within ±2.5 μm in the radial direction and ±3 μm in the axial direction) than the support vector machine model.

Sign in / Sign up

Export Citation Format

Share Document