scholarly journals Snowmelt-Driven Streamflow Prediction Using Machine Learning Techniques (LSTM, NARX, GPR, and SVR)

Water ◽  
2020 ◽  
Vol 12 (6) ◽  
pp. 1734 ◽  
Author(s):  
Samit Thapa ◽  
Zebin Zhao ◽  
Bo Li ◽  
Lu Lu ◽  
Donglei Fu ◽  
...  
Keyword(s):  
Machine Learning ◽  
Short Term Memory ◽  
Mean Squared Error ◽  
Gaussian Process Regression ◽  
Absolute Error ◽  
Machine Learning Techniques ◽  
Coefficient Of Determination ◽  
Support Vector ◽  
Streamflow Prediction ◽  
Moderate Resolution Imaging Spectroradiometer

Although machine learning (ML) techniques are increasingly popular in water resource studies, they are not extensively utilized in modeling snowmelt. In this study, we developed a model based on a deep learning long short-term memory (LSTM) for snowmelt-driven discharge modeling in a Himalayan basin. For comparison, we developed the nonlinear autoregressive exogenous model (NARX), Gaussian process regression (GPR), and support vector regression (SVR) models. The snow area derived from moderate resolution imaging spectroradiometer (MODIS) snow images along with remotely sensed meteorological products were utilized as inputs to the models. The Gamma test was conducted to determine the appropriate input combination for the models. The shallow LSTM model with a hidden layer achieved superior results than the deeper LSTM models with multiple hidden layers. Out of seven optimizers tested, Adamax proved to be the aptest optimizer for this study. The evaluation of the ML models was done by the coefficient of determination (R2), mean absolute error (MAE), modified Kling–Gupta efficiency (KGE’), Nash–Sutcliffe efficiency (NSE), and root-mean-squared error (RMSE). The LSTM model (KGE’ = 0.99) enriched with snow cover input achieved the best results followed by NARX (KGE’ = 0.974), GPR (KGE’ = 0.95), and SVR (KGE’ = 0.949), respectively. The outcome of this study proves the applicability of the ML models, especially the LSTM model, in predicting snowmelt driven discharge in the data-scant mountainous watersheds.

scholarly journals Forecasting Factor of Safety of Slopes Stability Using Several Machine Learning Techniques

2021 ◽  
Author(s):  
Arsalan Mahmoodzadeh ◽  
Mokhtar Mohammadi
Keyword(s):  
Machine Learning ◽  
Slope Stability ◽  
Factor Of Safety ◽  
Slope Failure ◽  
Short Term Memory ◽  
Gaussian Process Regression ◽  
Machine Learning Techniques ◽  
Unit Weight ◽  
Support Vector ◽  
Effective Parameters

Abstract Because of the disasters associated with slope failure, the analysis and forecasting of slope stability for geotechnical engineers are crucial. In this work, in order to forecast the factor of safety (FOS) of the slopes, six machine learning (ML) techniques of Gaussian process regression (GPR), support vector regression (SVR), decision trees (DT), long-short term memory (LSTM), deep neural networks (DNN), and K-nearest neighbors (KNN) were performed. A total of 327 slope cases in Iran with various geometric and shear strength parameters analyzed by PLAXIS software to evaluate their FOS, were employed in the models. The K-fold (K=5) cross-validation (CV) method was applied to evaluate the performance of models’ prediction. Finally, all the models produced acceptable results and almost close to each other. However, the GPR model with R2 = 0.8139, RMSE = 0.160893, and MAPE = 7.209772%, was the most accurate model to predict slope stability. Also, the backward selection method was applied to evaluate the contribution of each parameter in the prediction problem. The results showed that all the features considered in this study have significant contributions to slope stability. However, features φ (friction angle) and γ (unit weight) were the most effective and least effective parameters on slope stability, respectively.

Automated Outlier Detection for Electrical Motors and Transformers

2020 ◽  
Vol 17 (9) ◽  
pp. 4703-4708
Author(s):  
K. Anitha Kumari ◽  
Avinash Sharma ◽  
S. Nivethitha ◽  
V. Dharini ◽  
V. Sanjith ◽  
...  
Keyword(s):  
Machine Learning ◽  
Polynomial Regression ◽  
Mean Squared Error ◽  
Absolute Error ◽  
Machine Learning Algorithms ◽  
Supervised Machine Learning ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Squared Error ◽  
Electrical Motors

Electrical appliances most commonly consist of two electrical devices, namely, electrical motors and transformers. Typically, electrical motors are normally used in all sort of industrial purposes. Failures of such motors results in serious problems, such as overheat, shut down and even burnt, in their host systems. Thus, more attention have to be paid in detecting the outliers. In a similar way, to avoid the unexpected power reliability problems and system damages, the prediction of the failures in the transformers is expected to quantify the impacts. By predicting the failures, the lifetime of the transformers increases and unnecessary accidents is avoided. Therefore, this paper presents the detection of the outliers in electrical motors and failures in transformers using supervised machine learning algorithms. Machine learning techniques such as Support Vector Machine (SVM), Random Forest (RF) and regression techniques like Support Vector Regression (SVR), Polynomial Regression (PR) are used to analyze the use cases of different motor specifications. Evaluation and the efficiency of findings are proved by considering accuracy, precision, F-measure, and recall for motors. Mean Absolute Error (MAE), Mean Squared Error (MSE), Root Mean Square Error (RMSE) and R-squared Error (R2) are considered as metrics for transformers. The proposed approach helps to identify the anomalies like vibration loss, copper loss and overheating in the industrial motor and to determine the abnormal functioning of the transformer that in turn leads to ascertain the lifetime. The proposed system analyses the behaviour of the electrical machines using the energy meter data and reports the outliers to users. It also analyses the abnormalities occurring in the transformer using the parameters involved in the degradation of the paper-oil insulation system and the voltage of operation as a whole leads to the predict the lifetime.

scholarly journals Prediction of Combined Terrestrial Evapotranspiration Index (CTEI) over Large River Basin Based on Machine Learning Approaches

Water ◽  
2021 ◽  
Vol 13 (4) ◽  
pp. 547 ◽  
Author(s):  
Ahmed Elbeltagi ◽  
Nikul Kumari ◽  
Jaydeo K. Dharpure ◽  
Ali Mokhtar ◽  
Karam Alsafadi ◽  
...  
Keyword(s):  
Machine Learning ◽  
River Basin ◽  
Mean Squared Error ◽  
Gaussian Model ◽  
Gaussian Process Regression ◽  
Absolute Error ◽  
Support Vector ◽  
Learning Approaches ◽  
Ganga Basin ◽  
Svm Algorithm

Drought is a fundamental physical feature of the climate pattern worldwide. Over the past few decades, a natural disaster has accelerated its occurrence, which has significantly impacted agricultural systems, economies, environments, water resources, and supplies. Therefore, it is essential to develop new techniques that enable comprehensive determination and observations of droughts over large areas with satisfactory spatial and temporal resolution. This study modeled a new drought index called the Combined Terrestrial Evapotranspiration Index (CTEI), developed in the Ganga river basin. For this, five Machine Learning (ML) techniques, derived from artificial intelligence theories, were applied: the Support Vector Machine (SVM) algorithm, decision trees, Matern 5/2 Gaussian process regression, boosted trees, and bagged trees. These techniques were driven by twelve different models generated from input combinations of satellite data and hydrometeorological parameters. The results indicated that the eighth model performed best and was superior among all the models, with the SVM algorithm resulting in an R2 value of 0.82 and the lowest errors in terms of the Root Mean Squared Error (RMSE) (0.33) and Mean Absolute Error (MAE) (0.20), followed by the Matern 5/2 Gaussian model with an R2 value of 0.75 and RMSE and MAE of 0.39 and 0.21 mm/day, respectively. Moreover, among all the five methods, the SVM and Matern 5/2 Gaussian methods were the best-performing ML algorithms in our study of CTEI predictions for the Ganga basin.

scholarly journals Support vector regression algorithm modeling to predict the parturition date of small - to medium-sized dogs using maternal weight and fetal biparietal diameter

2021 ◽  
Vol 14 (4) ◽  
pp. 829-834
Author(s):  
Thanida Sananmuang ◽  
Kanchanarat Mankong ◽  
Suppawiwat Ponglowhapan ◽  
Kaj Chokeshaiusaha
Keyword(s):  
Machine Learning ◽  
Support Vector Regression ◽  
Mean Squared Error ◽  
Absolute Error ◽  
Kernel Functions ◽  
Coefficient Of Determination ◽  
Support Vector ◽  
Maternal Weight ◽  
Biparietal Diameter ◽  
Parturition Date

Background and Aim: Fetal biparietal diameter (BPD) is a feasible parameter to predict canine parturition date due to its inverted correlation with days before parturition (DBP). Although such a relationship is generally described using a simple linear regression (SLR) model, the imprecision of this model in predicting the parturition date in small- to medium-sized dogs is a common problem among veterinarian practitioners. Support vector regression (SVR) is a useful machine learning model for prediction. This study aimed to compare the accuracy of SVR with that of SLR in predicting DBP. Materials and Methods: After measuring 101 BPDs in 35 small- to medium-sized pregnant bitches, we fitted the data to the routine SLR model and the SVR model using three different kernel functions, radial basis function SVR, linear SVR, and polynomial SVR. The predicted DBP acquired from each model was further utilized for calculating the coefficient of determination (R2), mean absolute error, and mean squared error scores for determining the prediction accuracy. Results: All SVR models were more accurate than the SLR model at predicting DBP. The linear and polynomial SVRs were identified as the two most accurate models (p<0.01). Conclusion: With available machine learning software, linear and polynomial SVRs can be applied to predicting DBP in small- to medium-sized pregnant bitches.

Using Machine Learning Algorithms on Prediction of Stock Price

2020 ◽  
Vol 12 (2) ◽  
pp. 84-99
Author(s):  
Li-Pang Chen
Keyword(s):  
Machine Learning ◽  
Stock Price ◽  
Short Term Memory ◽  
Machine Learning Algorithms ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Short Term ◽  
Learning Techniques ◽  
Historical Database ◽  
Long Short Term Memory

In this paper, we investigate analysis and prediction of the time-dependent data. We focus our attention on four different stocks are selected from Yahoo Finance historical database. To build up models and predict the future stock price, we consider three different machine learning techniques including Long Short-Term Memory (LSTM), Convolutional Neural Networks (CNN) and Support Vector Regression (SVR). By treating close price, open price, daily low, daily high, adjusted close price, and volume of trades as predictors in machine learning methods, it can be shown that the prediction accuracy is improved.

Machine learning and Grad-Cam based vascular aging assessment using photoplethysmogram (Preprint)

2021 ◽  
Author(s):  
Hangsik Shin
Keyword(s):  
Machine Learning ◽  
Correlation Coefficient ◽  
Age Estimation ◽  
Mean Squared Error ◽  
Mean Absolute Error ◽  
Absolute Error ◽  
Coefficient Of Determination ◽  
Vascular Aging ◽  
Squared Error ◽  
Vascular Age

BACKGROUND Arterial stiffness due to vascular aging is a major indicator for evaluating cardiovascular risk. OBJECTIVE In this study, we propose a method of estimating age by applying machine learning to photoplethysmogram for non-invasive vascular age assessment. METHODS The machine learning-based age estimation model that consists of three convolutional layers and two-layer fully connected layers, was developed using segmented photoplethysmogram by pulse from a total of 752 adults aged 19–87 years. The performance of the developed model was quantitatively evaluated using mean absolute error, root-mean-squared-error, Pearson’s correlation coefficient, coefficient of determination. The Grad-Cam was used to explain the contribution of photoplethysmogram waveform characteristic in vascular age estimation. RESULTS Mean absolute error of 8.03, root mean squared error of 9.96, 0.62 of correlation coefficient, and 0.38 of coefficient of determination were shown through 10-fold cross validation. Grad-Cam, used to determine the weight that the input signal contributes to the result, confirmed that the contribution to the age estimation of the photoplethysmogram segment was high around the systolic peak. CONCLUSIONS The machine learning-based vascular aging analysis method using the PPG waveform showed comparable or superior performance compared to previous studies without complex feature detection in evaluating vascular aging. CLINICALTRIAL 2015-0104

scholarly journals Machine Learning-Based Gully Erosion Susceptibility Mapping: A Case Study of Eastern India

Sensors ◽  
2020 ◽  
Vol 20 (5) ◽  
pp. 1313 ◽  
Author(s):  
Sunil Saha ◽  
Jagabandhu Roy ◽  
Alireza Arabameri ◽  
Thomas Blaschke ◽  
Dieu Tien Bui
Keyword(s):  
Machine Learning ◽  
Mean Squared Error ◽  
Absolute Error ◽  
Gully Erosion ◽  
Machine Learning Techniques ◽  
Weight Of Evidence ◽  
Validation Dataset ◽  
Boosted Regression Tree ◽  
Area Index ◽  
Statistical Measures

Gully erosion is a form of natural disaster and one of the land loss mechanisms causing severe problems worldwide. This study aims to delineate the areas with the most severe gully erosion susceptibility (GES) using the machine learning techniques Random Forest (RF), Gradient Boosted Regression Tree (GBRT), Naïve Bayes Tree (NBT), and Tree Ensemble (TE). The gully inventory map (GIM) consists of 120 gullies. Of the 120 gullies, 84 gullies (70%) were used for training and 36 gullies (30%) were used to validate the models. Fourteen gully conditioning factors (GCFs) were used for GES modeling and the relationships between the GCFs and gully erosion was assessed using the weight-of-evidence (WofE) model. The GES maps were prepared using RF, GBRT, NBT, and TE and were validated using area under the receiver operating characteristic (AUROC) curve, the seed cell area index (SCAI) and five statistical measures including precision (PPV), false discovery rate (FDR), accuracy, mean absolute error (MAE), and root mean squared error (RMSE). Nearly 7% of the basin has high to very high susceptibility for gully erosion. Validation results proved the excellent ability of these models to predict the GES. Of the analyzed models, the RF (AUROC = 0.96, PPV = 1.00, FDR = 0.00, accuracy = 0.87, MAE = 0.11, RMSE = 0.19 for validation dataset) is accurate enough for modeling and better suited for GES modeling than the other models. Therefore, the RF model can be used to model the GES areas not only in this river basin but also in other areas with the same geo-environmental conditions.

scholarly journals A Machine Learning View on Momentum and Reversal Trading

Algorithms ◽  
2018 ◽  
Vol 11 (11) ◽  
pp. 170 ◽  
Author(s):  
Zhixi Li ◽  
Vincent Tam
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Stock Market ◽  
Short Term Memory ◽  
Predictive Ability ◽  
Trading Strategies ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Learning Approaches ◽  
Learning Techniques

Momentum and reversal effects are important phenomena in stock markets. In academia, relevant studies have been conducted for years. Researchers have attempted to analyze these phenomena using statistical methods and to give some plausible explanations. However, those explanations are sometimes unconvincing. Furthermore, it is very difficult to transfer the findings of these studies to real-world investment trading strategies due to the lack of predictive ability. This paper represents the first attempt to adopt machine learning techniques for investigating the momentum and reversal effects occurring in any stock market. In the study, various machine learning techniques, including the Decision Tree (DT), Support Vector Machine (SVM), Multilayer Perceptron Neural Network (MLP), and Long Short-Term Memory Neural Network (LSTM) were explored and compared carefully. Several models built on these machine learning approaches were used to predict the momentum or reversal effect on the stock market of mainland China, thus allowing investors to build corresponding trading strategies. The experimental results demonstrated that these machine learning approaches, especially the SVM, are beneficial for capturing the relevant momentum and reversal effects, and possibly building profitable trading strategies. Moreover, we propose the corresponding trading strategies in terms of market states to acquire the best investment returns.

scholarly journals Investigating the Applications of Machine Learning Techniques to Predict the Rock Brittleness Index

2020 ◽  
Vol 10 (5) ◽  
pp. 1691 ◽  
Author(s):  
Deliang Sun ◽  
Mahshid Lonbani ◽  
Behnam Askarian ◽  
Danial Jahed Armaghani ◽  
Reza Tarinejad ◽  
...  
Keyword(s):  
Machine Learning ◽  
Point Load ◽  
P Wave ◽  
Machine Learning Techniques ◽  
Brittleness Index ◽  
Coefficient Of Determination ◽  
Support Vector ◽  
Ann Model ◽  
Learning Techniques ◽  
Rock Brittleness

Despite the vast usage of machine learning techniques to solve engineering problems, a very limited number of studies on the rock brittleness index (BI) have used these techniques to analyze issues in this field. The present study developed five well-known machine learning techniques and compared their performance to predict the brittleness index of the rock samples. The comparison of the models’ performance was conducted through a ranking system. These techniques included Chi-square automatic interaction detector (CHAID), random forest (RF), support vector machine (SVM), K-nearest neighbors (KNN), and artificial neural network (ANN). This study used a dataset from a water transfer tunneling project in Malaysia. Results of simple rock index tests i.e., Schmidt hammer, p-wave velocity, point load, and density were considered as model inputs. The results of this study indicated that while the RF model had the best performance for training (ranking = 25), the ANN outperformed other models for testing (ranking = 22). However, the KNN model achieved the highest cumulative ranking, which was 37. The KNN model showed desirable stability for both training and testing. However, the results of validation stage indicated that RF model with coefficient of determination (R2) of 0.971 provides higher performance capacity for prediction of the rock BI compared to KNN model with R2 of 0.807 and ANN model with R2 of 0.860. The results of this study suggest a practical use of the machine learning models in solving problems related to rock mechanics specially rock brittleness index.

scholarly journals Sentiment Analysis of Lithuanian Texts Using Traditional and Deep Learning Approaches

Computers ◽  
2019 ◽  
Vol 8 (1) ◽  
pp. 4 ◽  
Author(s):  
Jurgita Kapočiūtė-Dzikienė ◽  
Robertas Damaševičius ◽  
Marcin Woźniak
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Sentiment Analysis ◽  
Short Term Memory ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Learning Approaches ◽  
Full Dataset ◽  
Learning Techniques ◽  
Long Short Term Memory

We describe the sentiment analysis experiments that were performed on the Lithuanian Internet comment dataset using traditional machine learning (Naïve Bayes Multinomial—NBM and Support Vector Machine—SVM) and deep learning (Long Short-Term Memory—LSTM and Convolutional Neural Network—CNN) approaches. The traditional machine learning techniques were used with the features based on the lexical, morphological, and character information. The deep learning approaches were applied on the top of two types of word embeddings (Vord2Vec continuous bag-of-words with negative sampling and FastText). Both traditional and deep learning approaches had to solve the positive/negative/neutral sentiment classification task on the balanced and full dataset versions. The best deep learning results (reaching 0.706 of accuracy) were achieved on the full dataset with CNN applied on top of the FastText embeddings, replaced emoticons, and eliminated diacritics. The traditional machine learning approaches demonstrated the best performance (0.735 of accuracy) on the full dataset with the NBM method, replaced emoticons, restored diacritics, and lemma unigrams as features. Although traditional machine learning approaches were superior when compared to the deep learning methods; deep learning demonstrated good results when applied on the small datasets.

Sign in / Sign up

Export Citation Format

Share Document