scholarly journals Short-Term Speed Prediction Using Remote Microwave Sensor Data: Machine Learning versus Statistical Model

2016 ◽  
Vol 2016 ◽  
pp. 1-13 ◽  
Author(s):  
Han Jiang ◽  
Yajie Zou ◽  
Shen Zhang ◽  
Jinjun Tang ◽  
Yinhai Wang
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Support Vector Machine ◽  
Statistical Models ◽  
Prediction Performance ◽  
Support Vector ◽  
Beijing City ◽  
Short Term ◽  
Time Step ◽  
Speed Prediction

Recently, a number of short-term speed prediction approaches have been developed, in which most algorithms are based on machine learning and statistical theory. This paper examined the multistep ahead prediction performance of eight different models using the 2-minute travel speed data collected from three Remote Traffic Microwave Sensors located on a southbound segment of 4th ring road in Beijing City. Specifically, we consider five machine learning methods: Back Propagation Neural Network (BPNN), nonlinear autoregressive model with exogenous inputs neural network (NARXNN), support vector machine with radial basis function as kernel function (SVM-RBF), Support Vector Machine with Linear Function (SVM-LIN), and Multilinear Regression (MLR) as candidate. Three statistical models are also selected: Autoregressive Integrated Moving Average (ARIMA), Vector Autoregression (VAR), and Space-Time (ST) model. From the prediction results, we find the following meaningful results: (1) the prediction accuracy of speed deteriorates as the prediction time steps increase for all models; (2) the BPNN, NARXNN, and SVM-RBF can clearly outperform two traditional statistical models: ARIMA and VAR; (3) the prediction performance of ANN is superior to that of SVM and MLR; (4) as time step increases, the ST model can consistently provide the lowest MAE comparing with ARIMA and VAR.

scholarly journals Evaluation of Short-Term Freeway Speed Prediction Based on Periodic Analysis Using Statistical Models and Machine Learning Models

2020 ◽  
Vol 2020 ◽  
pp. 1-16 ◽  
Author(s):  
Xiaoxue Yang ◽  
Yajie Zou ◽  
Jinjun Tang ◽  
Jian Liang ◽  
Muhammad Ijaz
Keyword(s):  
Machine Learning ◽  
Statistical Models ◽  
Prediction Performance ◽  
Periodic Component ◽  
Learning Approaches ◽  
Learning Models ◽  
Short Term ◽  
Speed Prediction ◽  
The Impact ◽  
Machine Learning Models

Accurate prediction of traffic information (i.e., traffic flow, travel time, traffic speed, etc.) is a key component of Intelligent Transportation System (ITS). Traffic speed is an important indicator to evaluate traffic efficiency. Up to date, although a few studies have considered the periodic feature in traffic prediction, very few studies comprehensively evaluate the impact of periodic component on statistical and machine learning prediction models. This paper selects several representative statistical models and machine learning models to analyze the influence of periodic component on short-term speed prediction under different scenarios: (1) multi-horizon ahead prediction (5, 15, 30, 60 minutes ahead predictions), (2) with and without periodic component, (3) two data aggregation levels (5-minute and 15-minute), (4) peak hours and off-peak hours. Specifically, three statistical models (i.e., space time (ST) model, vector autoregressive (VAR) model, autoregressive integrated moving average (ARIMA) model) and three machine learning approaches (i.e., support vector machines (SVM) model, multi-layer perceptron (MLP) model, recurrent neural network (RNN) model) are developed and examined. Furthermore, the periodic features of the speed data are considered via a hybrid prediction method, which assumes that the data consist of two components: a periodic component and a residual component. The periodic component is described by a trigonometric regression function, and the residual component is modeled by the statistical models or the machine learning approaches. The important conclusions can be summarized as follows: (1) the multi-step ahead prediction accuracy improves when considering the periodic component of speed data for both three statistical models and three machine learning models, especially in the peak hours; (2) considering the impact of periodic component for all models, the prediction performance improvement gradually becomes larger as the time step increases; (3) under the same prediction horizon, the prediction performance of all models for 15-minute speed data is generally better than that for 5-minute speed data. Overall, the findings in this paper suggest that the proposed hybrid prediction approach is effective for both statistical and machine learning models in short-term speed prediction.

An application of backtracking search optimization–based least squares support vector machine for prediction of short-term wind speed

2019 ◽  
Vol 44 (3) ◽  
pp. 266-281 ◽  
Author(s):  
Zhongda Tian ◽  
Yi Ren ◽  
Gang Wang
Keyword(s):  
Support Vector Machine ◽  
Wind Speed ◽  
Prediction Model ◽  
Least Squares ◽  
Support Vector ◽  
Short Term ◽  
Backtracking Search ◽  
Wind Speed Prediction ◽  
Search Optimization ◽  
Speed Prediction

Wind speed prediction is an important technology in the wind power field; however, because of their chaotic nature, predicting wind speed accurately is difficult. Aims at this challenge, a backtracking search optimization–based least squares support vector machine model is proposed for short-term wind speed prediction. In this article, the least squares support vector machine is chosen as the short-term wind speed prediction model and backtracking search optimization algorithm is used to optimize the important parameters which influence the least squares support vector machine regression model. Furthermore, the optimal parameters of the model are obtained, and the short-term wind speed prediction model of least squares support vector machine is established through parameter optimization. For time-varying systems similar to short-term wind speed time series, a model updating method based on prediction error accuracy combined with sliding window strategy is proposed. When the prediction model does not match the actual short-term wind model, least squares support vector machine trains and re-establishes. This model updating method avoids the mismatch problem between prediction model and actual wind speed data. The actual collected short-term wind speed time series is used as the research object. Multi-step prediction simulation of short-term wind speed is carried out. The simulation results show that backtracking search optimization algorithm–based least squares support vector machine model has higher prediction accuracy and reliability for the short-term wind speed. At the same time, the prediction performance indicators are also improved. The prediction result is that root mean square error is 0.1248, mean absolute error is 0.1374, mean absolute percentile error is 0.1589% and R2 is 0.9648. When the short-term wind speed varies from 0 to 4 m/s, the average value of absolute prediction error is 0.1113 m/s, and average value of absolute relative prediction error is 8.7111%. The proposed prediction model in this article has high engineering application value.

scholarly journals HARTH: A Human Activity Recognition Dataset for Machine Learning

Sensors ◽  
2021 ◽  
Vol 21 (23) ◽  
pp. 7853
Author(s):  
Aleksej Logacjov ◽  
Kerstin Bach ◽  
Atle Kongsvold ◽  
Hilde Bremseth Bårdstu ◽  
Paul Jarle Mork
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Support Vector Machine ◽  
Convolutional Neural Network ◽  
Activity Recognition ◽  
Human Activity ◽  
Short Term Memory ◽  
Human Activity Recognition ◽  
Support Vector ◽  
Free Living

Existing accelerometer-based human activity recognition (HAR) benchmark datasets that were recorded during free living suffer from non-fixed sensor placement, the usage of only one sensor, and unreliable annotations. We make two contributions in this work. First, we present the publicly available Human Activity Recognition Trondheim dataset (HARTH). Twenty-two participants were recorded for 90 to 120 min during their regular working hours using two three-axial accelerometers, attached to the thigh and lower back, and a chest-mounted camera. Experts annotated the data independently using the camera’s video signal and achieved high inter-rater agreement (Fleiss’ Kappa =0.96). They labeled twelve activities. The second contribution of this paper is the training of seven different baseline machine learning models for HAR on our dataset. We used a support vector machine, k-nearest neighbor, random forest, extreme gradient boost, convolutional neural network, bidirectional long short-term memory, and convolutional neural network with multi-resolution blocks. The support vector machine achieved the best results with an F1-score of 0.81 (standard deviation: ±0.18), recall of 0.85±0.13, and precision of 0.79±0.22 in a leave-one-subject-out cross-validation. Our highly professional recordings and annotations provide a promising benchmark dataset for researchers to develop innovative machine learning approaches for precise HAR in free living.

scholarly journals Deep Learning Assisted Neonatal Cry Classification via Support Vector Machine Models

2021 ◽  
Vol 9 ◽  
Author(s):  
Ashwini K ◽  
P. M. Durai Raj Vincent ◽  
Kathiravan Srinivasan ◽  
Chuan-Yu Chang
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Support Vector Machine ◽  
Feature Extraction ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Support Vector ◽  
Svm Classifier ◽  
Infant Cry ◽  
Learning Techniques

Neonatal infants communicate with us through cries. The infant cry signals have distinct patterns depending on the purpose of the cries. Preprocessing, feature extraction, and feature selection need expert attention and take much effort in audio signals in recent days. In deep learning techniques, it automatically extracts and selects the most important features. For this, it requires an enormous amount of data for effective classification. This work mainly discriminates the neonatal cries into pain, hunger, and sleepiness. The neonatal cry auditory signals are transformed into a spectrogram image by utilizing the short-time Fourier transform (STFT) technique. The deep convolutional neural network (DCNN) technique takes the spectrogram images for input. The features are obtained from the convolutional neural network and are passed to the support vector machine (SVM) classifier. Machine learning technique classifies neonatal cries. This work combines the advantages of machine learning and deep learning techniques to get the best results even with a moderate number of data samples. The experimental result shows that CNN-based feature extraction and SVM classifier provides promising results. While comparing the SVM-based kernel techniques, namely radial basis function (RBF), linear and polynomial, it is found that SVM-RBF provides the highest accuracy of kernel-based infant cry classification system provides 88.89% accuracy.

scholarly journals Predicting Rainfall-Induced Soil Erosion Based on a Hybridization of Adaptive Differential Evolution and Support Vector Machine Classification

2021 ◽  
Vol 2021 ◽  
pp. 1-20
Author(s):  
Tuan Vu Dinh ◽  
Hieu Nguyen ◽  
Xuan-Linh Tran ◽  
Nhat-Duc Hoang
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Artificial Neural Network ◽  
Support Vector Machine ◽  
Soil Erosion ◽  
Differential Evolution ◽  
Influencing Factors ◽  
Support Vector ◽  
Adaptive Differential Evolution ◽  
Artificial Neural

Soil erosion induced by rainfall is a critical problem in many regions in the world, particularly in tropical areas where the annual rainfall amount often exceeds 2000 mm. Predicting soil erosion is a challenging task, subjecting to variation of soil characteristics, slope, vegetation cover, land management, and weather condition. Conventional models based on the mechanism of soil erosion processes generally provide good results but are time-consuming due to calibration and validation. The goal of this study is to develop a machine learning model based on support vector machine (SVM) for soil erosion prediction. The SVM serves as the main prediction machinery establishing a nonlinear function that maps considered influencing factors to accurate predictions. In addition, in order to improve the accuracy of the model, the history-based adaptive differential evolution with linear population size reduction and population-wide inertia term (L-SHADE-PWI) is employed to find an optimal set of parameters for SVM. Thus, the proposed method, named L-SHADE-PWI-SVM, is an integration of machine learning and metaheuristic optimization. For the purpose of training and testing the method, a dataset consisting of 236 samples of soil erosion in Northwest Vietnam is collected with 10 influencing factors. The training set includes 90% of the original dataset; the rest of the dataset is reserved for assessing the generalization capability of the model. The experimental results indicate that the newly developed L-SHADE-PWI-SVM method is a competitive soil erosion predictor with superior performance statistics. Most importantly, L-SHADE-PWI-SVM can achieve a high classification accuracy rate of 92%, which is much better than that of backpropagation artificial neural network (87%) and radial basis function artificial neural network (78%).

Research on Particle Swarm Optimization Least Square Support Vector Machine for Short-Term Wind Speed Prediction

2014 ◽  
Vol 511-512 ◽  
pp. 927-930
Author(s):  
Shuai Zhang ◽  
Hai Rui Wang ◽  
Jin Huang ◽  
He Liu
Keyword(s):  
Support Vector Machine ◽  
Particle Swarm Optimization ◽  
Wind Speed ◽  
Particle Swarm ◽  
Least Square ◽  
Support Vector ◽  
Short Term ◽  
Swarm Optimization ◽  
Wind Speed Prediction ◽  
Speed Prediction

In the paper, the forecast problems of wind speed are considered. In order to enhance the redaction accuracy of the wind speed, this article is about a research on particle swarm optimization least square support vector machine for short-term wind speed prediction (PSO-LS-SVM). Firstly, the prediction models are built by using least square support vector machine based on particle swarm optimization, this model is used to predict the wind speed next 48 hours. In order to further improve the prediction accuracy, on this basis, introduction of the offset optimization method. Finally large amount of experiments and measurement data comparison compensation verify the effectiveness and feasibility of the research on particle swarm optimization least square support vector machine for short-term wind speed prediction, Thereby reducing the short-term wind speed prediction error, very broad application prospects.

Categorizing Natural Language-Based Customer Satisfaction: An Implementation Method Using Support Vector Machine and Long Short-Term Memory Neural Network

2021 ◽  
Vol 13 (4) ◽  
Author(s):  
Ralph Sherwin A. Corpuz ◽  
Keyword(s):  
Neural Network ◽  
Support Vector Machine ◽  
Natural Language ◽  
Text Categorization ◽  
Short Term Memory ◽  
Support Vector ◽  
Feature Engineering ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory

Analyzing natural language-based Customer Satisfaction (CS) is a tedious process. This issue is practically true if one is to manually categorize large datasets. Fortunately, the advent of supervised machine learning techniques has paved the way toward the design of efficient categorization systems used for CS. This paper presents the feasibility of designing a text categorization model using two popular and robust algorithms – the Support Vector Machine (SVM) and Long Short-Term Memory (LSTM) Neural Network, in order to automatically categorize complaints, suggestions, feedbacks, and commendations. The study found that, in terms of training accuracy, SVM has best rating of 98.63% while LSTM has best rating of 99.32%. Such results mean that both SVM and LSTM algorithms are at par with each other in terms of training accuracy, but SVM is significantly faster than LSTM by approximately 35.47s. The training performance results of both algorithms are attributed on the limitations of the dataset size, high-dimensionality of both English and Tagalog languages, and applicability of the feature engineering techniques used. Interestingly, based on the results of actual implementation, both algorithms are found to be 100% effective in accurately predicting the correct CS categories. Hence, the extent of preference between the two algorithms boils down on the available dataset and the skill in optimizing these algorithms through feature engineering techniques and in implementing them toward actual text categorization applications.

Sign in / Sign up

Export Citation Format

Share Document