scholarly journals An Optimal SVM with Feature Selection Using Multiobjective PSO

2016 ◽  
Vol 2016 ◽  
pp. 1-8 ◽  
Author(s):  
Iman Behravan ◽  
Oveis Dehghantanha ◽  
Seyed Hamid Zahiri ◽  
Nasser Mehrshad
Keyword(s):  
Kernel Function ◽  
Optimization Problem ◽  
Recognition Score ◽  
Computational Time ◽  
Support Vector ◽  
Feature Subset ◽  
Risk Minimization ◽  
Minimization Principle ◽  
Penalty Factor ◽  
Mlp Neural Networks

Support vector machine is a classifier, based on the structured risk minimization principle. The performance of the SVM depends on different parameters such as penalty factor, C, and the kernel factor, σ. Also choosing an appropriate kernel function can improve the recognition score and lower the amount of computation. Furthermore, selecting the useful features among several features in dataset not only increases the performance of the SVM, but also reduces the computational time and complexity. So this is an optimization problem which can be solved by heuristic algorithm. In some cases besides the recognition score, the reliability of the classifier’s output is important. So in such cases a multiobjective optimization algorithm is needed. In this paper we have got the MOPSO algorithm to optimize the parameters of the SVM, choose appropriate kernel function, and select the best feature subset simultaneously in order to optimize the recognition score and the reliability of the SVM concurrently. Nine different datasets, from UCI machine learning repository, are used to evaluate the power and the effectiveness of the proposed method (MOPSO-SVM). The results of the proposed method are compared to those which are achieved by single SVM, RBF, and MLP neural networks.

Passenger Flow Forecast of Urban Rail Transit Based on Support Vector Regression

2013 ◽  
Vol 433-435 ◽  
pp. 612-616 ◽  
Author(s):  
Bin Xia ◽  
Fan Yu Kong ◽  
Song Yuan Xie
Keyword(s):  
Support Vector Regression ◽  
Risk Function ◽  
Urban Rail Transit ◽  
Support Vector ◽  
Rail Transit ◽  
Risk Minimization ◽  
Promising Alternative ◽  
Minimization Principle ◽  
Passenger Flow ◽  
Urban Rail

This study analyses and compares several forecast methods of urban rail transit passenger flow, and indicates the necessity of forecasting short-term passenger flow. Support vector regression is a promising method for the forecast of passenger flow because it uses a risk function consisting of the empirical error and a regularized term which is based on the structural risk minimization principle. In this paper, the prediction model of urban rail transit passenger flow is constructed. Through the comparison with BP neural networks forecast methods, the experimental results show that applying this method in URT passenger flow forecasting is feasible and it provides a promising alternative to passenger flow prediction.

Application of Genetic Arithmetic and Support Vector Machine in Prediction of Compression Index of Clay

2013 ◽  
Vol 438-439 ◽  
pp. 1167-1170
Author(s):  
Xu Chao Shi ◽  
Ying Fei Gao
Keyword(s):  
Support Vector Machine ◽  
Influence Factors ◽  
Support Vector ◽  
Compression Index ◽  
Risk Minimization ◽  
Minimization Principle ◽  
Structural Risk Minimization Principle ◽  
Svm Model ◽  
Genetic Arithmetic ◽  
Practical Tool

The compression index is an important soil property that is essential to many geotechnical designs. As the determination of the compression index from consolidation tests is relatively time-consuming. Support Vector Machine (SVM) is a statistical learning theory based on a structural risk minimization principle that minimizes both error and weight terms. Considering the fact that parameters in SVM model are difficult to be decided, a genetic SVM was presented in which the parameters in SVM method are optimized by Genetic Algorithm (GA). Taking plasticity index, water content, void ration and density of soil as primary influence factors, the prediction model of compression index based on GA-SVM approach was obtained. The results of this study showed that the GA-SVM approach has the potential to be a practical tool for predicting compression index of soil.

Modeling river stage–discharge–sediment rating relation using support vector regression

2012 ◽  
Vol 43 (6) ◽  
pp. 851-861 ◽  
Author(s):  
Sharad K. Jain
Keyword(s):  
Support Vector Regression ◽  
Sediment Concentration ◽  
Support Vector ◽  
Learning Approaches ◽  
Risk Minimization ◽  
Minimization Principle ◽  
River Stage ◽  
Structural Risk Minimization Principle ◽  
Structural Risk ◽  
Regression Problems

A variety of data-driven approaches have been developed in the recent past to capture the properties of hydrological data for improved modeling. These include artificial neural networks (ANNs), fuzzy logic and evolutionary algorithms, amongst others. Of late, kernel-based machine learning approaches have become popular due to their inherent advantages over traditional modeling techniques. In this work, support vector machines (SVMs), a kernel-based learning approach, has been investigated for its suitability to model the relationship between the river stage, discharge, and sediment concentration. SVMs are an approximate implementation of the structural risk minimization principle that aims at minimizing a bound on the generalization error of a model. These have been found to be promising in many areas including hydrology. Application of SVMs to regression problems is known as support vector regression (SVR). This paper presents an application of SVR to model river discharge and sediment concentration rating relation. The results obtained using SVR were compared with those from ANNs and it was found that the SVR approach is better when compared with ANNs.

Support Vector Machine Ensemble Based on Choquet Integral for Financial Distress Prediction

2015 ◽  
Vol 29 (04) ◽  
pp. 1550016 ◽  
Author(s):  
Xihua Li ◽  
Fuqiang Wang ◽  
Xiaohong Chen
Keyword(s):  
Support Vector Machine ◽  
Financial Distress ◽  
Choquet Integral ◽  
Radical Change ◽  
Ensemble Method ◽  
Support Vector ◽  
Risk Minimization ◽  
Minimization Principle ◽  
Financial Distress Prediction ◽  
Distress Prediction

Due to the radical change in both Chinese and global economic environment, it is essential to develop a practical model to predict financial distress. The support vector machine (SVM), a new outstanding learning machine based on the statistical learning theory, embodying the principle of structural risk minimization instead of empirical risk minimization principle, is a promising method for such financial distress prediction. However, to some extent, the performance of single classifier depends on the sample's pattern characteristics and each single classifier has its own uncertainty. Using the ensemble methods to predict financial distress becomes a rising trend in this field. This research puts forward a SVM ensemble based on the Choquet integral for financial distress prediction in which Bagging algorithm is used to generate new training sets. The proposed ensemble method can be expressed as "Choquet + Bagging + SVMs". With real data from Chinese listed companies, an experiment is carried out to compare the performance of single classifiers with the proposed ensemble method. Empirical results indicate that the proposed ensemble of SVMs based on the Choquet integral for financial distress prediction has higher average accuracy and stability than single SVM classifiers.

Modelling Concrete Strength Using Support Vector Machines

2013 ◽  
Vol 438-439 ◽  
pp. 170-173 ◽  
Author(s):  
Hai Ying Yang ◽  
Yi Feng Dong
Keyword(s):  
Compressive Strength ◽  
Support Vector Machines ◽  
Concrete Strength ◽  
Support Vector ◽  
Generalized Regression Neural Network ◽  
Data Sets ◽  
Risk Minimization ◽  
Minimization Principle ◽  
Vector Machines ◽  
Compressive Strength Of Concrete

Support vector machine (SVM) is a statistical learning theory based on a structural risk minimization principle that minimizes both error and weight terms. A SVM model is presented to predict compressive strength of concrete at 28 days in this paper. A total of 20 data sets were used to train, whereas the remaining 10 data sets were used to test the created model. Radial basis function based on support vector machines was used to model the compressive strength and results were compared with a generalized regression neural network approach. The results of this study showed that the SVM approach has the potential to be a practical tool for predicting compressive strength of concrete at 28 days.

scholarly journals An Extreme Learning Machine Based on the Mixed Kernel Function of Triangular Kernel and Generalized Hermite Dirichlet Kernel

2016 ◽  
Vol 2016 ◽  
pp. 1-11
Author(s):  
Senyue Zhang ◽  
Wenan Tan
Keyword(s):  
Extreme Learning Machine ◽  
Kernel Function ◽  
Binary Classification ◽  
Dirichlet Kernel ◽  
Computational Time ◽  
Support Vector ◽  
Structure Information ◽  
Kernel Parameter ◽  
Hermitian Kernel ◽  
Learning Machine

According to the characteristics that the kernel function of extreme learning machine (ELM) and its performance have a strong correlation, a novel extreme learning machine based on a generalized triangle Hermitian kernel function was proposed in this paper. First, the generalized triangle Hermitian kernel function was constructed by using the product of triangular kernel and generalized Hermite Dirichlet kernel, and the proposed kernel function was proved as a valid kernel function of extreme learning machine. Then, the learning methodology of the extreme learning machine based on the proposed kernel function was presented. The biggest advantage of the proposed kernel is its kernel parameter values only chosen in the natural numbers, which thus can greatly shorten the computational time of parameter optimization and retain more of its sample data structure information. Experiments were performed on a number of binary classification, multiclassification, and regression datasets from the UCI benchmark repository. The experiment results demonstrated that the robustness and generalization performance of the proposed method are outperformed compared to other extreme learning machines with different kernels. Furthermore, the learning speed of proposed method is faster than support vector machine (SVM) methods.

Support Vector Machine and its Application Status

2014 ◽  
Vol 1030-1032 ◽  
pp. 1814-1817
Author(s):  
Lan Lan Kang ◽  
Wen Liang Cao
Keyword(s):  
Support Vector Machine ◽  
Small Error ◽  
Support Vector ◽  
Risk Minimization ◽  
Minimization Principle ◽  
Training Samples ◽  
Testing Error ◽  
Machine Theory ◽  
Learning Machine ◽  
Limited Training Samples

Support vector machine is a beginning of the 1990s, based on statistical learning theory proposed new machine learning method, which structural risk minimization principle as the theoretical basis, by appropriately selecting a subset of functions and discriminant function in the subset, so the actual risk of learning machine to a minimum, to ensure that the limited training samples obtained through a small error classifier, an independent test set for testing error remains small. In this paper, support vector machine theory, algorithm, application status, etc. are discussed in detail.

scholarly journals Bearing Fault Diagnosis Using a Support Vector Machine Optimized by an Improved Ant Lion Optimizer

2019 ◽  
Vol 2019 ◽  
pp. 1-20 ◽  
Author(s):  
Dalian Yang ◽  
Jingjing Miao ◽  
Fanyu Zhang ◽  
Jie Tao ◽  
Guangbin Wang ◽  
...  
Keyword(s):  
Support Vector Machine ◽  
Kernel Function ◽  
Gaussian Kernel ◽  
Support Vector ◽  
Model Parameters ◽  
Bearing Faults ◽  
Ring Fault ◽  
Penalty Factor ◽  
Kernel Parameter ◽  
Svm Model

Bearing is an important mechanical component that easily fails in a bad working environment. Support vector machines can be used to diagnose bearing faults; however, the recognition ability of the model is greatly affected by the kernel function and its parameters. Unfortunately, optimal parameters are difficult to select. To address these limitations, an escape mechanism and adaptive convergence conditions were introduced to the ALO algorithm. As a result, the EALO method was proposed and has been applied to the more accurate selection of SVM model parameters. To assess the model, the vibration acceleration signals of normal, inner ring fault, outer ring fault, and ball fault bearings were collected at different rotation speeds (1500 r/min, 1800 r/min, 2100 r/min, and 2400 r/min). The vibration signals were decomposed using the variational mode decomposition (VMD) method. The features were extracted through the kernel function to fuse the energy value of each VMD component. In these experiments, the two most important parameters for the support vector machine—the Gaussian kernel parameter σ and the penalty factor C—were optimized using the EALO algorithm, ALO algorithm, genetic algorithm (GA), and particle swarm optimization (PSO) algorithm. The performance of these four methods to optimize the two parameters was then compared and analyzed, with the EALO method having the best performance. The recognition rates for bearing faults under different tested rotation speeds were improved when the SVM model parameters optimized by the EALO were used.

HYBRID OF GENETIC ALGORITHM AND SIMULATED ANNEALING FOR SUPPORT VECTOR REGRESSION OPTIMIZATION IN RAINFALL FORECASTING

2013 ◽  
Vol 12 (02) ◽  
pp. 1350012 ◽  
Author(s):  
CHANGMING ZHU ◽  
JIANSHENG WU
Keyword(s):  
Genetic Algorithm ◽  
Kernel Function ◽  
Subset Selection ◽  
Feature Subset Selection ◽  
Support Vector ◽  
Feature Subset ◽  
Parameter Setting ◽  
Rainfall Forecasting ◽  
Input Feature ◽  
Kernel Parameter

Accurate forecasting of rainfall has been one of the most important issues in hydrological research such as river training works and design of flood warning systems. Support vector regression (SVR) is a popular regression method in rainfall forecasting. Type of kernel function and kernel parameter setting in the SVR traing procedure, along with the input feature subset selection, significantly influence regression accuracy. In this paper, an effective hybrid optimization strategy by combining the strengths of genetic algorithm (GA) and simulated annealing (SA), is employed to simultaneously optimize the input feature subset selection, the type of kernel function and the kernel parameter setting of SVR, namely GASA–SVR. The developed GASA–SVR model is being applied for monthly rainfall forecasting in Guilin of Guangxi. The GA is carried out as a main frame of this hybrid algorithm while SA is used as a local search strategy to help GA jump out of local optima and avoid sinking into the local optimal solution early. Compared with SVR, pure GA–SVR and HGA–SVR, results show that the hybrid GASA–SVR model can correctly select the discriminating input features subset, successfully identify the optimal type of kernel function and all the optimal values of the parameters of SVR with the lowest prediction error values in rainfall forecasting, can also significantly improve the rainfall forecasting accuracy. Experimental results reveal that the predictions using the proposed approach are consistently better than those obtained using the other methods presented in this study in terms of the same measurements. Those results show that the proposed GASA–SVR model provides a promising alternative to monthly rainfall prediction.

Sign in / Sign up

Export Citation Format

Share Document