A Multi-class Classifying Algorithm Based on Nonlinear Dimensionality Reduction and Support Vector Machines

2005 ◽  
pp. 692-695
Author(s):  
Lukui Shi ◽  
Qing Wu ◽  
Xueqin Shen ◽  
Pilian He
Keyword(s):  
Support Vector Machines ◽  
Dimensionality Reduction ◽  
Support Vector ◽  
Nonlinear Dimensionality Reduction ◽  
Vector Machines

scholarly journals Cascade Support Vector Machines with Dimensionality Reduction

2015 ◽  
Vol 2015 ◽  
pp. 1-8 ◽  
Author(s):  
Oliver Kramer
Keyword(s):  
Support Vector Machines ◽  
Dimensionality Reduction ◽  
Principal Component ◽  
Large Data ◽  
Locally Linear Embedding ◽  
Benchmark Problems ◽  
Support Vector ◽  
Training Set ◽  
Support Vectors ◽  
Vector Machines

Cascade support vector machines have been introduced as extension of classic support vector machines that allow a fast training on large data sets. In this work, we combine cascade support vector machines with dimensionality reduction based preprocessing. The cascade principle allows fast learning based on the division of the training set into subsets and the union of cascade learning results based on support vectors in each cascade level. The combination with dimensionality reduction as preprocessing results in a significant speedup, often without loss of classifier accuracies, while considering the high-dimensional pendants of the low-dimensional support vectors in each new cascade level. We analyze and compare various instantiations of dimensionality reduction preprocessing and cascade SVMs with principal component analysis, locally linear embedding, and isometric mapping. The experimental analysis on various artificial and real-world benchmark problems includes various cascade specific parameters like intermediate training set sizes and dimensionalities.

Sign in / Sign up

Export Citation Format

Share Document