An Introduction to Kernel Learning Algorithms

Author(s):  
Peter V. Gehler ◽  
Bernhard Schlkopf
2006 ◽  
Vol 18 (10) ◽  
pp. 2509-2528 ◽  
Author(s):  
Yoshua Bengio ◽  
Martin Monperrus ◽  
Hugo Larochelle

We claim and present arguments to the effect that a large class of manifold learning algorithms that are essentially local and can be framed as kernel learning algorithms will suffer from the curse of dimensionality, at the dimension of the true underlying manifold. This observation invites an exploration of nonlocal manifold learning algorithms that attempt to discover shared structure in the tangent planes at different positions. A training criterion for such an algorithm is proposed, and experiments estimating a tangent plane prediction function are presented, showing its advantages with respect to local manifold learning algorithms: it is able to generalize very far from training data (on learning handwritten character image rotations), where local nonparametric methods fail.


2004 ◽  
Vol 116 (4) ◽  
pp. 2480-2480
Author(s):  
Hassan H. Namarvar ◽  
Theodore W. Berger

Author(s):  
CHONG ZHANG ◽  
CHONG-XUN ZHENG ◽  
MING-PU ZHAO ◽  
XIAO-LIN YU

A new method by combining wavelet packet transform with kernel learning algorithms is proposed to estimate the mental fatigue state in this paper. The first step of this method is to investigate the impact of long term mental arithmetic task on psychology and physiology of subjects by subjective self-reporting measures, action performance test, power spectral indices of HRV and wavelet packet parameters of EEG. The second step is to calculate the wavelet packet features of all EEG data segments, including relative wavelet packet energy parameters in four frequency bands, wavelet packet entropy and three ratio indices. Finally, kernel principal component analysis (KPCA) and support vector machine (SVM) are jointly applied to differentiate two mental fatigue states. The investigation suggests that the joint KPCA-SVM method is able to effectively reduce the dimensionality of the feature vectors, speed up the convergence in the training of SVM and achieve higher classification accuracy (88%) of the mental fatigue state. Hence KPCA-SVM could be a promising model for the estimation of mental fatigue.


2008 ◽  
Vol 53 (12) ◽  
pp. 1835-1847 ◽  
Author(s):  
Chong Zhang ◽  
ChongXun Zheng ◽  
XiaoLin Yu

Sign in / Sign up

Export Citation Format

Share Document