scholarly journals Extreme Learning Machine Based on Firefly Adaptive Flower Pollination Algorithm Optimization

Processes ◽  
2020 ◽  
Vol 8 (12) ◽  
pp. 1583
Author(s):  
Ting Liu ◽  
Qinwei Fan ◽  
Qian Kang ◽  
Lei Niu
Keyword(s):  
Extreme Learning Machine ◽  
Credit Rating ◽  
Nonlinear Function ◽  
Flower Pollination Algorithm ◽  
Algorithm Optimization ◽  
Classification Problems ◽  
Generalization Performance ◽  
Flower Pollination ◽  
Fast Training ◽  
Learning Machine

Extreme learning machine (ELM) has aroused a lot of concern and discussion for its fast training speed and good generalization performance, and it has been used diffusely in both regression and classification problems. However, on account of the randomness of input parameters, it requires more hidden nodes to obtain the desired accuracy. In this paper, we come up with a firefly-based adaptive flower pollination algorithm (FA-FPA) to optimize the input weights and thresholds of the ELM algorithm. Nonlinear function fitting, iris classification and personal credit rating experiments show that the ELM with FA-FPA (FA-FPA-ELM) can obtain significantly better generalization performance (such as root mean square error, classification accuracy) than traditional ELM, ELM with firefly algorithm (FA-ELM), ELM with flower pollination algorithm (FPA-ELM), ELM with genetic algorithm (GA-ELM) and ELM with particle swarm optimization (PSO-ELM) algorithms.

scholarly journals An Extreme Learning Machine Based on Artificial Immune System

2018 ◽  
Vol 2018 ◽  
pp. 1-10 ◽  
Author(s):  
Hui-yuan Tian ◽  
Shi-jian Li ◽  
Tian-qi Wu ◽  
Min Yao
Keyword(s):  
Immune System ◽  
Extreme Learning Machine ◽  
Artificial Immune System ◽  
Superior Performance ◽  
Artificial Immune ◽  
Generalization Performance ◽  
Good Convergence ◽  
Fast Training ◽  
Benchmark Datasets ◽  
Learning Machine

Extreme learning machine algorithm proposed in recent years has been widely used in many fields due to its fast training speed and good generalization performance. Unlike the traditional neural network, the ELM algorithm greatly improves the training speed by randomly generating the relevant parameters of the input layer and the hidden layer. However, due to the randomly generated parameters, some generated “bad” parameters may be introduced to bring negative effect on the final generalization ability. To overcome such drawback, this paper combines the artificial immune system (AIS) with ELM, namely, AIS-ELM. With the help of AIS’s global search and good convergence, the randomly generated parameters of ELM are optimized effectively and efficiently to achieve a better generalization performance. To evaluate the performance of AIS-ELM, this paper compares it with relevant algorithms on several benchmark datasets. The experimental results reveal that our proposed algorithm can always achieve superior performance.

scholarly journals Fault diagnosis of industrial robot reducer by an extreme learning machine with a level-based learning swarm optimizer

2021 ◽  
Vol 13 (5) ◽  
pp. 168781402110195
Author(s):  
Jianwen Guo ◽  
Xiaoyan Li ◽  
Zhenpeng Lao ◽  
Yandong Luo ◽  
Jiapeng Wu ◽  
...  
Keyword(s):  
Fault Diagnosis ◽  
Extreme Learning Machine ◽  
Large Scale ◽  
Production Efficiency ◽  
Industrial Robot ◽  
Optimal Solution ◽  
Industrial Robots ◽  
Generalization Performance ◽  
Gradient Descent Algorithm ◽  
Learning Machine

Fault diagnosis is of great significance to improve the production efficiency and accuracy of industrial robots. Compared with the traditional gradient descent algorithm, the extreme learning machine (ELM) has the advantage of fast computing speed, but the input weights and the hidden node biases that are obtained at random affects the accuracy and generalization performance of ELM. However, the level-based learning swarm optimizer algorithm (LLSO) can quickly and effectively find the global optimal solution of large-scale problems, and can be used to solve the optimal combination of large-scale input weights and hidden biases in ELM. This paper proposes an extreme learning machine with a level-based learning swarm optimizer (LLSO-ELM) for fault diagnosis of industrial robot RV reducer. The model is tested by combining the attitude data of reducer gear under different fault modes. Compared with ELM, the experimental results show that this method has good stability and generalization performance.

scholarly journals A Novel Orthogonal Extreme Learning Machine for Regression and Classification Problems

Symmetry ◽  
2019 ◽  
Vol 11 (10) ◽  
pp. 1284
Author(s):  
Licheng Cui ◽  
Huawei Zhai ◽  
Hongfei Lin
Keyword(s):  
Least Squares ◽  
Extreme Learning Machine ◽  
Weight Matrix ◽  
Testing Time ◽  
Least Squares Regression ◽  
Classification Problems ◽  
Training Time ◽  
Discrimination Ability ◽  
Learning Machine ◽  
Hidden Layer

An extreme learning machine (ELM) is an innovative algorithm for the single hidden layer feed-forward neural networks and, essentially, only exists to find the optimal output weight so as to minimize output error based on the least squares regression from the hidden layer to the output layer. With a focus on the output weight, we introduce the orthogonal constraint into the output weight matrix, and propose a novel orthogonal extreme learning machine (NOELM) based on the idea of optimization column by column whose main characteristic is that the optimization of complex output weight matrix is decomposed into optimizing the single column vector of the matrix. The complex orthogonal procrustes problem is transformed into simple least squares regression with an orthogonal constraint, which can preserve more information from ELM feature space to output subspace, these make NOELM more regression analysis and discrimination ability. Experiments show that NOELM has better performance in training time, testing time and accuracy than ELM and OELM.

scholarly journals Correntropy induced loss based sparse robust graph regularized extreme learning machine for cancer classification

2020 ◽  
Vol 21 (1) ◽  
Author(s):  
Liang-Rui Ren ◽  
Ying-Lian Gao ◽  
Jin-Xing Liu ◽  
Junliang Shang ◽  
Chun-Hou Zheng
Keyword(s):  
Extreme Learning Machine ◽  
High Performance ◽  
Structural Information ◽  
Optimization Method ◽  
Classification Performance ◽  
Weight Matrix ◽  
New Method ◽  
Classification Problems ◽  
Graph Regularization ◽  
Learning Machine

Abstract Background As a machine learning method with high performance and excellent generalization ability, extreme learning machine (ELM) is gaining popularity in various studies. Various ELM-based methods for different fields have been proposed. However, the robustness to noise and outliers is always the main problem affecting the performance of ELM. Results In this paper, an integrated method named correntropy induced loss based sparse robust graph regularized extreme learning machine (CSRGELM) is proposed. The introduction of correntropy induced loss improves the robustness of ELM and weakens the negative effects of noise and outliers. By using the L2,1-norm to constrain the output weight matrix, we tend to obtain a sparse output weight matrix to construct a simpler single hidden layer feedforward neural network model. By introducing the graph regularization to preserve the local structural information of the data, the classification performance of the new method is further improved. Besides, we design an iterative optimization method based on the idea of half quadratic optimization to solve the non-convex problem of CSRGELM. Conclusions The classification results on the benchmark dataset show that CSRGELM can obtain better classification results compared with other methods. More importantly, we also apply the new method to the classification problems of cancer samples and get a good classification effect.

Channel Equalization of MIMO-OFDM System Based on Extreme Learning Machine

2014 ◽  
Vol 536-537 ◽  
pp. 1751-1757
Author(s):  
Ling Yang ◽  
Ming Ming Nie ◽  
Zi Long Zhong ◽  
Bin Bin Xue ◽  
Na Lv
Keyword(s):  
Extreme Learning Machine ◽  
Channel Equalization ◽  
Error Rates ◽  
Rate Performance ◽  
Ofdm System ◽  
Fast Training ◽  
Supervised Learning Algorithms ◽  
Mimo Ofdm ◽  
Feed Forward Neural Networks ◽  
Learning Machine

This paper proposes a novel and efficient method for channel equalization of MIMO-OFDM system. The method utilizes extreme learning machine (ELM), a class of supervised learning algorithms, to achieve fast training and low bit error rates. The numerical simulation results show that the proposed methods significantly outperform traditional feed-forward neural networks based MIMO-OFDM system equalizers in terms of bit error rate performance.

Sign in / Sign up

Export Citation Format

Share Document