A New DROS-Extreme Learning Machine With Differential Vector-KPCA Approach for Real-Time Fault Recognition of Nonlinear Processes

2015 ◽  
Vol 137 (5) ◽  
Author(s):  
Yuan Xu ◽  
Liang-Liang Ye ◽  
Qun-Xiong Zhu
Keyword(s):  
Real Time ◽  
Extreme Learning Machine ◽  
Detection Sensitivity ◽  
Fault Recognition ◽  
Differential Operation ◽  
Input Sample ◽  
The Common ◽  
The Difference ◽  
Learning Machine ◽  
Hidden Layer

In this paper, a new dynamic recurrent online sequential-extreme learning machine (DROS-ELM) OS-ELM with differential vector-kernel based principal component analysis (DV-KPCA) fault recognition approach is proposed to reconstruct the process feature and detect the process faults for real-time nonlinear system. Toward this end, the differential vector plus KPCA is first proposed to reduce the dimension of process data and enlarge the feature difference. In DV-KPCA, the differential vector is the difference between the input sample and the common sample, which is obtained from the historical data and represents the common invariant properties of the class. The optimal feature vectors of input sample and the common sample are obtained by KPCA procedure for the difference vectors. Through the differential operation between the input vectors and the common vectors, the reconstructed feature is derived by calculating the two-norm distance for the result of differential operation. The reconstructed features are then utilized to detect the process faults that may occur. In order to enhance the accuracy of fault recognition, a new DROS-ELM is developed by adding a self-feedback unit from the output of hidden layer to the input of hidden layer to record the sequential information. In the DROS-ELM, the output weight of feedback layer is updated dynamically by the change rate of output of the hidden layer. The DV-KPCA for feature reconstruction is exemplified using UCI handwriting (UCI handwriting recognition data: Database, using “Pen-Based Recognition of Handwritten Digits” produced in the Department of Computer Engineering Bogazici University, Istanbul 80815, Turkey, 1998), which the classification accuracy is obviously enhanced. Meanwhile, the DROS-ELM for process prediction is tested by the sunspot data from 1700 to 1987, which also shows better prediction accuracy than common methods. Finally, the new joint DROS-ELM with DV-KPCA method is exemplified in the complicated Tennessee Eastman (TE) benchmark process to illustrate the efficiencies. The results show that the DROS-ELM with DV-KPCA shows superiority not only in detection sensitivity and stability but also in timely fault recognition.

scholarly journals BD-ELM: A Regularized Extreme Learning Machine Using Biased DropConnect and Biased Dropout

2020 ◽  
Vol 2020 ◽  
pp. 1-7
Author(s):  
Jie Lai ◽  
Xiaodan Wang ◽  
Rui Li ◽  
Yafei Song ◽  
Lei Lei
Keyword(s):  
Extreme Learning Machine ◽  
Regularization Method ◽  
Network Performance ◽  
Structural Complexity ◽  
Benchmark Datasets ◽  
Fixed Constant ◽  
The Difference ◽  
Learning Machine ◽  
Hidden Layer ◽  
Hidden Nodes

In order to prevent the overfitting and improve the generalization performance of Extreme Learning Machine (ELM), a new regularization method, Biased DropConnect, and a new regularized ELM using the Biased DropConnect and Biased Dropout (BD-ELM) are both proposed in this paper. Like the Biased Dropout to hidden nodes, the Biased DropConnect can utilize the difference of connection weights to keep more information of network after dropping. The regular Dropout and DropConnect set the connection weights and output of the hidden layer to 0 with a single fixed probability. But the Biased DropConnect and Biased Dropout divide the connection weights and hidden nodes into high and low groups by threshold, and set different groups to 0 with different probabilities. Connection weights with high value and hidden nodes with a high-activated value, which make more contribution to network performance, will be kept by a lower drop probability, while the weights and hidden nodes with a low value will be given a higher drop probability to keep the drop probability of the whole network to a fixed constant. Using Biased DropConnect and Biased Dropout regularization, in BD-ELM, the sparsity of parameters is enhanced and the structural complexity is reduced. Experiments on various benchmark datasets show that Biased DropConnect and Biased Dropout can effectively address the overfitting, and BD-ELM can provide higher classification accuracy than ELM, R-ELM, and Drop-ELM.

A Real-Time Visual Tracking Approach Using Sparse Autoencoder and Extreme Learning Machine

2015 ◽  
Vol 03 (04) ◽  
pp. 267-275
Author(s):  
Liang Dai ◽  
Yuesheng Zhu ◽  
Guibo Luo ◽  
Chao He ◽  
Hanchi Lin
Keyword(s):  
Real Time ◽  
Extreme Learning Machine ◽  
Visual Tracking ◽  
Computational Cost ◽  
Real Time Tracking ◽  
Sparse Autoencoder ◽  
Selection For ◽  
Learning Machine ◽  
Hidden Layer ◽  
Online Process

Visual tracking algorithm based on deep learning is one of the state-of-the-art tracking approaches. However, its computational cost is high. To reduce the computational burden, in this paper, A real-time tracking approach is proposed by using three modules: a single hidden layer neural network based on sparse autoencoder, a feature selection for simplifying the network and an online process based on extreme learning machine. Our experimental results have demonstrated that the proposed algorithm has good performance of robust and real-time.

scholarly journals A Real-Time BOD Estimation Method in Wastewater Treatment Process Based on an Optimized Extreme Learning Machine

2019 ◽  
Author(s):  
Ping Yu ◽  
Jie Cao ◽  
Veeriah Jegatheesan ◽  
Xianjun Du
Keyword(s):  
Wastewater Treatment ◽  
Real Time ◽  
Extreme Learning Machine ◽  
Search Algorithm ◽  
Measurement Data ◽  
Estimation Method ◽  
Cuckoo Search ◽  
Bp Network ◽  
Learning Machine ◽  
Hidden Layer

It is difficult to capture the real-time online measurement data for biochemical oxygen demand (BOD) in wastewater treatment processes. An optimized extreme learning machine (ELM) based on an improved cuckoo search algorithm (ICS) is proposed in this paper for the design of soft BOD measurement model. In ICS-ELM, the input weights matrices of the extreme learning machine (ELM) and the threshold of the hidden layer are encoded as the cuckoo's nest locations. The best input weights matrices and threshold are obtained by using the strong global search ability of improved cuckoo search (ICS) algorithm. The optimal results can be used to improve the precision of forecasting based on less number of neurons of the hidden layer in ELM. Simulation results show that the soft sensor model has good real-time performance, high prediction accuracy and stronger generalization performance for BOD measurement of the effluent quality compared to other modeling methods such as back propagation (BP) network in most cases.

scholarly journals A Real-time BOD Estimation Method in Wastewater Treatment Process Based on an Optimized Extreme Learning Machine

2019 ◽  
Vol 9 (3) ◽  
pp. 523 ◽  
Author(s):  
Ping Yu ◽  
Jie Cao ◽  
Veeriah Jegatheesan ◽  
Xianjun Du
Keyword(s):  
Wastewater Treatment ◽  
Real Time ◽  
Extreme Learning Machine ◽  
Search Algorithm ◽  
Cuckoo Search ◽  
Cuckoo Search Algorithm ◽  
Bp Network ◽  
Learning Machine ◽  
Hidden Layer ◽  
Improved Cuckoo Search Algorithm

It is difficult to capture the real-time online measurement data for biochemical oxygen demand (BOD) in wastewater treatment processes. An optimized extreme learning machine (ELM) based on an improved cuckoo search algorithm (ICS) is proposed in this paper for the design of soft BOD measurement model. In ICS-ELM, the input weights matrices of the extreme learning machine and the threshold of the hidden layer are encoded as the cuckoo's nest locations. The best input weights matrices and threshold are obtained by using the strong global search ability of improved cuckoo search algorithm. The optimal results can be used to improve the precision of forecasting based on less number of neurons of the hidden layer in ELM. Simulation results show that the soft sensor model has good real-time performance, high prediction accuracy, and stronger generalization performance for BOD measurement of the effluent quality compared to other modeling methods such as back propagation (BP) network in most cases.

Negative Correlation Hidden Layer for the Extreme Learning Machine

2021 ◽  
pp. 107482
Author(s):  
Carlos Perales-González ◽  
Francisco Fernández-Navarro ◽  
Javier Pérez-Rodríguez ◽  
Mariano Carbonero-Ruz
Keyword(s):  
Extreme Learning Machine ◽  
Negative Correlation ◽  
Learning Machine ◽  
Hidden Layer

Study on Deep Structure of Extreme Learning Machine (DS-ELM) for Datasets with Noise

2014 ◽  
Vol 989-994 ◽  
pp. 3679-3682 ◽  
Author(s):  
Meng Meng Ma ◽  
Bo He
Keyword(s):  
Extreme Learning Machine ◽  
Simple Structure ◽  
Learning Algorithm ◽  
Deep Structure ◽  
Noisy Data ◽  
Machine Learning Algorithm ◽  
Feed Forward Neural Networks ◽  
Learning Machine ◽  
Hidden Layer ◽  
Auto Associative Neural Network

Extreme learning machine (ELM), a relatively novel machine learning algorithm for single hidden layer feed-forward neural networks (SLFNs), has been shown competitive performance in simple structure and superior training speed. To improve the effectiveness of ELM for dealing with noisy datasets, a deep structure of ELM, short for DS-ELM, is proposed in this paper. DS-ELM contains three level networks (actually contains three nets ): the first level network is trained by auto-associative neural network (AANN) aim to filter out noise as well as reduce dimension when necessary; the second level network is another AANN net aim to fix the input weights and bias of ELM; and the last level network is ELM. Experiments on four noisy datasets are carried out to examine the new proposed DS-ELM algorithm. And the results show that DS-ELM has higher performance than ELM when dealing with noisy data.

Dynamic adjustment of hidden layer structure for convex incremental extreme learning machine

2017 ◽  
Vol 261 ◽  
pp. 83-93 ◽  
Author(s):  
Yongjiao Sun ◽  
Yuangen Chen ◽  
Ye Yuan ◽  
Guoren Wang
Keyword(s):  
Extreme Learning Machine ◽  
Layer Structure ◽  
Dynamic Adjustment ◽  
Learning Machine ◽  
Hidden Layer

HONNs with Extreme Learning Machine to Handle Incomplete Datasets

2013 ◽  
pp. 276-292
Author(s):  
Shuxiang Xu
Keyword(s):  
Neural Networks ◽  
Missing Data ◽  
Extreme Learning Machine ◽  
Real Life ◽  
Bankruptcy Prediction ◽  
Share Prices ◽  
Fast Learning ◽  
Business Cases ◽  
Learning Machine ◽  
Hidden Layer

An Extreme Learning Machine (ELM) randomly chooses hidden neurons and analytically determines the output weights (Huang, et al., 2005, 2006, 2008). With the ELM algorithm, only the connection weights between hidden layer and output layer are adjusted. The ELM algorithm tends to generalize better at a very fast learning speed: it can learn thousands of times faster than conventionally popular learning algorithms (Huang, et al., 2006). Artificial Neural Networks (ANNs) have been widely used as powerful information processing models and adopted in applications such as bankruptcy prediction, predicting costs, forecasting revenue, forecasting share prices and exchange rates, processing documents, and many more. Higher Order Neural Networks (HONNs) are ANNs in which the net input to a computational neuron is a weighted sum of products of its inputs. Real life data are not usually perfect. They contain wrong, incomplete, or vague data. Hence, it is usual to find missing data in many information sources used. Missing data is a common problem in statistical analysis (Little & Rubin, 1987). This chapter uses the Extreme Learning Machine (ELM) algorithm for HONN models and applies it in several significant business cases, which involve missing datasets. The experimental results demonstrate that HONN models with the ELM algorithm offer significant advantages over standard HONN models, such as faster training, as well as improved generalization abilities.

Sign in / Sign up

Export Citation Format

Share Document