scholarly journals A Data-Independent Genetic Algorithm Framework for Fault-Type Classification and Remaining Useful Life Prediction

2020 ◽  
Vol 10 (1) ◽  
pp. 368 ◽  
Author(s):  
Hung-Cuong Trinh ◽  
Yung-Keun Kwon
Keyword(s):  
Machine Learning ◽  
Prediction Models ◽  
Remaining Useful Life ◽  
Fault Type ◽  
Benchmark Datasets ◽  
Useful Life ◽  
Machinery Diagnostics ◽  
Parameter Values ◽  
Prediction Problems ◽  
Type Classification

Machinery diagnostics and prognostics usually involve the prediction process of fault-types and remaining useful life (RUL) of a machine, respectively. The process of developing a data-driven diagnostics and prognostics method involves some fundamental subtasks such as data rebalancing, feature extraction, dimension reduction, and machine learning. In general, the best performing algorithm and the optimal hyper-parameters suitable for each subtask are varied across the characteristics of datasets. Therefore, it is challenging to develop a general diagnostic/prognostic framework that can automatically identify the best subtask algorithms and the optimal involved parameters for a given dataset. To resolve this problem, we propose a new framework based on an ensemble of genetic algorithms (GAs) that can be used for both the fault-type classification and RUL prediction. Our GA is combined with a specific machine-learning method and then tries to select the best algorithm and optimize the involved parameter values in each subtask. In addition, our method constructs an ensemble of various prediction models found by the GAs. Our method was compared to a traditional grid-search over three benchmark datasets of the fault-type classification and the RUL prediction problems and showed a significantly better performance than the latter. Taken together, our framework can be an effective approach for the fault-type and RUL prediction of various machinery systems.

scholarly journals A Genetic Algorithm Optimized RNN-LSTM Model for Remaining Useful Life Prediction of Turbofan Engine

Electronics ◽  
2021 ◽  
Vol 10 (3) ◽  
pp. 285
Author(s):  
Kwok Tai Chui ◽  
Brij B. Gupta ◽  
Pandian Vasant
Keyword(s):  
Genetic Algorithm ◽  
Feature Extraction ◽  
Prediction Model ◽  
Prediction Models ◽  
Remaining Useful Life ◽  
Prediction Algorithm ◽  
Short Term ◽  
Turbofan Engine ◽  
Term Prediction ◽  
Useful Life

Understanding the remaining useful life (RUL) of equipment is crucial for optimal predictive maintenance (PdM). This addresses the issues of equipment downtime and unnecessary maintenance checks in run-to-failure maintenance and preventive maintenance. Both feature extraction and prediction algorithm have played crucial roles on the performance of RUL prediction models. A benchmark dataset, namely Turbofan Engine Degradation Simulation Dataset, was selected for performance analysis and evaluation. The proposal of the combination of complete ensemble empirical mode decomposition and wavelet packet transform for feature extraction could reduce the average root-mean-square error (RMSE) by 5.14–27.15% compared with six approaches. When it comes to the prediction algorithm, the results of the RUL prediction model could be that the equipment needs to be repaired or replaced within a shorter or a longer period of time. Incorporating this characteristic could enhance the performance of the RUL prediction model. In this paper, we have proposed the RUL prediction algorithm in combination with recurrent neural network (RNN) and long short-term memory (LSTM). The former takes the advantages of short-term prediction whereas the latter manages better in long-term prediction. The weights to combine RNN and LSTM were designed by non-dominated sorting genetic algorithm II (NSGA-II). It achieved average RMSE of 17.2. It improved the RMSE by 6.07–14.72% compared with baseline models, stand-alone RNN, and stand-alone LSTM. Compared with existing works, the RMSE improvement by proposed work is 12.95–39.32%.

scholarly journals A Hybrid Prognostics Deep Learning Model for Remaining Useful Life Prediction

Electronics ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. 39
Author(s):  
Zhiyuan Xie ◽  
Shichang Du ◽  
Jun Lv ◽  
Yafei Deng ◽  
Shiyao Jia
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Learning Model ◽  
Recurrent Network ◽  
Remaining Useful Life ◽  
Support Vector ◽  
Second Phase ◽  
Learning Methods ◽  
Useful Life ◽  
Deep Learning Model

Remaining Useful Life (RUL) prediction is significant in indicating the health status of the sophisticated equipment, and it requires historical data because of its complexity. The number and complexity of such environmental parameters as vibration and temperature can cause non-linear states of data, making prediction tremendously difficult. Conventional machine learning models such as support vector machine (SVM), random forest, and back propagation neural network (BPNN), however, have limited capacity to predict accurately. In this paper, a two-phase deep-learning-model attention-convolutional forget-gate recurrent network (AM-ConvFGRNET) for RUL prediction is proposed. The first phase, forget-gate convolutional recurrent network (ConvFGRNET) is proposed based on a one-dimensional analog long short-term memory (LSTM), which removes all the gates except the forget gate and uses chrono-initialized biases. The second phase is the attention mechanism, which ensures the model to extract more specific features for generating an output, compensating the drawbacks of the FGRNET that it is a black box model and improving the interpretability. The performance and effectiveness of AM-ConvFGRNET for RUL prediction is validated by comparing it with other machine learning methods and deep learning methods on the Commercial Modular Aero-Propulsion System Simulation (C-MAPSS) dataset and a dataset of ball screw experiment.

scholarly journals An Empirical Investigation on a Multiple Filters-Based Approach for Remaining Useful Life Prediction

Machines ◽  
2018 ◽  
Vol 6 (3) ◽  
pp. 35 ◽  
Author(s):  
Hung-Cuong Trinh ◽  
Yung-Keun Kwon
Keyword(s):  
Scoring Function ◽  
Principal Component ◽  
Remaining Useful Life ◽  
Filter Method ◽  
Feature Construction ◽  
Training Set ◽  
Robust Solution ◽  
Benchmark Datasets ◽  
Useful Life ◽  
Better Than

Feature construction is critical in data-driven remaining useful life (RUL) prediction of machinery systems, and most previous studies have attempted to find a best single-filter method. However, there is no best single filter that is appropriate for all machinery systems. In this work, we devise a straightforward but efficient approach for RUL prediction by combining multiple filters and then reducing the dimension through principal component analysis. We apply multilayer perceptron and random forest methods to learn the underlying model. We compare our approach with traditional single-filtering approaches using two benchmark datasets. The former approach is significantly better than the latter in terms of a scoring function with a penalty for late prediction. In particular, we note that selecting a best single filter over the training set is not efficient because of overfitting. Taken together, we validate that our multiple filters-based approach can be a robust solution for RUL prediction of various machinery systems.

scholarly journals Transfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life Estimation

2018 ◽  
Vol 8 (12) ◽  
pp. 2416 ◽  
Author(s):  
Ansi Zhang ◽  
Honglei Wang ◽  
Shaobo Li ◽  
Yuxin Cui ◽  
Zhonghao Liu ◽  
...  
Keyword(s):  
Neural Networks ◽  
Transfer Learning ◽  
Recurrent Neural Networks ◽  
Prediction Models ◽  
Learning Algorithm ◽  
Remaining Useful Life ◽  
Operating Conditions ◽  
Training Data ◽  
Good Prediction ◽  
Useful Life

Prognostics, such as remaining useful life (RUL) prediction, is a crucial task in condition-based maintenance. A major challenge in data-driven prognostics is the difficulty of obtaining a sufficient number of samples of failure progression. However, for traditional machine learning methods and deep neural networks, enough training data is a prerequisite to train good prediction models. In this work, we proposed a transfer learning algorithm based on Bi-directional Long Short-Term Memory (BLSTM) recurrent neural networks for RUL estimation, in which the models can be first trained on different but related datasets and then fine-tuned by the target dataset. Extensive experimental results show that transfer learning can in general improve the prediction models on the dataset with a small number of samples. There is one exception that when transferring from multi-type operating conditions to single operating conditions, transfer learning led to a worse result.

scholarly journals Development of a Novel Methodology for Remaining Useful Life Prediction of Industrial Slurry Pumps in the Absence of Run to Failure Data

Sensors ◽  
2021 ◽  
Vol 21 (24) ◽  
pp. 8420
Author(s):  
Muhammad Mohsin Khan ◽  
Peter W. Tse ◽  
Amy J.C. Trappey
Keyword(s):  
Life Prediction ◽  
Prediction Models ◽  
Remaining Useful Life ◽  
Condition Based Maintenance ◽  
Vibration Signals ◽  
The Core ◽  
Failure Data ◽  
Periodic Maintenance ◽  
Useful Life ◽  
Nonlinear Autoregressive

Smart remaining useful life (RUL) prognosis methods for condition-based maintenance (CBM) of engineering equipment are getting high popularity nowadays. Current RUL prediction models in the literature are developed with an ideal database, i.e., a combination of a huge “run to failure” and “run to prior failure” data. However, in real-world, run to failure data for rotary machines is difficult to exist since periodic maintenance is continuously practiced to the running machines in industry, to save any production downtime. In such a situation, the maintenance staff only have run to prior failure data of an in operation machine for implementing CBM. In this study, a unique strategy for the RUL prediction of two identical and in-process slurry pumps, having only real-time run to prior failure data, is proposed. The obtained vibration signals from slurry pumps were utilized for generating degradation trends while a hybrid nonlinear autoregressive (NAR)-LSTM-BiLSTM model was developed for RUL prediction. The core of the developed strategy was the usage of the NAR prediction results as the “path to be followed” for the designed LSTM-BiLSTM model. The proposed methodology was also applied on publically available NASA’s C-MAPSS dataset for validating its applicability, and in return, satisfactory results were achieved.

scholarly journals Investigation of reliability assessement in power electronics circuits using machine learning

2021 ◽  
Vol 12 (1) ◽  
pp. 558
Author(s):  
Soumya Rani Mestha ◽  
Pinto Pius A.J
Keyword(s):  
Machine Learning ◽  
Power Electronics ◽  
New Technologies ◽  
Remaining Useful Life ◽  
Power Electronic ◽  
Electronic Components ◽  
Recent Advances ◽  
Useful Life ◽  
Comprehensive Study

<p>Recent advances in power electronics (PE) and machine learning (ML) have prompted the technologists to adapt these new technologies to improve the reliability of PE systems. During the process, a lot of investigations on the performance and reliability of PE systems is carried out. The intention of this paper is to present a comprehensive study of advances in the field of reliability of PE systems using machine learning. Recent publications in this regard are analysed and findings are tabulated. In addition to this, literatures published in the prediction of remaining useful life (RUL) of power electronic components is discussed with emphasis on its limitations.</p>

scholarly journals Remaining Useful Life Estimation of Bearings

2021 ◽  
Vol 11 (2) ◽  
Author(s):  
Hugo M. Ferreira ◽  
Alexandre C. De Sousa
Keyword(s):  
Best Practices ◽  
Model Evaluation ◽  
Prediction Models ◽  
Meta Analysis ◽  
Remaining Useful Life ◽  
Experimental Methodology ◽  
Data Set ◽  
Life Estimation ◽  
Problem Class ◽  
Useful Life

In the domain of predictive maintenance, when trying to repli- cate and compare research in remaining useful life estimation (RUL), several inconsistencies and errors were identified in the experimental methodology used by various researchers. This makes the replication and the comparison of results diffi- cult, thus severely hindering both progress in this research do- main and its practical application to industry. We survey the literature to evaluate the experimental procedures that were used, and identify the most common errors and omission in both experimental procedures and reporting. A total of 70 papers on RUL were audited. From this meta- analysis we estimate that approximately 11% of the papers present work that will allow for replication and comparison. Surprisingly, only about 24.3% (17 of the 70 articles) com- pared their results with previous work. Of the remaining work, 41.4% generated and compared several models of their own and, somewhat unsettling, 31.4% of the researchers made no comparison whatsoever. The remaining 2.9% did not use the same data set for comparisons. The results of this study were also aggregated into 3 categories: problem class selec- tion, model fitting best practices and evaluation best practices. We conclude that model evaluation is the most problematic one. The main contribution of the article is a proposal of an ex- perimental protocol and several recommendations that specif- ically target model evaluation. Adherence to this protocol should substantially facilitate the research and application of RUL prediction models. The goals are to promote the collab- oration between scholars and practitioners alike and advance the research in this domain.

scholarly journals Quantitative Toxicity Prediction via Ensembling of Heterogeneous Predictors

2019 ◽  
Author(s):  
Abdul Karim ◽  
Vahid Riahi ◽  
Avinash Mishra ◽  
Abdollah Dehzangi ◽  
M. A. Hakim Newton ◽  
...  
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Prediction Models ◽  
Individual Performance ◽  
Learning Model ◽  
Data Representation ◽  
Toxicity Prediction ◽  
Machine Learning Model ◽  
Machine Learning Approach ◽  
Benchmark Datasets

Abstract Representing molecules in the form of only one type of features and using those features to predict their activities is one of the most important approaches for machine-learning-based chemical-activity-prediction. For molecular activities like quantitative toxicity prediction, the performance depends on the type of features extracted and the machine learning approach used. For such cases, using one type of features and machine learning model restricts the prediction performance to specific representation and model used. In this paper, we study quantitative toxicity prediction and propose a machine learning model for the same. Our model uses an ensemble of heterogeneous predictors instead of typically using homogeneous predictors. The predictors that we use vary either on the type of features used or on the deep learning architecture employed. Each of these predictors presumably has its own strengths and weaknesses in terms of toxicity prediction. Our motivation is to make a combined model that utilizes different types of features and architectures to obtain better collective performance that could go beyond the performance of each individual predictor. We use six predictors in our model and test the model on four standard quantitative toxicity benchmark datasets. Experimental results show that our model outperforms the state-of-the-art toxicity prediction models in 8 out of 12 accuracy measures. Our experiments show that ensembling heterogeneous predictor improves the performance over single predictors and homogeneous ensembling of single predictors.The results show that each data representation or deep learning based predictor has its own strengths and weaknesses, thus employing a model ensembling multiple heterogeneous predictors could go beyond individual performance of each data representation or each predictor type.

Sign in / Sign up

Export Citation Format

Share Document