scholarly journals A Fault Diagnosis Method for Rolling Bearings Based on Parameter Transfer Learning under Imbalance Data Sets

Energies ◽  
2021 ◽  
Vol 14 (4) ◽  
pp. 944
Author(s):  
Cheng Peng ◽  
Lingling Li ◽  
Qing Chen ◽  
Zhaohui Tang ◽  
Weihua Gui ◽  
...  
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Hot Spot ◽  
Data Sets ◽  
Target Domain ◽  
Rolling Bearings ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Recognition Ability ◽  
Diagnosis Method

Fault diagnosis under the condition of data sets or samples with only a few fault labels has become a hot spot in the field of machinery fault diagnosis. To solve this problem, a fault diagnosis method based on deep transfer learning is proposed. Firstly, the discriminator of the generative adversarial network (GAN) is improved by enhancing its sparsity, and then adopts the adversarial mechanism to continuously optimize the recognition ability of the discriminator; finally, the parameter transfer learning (PTL) method is applied to transfer the trained discriminator to target domain to solve the fault diagnosis problem with only a small number of label samples. Experimental results show that this method has good fault diagnosis performance.

scholarly journals Spacecraft Intelligent Fault Diagnosis under Variable Working Conditions via Wasserstein Distance-Based Deep Adversarial Transfer Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-16
Author(s):  
Gang Xiang ◽  
Kun Tian
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Working Conditions ◽  
Manufacturing Industry ◽  
Probability Distributions ◽  
Wasserstein Distance ◽  
Target Domain ◽  
Target Feature ◽  
Generative Adversarial Network ◽  
Adversarial Network

In recent years, deep learning methods which promote the accuracy and efficiency of fault diagnosis task without any extra requirement of artificial feature extraction have elicited the attention of researchers in the field of manufacturing industry as well as aerospace. However, the problems that data in source and target domains usually have different probability distributions because of different working conditions and there are insufficient labeled or even unlabeled data in target domain significantly deteriorate the performance and generalization of deep fault diagnosis models. To address these problems, we propose a novel Wasserstein Generative Adversarial Network with Gradient Penalty- (WGAN-GP-) based deep adversarial transfer learning (WDATL) model in this study, which exploits a domain critic to learn domain invariant feature representations by minimizing the Wasserstein distance between the source and target feature distributions through adversarial training. Moreover, an improved one-dimensional convolutional neural network- (CNN-) based feature extractor which utilizes exponential linear units (ELU) as activation functions and wide kernels is designed to automatically extract the latent features of raw time-series input data. Then, the fault model classifier trained in one working condition (source domain) with sufficient labeled samples could be generalized to diagnose data in other working conditions (target domain) with insufficient labeled samples. Experiments on two open datasets demonstrate that our proposed WDATL model outperforms most of the state-of-the-art approaches on transfer diagnosis tasks under diverse working circumstances.

Generative Adversarial Network and Transfer Learning Based Fault Detection for Rotating Machinery with Imbalance Data Condition

2021 ◽  
Author(s):  
jun li ◽  
Yongbao Liu ◽  
Qijie Li
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Rolling Bearing ◽  
Rotating Machinery ◽  
Learning Method ◽  
Intelligent Fault Diagnosis ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Proposed Model ◽  
Diagnosis Method

Abstract Intelligent fault diagnosis achieves tremendous success in machine fault diagnosis because of the outstanding data-driven capability. However, the severe imbalanced dataset in practical scenarios of industrial rotating machinery is still a big challenge for the development of intelligent fault diagnosis method. In this paper, we solve this issue by constructing a novel deep learning model incorporated with a transfer learning method based on the Time-GAN and Efficient-Net models. Firstly, the proposed model so called Time-GAN-TL extends the imbalanced fault diagnosis of rolling bearings by using time series generative adversarial network. Secondly, balanced vibration signals are converted into two-dimensional images for training and classification by implementing the Efficient-Net into the transfer learning method. Finally, the proposed method is validated using two-types of rolling bearing experimental data. The high-precision diagnosis results of the transfer learning experiments and the comparison with other representative fault diagnosis classification methods reveal the efficiency, reliability, and generalization performance of the presented model.

scholarly journals A Transfer Deep Generative Adversarial Network Model to Synthetic Brain CT Generation from MR Images

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Yi Gu ◽  
Qiankun Zheng
Keyword(s):  
Transfer Learning ◽  
Network Model ◽  
Medical Images ◽  
Image Method ◽  
Data Sets ◽  
Generation Process ◽  
Image Generation ◽  
Generative Adversarial Network ◽  
Model Based ◽  
Adversarial Network

Background. The generation of medical images is to convert the existing medical images into one or more required medical images to reduce the time required for sample diagnosis and the radiation to the human body from multiple medical images taken. Therefore, the research on the generation of medical images has important clinical significance. At present, there are many methods in this field. For example, in the image generation process based on the fuzzy C-means (FCM) clustering method, due to the unique clustering idea of FCM, the images generated by this method are uncertain of the attribution of certain organizations. This will cause the details of the image to be unclear, and the resulting image quality is not high. With the development of the generative adversarial network (GAN) model, many improved methods based on the deep GAN model were born. Pix2Pix is a GAN model based on UNet. The core idea of this method is to use paired two types of medical images for deep neural network fitting, thereby generating high-quality images. The disadvantage is that the requirements for data are very strict, and the two types of medical images must be paired one by one. DualGAN model is a network model based on transfer learning. The model cuts the 3D image into multiple 2D slices, simulates each slice, and merges the generated results. The disadvantage is that every time an image is generated, bar-shaped “shadows” will be generated in the three-dimensional image. Method/Material. To solve the above problems and ensure the quality of image generation, this paper proposes a Dual3D&PatchGAN model based on transfer learning. Since Dual3D&PatchGAN is set based on transfer learning, there is no need for one-to-one paired data sets, only two types of medical image data sets are needed, which has important practical significance for applications. This model can eliminate the bar-shaped “shadows” produced by DualGAN’s generated images and can also perform two-way conversion of the two types of images. Results. From the multiple evaluation indicators of the experimental results, it can be analyzed that Dual3D&PatchGAN is more suitable for the generation of medical images than other models, and its generation effect is better.

scholarly journals Materials Representation and Transfer Learning for Multi-Property Prediction

2021 ◽  
Author(s):  
Shufeng Kong ◽  
Dan Guevarra ◽  
Carla P. Gomes ◽  
John Gregoire
Keyword(s):  
Machine Learning ◽  
Optical Absorption ◽  
Transfer Learning ◽  
Materials Science ◽  
Training Data ◽  
Target Domain ◽  
Generative Adversarial Network ◽  
Property Prediction ◽  
Adversarial Network ◽  
Correlation Learning

The adoption of machine learning in materials science has rapidly transformed materials property prediction. Hurdles limiting full capitalization of recent advancements in machine learning include the limited development of methods to learn the underlying interactions of multiple elements, as well as the relationships among multiple properties, to facilitate property prediction in new composition spaces. To address these issues, we introduce the Hierarchical Correlation Learning for Multi-property Prediction (H-CLMP) framework that seamlessly integrates (i) prediction using only a material’s composition, (ii) learning and exploitation of correlations among target properties in multitarget regression, and (iii) leveraging training data from tangential domains via generative transfer learning. The model is demonstrated for prediction of spectral optical absorption of complex metal oxides spanning 69 3-cation metal oxide composition spaces. H-CLMP accurately predicts non-linear composition-property relationships in composition spaces for which no training data is available, which broadens the purview of machine learning to the discovery of materials with exceptional properties. This achievement results from the principled integration of latent embedding learning, property correlation learning, generative transfer learning, and attention models. The best performance is obtained using H-CLMP with Transfer learning (H-CLMP(T)) wherein a generative adversarial network is trained on computational density of states data and deployed in the target domain to augment prediction of optical absorption from composition. H-CLMP(T) aggregates multiple knowledge sources with a framework that is well-suited for multi-target regression across the physical sciences.

scholarly journals Materials Representation and Transfer Learning for Multi-Property Prediction

2021 ◽  
Author(s):  
Shufeng Kong ◽  
Dan Guevarra ◽  
Carla P. Gomes ◽  
John Gregoire
Keyword(s):  
Machine Learning ◽  
Optical Absorption ◽  
Transfer Learning ◽  
Materials Science ◽  
Training Data ◽  
Target Domain ◽  
Generative Adversarial Network ◽  
Property Prediction ◽  
Adversarial Network ◽  
Correlation Learning

The adoption of machine learning in materials science has rapidly transformed materials property prediction. Hurdles limiting full capitalization of recent advancements in machine learning include the limited development of methods to learn the underlying interactions of multiple elements, as well as the relationships among multiple properties, to facilitate property prediction in new composition spaces. To address these issues, we introduce the Hierarchical Correlation Learning for Multi-property Prediction (H-CLMP) framework that seamlessly integrates (i) prediction using only a material’s composition, (ii) learning and exploitation of correlations among target properties in multitarget regression, and (iii) leveraging training data from tangential domains via generative transfer learning. The model is demonstrated for prediction of spectral optical absorption of complex metal oxides spanning 69 3-cation metal oxide composition spaces. H-CLMP accurately predicts non-linear composition-property relationships in composition spaces for which no training data is available, which broadens the purview of machine learning to the discovery of materials with exceptional properties. This achievement results from the principled integration of latent embedding learning, property correlation learning, generative transfer learning, and attention models. The best performance is obtained using H-CLMP with Transfer learning (H-CLMP(T)) wherein a generative adversarial network is trained on computational density of states data and deployed in the target domain to augment prediction of optical absorption from composition. H-CLMP(T) aggregates multiple knowledge sources with a framework that is well-suited for multi-target regression across the physical sciences.

scholarly journals Rotating Machinery Fault Diagnosis Method Based on Improved Semisupervised Generative Confrontation Network

2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Lei Wang ◽  
Qian Li ◽  
Jin Qin
Keyword(s):  
Fault Diagnosis ◽  
Fault Detection ◽  
Small Samples ◽  
Data Sets ◽  
Generative Adversarial Network ◽  
Defect Identification ◽  
Data Imbalance ◽  
Adversarial Network ◽  
Local Fisher Discriminant Analysis ◽  
Sample Data

Error diagnosis and detection have become important in modern production due to the importance of spinning equipment. Artificial neural network pattern recognition methods are widely utilized in rotating equipment fault detection. These methods often need a large quantity of sample data to train the model; however, sample data (especially fault samples) are uncommon in engineering. Preliminary work focuses on dimensionality reduction for big data sets using semisupervised methods. The rotary machine’s polar coordinate signal is used to build a GAN network structure. ANN and tiny samples are utilized to identify DCGAN model flaws. The time-conditional generative adversarial network is proposed for one-dimensional vibration signal defect identification under data imbalance. Finally, auxiliary samples are gathered under similar conditions, and CCNs learn about target sample characteristics. Convolutional neural networks handle the problem of defect identification with small samples in different ways. In high-dimensional data sets with nonlinearities, low fault type recognition rates and fewer marked fault samples may be addressed using kernel semisupervised local Fisher discriminant analysis. The SELF method is used to build the optimum projection transformation matrix from the data set. The KNN classifier then learns low-dimensional features and detects an error kind. Because DCGAN training is unstable and the results are incorrect, an improved deep convolutional generative adversarial network (IDCGAN) is proposed. The tests indicate that the IDCGAN generates more real samples and solves the problem of defect identification in small samples. Time-conditional generation adversarial network data improvement lowers fault diagnosis effort and deep learning model complexity. The TCGAN and CNN are combined to provide superior fault detection under data imbalance. Modeling and experiments demonstrate TCGAN’s use and superiority.

scholarly journals Deep transfer learning for rolling bearing fault diagnosis under variable operating conditions

2019 ◽  
Vol 11 (12) ◽  
pp. 168781401989721 ◽  
Author(s):  
Changchang Che ◽  
Huawei Wang ◽  
Qiang Fu ◽  
Xiaomei Ni
Keyword(s):  
Neural Network ◽  
Fault Diagnosis ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Rolling Bearing ◽  
Operating Conditions ◽  
Feature Representation ◽  
Target Domain ◽  
Rolling Bearings ◽  
Variable Operating Conditions

Rolling bearings are the vital components of rotary machines. The collected data of rolling bearing have strong noise interference, massive unlabeled samples, and different fault features. Thus, a deep transfer learning method is proposed for rolling bearings fault diagnosis under variable operating conditions. To obtain robust feature representation, the denoising autoencoder is used to denoise and reduce dimension of unlabeled rolling bearing signals. For those unlabeled target domain signals, a feature matching method based on multi-kernel maximum mean discrepancies between source domain and target domain is adopted to get enough labeled target domain samples. Then, these rolling bearing signals are converted to multi-dimensional graph samples and fed into a convolutional neural network model for fault diagnosis. To improve the generalization of convolutional neural network under variable operating conditions, we combine model-based transfer learning with feature-based transfer learning to initialize and optimize the convolutional neural network parameters. The effectiveness of the proposed method is validated through several comparative experiments of Case Western Reserve University data. The results demonstrate that the proposed method can learn features adaptively from noisy data and increase the accuracy rate by 2%–8% comparing with other models.

Sign in / Sign up

Export Citation Format

Share Document