scholarly journals Imbalanced Fault Diagnosis of Rotating Machinery Based on Deep Generative Adversarial Networks with Gradient Penalty

Processes ◽  
2021 ◽  
Vol 9 (10) ◽  
pp. 1751
Author(s):  
Junqi Luo ◽  
Liucun Zhu ◽  
Quanfang Li ◽  
Daopeng Liu ◽  
Mingyou Chen
Keyword(s):  
Neural Network ◽  
Fault Diagnosis ◽  
Rotating Machinery ◽  
Generative Adversarial Networks ◽  
Support Vector ◽  
Generative Adversarial Network ◽  
Data Set ◽  
Combination Methods ◽  
Generation Network ◽  
Noise Factors

In practical industrial application, the fault samples collected from rotating machinery are frequently unbalanced, which will create difficulties when it comes to diagnosis. Besides, the variation of working conditions and noise factors will further reduce the diagnosis’s accuracy and stability. Considering the above problems, we established a model based on deep Wasserstein generative adversarial network with gradient penalty (DWGANGP). In this model, the unbalanced fault data set will first be trained by the sample generation network to generate synthetic samples, which will be used to restore the balance. A one-dimensional convolutional neural network with a specific structure is then used as the fault diagnosis network to classify the reconstructed equilibrium samples. The experimental results show that the proposed sample generation network can generate high-quality synthetic samples under highly imbalanced data, and the diagnostic network has a fast training convergence. Compared to the combination methods of support vector machines, back propagation neural network and deep belief network, our method has a 74% average accuracy in all unbalanced experimental conditions, which has 64%, 69% and 87% averages leading, respectively.

scholarly journals Application of Deep Learning in Fault Diagnosis of Rotating Machinery

Processes ◽  
2021 ◽  
Vol 9 (6) ◽  
pp. 919
Author(s):  
Wanlu Jiang ◽  
Chenyang Wang ◽  
Jiayun Zou ◽  
Shuqing Zhang
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Fault Diagnosis ◽  
Rotating Machinery ◽  
Generative Adversarial Networks ◽  
Extraction Ability ◽  
One Dimensional ◽  
Adversarial Networks ◽  
Diagnosis Model ◽  
The One

The field of mechanical fault diagnosis has entered the era of “big data”. However, existing diagnostic algorithms, relying on artificial feature extraction and expert knowledge are of poor extraction ability and lack self-adaptability in the mass data. In the fault diagnosis of rotating machinery, due to the accidental occurrence of equipment faults, the proportion of fault samples is small, the samples are imbalanced, and available data are scarce, which leads to the low accuracy rate of the intelligent diagnosis model trained to identify the equipment state. To solve the above problems, an end-to-end diagnosis model is first proposed, which is an intelligent fault diagnosis method based on one-dimensional convolutional neural network (1D-CNN). That is to say, the original vibration signal is directly input into the model for identification. After that, through combining the convolutional neural network with the generative adversarial networks, a data expansion method based on the one-dimensional deep convolutional generative adversarial networks (1D-DCGAN) is constructed to generate small sample size fault samples and construct the balanced data set. Meanwhile, in order to solve the problem that the network is difficult to optimize, gradient penalty and Wasserstein distance are introduced. Through the test of bearing database and hydraulic pump, it shows that the one-dimensional convolution operation has strong feature extraction ability for vibration signals. The proposed method is very accurate for fault diagnosis of the two kinds of equipment, and high-quality expansion of the original data can be achieved.

scholarly journals Rotating Machinery Fault Diagnosis for Imbalanced Data Based on Fast Clustering Algorithm and Support Vector Machine

2017 ◽  
Vol 2017 ◽  
pp. 1-15 ◽  
Author(s):  
Xiaochen Zhang ◽  
Dongxiang Jiang ◽  
Te Han ◽  
Nanfei Wang ◽  
Wenguang Yang ◽  
...  
Keyword(s):  
Support Vector Machine ◽  
Fault Diagnosis ◽  
Clustering Algorithm ◽  
Imbalanced Data ◽  
Principal Component ◽  
Rotating Machinery ◽  
Support Vector ◽  
Data Set ◽  
Diagnosis Model ◽  
Sample Set

To diagnose rotating machinery fault for imbalanced data, a method based on fast clustering algorithm (FCA) and support vector machine (SVM) was proposed. Combined with variational mode decomposition (VMD) and principal component analysis (PCA), sensitive features of the rotating machinery fault were obtained and constituted the imbalanced fault sample set. Next, a fast clustering algorithm was adopted to reduce the number of the majority data from the imbalanced fault sample set. Consequently, the balanced fault sample set consisted of the clustered data and the minority data from the imbalanced fault sample set. After that, SVM was trained with the balanced fault sample set and tested with the imbalanced fault sample set so the fault diagnosis model of the rotating machinery could be obtained. Finally, the gearbox fault data set and the rolling bearing fault data set were adopted to test the fault diagnosis model. The experimental results showed that the fault diagnosis model could effectively diagnose the rotating machinery fault for imbalanced data.

scholarly journals Fault Diagnosis of Rotating Machinery Based on Convolutional Neural Network and Singular Value Decomposition

2020 ◽  
Vol 2020 ◽  
pp. 1-13
Author(s):  
Dong Liu ◽  
Xu Lai ◽  
Zhihuai Xiao ◽  
Dong Liu ◽  
Xiao Hu ◽  
...  
Keyword(s):  
Neural Network ◽  
Fault Diagnosis ◽  
Singular Value Decomposition ◽  
Convolutional Neural Network ◽  
Rotating Machinery ◽  
Singular Value ◽  
Support Vector ◽  
Discrete Wavelet ◽  
Comparison Results ◽  
Value Decomposition

Vibration signal and shaft orbit are important features that reflect the operating state of rotating machinery. Fault diagnosis and feature extraction are critical to ensure the safety and reliable operation of rotating machinery. A novel method of fault diagnosis based on convolutional neural network (CNN), discrete wavelet transform (DWT), and singular value decomposition (SVD) is proposed in this paper. CNN is used to extract features of shaft orbit images, DWT is used to transform the denoised swing signal of rotating machinery, and the wavelet decomposition coefficients of each branch of the signal are obtained by the transformation. The SVD input matrix is formed after single branch reconstruction of the different branch coefficients, and the singular value is extracted to obtain the feature vector. The features extracted from both methods are combined and then classified by support vector machines (SVMs). The comparison results show that this hybrid method has a higher recognition rate than other methods.

scholarly journals A Refined Composite Multivariate Multiscale Fluctuation Dispersion Entropy and Its Application to Multivariate Signal of Rotating Machinery

Entropy ◽  
2021 ◽  
Vol 23 (1) ◽  
pp. 128
Author(s):  
Chenbo Xi ◽  
Guangyou Yang ◽  
Lang Liu ◽  
Hongyuan Jiang ◽  
Xuehai Chen
Keyword(s):  
Fault Diagnosis ◽  
Single Channel ◽  
Vibration Signal ◽  
Rotating Machinery ◽  
Support Vector ◽  
Data Set ◽  
Rotary Machine ◽  
Gear Fault ◽  
Diagnosis Method ◽  
Low Sensitivity

In the fault monitoring of rotating machinery, the vibration signal of the bearing and gear in a complex operating environment has poor stationarity and high noise. How to accurately and efficiently identify various fault categories is a major challenge in rotary fault diagnosis. Most of the existing methods only analyze the single channel vibration signal and do not comprehensively consider the multi-channel vibration signal. Therefore, this paper presents Refined Composite Multivariate Multiscale Fluctuation Dispersion Entropy (RCMMFDE), a method which extracts the recognition information of multi-channel signals with different scale factors, and the refined composite analysis ensures the recognition stability. The simulation results show that this method has the characteristics of low sensitivity to signal length and strong anti-noise ability. At the same time, combined with Joint Mutual Information Maximisation (JMIM) and support vector machine (SVM), RCMMFDE-JMIM-SVM fault diagnosis method has been proposed. This method uses RCMMFDE to extract the state characteristics of the multiple vibration signals of the rotary machine, and then uses the JMIM method to extract the sensitive characteristics. Finally, different states of the rotary machine are classified by SVM. The validity of the method is verified by the composite gear fault data set and bearing fault data set. The diagnostic accuracy of the method is 99.25% and 100.00%. The experimental results show that RCMMFDE-JMIM-SVM can effectively recognize multiple signals.

scholarly journals Speech Emotion Recognition using Data Augmentation Method by Cycle-Generative Adversarial Networks

2021 ◽  
Author(s):  
Arash Shilandari ◽  
Hossein Marvi ◽  
Hossein Khosravi
Keyword(s):  
Neural Network ◽  
Emotion Recognition ◽  
Speech Processing ◽  
Data Augmentation ◽  
Generative Adversarial Networks ◽  
Speech Emotion Recognition ◽  
Support Vector ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Adversarial Networks

Nowadays, and with the mechanization of life, speech processing has become so crucial for the interaction between humans and machines. Deep neural networks require a database with enough data for training. The more features are extracted from the speech signal, the more samples are needed to train these networks. Adequate training of these networks can be ensured when there is access to sufficient and varied data in each class. If there is not enough data; it is possible to use data augmentation methods to obtain a database with enough samples. One of the obstacles to developing speech emotion recognition systems is the Data sparsity problem in each class for neural network training. The current study has focused on making a cycle generative adversarial network for data augmentation in a system for speech emotion recognition. For each of the five emotions employed, an adversarial generating network is designed to generate data that is very similar to the main data in that class, as well as differentiate the emotions of the other classes. These networks are taught in an adversarial way to produce feature vectors like each class in the space of the main feature, and then they add to the training sets existing in the database to train the classifier network. Instead of using the common cross-entropy error to train generative adversarial networks and to remove the vanishing gradient problem, Wasserstein Divergence has been used to produce high-quality artificial samples. The suggested network has been tested to be applied for speech emotion recognition using EMODB as training, testing, and evaluating sets, and the quality of artificial data evaluated using two Support Vector Machine (SVM) and Deep Neural Network (DNN) classifiers. Moreover, it has been revealed that extracting and reproducing high-level features from acoustic features, speech emotion recognition with separating five primary emotions has been done with acceptable accuracy.

scholarly journals A Novel Deep Learning Method for Intelligent Fault Diagnosis of Rotating Machinery Based on Improved CNN-SVM and Multichannel Data Fusion

Sensors ◽  
2019 ◽  
Vol 19 (7) ◽  
pp. 1693 ◽  
Author(s):  
Gong ◽  
Chen ◽  
Zhang ◽  
Zhang ◽  
Wang ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Fault Diagnosis ◽  
Convolutional Neural Network ◽  
Back Propagation ◽  
Rotating Machinery ◽  
Fault Classification ◽  
Support Vector ◽  
Intelligent Fault Diagnosis ◽  
K Nearest Neighbor

Intelligent fault diagnosis methods based on deep learning becomes a research hotspot in the fault diagnosis field. Automatically and accurately identifying the incipient micro-fault of rotating machinery, especially for fault orientations and severity degree, is still a major challenge in the field of intelligent fault diagnosis. The traditional fault diagnosis methods rely on the manual feature extraction of engineers with prior knowledge. To effectively identify an incipient fault in rotating machinery, this paper proposes a novel method, namely improved the convolutional neural network-support vector machine (CNN-SVM) method. This method improves the traditional convolutional neural network (CNN) model structure by introducing the global average pooling technology and SVM. Firstly, the temporal and spatial multichannel raw data from multiple sensors is directly input into the improved CNN-Softmax model for the training of the CNN model. Secondly, the improved CNN are used for extracting representative features from the raw fault data. Finally, the extracted sparse representative feature vectors are input into SVM for fault classification. The proposed method is applied to the diagnosis multichannel vibration signal monitoring data of a rolling bearing. The results confirm that the proposed method is more effective than other existing intelligence diagnosis methods including SVM, K-nearest neighbor, back-propagation neural network, deep BP neural network, and traditional CNN.

scholarly journals Generating Scenery Images with Larger Variety According to User Descriptions

2021 ◽  
Vol 11 (21) ◽  
pp. 10224
Author(s):  
Hsu-Yung Cheng ◽  
Chih-Chang Yu
Keyword(s):  
Neural Network ◽  
Data Augmentation ◽  
Memory Cell ◽  
Generative Adversarial Networks ◽  
Image Generation ◽  
Generative Adversarial Network ◽  
Data Set ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Hidden Layer

In this paper, a framework based on generative adversarial networks is proposed to perform nature-scenery generation according to descriptions from the users. The desired place, time and seasons of the generated scenes can be specified with the help of text-to-image generation techniques. The framework improves and modifies the architecture of a generative adversarial network with attention models by adding the imagination models. The proposed attentional and imaginative generative network uses the hidden layer information to initialize the memory cell of the recurrent neural network to produce the desired photos. A data set containing different categories of scenery images is established to train the proposed system. The experiments validate that the proposed method is able to increase the quality and diversity of the generated images compared to the existing method. A possible application of road image generation for data augmentation is also demonstrated in the experimental results.

scholarly journals Adversarial Sample Detection with Gaussian Mixture Conditional Generative Adversarial Networks

2021 ◽  
Vol 2021 ◽  
pp. 1-18
Author(s):  
Pengfei Zhang ◽  
Xiaoming Ju
Keyword(s):  
Neural Network ◽  
Gaussian Mixture ◽  
Physical World ◽  
Training Data ◽  
Generative Adversarial Networks ◽  
Support Vector ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Testing Stage

It is important to detect adversarial samples in the physical world that are far away from the training data distribution. Some adversarial samples can make a machine learning model generate a highly overconfident distribution in the testing stage. Thus, we proposed a mechanism for detecting adversarial samples based on semisupervised generative adversarial networks (GANs) with an encoder-decoder structure; this mechanism can be applied to any pretrained neural network without changing the network’s structure. The semisupervised GANs also give us insight into the behavior of adversarial samples and their flow through the layers of a deep neural network. In the supervised scenario, the latent feature of the semisupervised GAN and the target network’s logit information are used as the input of the external classifier support vector machine to detect the adversarial samples. In the unsupervised scenario, first, we proposed a one-class classier based on the semisupervised Gaussian mixture conditional generative adversarial network (GM-CGAN) to fit the joint feature information of the normal data, and then, we used a discriminator network to detect normal data and adversarial samples. In both supervised scenarios and unsupervised scenarios, experimental results show that our method outperforms latest methods.

scholarly journals Audio-Based Drone Detection and Identification Using Deep Learning Techniques with Dataset Enhancement through Generative Adversarial Networks

Sensors ◽  
2021 ◽  
Vol 21 (15) ◽  
pp. 4953
Author(s):  
Sara Al-Emadi ◽  
Abdulla Al-Ali ◽  
Abdulaziz Al-Ali
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Recurrent Neural Network ◽  
Learning Algorithms ◽  
Generative Adversarial Networks ◽  
Generative Adversarial Network ◽  
Adversarial Networks ◽  
Detection And Identification ◽  
Learning Techniques ◽  
The Impact

Drones are becoming increasingly popular not only for recreational purposes but in day-to-day applications in engineering, medicine, logistics, security and others. In addition to their useful applications, an alarming concern in regard to the physical infrastructure security, safety and privacy has arisen due to the potential of their use in malicious activities. To address this problem, we propose a novel solution that automates the drone detection and identification processes using a drone’s acoustic features with different deep learning algorithms. However, the lack of acoustic drone datasets hinders the ability to implement an effective solution. In this paper, we aim to fill this gap by introducing a hybrid drone acoustic dataset composed of recorded drone audio clips and artificially generated drone audio samples using a state-of-the-art deep learning technique known as the Generative Adversarial Network. Furthermore, we examine the effectiveness of using drone audio with different deep learning algorithms, namely, the Convolutional Neural Network, the Recurrent Neural Network and the Convolutional Recurrent Neural Network in drone detection and identification. Moreover, we investigate the impact of our proposed hybrid dataset in drone detection. Our findings prove the advantage of using deep learning techniques for drone detection and identification while confirming our hypothesis on the benefits of using the Generative Adversarial Networks to generate real-like drone audio clips with an aim of enhancing the detection of new and unfamiliar drones.

Sign in / Sign up

Export Citation Format

Share Document