scholarly journals Parallel Connected Generative Adversarial Network with Quadratic Operation for SAR Image Generation and Application for Classification

Sensors ◽  
2019 ◽  
Vol 19 (4) ◽  
pp. 871 ◽  
Author(s):  
Chu He ◽  
Dehui Xiong ◽  
Qingyi Zhang ◽  
Mingsheng Liao
Keyword(s):  
Image Classification ◽  
Large Scale ◽  
Statistical Characteristics ◽  
Sar Image ◽  
Deep Convolutional Neural Networks ◽  
Sar Images ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Optical Images ◽  
Sar Data

Thanks to the availability of large-scale data, deep Convolutional Neural Networks (CNNs) have witnessed success in various applications of computer vision. However, the performance of CNNs on Synthetic Aperture Radar (SAR) image classification is unsatisfactory due to the lack of well-labeled SAR data, as well as the differences in imaging mechanisms between SAR images and optical images. Therefore, this paper addresses the problem of SAR image classification by employing the Generative Adversarial Network (GAN) to produce more labeled SAR data. We propose special GANs for generating SAR images to be used in the training process. First, we incorporate the quadratic operation into the GAN, extending the convolution to make the discriminator better represent the SAR data; second, the statistical characteristics of SAR images are integrated into the GAN to make its value function more reasonable; finally, two types of parallel connected GANs are designed, one of which we call PWGAN, combining the Deep Convolutional GAN (DCGAN) and Wasserstein GAN with Gradient Penalty (WGAN-GP) together in the structure, and the other, which we call CNN-PGAN, applying a pre-trained CNN as a discriminator to the parallel GAN. Both PWGAN and CNN-PGAN consist of a number of discriminators and generators according to the number of target categories. Experimental results on the TerraSAR-X single polarization dataset demonstrate the effectiveness of the proposed method.

scholarly journals Dialectical GAN for SAR Image Translation: From Sentinel-1 to TerraSAR-X

2018 ◽  
Author(s):  
Dongyang Ao ◽  
Corneliu Octavian Dumitru ◽  
Gottfried Schwarz ◽  
Mihai Datcu
Keyword(s):  
Electromagnetic Spectrum ◽  
Sar Image ◽  
Sar Images ◽  
High Quality ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Optical Images ◽  
Image Translation ◽  
Gram Matrices ◽  
Processing Resources

Contrary to optical images, Synthetic Aperture Radar (SAR) images are in different electromagnetic spectrum where the human visual system is not accustomed to. Thus, with more and more SAR applications, the demand for enhanced high-quality SAR images has increased considerably. However, high-quality SAR images entail high costs due to the limitations of current SAR devices and their image processing resources. To improve the quality of SAR images and to reduce the costs of their generation, we propose a Dialectical Generative Adversarial Network (Dialectical GAN) to generate high-quality SAR images. This method is based on the analysis of hierarchical SAR information and the “dialectical” structure of GAN frameworks.  As a demonstration, a typical example will be shown where a low-resolution SAR image (e.g., a Sentinel-1 image) with large ground coverage is translated into a high-resolution SAR image (e.g., a TerraSAR-X image). Three traditional algorithms are compared, and a new algorithm is proposed based on a network framework by combining conditional WGAN-GP (Wasserstein Generative Adversarial Network - Gradient Penalty) loss functions and Spatial Gram matrices under the rule of dialectics. Experimental results show that the SAR image translation works very well when we compare the results of our proposed method with the selected traditional methods.

scholarly journals Multi-Temporal Sentinel-1 and -2 Data Fusion for Optical Image Simulation

2018 ◽  
Vol 7 (10) ◽  
pp. 389 ◽  
Author(s):  
Wei He ◽  
Naoto Yokoya
Keyword(s):  
Deep Learning ◽  
Large Scale ◽  
Super Resolution ◽  
Optical Image ◽  
Optical Data ◽  
Image Simulation ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Multi Temporal ◽  
Sar Data

In this paper, we present the optical image simulation from synthetic aperture radar (SAR) data using deep learning based methods. Two models, i.e., optical image simulation directly from the SAR data and from multi-temporal SAR-optical data, are proposed to testify the possibilities. The deep learning based methods that we chose to achieve the models are a convolutional neural network (CNN) with a residual architecture and a conditional generative adversarial network (cGAN). We validate our models using the Sentinel-1 and -2 datasets. The experiments demonstrate that the model with multi-temporal SAR-optical data can successfully simulate the optical image; meanwhile, the state-of-the-art model with simple SAR data as input failed. The optical image simulation results indicate the possibility of SAR-optical information blending for the subsequent applications such as large-scale cloud removal, and optical data temporal super-resolution. We also investigate the sensitivity of the proposed models against the training samples, and reveal possible future directions.

scholarly journals Dialectical GAN for SAR Image Translation: From Sentinel-1 to TerraSAR-X

2018 ◽  
Vol 10 (10) ◽  
pp. 1597 ◽  
Author(s):  
Dongyang Ao ◽  
Corneliu Octavian Dumitru ◽  
Gottfried Schwarz ◽  
Mihai Datcu
Keyword(s):  
Sar Image ◽  
Sar Images ◽  
High Quality ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Image Translation ◽  
Gram Matrices ◽  
Processing Resources ◽  
Ground Coverage

With more and more SAR applications, the demand for enhanced high-quality SAR images has increased considerably. However, high-quality SAR images entail high costs, due to the limitations of current SAR devices and their image processing resources. To improve the quality of SAR images and to reduce the costs of their generation, we propose a Dialectical Generative Adversarial Network (Dialectical GAN) to generate high-quality SAR images. This method is based on the analysis of hierarchical SAR information and the “dialectical” structure of GAN frameworks. As a demonstration, a typical example will be shown, where a low-resolution SAR image (e.g., a Sentinel-1 image) with large ground coverage is translated into a high-resolution SAR image (e.g., a TerraSAR-X image). A new algorithm is proposed based on a network framework by combining conditional WGAN-GP (Wasserstein Generative Adversarial Network—Gradient Penalty) loss functions and Spatial Gram matrices under the rule of dialectics. Experimental results show that the SAR image translation works very well when we compare the results of our proposed method with the selected traditional methods.

scholarly journals Polarimetric SAR image classification using 3D generative adversarial network

2021 ◽  
Vol 336 ◽  
pp. 08012
Author(s):  
Lu Liu ◽  
Guobao Feng
Keyword(s):  
Neural Network ◽  
Feature Extraction ◽  
Image Classification ◽  
Three Dimensional ◽  
Data Cube ◽  
Sar Image ◽  
Polarimetric Sar ◽  
Training Problem ◽  
Generative Adversarial Network ◽  
Adversarial Network

In this paper, a new architecture of three-dimensional deep convolutional generative adversarial network(3D-DCGAN) is specially defined to solve the unstable training problem of GAN and make full use of the information involved in polarimetric data. Firstly, a data cube with nine components of polarimetric coherency matrix are directly used as the input features of DCGAN. After that, a 3D convolutional model is designed as the components of generator and discriminator to construct the 3D-DCGAN, which considers the effective feature extraction capability of 3D convolutional neural network(CNN). Finally parameters of the network are fine-tuned to realize the polarimetric SAR image classification. The experiments results show the feasibility and efficiency of the proposed method.

scholarly journals An Imbalanced Image Classification Method for the Cell Cycle Phase

Information ◽  
2021 ◽  
Vol 12 (6) ◽  
pp. 249
Author(s):  
Xin Jin ◽  
Yuanwen Zou ◽  
Zhongbing Huang
Keyword(s):  
Cell Cycle ◽  
Deep Learning ◽  
Image Classification ◽  
Classification Accuracy ◽  
Data Augmentation ◽  
Cycle Phase ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Cellular Life

The cell cycle is an important process in cellular life. In recent years, some image processing methods have been developed to determine the cell cycle stages of individual cells. However, in most of these methods, cells have to be segmented, and their features need to be extracted. During feature extraction, some important information may be lost, resulting in lower classification accuracy. Thus, we used a deep learning method to retain all cell features. In order to solve the problems surrounding insufficient numbers of original images and the imbalanced distribution of original images, we used the Wasserstein generative adversarial network-gradient penalty (WGAN-GP) for data augmentation. At the same time, a residual network (ResNet) was used for image classification. ResNet is one of the most used deep learning classification networks. The classification accuracy of cell cycle images was achieved more effectively with our method, reaching 83.88%. Compared with an accuracy of 79.40% in previous experiments, our accuracy increased by 4.48%. Another dataset was used to verify the effect of our model and, compared with the accuracy from previous results, our accuracy increased by 12.52%. The results showed that our new cell cycle image classification system based on WGAN-GP and ResNet is useful for the classification of imbalanced images. Moreover, our method could potentially solve the low classification accuracy in biomedical images caused by insufficient numbers of original images and the imbalanced distribution of original images.

scholarly journals High-Resolution SAR Image Classification Using Multi-Scale Deep Feature Fusion and Covariance Pooling Manifold Network

2021 ◽  
Vol 13 (2) ◽  
pp. 328
Author(s):  
Wenkai Liang ◽  
Yan Wu ◽  
Ming Li ◽  
Yice Cao ◽  
Xin Hu
Keyword(s):  
High Resolution ◽  
Image Classification ◽  
Feature Fusion ◽  
Representation Learning ◽  
Sar Image ◽  
Gabor Filtering ◽  
Feature Maps ◽  
Sar Images ◽  
Multi Scale ◽  
Deep Feature

The classification of high-resolution (HR) synthetic aperture radar (SAR) images is of great importance for SAR scene interpretation and application. However, the presence of intricate spatial structural patterns and complex statistical nature makes SAR image classification a challenging task, especially in the case of limited labeled SAR data. This paper proposes a novel HR SAR image classification method, using a multi-scale deep feature fusion network and covariance pooling manifold network (MFFN-CPMN). MFFN-CPMN combines the advantages of local spatial features and global statistical properties and considers the multi-feature information fusion of SAR images in representation learning. First, we propose a Gabor-filtering-based multi-scale feature fusion network (MFFN) to capture the spatial pattern and get the discriminative features of SAR images. The MFFN belongs to a deep convolutional neural network (CNN). To make full use of a large amount of unlabeled data, the weights of each layer of MFFN are optimized by unsupervised denoising dual-sparse encoder. Moreover, the feature fusion strategy in MFFN can effectively exploit the complementary information between different levels and different scales. Second, we utilize a covariance pooling manifold network to extract further the global second-order statistics of SAR images over the fusional feature maps. Finally, the obtained covariance descriptor is more distinct for various land covers. Experimental results on four HR SAR images demonstrate the effectiveness of the proposed method and achieve promising results over other related algorithms.

Sign in / Sign up

Export Citation Format

Share Document