scholarly journals Semi-Supervised Generative Adversarial Nets with Multiple Generators for SAR Image Recognition

Sensors ◽  
2018 ◽  
Vol 18 (8) ◽  
pp. 2706 ◽  
Author(s):  
Fei Gao ◽  
Fei Ma ◽  
Jun Wang ◽  
Jinping Sun ◽  
Erfu Yang ◽  
...  
Keyword(s):  
Feature Extraction ◽  
Deep Learning ◽  
Recognition Performance ◽  
Sar Image ◽  
Learning Models ◽  
Sar Images ◽  
Stationary Target ◽  
Optical Images ◽  
Supervised Methods ◽  
The Stability

As an important model of deep learning, semi-supervised learning models are based on Generative Adversarial Nets (GANs) and have achieved a competitive performance on standard optical images. However, the training of GANs becomes unstable when they are applied to SAR images, which reduces the feature extraction capability of the discriminator in GANs. This paper presents a new semi-supervised GANs with Multiple generators and a classifier (MCGAN). This model improves the stability of training for SAR images by employing multiple generators. A multi-classifier is introduced to the new GANs to utilize the labeled images during the training of the GANs, which shares the low level layers with the discriminator. Then, the layers of the trained discriminator and the classifier construct the recognition network for SAR images after having been finely tuned using a small number of the labeled images. Experiments on the Moving and Stationary Target Acquisition and Recognition (MSTAR) databases show that the proposed recognition network achieves a better and more stable recognition performance than several traditional semi-supervised methods as well as other GANs-based semi-supervised methods.

Combination of ELM and BEMD for Target Recognition of SAR Images

2021 ◽  
Vol 30 (13) ◽  
Author(s):  
Zhichao Liu ◽  
Baida Qu
Keyword(s):  
Feature Extraction ◽  
Embedded System ◽  
High Efficiency ◽  
Target Recognition ◽  
Recognition Performance ◽  
Recognition Algorithm ◽  
Operating Conditions ◽  
Intrinsic Mode Functions ◽  
Sar Images ◽  
Stationary Target

For the problem of target recognition of synthetic aperture radar (SAR) images, a method based on the combination of bidimensional empirical mode decomposition (BEMD) and extreme learning machine (ELM) is proposed. BEMD performs feature extraction for SAR images, producing multi-layer bidimensional intrinsic mode functions (BIMF). These BIMFs covey the discrimination of the original target while effectively eliminating the noises. ELM conducts the classification of each BIMF with high efficiency and robustness. Finally, the decisions from different BIMFs are fused using a linear weighting strategy to reach a reliable decision on the target label. The proposed method compensates the relatively low adaptivity of ELM to noise corruption by BEMD feature extraction. Moreover, the multi-layer BIMFs provide more discriminative information for correct decision. Hence, the overall recognition performance can be improved. As an efficient recognition algorithm, the proposed method can be used in an embedded system for wide applications. Experiments are designed and implemented on the moving and stationary target acquisition and recognition (MSTAR) dataset. The proposed method is tested under both the standard operating condition (SOC) and extended operating conditions (EOCs). The results reflect its effectiveness and robustness via quantitative comparisons.

scholarly journals Target Detection Network for SAR Images Based on Semi-Supervised Learning and Attention Mechanism

2021 ◽  
Vol 13 (14) ◽  
pp. 2686
Author(s):  
Di Wei ◽  
Yuang Du ◽  
Lan Du ◽  
Lu Li
Keyword(s):  
Feature Extraction ◽  
Supervised Learning ◽  
Target Detection ◽  
Scene Recognition ◽  
Attention Mechanism ◽  
Sar Image ◽  
Target Level ◽  
Sar Images ◽  
Training Samples ◽  
Pass Through

The existing Synthetic Aperture Radar (SAR) image target detection methods based on convolutional neural networks (CNNs) have achieved remarkable performance, but these methods require a large number of target-level labeled training samples to train the network. Moreover, some clutter is very similar to targets in SAR images with complex scenes, making the target detection task very difficult. Therefore, a SAR target detection network based on a semi-supervised learning and attention mechanism is proposed in this paper. Since the image-level label simply marks whether the image contains the target of interest or not, which is easier to be labeled than the target-level label, the proposed method uses a small number of target-level labeled training samples and a large number of image-level labeled training samples to train the network with a semi-supervised learning algorithm. The proposed network consists of a detection branch and a scene recognition branch with a feature extraction module and an attention module shared between these two branches. The feature extraction module can extract the deep features of the input SAR images, and the attention module can guide the network to focus on the target of interest while suppressing the clutter. During the semi-supervised learning process, the target-level labeled training samples will pass through the detection branch, while the image-level labeled training samples will pass through the scene recognition branch. During the test process, considering the help of global scene information in SAR images for detection, a novel coarse-to-fine detection procedure is proposed. After the coarse scene recognition determining whether the input SAR image contains the target of interest or not, the fine target detection is performed on the image that may contain the target. The experimental results based on the measured SAR dataset demonstrate that the proposed method can achieve better performance than the existing methods.

scholarly journals Unsupervised Multi-Level Feature Extraction for Improvement of Hyperspectral Classification

2021 ◽  
Vol 13 (8) ◽  
pp. 1602
Author(s):  
Qiaoqiao Sun ◽  
Xuefeng Liu ◽  
Salah Bourennane
Keyword(s):  
Feature Extraction ◽  
Deep Learning ◽  
Spatial Information ◽  
Hyperspectral Data ◽  
Great Promise ◽  
Learning Models ◽  
Single Level ◽  
Multiple Networks ◽  
Multi Level ◽  
Hyperspectral Classification

Deep learning models have strong abilities in learning features and they have been successfully applied in hyperspectral images (HSIs). However, the training of most deep learning models requires labeled samples and the collection of labeled samples are labor-consuming in HSI. In addition, single-level features from a single layer are usually considered, which may result in the loss of some important information. Using multiple networks to obtain multi-level features is a solution, but at the cost of longer training time and computational complexity. To solve these problems, a novel unsupervised multi-level feature extraction framework that is based on a three dimensional convolutional autoencoder (3D-CAE) is proposed in this paper. The designed 3D-CAE is stacked by fully 3D convolutional layers and 3D deconvolutional layers, which allows for the spectral-spatial information of targets to be mined simultaneously. Besides, the 3D-CAE can be trained in an unsupervised way without involving labeled samples. Moreover, the multi-level features are directly obtained from the encoded layers with different scales and resolutions, which is more efficient than using multiple networks to get them. The effectiveness of the proposed multi-level features is verified on two hyperspectral data sets. The results demonstrate that the proposed method has great promise in unsupervised feature learning and can help us to further improve the hyperspectral classification when compared with single-level features.

scholarly journals Underwater Target Recognition Based on Multi-Decision LOFAR Spectrum Enhancement: A Deep-Learning Approach

2021 ◽  
Vol 13 (10) ◽  
pp. 265
Author(s):  
Jie Chen ◽  
Bing Han ◽  
Xufeng Ma ◽  
Jian Zhang
Keyword(s):  
Feature Extraction ◽  
Deep Learning ◽  
Recognition Accuracy ◽  
Target Recognition ◽  
Signal To Noise Ratio ◽  
Recognition Performance ◽  
Low Frequency ◽  
Learning Approach ◽  
Decision Algorithm ◽  
Underwater Target

Underwater target recognition is an important supporting technology for the development of marine resources, which is mainly limited by the purity of feature extraction and the universality of recognition schemes. The low-frequency analysis and recording (LOFAR) spectrum is one of the key features of the underwater target, which can be used for feature extraction. However, the complex underwater environment noise and the extremely low signal-to-noise ratio of the target signal lead to breakpoints in the LOFAR spectrum, which seriously hinders the underwater target recognition. To overcome this issue and to further improve the recognition performance, we adopted a deep-learning approach for underwater target recognition, and a novel LOFAR spectrum enhancement (LSE)-based underwater target-recognition scheme was proposed, which consists of preprocessing, offline training, and online testing. In preprocessing, we specifically design a LOFAR spectrum enhancement based on multi-step decision algorithm to recover the breakpoints in LOFAR spectrum. In offline training, the enhanced LOFAR spectrum is adopted as the input of convolutional neural network (CNN) and a LOFAR-based CNN (LOFAR-CNN) for online recognition is developed. Taking advantage of the powerful capability of CNN in feature extraction, the recognition accuracy can be further improved by the proposed LOFAR-CNN. Finally, extensive simulation results demonstrate that the LOFAR-CNN network can achieve a recognition accuracy of 95.22%, which outperforms the state-of-the-art methods.

scholarly journals Research on the Application of Artificial Intelligence Machine Learning Technology in Improving the Accuracy of Engineering Image Processing

2021 ◽  
Vol 2083 (4) ◽  
pp. 042007
Author(s):  
Xiaowen Liu ◽  
Juncheng Lei
Keyword(s):  
Machine Learning ◽  
Feature Extraction ◽  
Deep Learning ◽  
Image Recognition ◽  
Recognition Performance ◽  
Color Space ◽  
Gaussian Model ◽  
Image Feature ◽  
Layer By Layer ◽  
Image Information

Abstract Image recognition technology mainly includes image feature extraction and classification recognition. Feature extraction is the key link, which determines whether the recognition performance is good or bad. Deep learning builds a model by building a hierarchical model structure like the human brain, extracting features layer by layer from the data. Applying deep learning to image recognition can further improve the accuracy of image recognition. Based on the idea of clustering, this article establishes a multi-mix Gaussian model for engineering image information in RGB color space through offline learning and expectation-maximization algorithms, to obtain a multi-mix cluster representation of engineering image information. Then use the sparse Gaussian machine learning model on the YCrCb color space to quickly learn the distribution of engineering images online, and design an engineering image recognizer based on multi-color space information.

scholarly journals Robust Automatic Target Recognition Algorithm for Large-Scene SAR Images and Its Adaptability Analysis on Speckle

2016 ◽  
Vol 2016 ◽  
pp. 1-11 ◽  
Author(s):  
Hongqiao Wang ◽  
Yanning Cai ◽  
Guangyuan Fu ◽  
Shicheng Wang
Keyword(s):  
Target Recognition ◽  
Low Frequency ◽  
Automatic Target Recognition ◽  
Recognition Algorithm ◽  
Scale Transformation ◽  
Sar Image ◽  
Sar Images ◽  
Stationary Target ◽  
Multilevel Sampling ◽  
Process Method

Aiming at the multiple target recognition problems in large-scene SAR image with strong speckle, a robust full-process method from target detection, feature extraction to target recognition is studied in this paper. By introducing a simple 8-neighborhood orthogonal basis, a local multiscale decomposition method from the center of gravity of the target is presented. Using this method, an image can be processed with a multilevel sampling filter and the target’s multiscale features in eight directions and one low frequency filtering feature can be derived directly by the key pixels sampling. At the same time, a recognition algorithm organically integrating the local multiscale features and the multiscale wavelet kernel classifier is studied, which realizes the quick classification with robustness and high accuracy for multiclass image targets. The results of classification and adaptability analysis on speckle show that the robust algorithm is effective not only for the MSTAR (Moving and Stationary Target Automatic Recognition) target chips but also for the automatic target recognition of multiclass/multitarget in large-scene SAR image with strong speckle; meanwhile, the method has good robustness to target’s rotation and scale transformation.

scholarly journals Two-Phase Object-Based Deep Learning for Multi-Temporal SAR Image Change Detection

2020 ◽  
Vol 12 (3) ◽  
pp. 548 ◽  
Author(s):  
Xinzheng Zhang ◽  
Guo Liu ◽  
Ce Zhang ◽  
Peter M. Atkinson ◽  
Xiaoheng Tan ◽  
...  
Keyword(s):  
Deep Learning ◽  
Change Detection ◽  
Speckle Noise ◽  
Sar Image ◽  
Phase Object ◽  
Sar Images ◽  
Two Phase ◽  
Object Based ◽  
Multi Temporal ◽  
Image Change Detection

Change detection is one of the fundamental applications of synthetic aperture radar (SAR) images. However, speckle noise presented in SAR images has a negative effect on change detection, leading to frequent false alarms in the mapping products. In this research, a novel two-phase object-based deep learning approach is proposed for multi-temporal SAR image change detection. Compared with traditional methods, the proposed approach brings two main innovations. One is to classify all pixels into three categories rather than two categories: unchanged pixels, changed pixels caused by strong speckle (false changes), and changed pixels formed by real terrain variation (real changes). The other is to group neighbouring pixels into superpixel objects such as to exploit local spatial context. Two phases are designed in the methodology: (1) Generate objects based on the simple linear iterative clustering (SLIC) algorithm, and discriminate these objects into changed and unchanged classes using fuzzy c-means (FCM) clustering and a deep PCANet. The prediction of this Phase is the set of changed and unchanged superpixels. (2) Deep learning on the pixel sets over the changed superpixels only, obtained in the first phase, to discriminate real changes from false changes. SLIC is employed again to achieve new superpixels in the second phase. Low rank and sparse decomposition are applied to these new superpixels to suppress speckle noise significantly. A further clustering step is applied to these new superpixels via FCM. A new PCANet is then trained to classify two kinds of changed superpixels to achieve the final change maps. Numerical experiments demonstrate that, compared with benchmark methods, the proposed approach can distinguish real changes from false changes effectively with significantly reduced false alarm rates, and achieve up to 99.71% change detection accuracy using multi-temporal SAR imagery.

scholarly journals Product Dictionary Learning-Based SAR Target Configuration Recognition

2020 ◽  
Vol 2020 ◽  
pp. 1-8
Author(s):  
Ming Liu ◽  
Shichao Chen ◽  
Fugang Lu ◽  
Junsheng Liu
Keyword(s):  
Synthetic Aperture Radar ◽  
Sparse Representation ◽  
Dictionary Learning ◽  
Synthetic Aperture ◽  
Sar Image ◽  
Product Model ◽  
Sar Images ◽  
Stationary Target ◽  
Target Configuration ◽  
Key Factor

Dictionary construction is a key factor for the sparse representation- (SR-) based algorithms. It has been verified that the learned dictionaries are more effective than the predefined ones. In this paper, we propose a product dictionary learning (PDL) algorithm to achieve synthetic aperture radar (SAR) target configuration recognition. The proposed algorithm obtains the dictionaries from a statistical standpoint to enhance the robustness of the proposed algorithm to noise. And, taking the inevitable multiplicative speckle in SAR images into account, the proposed algorithm employs the product model to describe SAR images. A more accurate description of the SAR image results in higher recognition rates. The accuracy and robustness of the proposed algorithm are validated by the moving and stationary target acquisition and recognition (MSTAR) database.

scholarly journals Generative Adversarial Networks for Visible to Infrared Video Conversion

2020 ◽  
Author(s):  
Mohammad Shahab Uddin ◽  
Jiang Li
Keyword(s):  
Deep Learning ◽  
Performance Metrics ◽  
Infrared Image ◽  
Image Databases ◽  
Learning Models ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Optical Images ◽  
Infrared Video ◽  
Image Pairs

Deep learning models are data driven. For example, the most popular convolutional neural network (CNN) model used for image classification or object detection requires large labeled databases for training to achieve competitive performances. This requirement is not difficult to be satisfied in the visible domain since there are lots of labeled video and image databases available nowadays. However, given the less popularity of infrared (IR) camera, the availability of labeled infrared videos or image databases is limited. Therefore, training deep learning models in infrared domain is still challenging. In this chapter, we applied the pix2pix generative adversarial network (Pix2Pix GAN) and cycle-consistent GAN (Cycle GAN) models to convert visible videos to infrared videos. The Pix2Pix GAN model requires visible-infrared image pairs for training while the Cycle GAN relaxes this constraint and requires only unpaired images from both domains. We applied the two models to an open-source database where visible and infrared videos provided by the signal multimedia and telecommunications laboratory at the Federal University of Rio de Janeiro. We evaluated conversion results by performance metrics including Inception Score (IS), Frechet Inception Distance (FID) and Kernel Inception Distance (KID). Our experiments suggest that cycle-consistent GAN is more effective than pix2pix GAN for generating IR images from optical images.

scholarly journals Block Sparse Bayesian Learning over Local Dictionary for Robust SAR Target Recognition

2020 ◽  
Vol 2020 ◽  
pp. 1-10 ◽  
Author(s):  
Chenyu Li ◽  
Guohua Liu
Keyword(s):  
Bayesian Learning ◽  
Block Structure ◽  
Target Recognition ◽  
Recognition Performance ◽  
Test Sample ◽  
Synthetic Aperture ◽  
Sparse Bayesian Learning ◽  
Sar Images ◽  
Stationary Target ◽  
Sar Target Recognition

This paper applied block sparse Bayesian learning (BSBL) to synthetic aperture radar (SAR) target recognition. The traditional sparse representation-based classification (SRC) operates on the global dictionary collaborated by different classes. Afterwards, the similarities between the test sample and various classes are evaluated by the reconstruction errors. This paper reconstructs the test sample based on local dictionaries formed by individual classes. Considering the azimuthal sensitivity of SAR images, the linear coefficients on the local dictionary are sparse ones with block structure. Therefore, to solve the sparse coefficients, the BSBL is employed. The proposed method can better exploit the representation capability of each class, thus benefiting the recognition performance. Based on the experimental results on the moving and stationary target acquisition and recognition (MSTAR) dataset, the effectiveness and robustness of the proposed method is confirmed.

Sign in / Sign up

Export Citation Format

Share Document