scholarly journals Adaptive Weighting Feature Fusion Approach Based on Generative Adversarial Network for Hyperspectral Image Classification

2021 ◽  
Vol 13 (2) ◽  
pp. 198
Author(s):  
Hongbo Liang ◽  
Wenxing Bao ◽  
Xiangfei Shen
Keyword(s):  
Hyperspectral Image ◽  
Feature Fusion ◽  
Classification Performance ◽  
Feature Weighting ◽  
Superior Performance ◽  
Feature Maps ◽  
Generative Adversarial Network ◽  
Research Attention ◽  
Adaptive Weighting ◽  
Adversarial Network

Recently, generative adversarial network (GAN)-based methods for hyperspectral image (HSI) classification have attracted research attention due to their ability to alleviate the challenges brought by having limited labeled samples. However, several studies have demonstrated that existing GAN-based HSI classification methods are limited in redundant spectral knowledge and cannot extract discriminative characteristics, thus affecting classification performance. In addition, GAN-based methods always suffer from the model collapse, which seriously hinders their development. In this study, we proposed a semi-supervised adaptive weighting feature fusion generative adversarial network (AWF2-GAN) to alleviate these problems. We introduced unlabeled data to address the issue of having a small number of samples. First, to build valid spectral–spatial feature engineering, the discriminator learns both the dense global spectrum and neighboring separable spatial context via well-designed extractors. Second, a lightweight adaptive feature weighting component is proposed for feature fusion; it considers four predictive fusion options, that is, adding or concatenating feature maps with similar or adaptive weights. Finally, for the mode collapse, the proposed AWF2-GAN combines supervised central loss and unsupervised mean minimization loss for optimization. Quantitative results on two HSI datasets show that our AWF2-GAN achieves superior performance over state-of-the-art GAN-based methods.

scholarly journals Wavelet Feature Outdoor Fingerprint Localization Based on ResNet and Deep Convolution GAN

Symmetry ◽  
2020 ◽  
Vol 12 (9) ◽  
pp. 1565
Author(s):  
Yingke Lei ◽  
Da Li ◽  
Haichuan Zhang ◽  
Xin Li
Keyword(s):  
Reference Points ◽  
Location Based Services ◽  
Positioning System ◽  
Feature Maps ◽  
Generative Adversarial Network ◽  
Lte Networks ◽  
Research Attention ◽  
Adversarial Network ◽  
Significant Research ◽  
Fingerprint Database

Due to the explosive development of location-based services (LBS), localization has attracted significant research attention over the past decade. Among the associated techniques, wireless fingerprint positioning has garnered much interest due to its compatibility with existing hardware. At present, with the widespread deployment of long-term evolution (LTE) networks and the uniqueness of wireless information fingerprints, fingerprint positioning based on LTE networks is the mainstream method for outdoor positioning. However, in order to improve its accuracy, this method needs to collect enough data at a large number of reference points, which is a labor-intensive task. In this paper, experimental data are collected at different reference points and then converted into wavelet feature maps. Then, a Deep Convolutional Generative Adversarial Network (DCGAN) is leveraged to generate a symmetric fingerprint database. Localization is then carried out by the proposed Deep Residual Network (Resnet), which is capable of learning reliable features from a fingerprint image database. To further increase the robustness of the positioning system, a variety of data enhancement methods are used. Finally, we experimentally demonstrate that the generated symmetric fingerprint database and proposed Resnet reduce the manpower required for fingerprint database collection and improve the accuracy of the outdoor positioning system.

scholarly journals Variational Generative Adversarial Network with Crossed Spatial and Spectral Interactions for Hyperspectral Image Classification

2021 ◽  
Vol 13 (16) ◽  
pp. 3131
Author(s):  
Zhongwei Li ◽  
Xue Zhu ◽  
Ziqi Xin ◽  
Fangming Guo ◽  
Xingshuai Cui ◽  
...  
Keyword(s):  
Image Classification ◽  
Spatial Information ◽  
Hyperspectral Image ◽  
Classification Performance ◽  
Generative Adversarial Networks ◽  
Hyperspectral Image Classification ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Spatial Features ◽  
Virtual Samples

Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) have been widely used in hyperspectral image classification (HSIC) tasks. However, the generated HSI virtual samples by VAEs are often ambiguous, and GANs are prone to the mode collapse, which lead the poor generalization abilities ultimately. Moreover, most of these models only consider the extraction of spectral or spatial features. They fail to combine the two branches interactively and ignore the correlation between them. Consequently, the variational generative adversarial network with crossed spatial and spectral interactions (CSSVGAN) was proposed in this paper, which includes a dual-branch variational Encoder to map spectral and spatial information to different latent spaces, a crossed interactive Generator to improve the quality of generated virtual samples, and a Discriminator stuck with a classifier to enhance the classification performance. Combining these three subnetworks, the proposed CSSVGAN achieves excellent classification by ensuring the diversity and interacting spectral and spatial features in a crossed manner. The superior experimental results on three datasets verify the effectiveness of this method.

scholarly journals Classification of Space Objects by Using Deep Learning with Micro-Doppler Signature Images

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4365
Author(s):  
Kwangyong Jung ◽  
Jae-In Lee ◽  
Nammoon Kim ◽  
Sunjin Oh ◽  
Dong-Wook Seo
Keyword(s):  
Transfer Learning ◽  
Data Augmentation ◽  
Doppler Frequency ◽  
Extraction Methods ◽  
Classification Performance ◽  
Reconstruction Method ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Space Objects ◽  
Target Characteristics

Radar target classification is an important task in the missile defense system. State-of-the-art studies using micro-doppler frequency have been conducted to classify the space object targets. However, existing studies rely highly on feature extraction methods. Therefore, the generalization performance of the classifier is limited and there is room for improvement. Recently, to improve the classification performance, the popular approaches are to build a convolutional neural network (CNN) architecture with the help of transfer learning and use the generative adversarial network (GAN) to increase the training datasets. However, these methods still have drawbacks. First, they use only one feature to train the network. Therefore, the existing methods cannot guarantee that the classifier learns more robust target characteristics. Second, it is difficult to obtain large amounts of data that accurately mimic real-world target features by performing data augmentation via GAN instead of simulation. To mitigate the above problem, we propose a transfer learning-based parallel network with the spectrogram and the cadence velocity diagram (CVD) as the inputs. In addition, we obtain an EM simulation-based dataset. The radar-received signal is simulated according to a variety of dynamics using the concept of shooting and bouncing rays with relative aspect angles rather than the scattering center reconstruction method. Our proposed model is evaluated on our generated dataset. The proposed method achieved about 0.01 to 0.39% higher accuracy than the pre-trained networks with a single input feature.

scholarly journals Deep Spectral Spatial Inverted Residual Network for Hyperspectral Image Classification

2021 ◽  
Vol 13 (21) ◽  
pp. 4472
Author(s):  
Tianyu Zhang ◽  
Cuiping Shi ◽  
Diling Liao ◽  
Liguo Wang
Keyword(s):  
Image Classification ◽  
Data Augmentation ◽  
Hyperspectral Image ◽  
Classification Performance ◽  
Hyperspectral Data ◽  
Hyperspectral Images ◽  
Hyperspectral Image Classification ◽  
Feature Maps ◽  
Spatial Feature ◽  
Global Context

Convolutional neural networks (CNNs) have been widely used in hyperspectral image classification in recent years. The training of CNNs relies on a large amount of labeled sample data. However, the number of labeled samples of hyperspectral data is relatively small. Moreover, for hyperspectral images, fully extracting spectral and spatial feature information is the key to achieve high classification performance. To solve the above issues, a deep spectral spatial inverted residuals network (DSSIRNet) is proposed. In this network, a data block random erasing strategy is introduced to alleviate the problem of limited labeled samples by data augmentation of small spatial blocks. In addition, a deep inverted residuals (DIR) module for spectral spatial feature extraction is proposed, which locks the effective features of each layer while avoiding network degradation. Furthermore, a global 3D attention module is proposed, which can realize the fine extraction of spectral and spatial global context information under the condition of the same number of input and output feature maps. Experiments are carried out on four commonly used hyperspectral datasets. A large number of experimental results show that compared with some state-of-the-art classification methods, the proposed method can provide higher classification accuracy for hyperspectral images.

An enhanced OCT image captioning system to assist ophthalmologists in detecting and classifying eye diseases

2020 ◽  
Vol 28 (5) ◽  
pp. 975-988
Author(s):  
Sivamurugan Vellakani ◽  
Indumathi Pushbam
Keyword(s):  
Short Term Memory ◽  
Clinical Decision ◽  
True Positive Rate ◽  
Eye Diseases ◽  
Age Related Macular Degeneration ◽  
Superior Performance ◽  
Image Captioning ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Age Related

Human eye is affected by the different eye diseases including choroidal neovascularization (CNV), diabetic macular edema (DME) and age-related macular degeneration (AMD). This work aims to design an artificial intelligence (AI) based clinical decision support system for eye disease detection and classification to assist the ophthalmologists more effectively detecting and classifying CNV, DME and drusen by using the Optical Coherence Tomography (OCT) images depicting different tissues. The methodology used for designing this system involves different deep learning convolutional neural network (CNN) models and long short-term memory networks (LSTM). The best image captioning model is selected after performance analysis by comparing nine different image captioning systems for assisting ophthalmologists to detect and classify eye diseases. The quantitative data analysis results obtained for the image captioning models designed using DenseNet201 with LSTM have superior performance in terms of overall accuracy of 0.969, positive predictive value of 0.972 and true-positive rate of 0.969using OCT images enhanced by the generative adversarial network (GAN). The corresponding performance values for the Xception with LSTM image captioning models are 0.969, 0.969 and 0.938, respectively. Thus, these two models yield superior performance and have potential to assist ophthalmologists in making optimal diagnostic decision.

scholarly journals Mixed 2D/3D Convolutional Network for Hyperspectral Image Super-Resolution

2020 ◽  
Vol 12 (10) ◽  
pp. 1660 ◽  
Author(s):  
Qiang Li ◽  
Qi Wang ◽  
Xuelong Li
Keyword(s):  
Spatial Information ◽  
Hyperspectral Image ◽  
Feature Fusion ◽  
Super Resolution ◽  
Superior Performance ◽  
Spectral Information ◽  
Great Success ◽  
Convolutional Network ◽  
Training Time ◽  
Image Super Resolution

Deep learning-based hyperspectral image super-resolution (SR) methods have achieved great success recently. However, there are two main problems in the previous works. One is to use the typical three-dimensional convolution analysis, resulting in more parameters of the network. The other is not to pay more attention to the mining of hyperspectral image spatial information, when the spectral information can be extracted. To address these issues, in this paper, we propose a mixed convolutional network (MCNet) for hyperspectral image super-resolution. We design a novel mixed convolutional module (MCM) to extract the potential features by 2D/3D convolution instead of one convolution, which enables the network to more mine spatial features of hyperspectral image. To explore the effective features from 2D unit, we design the local feature fusion to adaptively analyze from all the hierarchical features in 2D units. In 3D unit, we employ spatial and spectral separable 3D convolution to extract spatial and spectral information, which reduces unaffordable memory usage and training time. Extensive evaluations and comparisons on three benchmark datasets demonstrate that the proposed approach achieves superior performance in comparison to existing state-of-the-art methods.

Sign in / Sign up

Export Citation Format

Share Document