scholarly journals Dual-Window Superpixel Data Augmentation for Hyperspectral Image Classification

2020 ◽  
Vol 10 (24) ◽  
pp. 8833
Author(s):  
Álvaro Acción ◽  
Francisco Argüello ◽  
Dora B. Heras
Keyword(s):  
Classification Accuracy ◽  
Classification Scheme ◽  
Data Augmentation ◽  
Hyperspectral Image ◽  
Classification Model ◽  
Hyperspectral Image Classification ◽  
Augmentation Techniques ◽  
Simple Linear Iterative Clustering ◽  
Classification Tasks ◽  
Dual Window

Deep learning (DL) has been shown to obtain superior results for classification tasks in the field of remote sensing hyperspectral imaging. Superpixel-based techniques can be applied to DL, significantly decreasing training and prediction times, but the results are usually far from satisfactory due to overfitting. Data augmentation techniques alleviate the problem by synthetically generating new samples from an existing dataset in order to improve the generalization capabilities of the classification model. In this paper we propose a novel data augmentation framework in the context of superpixel-based DL called dual-window superpixel (DWS). With DWS, data augmentation is performed over patches centered on the superpixels obtained by the application of simple linear iterative clustering (SLIC) superpixel segmentation. DWS is based on dividing the input patches extracted from the superpixels into two regions and independently applying transformations over them. As a result, four different data augmentation techniques are proposed that can be applied to a superpixel-based CNN classification scheme. An extensive comparison in terms of classification accuracy with other data augmentation techniques from the literature using two datasets is also shown. One of the datasets consists of small hyperspectral small scenes commonly found in the literature. The other consists of large multispectral vegetation scenes of river basins. The experimental results show that the proposed approach increases the overall classification accuracy for the selected datasets. In particular, two of the data augmentation techniques introduced, namely, dual-flip and dual-rotate, obtained the best results.

scholarly journals Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism

2021 ◽  
Vol 13 (3) ◽  
pp. 335
Author(s):  
Yuhao Qing ◽  
Wenyi Liu
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Classification Accuracy ◽  
Hyperspectral Image ◽  
Principal Component ◽  
Hyperspectral Image Classification ◽  
Deep Network ◽  
Multi Scale

In recent years, image classification on hyperspectral imagery utilizing deep learning algorithms has attained good results. Thus, spurred by that finding and to further improve the deep learning classification accuracy, we propose a multi-scale residual convolutional neural network model fused with an efficient channel attention network (MRA-NET) that is appropriate for hyperspectral image classification. The suggested technique comprises a multi-staged architecture, where initially the spectral information of the hyperspectral image is reduced into a two-dimensional tensor, utilizing a principal component analysis (PCA) scheme. Then, the constructed low-dimensional image is input to our proposed ECA-NET deep network, which exploits the advantages of its core components, i.e., multi-scale residual structure and attention mechanisms. We evaluate the performance of the proposed MRA-NET on three public available hyperspectral datasets and demonstrate that, overall, the classification accuracy of our method is 99.82 %, 99.81%, and 99.37, respectively, which is higher compared to the corresponding accuracy of current networks such as 3D convolutional neural network (CNN), three-dimensional residual convolution structure (RES-3D-CNN), and space–spectrum joint deep network (SSRN).

scholarly journals Deep Spectral Spatial Inverted Residual Network for Hyperspectral Image Classification

2021 ◽  
Vol 13 (21) ◽  
pp. 4472
Author(s):  
Tianyu Zhang ◽  
Cuiping Shi ◽  
Diling Liao ◽  
Liguo Wang
Keyword(s):  
Image Classification ◽  
Data Augmentation ◽  
Hyperspectral Image ◽  
Classification Performance ◽  
Hyperspectral Data ◽  
Hyperspectral Images ◽  
Hyperspectral Image Classification ◽  
Feature Maps ◽  
Spatial Feature ◽  
Global Context

Convolutional neural networks (CNNs) have been widely used in hyperspectral image classification in recent years. The training of CNNs relies on a large amount of labeled sample data. However, the number of labeled samples of hyperspectral data is relatively small. Moreover, for hyperspectral images, fully extracting spectral and spatial feature information is the key to achieve high classification performance. To solve the above issues, a deep spectral spatial inverted residuals network (DSSIRNet) is proposed. In this network, a data block random erasing strategy is introduced to alleviate the problem of limited labeled samples by data augmentation of small spatial blocks. In addition, a deep inverted residuals (DIR) module for spectral spatial feature extraction is proposed, which locks the effective features of each layer while avoiding network degradation. Furthermore, a global 3D attention module is proposed, which can realize the fine extraction of spectral and spatial global context information under the condition of the same number of input and output feature maps. Experiments are carried out on four commonly used hyperspectral datasets. A large number of experimental results show that compared with some state-of-the-art classification methods, the proposed method can provide higher classification accuracy for hyperspectral images.

A NEW SPECTRAL–SPATIAL JOINTED HYPERSPECTRAL IMAGE CLASSIFICATION APPROACH BASED ON FRACTAL DIMENSION ANALYSIS

Fractals ◽  
2019 ◽  
Vol 27 (05) ◽  
pp. 1950079
Author(s):  
JUNYING SU ◽  
YINGKUI LI ◽  
QINGWU HU
Keyword(s):  
Fractal Dimension ◽  
Image Classification ◽  
Classification Accuracy ◽  
Hyperspectral Image ◽  
Spatial Domain ◽  
Spectral Domain ◽  
Hyperspectral Image Classification ◽  
Self Similarity ◽  
Classification Approach ◽  
Image Set

To maximize the advantages of both spectral and spatial information, we introduce a new spectral–spatial jointed hyperspectral image classification approach based on fractal dimension (FD) analysis of spectral response curve (SRC) in spectral domain and extended morphological processing in spatial domain. This approach first calculates the FD image based on the whole SRC of the hyperspectral image and decomposes the SRC into segments to derive the FD images with each SRC segment. These FD images based on the segmented SRC are composited into a multidimensional FD image set in spectral domain. Then, the extended morphological profiles (EMPs) are derived from the image set through morphological open and close operations in spatial domain. Finally, all these EMPs and FD features are combined into one feature vector for a probabilistic support vector machine (SVM) classification. This approach was demonstrated using three hyperspectral images in urban areas of the university campus and downtown area of Pavia, Italy, and the Washington DC Mall area in the USA, respectively. We assessed the potential and performance of this approach by comparing with PCA-based method in hyperspectral image classification. Our results indicate that the classification accuracy of our proposed method is much higher than the accuracies of the classification methods based on the spectral or spatial domain alone, and similar to or slightly higher than the classification accuracy of PCA-based spectral–spatial jointed classification method. The proposed FD approach also provides a new self-similarity measure of land class in spectral domain, a unique property to represent hyperspectral self-similarity of SRC in hyperspectral imagery.

scholarly journals Hyperspectral Image Classification Using Feature Relations Map Learning

2020 ◽  
Vol 12 (18) ◽  
pp. 2956 ◽  
Author(s):  
Peng Dou ◽  
Chao Zeng
Keyword(s):  
Image Classification ◽  
Classification Accuracy ◽  
Hyperspectral Image ◽  
Image Data ◽  
Hyperspectral Images ◽  
Hyperspectral Image Classification ◽  
Map Learning ◽  
Feature Extractor ◽  
Spatial Domains ◽  
Normalized Difference Index

Recently, deep learning has been reported to be an effective method for improving hyperspectral image classification and convolutional neural networks (CNNs) are, in particular, gaining more and more attention in this field. CNNs provide automatic approaches that can learn more abstract features of hyperspectral images from spectral, spatial, or spectral-spatial domains. However, CNN applications are focused on learning features directly from image data—while the intrinsic relations between original features, which may provide more information for classification, are not fully considered. In order to make full use of the relations between hyperspectral features and to explore more objective features for improving classification accuracy, we proposed feature relations map learning (FRML) in this paper. FRML can automatically enhance the separability of different objects in an image, using a segmented feature relations map (SFRM) that reflects the relations between spectral features through a normalized difference index (NDI), and it can then learn new features from SFRM using a CNN-based feature extractor. Finally, based on these features, a classifier was designed for the classification. With FRML, our experimental results from four popular hyperspectral datasets indicate that the proposed method can achieve more representative and objective features to improve classification accuracy, outperforming classifications using the comparative methods.

scholarly journals Three-Dimensional ResNeXt Network Using Feature Fusion and Label Smoothing for Hyperspectral Image Classification

Sensors ◽  
2020 ◽  
Vol 20 (6) ◽  
pp. 1652 ◽  
Author(s):  
Peida Wu ◽  
Ziguan Cui ◽  
Zongliang Gan ◽  
Feng Liu
Keyword(s):  
Hyperspectral Image ◽  
Feature Fusion ◽  
Three Dimensional ◽  
Spectral Feature ◽  
Feature Learning ◽  
Hyperspectral Image Classification ◽  
Training Samples ◽  
Dramatic Rise ◽  
Classification Tasks ◽  
The One

In recent years, deep learning methods have been widely used in the hyperspectral image (HSI) classification tasks. Among them, spectral-spatial combined methods based on the three-dimensional (3-D) convolution have shown good performance. However, because of the three-dimensional convolution, increasing network depth will result in a dramatic rise in the number of parameters. In addition, the previous methods do not make full use of spectral information. They mostly use the data after dimensionality reduction directly as the input of networks, which result in poor classification ability in some categories with small numbers of samples. To address the above two issues, in this paper, we designed an end-to-end 3D-ResNeXt network which adopts feature fusion and label smoothing strategy further. On the one hand, the residual connections and split-transform-merge strategy can alleviate the declining-accuracy phenomenon and decrease the number of parameters. We can adjust the hyperparameter cardinality instead of the network depth to extract more discriminative features of HSIs and improve the classification accuracy. On the other hand, in order to improve the classification accuracies of classes with small numbers of samples, we enrich the input of the 3D-ResNeXt spectral-spatial feature learning network by additional spectral feature learning, and finally use a loss function modified by label smoothing strategy to solve the imbalance of classes. The experimental results on three popular HSI datasets demonstrate the superiority of our proposed network and an effective improvement in the accuracies especially for the classes with small numbers of training samples.

scholarly journals Logo Classification and Data Augmentation Techniques for PCB Assurance and Counterfeit Detection

2021 ◽  
Author(s):  
Mukhil Azhagan Mallaiyan Sathiaseelan ◽  
Olivia P. Paradis ◽  
Rajat Rai ◽  
Suryaprakash Vasudev Pandurangi ◽  
Manoj Yasaswi Vutukuru ◽  
...  
Keyword(s):  
Neural Network ◽  
Data Augmentation ◽  
Bag Of Visual Words ◽  
Visual Words ◽  
Bill Of Materials ◽  
Augmentation Techniques ◽  
Classification Tasks ◽  
Index Terms ◽  
Fully Connected ◽  
Future Work

Abstract In this manuscript, we present our work on Logo classification in PCBs for Hardware assurance purposes. Identifying and classifying logos have important uses for text detection, component authentication and counterfeit detection. Since PCB assurance faces the lack of a representative dataset for classification and detection tasks, we collect different variants of logos from PCBs and present data augmentation techniques to create the necessary data to perform machine learning. In addition to exploring the challenges for image classification tasks in PCBs, we present experiments using Random Forest classifiers, Bag of Visual Words (BoVW) using SIFT and ORB Fully Connected Neural Networks (FCN) and Convolutional Neural Network (CNN) architectures. We present results and also a discussion on the edge cases where our algorithms fail including the potential for future work in PCB logo detection. The code for the algorithms along with the dataset that includes 18 classes of logos with 14000+ images is provided at this link: https://www.trusthub.org/#/data Index Terms—AutoBoM, Logo classification, Data augmentation, Bill of materials, PCB Assurance, Hardware Assurance, Counterfeit avoidance

scholarly journals Hyperspectral Image Classification Based on Sparse Superpixel Graph

2021 ◽  
Vol 13 (18) ◽  
pp. 3592
Author(s):  
Yifei Zhao ◽  
Fengqin Yan
Keyword(s):  
Classification Accuracy ◽  
Spatial Information ◽  
Hyperspectral Image ◽  
Hyperspectral Images ◽  
Spectral Information ◽  
Hyperspectral Image Classification ◽  
Computational Burden ◽  
Large Size ◽  
High Classification Accuracy ◽  
Good Classification

Hyperspectral image (HSI) classification is one of the major problems in the field of remote sensing. Particularly, graph-based HSI classification is a promising topic and has received increasing attention in recent years. However, graphs with pixels as nodes generate large size graphs, thus increasing the computational burden. Moreover, satisfactory classification results are often not obtained without considering spatial information in constructing graph. To address these issues, this study proposes an efficient and effective semi-supervised spectral-spatial HSI classification method based on sparse superpixel graph (SSG). In the constructed sparse superpixels graph, each vertex represents a superpixel instead of a pixel, which greatly reduces the size of graph. Meanwhile, both spectral information and spatial structure are considered by using superpixel, local spatial connection and global spectral connection. To verify the effectiveness of the proposed method, three real hyperspectral images, Indian Pines, Pavia University and Salinas, are chosen to test the performance of our proposal. Experimental results show that the proposed method has good classification completion on the three benchmarks. Compared with several competitive superpixel-based HSI classification approaches, the method has the advantages of high classification accuracy (>97.85%) and rapid implementation (<10 s). This clearly favors the application of the proposed method in practice.

scholarly journals Research and Application of Several Key Techniques in Hyperspectral Image Preprocessing

2021 ◽  
Vol 12 ◽  
Author(s):  
Yu-hang Li ◽  
Xin Tan ◽  
Wei Zhang ◽  
Qing-bin Jiao ◽  
Yu-xing Xu ◽  
...  
Keyword(s):  
Image Segmentation ◽  
Classification Accuracy ◽  
Hyperspectral Image ◽  
Hyperspectral Images ◽  
Classification Model ◽  
Spectral Information ◽  
Convolution Kernel ◽  
Image Correction ◽  
Image Preprocessing ◽  
Segmentation Image

This paper focuses on image segmentation, image correction and spatial-spectral dimensional denoising of images in hyperspectral image preprocessing to improve the classification accuracy of hyperspectral images. Firstly, the images were filtered and segmented by using spectral angle and principal component analysis, and the segmented results are intersected and then used to mask the hyperspectral images. Hyperspectral images with a excellent segmentation result was obtained. Secondly, the standard reflectance plates with reflectance of 2 and 98% were used as a priori spectral information for image correction of samples with known true spectral information. The mean square error between the corrected and calibrated spectra is less than 0.0001. Comparing with the black-and-white correction method, the classification model constructed based on this method has higher classification accuracy. Finally, the convolution kernel of the one-dimensional Savitzky-Golay (SG) filter was extended into a two-dimensional convolution kernel to perform joint spatial-spectral dimensional filtering (TSG) on the hyperspectral images. The SG filter (m = 7,n = 3) and TSG filter (m = 3,n = 4) were applied to the hyperspectral image of Pavia University and the quality of the hyperspectral image was evaluated. It was found that the TSG filter retained most of the original features while the noise information of the filtered hyperspectral image was less. The hyperspectral images of sample 1–1 and sample 1–2 were processed by the image segmentation and image correction methods proposed in this paper. Then the classification models based on SG filtering and TSG filtering hyperspectral images were constructed, respectively. The results showed that the TSG filter-based model had higher classification accuracy and the classification accuracy is more than 98%.

scholarly journals A Novel 2D-3D CNN with Spectral-Spatial Multi-Scale Feature Fusion for Hyperspectral Image Classification

2021 ◽  
Vol 13 (22) ◽  
pp. 4621
Author(s):  
Dongxu Liu ◽  
Guangliang Han ◽  
Peixun Liu ◽  
Hang Yang ◽  
Xinglong Sun ◽  
...  
Keyword(s):  
Feature Extraction ◽  
Image Classification ◽  
Classification Scheme ◽  
Hyperspectral Image ◽  
Feature Fusion ◽  
Spectral Feature ◽  
Hyperspectral Image Classification ◽  
Scale Feature ◽  
Multi Scale ◽  
3D Cnn

Multifarious hyperspectral image (HSI) classification methods based on convolutional neural networks (CNN) have been gradually proposed and achieve a promising classification performance. However, hyperspectral image classification still suffers from various challenges, including abundant redundant information, insufficient spectral-spatial representation, irregular class distribution, and so forth. To address these issues, we propose a novel 2D-3D CNN with spectral-spatial multi-scale feature fusion for hyperspectral image classification, which consists of two feature extraction streams, a feature fusion module as well as a classification scheme. First, we employ two diverse backbone modules for feature representation, that is, the spectral feature and the spatial feature extraction streams. The former utilizes a hierarchical feature extraction module to capture multi-scale spectral features, while the latter extracts multi-stage spatial features by introducing a multi-level fusion structure. With these network units, the category attribute information of HSI can be fully excavated. Then, to output more complete and robust information for classification, a multi-scale spectral-spatial-semantic feature fusion module is presented based on a Decomposition-Reconstruction structure. Last of all, we innovate a classification scheme to lift the classification accuracy. Experimental results on three public datasets demonstrate that the proposed method outperforms the state-of-the-art methods.

Sign in / Sign up

Export Citation Format

Share Document