scholarly journals Hyperspectral Image Classification Based on Spectral and Spatial Information Using Multi-Scale ResNet

2019 ◽  
Vol 9 (22) ◽  
pp. 4890 ◽  
Author(s):  
Zong-Yue Wang ◽  
Qi-Ming Xia ◽  
Jing-Wen Yan ◽  
Shu-Qi Xuan ◽  
Jin-He Su ◽  
...  
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Classification Accuracy ◽  
Spatial Information ◽  
Hyperspectral Image ◽  
Computational Cost ◽  
Data Cube ◽  
Hyperspectral Image Classification ◽  
Fixed Size ◽  
Multi Scale

Hyperspectral imaging (HSI) contains abundant spectrums as well as spatial information, providing a great basis for classification in the field of remote sensing. In this paper, to make full use of HSI information, we combined spectral and spatial information into a two-dimension image in a particular order by extracting a data cube and unfolding it. Prior to the step of combining, principle component analysis (PCA) is utilized to decrease the dimensions of HSI so as to reduce computational cost. Moreover, the classification block used during the experiment is a convolutional neural network (CNN). Instead of using traditionally fixed-size kernels in CNN, we leverage a multi-scale kernel in the first convolutional layer so that it can scale to the receptive field. To attain higher classification accuracy with deeper layers, residual blocks are also applied to the network. Extensive experiments on the datasets from Pavia University and Salinas demonstrate that the proposed method significantly improves the accuracy in HSI classification.

scholarly journals HYPERSPECTRAL IMAGE CLASSIFICATION USING RESIDUAL 2D AND 3D CONVOLUTIONAL NEURAL NETWORK JOINT ATTENTION MODEL

2021 ◽  
Vol XLIV-M-3-2021 ◽  
pp. 187-193
Author(s):  
Q. Yuan ◽  
Y. Ang ◽  
H. Z. M. Shafri
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Classification Accuracy ◽  
Spatial Information ◽  
Hyperspectral Image ◽  
Spectral Features ◽  
Hyperspectral Image Classification ◽  
Spatial Features ◽  
3D Cnn ◽  
2D And 3D

Abstract. Hyperspectral image classification (HSIC) is a challenging task in remote sensing data analysis, which has been applied in many domains for better identification and inspection of the earth surface by extracting spectral and spatial information. The combination of abundant spectral features and accurate spatial information can improve classification accuracy. However, many traditional methods are based on handcrafted features, which brings difficulties for multi-classification tasks due to spectral intra-class heterogeneity and similarity of inter-class. The deep learning algorithm, especially the convolutional neural network (CNN), has been perceived promising feature extractor and classification for processing hyperspectral remote sensing images. Although 2D CNN can extract spatial features, the specific spectral properties are not used effectively. While 3D CNN has the capability for them, but the computational burden increases as stacking layers. To address these issues, we propose a novel HSIC framework based on the residual CNN network by integrating the advantage of 2D and 3D CNN. First, 3D convolutions focus on extracting spectral features with feature recalibration and refinement by channel attention mechanism. The 2D depth-wise separable convolution approach with different size kernels concentrates on obtaining multi-scale spatial features and reducing model parameters. Furthermore, the residual structure optimizes the back-propagation for network training. The results and analysis of extensive HSIC experiments show that the proposed residual 2D-3D CNN network can effectively extract spectral and spatial features and improve classification accuracy.

scholarly journals Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism

2021 ◽  
Vol 13 (3) ◽  
pp. 335
Author(s):  
Yuhao Qing ◽  
Wenyi Liu
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Classification Accuracy ◽  
Hyperspectral Image ◽  
Principal Component ◽  
Hyperspectral Image Classification ◽  
Deep Network ◽  
Multi Scale

In recent years, image classification on hyperspectral imagery utilizing deep learning algorithms has attained good results. Thus, spurred by that finding and to further improve the deep learning classification accuracy, we propose a multi-scale residual convolutional neural network model fused with an efficient channel attention network (MRA-NET) that is appropriate for hyperspectral image classification. The suggested technique comprises a multi-staged architecture, where initially the spectral information of the hyperspectral image is reduced into a two-dimensional tensor, utilizing a principal component analysis (PCA) scheme. Then, the constructed low-dimensional image is input to our proposed ECA-NET deep network, which exploits the advantages of its core components, i.e., multi-scale residual structure and attention mechanisms. We evaluate the performance of the proposed MRA-NET on three public available hyperspectral datasets and demonstrate that, overall, the classification accuracy of our method is 99.82 %, 99.81%, and 99.37, respectively, which is higher compared to the corresponding accuracy of current networks such as 3D convolutional neural network (CNN), three-dimensional residual convolution structure (RES-3D-CNN), and space–spectrum joint deep network (SSRN).

scholarly journals Approaches for Hyperspectral Image Classification Detailed Review

2021 ◽  
Vol 11 (1) ◽  
pp. 13-22
Author(s):  
Kushalatha M R ◽  
◽  
Prasantha H S ◽  
Beena R. Shetty ◽  
◽  
...  
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Image Classification ◽  
Spatial Information ◽  
Hyperspectral Image ◽  
Support Vector ◽  
Electromagnetic Spectrum ◽  
Hyperspectral Image Classification ◽  
Sensing Applications ◽  
Remote Sensing Applications

Hyperspectral Image (HSI) processing is the new advancement in image / signal processing field. The growth over the years is appreciable. The main reason behind the successful growth of the Hyperspectral imaging field is due to the enormous amount of spectral and spatial information that the imagery contains. The spectral band that the HSI which contains is also more in number. When an image is captured through the HSI cameras, it contains around 200-250 images of the same scene. Nowadays HSI is used extensively in the fields of environmental monitoring, Crop-Field monitoring, Classification, Identification, Remote sensing applications, Surveillance etc. The spectral and spatial information content present in Hyperspectral images are with high resolutions.Hyperspectral imaging has shown significant growth and widely used in most of the remote sensing applications due to its presence of information of a scene over hundreds of contiguous bands In. Hyperspectral Image Classification of materials is the critical application of HSI using Hyperspectral sensors. It collects hundreds of spectrum channels, where each channel consists of a sharp point of Electromagnetic Spectrum. The paper mainly focuses on Deep Learning techniques such as Convolutional Neural Network (CNN), Artificial Neural Network (ANN), and Support Vector machines (SVM), K-Nearest Neighbour (KNN) for the accuracy in classification. Finally in the summary the current state-of-the-art scheme, a critical discussion after reviewing the research work by other professionals and organizing it into review-based paper, also implying about the present status on classification accuracy using neural networks is carried out.

scholarly journals Hyperspectral Image Classification Based on Sparse Superpixel Graph

2021 ◽  
Vol 13 (18) ◽  
pp. 3592
Author(s):  
Yifei Zhao ◽  
Fengqin Yan
Keyword(s):  
Classification Accuracy ◽  
Spatial Information ◽  
Hyperspectral Image ◽  
Hyperspectral Images ◽  
Spectral Information ◽  
Hyperspectral Image Classification ◽  
Computational Burden ◽  
Large Size ◽  
High Classification Accuracy ◽  
Good Classification

Hyperspectral image (HSI) classification is one of the major problems in the field of remote sensing. Particularly, graph-based HSI classification is a promising topic and has received increasing attention in recent years. However, graphs with pixels as nodes generate large size graphs, thus increasing the computational burden. Moreover, satisfactory classification results are often not obtained without considering spatial information in constructing graph. To address these issues, this study proposes an efficient and effective semi-supervised spectral-spatial HSI classification method based on sparse superpixel graph (SSG). In the constructed sparse superpixels graph, each vertex represents a superpixel instead of a pixel, which greatly reduces the size of graph. Meanwhile, both spectral information and spatial structure are considered by using superpixel, local spatial connection and global spectral connection. To verify the effectiveness of the proposed method, three real hyperspectral images, Indian Pines, Pavia University and Salinas, are chosen to test the performance of our proposal. Experimental results show that the proposed method has good classification completion on the three benchmarks. Compared with several competitive superpixel-based HSI classification approaches, the method has the advantages of high classification accuracy (>97.85%) and rapid implementation (<10 s). This clearly favors the application of the proposed method in practice.

scholarly journals Multi-scale guided feature extraction and classification algorithm for hyperspectral images

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Shiqi Huang ◽  
Ying Lu ◽  
Wenqing Wang ◽  
Ke Sun
Keyword(s):  
Feature Extraction ◽  
Image Classification ◽  
Classification Accuracy ◽  
Hyperspectral Image ◽  
Image Data ◽  
Hyperspectral Images ◽  
Hyperspectral Image Classification ◽  
Multi Scale ◽  
Hyperspectral Image Data ◽  
Guided Filtering

AbstractTo solve the problem that the traditional hyperspectral image classification method cannot effectively distinguish the boundary of objects with a single scale feature, which leads to low classification accuracy, this paper introduces the idea of guided filtering into hyperspectral image classification, and then proposes a multi-scale guided feature extraction and classification (MGFEC) algorithm for hyperspectral images. Firstly, the principal component analysis theory is used to reduce the dimension of hyperspectral image data. Then, guided filtering algorithm is used to achieve multi-scale spatial structure extraction of hyperspectral image by setting different sizes of filtering windows, so as to retain more edge details. Finally, the extracted multi-scale features are input into the support vector machine classifier for classification. Several practical hyperspectral image datasets were used to verify the experiment, and compared with other spectral feature extraction algorithms. The experimental results show that the multi-scale features extracted by the MGFEC algorithm proposed in this paper are more accurate than those extracted by only using spectral information, which leads to the improvement of the final classification accuracy. This fully shows that the proposed method is not only effective, but also suitable for processing different hyperspectral image data.

scholarly journals Spectral-Spatial Attention Networks for Hyperspectral Image Classification

2019 ◽  
Vol 11 (8) ◽  
pp. 963 ◽  
Author(s):  
Xiaoguang Mei ◽  
Erting Pan ◽  
Yong Ma ◽  
Xiaobing Dai ◽  
Jun Huang ◽  
...  
Keyword(s):  
Neural Network ◽  
Image Classification ◽  
Spatial Attention ◽  
Spatial Information ◽  
Hyperspectral Image ◽  
Spatial Dimension ◽  
Hyperspectral Image Classification ◽  
Attention Networks ◽  
Land Covers

Many deep learning models, such as convolutional neural network (CNN) and recurrent neural network (RNN), have been successfully applied to extracting deep features for hyperspectral tasks. Hyperspectral image classification allows distinguishing the characterization of land covers by utilizing their abundant information. Motivated by the attention mechanism of the human visual system, in this study, we propose a spectral-spatial attention network for hyperspectral image classification. In our method, RNN with attention can learn inner spectral correlations within a continuous spectrum, while CNN with attention is designed to focus on saliency features and spatial relevance between neighboring pixels in the spatial dimension. Experimental results demonstrate that our method can fully utilize the spectral and spatial information to obtain competitive performance.

scholarly journals A Multi-Scale and Multi-Level Spectral-Spatial Feature Fusion Network for Hyperspectral Image Classification

2020 ◽  
Vol 12 (1) ◽  
pp. 125 ◽  
Author(s):  
Mu ◽  
Guo ◽  
Liu
Keyword(s):  
Neural Network ◽  
Hyperspectral Image ◽  
Feature Fusion ◽  
Hyperspectral Images ◽  
Spectral Features ◽  
Hyperspectral Image Classification ◽  
Spatial Feature ◽  
Multi Scale ◽  
Spatial Features ◽  
Multi Level

Extracting spatial and spectral features through deep neural networks has become an effective means of classification of hyperspectral images. However, most networks rarely consider the extraction of multi-scale spatial features and cannot fully integrate spatial and spectral features. In order to solve these problems, this paper proposes a multi-scale and multi-level spectral-spatial feature fusion network (MSSN) for hyperspectral image classification. The network uses the original 3D cube as input data and does not need to use feature engineering. In the MSSN, using different scale neighborhood blocks as the input of the network, the spectral-spatial features of different scales can be effectively extracted. The proposed 3D–2D alternating residual block combines the spectral features extracted by the three-dimensional convolutional neural network (3D-CNN) with the spatial features extracted by the two-dimensional convolutional neural network (2D-CNN). It not only achieves the fusion of spectral features and spatial features but also achieves the fusion of high-level features and low-level features. Experimental results on four hyperspectral datasets show that this method is superior to several state-of-the-art classification methods for hyperspectral images.

Sign in / Sign up

Export Citation Format

Share Document