scholarly journals Detection and Classification of Early Decay on Blueberry Based on Improved Deep Residual 3D Convolutional Neural Network in Hyperspectral Images

2020 ◽  
Vol 2020 ◽  
pp. 1-12 ◽  
Author(s):  
Shicheng Qiao ◽  
Qinghu Wang ◽  
Jun Zhang ◽  
Zhili Pei
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Network Performance ◽  
Hyperspectral Image ◽  
Hyperspectral Images ◽  
Training Time ◽  
Spatial Features ◽  
Fast Training ◽  
Novel Strategy ◽  
3D Cnn

Recently, the automatic detection of decayed blueberries is still a challenge in food industry. Early decay of blueberries happens on surface peel, which may adopt the feasibility of hyperspectral imaging mode to detect decayed region of blueberries. An improved deep residual 3D convolutional neural network (3D-CNN) framework is proposed for hyperspectral images classification so as to realize fast training, classification, and parameter optimization. Rich spectral and spatial features can be rapidly extracted from samples of complete hyperspectral images using our proposed network. This combines the tree structured Parzen estimator (TPE) adaptively and selects the super parameters to optimize the network performance. In addition, aiming at the problem of few samples, this paper proposes a novel strategy to enhance the hyperspectral image sample data, which can improve the training effect. Experimental results on the standard hyperspectral blueberry datasets show that the proposed framework improves the classification accuracy compared with AlexNet and GoogleNet. In addition, our proposed network reduces the number of parameters by half and the training time by about 10%.

scholarly journals Comparison of CNN Algorithms on Hyperspectral Image Classification in Agricultural Lands

Sensors ◽  
2020 ◽  
Vol 20 (6) ◽  
pp. 1734 ◽  
Author(s):  
Tien-Heng Hsieh ◽  
Jean-Fu Kiang
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Principal Components ◽  
Hyperspectral Image ◽  
Hyperspectral Images ◽  
Agricultural Lands ◽  
Hyperspectral Image Classification ◽  
Spatial Features ◽  
Salinas Valley ◽  
Crop Agriculture

Several versions of convolutional neural network (CNN) were developed to classify hyperspectral images (HSIs) of agricultural lands, including 1D-CNN with pixelwise spectral data, 1D-CNN with selected bands, 1D-CNN with spectral-spatial features and 2D-CNN with principal components. The HSI data of a crop agriculture in Salinas Valley and a mixed vegetation agriculture in Indian Pines were used to compare the performance of these CNN algorithms. The highest overall accuracy on these two cases are 99.8% and 98.1%, respectively, achieved by applying 1D-CNN with augmented input vectors, which contain both spectral and spatial features embedded in the HSI data.

scholarly journals Patch-Wise Semantic Segmentation for Hyperspectral Images via a Cubic Capsule Network with EMAP Features

2021 ◽  
Vol 13 (17) ◽  
pp. 3497
Author(s):  
Le Sun ◽  
Xiangbo Song ◽  
Huxiang Guo ◽  
Guangrui Zhao ◽  
Jinwei Wang
Keyword(s):  
Neural Network ◽  
Hyperspectral Image ◽  
Principal Component ◽  
Semantic Segmentation ◽  
Hyperspectral Images ◽  
Experimental Comparison ◽  
Spatial Features ◽  
Segmentation Methods ◽  
High Layer ◽  
Morphological Attribute

In order to overcome the disadvantages of convolution neural network (CNN) in the current hyperspectral image (HSI) classification/segmentation methods, such as the inability to recognize the rotation of spatial objects, the difficulty to capture the fine spatial features and the problem that principal component analysis (PCA) ignores some important information when it retains few components, in this paper, an HSI segmentation model based on extended multi-morphological attribute profile (EMAP) features and cubic capsule network (EMAP–Cubic-Caps) was proposed. EMAP features can effectively extract various attributes profile features of entities in HSI, and the cubic capsule neural network can effectively capture complex spatial features with more details. Firstly, EMAP algorithm is introduced to extract the morphological attribute profile features of the principal components extracted by PCA, and the EMAP feature map is used as the input of the network. Then, the spectral and spatial low-layer information of the HSI is extracted by a cubic convolution network, and the high-layer information of HSI is extracted by the capsule module, which consists of an initial capsule layer and a digital capsule layer. Through the experimental comparison on three well-known HSI datasets, the superiority of the proposed algorithm in semantic segmentation is validated.

scholarly journals A Multi-Scale and Multi-Level Spectral-Spatial Feature Fusion Network for Hyperspectral Image Classification

2020 ◽  
Vol 12 (1) ◽  
pp. 125 ◽  
Author(s):  
Mu ◽  
Guo ◽  
Liu
Keyword(s):  
Neural Network ◽  
Hyperspectral Image ◽  
Feature Fusion ◽  
Hyperspectral Images ◽  
Spectral Features ◽  
Hyperspectral Image Classification ◽  
Spatial Feature ◽  
Multi Scale ◽  
Spatial Features ◽  
Multi Level

Extracting spatial and spectral features through deep neural networks has become an effective means of classification of hyperspectral images. However, most networks rarely consider the extraction of multi-scale spatial features and cannot fully integrate spatial and spectral features. In order to solve these problems, this paper proposes a multi-scale and multi-level spectral-spatial feature fusion network (MSSN) for hyperspectral image classification. The network uses the original 3D cube as input data and does not need to use feature engineering. In the MSSN, using different scale neighborhood blocks as the input of the network, the spectral-spatial features of different scales can be effectively extracted. The proposed 3D–2D alternating residual block combines the spectral features extracted by the three-dimensional convolutional neural network (3D-CNN) with the spatial features extracted by the two-dimensional convolutional neural network (2D-CNN). It not only achieves the fusion of spectral features and spatial features but also achieves the fusion of high-level features and low-level features. Experimental results on four hyperspectral datasets show that this method is superior to several state-of-the-art classification methods for hyperspectral images.

scholarly journals HYPERSPECTRAL IMAGE CLASSIFICATION USING RESIDUAL 2D AND 3D CONVOLUTIONAL NEURAL NETWORK JOINT ATTENTION MODEL

2021 ◽  
Vol XLIV-M-3-2021 ◽  
pp. 187-193
Author(s):  
Q. Yuan ◽  
Y. Ang ◽  
H. Z. M. Shafri
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Classification Accuracy ◽  
Spatial Information ◽  
Hyperspectral Image ◽  
Spectral Features ◽  
Hyperspectral Image Classification ◽  
Spatial Features ◽  
3D Cnn ◽  
2D And 3D

Abstract. Hyperspectral image classification (HSIC) is a challenging task in remote sensing data analysis, which has been applied in many domains for better identification and inspection of the earth surface by extracting spectral and spatial information. The combination of abundant spectral features and accurate spatial information can improve classification accuracy. However, many traditional methods are based on handcrafted features, which brings difficulties for multi-classification tasks due to spectral intra-class heterogeneity and similarity of inter-class. The deep learning algorithm, especially the convolutional neural network (CNN), has been perceived promising feature extractor and classification for processing hyperspectral remote sensing images. Although 2D CNN can extract spatial features, the specific spectral properties are not used effectively. While 3D CNN has the capability for them, but the computational burden increases as stacking layers. To address these issues, we propose a novel HSIC framework based on the residual CNN network by integrating the advantage of 2D and 3D CNN. First, 3D convolutions focus on extracting spectral features with feature recalibration and refinement by channel attention mechanism. The 2D depth-wise separable convolution approach with different size kernels concentrates on obtaining multi-scale spatial features and reducing model parameters. Furthermore, the residual structure optimizes the back-propagation for network training. The results and analysis of extensive HSIC experiments show that the proposed residual 2D-3D CNN network can effectively extract spectral and spatial features and improve classification accuracy.

scholarly journals Composite Clustering Sampling Strategy for Multiscale Spectral-Spatial Classification of Hyperspectral Images

2020 ◽  
Vol 2020 ◽  
pp. 1-17
Author(s):  
Chenming Li ◽  
Xiaoyu Qu ◽  
Yao Yang ◽  
Dan Yao ◽  
Hongmin Gao ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Hyperspectral Image ◽  
Sampling Strategy ◽  
Classification Methods ◽  
Hyperspectral Image Classification ◽  
Training Set ◽  
Training Time ◽  
Resource Requirements

In recent years, many high-performance spectral-spatial classification methods were proposed in the field of hyperspectral image classification. At present, a great quantity of studies has focused on developing methods to improve classification accuracy. However, some research has shown that the widely adopted pixel-based random sampling strategy is not suitable for spectral-spatial hyperspectral image classification algorithms. Therefore, a composite clustering sampling strategy is proposed, which can greatly reduce the overlap between the training set and the test set, while making sample points in the training set sufficiently representative in the spectral domain. At the same time, in order to solve problems of a three-dimensional Convolutional Neural Network which is commonly used in spectral-spatial hyperspectral image classification methods, such as long training time and large computing resource requirements, a multiscale spectral-spatial hyperspectral image classification model based on a two-dimensional Convolutional Neural Network is proposed, which effectively reduces the training time and computing resource requirements.

scholarly journals Three-Dimensional Convolutional Neural Network Model for Early Detection of Pine Wilt Disease Using UAV-Based Hyperspectral Images

2021 ◽  
Vol 13 (20) ◽  
pp. 4065
Author(s):  
Run Yu ◽  
Youqing Luo ◽  
Haonan Li ◽  
Liyuan Yang ◽  
Huaguo Huang ◽  
...  
Keyword(s):  
Neural Network ◽  
Early Detection ◽  
Convolutional Neural Network ◽  
Three Dimensional ◽  
Pine Wilt Disease ◽  
Wilt Disease ◽  
Hyperspectral Images ◽  
Pine Wilt ◽  
Pine Trees ◽  
3D Cnn

As one of the most devastating disasters to pine forests, pine wilt disease (PWD) has caused tremendous ecological and economic losses in China. An effective way to prevent large-scale PWD outbreaks is to detect and remove the damaged pine trees at the early stage of PWD infection. However, early infected pine trees do not show obvious changes in morphology or color in the visible wavelength range, making early detection of PWD tricky. Unmanned aerial vehicle (UAV)-based hyperspectral imagery (HI) has great potential for early detection of PWD. However, the commonly used methods, such as the two-dimensional convolutional neural network (2D-CNN), fail to simultaneously extract and fully utilize the spatial and spectral information, whereas the three-dimensional convolutional neural network (3D-CNN) is able to collect this information from raw hyperspectral data. In this paper, we applied the residual block to 3D-CNN and constructed a 3D-Res CNN model, the performance of which was then compared with that of 3D-CNN, 2D-CNN, and 2D-Res CNN in identifying PWD-infected pine trees from the hyperspectral images. The 3D-Res CNN model outperformed the other models, achieving an overall accuracy (OA) of 88.11% and an accuracy of 72.86% for detecting early infected pine trees (EIPs). Using only 20% of the training samples, the OA and EIP accuracy of 3D-Res CNN can still achieve 81.06% and 51.97%, which is superior to the state-of-the-art method in the early detection of PWD based on hyperspectral images. Collectively, 3D-Res CNN was more accurate and effective in early detection of PWD. In conclusion, 3D-Res CNN is proposed for early detection of PWD in this paper, making the prediction and control of PWD more accurate and effective. This model can also be applied to detect pine trees damaged by other diseases or insect pests in the forest.

scholarly journals Extended Morphological Profile Cube for Hyperspectral Image Classification

2021 ◽  
Author(s):  
ALOU DIAKITE ◽  
GUI JIANGSHENG ◽  
FU XIAPING
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Hyperspectral Image ◽  
Principal Component ◽  
Kappa Coefficient ◽  
Sparse Principal Component Analysis ◽  
Hyperspectral Image Classification ◽  
New Approach ◽  
Spatial Features ◽  
Training Samples

<p>Hyperspectral image (HSI) classification using convolutional neural network requires a lot of training samples, which is not always available. Consequently, decreases the classification accuracy due to the overfitting problem. Many studies have been conducted to solve the issue; however, they failed to solve it entirely. Therefore, we proposed a new approach to classify HSI with few training samples using a convolutional neural network in that context. The proposed approach employed an extended morphological profile cube (EMPC) to extract rich spectral-spatial features and then used a 3D densely connected network for classification. Besides, we used sparse principal component analysis to reduce the high spectral dimension of HSI. Experiments results on Indian Pines (IP) and University of Pavia (UP) datasets proved the efficiency of the proposed approach. It increased the OA by 2.61% - 13% and the Kappa coefficient by 2.68% - 15:51% on IP dataset and increased the OA by 0.17% - 11% and the Kappa coefficient by 0.23% - 19% on UP dataset, which is superior to some state-of-art methods.</p>

scholarly journals Dynamic Gesture Recognition Algorithm Based on 3D Convolutional Neural Network

2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Yuting Liu ◽  
Du Jiang ◽  
Haojie Duan ◽  
Ying Sun ◽  
Gongfa Li ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Gesture Recognition ◽  
Network Performance ◽  
Recognition Algorithm ◽  
Extraction Technology ◽  
Visual Technology ◽  
Spatial Features ◽  
Dynamic Gestures ◽  
Dynamic Gesture Recognition

Gesture recognition is one of the important ways of human-computer interaction, which is mainly detected by visual technology. The temporal and spatial features are extracted by convolution of the video containing gesture. However, compared with the convolution calculation of a single image, multiframe image of dynamic gestures has more computation, more complex feature extraction, and more network parameters, which affects the recognition efficiency and real-time performance of the model. To solve above problems, a dynamic gesture recognition model based on CBAM-C3D is proposed. Key frame extraction technology, multimodal joint training, and network optimization with BN layer are used for making the network performance better. The experiments show that the recognition accuracy of the proposed 3D convolutional neural network combined with attention mechanism reaches 72.4% on EgoGesture dataset, which is improved greatly compared with the current main dynamic gesture recognition methods, and the effectiveness of the proposed algorithm is verified.

scholarly journals HYPERSPECTRAL IMAGES CLASSIFICATION BASED ON FUSION FEATURES DERIVED FROM 1D AND 2D CONVOLUTIONAL NEURAL NETWORK

2020 ◽  
Vol XLII-3/W10 ◽  
pp. 335-341
Author(s):  
T. Jiang ◽  
X. J. Wang
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Classification Accuracy ◽  
Hyperspectral Image ◽  
Structural Characteristics ◽  
Hyperspectral Images ◽  
Fusion Model ◽  
Data Set ◽  
Features Fusion

Abstract. In recent years, deep learning technology has been continuously developed and gradually transferred to various fields. Among them, Convolutional Neural Network (CNN), which has the ability to extract deep features of images due to its unique network structure, plays an increasingly important role in the realm of Hyperspectral images classification. This paper attempts to construct a features fusion model that combines the deep features derived from 1D-CNN and 2D-CNN, and explores the potential of features fusion model in the field of hyperspectral image classification. The experiment is based on the deep learning open source framework TensorFlow with Python3 as programming environment. Firstly, constructing multi-layer perceptron (MLP), 1D-CNN and 2DCNN models respectively, and then, using the pre-trained 1D-CNN and 2D-CNN models as feature extractors, finally, extracting features via constructing the features fusion model. The general open hyperspectral datasets (Pavia University) were selected as a test to compare classification accuracy and classification confidence among different models. The experimental results show that the features fusion model obtains higher overall accuracy (99.65%), Kappa coefficient (0.9953) and lower uncertainty for the boundary and unknown regions (3.43%) in the data set. Since features fusion model inherits the structural characteristics of 1D-CNN and 2DCNN, the complementary advantages between the models are achieved. The spectral and spatial features of hyperspectral images are fully exploited, thus getting state-of-the-art classification accuracy and generalization performance.

scholarly journals Extended Morphological Profile Cube for Hyperspectral Image Classification

2021 ◽  
Author(s):  
ALOU DIAKITE ◽  
GUI JIANGSHENG ◽  
FU XIAPING
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Hyperspectral Image ◽  
Principal Component ◽  
Kappa Coefficient ◽  
Sparse Principal Component Analysis ◽  
Hyperspectral Image Classification ◽  
New Approach ◽  
Spatial Features ◽  
Training Samples

<p>Hyperspectral image (HSI) classification using convolutional neural network requires a lot of training samples, which is not always available. Consequently, decreases the classification accuracy due to the overfitting problem. Many studies have been conducted to solve the issue; however, they failed to solve it entirely. Therefore, we proposed a new approach to classify HSI with few training samples using a convolutional neural network in that context. The proposed approach employed an extended morphological profile cube (EMPC) to extract rich spectral-spatial features and then used a 3D densely connected network for classification. Besides, we used sparse principal component analysis to reduce the high spectral dimension of HSI. Experiments results on Indian Pines (IP) and University of Pavia (UP) datasets proved the efficiency of the proposed approach. It increased the OA by 2.61% - 13% and the Kappa coefficient by 2.68% - 15:51% on IP dataset and increased the OA by 0.17% - 11% and the Kappa coefficient by 0.23% - 19% on UP dataset, which is superior to some state-of-art methods.</p>

Sign in / Sign up

Export Citation Format

Share Document