scholarly journals SAR Image Classification Using Fully Connected Conditional Random Fields Combined with Deep Learning and Superpixel Boundary Constraint

2021 ◽  
Vol 13 (2) ◽  
pp. 271
Author(s):  
Zhensheng Sun ◽  
Miao Liu ◽  
Peng Liu ◽  
Juan Li ◽  
Tao Yu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Image Classification ◽  
Random Fields ◽  
Conditional Random Fields ◽  
Microwave Remote Sensing ◽  
Electromagnetic Spectrum ◽  
Sar Image ◽  
Sensing Applications ◽  
Boundary Constraint ◽  
Fully Connected

As one of the most important active remote sensing technologies, synthetic aperture radar (SAR) provides advanced advantages of all-day, all-weather, and strong penetration capabilities. Due to its unique electromagnetic spectrum and imaging mechanism, the dimensions of remote sensing data have been considerably expanded. Important for fundamental research in microwave remote sensing, SAR image classification has been proven to have great value in many remote sensing applications. Many widely used SAR image classification algorithms rely on the combination of hand-designed features and machine learning classifiers, which still experience many issues that remain to be resolved and overcome, including optimized feature representation, the fuzzy confusion of speckle noise, the widespread applicability, and so on. To mitigate some of the issues and to improve the pattern recognition of high-resolution SAR images, a ConvCRF model combined with superpixel boundary constraint is developed. The proposed algorithm can successfully combine the local and global advantages of fully connected conditional random fields and deep models. An optimizing strategy using a superpixel boundary constraint in the inference iterations more efficiently preserves structure details. The experimental results demonstrate that the proposed method provides competitive advantages over other widely used models. In the land cover classification experiments using the MSTAR, E-SAR and GF-3 datasets, the overall accuracy of our proposed method achieves 90.18 ± 0.37, 91.63 ± 0.27, and 90.91 ± 0.31, respectively. Regarding the issues of SAR image classification, a novel integrated learning containing local and global image features can bring practical implications.

scholarly journals Fully Connected Conditional Random Fields for High-Resolution Remote Sensing Land Use/Land Cover Classification with Convolutional Neural Networks

2018 ◽  
Vol 10 (12) ◽  
pp. 1889 ◽  
Author(s):  
Bin Zhang ◽  
Cunpeng Wang ◽  
Yonglin Shen ◽  
Yueyan Liu
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Random Fields ◽  
Conditional Random Fields ◽  
Svm Classifier ◽  
Spectral Features ◽  
Remote Sensing Images ◽  
Feature Descriptors ◽  
New Feature ◽  
Fully Connected

The interpretation of land use and land cover (LULC) is an important issue in the fields of high-resolution remote sensing (RS) image processing and land resource management. Fully training a new or existing convolutional neural network (CNN) architecture for LULC classification requires a large amount of remote sensing images. Thus, fine-tuning a pre-trained CNN for LULC detection is required. To improve the classification accuracy for high resolution remote sensing images, it is necessary to use another feature descriptor and to adopt a classifier for post-processing. A fully connected conditional random fields (FC-CRF), to use the fine-tuned CNN layers, spectral features, and fully connected pairwise potentials, is proposed for image classification of high-resolution remote sensing images. First, an existing CNN model is adopted, and the parameters of CNN are fine-tuned by training datasets. Then, the probabilities of image pixels belong to each class type are calculated. Second, we consider the spectral features and digital surface model (DSM) and combined with a support vector machine (SVM) classifier, the probabilities belong to each LULC class type are determined. Combined with the probabilities achieved by the fine-tuned CNN, new feature descriptors are built. Finally, FC-CRF are introduced to produce the classification results, whereas the unary potentials are achieved by the new feature descriptors and SVM classifier, and the pairwise potentials are achieved by the three-band RS imagery and DSM. Experimental results show that the proposed classification scheme achieves good performance when the total accuracy is about 85%.

scholarly journals Fully Connected Conditional Random Fields for High-Resolution Remote Sensing Land Use/Land Cover Classification with Convolutional Neural Networks

2018 ◽  
Author(s):  
Bin Zhang ◽  
Cunpeng Wang ◽  
Yonglin Shen ◽  
Yueyan Liu
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Random Fields ◽  
Conditional Random Fields ◽  
Svm Classifier ◽  
Spectral Features ◽  
Remote Sensing Images ◽  
Feature Descriptors ◽  
New Feature ◽  
Fully Connected

The interpretation of land use and land cover (LULC) is an important issue in the fields of high-resolution remote sensing (RS) image processing and land resource management. Fully training a new or existing convolutional neural network (CNN) architecture for LULC classification requires a large amount of remote sensing images. Thus, fine-tuning a pre-trained CNN for LULC detection is required. To improve the classification accuracy for high resolution remote sensing images, it is necessary to use another feature descriptor and to adopt a classifier for post-processing. A fully connected conditional random fields (FC-CRF), to use the fine-tuned CNN layers, spectral features, and fully connected pairwise potentials, is proposed for image classification of high-resolution remote sensing images. First, an existing CNN model is adopted, and the parameters of CNN are fine-tuned by training datasets. Then, the probabilities of image pixels belong to each class type are calculated. Second, we consider the spectral features and digital surface model (DSM) and combined with a support vector machine (SVM) classifier, the probabilities belong to each LULC class type are determined. Combined with the probabilities achieved by the fine-tuned CNN, new feature descriptors are built. Finally, FC-CRF are introduced to produce the classification results, whereas the unary potentials are achieved by the new feature descriptors and SVM classifier, and the pairwise potentials are achieved by the three-band RS imagery and DSM. Experimental results show that the proposed classification scheme achieves good performance when the total accuracy is about 85%.

scholarly journals Approaches for Hyperspectral Image Classification Detailed Review

2021 ◽  
Vol 11 (1) ◽  
pp. 13-22
Author(s):  
Kushalatha M R ◽  
◽  
Prasantha H S ◽  
Beena R. Shetty ◽  
◽  
...  
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Image Classification ◽  
Spatial Information ◽  
Hyperspectral Image ◽  
Support Vector ◽  
Electromagnetic Spectrum ◽  
Hyperspectral Image Classification ◽  
Sensing Applications ◽  
Remote Sensing Applications

Hyperspectral Image (HSI) processing is the new advancement in image / signal processing field. The growth over the years is appreciable. The main reason behind the successful growth of the Hyperspectral imaging field is due to the enormous amount of spectral and spatial information that the imagery contains. The spectral band that the HSI which contains is also more in number. When an image is captured through the HSI cameras, it contains around 200-250 images of the same scene. Nowadays HSI is used extensively in the fields of environmental monitoring, Crop-Field monitoring, Classification, Identification, Remote sensing applications, Surveillance etc. The spectral and spatial information content present in Hyperspectral images are with high resolutions.Hyperspectral imaging has shown significant growth and widely used in most of the remote sensing applications due to its presence of information of a scene over hundreds of contiguous bands In. Hyperspectral Image Classification of materials is the critical application of HSI using Hyperspectral sensors. It collects hundreds of spectrum channels, where each channel consists of a sharp point of Electromagnetic Spectrum. The paper mainly focuses on Deep Learning techniques such as Convolutional Neural Network (CNN), Artificial Neural Network (ANN), and Support Vector machines (SVM), K-Nearest Neighbour (KNN) for the accuracy in classification. Finally in the summary the current state-of-the-art scheme, a critical discussion after reviewing the research work by other professionals and organizing it into review-based paper, also implying about the present status on classification accuracy using neural networks is carried out.

RNN-based multispectral satellite image processing for remote sensing applications

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Venkata Dasu Marri ◽  
Veera Narayana Reddy P. ◽  
Chandra Mohan Reddy S.
Keyword(s):  
Remote Sensing ◽  
Image Processing ◽  
Deep Learning ◽  
Image Classification ◽  
Satellite Image ◽  
Multispectral Image ◽  
Content Type ◽  
Colliding Bodies Optimization ◽  
Sensing Applications ◽  
Remote Sensing Applications

Purpose Image classification is a fundamental form of digital image processing in which pixels are labeled into one of the object classes present in the image. Multispectral image classification is a challenging task due to complexities associated with the images captured by satellites. Accurate image classification is highly essential in remote sensing applications. However, existing machine learning and deep learning–based classification methods could not provide desired accuracy. The purpose of this paper is to classify the objects in the satellite image with greater accuracy. Design/methodology/approach This paper proposes a deep learning-based automated method for classifying multispectral images. The central issue of this work is that data sets collected from public databases are first divided into a number of patches and their features are extracted. The features extracted from patches are then concatenated before a classification method is used to classify the objects in the image. Findings The performance of proposed modified velocity-based colliding bodies optimization method is compared with existing methods in terms of type-1 measures such as sensitivity, specificity, accuracy, net present value, F1 Score and Matthews correlation coefficient and type 2 measures such as false discovery rate and false positive rate. The statistical results obtained from the proposed method show better performance than existing methods. Originality/value In this work, multispectral image classification accuracy is improved with an optimization algorithm called modified velocity-based colliding bodies optimization.

scholarly journals Improved Oriented Object Detection in Remote Sensing Images Based on a Three-Point Regression Method

2021 ◽  
Vol 13 (22) ◽  
pp. 4517
Author(s):  
Falin Wu ◽  
Jiaqi He ◽  
Guopeng Zhou ◽  
Haolun Li ◽  
Yushuang Liu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Poor Performance ◽  
Regression Method ◽  
Remote Sensing Images ◽  
Sensing Applications ◽  
Bounding Box ◽  
Bounding Boxes ◽  
Fully Connected ◽  
Oriented Object

Object detection in remote sensing images plays an important role in both military and civilian remote sensing applications. Objects in remote sensing images are different from those in natural images. They have the characteristics of scale diversity, arbitrary directivity, and dense arrangement, which causes difficulties in object detection. For objects with a large aspect ratio and that are oblique and densely arranged, using an oriented bounding box can help to avoid deleting some correct detection bounding boxes by mistake. The classic rotational region convolutional neural network (R2CNN) has advantages for text detection. However, R2CNN has poor performance in the detection of slender objects with arbitrary directivity in remote sensing images, and its fault tolerance rate is low. In order to solve this problem, this paper proposes an improved R2CNN based on a double detection head structure and a three-point regression method, namely, TPR-R2CNN. The proposed network modifies the original R2CNN network structure by applying a double fully connected (2-fc) detection head and classification fusion. One detection head is for classification and horizontal bounding box regression, the other is for classification and oriented bounding box regression. The three-point regression method (TPR) is proposed for oriented bounding box regression, which determines the positions of the oriented bounding box by regressing the coordinates of the center point and the first two vertices. The proposed network was validated on the DOTA-v1.5 and HRSC2016 datasets, and it achieved a mean average precision (mAP) of 3.90% and 15.27%, respectively, from feature pyramid network (FPN) baselines with a ResNet-50 backbone.

Sign in / Sign up

Export Citation Format

Share Document