scholarly journals A Fast Aircraft Detection Method for SAR Images Based on Efficient Bidirectional Path Aggregated Attention Network

2021 ◽  
Vol 13 (15) ◽  
pp. 2940
Author(s):  
Ru Luo ◽  
Lifu Chen ◽  
Jin Xing ◽  
Zhihui Yuan ◽  
Siyu Tan ◽  
...  
Keyword(s):  
Spatial Information ◽  
Speckle Noise ◽  
False Alarms ◽  
Detection Accuracy ◽  
Sar Images ◽  
Attention Network ◽  
Multi Scale ◽  
Complex Background ◽  
Size Heterogeneity ◽  
Aircraft Detection

In aircraft detection from synthetic aperture radar (SAR) images, there are several major challenges: the shattered features of the aircraft, the size heterogeneity and the interference of a complex background. To address these problems, an Efficient Bidirectional Path Aggregation Attention Network (EBPA2N) is proposed. In EBPA2N, YOLOv5s is used as the base network and then the Involution Enhanced Path Aggregation (IEPA) module and Effective Residual Shuffle Attention (ERSA) module are proposed and systematically integrated to improve the detection accuracy of the aircraft. The IEPA module aims to effectively extract advanced semantic and spatial information to better capture multi-scale scattering features of aircraft. Then, the lightweight ERSA module further enhances the extracted features to overcome the interference of complex background and speckle noise, so as to reduce false alarms. To verify the effectiveness of the proposed network, Gaofen-3 airports SAR data with 1 m resolution are utilized in the experiment. The detection rate and false alarm rate of our EBPA2N algorithm are 93.05% and 4.49%, respectively, which is superior to the latest networks of EfficientDet-D0 and YOLOv5s, and it also has an advantage of detection speed.

scholarly journals Change Detection Based on Multi-Grained Cascade Forest and Multi-Scale Fusion for SAR Images

2019 ◽  
Vol 11 (2) ◽  
pp. 142 ◽  
Author(s):  
Wenping Ma ◽  
Hui Yang ◽  
Yue Wu ◽  
Yunta Xiong ◽  
Tao Hu ◽  
...  
Keyword(s):  
Change Detection ◽  
Representation Learning ◽  
Local Information ◽  
Learning Ability ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Image Block ◽  
Sar Images ◽  
Difference Image ◽  
Multi Scale

In this paper, a novel change detection approach based on multi-grained cascade forest(gcForest) and multi-scale fusion for synthetic aperture radar (SAR) images is proposed. It detectsthe changed and unchanged areas of the images by using the well-trained gcForest. Most existingchange detection methods need to select the appropriate size of the image block. However, thesingle size image block only provides a part of the local information, and gcForest cannot achieve agood effect on the image representation learning ability. Therefore, the proposed approach choosesdifferent sizes of image blocks as the input of gcForest, which can learn more image characteristicsand reduce the influence of the local information of the image on the classification result as well.In addition, in order to improve the detection accuracy of those pixels whose gray value changesabruptly, the proposed approach combines gradient information of the difference image with theprobability map obtained from the well-trained gcForest. Therefore, the image edge information canbe enhanced and the accuracy of edge detection can be improved by extracting the image gradientinformation. Experiments on four data sets indicate that the proposed approach outperforms otherstate-of-the-art algorithms.

scholarly journals Image Deblurring Using Multi-Stream Bottom-Top-Bottom Attention Network and Global Information-Based Fusion and Reconstruction Network

Sensors ◽  
2020 ◽  
Vol 20 (13) ◽  
pp. 3724
Author(s):  
Quan Zhou ◽  
Mingyue Ding ◽  
Xuming Zhang
Keyword(s):  
Deep Learning ◽  
Spatial Information ◽  
Structural Similarity ◽  
Image Deblurring ◽  
Image Features ◽  
Human Vision ◽  
Global Information ◽  
Attention Network ◽  
Multi Scale ◽  
Blind Image Deblurring

Image deblurring has been a challenging ill-posed problem in computer vision. Gaussian blur is a common model for image and signal degradation. The deep learning-based deblurring methods have attracted much attention due to their advantages over the traditional methods relying on hand-designed features. However, the existing deep learning-based deblurring techniques still cannot perform well in restoring the fine details and reconstructing the sharp edges. To address this issue, we have designed an effective end-to-end deep learning-based non-blind image deblurring algorithm. In the proposed method, a multi-stream bottom-top-bottom attention network (MBANet) with the encoder-to-decoder structure is designed to integrate low-level cues and high-level semantic information, which can facilitate extracting image features more effectively and improve the computational efficiency of the network. Moreover, the MBANet adopts a coarse-to-fine multi-scale strategy to process the input images to improve image deblurring performance. Furthermore, the global information-based fusion and reconstruction network is proposed to fuse multi-scale output maps to improve the global spatial information and recurrently refine the output deblurred image. The experiments were done on the public GoPro dataset and the realistic and dynamic scenes (REDS) dataset to evaluate the effectiveness and robustness of the proposed method. The experimental results show that the proposed method generally outperforms some traditional deburring methods and deep learning-based state-of-the-art deblurring methods such as scale-recurrent network (SRN) and denoising prior driven deep neural network (DPDNN) in terms of such quantitative indexes as peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) and human vision.

An Improved Algorithm for Ship Detection from the High-Resolution SAR Images

2014 ◽  
Vol 1044-1045 ◽  
pp. 1040-1044
Author(s):  
Qing Ping Wang ◽  
Hong Zhu ◽  
Wei Wei Wu ◽  
Chang Zhu ◽  
Nai Chang Yuan
Keyword(s):  
High Resolution ◽  
Region Of Interest ◽  
Speckle Noise ◽  
False Alarms ◽  
Constant False Alarm Rate ◽  
Sar Images ◽  
Ship Detection ◽  
Whole Process ◽  
Preliminary Extraction ◽  
Improved Algorithm

An improved algorithm for ship detection from the high-resolution synthetic aperture radar (SAR) images is proposed in this paper. In this algorithm, we firstly utilize the image pre-processing step to suppress the speckle noise. Then, the ship ROIs (Region of Interest) are obtained based on MSER (Maximally Stable Extremal Region) method, which enables preliminary extraction of ship candidates. Finally, an improved CFAR (Constant False Alarm Rate) detector is designed for accurate detection with the purpose of accelerating the whole process and decreasing false alarms. The experimental results show that this method can achieve effective ship detection in high-resolution SAR images. The process of ship detection is also accelerated which is in favour of the project realization.

scholarly journals Subtask Attention Based Object Detection in Remote Sensing Images

2021 ◽  
Vol 13 (10) ◽  
pp. 1925
Author(s):  
Shengzhou Xiong ◽  
Yihua Tan ◽  
Yansheng Li ◽  
Cai Wen ◽  
Pei Yan
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Feature Fusion ◽  
Detection Task ◽  
Feature Representation ◽  
Detection Accuracy ◽  
Remote Sensing Images ◽  
Attention Network ◽  
Multi Scale ◽  
Automatic Interpretation

Object detection in remote sensing images (RSIs) is one of the basic tasks in the field of remote sensing image automatic interpretation. In recent years, the deep object detection frameworks of natural scene images (NSIs) have been introduced into object detection on RSIs, and the detection performance has improved significantly because of the powerful feature representation. However, there are still many challenges concerning the particularities of remote sensing objects. One of the main challenges is the missed detection of small objects which have less than five percent of the pixels of the big objects. Generally, the existing algorithms choose to deal with this problem by multi-scale feature fusion based on a feature pyramid. However, the benefits of this strategy are limited, considering that the location of small objects in the feature map will disappear when the detection task is processed at the end of the network. In this study, we propose a subtask attention network (StAN), which handles the detection task directly on the shallow layer of the network. First, StAN contains one shared feature branch and two subtask attention branches of a semantic auxiliary subtask and a detection subtask based on the multi-task attention network (MTAN). Second, the detection branch uses only low-level features considering small objects. Third, the attention map guidance mechanism is put forward to optimize the network for keeping the identification ability. Fourth, the multi-dimensional sampling module (MdS), global multi-view channel weights (GMulW) and target-guided pixel attention (TPA) are designed for further improvement of the detection accuracy in complex scenes. The experimental results on the NWPU VHR-10 dataset and DOTA dataset demonstrated that the proposed algorithm achieved the SOTA performance, and the missed detection of small objects decreased. On the other hand, ablation experiments also proved the effects of MdS, GMulW and TPA.

AN APPROACH FOR IMPROVING ACCURACY OF CHANGE DETECTION IN MULTI-TEMOPRAL SAR IMAGES

2020 ◽  
pp. 47-54
Author(s):  
Nguyen Hung An
Keyword(s):  
Change Detection ◽  
Natural Resource ◽  
Speckle Noise ◽  
Sea Surface ◽  
Detection Accuracy ◽  
Sar Images ◽  
Novel Approach ◽  
Multi Temporal ◽  
Improving Accuracy

Algorithms of change detection in multi-temporal SAR images have received great interests for recent decades, and been widely applied in natural resource supervision activities. However, these algorithms still expose the limitation of detection accuracy due to inhenrent presence of speckle noise in SAR images. This paper developed a novel approach of change detection in multi-temporal SAR images of sea surface. The algorithm has increased accuracy of change detection in multi-temporal SAR images of sea surface compared with recent other methods.

scholarly journals A Robust Algorithm Based on Phase Congruency for Optical and SAR Image Registration in Suburban Areas

2020 ◽  
Vol 12 (20) ◽  
pp. 3339
Author(s):  
Lina Wang ◽  
Mingchao Sun ◽  
Jinghong Liu ◽  
Lihua Cao ◽  
Guoqing Ma
Keyword(s):  
Image Registration ◽  
Feature Detection ◽  
Speckle Noise ◽  
Feature Descriptor ◽  
Phase Congruency ◽  
Sar Images ◽  
Robust Algorithm ◽  
Multi Scale ◽  
Edge Points ◽  
Index Maps

Automatic registration of optical and synthetic aperture radar (SAR) images is a challenging task due to the influence of SAR speckle noise and nonlinear radiometric differences. This study proposes a robust algorithm based on phase congruency to register optical and SAR images (ROS-PC). It consists of a uniform Harris feature detection method based on multi-moment of the phase congruency map (UMPC-Harris) and a local feature descriptor based on the histogram of phase congruency orientation on multi-scale max amplitude index maps (HOSMI). The UMPC-Harris detects corners and edge points based on a voting strategy, the multi-moment of phase congruency maps, and an overlapping block strategy, which is used to detect stable and uniformly distributed keypoints. Subsequently, HOSMI is derived for a keypoint by utilizing the histogram of phase congruency orientation on multi-scale max amplitude index maps, which effectively increases the discriminability and robustness of the final descriptor. Finally, experimental results obtained using simulated images show that the UMPC-Harris detector has a superior repeatability rate. The image registration results obtained on test images show that the ROS-PC is robust against SAR speckle noise and nonlinear radiometric differences. The ROS-PC can tolerate some rotational and scale changes.

scholarly journals A Novel Effectively Optimized One-Stage Network for Object Detection in Remote Sensing Imagery

2019 ◽  
Vol 11 (11) ◽  
pp. 1376 ◽  
Author(s):  
Weiying Xie ◽  
Haonan Qin ◽  
Yunsong Li ◽  
Zhuo Wang ◽  
Jie Lei
Keyword(s):  
Remote Sensing ◽  
Spatial Information ◽  
Feature Fusion ◽  
Field Enhancement ◽  
Feature Representation ◽  
Detection Accuracy ◽  
Convolutional Network ◽  
Remote Sensing Imagery ◽  
Multi Scale ◽  
One Stage

With great significance in military and civilian applications, the topic of detecting small and densely arranged objects in wide-scale remote sensing imagery is still challenging nowadays. To solve this problem, we propose a novel effectively optimized one-stage network (NEOON). As a fully convolutional network, NEOON consists of four parts: Feature extraction, feature fusion, feature enhancement, and multi-scale detection. To extract effective features, the first part has implemented bottom-up and top-down coherent processing by taking successive down-sampling and up-sampling operations in conjunction with residual modules. The second part consolidates high-level and low-level features by adopting concatenation operations with subsequent convolutional operations to explicitly yield strong feature representation and semantic information. The third part is implemented by constructing a receptive field enhancement (RFE) module and incorporating it into the fore part of the network where the information of small objects exists. The final part is achieved by four detectors with different sensitivities accessing the fused features, all four parallel, to enable the network to make full use of information of objects in different scales. Besides, the Focal Loss is set to enable the cross entropy for classification to solve the tough problem of class imbalance in one-stage methods. In addition, we introduce the Soft-NMS to preserve accurate bounding boxes in the post-processing stage especially for densely arranged objects. Note that the split and merge strategy and multi-scale training strategy are employed in training. Thorough experiments are performed on ACS datasets constructed by us and NWPU VHR-10 datasets to evaluate the performance of NEOON. Specifically, 4.77% and 5.50% improvements in mAP and recall, respectively, on the ACS dataset as compared to YOLOv3 powerfully prove that NEOON can effectually improve the detection accuracy of small objects in remote sensing imagery. In addition, extensive experiments and comprehensive evaluations on the NWPU VHR-10 dataset with 10 classes have illustrated the superiority of NEOON in the extraction of spatial information of high-resolution remote sensing images.

scholarly journals DB-YOLO: A Duplicate Bilateral YOLO Network for Multi-Scale Ship Detection in SAR Images

Sensors ◽  
2021 ◽  
Vol 21 (23) ◽  
pp. 8146
Author(s):  
Haozhen Zhu ◽  
Yao Xie ◽  
Huihui Huang ◽  
Chen Jing ◽  
Yingjiao Rong ◽  
...  
Keyword(s):  
Real Time ◽  
Spatial Information ◽  
Detection Methods ◽  
Small Scale ◽  
Sar Images ◽  
Ship Detection ◽  
Multi Scale ◽  
Real Time Detection ◽  
Bounding Boxes ◽  
Improving Accuracy

With the wide application of convolutional neural networks (CNNs), a variety of ship detection methods based on CNNs in synthetic aperture radar (SAR) images were proposed, but there are still two main challenges: (1) Ship detection requires high real-time performance, and a certain detection speed should be ensured while improving accuracy; (2) The diversity of ships in SAR images requires more powerful multi-scale detectors. To address these issues, a SAR ship detector called Duplicate Bilateral YOLO (DB-YOLO) is proposed in this paper, which is composed of a Feature Extraction Network (FEN), Duplicate Bilateral Feature Pyramid Network (DB-FPN) and Detection Network (DN). Firstly, a single-stage network is used to meet the need of real-time detection, and the cross stage partial (CSP) block is used to reduce the redundant parameters. Secondly, DB-FPN is designed to enhance the fusion of semantic and spatial information. In view of the ships in SAR image are mainly distributed with small-scale targets, the distribution of parameters and computation values between FEN and DB-FPN in different feature layers is redistributed to solve the multi-scale detection. Finally, the bounding boxes and confidence scores are given through the detection head of YOLO. In order to evaluate the effectiveness and robustness of DB-YOLO, comparative experiments with the other six state-of-the-art methods (Faster R-CNN, Cascade R-CNN, Libra R-CNN, FCOS, CenterNet and YOLOv5s) on two SAR ship datasets, i.e., SSDD and HRSID, are performed. The experimental results show that the AP50 of DB-YOLO reaches 97.8% on SSDD and 94.4% on HRSID, respectively. DB-YOLO meets the requirement of real-time detection (48.1 FPS) and is superior to other methods in the experiments.

scholarly journals HDRANet: Hybrid Dilated Residual Attention Network for SAR Image Despeckling

2019 ◽  
Vol 11 (24) ◽  
pp. 2921 ◽  
Author(s):  
Jingyu Li ◽  
Ying Li ◽  
Yayuan Xiao ◽  
Yunpeng Bai
Keyword(s):  
Network Architecture ◽  
State Of The Art ◽  
Speckle Noise ◽  
Superior Performance ◽  
Synthetic Aperture ◽  
Sar Images ◽  
Attention Network ◽  
Quantitative Metrics ◽  
Proposed Model ◽  
And Performance

In order to remove speckle noise from original synthetic aperture radar (SAR) images effectively and efficiently, this paper proposes a hybrid dilated residual attention network (HDRANet) with residual learning for SAR despeckling. Firstly, HDRANet employs the hybrid dilated convolution (HDC) in lightweight network architecture to enlarge the receptive field and aggregate global information. Then, a simple yet effective attention module, convolutional block attention module (CBAM), is integrated into the proposed model to constitute a residual HDC attention block through skip connection, which further enhances representation power and performance of the model. Extensive experimental results on the synthetic and real SAR images demonstrate the superior performance of HDRANet over the state-of-the-art methods in terms of quantitative metrics and visual quality.

scholarly journals Integrating Weighted Feature Fusion and the Spatial Attention Module with Convolutional Neural Networks for Automatic Aircraft Detection from SAR Images

2021 ◽  
Vol 13 (5) ◽  
pp. 910
Author(s):  
Jielan Wang ◽  
Hongguang Xiao ◽  
Lifu Chen ◽  
Jin Xing ◽  
Zhouhao Pan ◽  
...  
Keyword(s):  
Neural Networks ◽  
Spatial Attention ◽  
Large Scale ◽  
Feature Fusion ◽  
Background Information ◽  
Test Time ◽  
Detection Accuracy ◽  
Sar Images ◽  
Airport Runway ◽  
Aircraft Detection

The automatic detection of aircrafts from SAR images is widely applied in both military and civil fields, but there are still considerable challenges. To address the high variety of aircraft sizes and complex background information in SAR images, a new fast detection framework based on convolution neural networks is proposed, which achieves automatic and rapid detection of aircraft with high accuracy. First, the airport runway areas are detected to generate the airport runway mask and rectangular contour of the whole airport are generated. Then, a new deep neural network proposed in this paper, named Efficient Weighted Feature Fusion and Attention Network (EWFAN), is used to detect aircrafts. EWFAN integrates the weighted feature fusion module, the spatial attention mechanism, and the CIF loss function. EWFAN can effectively reduce the interference of negative samples and enhance feature extraction, thereby significantly improving the detection accuracy. Finally, the airport runway mask is applied to the detected results to reduce false alarms and produce the final aircraft detection results. To evaluate the performance of the proposed framework, large-scale Gaofen-3 SAR images with 1 m resolution are utilized in the experiment. The detection rate and false alarm rate of our EWFAN algorithm are 95.4% and 3.3%, respectively, which outperforms Efficientdet and YOLOv4. In addition, the average test time with the proposed framework is only 15.40 s, indicating satisfying efficiency of automatic aircraft detection.

Sign in / Sign up

Export Citation Format

Share Document