scholarly journals Improved YOLOv3 Based on Attention Mechanism for Fast and Accurate Ship Detection in Optical Remote Sensing Images

2021 ◽  
Vol 13 (4) ◽  
pp. 660
Author(s):  
Liqiong Chen ◽  
Wenxuan Shi ◽  
Dexiang Deng
Keyword(s):  
Remote Sensing ◽  
High Efficiency ◽  
Attention Mechanism ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Ship Detection ◽  
Maritime Surveillance ◽  
Detection Speed

Ship detection is an important but challenging task in the field of computer vision, partially due to the minuscule ship objects in optical remote sensing images and the interference of clouds occlusion and strong waves. Most of the current ship detection methods focus on boosting detection accuracy while they may ignore the detection speed. However, it is also indispensable to increase ship detection speed because it can provide timely ocean rescue and maritime surveillance. To solve the above problems, we propose an improved YOLOv3 (ImYOLOv3) based on attention mechanism, aiming to achieve the best trade-off between detection accuracy and speed. First, to realize high-efficiency ship detection, we adopt the off-the-shelf YOLOv3 as our basic detection framework due to its fast speed. Second, to boost the performance of original YOLOv3 for small ships, we design a novel and lightweight dilated attention module (DAM) to extract discriminative features for ship targets, which can be easily embedded into the basic YOLOv3. The integrated attention mechanism can help our model learn to suppress irrelevant regions while highlighting salient features useful for ship detection task. Furthermore, we introduce a multi-class ship dataset (MSD) and explicitly set supervised subclass according to the scales and moving states of ships. Extensive experiments verify the effectiveness and robustness of ImYOLOv3, and show that our method can accurately detect ships with different scales in different backgrounds, while at a real-time speed.

scholarly journals Explore the application of high-resolution nighttime light remote sensing images in nighttime marine ship detection: A case study of LJ1-01 data

2020 ◽  
Vol 12 (1) ◽  
pp. 1169-1184
Author(s):  
Liang Zhong ◽  
Xiaosheng Liu ◽  
Peng Yang ◽  
Rizhi Lin
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Infrared Imaging ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Constant False Alarm Rate ◽  
Remote Sensing Images ◽  
Ship Detection ◽  
Application Potential ◽  
Nighttime Light

AbstractNighttime light remote sensing images show significant application potential in marine ship monitoring, but in areas where ships are densely distributed, the detection accuracy of the current methods is still limited. This article considered the LJ1-01 data as an example, compared with the National Polar-orbiting Partnership (NPP)/Visible Infrared Imaging Radiometer Suite (VIIRS) data, and explored the application of high-resolution nighttime light images in marine ship detection. The radiation values of the aforementioned two images were corrected to achieve consistency, and the interference light sources of the ship light were filtered. Then, when the threshold segmentation and two-parameter constant false alarm rate methods are combined, the ships’ location information was with obtained, and the reliability of the results was analyzed. The results show that the LJ1-01 data can not only record more potential ship light but also distinguish the ship light and background noise in the data. The detection accuracy of the LJ1-01 data in both ship detection methods is significantly higher than that of the NPP/VIIRS data. This study analyzes the characteristics, performance, and application potential of the high-resolution nighttime light data in the detection of marine vessels. The relevant results can provide a reference for the high-precision monitoring of nighttime marine ships.

scholarly journals A Novel Coarse-to-Fine Method of Ship Detection in Optical Remote Sensing Images Based on a Deep Residual Dense Network

2020 ◽  
Vol 12 (19) ◽  
pp. 3115 ◽  
Author(s):  
Liqiong Chen ◽  
Wenxuan Shi ◽  
Cien Fan ◽  
Lian Zou ◽  
Dexiang Deng
Keyword(s):  
Remote Sensing ◽  
Large Scale ◽  
False Alarms ◽  
Discrete Wavelet ◽  
Detection Accuracy ◽  
Optical Remote Sensing ◽  
Dense Network ◽  
Remote Sensing Images ◽  
Ship Detection ◽  
Coarse To Fine

Automatic ship detection in optical remote sensing images is of great significance due to its broad applications in maritime security and fishery control. Most ship detection algorithms utilize a single-band image to design low-level and hand-crafted features, which are easily influenced by interference like clouds and strong waves and not robust for large-scale variation of ships. In this paper, we propose a novel coarse-to-fine ship detection method based on discrete wavelet transform (DWT) and a deep residual dense network (DRDN) to address these problems. First, multi-spectral images are adopted for sea-land segmentation, and an enhanced DWT is employed to quickly extract ship candidate regions with missing alarms as low as possible. Second, panchromatic images with clear spatial details are used for ship classification. Specifically, we propose the local residual dense block (LRDB) to fully extract semantic feature via local residual connection and densely connected convolutional layers. DRDN mainly consists of four LRDBs and is designed to further remove false alarms. Furthermore, we exploit the multiclass classification strategy, which can overcome the large intra-class difference of targets and identify ships of different sizes. Extensive experiments demonstrate that the proposed method has high robustness in complex image backgrounds and achieves higher detection accuracy than other state-of-the-art methods.

scholarly journals A Coarse-to-Fine Network for Ship Detection in Optical Remote Sensing Images

2020 ◽  
Vol 12 (2) ◽  
pp. 246 ◽  
Author(s):  
Yue Wu ◽  
Wenping Ma ◽  
Maoguo Gong ◽  
Zhuangfei Bai ◽  
Wei Zhao ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Detection Methods ◽  
False Alarms ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Ship Detection ◽  
Detection Strategy ◽  
Image Pixels ◽  
Bounding Boxes ◽  
Coarse To Fine

With the increasing resolution of optical remote sensing images, ship detection in optical remote sensing images has attracted a lot of research interests. The current ship detection methods usually adopt the coarse-to-fine detection strategy, which firstly extracts low-level and manual features, and then performs multi-step training. Inadequacies of this strategy are that it would produce complex calculation, false detection on land and difficulty in detecting the small size ship. Aiming at these problems, a sea-land separation algorithm that combines gradient information and gray information is applied to avoid false alarms on land, the feature pyramid network (FPN) is used to achieve small ship detection, and a multi-scale detection strategy is proposed to achieve ship detection with different degrees of refinement. Then the feature extraction structure is adopted to fuse different hierarchical features to improve the representation ability of features. Finally, we propose a new coarse-to-fine ship detection network (CF-SDN) that directly achieves an end-to-end mapping from image pixels to bounding boxes with confidences. A coarse-to-fine detection strategy is applied to improve the classification ability of the network. Experimental results on optical remote sensing image set indicate that the proposed method outperforms the other excellent detection algorithms and achieves good detection performance on images including some small-sized ships and dense ships near the port.

scholarly journals Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images

2020 ◽  
Vol 12 (15) ◽  
pp. 2416 ◽  
Author(s):  
Zhuangzhuang Tian ◽  
Ronghui Zhan ◽  
Jiemin Hu ◽  
Wei Wang ◽  
Zhiqiang He ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Attention Mechanism ◽  
Detection Methods ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Feature Maps ◽  
Wide Range ◽  
Feature Pyramid ◽  
Comprehensive Evaluations

Nowadays, object detection methods based on deep learning are applied more and more to the interpretation of optical remote sensing images. However, the complex background and the wide range of object sizes in remote sensing images increase the difficulty of object detection. In this paper, we improve the detection performance by combining the attention information, and generate adaptive anchor boxes based on the attention map. Specifically, the attention mechanism is introduced into the proposed method to enhance the features of the object regions while reducing the influence of the background. The generated attention map is then used to obtain diverse and adaptable anchor boxes using the guided anchoring method. The generated anchor boxes can match better with the scene and the objects, compared with the traditional proposal boxes. Finally, the modulated feature adaptation module is applied to transform the feature maps to adapt to the diverse anchor boxes. Comprehensive evaluations on the DIOR dataset demonstrate the superiority of the proposed method over the state-of-the-art methods, such as RetinaNet, FCOS and CornerNet. The mean average precision of the proposed method is 4.5% higher than the feature pyramid network. In addition, the ablation experiments are also implemented to further analyze the respective influence of different blocks on the performance improvement.

scholarly journals Ship Detection in Panchromatic Optical Remote Sensing Images Based on Visual Saliency and Multi-Dimensional Feature Description

2020 ◽  
Vol 12 (1) ◽  
pp. 152 ◽  
Author(s):  
Ting Nie ◽  
Xiyu Han ◽  
Bin He ◽  
Xiansheng Li ◽  
Hongxing Liu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Fourier Transform ◽  
Detection Method ◽  
Saliency Detection ◽  
Visual Saliency ◽  
Saliency Map ◽  
False Alarms ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Ship Detection

Ship detection in panchromatic optical remote sensing images is faced with two major challenges, locating candidate regions from complex backgrounds quickly and describing ships effectively to reduce false alarms. Here, a practical method was proposed to solve these issues. Firstly, we constructed a novel visual saliency detection method based on a hyper-complex Fourier transform of a quaternion to locate regions of interest (ROIs), which can improve the accuracy of the subsequent discrimination process for panchromatic images, compared with the phase spectrum quaternary Fourier transform (PQFT) method. In addition, the Gaussian filtering of different scales was performed on the transformed result to synthesize the best saliency map. An adaptive method based on GrabCut was then used for binary segmentation to extract candidate positions. With respect to the discrimination stage, a rotation-invariant modified local binary pattern (LBP) description was achieved by combining shape, texture, and moment invariant features to describe the ship targets more powerfully. Finally, the false alarms were eliminated through SVM training. The experimental results on panchromatic optical remote sensing images demonstrated that the presented saliency model under various indicators is superior, and the proposed ship detection method is accurate and fast with high robustness, based on detailed comparisons to existing efforts.

scholarly journals Ship Detection and Classification on Optical Remote Sensing Images Using Deep Learning

2017 ◽  
Vol 12 ◽  
pp. 05012 ◽  
Author(s):  
Ying Liu ◽  
Hong-Yuan Cui ◽  
Zheng Kuang ◽  
Guo-Qing Li
Keyword(s):  
Remote Sensing ◽  
Deep Learning ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Ship Detection

scholarly journals Ship Target Automatic Detection Based on Hypercomplex Flourier Transform Saliency Model in High Spatial Resolution Remote-Sensing Images

Sensors ◽  
2020 ◽  
Vol 20 (9) ◽  
pp. 2536 ◽  
Author(s):  
Jian He ◽  
Yongfei Guo ◽  
Hangfei Yuan
Keyword(s):  
Remote Sensing ◽  
Spatial Resolution ◽  
Detection Efficiency ◽  
Detection System ◽  
Automatic Detection ◽  
Sea Surface ◽  
Detection Methods ◽  
Remote Sensing Images ◽  
Ship Detection ◽  
Saliency Model

Efficient ship detection is essential to the strategies of commerce and military. However, traditional ship detection methods have low detection efficiency and poor reliability due to uncertain conditions of the sea surface, such as the atmosphere, illumination, clouds and islands. Hence, in this study, a novel ship target automatic detection system based on a modified hypercomplex Flourier transform (MHFT) saliency model is proposed for spatial resolution of remote-sensing images. The method first utilizes visual saliency theory to effectively suppress sea surface interference. Then we use OTSU methods to extract regions of interest. After obtaining the candidate ship target regions, we get the candidate target using a method of ship target recognition based on ResNet framework. This method has better accuracy and better performance for the recognition of ship targets than other methods. The experimental results show that the proposed method not only accurately and effectively recognizes ship targets, but also is suitable for spatial resolution of remote-sensing images with complex backgrounds.

Sign in / Sign up

Export Citation Format

Share Document