scholarly journals Lightweight Ship Detection Methods Based on YOLOv3 and DenseNet

2020 ◽  
Vol 2020 ◽  
pp. 1-10
Author(s):  
Zhelin Li ◽  
Lining Zhao ◽  
Xu Han ◽  
Mingyang Pan ◽  
Feng-Jang Hwang
Keyword(s):  
Spatial Separation ◽  
Experimental Results ◽  
Detection Methods ◽  
Automatic Identification ◽  
Identification System ◽  
Ship Detection ◽  
Detection Model ◽  
Backbone Network ◽  
Time Requirements ◽  
Detection Speed

Ship detection is one of the most important research contents of ship intelligent navigation and monitoring. As a supplement to classical navigational equipment such as radar and the Automatic Identification System (AIS), target detection based on computer vision and deep learning has become a new important method. A target detector called YOLOv3 has the advantages of detection speed and accuracy and meets the real-time requirements for ship detection. However, YOLOv3 has a large number of backbone network parameters and requires high hardware performance, which is not conducive to the popularization of applications. On the basis of YOLOv3, this paper proposes a lightweight ship detection model (LSDM) in which the backbone network is improved by using dense connection inspired from DenseNet, and the feature pyramid networks are improved by using spatial separation convolution to replace normal convolution. The two improvements reduce parameters and optimize the network structure greatly. The experimental results show that, with only one-third of parameters of YOLOv3, the LSDM has higher accuracy and speed for ship detection. In addition, the LSDM is simplified further by reducing the number of densely connected units to form a model called LSDM-tiny. The experimental results show that, LSDM-tiny has similar detection speed with YOLOv3-tiny, but has a lot higher accuracy.

scholarly journals LS-SSDD-v1.0: A Deep Learning Dataset Dedicated to Small Ship Detection from Large-Scale Sentinel-1 SAR Images

2020 ◽  
Vol 12 (18) ◽  
pp. 2997 ◽  
Author(s):  
Tianwen Zhang ◽  
Xiaoling Zhang ◽  
Xiao Ke ◽  
Xu Zhan ◽  
Jun Shi ◽  
...  
Keyword(s):  
Deep Learning ◽  
Large Scale ◽  
Google Earth ◽  
Detection Methods ◽  
False Alarms ◽  
Automatic Identification ◽  
Identification System ◽  
Sar Images ◽  
Ship Detection ◽  
Small Ship

Ship detection in synthetic aperture radar (SAR) images is becoming a research hotspot. In recent years, as the rise of artificial intelligence, deep learning has almost dominated SAR ship detection community for its higher accuracy, faster speed, less human intervention, etc. However, today, there is still a lack of a reliable deep learning SAR ship detection dataset that can meet the practical migration application of ship detection in large-scene space-borne SAR images. Thus, to solve this problem, this paper releases a Large-Scale SAR Ship Detection Dataset-v1.0 (LS-SSDD-v1.0) from Sentinel-1, for small ship detection under large-scale backgrounds. LS-SSDD-v1.0 contains 15 large-scale SAR images whose ground truths are correctly labeled by SAR experts by drawing support from the Automatic Identification System (AIS) and Google Earth. To facilitate network training, the large-scale images are directly cut into 9000 sub-images without bells and whistles, providing convenience for subsequent detection result presentation in large-scale SAR images. Notably, LS-SSDD-v1.0 has five advantages: (1) large-scale backgrounds, (2) small ship detection, (3) abundant pure backgrounds, (4) fully automatic detection flow, and (5) numerous and standardized research baselines. Last but not least, combined with the advantage of abundant pure backgrounds, we also propose a Pure Background Hybrid Training mechanism (PBHT-mechanism) to suppress false alarms of land in large-scale SAR images. Experimental results of ablation study can verify the effectiveness of the PBHT-mechanism. LS-SSDD-v1.0 can inspire related scholars to make extensive research into SAR ship detection methods with engineering application value, which is conducive to the progress of SAR intelligent interpretation technology.

scholarly journals Automated Procurement of Training Data for Machine Learning Algorithm on Ship Detection Using AIS Information

2020 ◽  
Vol 12 (9) ◽  
pp. 1443
Author(s):  
Juyoung Song ◽  
Duk-jin Kim ◽  
Ki-mook Kang
Keyword(s):  
Learning Algorithm ◽  
Doppler Frequency ◽  
Training Model ◽  
Training Data ◽  
Automatic Identification ◽  
Identification System ◽  
Visual Interpretation ◽  
Sar Images ◽  
Ship Detection ◽  
Detection Model

Development of convolutional neural network (CNN) optimized for object detection, led to significant developments in ship detection. Although training data critically affect the performance of the CNN-based training model, previous studies focused mostly on enhancing the architecture of the training model. This study developed a sophisticated and automatic methodology to generate verified and robust training data by employing synthetic aperture radar (SAR) images and automatic identification system (AIS) data. The extraction of training data initiated from interpolating the discretely received AIS positions to the exact position of the ship at the time of image acquisition. The interpolation was conducted by applying a Kalman filter, followed by compensating the Doppler frequency shift. The bounding box for the ship was constructed tightly considering the installation of the AIS equipment and the exact size of the ship. From 18 Sentinel-1 SAR images using a completely automated procedure, 7489 training data were obtained, compared with a different set of training data from visual interpretation. The ship detection model trained using the automatic training data obtained 0.7713 of overall detection performance from 3 Sentinel-1 SAR images, which exceeded that of manual training data, evading the artificial structures of harbors and azimuth ambiguity ghost signals from detection.

scholarly journals Improved Testing of AI-Based Anomaly Detection Systems Using Synthetic Surveillance Data

Proceedings ◽  
2020 ◽  
Vol 59 (1) ◽  
pp. 9
Author(s):  
Antoine Chevrot ◽  
Alexandre Vernotte ◽  
Pierre Bernabe ◽  
Aymeric Cretin ◽  
Fabien Peureux ◽  
...  
Keyword(s):  
Anomaly Detection ◽  
Cyber Security ◽  
Surveillance Data ◽  
Automatic Identification ◽  
Identification System ◽  
Surveillance Systems ◽  
Sea Transport ◽  
Detection Model ◽  
Detection Systems ◽  
Anomalous Data

Major transportation surveillance protocols have not been specified with cyber security in mind and therefore provide no encryption nor identification. These issues expose air and sea transport to false data injection attacks (FDIAs), in which an attacker modifies, blocks or emits fake surveillance messages to dupe controllers and surveillance systems. There has been growing interest in conducting research on machine learning-based anomaly detection systems that address these new threats. However, significant amounts of data are needed to achieve meaningful results with this type of model. Raw, genuine data can be obtained from existing databases but need to be preprocessed before being fed to a model. Acquiring anomalous data is another challenge: such data is much too scarce for both the Automatic Dependent Surveillance–Broadcast (ADS-B) and the Automatic Identification System (AIS). Crafting anomalous data by hand, which has been the sole method applied to date, is hardly suitable for broad detection model testing. This paper proposes an approach built upon existing libraries and ideas that offers ML researchers the necessary tools to facilitate the access and processing of genuine data as well as to automatically generate synthetic anomalous surveillance data to constitute broad, elaborated test datasets. We demonstrate the usability of the approach by discussing work in progress that includes the reproduction of related work, creation of relevant datasets and design of advanced anomaly detection models for both domains of application.

scholarly journals Large-Scale Automatic Vessel Monitoring Based on Dual-Polarization Sentinel-1 and AIS Data

2019 ◽  
Vol 11 (9) ◽  
pp. 1078 ◽  
Author(s):  
Ramona Pelich ◽  
Marco Chini ◽  
Renaud Hostache ◽  
Patrick Matgen ◽  
Carlos Lopez-Martinez ◽  
...  
Keyword(s):  
Detection Rate ◽  
Large Scale ◽  
Added Value ◽  
Automatic Identification ◽  
Identification System ◽  
Dual Polarization ◽  
Ship Detection ◽  
Traffic Conditions ◽  
Intensity Images ◽  
Polarization Channel

This research addresses the use of dual-polarimetric descriptors for automatic large-scale ship detection and characterization from synthetic aperture radar (SAR) data. Ship detection is usually performed independently on each polarization channel and the detection results are merged subsequently. In this study, we propose to make use of the complex coherence between the two polarization channels of Sentinel-1 and to perform vessel detection in this domain. Therefore, an automatic algorithm, based on the dual-polarization coherence, and applicable to entire large scale SAR scenes in a timely manner, is developed. Automatic identification system (AIS) data are used for an extensive and also large scale cross-comparison with the SAR-based detections. The comparative assessment allows us to evaluate the added-value of the dual-polarization complex coherence, with respect to SAR intensity images in ship detection, as well as the SAR detection performances depending on a vessel’s size. The proposed methodology is justified statistically and tested on Sentinel-1 data acquired over two different and contrasting, in terms of traffic conditions, areas: the English Channel the and Pacific coastline of Mexico. The results indicate a very high SAR detection rate, i.e., >80%, for vessels larger than 60 m and a decrease of detection rate up to 40 % for smaller size vessels. In addition, the analysis highlights many SAR detections without corresponding AIS positions, indicating the complementarity of SAR with respect to cooperative sources for detecting dark vessels.

scholarly journals Ship Detection Based on YOLOv2 for SAR Imagery

2019 ◽  
Vol 11 (7) ◽  
pp. 786 ◽  
Author(s):  
Yang-Lang Chang ◽  
Amare Anagaw ◽  
Lena Chang ◽  
Yi Wang ◽  
Chih-Yu Hsiao ◽  
...  
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Real Time ◽  
Experimental Results ◽  
Detection Methods ◽  
Computational Time ◽  
Detection Accuracy ◽  
Single Shot ◽  
Ship Detection ◽  
Sar Imagery

Synthetic aperture radar (SAR) imagery has been used as a promising data source for monitoring maritime activities, and its application for oil and ship detection has been the focus of many previous research studies. Many object detection methods ranging from traditional to deep learning approaches have been proposed. However, majority of them are computationally intensive and have accuracy problems. The huge volume of the remote sensing data also brings a challenge for real time object detection. To mitigate this problem a high performance computing (HPC) method has been proposed to accelerate SAR imagery analysis, utilizing the GPU based computing methods. In this paper, we propose an enhanced GPU based deep learning method to detect ship from the SAR images. The You Only Look Once version 2 (YOLOv2) deep learning framework is proposed to model the architecture and training the model. YOLOv2 is a state-of-the-art real-time object detection system, which outperforms Faster Region-Based Convolutional Network (Faster R-CNN) and Single Shot Multibox Detector (SSD) methods. Additionally, in order to reduce computational time with relatively competitive detection accuracy, we develop a new architecture with less number of layers called YOLOv2-reduced. In the experiment, we use two types of datasets: A SAR ship detection dataset (SSDD) dataset and a Diversified SAR Ship Detection Dataset (DSSDD). These two datasets were used for training and testing purposes. YOLOv2 test results showed an increase in accuracy of ship detection as well as a noticeable reduction in computational time compared to Faster R-CNN. From the experimental results, the proposed YOLOv2 architecture achieves an accuracy of 90.05% and 89.13% on the SSDD and DSSDD datasets respectively. The proposed YOLOv2-reduced architecture has a similarly competent detection performance as YOLOv2, but with less computational time on a NVIDIA TITAN X GPU. The experimental results shows that the deep learning can make a big leap forward in improving the performance of SAR image ship detection.

scholarly journals Ship Identification and Characterization in Sentinel-1 SAR Images with Multi-Task Deep Learning

2019 ◽  
Vol 11 (24) ◽  
pp. 2997 ◽  
Author(s):  
Clément Dechesne ◽  
Sébastien Lefèvre ◽  
Rodolphe Vadaine ◽  
Guillaume Hajduch ◽  
Ronan Fablet
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Network Architecture ◽  
Large Scale ◽  
Visual Analysis ◽  
Automatic Identification ◽  
Identification System ◽  
Human Observer ◽  
Convolutional Network ◽  
Ship Detection

The monitoring and surveillance of maritime activities are critical issues in both military and civilian fields, including among others fisheries’ monitoring, maritime traffic surveillance, coastal and at-sea safety operations, and tactical situations. In operational contexts, ship detection and identification is traditionally performed by a human observer who identifies all kinds of ships from a visual analysis of remotely sensed images. Such a task is very time consuming and cannot be conducted at a very large scale, while Sentinel-1 SAR data now provide a regular and worldwide coverage. Meanwhile, with the emergence of GPUs, deep learning methods are now established as state-of-the-art solutions for computer vision, replacing human intervention in many contexts. They have been shown to be adapted for ship detection, most often with very high resolution SAR or optical imagery. In this paper, we go one step further and investigate a deep neural network for the joint classification and characterization of ships from SAR Sentinel-1 data. We benefit from the synergies between AIS (Automatic Identification System) and Sentinel-1 data to build significant training datasets. We design a multi-task neural network architecture composed of one joint convolutional network connected to three task specific networks, namely for ship detection, classification, and length estimation. The experimental assessment shows that our network provides promising results, with accurate classification and length performance (classification overall accuracy: 97.25%, mean length error: 4.65 m ± 8.55 m).

A Beam Scanning Method based on the Helical Antenna for Space-based AIS

2014 ◽  
Vol 68 (1) ◽  
pp. 52-70 ◽  
Author(s):  
Yun Cheng ◽  
Lihu Chen ◽  
Xiaoqian Chen
Keyword(s):  
Detection Probability ◽  
Automatic Identification ◽  
Identification System ◽  
Helical Antenna ◽  
Beam Scanning ◽  
Scanning Method ◽  
Ship Detection ◽  
Low Earth Orbits ◽  
Earth Orbits ◽  
Scanning Antenna

We investigate a strategy to address the problem of low ship detection probability of space-based Automatic Identification System (AIS). A directional AIS antenna and an innovative beam scanning method are proposed, which scan the antenna across a wide swath to provide complete coverage and maintain the advantage of a narrow footprint to reduce signal collision. Aiming at the mission requirement of global ship detection by the year 2016, the appropriate swath, the scanning range and the scanning rate were studied and designed in detail. Theoretical analysis and simulations showed that this scanning antenna can greatly improve ship detection probability and hold the detection probability at an average reporting interval from six to 15 seconds for most oceans when compared with the traditional fixed wide beam antenna. Furthermore, the detection capacity of this scanning antenna was little affected by the heights of different Low Earth Orbits. The results of this work show that the design of the helical antenna along with the beam scanning method can be considered as a building block of future space-based AIS.

scholarly journals End-to-End Ship Detection in SAR Images for Complex Scenes Based on Deep CNNs

2021 ◽  
Vol 2021 ◽  
pp. 1-19
Author(s):  
Yao Chen ◽  
Tao Duan ◽  
Changyuan Wang ◽  
Yuanyuan Zhang ◽  
Mo Huang
Keyword(s):  
Data Augmentation ◽  
Feature Fusion ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Deep Convolutional Neural Networks ◽  
Sar Images ◽  
Ship Detection ◽  
End To End ◽  
Sar Imagery ◽  
Detection Speed

Ship detection on synthetic aperture radar (SAR) imagery has many valuable applications for both civil and military fields and has received extraordinary attention in recent years. The traditional detection methods are insensitive to multiscale ships and usually time-consuming, results in low detection accuracy and limitation for real-time processing. To balance the accuracy and speed, an end-to-end ship detection method for complex inshore and offshore scenes based on deep convolutional neural networks (CNNs) is proposed in this paper. First, the SAR images are divided into different grids, and the anchor boxes are predefined based on the responsible grids for dense ship prediction. Then, Darknet-53 with residual units is adopted as a backbone to extract features, and a top-down pyramid structure is added for multiscale feature fusion with concatenation. By this means, abundant hierarchical features containing both spatial and semantic information are extracted. Meanwhile, the strategies such as soft non-maximum suppression (Soft-NMS), mix-up and mosaic data augmentation, multiscale training, and hybrid optimization are used for performance enhancement. Besides, the model is trained from scratch to avoid learning objective bias of pretraining. The proposed one-stage method adopts end-to-end inference by a single network, so the detection speed can be guaranteed due to the concise paradigm. Extensive experiments are performed on the public SAR ship detection dataset (SSDD), and the results show that the method can detect both inshore and offshore ships with higher accuracy than other mainstream methods, yielding the accuracy with an average of 95.52%, and the detection speed is quite fast with about 72 frames per second (FPS). The actual Sentinel-1 and Gaofen-3 data are utilized for verification, and the detection results also show the effectiveness and robustness of the method.

scholarly journals DEEP LEARNING FOR VESSEL DETECTION AND IDENTIFICATION FROM SPACEBORNE OPTICAL IMAGERY

2021 ◽  
Vol V-3-2021 ◽  
pp. 303-310
Author(s):  
G. Matasci ◽  
J. Plante ◽  
K. Kasa ◽  
P. Mousavi ◽  
A. Stewart ◽  
...  
Keyword(s):  
Deep Learning ◽  
Large Scale ◽  
Input Image ◽  
Automatic Identification ◽  
Identification System ◽  
Optical Remote Sensing ◽  
Detection Model ◽  
Model Based ◽  
Optical Images ◽  
Vessel Detection

Abstract. We present a deep learning-based vessel detection and (re-)identification approach from spaceborne optical images. We introduce these two components as part of a maritime surveillance from space pipeline and present experimental results on challenging real-world maritime datasets derived from WorldView imagery. First, we developed a vessel detection model based on RetinaNet achieving a performance of 0.795 F1-score on a challenging multi-scale dataset. We then collected a large-scale dataset for vessel identification by applying the detection model on 200+ optical images, detecting the vessels therein and assigning them an identity via an Automatic Identification System association framework. A vessel re-identification model based on Twin neural networks has then been trained on this dataset featuring 2500+ unique vessels with multiple repeated occurrences across different acquisitions. The model allows to naturally establish similarities between vessel images. It returns a relevant ranking of candidate vessels from a database when provided an input image for a specific vessel the user might be interested in, with top-1 and top-10 accuracies of 38.7% and 76.5%, respectively. This study demonstrates the potential offered by the latest advances in deep learning and computer vision when applied to optical remote sensing imagery in a maritime context, opening new opportunities for automated vessel monitoring and tracking capabilities from space.

Sign in / Sign up

Export Citation Format

Share Document