scholarly journals On-Board Real-Time Ship Detection in HISEA-1 SAR Images Based on CFAR and Lightweight Deep Learning

2021 ◽  
Vol 13 (10) ◽  
pp. 1995
Author(s):  
Pan Xu ◽  
Qingyang Li ◽  
Bo Zhang ◽  
Fan Wu ◽  
Ke Zhao ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Deep Learning ◽  
Real Time ◽  
Weather Conditions ◽  
Processing Unit ◽  
Constant False Alarm Rate ◽  
Remote Sensing Images ◽  
Detection Scheme ◽  
Ship Detection ◽  
Emergency Situations

Synthetic aperture radar (SAR) satellites produce large quantities of remote sensing images that are unaffected by weather conditions and, therefore, widely used in marine surveillance. However, because of the hysteresis of satellite-ground communication and the massive quantity of remote sensing images, rapid analysis is not possible and real-time information for emergency situations is restricted. To solve this problem, this paper proposes an on-board ship detection scheme that is based on the traditional constant false alarm rate (CFAR) method and lightweight deep learning. This scheme can be used by the SAR satellite on-board computing platform to achieve near real-time image processing and data transmission. First, we use CFAR to conduct the initial ship detection and then apply the You Only Look Once version 4 (YOLOv4) method to obtain more accurate final results. We built a ground verification system to assess the feasibility of our scheme. With the help of the embedded Graphic Processing Unit (GPU) with high integration, our method achieved 85.9% precision for the experimental data, and the experimental results showed that the processing time was nearly half that required by traditional methods.

scholarly journals On-Board Ship Detection in Micro-Nano Satellite Based on Deep Learning and COTS Component

2019 ◽  
Vol 11 (7) ◽  
pp. 762 ◽  
Author(s):  
Yuan Yao ◽  
Zhiguo Jiang ◽  
Haopeng Zhang ◽  
Yu Zhou
Keyword(s):  
Remote Sensing ◽  
Deep Learning ◽  
High Performance ◽  
Detection Algorithm ◽  
Remote Sensing Images ◽  
Detection Scheme ◽  
Ship Detection ◽  
Computing Platform ◽  
Low Efficiency ◽  
Board Ship

Micro-nano satellites have provided a large amount of remote sensing images for many earth observation applications. However, the hysteresis of satellite-ground mutual communication of massive remote sensing images and the low efficiency of traditional information processing flow have become the bottlenecks for the further development of micro-nano satellites. To solve this problem, this paper proposes an on-board ship detection scheme based on deep learning and Commercial Off-The-Shelf (COTS) component, which can be used to achieve near real-time on-board processing by micro-nano satellite computing platform. The on-board ship detection algorithm based on deep learning consists of a feature extraction network, Region Proposal Network (RPN) with square anchors, Global Average Pooling (GAP), and Bigger-Left Non-Maximum Suppression (BL-NMS). With the help of high performance COTS components, the proposed scheme can extract target patches and valuable information from remote sensing images quickly and accurately. A ground demonstration and verification system is built to verify the feasibility and effectiveness of our scheme. Our method achieves the performance with 95.9% recall and 80.5% precision in our dataset. Experimental results show that the scheme has a good application prospect in micro-nano satellites with limited power and computing resources.

scholarly journals An Approach on Image Processing of Deep Learning Based on Improved SSD

Symmetry ◽  
2021 ◽  
Vol 13 (3) ◽  
pp. 495
Author(s):  
Liang Jin ◽  
Guodong Liu
Keyword(s):  
Remote Sensing ◽  
Deep Learning ◽  
Object Detection ◽  
Real Time ◽  
Remote Sensing Image ◽  
Detection Accuracy ◽  
Remote Sensing Images ◽  
Image Detection ◽  
Ship Detection ◽  
Real Time Detection

Compared with ordinary images, each of the remote sensing images contains many kinds of objects with large scale changes, providing more details. As a typical object of remote sensing image, ship detection has been playing an essential role in the field of remote sensing. With the rapid development of deep learning, remote sensing image detection method based on convolutional neural network (CNN) has occupied a key position. In remote sensing images, the objects of which small scale objects account for a large proportion are closely arranged. In addition, the convolution layer in CNN lacks ample context information, leading to low detection accuracy for remote sensing image detection. To improve detection accuracy and keep the speed of real-time detection, this paper proposed an efficient object detection algorithm for ship detection of remote sensing image based on improved SSD. Firstly, we add a feature fusion module to shallow feature layers to refine feature extraction ability of small object. Then, we add Squeeze-and-Excitation Network (SE) module to each feature layers, introducing attention mechanism to network. The experimental results based on Synthetic Aperture Radar ship detection dataset (SSDD) show that the mAP reaches 94.41%, and the average detection speed is 31FPS. Compared with SSD and other representative object detection algorithms, this improved algorithm has a better performance in detection accuracy and can realize real-time detection.

scholarly journals Ship Detection and Classification on Optical Remote Sensing Images Using Deep Learning

2017 ◽  
Vol 12 ◽  
pp. 05012 ◽  
Author(s):  
Ying Liu ◽  
Hong-Yuan Cui ◽  
Zheng Kuang ◽  
Guo-Qing Li
Keyword(s):  
Remote Sensing ◽  
Deep Learning ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Ship Detection

scholarly journals Multi-Spectral Ship Detection Using Optical, Hyperspectral, and Microwave SAR Remote Sensing Data in Coastal Regions

2018 ◽  
Vol 10 (11) ◽  
pp. 4064 ◽  
Author(s):  
Kyung-Ae Park ◽  
Jae-Jin Park ◽  
Jae-Cheol Jang ◽  
Ji-Hyun Lee ◽  
Sangwoo Oh ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Real Time ◽  
Satellite Images ◽  
Coastal Region ◽  
Probability Of Detection ◽  
Constant False Alarm Rate ◽  
Coastal Regions ◽  
Ship Detection ◽  
Radar Images ◽  
Sar Remote Sensing

The necessity of efficient monitoring of ships in coastal regions has been increasing over time. Multi-satellite observations make it possible to effectively monitor vessels. This study presents the results of ship detection methodology, applied to optical, hyperspectral, and microwave satellite images in the seas around the Korean Peninsula. Spectral matching algorithms are used to detect ships using hyperspectral images with hundreds of spectral channels and investigate the similarity between the spectra and in-situ measurements. In the case of SAR (Synthetic Aperture Radar) images, the Constant False Alarm Rate (CFAR) algorithm is used to discriminate the vessels from the backscattering coefficients of Sentinel-1B SAR and ALOS-2 PALSAR2 images. Validation results exhibited that the locations of the satellite-detected vessels showed good agreement with real-time location data within the Sentinel-1B coverage in the Korean coastal region. This study presented the probability of detection values of optical and SAR-based ship detection and discussed potential causes of the errors. This study also suggested a possibility for real-time operational use of vessel detection from multi-satellite images based on optical, hyperspectral, and SAR remote sensing, particularly in the inaccessible coastal regions off North Korea, for comprehensive coastal management and sustainability.

scholarly journals Locally Oriented Scene Complexity Analysis Real-Time Ocean Ship Detection from Optical Remote Sensing Images

Sensors ◽  
2018 ◽  
Vol 18 (11) ◽  
pp. 3799 ◽  
Author(s):  
Yin Zhuang ◽  
Baogui Qi ◽  
He Chen ◽  
Fukun Bi ◽  
Lianlin Li ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Real Time ◽  
Cloud Cover ◽  
Complexity Analysis ◽  
Response Analysis ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Feature Clustering ◽  
Ship Detection ◽  
Clustering Model

Due to strong ocean waves, broken clouds, and extensive cloud cover interferences, ocean ship detection performs poorly when using optical remote sensing images. In addition, it is a challenge to detect small ships on medium resolution optical remote sensing that cover a large area. In this paper, in order to balance the requirements of real-time processing and high accuracy detection, we proposed a novel ship detection framework based on locally oriented scene complexity analysis. First, the proposed method can separate a full image into two types of local scenes (i.e., simple or complex local scenes). Next, simple local scenes would utilize the fast saliency model (FSM) to rapidly complete candidate extraction, and for complex local scenes, the ship feature clustering model (SFCM) will be applied to achieve refined detection against severe background interferences. The FSM considers a fusion enhancement image as an input of the pulse response analysis in the frequency domain to achieve rapid ship detection in simple local scenes. Next, the SFCM builds the descriptive model of the ship feature clustering algorithm to ensure the detection performance on complex local scenes. Extensive experiments on SPOT-5 and GF-2 ocean optical remote sensing images show that the proposed ship detection framework has better performance than the state-of-the-art methods, and it addresses the tricky problem of real-time ocean ship detection under strong waves, broken clouds, extensive cloud cover, and ship fleet interferences. Finally, the proposed ocean ship detection framework is demonstrated on an onboard processing hardware.

scholarly journals Explore the application of high-resolution nighttime light remote sensing images in nighttime marine ship detection: A case study of LJ1-01 data

2020 ◽  
Vol 12 (1) ◽  
pp. 1169-1184
Author(s):  
Liang Zhong ◽  
Xiaosheng Liu ◽  
Peng Yang ◽  
Rizhi Lin
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Infrared Imaging ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Constant False Alarm Rate ◽  
Remote Sensing Images ◽  
Ship Detection ◽  
Application Potential ◽  
Nighttime Light

AbstractNighttime light remote sensing images show significant application potential in marine ship monitoring, but in areas where ships are densely distributed, the detection accuracy of the current methods is still limited. This article considered the LJ1-01 data as an example, compared with the National Polar-orbiting Partnership (NPP)/Visible Infrared Imaging Radiometer Suite (VIIRS) data, and explored the application of high-resolution nighttime light images in marine ship detection. The radiation values of the aforementioned two images were corrected to achieve consistency, and the interference light sources of the ship light were filtered. Then, when the threshold segmentation and two-parameter constant false alarm rate methods are combined, the ships’ location information was with obtained, and the reliability of the results was analyzed. The results show that the LJ1-01 data can not only record more potential ship light but also distinguish the ship light and background noise in the data. The detection accuracy of the LJ1-01 data in both ship detection methods is significantly higher than that of the NPP/VIIRS data. This study analyzes the characteristics, performance, and application potential of the high-resolution nighttime light data in the detection of marine vessels. The relevant results can provide a reference for the high-precision monitoring of nighttime marine ships.

scholarly journals Ship Detection in Multispectral Satellite Images Under Complex Environment

2020 ◽  
Vol 12 (5) ◽  
pp. 792 ◽  
Author(s):  
Xiaoyang Xie ◽  
Bo Li ◽  
Xingxing Wei
Keyword(s):  
Remote Sensing ◽  
Weather Conditions ◽  
Detection Methods ◽  
Multispectral Images ◽  
Complex Environments ◽  
Remote Sensing Images ◽  
Ship Detection ◽  
Additional Information ◽  
Multispectral Satellite Images ◽  
New Feature

Ship detection in multispectral remote-sensing images is critical in marine surveillance applications. The previously proposed ship-detection methods for multispectral satellite imagery usually work well under ideal conditions. When meeting complex environments such as shadows, mists, or clouds, they fail to detect ships. To solve this problem, we propose a novel spectral-reflectance-based ship-detection method. Research has shown that different materials have unique reflectance curves in the same spectral wavelength range. Based on this observation, we present a new feature using the reflectance gradient across multispectral bands. Moreover, we propose a neural network called lightweight fusion networks (LFNet). This network combines the aforementioned reflectance and the color information of multispectral images to jointly verify the regions with ships. The method utilizes a coarse-to-fine detection framework because of the large-sense-sparse-targets situation in remote-sensing images. In the coarse stage, the proposed reflectance feature vector is used to input the classifier to rule out the regions without ships. In fine detection, the LFNet is used to verify true ships. Compared with some traditional methods that merely depend on appearance features in images, the proposed method takes advantage of employing the reflectance variance in objects between each band as additional information. Extensive experiments have been conducted on multispectral images from four satellites under different weather and environmental conditions to demonstrate the effectiveness and efficiency of the proposed method. The results show that our method can still achieve good performance even under harsh weather conditions.

Sign in / Sign up

Export Citation Format

Share Document