scholarly journals Improved YOLOv3 Network for Insulator Detection in Aerial Images with Diverse Background Interference

Electronics ◽  
2021 ◽  
Vol 10 (7) ◽  
pp. 771
Author(s):  
Chuanyang Liu ◽  
Yiquan Wu ◽  
Jingjing Liu ◽  
Zuo Sun
Keyword(s):  
Transmission Lines ◽  
Feature Fusion ◽  
Aerial Images ◽  
Detection Accuracy ◽  
Dense Network ◽  
Feature Mapping ◽  
Background Interference ◽  
Diverse Background ◽  
Aerial Vehicle ◽  
Traditional Image

Automatic inspection of insulators from high-voltage transmission lines is of paramount importance to the safety and reliable operation of the power grid. Due to different size insulators and the complex background of aerial images, it is a difficult task to recognize insulators in aerial views. Most of the traditional image processing methods and machine learning methods cannot achieve sufficient performance for insulator detection when diverse background interference is present. In this study, a deep learning method—based on You Only Look Once (YOLO)—will be proposed, capable of detecting insulators from aerial images with complex backgrounds. Firstly, aerial images with common aerial scenes were collected by Unmanned Aerial Vehicle (UAV), and a novel insulator dataset was constructed. Secondly, to enhance feature reuse and propagation, on the basis of YOLOv3 and Dense-Blocks, the YOLOv3-dense network was utilized for insulator detection. To improve detection accuracy for different sized insulators, a structure of multiscale feature fusion was adapted to the YOLOv3-dense network. To obtain abundant semantic information of upper and lower layers, multilevel feature mapping modules were employed across the YOLOv3-dense network. Finally, the YOLOv3-dense network and compared networks were trained and tested on the testing set. The average precision of YOLOv3-dense, YOLOv3, and YOLOv2 were 94.47%, 90.31%, and 83.43%, respectively. Experimental results and analysis validate the claim that the proposed YOLOv3-dense network achieves good performance in the detection of different size insulators amid diverse background interference.

scholarly journals MTI-YOLO: A Light-Weight and Real-Time Deep Neural Network for Insulator Detection in Complex Aerial Images

Energies ◽  
2021 ◽  
Vol 14 (5) ◽  
pp. 1426
Author(s):  
Chuanyang Liu ◽  
Yiquan Wu ◽  
Jingjing Liu ◽  
Jiaming Han
Keyword(s):  
Feature Detection ◽  
Feature Fusion ◽  
Memory Storage ◽  
Aerial Images ◽  
Detection Accuracy ◽  
Composite Insulator ◽  
Running Time ◽  
Scale Feature ◽  
Multi Scale ◽  
Good Trade

Insulator detection is an essential task for the safety and reliable operation of intelligent grids. Owing to insulator images including various background interferences, most traditional image-processing methods cannot achieve good performance. Some You Only Look Once (YOLO) networks are employed to meet the requirements of actual applications for insulator detection. To achieve a good trade-off among accuracy, running time, and memory storage, this work proposes the modified YOLO-tiny for insulator (MTI-YOLO) network for insulator detection in complex aerial images. First of all, composite insulator images are collected in common scenes and the “CCIN_detection” (Chinese Composite INsulator) dataset is constructed. Secondly, to improve the detection accuracy of different sizes of insulator, multi-scale feature detection headers, a structure of multi-scale feature fusion, and the spatial pyramid pooling (SPP) model are adopted to the MTI-YOLO network. Finally, the proposed MTI-YOLO network and the compared networks are trained and tested on the “CCIN_detection” dataset. The average precision (AP) of our proposed network is 17% and 9% higher than YOLO-tiny and YOLO-v2. Compared with YOLO-tiny and YOLO-v2, the running time of the proposed network is slightly higher. Furthermore, the memory usage of the proposed network is 25.6% and 38.9% lower than YOLO-v2 and YOLO-v3, respectively. Experimental results and analysis validate that the proposed network achieves good performance in both complex backgrounds and bright illumination conditions.

Insulator Fault Detection in Aerial Images based on the Mixed-grouped Fire Single-shot Multibox Detector

2020 ◽  
Author(s):  
Songbo Chen ◽  
Chao Su ◽  
Zhenxing Kuang ◽  
Ye Ouyang ◽  
Xiang Gong
Keyword(s):  
Feature Fusion ◽  
Complex Structure ◽  
Aerial Images ◽  
Detection Accuracy ◽  
Single Shot ◽  
Small Object ◽  
Two Stage ◽  
One Stage ◽  
Complex Background ◽  
Lower Accuracy

In a complex background, insulator fault is the main factor behind transmission accidents. With the wide application of unmanned aerial vehicle (UAV) photography, digital image recognition technology has been further developed to detect the position and fault of insulators. There are two mainstream methods based on deep learning: the first is the “two-stage” example for a region convolutional neural network and the second is the “one-stage” example such as a single-shot multibox detector (SSD), both of which pose many difficulties and challenges. However, due to the complex background and various types of insulators, few researchers apply the “two-stage” method for the detection of insulator faults in aerial images. Moreover, the detection performance of “one-stage” methods is poor for small targets because of the smaller scope of vision and lower accuracy in target detection. In this article, the authors propose an accurate and real-time method for small object detection, an example for insulator location, and its fault inspection based on a mixed- grouped fire single-shot multibox detector (MGFSSD). Based on SSD and deconvolutional single-shot detector (DSSD) networks, the MGFSSD algorithm solves the problems of inaccurate recognition in small objects of the SSD and complex structure and long running time of the DSSD. To resolve the problems of some target repeated detection and small-target missing detection of the original SSD, the authors describe how to design an effective and lightweight feature fusion module to improve the performance of traditional SSDs so that the classifier network can take full advantage of the relationship between the pyramid layer features without changing the base network closest to the input data. The data processing results show that the method can effectively detect insulator faults. The average detection accuracy of insulator faults is 92.4% and the average recall rate is 91.2%.

scholarly journals Autonomous, Onboard Vision-Based Trash and Litter Detection in Low Altitude Aerial Images Collected by an Unmanned Aerial Vehicle

2021 ◽  
Vol 13 (5) ◽  
pp. 965
Author(s):  
Marek Kraft ◽  
Mateusz Piechocki ◽  
Bartosz Ptak ◽  
Krzysztof Walas
Keyword(s):  
Neural Networks ◽  
Unmanned Aerial Vehicle ◽  
Low Cost ◽  
Detection Algorithm ◽  
Aerial Images ◽  
Detection Accuracy ◽  
Deep Convolutional Neural Networks ◽  
Domain Specific ◽  
Aerial Vehicle ◽  
Low Altitude

Public littering and discarded trash are, despite the effort being put to limit it, still a serious ecological, aesthetic, and social problem. The problematic waste is usually localised and picked up by designated personnel, which is a tiresome, time-consuming task. This paper proposes a low-cost solution enabling the localisation of trash and litter objects in low altitude imagery collected by an unmanned aerial vehicle (UAV) during an autonomous patrol mission. The objects of interest are detected in the acquired images and put on the global map using a set of onboard sensors commonly found in typical UAV autopilots. The core object detection algorithm is based on deep, convolutional neural networks. Since the task is domain-specific, a dedicated dataset of images containing objects of interest was collected and annotated. The dataset is made publicly available, and its description is contained in the paper. The dataset was used to test a range of embedded devices enabling the deployment of deep neural networks for inference onboard the UAV. The results of measurements in terms of detection accuracy and processing speed are enclosed, and recommendations for the neural network model and hardware platform are given based on the obtained values. The complete system can be put together using inexpensive, off-the-shelf components, and perform autonomous localisation of discarded trash, relieving human personnel of this burdensome task, and enabling automated pickup planning.

scholarly journals Detection of Schools in Remote Sensing Images Based on Attention-Guided Dense Network

2021 ◽  
Vol 10 (11) ◽  
pp. 736
Author(s):  
Han Fu ◽  
Xiangtao Fan ◽  
Zhenzhen Yan ◽  
Xiaoping Du
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Feature Fusion ◽  
State Of The Art ◽  
Feature Representation ◽  
Detection Accuracy ◽  
Dense Network ◽  
Remote Sensing Images ◽  
Composite Object ◽  
Detection Algorithms

The detection of primary and secondary schools (PSSs) is a meaningful task for composite object detection in remote sensing images (RSIs). As a typical composite object in RSIs, PSSs have diverse appearances with complex backgrounds, which makes it difficult to effectively extract their features using the existing deep-learning-based object detection algorithms. Aiming at the challenges of PSSs detection, we propose an end-to-end framework called the attention-guided dense network (ADNet), which can effectively improve the detection accuracy of PSSs. First, a dual attention module (DAM) is designed to enhance the ability in representing complex characteristics and alleviate distractions in the background. Second, a dense feature fusion module (DFFM) is built to promote attention cues flow into low layers, which guides the generation of hierarchical feature representation. Experimental results demonstrate that our proposed method outperforms the state-of-the-art methods and achieves 79.86% average precision. The study proves the effectiveness of our proposed method on PSSs detection.

scholarly journals Multitarget Detection of Transmission Lines Based on DANet and YOLOv4

2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Zhen Yang ◽  
Xuefei Xu ◽  
Keke Wang ◽  
Xin Li ◽  
Chi Ma
Keyword(s):  
Loss Function ◽  
Transmission Lines ◽  
Recognition Rate ◽  
Gaussian Function ◽  
Aerial Images ◽  
Detection Accuracy ◽  
Data Set ◽  
Detection Model ◽  
Leibler Divergence ◽  
The Impact

In order to accurately identify targets such as insulators, shock hammers, bird nests, and spacers on high-voltage transmission lines, this paper proposes a multitarget detection model for transmission lines based on DANet and YOLOv4. First, the DANet and YOLOv4 are fused to solve the difficulty in understanding the scene and the discrimination of pixels caused by the complex and diverse scenes of UAV’ (unmanned aerial vehicle) aerial images (lighting, viewing angle, scale, occlusion, and so on) so as to improve the significance of the detection target. Gaussian function and KL (Kullback–Leibler) divergence are used to improve the nonmaximum suppression in YOLOv4 so as to improve the recognition rate of occluded targets; the focal loss function and the balanced cross entropy function are used to improve the loss function of YOLOv4 in order to reduce the impact of not only the imbalance between the background and the detection target but also the imbalance among the samples, which is aimed at improving the accuracy of the detection. Then, a data set is made for the experiment by using the UAV inspection image provided by a power grid company in Eastern Inner Mongolia. Finally, the algorithm proposed in this paper is compared with other target detection algorithms. Experimental results show that the average detection accuracy of the proposed algorithm can reach 94.7%, and the detection time of each image is 0.05 seconds. The method has good accuracy, real-time, and robustness.

scholarly journals Multi-Feature Fusion for Weak Target Detection on Sea-Surface Based on FAR Controllable Deep Forest Model

2021 ◽  
Vol 13 (4) ◽  
pp. 812
Author(s):  
Jiahuan Zhang ◽  
Hongjun Song
Keyword(s):  
Target Detection ◽  
Feature Fusion ◽  
Feature Space ◽  
Sea Surface ◽  
Detection Accuracy ◽  
Forest Model ◽  
High Profile ◽  
Deep Forest ◽  
Positive Effect ◽  
Weak Target

Target detection on the sea-surface has always been a high-profile problem, and the detection of weak targets is one of the most difficult problems and the key issue under this problem. Traditional techniques, such as imaging, cannot effectively detect these types of targets, so researchers choose to start by mining the characteristics of the received echoes and other aspects for target detection. This paper proposes a false alarm rate (FAR) controllable deep forest model based on six-dimensional feature space for efficient and accurate detection of weak targets on the sea-surface. This is the first attempt at the deep forest model in this field. The validity of the model was verified on IPIX data, and the detection probability was compared with other proposed methods. Under the same FAR condition, the average detection accuracy rate of the proposed method could reach over 99.19%, which is 9.96% better than the results of the current most advanced method (K-NN FAR-controlled Detector). Experimental results show that multi-feature fusion and the use of a suitable detection framework have a positive effect on the detection of weak targets on the sea-surface.

RSNet: Rail semantic segmentation network for extracting aerial railroad images

2021 ◽  
pp. 1-18
Author(s):  
R.S. Rampriya ◽  
Sabarinathan ◽  
R. Suganya
Keyword(s):  
Real Time ◽  
Visual Processing ◽  
Feature Fusion ◽  
Semantic Segmentation ◽  
Vital Role ◽  
Obstacle Detection ◽  
Aerial Images ◽  
Computationally Efficient ◽  
Fusion Algorithm ◽  
Uav Images

In the near future, combo of UAV (Unmanned Aerial Vehicle) and computer vision will play a vital role in monitoring the condition of the railroad periodically to ensure passenger safety. The most significant module involved in railroad visual processing is obstacle detection, in which caution is obstacle fallen near track gage inside or outside. This leads to the importance of detecting and segment the railroad as three key regions, such as gage inside, rails, and background. Traditional railroad segmentation methods depend on either manual feature selection or expensive dedicated devices such as Lidar, which is typically less reliable in railroad semantic segmentation. Also, cameras mounted on moving vehicles like a drone can produce high-resolution images, so segmenting precise pixel information from those aerial images has been challenging due to the railroad surroundings chaos. RSNet is a multi-level feature fusion algorithm for segmenting railroad aerial images captured by UAV and proposes an attention-based efficient convolutional encoder for feature extraction, which is robust and computationally efficient and modified residual decoder for segmentation which considers only essential features and produces less overhead with higher performance even in real-time railroad drone imagery. The network is trained and tested on a railroad scenic view segmentation dataset (RSSD), which we have built from real-time UAV images and achieves 0.973 dice coefficient and 0.94 jaccard on test data that exhibits better results compared to the existing approaches like a residual unit and residual squeeze net.

Improved SSD-assisted algorithm for surface defect detection of electromagnetic luminescence

2021 ◽  
pp. 1748006X2199538
Author(s):  
Zhenying Xu ◽  
Ziqian Wu ◽  
Wei Fan
Keyword(s):  
Defect Detection ◽  
Feature Fusion ◽  
Recognition Rate ◽  
Detection Methods ◽  
Small Scale ◽  
Detection Accuracy ◽  
Single Shot ◽  
Surface Defect Detection ◽  
Feature Pyramid ◽  
Small Feature

Defect detection of electromagnetic luminescence (EL) cells is the core step in the production and preparation of solar cell modules to ensure conversion efficiency and long service life of batteries. However, due to the lack of feature extraction capability for small feature defects, the traditional single shot multibox detector (SSD) algorithm performs not well in EL defect detection with high accuracy. Consequently, an improved SSD algorithm with modification in feature fusion in the framework of deep learning is proposed to improve the recognition rate of EL multi-class defects. A dataset containing images with four different types of defects through rotation, denoising, and binarization is established for the EL. The proposed algorithm can greatly improve the detection accuracy of the small-scale defect with the idea of feature pyramid networks. An experimental study on the detection of the EL defects shows the effectiveness of the proposed algorithm. Moreover, a comparison study shows the proposed method outperforms other traditional detection methods, such as the SIFT, Faster R-CNN, and YOLOv3, in detecting the EL defect.

Subglacial topography and thickness of ice caps on the Argentine Islands

2019 ◽  
Vol 31 (6) ◽  
pp. 332-344 ◽  
Author(s):  
Jānis Karušs ◽  
Kristaps Lamsters ◽  
Anatolii Chernov ◽  
Māris Krievāns ◽  
Jurijs Ješkins
Keyword(s):  
Land Surface ◽  
Geological Structure ◽  
Aerial Images ◽  
Ice Thickness ◽  
Ice Caps ◽  
The North ◽  
Prevailing Wind Direction ◽  
Aerial Vehicle ◽  
Subglacial Topography ◽  
Ground Penetrating

AbstractThis study presents the first subglacial topography and ice thickness models of the largest ice caps of the Argentine Islands, Wilhelm Archipelago, West Antarctica. During this study, ground-penetrating radar was used to map the thickness and inner structure of the ice caps. Digital surface models of all studied islands were created from aerial images obtained with a small-sized unmanned aerial vehicle and used for the construction of subglacial topography models. Ice caps of the Argentine Islands cover ~50% of the land surface of the islands on average. The maximum thickness of only two islands (Galindez and Skua) exceeds 30 m, while the average thickness of all islands is only ~5 m. The maximum ice thickness reaches 35.3 m on Galindez Island. The ice thickness and glacier distribution are mainly governed by prevailing wind direction from the north. This has created the prominent narrow ice ridges on Uruguay and Irizar islands, which are not supported by topographic obstacles, as well as the elongated shape of other ice caps. The subglacial topography of the ice caps is undulated and mainly dependent on the geological structure and composition of magmatic rocks.

scholarly journals Multiscale Semantic Feature Optimization and Fusion Network for Building Extraction Using High-Resolution Aerial Images and LiDAR Data

2021 ◽  
Vol 13 (13) ◽  
pp. 2473
Author(s):  
Qinglie Yuan ◽  
Helmi Zulhaidi Mohd Shafri ◽  
Aidi Hizami Alias ◽  
Shaiful Jahari Hashim
Keyword(s):  
High Resolution ◽  
Large Scale ◽  
Spatial Information ◽  
Feature Fusion ◽  
Aerial Images ◽  
Semantic Gap ◽  
Superior Performance ◽  
Lidar Data ◽  
Building Extraction ◽  
Hierarchical Features

Automatic building extraction has been applied in many domains. It is also a challenging problem because of the complex scenes and multiscale. Deep learning algorithms, especially fully convolutional neural networks (FCNs), have shown robust feature extraction ability than traditional remote sensing data processing methods. However, hierarchical features from encoders with a fixed receptive field perform weak ability to obtain global semantic information. Local features in multiscale subregions cannot construct contextual interdependence and correlation, especially for large-scale building areas, which probably causes fragmentary extraction results due to intra-class feature variability. In addition, low-level features have accurate and fine-grained spatial information for tiny building structures but lack refinement and selection, and the semantic gap of across-level features is not conducive to feature fusion. To address the above problems, this paper proposes an FCN framework based on the residual network and provides the training pattern for multi-modal data combining the advantage of high-resolution aerial images and LiDAR data for building extraction. Two novel modules have been proposed for the optimization and integration of multiscale and across-level features. In particular, a multiscale context optimization module is designed to adaptively generate the feature representations for different subregions and effectively aggregate global context. A semantic guided spatial attention mechanism is introduced to refine shallow features and alleviate the semantic gap. Finally, hierarchical features are fused via the feature pyramid network. Compared with other state-of-the-art methods, experimental results demonstrate superior performance with 93.19 IoU, 97.56 OA on WHU datasets and 94.72 IoU, 97.84 OA on the Boston dataset, which shows that the proposed network can improve accuracy and achieve better performance for building extraction.

Sign in / Sign up

Export Citation Format

Share Document