scholarly journals Research on Deviation Detection of Belt Conveyor Based on Inspection Robot and Deep Learning

Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-15
Author(s):  
Yi Liu ◽  
Changyun Miao ◽  
Xianguo Li ◽  
Guowei Xu
Keyword(s):  
Deep Learning ◽  
Template Matching ◽  
Region Of Interest ◽  
Conveyor Belt ◽  
Detection Algorithm ◽  
Outer Edge ◽  
Detection Accuracy ◽  
Belt Conveyor ◽  
Inspection Robot ◽  
Edge Points

The deviation of the conveyor belt is a common failure that affects the safe operation of the belt conveyor. In this paper, a deviation detection method of the belt conveyor based on inspection robot and deep learning is proposed to detect the deviation at its any position. Firstly, the inspection robot captures the image and the region of interest (ROI) containing the conveyor belt edge and the exposed idler is extracted by the optimized MobileNet SSD (OM-SSD). Secondly, Hough line transform algorithm is used to detect the conveyor belt edge, and an elliptical arc detection algorithm based on template matching is proposed to detect the idler outer edge. Finally, a geometric correction algorithm based on homography transformation is proposed to correct the coordinates of the detected edge points, and the deviation degree (DD) of the conveyor belt is estimated based on the corrected coordinates. The experimental results show that the proposed method can detect the deviation of the conveyor belt continuously with an RMSE of 3.7 mm, an MAE of 4.4 mm, and an average time consumption of 135.5 ms. It improves the monitoring range, detection accuracy, reliability, robustness, and real-time performance of the deviation detection of the belt conveyor.

scholarly journals Parallel Ensemble Deep Learning for Real-Time Remote Sensing Video Multi-Target Detection

2021 ◽  
Vol 13 (21) ◽  
pp. 4377
Author(s):  
Long Sun ◽  
Jie Chen ◽  
Dazheng Feng ◽  
Mengdao Xing
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Unmanned Aerial Vehicle ◽  
Target Detection ◽  
Template Matching ◽  
Detection Algorithm ◽  
Detection Accuracy ◽  
Information Warfare ◽  
Aerial Vehicle ◽  
Uav Images

Unmanned aerial vehicle (UAV) is one of the main means of information warfare, such as in battlefield cruises, reconnaissance, and military strikes. Rapid detection and accurate recognition of key targets in UAV images are the basis of subsequent military tasks. The UAV image has characteristics of high resolution and small target size, and in practical application, the detection speed is often required to be fast. Existing algorithms are not able to achieve an effective trade-off between detection accuracy and speed. Therefore, this paper proposes a parallel ensemble deep learning framework for unmanned aerial vehicle video multi-target detection, which is a global and local joint detection strategy. It combines a deep learning target detection algorithm with template matching to make full use of image information. It also integrates multi-process and multi-threading mechanisms to speed up processing. Experiments show that the system has high detection accuracy for targets with focal lengths varying from one to ten times. At the same time, the real-time and stable display of detection results is realized by aiming at the moving UAV video image.

scholarly journals FPGA-Based Linear Detection Algorithm of an Underground Inspection Robot

Algorithms ◽  
2021 ◽  
Vol 14 (10) ◽  
pp. 284
Author(s):  
Chuanwei Zhang ◽  
Shirui Chen ◽  
Lu Zhao ◽  
Xianghe Li ◽  
Xiaowen Ma
Keyword(s):  
Bulk Material ◽  
High Reliability ◽  
Conveyor Belt ◽  
Detection Algorithm ◽  
Belt Conveyor ◽  
Material Transport ◽  
Inspection Robot ◽  
Sensor Arrangement ◽  
Linear Detection ◽  
Belt Conveyors

Conveyor belts are key pieces of equipment for bulk material transport, and they are of great significance to ensure safe operation. With the development of belt conveyors in the direction of long distances, large volumes, high speeds, and high reliability, the use of inspection robots to perform full inspections of belt conveyors has not only improved the efficiency and scope of the inspections but has also eliminated the dependence of the traditional method on the density of sensor arrangement. In this paper, relying on the wireless-power-supply orbital inspection robot independently developed by the laboratory, aimed at the problem of the deviation of the belt conveyor, the methods for the diagnosis of the deviation of the conveyor belt and FPGA (field-programmable gate array) parallel computing technology are studied. Based on the traditional LSD (line segment detection) algorithm, a straight-line extraction IP core, suitable for an FPGA computing platform, was constructed. This new hardware linear detection algorithm improves the real-time performance and flexibility of the belt conveyor diagnosis mechanism.

The Traffic Sign Detection Algorithm Based on Region of Interest Extraction and Double Filter

2019 ◽  
Vol 13 ◽  
Author(s):  
Dongxian Yu ◽  
Jiatao Kang ◽  
Zaihui Cao ◽  
Neha Jain
Keyword(s):  
Region Of Interest ◽  
Detection Algorithm ◽  
Light Filter ◽  
Support Vector ◽  
Detection Accuracy ◽  
Traffic Light ◽  
Traffic Sign ◽  
Traffic Signs ◽  
Sign Detection ◽  
Traffic Sign Detection

In order to solve the current traffic sign detection technology due to the interference of various complex factors, it is difficult to effectively carry out the correct detection of traffic signs, and the robustness is weak, a traffic sign detection algorithm based on the region of interest extraction and double filter is designed.First, in order to reduce environmental interference, the input image is preprocessed to enhance the main color of each logo.Secondly, in order to improve the extraction ability Of Regions Of Interest, a Region Of Interest (ROI) detector based on Maximally Stable Extremal Regions (MSER) and Wave Equation (WE) was defined, and candidate Regions were selected through the ROI detector.Then, an effective HOG (Histogram of Oriented Gradient) descriptor is introduced as the detection feature of traffic signs, and SVM (Support Vector Machine) is used to classify them into traffic signs or background.Finally, the context-aware filter and the traffic light filter are used to further identify the false traffic signs and improve the detection accuracy.In the GTSDB database, three kinds of traffic signs, which are indicative, prohibited and dangerous, are tested, and the results show that the proposed algorithm has higher detection accuracy and robustness compared with the current traffic sign recognition technology.

scholarly journals High-Speed Lightweight Ship Detection Algorithm Based on YOLO-V4 for Three-Channels RGB SAR Image

2021 ◽  
Vol 13 (10) ◽  
pp. 1909
Author(s):  
Jiahuan Jiang ◽  
Xiongjun Fu ◽  
Rui Qin ◽  
Xiaoyan Wang ◽  
Zhifeng Ma
Keyword(s):  
Deep Learning ◽  
Gpu Computing ◽  
Hot Spot ◽  
Detection Algorithm ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Processing Unit ◽  
Sar Image ◽  
Marine Monitoring ◽  
Ship Detection

Synthetic Aperture Radar (SAR) has become one of the important technical means of marine monitoring in the field of remote sensing due to its all-day, all-weather advantage. National territorial waters to achieve ship monitoring is conducive to national maritime law enforcement, implementation of maritime traffic control, and maintenance of national maritime security, so ship detection has been a hot spot and focus of research. After the development from traditional detection methods to deep learning combined methods, most of the research always based on the evolving Graphics Processing Unit (GPU) computing power to propose more complex and computationally intensive strategies, while in the process of transplanting optical image detection ignored the low signal-to-noise ratio, low resolution, single-channel and other characteristics brought by the SAR image imaging principle. Constantly pursuing detection accuracy while ignoring the detection speed and the ultimate application of the algorithm, almost all algorithms rely on powerful clustered desktop GPUs, which cannot be implemented on the frontline of marine monitoring to cope with the changing realities. To address these issues, this paper proposes a multi-channel fusion SAR image processing method that makes full use of image information and the network’s ability to extract features; it is also based on the latest You Only Look Once version 4 (YOLO-V4) deep learning framework for modeling architecture and training models. The YOLO-V4-light network was tailored for real-time and implementation, significantly reducing the model size, detection time, number of computational parameters, and memory consumption, and refining the network for three-channel images to compensate for the loss of accuracy due to light-weighting. The test experiments were completed entirely on a portable computer and achieved an Average Precision (AP) of 90.37% on the SAR Ship Detection Dataset (SSDD), simplifying the model while ensuring a lead over most existing methods. The YOLO-V4-lightship detection algorithm proposed in this paper has great practical application in maritime safety monitoring and emergency rescue.

scholarly journals A Deep Learning-Based Approach for the Detection of Early Signs of Gingivitis in Orthodontic Patients Using Faster Region-Based Convolutional Neural Networks

2020 ◽  
Vol 17 (22) ◽  
pp. 8447
Author(s):  
Dima M. Alalharith ◽  
Hajar M. Alharthi ◽  
Wejdan M. Alghamdi ◽  
Yasmine M. Alsenbel ◽  
Nida Aslam ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Periodontal Disease ◽  
Convolutional Neural Network ◽  
Region Of Interest ◽  
Training Dataset ◽  
Detection Accuracy ◽  
Detection Model ◽  
Art Object ◽  
Orthodontic Patients

Computer-based technologies play a central role in the dentistry field, as they present many methods for diagnosing and detecting various diseases, such as periodontitis. The current study aimed to develop and evaluate the state-of-the-art object detection and recognition techniques and deep learning algorithms for the automatic detection of periodontal disease in orthodontic patients using intraoral images. In this study, a total of 134 intraoral images were divided into a training dataset (n = 107 [80%]) and a test dataset (n = 27 [20%]). Two Faster Region-based Convolutional Neural Network (R-CNN) models using ResNet-50 Convolutional Neural Network (CNN) were developed. The first model detects the teeth to locate the region of interest (ROI), while the second model detects gingival inflammation. The detection accuracy, precision, recall, and mean average precision (mAP) were calculated to verify the significance of the proposed model. The teeth detection model achieved an accuracy, precision, recall, and mAP of 100 %, 100%, 51.85%, and 100%, respectively. The inflammation detection model achieved an accuracy, precision, recall, and mAP of 77.12%, 88.02%, 41.75%, and 68.19%, respectively. This study proved the viability of deep learning models for the detection and diagnosis of gingivitis in intraoral images. Hence, this highlights its potential usability in the field of dentistry and aiding in reducing the severity of periodontal disease globally through preemptive non-invasive diagnosis.

scholarly journals Real-Time Vehicle Detection Algorithm Based on Vision and Lidar Point Cloud Fusion

2019 ◽  
Vol 2019 ◽  
pp. 1-9 ◽  
Author(s):  
Hai Wang ◽  
Xinyu Lou ◽  
Yingfeng Cai ◽  
Yicheng Li ◽  
Long Chen
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Autonomous Vehicles ◽  
Point Cloud ◽  
Vehicle Detection ◽  
Detection Algorithm ◽  
Detection Methods ◽  
Depth Information ◽  
Detection Accuracy ◽  
Classification Rate

Vehicle detection is one of the most important environment perception tasks for autonomous vehicles. The traditional vision-based vehicle detection methods are not accurate enough especially for small and occluded targets, while the light detection and ranging- (lidar-) based methods are good in detecting obstacles but they are time-consuming and have a low classification rate for different target types. Focusing on these shortcomings to make the full use of the advantages of the depth information of lidar and the obstacle classification ability of vision, this work proposes a real-time vehicle detection algorithm which fuses vision and lidar point cloud information. Firstly, the obstacles are detected by the grid projection method using the lidar point cloud information. Then, the obstacles are mapped to the image to get several separated regions of interest (ROIs). After that, the ROIs are expanded based on the dynamic threshold and merged to generate the final ROI. Finally, a deep learning method named You Only Look Once (YOLO) is applied on the ROI to detect vehicles. The experimental results on the KITTI dataset demonstrate that the proposed algorithm has high detection accuracy and good real-time performance. Compared with the detection method based only on the YOLO deep learning, the mean average precision (mAP) is increased by 17%.

scholarly journals Classification of Shellfish Recognition Based on Improved Faster R-CNN Framework of Deep Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Yiran Feng ◽  
Xueheng Tao ◽  
Eung-Joo Lee
Keyword(s):  
Deep Learning ◽  
Learning Algorithm ◽  
Experimental Tests ◽  
Detection Algorithm ◽  
Detection Accuracy ◽  
Multiple Objects ◽  
Detection Model ◽  
Deep Learning Algorithm ◽  
Quality Sorting

In view of the current absence of any deep learning algorithm for shellfish identification in real contexts, an improved Faster R-CNN-based detection algorithm is proposed in this paper. It achieves multiobject recognition and localization through a second-order detection network and replaces the original feature extraction module with DenseNet, which can fuse multilevel feature information, increase network depth, and avoid the disappearance of network gradients. Meanwhile, the proposal merging strategy is improved with Soft-NMS, where an attenuation function is designed to replace the conventional NMS algorithm, thereby avoiding missed detection of adjacent or overlapping objects and enhancing the network detection accuracy under multiple objects. By constructing a real contexts shellfish dataset and conducting experimental tests on a vision recognition seafood sorting robot production line, we were able to detect the features of shellfish in different scenarios, and the detection accuracy was improved by nearly 4% compared to the original detection model, achieving a better detection accuracy. This provides favorable technical support for future quality sorting of seafood using the improved Faster R-CNN-based approach.

scholarly journals A New Steel Defect Detection Algorithm Based on Deep Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Weidong Zhao ◽  
Feng Chen ◽  
Hancheng Huang ◽  
Dan Li ◽  
Wei Cheng
Keyword(s):  
Deep Learning ◽  
Target Detection ◽  
Defect Detection ◽  
Steel Surface ◽  
Surface Defect ◽  
Detection Algorithm ◽  
Detection Accuracy ◽  
Average Precision ◽  
Original Algorithm ◽  
Surface Defect Detection

In recent years, more and more scholars devoted themselves to the research of the target detection algorithm due to the continuous development of deep learning. Among them, the detection and recognition of small and complex targets are still a problem to be solved. The authors of this article have understood the shortcomings of the deep learning detection algorithm in detecting small and complex defect targets and would like to share a new improved target detection algorithm in steel surface defect detection. The steel surface defects will affect the quality of steel seriously. We find that most of the current detection algorithms for NEU-DET dataset detection accuracy are low, so we choose to verify a steel surface defect detection algorithm based on machine vision on this dataset for the problem of defect detection in steel production. A series of improvement measures are carried out in the traditional Faster R-CNN algorithm, such as reconstructing the network structure of Faster R-CNN. Based on the small features of the target, we train the network with multiscale fusion. For the complex features of the target, we replace part of the conventional convolution network with a deformable convolution network. The experimental results show that the deep learning network model trained by the proposed method has good detection performance, and the mean average precision is 0.752, which is 0.128 higher than the original algorithm. Among them, the average precision of crazing, inclusion, patches, pitted surface, rolled in scale and scratches is 0.501, 0.791, 0.792, 0.874, 0.649, and 0.905, respectively. The detection method is able to identify small target defects on the steel surface effectively, which can provide a reference for the automatic detection of steel defects.

scholarly journals Mini-Crack Detection of Conveyor Belt Based on Laser Excited Thermography

2021 ◽  
Vol 11 (22) ◽  
pp. 10766
Author(s):  
Fei Zeng ◽  
Sheng Zhang ◽  
Tao Wang ◽  
Qing Wu
Keyword(s):  
Crack Detection ◽  
Signal To Noise Ratio ◽  
Thermal Response ◽  
Infrared Camera ◽  
Conveyor Belt ◽  
Detection Accuracy ◽  
Belt Conveyor ◽  
Thermal Images ◽  
High Speeds ◽  
Conveyor Belts

For a belt conveyor, a belt with mini-cracks influences the safety of the operation of the belt conveyor devices significantly. The lumpy material rubbing against a belt with mini-cracks will lead to detrimental tears on the belt while the conveyor works at high speeds. In order to detect mini-cracks in a timely manner, before the occurrence of large tears, a new mini-crack detection method for conveyor belts based on laser excited thermography is proposed. A laser beam is applied to generate a heat wave on the belt surface, so the corresponding thermal images can be recorded by an infrared camera. Then, an algorithm for extracting and fusing the features of mini-crack belt’s thermal images is firstly proposed by using time sequence analysis. It could transform multiple sequential thermal images into a single thermal image according to the frame difference method, so that the infrared thermal response of the mini-crack over time could be recorded quickly. To reveal the features of mini-crack, the power function image enhancement algorithm is proposed. After that, the threshold segmentation and Hough transform algorithm are used to determine the size of the mini-crack. The experimental results show that the mini-cracks with length of 50–140 mm, width of 1–10 mm, and depth of 5 mm can be successfully detected, and the detection accuracy could reach 96%. The detection results of different sizes of mini-crack show that the laser excited thermography has high damage sensitivity (1 mm diameter mini-crack detection), high accuracy (96%), lower power consumption (15 W laser excitation), and high SNR (signal-to-noise ratio).

scholarly journals Lane Detection Algorithm Based on Road Structure and Extended Kalman Filter

2020 ◽  
Vol 12 (2) ◽  
pp. 1-20
Author(s):  
Jinsheng Xiao ◽  
Wenxin Xiong ◽  
Yuan Yao ◽  
Liang Li ◽  
Reinhard Klette
Keyword(s):  
Kalman Filter ◽  
Extended Kalman Filter ◽  
Region Of Interest ◽  
Detection Algorithm ◽  
Lane Detection ◽  
Strong Light ◽  
Edge Strength ◽  
Straight Line ◽  
Edge Points ◽  
The Stability

Lane detection still demonstrates low accuracy and missing robustness when recorded markings are interrupted by strong light or shadows or missing marking. This article proposes a new algorithm using a model of road structure and an extended Kalman filter. The region of interest is set according to the vanishing point. First, an edge-detection operator is used to scan horizontal pixels and calculate edge-strength values. The corresponding straight line is detected by line parameters voted by edge points. From the edge points and lane mark candidates extracted above, and other constraints, these points are treated as the potential lane boundary. Finally, the lane parameters are estimated using the coordinates of the lane boundary points. They are updated by an extended Kalman filter to ensure the stability and robustness. Results indicate that the proposed algorithm is robust for challenging road scenes with low computational complexity.

Sign in / Sign up

Export Citation Format

Share Document