scholarly journals Real-Time Inspection System for Ballast Railway Fasteners Based on Point Cloud Deep Learning

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 61604-61614
Author(s):  
Hao Cui ◽  
Jian Li ◽  
Qingwu Hu ◽  
Qingzhou Mao
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Point Cloud ◽  
Inspection System

scholarly journals Real-Time Vehicle Detection Algorithm Based on Vision and Lidar Point Cloud Fusion

2019 ◽  
Vol 2019 ◽  
pp. 1-9 ◽  
Author(s):  
Hai Wang ◽  
Xinyu Lou ◽  
Yingfeng Cai ◽  
Yicheng Li ◽  
Long Chen
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Autonomous Vehicles ◽  
Point Cloud ◽  
Vehicle Detection ◽  
Detection Algorithm ◽  
Detection Methods ◽  
Depth Information ◽  
Detection Accuracy ◽  
Classification Rate

Vehicle detection is one of the most important environment perception tasks for autonomous vehicles. The traditional vision-based vehicle detection methods are not accurate enough especially for small and occluded targets, while the light detection and ranging- (lidar-) based methods are good in detecting obstacles but they are time-consuming and have a low classification rate for different target types. Focusing on these shortcomings to make the full use of the advantages of the depth information of lidar and the obstacle classification ability of vision, this work proposes a real-time vehicle detection algorithm which fuses vision and lidar point cloud information. Firstly, the obstacles are detected by the grid projection method using the lidar point cloud information. Then, the obstacles are mapped to the image to get several separated regions of interest (ROIs). After that, the ROIs are expanded based on the dynamic threshold and merged to generate the final ROI. Finally, a deep learning method named You Only Look Once (YOLO) is applied on the ROI to detect vehicles. The experimental results on the KITTI dataset demonstrate that the proposed algorithm has high detection accuracy and good real-time performance. Compared with the detection method based only on the YOLO deep learning, the mean average precision (mAP) is increased by 17%.

scholarly journals Real‐time comprehensive glass container inspection system based on deep learning framework

2019 ◽  
Vol 55 (3) ◽  
pp. 131-132 ◽  
Author(s):  
Qiaokang Liang ◽  
Shao Xiang ◽  
Jianyong Long ◽  
Wei Sun ◽  
Yaonan Wang ◽  
...  
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Glass Container ◽  
Inspection System ◽  
Learning Framework ◽  
Container Inspection

scholarly journals Real-Time Detection and Location of Potted Flowers Based on a ZED Camera and a YOLO V4-Tiny Deep Learning Algorithm

Horticulturae ◽  
2021 ◽  
Vol 8 (1) ◽  
pp. 21
Author(s):  
Jizhang Wang ◽  
Zhiheng Gao ◽  
Yun Zhang ◽  
Jing Zhou ◽  
Jianzhi Wu ◽  
...  
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Point Cloud ◽  
Learning Algorithm ◽  
Absolute Error ◽  
Frame Rate ◽  
3D Point Cloud ◽  
The Real ◽  
Deep Learning Algorithm ◽  
The Mean

In order to realize the real-time and accurate detection of potted flowers on benches, in this paper we propose a method based on the ZED 2 stereo camera and the YOLO V4-Tiny deep learning algorithm for potted flower detection and location. First, an automatic detection model of flowers was established based on the YOLO V4-Tiny convolutional neural network (CNN) model, and the center points on the pixel plane of the flowers were obtained according to the prediction box. Then, the real-time 3D point cloud information obtained by the ZED 2 camera was used to calculate the actual position of the flowers. The test results showed that the mean average precision (MAP) and recall rate of the training model was 89.72% and 80%, respectively, and the real-time average detection frame rate of the model deployed under Jetson TX2 was 16 FPS. The results of the occlusion experiment showed that when the canopy overlap ratio between the two flowers is more than 10%, the recognition accuracy will be affected. The mean absolute error of the flower center location based on 3D point cloud information of the ZED 2 camera was 18.1 mm, and the maximum locating error of the flower center was 25.8 mm under different light radiation conditions. The method in this paper establishes the relationship between the detection target of flowers and the actual spatial location, which has reference significance for the machinery and automatic management of potted flowers on benches.

Edge Computing Accelerated Defect Classification Based on Deep Convolutional Neural Network With Application in Rolling Image Inspection

2020 ◽  
Author(s):  
Jiayu Huang ◽  
Nurretin Sergin ◽  
Akshay Dua ◽  
Erfan Bank Tavakoli ◽  
Hao Yan ◽  
...  
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Small Sample ◽  
Edge Computing ◽  
Machine Learning Algorithms ◽  
Computational Time ◽  
Inspection System ◽  
The Real ◽  
Computational Requirement ◽  
Computing Framework

Abstract This paper develops a unified framework for training and deploying deep neural networks on the edge computing framework for image defect detection and classification. In the proposed framework, we combine the transfer learning and data augmentation with the improved accuracy given the small sample size. We further implement the edge computing framework to satisfy the real-time computational requirement. After the implement of the proposed model into a rolling manufacturing system, we conclude that deep learning approaches can perform around 30–40% better than some traditional machine learning algorithms such as random forest, decision tree, and SVM in terms of prediction accuracy. Furthermore, by deploying the CNNs in the edge computing framework, we can significantly reduce the computational time and satisfy the real-time computational requirement in the high-speed rolling and inspection system. Finally, the saliency map and embedding layer visualization techniques are used for a better understanding of proposed deep learning models.

scholarly journals A Drone Based Transmission Line Components Inspection System with Deep Learning Technique

Energies ◽  
2020 ◽  
Vol 13 (13) ◽  
pp. 3348
Author(s):  
Zahid Ali Siddiqui ◽  
Unsang Park
Keyword(s):  
Deep Learning ◽  
Transmission Line ◽  
Real Time ◽  
Defect Detection ◽  
Power Line ◽  
Inspection Time ◽  
Inspection System ◽  
Continuous Exposure ◽  
Detection Algorithms ◽  
Detection And Localization

Defects in high voltage transmission line components such as cracked insulators, broken wires rope, and corroded power line joints, are very common due to continuous exposure of these components to harsh environmental conditions. Consequently, they pose a great threat to humans and the environment. This paper presents a real-time aerial power line inspection system that aims to detect power line components such as insulators (polymer and porcelain), splitters, damper-weights, power lines, and then analyze these transmission line components for potential defects. The proposed system employs a deep learning-based framework using Jetson TX2 embedded platform for the real-time detection and localization of these components from a live video captured by remote-controlled drone. The detected components are then analyzed using novel defect detection algorithms, presented in this paper. Results show that the proposed detection and localization system is robust against highly cluttered environment, while the proposed defect analyzer outperforms similar researches in terms of defect detection precision and recall. With the help of the proposed system automatic defect analyzing system, manual inspection time can be reduced.

Smart teaching mode based on particle swarm image recognition and human-computer interaction deep learning

2020 ◽  
Vol 39 (4) ◽  
pp. 5699-5711
Author(s):  
Shirong Long ◽  
Xuekong Zhao
Keyword(s):  
Feature Extraction ◽  
Particle Swarm Optimization ◽  
Deep Learning ◽  
Real Time ◽  
Image Recognition ◽  
Particle Swarm ◽  
Learning Technology ◽  
Search Performance ◽  
Swarm Optimization ◽  
Teaching Mode

The smart teaching mode overcomes the shortcomings of traditional teaching online and offline, but there are certain deficiencies in the real-time feature extraction of teachers and students. In view of this, this study uses the particle swarm image recognition and deep learning technology to process the intelligent classroom video teaching image and extracts the classroom task features in real time and sends them to the teacher. In order to overcome the shortcomings of the premature convergence of the standard particle swarm optimization algorithm, an improved strategy for multiple particle swarm optimization algorithms is proposed. In order to improve the premature problem in the search performance algorithm of PSO algorithm, this paper combines the algorithm with the useful attributes of other algorithms to improve the particle diversity in the algorithm, enhance the global search ability of the particle, and achieve effective feature extraction. The research indicates that the method proposed in this paper has certain practical effects and can provide theoretical reference for subsequent related research.

Real-time Worker Safety Management System Using Deep Learning-based Video Analysis Algorithm

2020 ◽  
Vol 9 (3) ◽  
pp. 25-30
Author(s):  
So Yeon Jeon ◽  
Jong Hwa Park ◽  
Sang Byung Youn ◽  
Young Soo Kim ◽  
Yong Sung Lee ◽  
...  
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Video Analysis ◽  
Management System ◽  
Safety Management ◽  
Worker Safety ◽  
Safety Management System ◽  
Analysis Algorithm
Sign in / Sign up

Export Citation Format

Share Document