scholarly journals Drain Structural Defect Detection and Mapping Using AI-Enabled Reconfigurable Robot Raptor and IoRT Framework

Sensors ◽  
2021 ◽  
Vol 21 (21) ◽  
pp. 7287
Author(s):  
Povendhan Palanisamy ◽  
Rajesh Elara Mohan ◽  
Archana Semwal ◽  
Lee Ming Jun Melivin ◽  
Braulio Félix Félix Gómez ◽  
...  
Keyword(s):  
Deep Learning ◽  
Defect Detection ◽  
Structural Defect ◽  
Visual Inspection ◽  
Field Trials ◽  
Detection Task ◽  
Robot Assisted ◽  
Inspection Robot ◽  
Reconfigurable Robot ◽  
Learning Frameworks

Human visual inspection of drains is laborious, time-consuming, and prone to accidents. This work presents an AI-enabled robot-assisted remote drain inspection and mapping framework using our in-house developed reconfigurable robot Raptor. The four-layer IoRT serves as a bridge between the users and the robots, through which seamless information sharing takes place. The Faster RCNN ResNet50, Faster RCNN ResNet101, and Faster RCNN Inception-ResNet-v2 deep learning frameworks were trained using a transfer learning scheme with six typical concrete defect classes and deployed in an IoRT framework remote defect detection task. The efficiency of the trained CNN algorithm and drain inspection robot Raptor was evaluated through various real-time drain inspection field trials using the SLAM technique. The experimental results indicate that robot’s maneuverability was stable, and its mapping and localization were also accurate in different drain types. Finally, for effective drain maintenance, the SLAM-based defect map was generated by fusing defect detection results in the lidar-SLAM map.

scholarly journals Research on Recognition Technology of Aluminum Profile Surface Defects Based on Deep Learning

2019 ◽  
Author(s):  
Ruofeng Wei ◽  
Yunbo Bi
Keyword(s):  
Deep Learning ◽  
Machine Vision ◽  
Defect Detection ◽  
Visual Inspection ◽  
Surface Defects ◽  
Average Precision ◽  
Saliency Maps ◽  
Aluminum Profile ◽  
Safety And Reliability ◽  
Aluminum Profiles

Aluminum profile surface defects can greatly affect the performance, safety and reliability of products. Traditional human-based visual inspection is low accuracy and time consuming, and machine vision-based methods depend on hand-crafted features which need to be carefully designed and lack robustness. To recognize the multiple types of defects with various size on aluminum profiles, a multiscale defect detection network based on deep learning is proposed. Then, the network is trained and evaluated using aluminum profile surface defects images. Results show 84.6%, 48.5%, 96.9%, 97.9%, 96.9%, 42.5%, 47.2%, 100%, 100%, 43.3% average precision(AP) for the ten defect categories, respectively, with a mean AP of 75.8%, which illustrate the effectiveness of the network in aluminum profile surface defects detection. In addition, saliency maps also show the feasibility of the proposed network.

Simultaneous pixel-level concrete defect detection and grouping using a fully convolutional model

2021 ◽  
pp. 147592172098543
Author(s):  
Chaobo Zhang ◽  
Chih-chen Chang ◽  
Maziar Jamshidi
Keyword(s):  
Deep Learning ◽  
Defect Detection ◽  
Visual Inspection ◽  
Surface Defects ◽  
Semantic Segmentation ◽  
Input Image ◽  
Image Size ◽  
Bounding Box ◽  
Proposed Model ◽  
Image Pixels

Deep learning techniques have attracted significant attention in the field of visual inspection of civil infrastructure systems recently. Currently, most deep learning-based visual inspection techniques utilize a convolutional neural network to recognize surface defects either by detecting a bounding box of each defect or classifying all pixels on an image without distinguishing between different defect instances. These outputs cannot be directly used for acquiring the geometric properties of each individual defect in an image, thus hindering the development of fully automated structural assessment techniques. In this study, a novel fully convolutional model is proposed for simultaneously detecting and grouping the image pixels for each individual defect on an image. The proposed model integrates an optimized mask subnet with a box-level detection network, where the former outputs a set of position-sensitive score maps for pixel-level defect detection and the latter predicts a bounding box for each defect to group the detected pixels. An image dataset containing three common types of concrete defects, crack, spalling and exposed rebar, is used for training and testing of the model. Results demonstrate that the proposed model is robust to various defect sizes and shapes and can achieve a mask-level mean average precision ( mAP) of 82.4% and a mean intersection over union ( mIoU) of 75.5%, with a processing speed of about 10 FPS at input image size of 576 × 576 when tested on an NVIDIA GeForce GTX 1060 GPU. Its performance is compared with the state-of-the-art instance segmentation network Mask R-CNN and the semantic segmentation network U-Net. The comparative studies show that the proposed model has a distinct defect boundary delineation capability and outperforms the Mask R-CNN and the U-Net in both accuracy and speed.

scholarly journals State of the Art in Defect Detection Based on Machine Vision

2021 ◽  
Author(s):  
Zhonghe Ren ◽  
Fengzhou Fang ◽  
Ning Yan ◽  
You Wu
Keyword(s):  
Image Processing ◽  
Image Analysis ◽  
Deep Learning ◽  
Machine Vision ◽  
Defect Detection ◽  
Visual Inspection ◽  
State Of The Art ◽  
Image Acquisition ◽  
Detection Algorithms ◽  
Further Development

AbstractMachine vision significantly improves the efficiency, quality, and reliability of defect detection. In visual inspection, excellent optical illumination platforms and suitable image acquisition hardware are the prerequisites for obtaining high-quality images. Image processing and analysis are key technologies in obtaining defect information, while deep learning is significantly impacting the field of image analysis. In this study, a brief history and the state of the art in optical illumination, image acquisition, image processing, and image analysis in the field of visual inspection are systematically discussed. The latest developments in industrial defect detection based on machine vision are introduced. In the further development of the field of visual inspection, the application of deep learning will play an increasingly important role. Thus, a detailed description of the application of deep learning in defect classification, localization and segmentation follows the discussion of traditional defect detection algorithms. Finally, future prospects for the development of visual inspection technology are explored.

scholarly journals Automatic Detection of Display Defects for Smart Meters based on Deep Learning

2021 ◽  
Vol 28 (4) ◽  
pp. 241-254
Author(s):  
Ye Chen ◽  
Zhihu Hong ◽  
Yaohua Liao ◽  
Mengmeng Zhu ◽  
Tong Han ◽  
...  
Keyword(s):  
Deep Learning ◽  
Fault Detection ◽  
Defect Detection ◽  
Automatic Detection ◽  
Detection Task ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Smart Meter ◽  
Smart Meters ◽  
The Common

The smart meter is an essential part of an intelligent grid system. Defects in the LCD screen the smart meters affect their use. Therefore, detection of LCD screen defects of smart meters is of great significance for management and use of smart electricity meters. At present, detection methods are mainly realized by manual detection and automatic detection based on machine vision. However, performance of these two methods is not satisfactory. The fault detection task of a smart meter LCD screen can be divided into two parts: smart meter LCD localization and LCD fault detection. Therefore, this paper proposes a twostage system based on deep learning, which combines YOLOv5 with ResNet34. YOLOv5 is used for smart meter LCD localization and the classification network based on ResNet34 for LCD fault detection. We have constructed an LCD screen localization dataset and an LCD screen defect detection dataset to train and test our model. As a result, our model achieves a defect detection accuracy of 98.9% on the dataset proposed in this paper and can accurately detect the common defects of an LCD screen.

Automated visual inspection of fabric image using deep learning approach for defect detection

2021 ◽  
Author(s):  
Vyacheslav V. Voronin ◽  
Roman Sizyakin ◽  
Marina Zhdanova ◽  
Evgenii A. Semenishchev ◽  
Dmitry Bezuglov ◽  
...  
Keyword(s):  
Deep Learning ◽  
Defect Detection ◽  
Visual Inspection ◽  
Learning Approach ◽  
Automated Visual Inspection

scholarly journals Research on Recognition Technology of Aluminum Profile Surface Defects Based on Deep Learning

Materials ◽  
2019 ◽  
Vol 12 (10) ◽  
pp. 1681 ◽  
Author(s):  
Ruofeng Wei ◽  
Yunbo Bi
Keyword(s):  
Deep Learning ◽  
Machine Vision ◽  
Defect Detection ◽  
Visual Inspection ◽  
Surface Defects ◽  
Average Precision ◽  
Saliency Maps ◽  
Aluminum Profile ◽  
Safety And Reliability ◽  
Aluminum Profiles

Aluminum profile surface defects can greatly affect the performance, safety, and reliability of products. Traditional human-based visual inspection has low accuracy and is time consuming, and machine vision-based methods depend on hand-crafted features that need to be carefully designed and lack robustness. To recognize the multiple types of defects with various size on aluminum profiles, a multiscale defect-detection network based on deep learning is proposed. Then, the network is trained and evaluated using aluminum profile surface defects images. Results show 84.6%, 48.5%, 96.9%, 97.9%, 96.9%, 42.5%, 47.2%, 100%, 100%, and 43.3% average precision (AP) for the 10 defect categories, respectively, with a mean AP of 75.8%, which illustrate the effectiveness of the network in aluminum profile surface defects detection. In addition, saliency maps also show the feasibility of the proposed network.

Sequence-Based Deep Learning Frameworks on Enhancer-Promoter Interactions Prediction

2020 ◽  
Vol 26 ◽  
Author(s):  
Xiaoping Min ◽  
Fengqing Lu ◽  
Chunyan Li
Keyword(s):  
Gene Expression ◽  
Deep Learning ◽  
Dna Sequences ◽  
Experimental Methods ◽  
Learning Methods ◽  
Comprehensive Review ◽  
Genomic Features ◽  
Disease Mechanisms ◽  
Evaluation Strategies ◽  
Learning Frameworks

: Enhancer-promoter interactions (EPIs) in the human genome are of great significance to transcriptional regulation which tightly controls gene expression. Identification of EPIs can help us better deciphering gene regulation and understanding disease mechanisms. However, experimental methods to identify EPIs are constrained by the fund, time and manpower while computational methods using DNA sequences and genomic features are viable alternatives. Deep learning methods have shown promising prospects in classification and efforts that have been utilized to identify EPIs. In this survey, we specifically focus on sequence-based deep learning methods and conduct a comprehensive review of the literatures of them. We first briefly introduce existing sequence-based frameworks on EPIs prediction and their technique details. After that, we elaborate on the dataset, pre-processing means and evaluation strategies. Finally, we discuss the challenges these methods are confronted with and suggest several future opportunities.

Sign in / Sign up

Export Citation Format

Share Document