scholarly journals Deep Metallic Surface Defect Detection: The New Benchmark and Detection Network

Sensors ◽  
2020 ◽  
Vol 20 (6) ◽  
pp. 1562 ◽  
Author(s):  
Xiaoming Lv ◽  
Fajie Duan ◽  
Jia-jia Jiang ◽  
Xiao Fu ◽  
Lin Gan
Keyword(s):  
Defect Detection ◽  
Large Scale ◽  
Surface Defect ◽  
Data Augmentation ◽  
Training Data ◽  
Metallic Surface ◽  
Single Shot ◽  
Limited Data ◽  
Detection Model ◽  
Surface Defect Detection

Metallic surface defect detection is an essential and necessary process to control the qualities of industrial products. However, due to the limited data scale and defect categories, existing defect datasets are generally unavailable for the deployment of the detection model. To address this problem, we contribute a new dataset called GC10-DET for large-scale metallic surface defect detection. The GC10-DET dataset has great challenges on defect categories, image number, and data scale. Besides, traditional detection approaches are poor in both efficiency and accuracy for the complex real-world environment. Thus, we also propose a novel end-to-end defect detection network (EDDN) based on the Single Shot MultiBox Detector. The EDDN model can deal with defects with different scales. Furthermore, a hard negative mining method is designed to alleviate the problem of data imbalance, while some data augmentation methods are adopted to enrich the training data for the expensive data collection problem. Finally, the extensive experiments on two datasets demonstrate that the proposed method is robust and can meet accuracy requirements for metallic defect detection.

scholarly journals Research on a Surface Defect Detection Algorithm Based on MobileNet-SSD

2018 ◽  
Vol 8 (9) ◽  
pp. 1678 ◽  
Author(s):  
Yiting Li ◽  
Haisong Huang ◽  
Qingsheng Xie ◽  
Liguo Yao ◽  
Qipeng Chen
Keyword(s):  
Defect Detection ◽  
Surface Defect ◽  
Surface Defects ◽  
Detection Method ◽  
Detection Algorithm ◽  
Single Shot ◽  
Detection Model ◽  
Machine Learning Methods ◽  
Network Methods ◽  
Surface Defect Detection

This paper aims to achieve real-time and accurate detection of surface defects by using a deep learning method. For this purpose, the Single Shot MultiBox Detector (SSD) network was adopted as the meta structure and combined with the base convolution neural network (CNN) MobileNet into the MobileNet-SSD. Then, a detection method for surface defects was proposed based on the MobileNet-SSD. Specifically, the structure of the SSD was optimized without sacrificing its accuracy, and the network structure and parameters were adjusted to streamline the detection model. The proposed method was applied to the detection of typical defects like breaches, dents, burrs and abrasions on the sealing surface of a container in the filling line. The results show that our method can automatically detect surface defects more accurately and rapidly than lightweight network methods and traditional machine learning methods. The research results shed new light on defect detection in actual industrial scenarios.

Deep Learning Based Active Monitoring for Anti-collision between Vessels and Bridges

2019 ◽  
Author(s):  
Limu Chen ◽  
Ye Xia ◽  
Dexiong Pan ◽  
Chengbin Wang
Keyword(s):  
Decision Making ◽  
Deep Learning ◽  
Object Detection ◽  
Large Scale ◽  
Data Augmentation ◽  
Information Support ◽  
Single Shot ◽  
Active Monitoring ◽  
Detection Model ◽  
Comparison Results

<p>Deep-learning based navigational object detection is discussed with respect to active monitoring system for anti-collision between vessel and bridge. Motion based object detection method widely used in existing anti-collision monitoring systems is incompetent in dealing with complicated and changeable waterway for its limitations in accuracy, robustness and efficiency. The video surveillance system proposed contains six modules, including image acquisition, detection, tracking, prediction, risk evaluation and decision-making, and the detection module is discussed in detail. A vessel-exclusive dataset with tons of image samples is established for neural network training and a SSD (Single Shot MultiBox Detector) based object detection model with both universality and pertinence is generated attributing to tactics of sample filtering, data augmentation and large-scale optimization, which make it capable of stable and intelligent vessel detection. Comparison results with conventional methods indicate that the proposed deep-learning method shows remarkable advantages in robustness, accuracy, efficiency and intelligence. In-situ test is carried out at Songpu Bridge in Shanghai, and the results illustrate that the method is qualified for long-term monitoring and providing information support for further analysis and decision making.</p>

scholarly journals Deep Active Learning for Surface Defect Detection

Sensors ◽  
2020 ◽  
Vol 20 (6) ◽  
pp. 1650 ◽  
Author(s):  
Xiaoming Lv ◽  
Fajie Duan ◽  
Jia-Jia Jiang ◽  
Xiao Fu ◽  
Lin Gan
Keyword(s):  
Active Learning ◽  
Object Detection ◽  
Defect Detection ◽  
Surface Defect ◽  
Candidate List ◽  
Detection Model ◽  
Detection Systems ◽  
Learning Framework ◽  
Surface Defect Detection ◽  
Sampling Scale

Most of the current object detection approaches deliver competitive results with an assumption that a large number of labeled data are generally available and can be fed into a deep network at once. However, due to expensive labeling efforts, it is difficult to deploy the object detection systems into more complex and challenging real-world environments, especially for defect detection in real industries. In order to reduce the labeling efforts, this study proposes an active learning framework for defect detection. First, an Uncertainty Sampling is proposed to produce the candidate list for annotation. Uncertain images can provide more informative knowledge for the learning process. Then, an Average Margin method is designed to set the sampling scale for each defect category. In addition, an iterative pattern of training and selection is adopted to train an effective detection model. Extensive experiments demonstrate that the proposed method can render the required performance with fewer labeled data.

Online metallic surface defect detection using deep learning

2020 ◽  
Vol 9 (4) ◽  
pp. 1266-1273
Author(s):  
Feyza Cerezci ◽  
Serap Kazan ◽  
Muhammed Ali Oz ◽  
Cemil Oz ◽  
Tugrul Tasci ◽  
...  
Keyword(s):  
Deep Learning ◽  
Defect Detection ◽  
Surface Defect ◽  
Metallic Surface ◽  
Surface Defect Detection

scholarly journals PSIC-Net: Pixel-Wise Segmentation and Image-Wise Classification Network for Surface Defects

Machines ◽  
2021 ◽  
Vol 9 (10) ◽  
pp. 221
Author(s):  
Linjian Lei ◽  
Shengli Sun ◽  
Yue Zhang ◽  
Huikai Liu ◽  
Wenjun Xu
Keyword(s):  
Deep Learning ◽  
Defect Detection ◽  
Surface Defect ◽  
Performance Metrics ◽  
Surface Defects ◽  
Training Data ◽  
Detection Methods ◽  
Detection Technology ◽  
Surface Defect Detection ◽  
Public Datasets

Recent years have witnessed the widespread research of the surface defect detection technology based on machine vision, which has spawned various effective detection methods. In particular, the rise of deep learning has allowed the surface defect detection technology to develop further. However, these methods based on deep learning still have some drawbacks. For example, the size of the sample data is not large enough to support deep learning; the location and recognition of surface defects are not accurate enough; the real-time performance of segmentation and classification is not satisfactory. In the context, this paper proposes an end-to-end convolutional neural network model: the pixel-wise segmentation and image-wise classification network (PSIC-Net). With the innovative design of a three-stage network structure, improved loss function and a two-step training mode, PSIC-Net can accurately and quickly segment and classify surface defects with a small dataset of training data. This model was evaluated with three public datasets, and compared with the most advanced defect detection methods. All the performance metrics prove the effectiveness and advancement of PSIC-Net.

Evaluation of Data Augmentation on Surface Defect Detection

2021 ◽  
Author(s):  
Isack Farady ◽  
Chih-Yang Lin ◽  
Fityanul Akhyar ◽  
R. Roshini ◽  
John Sahaya Rani Alex
Keyword(s):  
Defect Detection ◽  
Surface Defect ◽  
Data Augmentation ◽  
Surface Defect Detection ◽  
Evaluation Of Data

scholarly journals Automatic and efficient metallic surface defect detection based on key pixel point locations

2020 ◽  
pp. 1-1
Author(s):  
Jiahui Yu ◽  
Hongwei Gao ◽  
Jian Sun ◽  
Wei Yang ◽  
Yueqiu Jiang ◽  
...  
Keyword(s):  
Defect Detection ◽  
Surface Defect ◽  
Metallic Surface ◽  
Surface Defect Detection

scholarly journals Lychee Surface Defect Detection Based on Deep Convolutional Neural Networks with GAN-Based Data Augmentation

Agronomy ◽  
2021 ◽  
Vol 11 (8) ◽  
pp. 1500
Author(s):  
Chenglong Wang ◽  
Zhifeng Xiao
Keyword(s):  
Defect Detection ◽  
Surface Defect ◽  
Data Augmentation ◽  
Cost Effective ◽  
Deep Convolutional Neural Networks ◽  
Object Boundary ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Original Dataset ◽  
Surface Defect Detection

The performance of fruit surface defect detection is easily affected by factors such as noisy background and foliage occlusion. In this study, we choose lychee as a fruit type to investigate its surface quality. Lychees are hard to preserve and have to be stored at low temperatures to keep fresh. Additionally, the surface of lychees is subject to scratches and cracks during harvesting/processing. To explore the feasibility of the automation of defective surface detection for lychees, we build a dataset with 3743 samples divided into three categories, namely, mature, defects, and rot. The original dataset suffers an imbalanced distribution issue. To address it, we adopt a transformer-based generative adversarial network (GAN) as a means of data augmentation that can effectively enhance the original training set with more and diverse samples to rebalance the three categories. In addition, we investigate three deep convolutional neural network (DCNN) models, including SSD-MobileNet V2, Faster RCNN-ResNet50, and Faster RCNN-Inception-ResNet V2, trained under different settings for an extensive comparison study. The results show that all three models demonstrate consistent performance gains in mean average precision (mAP), with the application of GAN-based augmentation. The rebalanced dataset also reduces the inter-category discrepancy, allowing a DCNN model to be trained equally across categories. In addition, the qualitative results show that models trained under the augmented setting can better identify the critical regions and the object boundary, leading to gains in mAP. Lastly, we conclude that the most cost-effective model, SSD-MobileNet V2, presents a comparable mAP (91.81%) and a superior inference speed (102 FPS), suitable for real-time detection in industrial-level applications.

Sign in / Sign up

Export Citation Format

Share Document