scholarly journals A Light-Weight Deep-Learning Model with Multi-Scale Features for Steel Surface Defect Classification

Materials ◽  
2020 ◽  
Vol 13 (20) ◽  
pp. 4629
Author(s):  
Yang Liu ◽  
Yachao Yuan ◽  
Cristhian Balta ◽  
Jing Liu

Automatic inspection of surface defects is crucial in industries for real-time applications. Nowadays, computer vision-based approaches have been successfully employed. However, most of the existing works need a large number of training samples to achieve satisfactory classification results, while collecting massive training datasets is labor-intensive and financially costly. Moreover, most of them obtain high accuracy at the expense of high latency, and are thus not suitable for real-time applications. In this work, a novel Concurrent Convolutional Neural Network (ConCNN) with different image scales is proposed, which is light-weighted and easy to deploy for real-time defect classification applications. To evaluate the performance of ConCNN, the NEU-CLS dataset is used in our experiments. Simulation results demonstrate that ConCNN performs better than other state-of-the-art approaches considering accuracy and latency for steel surface defect classification. Specifically, ConCNN achieves as high as 98.89% classification accuracy with only around 5.58 ms latency over low training cost.

2021 ◽  
Vol 11 (23) ◽  
pp. 11459
Author(s):  
Shiqing Wu ◽  
Shiyu Zhao ◽  
Qianqian Zhang ◽  
Long Chen ◽  
Chenrui Wu

The classification of steel surface defects plays a very important role in analyzing their causes to improve manufacturing process and eliminate defects. However, defective samples are very scarce in actual production, so using very few samples to construct a good classifier is a challenge to be addressed. If the layer number of the model with proper depth is increased, the model accuracy will decrease (not caused by overfit), and the training error as well as the test error will be very high. This is called the degradation problem. In this paper, we propose to use feature extraction + feature transformation + nearest neighbors to classify steel surface defects. In order to solve the degradation problem caused by network deepening, the three feature extraction networks of Residual Net, Mobile Net and Dense Net are designed and analyzed. Experiment results show that in the case of a small sample number, Dense block can better solve the degradation problem caused by network deepening than Residual block. Moreover, if Dense Net is used as the feature extraction network, and the nearest neighbor classification algorithm based on Euclidean metric is used in the new feature space, the defect classification accuracy can reach 92.33% when only five labeled images of each category are used as the training set. This paper is of some guiding significance for surface defect classification when the sample number is small.


Metals ◽  
2020 ◽  
Vol 10 (6) ◽  
pp. 846
Author(s):  
Ihor Konovalenko ◽  
Pavlo Maruschak ◽  
Janette Brezinová ◽  
Ján Viňáš ◽  
Jakub Brezina

An automated method for detecting and classifying three classes of surface defects in rolled metal has been developed, which allows for conducting defectoscopy with specified parameters of efficiency and speed. The possibility of using the residual neural networks for classifying defects has been investigated. The classifier based on the ResNet50 neural network is accepted as a basis. The model allows classifying images of flat surfaces with damage of three classes with the general accuracy of 96.91% based on the test data. The use of ResNet50 is shown to provide excellent recognition, high speed, and accuracy, which makes it an effective tool for detecting defects on metal surfaces.


2011 ◽  
Vol 308-310 ◽  
pp. 1328-1332 ◽  
Author(s):  
Wu Bin Li ◽  
Chang Hou Lu ◽  
Jian Chuan Zhang

Rolling steel surface defect inspection technology based on machine vision is more and more widely used. The latest progress of vision-based real-time inspection algorithm for rolling steel surface defect at home and abroad is introduced, and several key issues are analyzed. Finally, the current domestic research emphases and development trends are proposed.


Author(s):  
Yang Liu ◽  
Yachao Yuan ◽  
Jing Liu

Abstract Automatic defect classification is vital to ensure product quality, especially for steel production. In the real world, the amount of collected samples with labels is limited due to high labor costs, and the gathered dataset is usually imbalanced, making accurate steel defect classification very challenging. In this paper, a novel deep learning model for imbalanced multi-label surface defect classification, named ImDeep, is proposed. It can be deployed easily in steel production lines to identify different defect types on the steel's surface. ImDeep incorporates three key techniques, i.e., Imbalanced Sampler, Fussy-FusionNet, and Transfer Learning. It improves the model's classification performance with multi-label and reduces the model's complexity over small datasets with low latency. The performance of different fusion strategies and three key techniques of ImDeep is verified. Simulation results prove that ImDeep accomplishes better performance than the state-of-the-art over the public dataset with varied sizes. Specifically, ImDeep achieves about 97% accuracy of steel surface defect classification over a small imbalanced dataset with a low latency, which improves about 10% compared with that of the state-of-the-art.


Sensors ◽  
2020 ◽  
Vol 20 (16) ◽  
pp. 4356 ◽  
Author(s):  
Chi-Yi Tsai ◽  
Hao-Wei Chen

This paper presents an improved Convolutional Neural Network (CNN) architecture to recognize surface defects of the Calcium Silicate Board (CSB) using visual image information based on a deep learning approach. The proposed CNN architecture is inspired by the existing SurfNet architecture and is named SurfNetv2, which comprises a feature extraction module and a surface defect recognition module. The output of the system is the recognized defect category on the surface of the CSB. In the collection of the training dataset, we manually captured the defect images presented on the surface of the CSB samples. Then, we divided these defect images into four categories, which are crash, dirty, uneven, and normal. In the training stage, the proposed SurfNetv2 is trained through an end-to-end supervised learning method, so that the CNN model learns how to recognize surface defects of the CSB only through the RGB image information. Experimental results show that the proposed SurfNetv2 outperforms five state-of-the-art methods and achieves a high recognition accuracy of 99.90% and 99.75% in our private CSB dataset and the public Northeastern University (NEU) dataset, respectively. Moreover, the proposed SurfNetv2 model achieves a real-time computing speed of about 199.38 fps when processing images with a resolution of 128 × 128 pixels. Therefore, the proposed CNN model has great potential for real-time automatic surface defect recognition applications.


2018 ◽  
Vol 2018 ◽  
pp. 1-8
Author(s):  
Hou Jingzhong ◽  
Xia Kewen ◽  
Yang Fan ◽  
Zu Baokai

Strip steel surface defect recognition is a pattern recognition problem with wide applications. Previous works on strip surface defect recognition mainly focus on feature selection and dimension reduction. There are also approaches on real-time systems that mainly exploit the autocorrection within some given picture. However, the instances cannot be used in practical applications because of a bad recognition rate and low efficiency. In this paper, we study the intelligent algorithm of strip steel surface defect recognition, where the goal is to improve the accuracy and save running time. This problem is very important in various applications, especially the process testing of steel manufacturing. We propose an approach called the second-order cone programming (SOCP) optimized multiple kernel relevance vector machine (MKRVM), which can recognize strip surface defects much better than other methods. The method includes the model parameter estimation, training, and optimization of the model based on SOCP and the classification test. We compare our approach with existing methods on strip surface defect recognition. The results demonstrate that our proposed approach can improve the recognition accuracy and reduce the time costs of the strip surface defect.


2019 ◽  
Vol 68 (3) ◽  
pp. 667-679 ◽  
Author(s):  
Qiwu Luo ◽  
Yichuang Sun ◽  
Pengcheng Li ◽  
Oluyomi Simpson ◽  
Lu Tian ◽  
...  

Author(s):  
Wenyan Wang ◽  
Chunfeng Mi ◽  
Ziheng Wu ◽  
Kun Lu ◽  
Hongming Long ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document