Deep Learning-Based Data Fusion Method for In Situ Porosity Detection in Laser-Based Additive Manufacturing

2020 ◽  
Vol 143 (4) ◽  
Author(s):  
Qi Tian ◽  
Shenghan Guo ◽  
Erika Melder ◽  
Linkan Bian ◽  
Weihong “Grace” Guo

Abstract Laser-based additive manufacturing (LBAM) provides unrivalled design freedom with the ability to manufacture complicated parts for a wide range of engineering applications. Melt pool is one of the most important signatures in LBAM and is indicative of process anomalies and part defects. High-speed thermal images of the melt pool captured during LBAM make it possible for in situ melt pool monitoring and porosity prediction. This paper aims to broaden current knowledge of the underlying relationship between process and porosity in LBAM and provide new possibilities for efficient and accurate porosity prediction. We present a deep learning-based data fusion method to predict porosity in LBAM parts by leveraging the measured melt pool thermal history and two newly created deep learning neural networks. A PyroNet, based on Convolutional Neural Networks, is developed to correlate in-process pyrometry images with layer-wise porosity; an IRNet, based on Long-term Recurrent Convolutional Networks, is developed to correlate sequential thermal images from an infrared camera with layer-wise porosity. Predictions from PyroNet and IRNet are fused at the decision-level to obtain a more accurate prediction of layer-wise porosity. The model fidelity is validated with LBAM Ti–6Al–4V thin-wall structure. This is the first work that manages to fuse pyrometer data and infrared camera data for metal additive manufacturing (AM). The case study results based on benchmark datasets show that our method can achieve high accuracy with relatively high efficiency, demonstrating the applicability of the method for in situ porosity detection in LBAM.

IEEE Access ◽  
2021 ◽  
pp. 1-1
Author(s):  
Samson Ho ◽  
Wenlu Zhang ◽  
Wesley Young ◽  
Matthew Buchholz ◽  
Saleh Al Jufout ◽  
...  

2020 ◽  
Vol 32 (5) ◽  
pp. 829-864 ◽  
Author(s):  
Jing Gao ◽  
Peng Li ◽  
Zhikui Chen ◽  
Jianing Zhang

With the wide deployments of heterogeneous networks, huge amounts of data with characteristics of high volume, high variety, high velocity, and high veracity are generated. These data, referred to multimodal big data, contain abundant intermodality and cross-modality information and pose vast challenges on traditional data fusion methods. In this review, we present some pioneering deep learning models to fuse these multimodal big data. With the increasing exploration of the multimodal big data, there are still some challenges to be addressed. Thus, this review presents a survey on deep learning for multimodal data fusion to provide readers, regardless of their original community, with the fundamentals of multimodal deep learning fusion method and to motivate new multimodal data fusion techniques of deep learning. Specifically, representative architectures that are widely used are summarized as fundamental to the understanding of multimodal deep learning. Then the current pioneering multimodal data fusion deep learning models are summarized. Finally, some challenges and future topics of multimodal data fusion deep learning models are described.


2021 ◽  
Vol 25 (3) ◽  
pp. 31-35
Author(s):  
Piotr Więcek ◽  
Dominik Sankowski

The article presents a new algorithm for increasing the resolution of thermal images. For this purpose, the residual network was integrated with the Kernel-Sharing Atrous Convolution (KSAC) image sub-sampling module. A significant reduction in the algorithm’s complexity and shortening the execution time while maintaining high accuracy were achieved. The neural network has been implemented in the PyTorch environment. The results of the proposed new method of increasing the resolution of thermal images with sizes 32 × 24, 160 × 120 and 640 × 480 for scales up to 6 are presented.


2021 ◽  
Author(s):  
Chunyang Xia ◽  
Zengxi Pan ◽  
Yuxing Li ◽  
Huijun Li

Abstract Wire-arc additive manufacturing (WAAM) technology has been widely recognized as a promising alternative for fabricating large-scale components, due to its advantages of high deposition rate and high material utilization rate. However, some anomalies may occur during the deposition process, such as humping, spattering, and robot suspend. this study proposed to apply Deep Learning in the visual monitoring to diagnose different anomalies during WAAM process. The melt pool images of different anomalies were collected for training and validation by a visual monitoring system. The classification performance of several representative CNN architectures, including ResNet, EfficientNet, VGG-16 and GoogLeNet, were investigated and compared. The classification accuracy of 97.62%, 97.45%, 97.15% and 97.25% was achieved by each model. The results proved that the CNN models are effective in classifying different types of melt pool images of WAAM. Our study is applicable beyond WAAM and should benefit other additive manufacturing or arc welding techniques.


2021 ◽  
Vol 150 (4) ◽  
pp. A307-A307
Author(s):  
Christopher M. Kube ◽  
Nathan Kizer ◽  
Abdalla Nassar ◽  
Edward Reutzel ◽  
Haifeng Zhang ◽  
...  

2021 ◽  
Author(s):  
Kevontrez Jones ◽  
Zhuo Yang ◽  
Ho Yeung ◽  
Paul Witherell ◽  
Yan Lu

Abstract Laser powder-bed fusion is an additive manufacturing (AM) process that offers exciting advantages for the fabrication of metallic parts compared to traditional techniques, such as the ability to create complex geometries with less material waste. However, the intricacy of the additive process and extreme cyclic heating and cooling leads to material defects and variations in mechanical properties; this often results in unpredictable and even inferior performance of additively manufactured materials. Key indicators for the potential performance of a fabricated part are the geometry and temperature of the melt pool during the building process, due to its impact upon the underlining microstructure. Computational models, such as those based on the finite element method, of the AM process can be used to elucidate and predict the effects of various process parameters on the melt pool, according to physical principles. However, these physics-based models tend to be too computationally expensive for real-time process control. Hence, in this work, a hybrid model utilizing neural networks is proposed and demonstrated to be an accurate and efficient alternative for predicting melt pool geometries in AM, which provides a unified description of the melting conditions. The results of both a physics-based finite element model and the hybrid model are compared to real-time experimental measurements of the melt pool during single-layer AM builds using various scanning strategies.


Sign in / Sign up

Export Citation Format

Share Document