scholarly journals 3D convolutional neural networks to estimate assembly process parameters using 3D point-clouds

2019 ◽  
Author(s):  
Sumit Sinha ◽  
Emile Glorieux ◽  
Pasquale Franciosa ◽  
Dariusz Ceglarek
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Process Parameters ◽  
Point Clouds ◽  
Assembly Process ◽  
3D Point Clouds

scholarly journals Deep Learning Classification of 2D Orthomosaic Images and 3D Point Clouds for Post-Event Structural Damage Assessment

Drones ◽  
2020 ◽  
Vol 4 (2) ◽  
pp. 24 ◽  
Author(s):  
Yijun Liao ◽  
Mohammad Ebrahim Mohammadi ◽  
Richard L. Wood
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Damage Assessment ◽  
Structural Damage ◽  
Point Clouds ◽  
Depth Information ◽  
3D Point Clouds ◽  
Aerial Imaging ◽  
Damage States

Efficient and rapid data collection techniques are necessary to obtain transitory information in the aftermath of natural hazards, which is not only useful for post-event management and planning, but also for post-event structural damage assessment. Aerial imaging from unpiloted (gender-neutral, but also known as unmanned) aerial systems (UASs) or drones permits highly detailed site characterization, in particular in the aftermath of extreme events with minimal ground support, to document current conditions of the region of interest. However, aerial imaging results in a massive amount of data in the form of two-dimensional (2D) orthomosaic images and three-dimensional (3D) point clouds. Both types of datasets require effective and efficient data processing workflows to identify various damage states of structures. This manuscript aims to introduce two deep learning models based on both 2D and 3D convolutional neural networks to process the orthomosaic images and point clouds, for post windstorm classification. In detail, 2D convolutional neural networks (2D CNN) are developed based on transfer learning from two well-known networks AlexNet and VGGNet. In contrast, a 3D fully convolutional network (3DFCN) with skip connections was developed and trained based on the available point cloud data. Within this study, the datasets were created based on data from the aftermath of Hurricanes Harvey (Texas) and Maria (Puerto Rico). The developed 2DCNN and 3DFCN models were compared quantitatively based on the performance measures, and it was observed that the 3DFCN was more robust in detecting the various classes. This demonstrates the value and importance of 3D datasets, particularly the depth information, to distinguish between instances that represent different damage states in structures.

scholarly journals USING SIMULATION DATA FROM GAMING ENVIRONMENTS FOR TRAINING A DEEP LEARNING ALGORITHM ON 3D POINT CLOUDS

2021 ◽  
Vol VIII-4/W2-2021 ◽  
pp. 67-74
Author(s):  
S. Spiegel ◽  
J. Chen
Keyword(s):  
Neural Networks ◽  
Real World ◽  
Resource Constraints ◽  
Learning Algorithm ◽  
Point Clouds ◽  
Training Data ◽  
Lidar Data ◽  
Learning Approaches ◽  
Data Set ◽  
3D Point Clouds

Abstract. Deep neural networks (DNNs) and convolutional neural networks (CNNs) have demonstrated greater robustness and accuracy in classifying two-dimensional images and three-dimensional point clouds compared to more traditional machine learning approaches. However, their main drawback is the need for large quantities of semantically labeled training data sets, which are often out of reach for those with resource constraints. In this study, we evaluated the use of simulated 3D point clouds for training a CNN learning algorithm to segment and classify 3D point clouds of real-world urban environments. The simulation involved collecting light detection and ranging (LiDAR) data using a simulated 16 channel laser scanner within the the CARLA (Car Learning to Act) autonomous vehicle gaming environment. We used this labeled data to train the Kernel Point Convolution (KPConv) and KPConv Segmentation Network for Point Clouds (KP-FCNN), which we tested on real-world LiDAR data from the NPM3D benchmark data set. Our results showed that high accuracy can be achieved using data collected in a simulator.

scholarly journals Remaining Useful Life Prediction from 3D Scan Data with Genetically Optimized Convolutional Neural Networks

2021 ◽  
Author(s):  
Giovanni Diraco ◽  
Pietro Siciliano ◽  
Alessandro Leone
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Support Vector Regression ◽  
Transfer Learning ◽  
Convolutional Neural Networks ◽  
Life Prediction ◽  
Point Clouds ◽  
Remaining Useful Life ◽  
Support Vector ◽  
Useful Life

In the current industrial landscape, increasingly pervaded by technological innovations, the adoption of optimized strategies for asset management is becoming a critical key success factor. Among the various strategies available, the “Prognostics and Health Management” strategy is able to support maintenance management decisions more accurately, through continuous monitoring of equipment health and “Remaining Useful Life” forecasting. In the present study, Convolutional Neural Network-based Deep Neural Network techniques are investigated for the Remaining Useful Life prediction of a punch tool, whose degradation is caused by working surface deformations during the machining process. Surface deformation is determined using a 3D scanning sensor capable of returning point clouds with micrometric accuracy during the operation of the punching machine, avoiding both downtime and human intervention. The 3D point clouds thus obtained are transformed into bidimensional image-type maps, i.e., maps of depths and normal vectors, to fully exploit the potential of convolutional neural networks for extracting features. Such maps are then processed by comparing 15 genetically optimized architectures with the transfer learning of 19 pre-trained models, using a classic machine learning approach, i.e., Support Vector Regression, as a benchmark. The achieved results clearly show that, in this specific case, optimized architectures provide performance far superior (MAPE=0.058) to that of transfer learning which, instead, remains at a lower or slightly higher level (MAPE=0.416) than Support Vector Regression (MAPE=0.857).

Determining Dendrometry Using Drone Scouting, Convolutional Neural Networks and Point Clouds

2021 ◽  
Author(s):  
Kim Jensen ◽  
Oskar Kondrup Krogh ◽  
Marius Willemoes Jorgensen ◽  
Daniel Lehotsky ◽  
Anton Bock Andersen ◽  
...  
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Point Clouds
Sign in / Sign up

Export Citation Format

Share Document