scholarly journals Deep Learning-Based Pose Estimation of Apples for Inspection in Logistic Centers Using Single-Perspective Imaging

Processes ◽  
2019 ◽  
Vol 7 (7) ◽  
pp. 424 ◽  
Author(s):  
Lino Antoni Giefer ◽  
Juan Daniel Arango Castellanos ◽  
Mohammad Mohammadzadeh Babr ◽  
Michael Freitag
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Pose Estimation ◽  
Three Dimensional ◽  
Estimation Algorithm ◽  
Single Shot ◽  
Network Architectures ◽  
Image Area ◽  
Natural Variations ◽  
Bounding Boxes

Fruit packaging is a time-consuming task due to its low automation level. The gentle handling required by some kinds of fruits and their natural variations complicates the implementation of automated quality controls and tray positioning for final packaging. In this article, we propose a method for the automatic localization and pose estimation of apples captured by a Red-Green-Blue (RGB) camera using convolutional neural networks. Our pose estimation algorithm uses a cascaded structure composed of two independent convolutional neural networks: one for the localization of apples within the images and a second for the estimation of the three-dimensional rotation of the localized and cropped image area containing an apple. We used a single shot multi-box detector to find the bounding boxes of the apples in the images. Lie algebra is used for the regression of the rotation, which represents an innovation in this kind of application. We compare the performances of four different network architectures and show that this kind of representation is more suitable than using state-of-the-art quaternions. By using this method, we achieved a promising accuracy for the rotation regression of 98.36%, considering an error range lower than 15 degrees, forming a base for the automation of fruit packing systems.

scholarly journals Generation and Annotation of Simulation-Real Ship Images for Convolutional Neural Networks Training and Testing

2021 ◽  
Vol 11 (13) ◽  
pp. 5931
Author(s):  
Ji’an You ◽  
Zhaozheng Hu ◽  
Chao Peng ◽  
Zhiqiang Wang
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Image Annotation ◽  
Three Dimensional ◽  
Image Data ◽  
Detection Algorithm ◽  
Simulation Software ◽  
High Quality ◽  
Annotation Method ◽  
Detection Of Objects

Large amounts of high-quality image data are the basis and premise of the high accuracy detection of objects in the field of convolutional neural networks (CNN). It is challenging to collect various high-quality ship image data based on the marine environment. A novel method based on CNN is proposed to generate a large number of high-quality ship images to address this. We obtained ship images with different perspectives and different sizes by adjusting the ships’ postures and sizes in three-dimensional (3D) simulation software, then 3D ship data were transformed into 2D ship image according to the principle of pinhole imaging. We selected specific experimental scenes as background images, and the target ships of the 2D ship images were superimposed onto the background images to generate “Simulation–Real” ship images (named SRS images hereafter). Additionally, an image annotation method based on SRS images was designed. Finally, the target detection algorithm based on CNN was used to train and test the generated SRS images. The proposed method is suitable for generating a large number of high-quality ship image samples and annotation data of corresponding ship images quickly to significantly improve the accuracy of ship detection. The annotation method proposed is superior to the annotation methods that label images with the image annotation software of Label-me and Label-img in terms of labeling the SRS images.

scholarly journals Identification of Mode Shapes of a Composite Cylinder Using Convolutional Neural Networks

Materials ◽  
2021 ◽  
Vol 14 (11) ◽  
pp. 2801
Author(s):  
Bartosz Miller ◽  
Leonard Ziemiański
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Composite Structures ◽  
Three Dimensional ◽  
Mode Shapes ◽  
Identification Algorithm ◽  
Material Degradation ◽  
Local Material ◽  
Noisy Input ◽  
Shape Vector

The aim of the following paper is to discuss a newly developed approach for the identification of vibration mode shapes of multilayer composite structures. To overcome the limitations of the approaches based on image analysis (two-dimensional structures, high spatial resolution of mode shapes description), convolutional neural networks (CNNs) are applied to create a three-dimensional mode shapes identification algorithm with a significantly reduced number of mode shape vector coordinates. The CNN-based procedure is accurate, effective, and robust to noisy input data. The appearance of local damage is not an obstacle. The change of the material and the occurrence of local material degradation do not affect the accuracy of the method. Moreover, the application of the proposed identification method allows identifying the material degradation occurrence.

Driver pose estimation using convolutional neural networks

2021 ◽  
Vol 29 (4) ◽  
pp. 813-821
Author(s):  
Ren-wen CHEN ◽  
◽  
Ting-ting YUAN ◽  
Wen-bin HUANG ◽  
Yu-xiang ZHANG
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Pose Estimation
Sign in / Sign up

Export Citation Format

Share Document