scholarly journals Three-Dimensional Point Cloud Reconstruction and Morphology Measurement Method for Greenhouse Plants Based on the Kinect Sensor Self-Calibration

Agronomy ◽  
2019 ◽  
Vol 9 (10) ◽  
pp. 596 ◽  
Author(s):  
Guoxiang Sun ◽  
Xiaochan Wang
Keyword(s):  
High Throughput ◽  
Point Cloud ◽  
Three Dimensional ◽  
Growth Cycle ◽  
Morphological Data ◽  
Normal Vector ◽  
Reconstruction Method ◽  
3D Point Cloud ◽  
Kinect Sensor ◽  
3D Point Cloud Reconstruction

Plant morphological data are an important basis for precision agriculture and plant phenomics. The three-dimensional (3D) geometric shape of plants is complex, and the 3D morphology of a plant changes relatively significantly during the full growth cycle. In order to make high-throughput measurements of the 3D morphological data of greenhouse plants, it is necessary to frequently adjust the relative position between the sensor and the plant. Therefore, it is necessary to frequently adjust the Kinect sensor position and consequently recalibrate the Kinect sensor during the full growth cycle of the plant, which significantly increases the tedium of the multiview 3D point cloud reconstruction process. A high-throughput 3D rapid greenhouse plant point cloud reconstruction method based on autonomous Kinect v2 sensor position calibration is proposed for 3D phenotyping greenhouse plants. Two red–green–blue–depth (RGB-D) images of the turntable surface are acquired by the Kinect v2 sensor. The central point and normal vector of the axis of rotation of the turntable are calculated automatically. The coordinate systems of RGB-D images captured at various view angles are unified based on the central point and normal vector of the axis of the turntable to achieve coarse registration. Then, the iterative closest point algorithm is used to perform multiview point cloud precise registration, thereby achieving rapid 3D point cloud reconstruction of the greenhouse plant. The greenhouse tomato plants were selected as measurement objects in this study. Research results show that the proposed 3D point cloud reconstruction method was highly accurate and stable in performance, and can be used to reconstruct 3D point clouds for high-throughput plant phenotyping analysis and to extract the morphological parameters of plants.

scholarly journals Weakly-Supervised Single-view Dense 3D Point Cloud Reconstruction via Differentiable Renderer

2021 ◽  
Vol 34 (1) ◽  
Author(s):  
Peng Jin ◽  
Shaoli Liu ◽  
Jianhua Liu ◽  
Hao Huang ◽  
Linlin Yang ◽  
...  
Keyword(s):  
Point Cloud ◽  
3D Structure ◽  
Three Dimensional ◽  
Ground Truth ◽  
3D Point Cloud ◽  
Real World Data ◽  
Single View ◽  
Camera Pose ◽  
3D Point Cloud Reconstruction ◽  
The Individual

AbstractIn recent years, addressing ill-posed problems by leveraging prior knowledge contained in databases on learning techniques has gained much attention. In this paper, we focus on complete three-dimensional (3D) point cloud reconstruction based on a single red-green-blue (RGB) image, a task that cannot be approached using classical reconstruction techniques. For this purpose, we used an encoder-decoder framework to encode the RGB information in latent space, and to predict the 3D structure of the considered object from different viewpoints. The individual predictions are combined to yield a common representation that is used in a module combining camera pose estimation and rendering, thereby achieving differentiability with respect to imaging process and the camera pose, and optimization of the two-dimensional prediction error of novel viewpoints. Thus, our method allows end-to-end training and does not require supervision based on additional ground-truth (GT) mask annotations or ground-truth camera pose annotations. Our evaluation of synthetic and real-world data demonstrates the robustness of our approach to appearance changes and self-occlusions, through outperformance of current state-of-the-art methods in terms of accuracy, density, and model completeness.

scholarly journals Geometric Modeling of Rosa roxburghii Fruit Based on Three-Dimensional Point Cloud Reconstruction

2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Zhiping Xie ◽  
Yancheng Lang ◽  
Luqi Chen
Keyword(s):  
Geometric Modeling ◽  
Point Cloud ◽  
Three Dimensional ◽  
Laser Scanner ◽  
Reconstruction Algorithm ◽  
Reconstruction Method ◽  
3D Point Cloud ◽  
Outlier Removal ◽  
Actual Surface ◽  
Rosa Roxburghii

Fruit three-dimensional (3D) model is crucial to estimating its geometrical and mechanical properties and improving the level of fruit mechanical processing. Considering the complex geometrical features and the required model accuracy, this paper proposed a 3D point cloud reconstruction method for the Rosa roxburghii fruit based on a three-dimensional laser scanner, including 3D point cloud generation, point cloud registration, fruit thorns segmentation, and 3D reconstruction. The 3D laser scanner was used to obtain the original 3D point cloud data of the Rosa roxburghii fruit, and then the fruit thorns data were removed by the segmentation algorithm combining the statistical outlier removal and radius outlier removal. By analyzing the effects of five-point cloud simplification methods, the optimal simplification method was determined. The Poisson reconstruction algorithm, the screened Poisson reconstruction algorithm, the greedy projection triangulation algorithm, and the Delaunay triangulation algorithm were utilized to reconstruct the fruit model. The number of model vertices, the number of facets, and the relative volume error were used to determine the best reconstruction algorithm. The results indicated that this model can better reconstruct the actual surface of Rosa roxburghii fruit. The method provides a reference for the related application.

scholarly journals 3D Point Cloud Reconstruction Using Inversely Mapping and Voting from Single Pass CSAR Images

2021 ◽  
Vol 13 (17) ◽  
pp. 3534
Author(s):  
Shanshan Feng ◽  
Yun Lin ◽  
Yanping Wang ◽  
Fei Teng ◽  
Wen Hong
Keyword(s):  
Point Cloud ◽  
Three Dimensional ◽  
Target Point ◽  
3D Point Cloud ◽  
Data Set ◽  
Single Pass ◽  
Imaging Results ◽  
Imaging Point ◽  
3D Point Cloud Reconstruction ◽  
Projection Point

3D reconstruction has raised much interest in the field of CSAR. However, three dimensional imaging results with single pass CSAR data reveals that the 3D resolution of the system is poor for anisotropic scatterers. According to the imaging mechanism of CSAR, different targets located on the same iso-range line in the zero doppler plane fall into the same cell while for the same target point, imaging point will fall into the different positions at different aspect angles. In this paper, we proposed a method for 3D point cloud reconstruction using projections on 2D sub-aperture images. The target and background in the sub-aperture images are separated and binarized. For a projection point of target, given a series of offsets, the projection point will be mapped inversely to the 3D mesh along the iso-range line. We can obtain candidate points of the target. The intersection of iso-range lines can be regarded as voting process. For a candidate, the more times of intersection, the higher the number of votes, and the candidate point will be reserved. This fully excavates the information contained in the angle dimension of CSAR. The proposed approach is verified by the Gotcha Volumetric SAR Data Set.

scholarly journals Automatic Reconstruction of Multi-Level Indoor Spaces from Point Cloud and Trajectory

Sensors ◽  
2021 ◽  
Vol 21 (10) ◽  
pp. 3493
Author(s):  
Gahyeon Lim ◽  
Nakju Doh
Keyword(s):  
Point Cloud ◽  
Dimensional Space ◽  
Three Dimensional ◽  
Reconstruction Method ◽  
Complex Environments ◽  
Indoor Space ◽  
Multi Level ◽  
Level Building ◽  
Indoor Spaces ◽  
Data Term

Remarkable progress in the development of modeling methods for indoor spaces has been made in recent years with a focus on the reconstruction of complex environments, such as multi-room and multi-level buildings. Existing methods represent indoor structure models as a combination of several sub-spaces, which are constructed by room segmentation or horizontal slicing approach that divide the multi-room or multi-level building environments into several segments. In this study, we propose an automatic reconstruction method of multi-level indoor spaces with unique models, including inter-room and inter-floor connections from point cloud and trajectory. We construct structural points from registered point cloud and extract piece-wise planar segments from the structural points. Then, a three-dimensional space decomposition is conducted and water-tight meshes are generated with energy minimization using graph cut algorithm. The data term of the energy function is expressed as a difference in visibility between each decomposed space and trajectory. The proposed method allows modeling of indoor spaces in complex environments, such as multi-room, room-less, and multi-level buildings. The performance of the proposed approach is evaluated for seven indoor space datasets.

scholarly journals Three-Dimensional Morphological Measurement Method for a Fruit Tree Canopy Based on Kinect Sensor Self-Calibration

Agronomy ◽  
2019 ◽  
Vol 9 (11) ◽  
pp. 741 ◽  
Author(s):  
Haihui Yang ◽  
Xiaochan Wang ◽  
Guoxiang Sun
Keyword(s):  
Intelligent Control ◽  
Point Cloud ◽  
Three Dimensional ◽  
Fruit Tree ◽  
Tree Canopy ◽  
Morphological Parameters ◽  
Kinect Sensor ◽  
Self Calibration ◽  
Morphological Measurement ◽  
Tree Width

Perception of the fruit tree canopy is a vital technology for the intelligent control of a modern standardized orchard. Due to the complex three-dimensional (3D) structure of the fruit tree canopy, morphological parameters extracted from two-dimensional (2D) or single-perspective 3D images are not comprehensive enough. Three-dimensional information from different perspectives must be combined in order to perceive the canopy information efficiently and accurately in complex orchard field environment. The algorithms used for the registration and fusion of data from different perspectives and the subsequent extraction of fruit tree canopy related parameters are the keys to the problem. This study proposed a 3D morphological measurement method for a fruit tree canopy based on Kinect sensor self-calibration, including 3D point cloud generation, point cloud registration and canopy information extraction of apple tree canopy. Using 32 apple trees (Yanfu 3 variety) morphological parameters of the height (H), maximum canopy width (W) and canopy thickness (D) were calculated. The accuracy and applicability of this method for extraction of morphological parameters were statistically analyzed. The results showed that, on both sides of the fruit trees, the average relative error (ARE) values of the morphological parameters including the fruit tree height (H), maximum tree width (W) and canopy thickness (D) between the calculated values and measured values were 3.8%, 12.7% and 5.0%, respectively, under the V1 mode; the ARE values under the V2 mode were 3.3%, 9.5% and 4.9%, respectively; and the ARE values under the V1 and V2 merged mode were 2.5%, 3.6% and 3.2%, respectively. The measurement accuracy of the tree width (W) under the double visual angle mode had a significant advantage over that under the single visual angle mode. The 3D point cloud reconstruction method based on Kinect self-calibration proposed in this study has high precision and stable performance, and the auxiliary calibration objects are readily portable and easy to install. It can be applied to different experimental scenes to extract 3D information of fruit tree canopies and has important implications to achieve the intelligent control of standardized orchards.

Automated Surface Inspection Using 3D Point Cloud Data in Manufacturing: A Case Study

2018 ◽  
Author(s):  
Romina Dastoorian ◽  
Ahmad E. Elhabashy ◽  
Wenmeng Tian ◽  
Lee J. Wells ◽  
Jaime A. Camelio
Keyword(s):  
Point Cloud ◽  
Surface Defect ◽  
Fault Location ◽  
Three Dimensional ◽  
Practical Case ◽  
3D Point Cloud ◽  
Point Cloud Data ◽  
Defect Inspection ◽  
Cloud Data

With the latest advancements in three-dimensional (3D) measurement technologies, obtaining 3D point cloud data for inspection purposes in manufacturing is becoming more common. While 3D point cloud data allows for better inspection capabilities, their analysis is typically challenging. Especially with unstructured 3D point cloud data, containing coordinates at random locations, the challenges increase with higher levels of noise and larger volumes of data. Hence, the objective of this paper is to extend the previously developed Adaptive Generalized Likelihood Ratio (AGLR) approach to handle unstructured 3D point cloud data used for automated surface defect inspection in manufacturing. More specifically, the AGLR approach was implemented in a practical case study to inspect twenty-seven samples, each with a unique fault. These faults were designed to cover an array of possible faults having three different sizes, three different magnitudes, and located in three different locations. The results show that the AGLR approach can indeed differentiate between non-faulty and a varying range of faulty surfaces while being able to pinpoint the fault location. This work also serves as a validation for the previously developed AGLR approach in a practical scenario.

Sign in / Sign up

Export Citation Format

Share Document