scholarly journals Efficient 3D Object Recognition from Cluttered Point Cloud

Sensors ◽  
2021 ◽  
Vol 21 (17) ◽  
pp. 5850
Author(s):  
Wei Li ◽  
Hongtai Cheng ◽  
Xiaohua Zhang
Keyword(s):  
Point Cloud ◽  
Evaluation Process ◽  
Point Clouds ◽  
3D Object Recognition ◽  
Initial Alignment ◽  
Complex Scene ◽  
3D Objects ◽  
Key Points ◽  
Real Time Applications ◽  
Correspondence Search

Recognizing 3D objects and estimating their postures in a complex scene is a challenging task. Sample Consensus Initial Alignment (SAC-IA) is a commonly used point cloud-based method to achieve such a goal. However, its efficiency is low, and it cannot be applied in real-time applications. This paper analyzes the most time-consuming part of the SAC-IA algorithm: sample generation and evaluation. We propose two improvements to increase efficiency. In the initial aligning stage, instead of sampling the key points, the correspondence pairs between model and scene key points are generated in advance and chosen in each iteration, which reduces the redundant correspondence search operations; a geometric filter is proposed to prevent the invalid samples to the evaluation process, which is the most time-consuming operation because it requires transforming and calculating the distance between two point clouds. The introduction of the geometric filter can significantly increase the sample quality and reduce the required sample numbers. Experiments are performed on our own datasets captured by Kinect v2 Camera and on Bologna 1 dataset. The results show that the proposed method can significantly increase (10–30×) the efficiency of the original SAC-IA method without sacrificing accuracy.

scholarly journals Planar surface segmentation using a color-enhanced hybrid model for RGB-D camera-based indoor mobile mapping point clouds

2014 ◽  
Vol II-1 ◽  
pp. 61-67
Author(s):  
C. Wen ◽  
S. Lin ◽  
C. Wang ◽  
J. Li
Keyword(s):  
Point Cloud ◽  
Evaluation Process ◽  
Point Clouds ◽  
Planar Surface ◽  
Mobile Mapping ◽  
Hybrid Features ◽  
Segmentation Evaluation ◽  
Cloud Data ◽  
Surface Segmentation ◽  
Mapping Point

Point clouds acquired by RGB-D camera-based indoor mobile mapping system suffer the problems of being noisy, exhibiting an uneven distribution, and incompleteness, which are the problems that introduce difficulties for point cloud planar surface segmentation. This paper presents a novel color-enhanced hybrid planar surface segmentation model for RGB-D camera-based indoor mobile mapping point clouds based on region growing method, and the model specially addresses the planar surface extraction task over point cloud according to the noisy and incomplete indoor mobile mapping point clouds. The proposed model combines the color moments features with the curvature feature to select the seed points better. Additionally, a more robust growing criteria based on the hybrid features is developed to avoid the generation of excessive over-segmentation debris. A segmentation evaluation process with a small set of labeled segmented data is used to determine the optimal hybrid weight. Several comparative experiments were conducted to evaluate the segmentation model, and the experimental results demonstrate the effectiveness and efficiency of the proposed hybrid segmentation method for indoor mobile mapping three-dimensional (3D) point cloud data.

scholarly journals BUILDING FEATURES RECOGNITION FROM UNCERTAIN 3D LIDAR POINT CLOUDS: A SEMANTIC APPROACH

2020 ◽  
Vol XLIII-B4-2020 ◽  
pp. 89-96
Author(s):  
X.-F. Xing ◽  
M. A. Mostafavi
Keyword(s):  
Point Cloud ◽  
Evaluation Process ◽  
Point Clouds ◽  
Semantic Approach ◽  
Semantic Reasoning ◽  
Knowledge Based ◽  
3D Point Clouds ◽  
Building Components ◽  
3D Lidar

Abstract. LiDAR technology allows rapid observation of high-resolution and precise 3D point clouds for diverse applications in urban and natural areas. However, uneven density and incomplete point clouds make LiDAR data processing more challenging for the extraction of semantic information on objects and their components. In this paper, we propose a knowledge based semantic reasoning solution for the recognition of building components (e.g. roofs) from segmentation results in the presence of uncertainties in LiDAR point clouds. The proposed solution uses a semantic reasoning approach as well as a similarity evaluation process for object recognition. We apply the proposed method to recognize buildings’ roof styles from a point cloud with uncertainty as a case study.

scholarly journals TLS POINT CLOUD REGISTRATION FOR DETECTING CHANGE IN INDIVIDUAL ROCKS OF A MOUNTAIN RIVER BED

2019 ◽  
Vol XLII-2/W13 ◽  
pp. 1149-1154
Author(s):  
A. Walicka ◽  
N. Pfeifer ◽  
G. Jóźków ◽  
A. Borkowski
Keyword(s):  
Gaussian Curvature ◽  
Point Cloud ◽  
Laser Scanning ◽  
Nearest Neighbor ◽  
Point Clouds ◽  
Point Cloud Registration ◽  
River Bed ◽  
Key Points ◽  
Transformation Parameters ◽  
Movement Parameters

<p><strong>Abstract.</strong> Remote sensing techniques are an important tool in fluvial transport monitoring, since they allow for effective evaluation of the volume of transported material. Nevertheless, there is no methodology for automatic calculation of movement parameters of individual rocks. These parameters can be determined by point cloud registration. Hence, the goal of this study is to develop a robust algorithm for terrestrial laser scanning point cloud registration. The registration is based on Iterative Closest Point algorithm, which requires well established initial parameters of transformation. Thus, we propose to calculate the initial parameters based on key points representing the maximum of Gaussian curvature. For each key point the set of geometrical features is calculated. The key points are then matched between two point clouds as a nearest neighbor in feature domain. Different combinations of neighborhood sizes, feature subsets, metrics and number of nearest neighbors were tested to obtain the highest ratio between properly and improperly matched key points. Finally, RANSAC algorithm was used to calculate the initial transformation parameters between the point clouds and the ICP algorithm was used for calculation of final transformation parameters. The investigations carried out on sample point clouds representing rocks enabled the adjustment of parameters of the algorithm and showed that the Gaussian curvature can be used as a 3-dimentional key point detector for such objects. The proposed algorithm enabled to register point clouds with the mean distance between point clouds equal to 3&amp;thinsp;mm.</p>

scholarly journals LIDAR Point Cloud Registration for Sensing and Reconstruction of Unstructured Terrain

2018 ◽  
Vol 8 (11) ◽  
pp. 2318 ◽  
Author(s):  
Qingyuan Zhu ◽  
Jinjin Wu ◽  
Huosheng Hu ◽  
Chunsheng Xiao ◽  
Wei Chen
Keyword(s):  
Autonomous Vehicles ◽  
Point Cloud ◽  
Laser Scanning ◽  
Point Clouds ◽  
Normal Vector ◽  
Registration Method ◽  
High Noise ◽  
Key Points ◽  
Scanning Lidar ◽  
Multisensor Data

When 3D laser scanning (LIDAR) is used for navigation of autonomous vehicles operated on unstructured terrain, it is necessary to register the acquired point cloud and accurately perform point cloud reconstruction of the terrain in time. This paper proposes a novel registration method to deal with uneven-density and high-noise of unstructured terrain point clouds. It has two steps of operation, namely initial registration and accurate registration. Multisensor data is firstly used for initial registration. An improved Iterative Closest Point (ICP) algorithm is then deployed for accurate registration. This algorithm extracts key points and builds feature descriptors based on the neighborhood normal vector, point cloud density and curvature. An adaptive threshold is introduced to accelerate iterative convergence. Experimental results are given to show that our two-step registration method can effectively solve the uneven-density and high-noise problem in registration of unstructured terrain point clouds, thereby improving the accuracy of terrain point cloud reconstruction.

scholarly journals Feature-Preserved Point Cloud Simplification Based on Natural Quadric Shape Models

2019 ◽  
Vol 9 (10) ◽  
pp. 2130 ◽  
Author(s):  
Kun Zhang ◽  
Shiquan Qiao ◽  
Xiaohong Wang ◽  
Yongtao Yang ◽  
Yongqiang Zhang
Keyword(s):  
Point Cloud ◽  
Shape Operator ◽  
Point Clouds ◽  
Data Set ◽  
Cloud Data ◽  
Shape Models ◽  
Huge Data ◽  
Key Points ◽  
Data Volume ◽  
Point Cloud Simplification

With the development of 3D scanning technology, a huge volume of point cloud data has been collected at a lower cost. The huge data set is the main burden during the data processing of point clouds, so point cloud simplification is critical. The main aim of point cloud simplification is to reduce data volume while preserving the data features. Therefore, this paper provides a new method for point cloud simplification, named FPPS (feature-preserved point cloud simplification). In FPPS, point cloud simplification entropy is defined, which quantifies features hidden in point clouds. According to simplification entropy, the key points including the majority of the geometric features are selected. Then, based on the natural quadric shape, we introduce a point cloud matching model (PCMM), by which the simplification rules are set. Additionally, the similarity between PCMM and the neighbors of the key points is measured by the shape operator. This represents the criteria for the adaptive simplification parameters in FPPS. Finally, the experiment verifies the feasibility of FPPS and compares FPPS with other four-point cloud simplification algorithms. The results show that FPPS is superior to other simplification algorithms. In addition, FPPS can partially recognize noise.

scholarly journals DGCB-Net: Dynamic Graph Convolutional Broad Network for 3D Object Recognition in Point Cloud

2020 ◽  
Vol 13 (1) ◽  
pp. 66
Author(s):  
Yifei Tian ◽  
Long Chen ◽  
Wei Song ◽  
Yunsick Sung ◽  
Sangchul Woo
Keyword(s):  
Object Recognition ◽  
Point Cloud ◽  
Recognition Performance ◽  
Point Clouds ◽  
Disease Diagnosis ◽  
3D Object Recognition ◽  
Dynamic Graph ◽  
3D Object ◽  
Feature Aggregation ◽  
Dimensional Object

3D (3-Dimensional) object recognition is a hot research topic that benefits environment perception, disease diagnosis, and the mobile robot industry. Point clouds collected by range sensors are a popular data structure to represent a 3D object model. This paper proposed a 3D object recognition method named Dynamic Graph Convolutional Broad Network (DGCB-Net) to realize feature extraction and 3D object recognition from the point cloud. DGCB-Net adopts edge convolutional layers constructed by weight-shared multiple-layer perceptrons (MLPs) to extract local features from the point cloud graph structure automatically. Features obtained from all edge convolutional layers are concatenated together to form a feature aggregation. Unlike stacking many layers in-depth, our DGCB-Net employs a broad architecture to extend point cloud feature aggregation flatly. The broad architecture is structured utilizing a flat combining architecture with multiple feature layers and enhancement layers. Both feature layers and enhancement layers concatenate together to further enrich the features’ information of the point cloud. All features work on the object recognition results thus that our DGCB-Net show better recognition performance than other 3D object recognition algorithms on ModelNet10/40 and our scanning point cloud dataset.

scholarly journals OPACITY-BASED EDGE HIGHLIGHTING FOR TRANSPARENT VISUALIZATION OF 3D SCANNED POINT CLOUDS

2020 ◽  
Vol V-2-2020 ◽  
pp. 373-380
Author(s):  
K. Kawakami ◽  
K. Hasegawa ◽  
L. Li ◽  
H. Nagata ◽  
M. Adachi ◽  
...  
Keyword(s):  
Real World ◽  
Point Cloud ◽  
Large Scale ◽  
3D Structure ◽  
Point Clouds ◽  
High Quality ◽  
3D Images ◽  
3D Structures ◽  
3D Objects ◽  
Scale Point

Abstract. The recent development of 3D scanning technologies has made it possible to quickly and accurately record various 3D objects in the real world. The 3D scanned data take the form of large-scale point clouds, which describe complex 3D structures of the target objects and the surrounding scenes. The complexity becomes significant in cases that a scanned object has internal 3D structures, and the acquired point cloud is created by merging the scanning results of both the interior and surface shapes. To observe the whole 3D structure of such complex point-based objects, the point-based transparent visualization, which we recently proposed, is useful because we can observe the internal 3D structures as well as the surface shapes based on high-quality see-through 3D images. However, transparent visualization sometimes shows us too much information so that the generated images become confusing. To address this problem, in this paper, we propose to combine “edge highlighting” with transparent visualization. This combination makes the created see-through images quite understandable because we can highlight the 3D edges of visualized shapes as high-curvature areas. In addition, to make the combination more effective, we propose a new edge highlighting method applicable to 3D scanned point clouds. We call the method “opacity-based edge highlighting,” which appropriately utilizes the effect of transparency to make the 3D edge regions look clearer. The proposed method works well for both sharp (high-curvature) and soft (low-curvature) 3D edges. We show several experiments that demonstrate our method’s effectiveness by using real 3D scanned point clouds.

scholarly journals Automatic Point Cloud Registration for Large Outdoor Scenes Using a Priori Semantic Information

2021 ◽  
Vol 13 (17) ◽  
pp. 3474
Author(s):  
Jian Li ◽  
Shuowen Huang ◽  
Hao Cui ◽  
Yurong Ma ◽  
Xiaolong Chen
Keyword(s):  
Point Cloud ◽  
Semantic Information ◽  
A Priori ◽  
Semantic Segmentation ◽  
Point Clouds ◽  
Global Alignment ◽  
Feature Descriptor ◽  
Point Cloud Registration ◽  
Key Points ◽  
Outdoor Scenes

As an important and fundamental step in 3D reconstruction, point cloud registration aims to find rigid transformation that register two point sets. The major challenge in point cloud registration techniques is finding correct correspondences in the scenes which may contain many repetitive structures and noise. This paper is primarily concerned with improving registration using a priori semantic information in the search for correspondences. In particular, we present a new point cloud registration pipeline for large outdoor scenes that takes advantage of semantic segmentation. Our method consists of extracting semantic segments from point clouds uses an efficient deep neural network; then, detecting the key points of the point cloud and using a feature descriptor to get the initial correspondence set; finally, applying a Random Sample Consensus (RANSAC) strategy to estimate the transformations that align segments with the same labels. Instead of using all points to estimate a global alignment, our method aligns two point clouds using transformations calculated by each segment with the highest inlier ratio. We evaluate our method on the publicly available Whu-TLS registration dataset. These experiments demonstrate how a priori semantic information the improves registration in terms of precision and speed.

scholarly journals DEM BASED REGISTRATION OF MULTI-SENSOR AIRBORNE POINT CLOUDS EXEMPLARY SHOWN ON A RIVER SIDE IN NON URBAN AREA

2018 ◽  
Vol XLII-2 ◽  
pp. 109-116 ◽  
Author(s):  
R. Boerner ◽  
Y. Xu ◽  
L. Hoegner ◽  
R. Baran ◽  
F. Steinbacher ◽  
...  
Keyword(s):  
Urban Areas ◽  
Point Cloud ◽  
Grid Cell ◽  
Point Clouds ◽  
Control Points ◽  
Building Structures ◽  
Optical Images ◽  
Key Points ◽  
Geometric Primitives ◽  
Center Cell

This paper presents a method to register photogrammetric point clouds generated from optical images acquired by UAV and aerial LIDAR point clouds. Normally, the registration of two airborne scans of the same scene is solved by the use of control points and the direct registration using GNSS and INS information. However, the registration of multi-sensor point clouds without control points is more complicated and challenging. For the scene of non urban areas, the registration task gets even more complicated, because it is hard to extract sufficient geometric primitives from the building structures. For our proposed method, an outdoor scene is tested providing almost no man-made objects. Therefore, it is nearly impossible to search for planar objects and use them for registration. With no geometric primitives extracted, the proposed method utilizes the structure of the 2.5D DEM created from the ground points of the point cloud. Besides, instead of using control points or key points, the method automatic detect key planes from the 2.5D DEM as correspondences. These key planes are detected on a regular grid by the use of a predefined mask. To mark a DEM grid cell as key plane the histogram of sums of the angles between the center cell is used. Afterwards, similarity values between two key planes are calculated based on the histogram differences and a RANSAC based strategy is adopted to find corresponding key planes and estimate the transformation parameters. Experiments conducted in this paper indicate that it is feasible to register multi sensor point clouds with a big difference in their ground sampling distances with respect to the used cell size of the 2.5D DEM.

scholarly journals PHOTOGRAMMETRY AND COMPUTED TOMOGRAPHY POINT CLOUD REGISTRATION USING VIRTUAL CONTROL POINTS

2021 ◽  
Vol XLIII-B2-2021 ◽  
pp. 265-270
Author(s):  
K. Zhan ◽  
D. Fritsch ◽  
J. F. Wagner
Keyword(s):  
Computed Tomography ◽  
Point Cloud ◽  
Control Point ◽  
Point Clouds ◽  
Parameters Estimation ◽  
Control Points ◽  
Initial Alignment ◽  
3D Reconstructions ◽  
Virtual Control ◽  
Geometric Primitives

Abstract. In this paper we propose a virtual control point based method for the registration of photogrammetry and computed tomography (CT) data. Because of the fundamentally different two data sources, conventional registration methods, such as manual control points registration or 3D local feature-based registration, are not suitable. The registration objective of our application is about 3D reconstructions of gyroscopes, which contain abundant geometric primitives to be fitted in the point clouds. In the first place, photogrammetry and CT scanning are applied, respectively, for 3D reconstructions. Secondly, our workflow implements a segmentation after obtaining the surface point cloud from the complete CT volumetric data. Then geometric primitives are fitted in this point cloud benefitting from the less complex cluster segments. In the next step, intersection operations of the parametrized primitives generates virtual points, which are utilized as control points for the transformation parameters estimation. A random sample consensus (RANSAC) method is applied to find the correspondences of both virtual control point sets using corresponding descriptors and calculates the transformation matrix as an initial alignment for further refining the registration. The workflow is invariant to pose, resolution, completeness and noise within our validation process.

Sign in / Sign up

Export Citation Format

Share Document