scholarly journals An Improved Algorithm Robust to Illumination Variations for Reconstructing Point Cloud Models from Images

2021 ◽  
Vol 13 (4) ◽  
pp. 567
Author(s):  
Nan Luo ◽  
Ling Huang ◽  
Quan Wang ◽  
Gang Liu

Reconstructing 3D point cloud models from image sequences tends to be impacted by illumination variations and textureless cases in images, resulting in missing parts or uneven distribution of retrieved points. To improve the reconstructing completeness, this work proposes an enhanced similarity metric which is robust to illumination variations among images during the dense diffusions to push the seed-and-expand reconstructing scheme to a further extent. This metric integrates the zero-mean normalized cross-correlation coefficient of illumination and that of texture information which respectively weakens the influence of illumination variations and textureless cases. Incorporated with disparity gradient and confidence constraints, the candidate image features are diffused to their neighborhoods for dense 3D points recovering. We illustrate the two-phase results of multiple datasets and evaluate the robustness of proposed algorithm to illumination variations. Experiments show that ours recovers 10.0% more points, on average, than comparing methods in illumination varying scenarios and achieves better completeness with comparative accuracy.

Materials ◽  
2021 ◽  
Vol 14 (6) ◽  
pp. 1563
Author(s):  
Ruibing Wu ◽  
Ziping Yu ◽  
Donghong Ding ◽  
Qinghua Lu ◽  
Zengxi Pan ◽  
...  

As promising technology with low requirements and high depositing efficiency, Wire Arc Additive Manufacturing (WAAM) can significantly reduce the repair cost and improve the formation quality of molds. To further improve the accuracy of WAAM in repairing molds, the point cloud model that expresses the spatial distribution and surface characteristics of the mold is proposed. Since the mold has a large size, it is necessary to be scanned multiple times, resulting in multiple point cloud models. The point cloud registration, such as the Iterative Closest Point (ICP) algorithm, then plays the role of merging multiple point cloud models to reconstruct a complete data model. However, using the ICP algorithm to merge large point clouds with a low-overlap area is inefficient, time-consuming, and unsatisfactory. Therefore, this paper provides the improved Offset Iterative Closest Point (OICP) algorithm, which is an online fast registration algorithm suitable for intelligent WAAM mold repair technology. The practicality and reliability of the algorithm are illustrated by the comparison results with the standard ICP algorithm and the three-coordinate measuring instrument in the Experimental Setup Section. The results are that the OICP algorithm is feasible for registrations with low overlap rates. For an overlap rate lower than 60% in our experiments, the traditional ICP algorithm failed, while the Root Mean Square (RMS) error reached 0.1 mm, and the rotation error was within 0.5 degrees, indicating the improvement of the proposed OICP algorithm.


Author(s):  
L. Zhang ◽  
P. van Oosterom ◽  
H. Liu

Abstract. Point clouds have become one of the most popular sources of data in geospatial fields due to their availability and flexibility. However, because of the large amount of data and the limited resources of mobile devices, the use of point clouds in mobile Augmented Reality applications is still quite limited. Many current mobile AR applications of point clouds lack fluent interactions with users. In our paper, a cLoD (continuous level-of-detail) method is introduced to filter the number of points to be rendered considerably, together with an adaptive point size rendering strategy, thus improve the rendering performance and remove visual artifacts of mobile AR point cloud applications. Our method uses a cLoD model that has an ideal distribution over LoDs, with which can remove unnecessary points without sudden changes in density as present in the commonly used discrete level-of-detail approaches. Besides, camera position, orientation and distance from the camera to point cloud model is taken into consideration as well. With our method, good interactive visualization of point clouds can be realized in the mobile AR environment, with both nice visual quality and proper resource consumption.


10.29007/2493 ◽  
2020 ◽  
Author(s):  
Gustavo Maldonado ◽  
Marcel Maghiar ◽  
Brent Tharp ◽  
Dhruv Patel

This study considers the generation of virtual, 3D point-cloud models of seven deteriorating historical, agricultural barns in Bulloch County, Georgia, USA, for preservation purposes. The work was completed as a service-learning project in a course on Terrestrial Light Detection and Ranging (T-LiDAR), offered at Georgia Southern University. The resulting models and fly-through videos were donated to Bulloch County Historical Society and to the Georgia Southern Museum, to make them available to the general public and future generations. Additionally, one of the seven barns was selected to be extensively measured to estimate the relative spatial accuracy of all seven resulting 3D point-cloud models, with respect to measurements completed with a highly accurate instrument. Three accurate benchmarks were established around it for georeferencing purposes. The positions of 44 points were measured in the field via an accurate, one- second, robotic total-station (RTS) instrument. Also, the coordinates of the same points were acquired from within georeferenced and non-georeferenced point-cloud models. These points defined 259 distances. They were compared to determine their discrepancy statistics. It was observed that this process produced virtual models with an approximate maximum spatial discrepancy of one-half inch (0.5 in) with respect to measurements performed by a highly accurate RTS device. There were no substantial differences in the relative accuracies of the georeferenced and non-georeferenced models.


2017 ◽  
Vol 32 (11) ◽  
pp. 893-908 ◽  
Author(s):  
Mohammad-Mahdi Sharif ◽  
Mohammad Nahangi ◽  
Carl Haas ◽  
Jeffrey West

2016 ◽  
Vol 33 (3) ◽  
pp. 385-398 ◽  
Author(s):  
Long Yang ◽  
Qingan Yan ◽  
Chunxia Xiao
Keyword(s):  

Author(s):  
W. Yuan ◽  
X. Yuan ◽  
Z. Fan ◽  
Z. Guo ◽  
X. Shi ◽  
...  

Abstract. Building Change Detection (BCD) via multi-temporal remote sensing images is essential for various applications such as urban monitoring, urban planning, and disaster assessment. However, most building change detection approaches only extract features from different kinds of remote sensing images for change index determination, which can not determine the insignificant changes of small buildings. Given co-registered multi-temporal remote sensing images, the illumination variations and misregistration errors always lead to inaccurate change detection results. This study investigates the applicability of multi-feature fusion from both directly extract 2D features from remote sensing images and 3D features extracted by the dense image matching (DIM) generated 3D point cloud for accurate building change index generation. This paper introduces a graph neural network (GNN) based end-to-end learning framework for building change detection. The proposed framework includes feature extraction, feature fusion, and change index prediction. It starts with a pre-trained VGG-16 network as a backend and uses U-net architecture with five layers for feature map extraction. The extracted 2D features and 3D features are utilized as input into GNN based feature fusion parts. In the GNN parts, we introduce a flexible context aggregation mechanism based on attention to address the illumination variations and misregistration errors, enabling the framework to reason about the image-based texture information and depth information introduced by DIM generated 3D point cloud jointly. After that, the GNN generated affinity matrix is utilized for change index determination through a Hungarian algorithm. The experiment conducted on a dataset that covered Setagaya-Ku, Tokyo area, shows that the proposed method generated change map achieved the precision of 0.762 and the F1-score of 0.68 at pixel-level. Compared to traditional image-based change detection methods, our approach learns prior over geometrical structure information from the real 3D world, which robust to the misregistration errors. Compared to CNN based methods, the proposed method learns to fuse 2D and 3D features together to represent more comprehensive information for building change index determination. The experimental comparison results demonstrated that the proposed approach outperforms the traditional methods and CNN based methods.


2020 ◽  
Vol 5 (2) ◽  
pp. 296-306
Author(s):  
Philipp R. W. Urech

Pragmatic planning juxtaposed with conflicting agendas has led to metropolitan territories with little quality for urban life. Rapidly growing urban agglomeration, synchronous with the Great Acceleration of the global society, is causing massive landscape change leading to radical breaks with traditional landscapes. By drawing from the formal properties of the environment that include existing qualities, it is possible to develop solutions that respond to both a broader and more specific context. The method resorts to laser scanning technology to produce three-dimensional point cloud models and use them as a prospective medium to perform informed transformations in the landscape. Laser-scanned 3D models can help take advantage of subtle topographic differences to support water management, capture significant site features, and provide an accurate site inventory that could reduce the cost of displaced terrain and replanted trees. The article discusses how point cloud models can support the site investigation as part of a digital design method in the field of landscape design. The approach engages formal characteristics of a physical landscape and results in a transformative workflow linked to the survey and the analysis of the site. By using modes of visualization and coloring to emphasize shapes, densities, and heights, the model can reveal relevant landscape features and patterns that are otherwise not noticeable. Section 1 introduces the methods used in other disciplines; Section 2 provides explanations about how the methods apply to a case study in landscape design; Section 3 presents the possibilities offered by the approach to integrate formal characteristics of the environment during the design process. Design development based on documented features in the point cloud model increases the control to shape environments that contribute to the process of accumulation occurring in the landscape.


2021 ◽  
Vol 2021 ◽  
pp. 1-8
Author(s):  
Jingli Wang ◽  
Huiyuan Zhang ◽  
Jingxiang Gao ◽  
Dong Xiao

With the further development of the construction of “smart mine,” the establishment of three-dimensional (3D) point cloud models of mines has become very common. However, the truck operation caused the 3D point cloud model of the mining area to contain dust points, and the 3D point cloud model established by the Context Capture modeling software is a hollow structure. The previous point cloud denoising algorithms caused holes in the model. In view of the above problems, this paper proposes the point cloud denoising method based on orthogonal total least squares fitting and two-layer extreme learning machine improved by genetic algorithm (GA-TELM). The steps are to separate dust points and ground points by orthogonal total least squares fitting and use GA-TELM to repair holes. The advantages of the proposed method are listed as follows. First, this method could denoise without generating holes, which solves engineering problems. Second, GA-TELM has a better effect in repairing holes compared with the other methods considered in this paper. Finally, this method starts from actual problems and could be used in mining areas with the same problems. Experimental results demonstrate that it can remove dust spots in the flat area of the mine effectively and ensure the integrity of the model.


Sign in / Sign up

Export Citation Format

Share Document