Accurate Motion Estimation and High-Precision 3D Reconstruction by Sensor Fusion

Author(s):  
Yunsu Bok ◽  
Youngbae Hwang ◽  
In So Kweon
2021 ◽  
Vol 13 (10) ◽  
pp. 1981
Author(s):  
Ruike Ren ◽  
Hao Fu ◽  
Hanzhang Xue ◽  
Zhenping Sun ◽  
Kai Ding ◽  
...  

High-precision 3D maps play an important role in autonomous driving. The current mapping system performs well in most circumstances. However, it still encounters difficulties in the case of the Global Navigation Satellite System (GNSS) signal blockage, when surrounded by too many moving objects, or when mapping a featureless environment. In these challenging scenarios, either the global navigation approach or the local navigation approach will degenerate. With the aim of developing a degeneracy-aware robust mapping system, this paper analyzes the possible degeneration states for different navigation sources and proposes a new degeneration indicator for the point cloud registration algorithm. The proposed degeneracy indicator could then be seamlessly integrated into the factor graph-based mapping framework. Extensive experiments on real-world datasets demonstrate that the proposed 3D reconstruction system based on GNSS and Light Detection and Ranging (LiDAR) sensors can map challenging scenarios with high precision.


Water ◽  
2019 ◽  
Vol 11 (10) ◽  
pp. 2101 ◽  
Author(s):  
Zhang ◽  
Zhao ◽  
Hu ◽  
Wang ◽  
Ai ◽  
...  

Urban drainage pipe networks have complex spatial contributions, andthey are now facing problems such as damage, defects, and aging. A rapid and high-precision pipe inspection strategy is thekey to ensuring thesustainable development of urban water supply and drainage system. In this paper, a three-dimensional (3D) reconstruction pipeline of urban drainage pipes based on multiview image matching using low-cost panoramic video cameras is proposed, which provides an innovative technical approach for pipe inspection. Firstly, we extracted frames from the panoramic video of the pipes andcorrected the geometric distortion using a spherical reprojection to obtain multiview pipe images. Second, the robust feature matching method using support lines and affine-invariant ratios isintroduced to conduct pipe image matching. Finally, the photogrammetric processing, using structure from motion (SfM) and dense reconstruction, wasintroduced to achieve the 3D modeling of drainage pipes. Several typical drainage pipes and shafts of the real scenes were taken for the 3D reconstruction experiments. Theresults show that our strategy can realize high-precision 3D reconstruction of different types of pipes, which can provide effective technical support for rapid and efficient inspection of urban pipes with broad application prospects in the daily management of sustainable urban drainage systems (SUDSs).


Author(s):  
Mikhail Sizintsev ◽  
Abhinav Rajvanshi ◽  
Han-Pang Chiu ◽  
Kevin Kaighn ◽  
Supun Samarasekera ◽  
...  

Author(s):  
Jose-Luis Blanco ◽  
Javier Gonzalez ◽  
Juan-Antonio Fernandez-Madrigal

Author(s):  
Young Min Kim ◽  
Christian Theobalt ◽  
James Diebel ◽  
Jana Kosecka ◽  
Branislav Miscusik ◽  
...  

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Yun Shi ◽  
Cong Tao ◽  
Xiaoping Wang ◽  
Liyan Zhang

The application of artificial intelligence and deep learning in the fields of wireless communication, image and speech recognition, and 3D reconstruction has successfully solved some difficult modeling problems. This paper focuses on the high-precision 3D reconstruction of the motion-blurred cooperative markers, including the Chinese character coded targets (CCTs) and the noncoded circular markers. A simulation-based motion-blurred image generation model is constructed to provide sufficient samples for training the convolutional neural network to identify and match the motion-blurred CCTs on the moving object. The blurred noncoded marker matching is performed through homography. The 3D reconstruction of the markers is realized via the optimization of the spatial moving path within the exposure period. The midpoint of the moving path of the markers is taken as the final reconstruction result. The experimental results show that the 3D reconstruction accuracy of the markers with a certain motion blur effect is about 0.08 mm.


2021 ◽  
Vol 50 (1) ◽  
pp. 20200104-20200104
Author(s):  
孙日明 Riming Sun ◽  
杨苡辰 Yichen Yang ◽  
马永峰 Yongfeng Ma ◽  
孔祥宇 Xiangyu Kong ◽  
李常贤 Changxian Li

Author(s):  
Yanxue Wu ◽  
Gaoxu Wu ◽  
Shichao Yang ◽  
Tian Yang ◽  
Fei Liu

Abstract The conventional multi-frequency heterodyne method is one of the most widely used methods in non-contact 3D measurement. However, it needs to project different phase-shifting patterns with different frequencies, so a large number of patterns are required. For most conventional methods, the fringe period number of the projected patterns is usually small due to its limited noise tolerance, though the larger fringe period number always means higher accuracy. We propose a two-step phase-shifting demodulation algorithm based on intensity-gradient. In this method, only two patterns for each frequency are required. With the intensity-gradient of the two patterns, we obtain the wrapped phase of each frequency. Next, the absolute phase is retrieved from the three wrapped phases with the heterodyne algorithm. Because only two patterns are required for each frequency, the proposed method is more robust and has higher measuring speed compared with the traditional 3-frequency 4-step heterodyne method. Simulations and experiments prove the feasibility and effectiveness of the method, and demonstrate that the proposed method extends the noise tolerance and achieves high-precision with only a half of the patterns required by the traditional 3-frequency 4-step method.


Sign in / Sign up

Export Citation Format

Share Document