scholarly journals An Integrated GNSS/LiDAR-SLAM Pose Estimation Framework for Large-Scale Map Building in Partially GNSS-Denied Environments

2021 ◽  
Vol 70 ◽  
pp. 1-9
Author(s):  
Guojian He ◽  
Xingda Yuan ◽  
Yan Zhuang ◽  
Huosheng Hu
2014 ◽  
Vol 2014 ◽  
pp. 1-23 ◽  
Author(s):  
Francisco Amorós ◽  
Luis Payá ◽  
Oscar Reinoso ◽  
Walterio Mayol-Cuevas ◽  
Andrew Calway

In this work we present a topological map building and localization system for mobile robots based on global appearance of visual information. We include a comparison and analysis of global-appearance techniques applied to wide-angle scenes in retrieval tasks. Next, we define multiscale analysis, which permits improving the association between images and extracting topological distances. Then, a topological map-building algorithm is proposed. At first, the algorithm has information only of some isolated positions of the navigation area in the form of nodes. Each node is composed of a collection of images that covers the complete field of view from a certain position. The algorithm solves the node retrieval and estimates their spatial arrangement. With these aims, it uses the visual information captured along some routes that cover the navigation area. As a result, the algorithm builds a graph that reflects the distribution and adjacency relations between nodes (map). After the map building, we also propose a route path estimation system. This algorithm takes advantage of the multiscale analysis. The accuracy in the pose estimation is not reduced to the nodes locations but also to intermediate positions between them. The algorithms have been tested using two different databases captured in real indoor environments under dynamic conditions.


2021 ◽  
Vol 10 (11) ◽  
pp. 748
Author(s):  
Ferdinand Maiwald ◽  
Christoph Lehmann ◽  
Taras Lazariv

The idea of virtual time machines in digital environments like hand-held virtual reality or four-dimensional (4D) geographic information systems requires an accurate positioning and orientation of urban historical images. The browsing of large repositories to retrieve historical images and their subsequent precise pose estimation is still a manual and time-consuming process in the field of Cultural Heritage. This contribution presents an end-to-end pipeline from finding relevant images with utilization of content-based image retrieval to photogrammetric pose estimation of large historical terrestrial image datasets. Image retrieval as well as pose estimation are challenging tasks and are subjects of current research. Thereby, research has a strong focus on contemporary images but the methods are not considered for a use on historical image material. The first part of the pipeline comprises the precise selection of many relevant historical images based on a few example images (so called query images) by using content-based image retrieval. Therefore, two different retrieval approaches based on convolutional neural networks (CNN) are tested, evaluated, and compared with conventional metadata search in repositories. Results show that image retrieval approaches outperform the metadata search and are a valuable strategy for finding images of interest. The second part of the pipeline uses techniques of photogrammetry to derive the camera position and orientation of the historical images identified by the image retrieval. Multiple feature matching methods are used on four different datasets, the scene is reconstructed in the Structure-from-Motion software COLMAP, and all experiments are evaluated on a newly generated historical benchmark dataset. A large number of oriented images, as well as low error measures for most of the datasets, show that the workflow can be successfully applied. Finally, the combination of a CNN-based image retrieval and the feature matching methods SuperGlue and DISK show very promising results to realize a fully automated workflow. Such an automated workflow of selection and pose estimation of historical terrestrial images enables the creation of large-scale 4D models.


Sensors ◽  
2020 ◽  
Vol 20 (23) ◽  
pp. 6940
Author(s):  
Elise Klæbo Vonstad ◽  
Xiaomeng Su ◽  
Beatrix Vereijken ◽  
Kerstin Bach ◽  
Jan Harald Nilsen

Using standard digital cameras in combination with deep learning (DL) for pose estimation is promising for the in-home and independent use of exercise games (exergames). We need to investigate to what extent such DL-based systems can provide satisfying accuracy on exergame relevant measures. Our study assesses temporal variation (i.e., variability) in body segment lengths, while using a Deep Learning image processing tool (DeepLabCut, DLC) on two-dimensional (2D) video. This variability is then compared with a gold-standard, marker-based three-dimensional Motion Capturing system (3DMoCap, Qualisys AB), and a 3D RGB-depth camera system (Kinect V2, Microsoft Inc). Simultaneous data were collected from all three systems, while participants (N = 12) played a custom balance training exergame. The pose estimation DLC-model is pre-trained on a large-scale dataset (ImageNet) and optimized with context-specific pose annotated images. Wilcoxon’s signed-rank test was performed in order to assess the statistical significance of the differences in variability between systems. The results showed that the DLC method performs comparably to the Kinect and, in some segments, even to the 3DMoCap gold standard system with regard to variability. These results are promising for making exergames more accessible and easier to use, thereby increasing their availability for in-home exercise.


2018 ◽  
Vol 35 (6) ◽  
pp. 835-849 ◽  
Author(s):  
Hao Wang ◽  
Zongying Shi ◽  
Geng Lu ◽  
Yisheng Zhong

2016 ◽  
Vol 2016 ◽  
pp. 1-20
Author(s):  
Guanglei Huo ◽  
Lijun Zhao ◽  
Ke Wang ◽  
Ruifeng Li ◽  
Jianqiang Li

A novel point-to-point scan matching approach is proposed to address pose estimation and map building issues of mobile robots. Polar Scan Matching (PSM) and Metric-Based Iterative Closest Point (Mb-ICP) are usually employed for point-to-point scan matching tasks. However, due to the facts that PSM considers the distribution similarity of polar radii in irrelevant region of reference and current scans and Mb-ICP assumes a constant weight in the norm about rotation angle, they may lead to a mismatching of the reference and current scan in real-world scenarios. In order to obtain better match results and accurate estimation of the robot pose, we introduce a new metric rule, Polar Metric-Weighted Norm (PMWN), which takes both rotation and translation into account to match the reference and current scan. For robot pose estimation, the heading rotation angle is estimated by correspondences establishing results and further corrected by an absolute-value function, and then the geometric property of PMWN called projected circle is used to estimate the robot translation. The extensive experiments are conducted to evaluate the performance of PMWN-based approach. The results show that the proposed approach outperforms PSM and Mb-ICP in terms of accuracy, efficiency, and loop closure error of mapping.


2014 ◽  
Vol 10 (01) ◽  
pp. 69-90 ◽  
Author(s):  
CHENGUANG LIU ◽  
HENGDA CHENG ◽  
ARAVIND DASU

Head pose estimation has been widely studied in recent decades due to many significant applications. Different from most of the current methods which utilize face models to estimate head position, we develop a relative homography transformation based algorithm which is robust to the large scale change of the head. In the proposed method, salient Harris corners are detected on a face, and local binary pattern features are extracted around each of the corners. And then, relative homography transformation is calculated by using RANSAC optimization algorithm, which applies homography to a region of interest (ROI) on an image and calculates the transformation of a planar object moving in the scene relative to a virtual camera. By doing so, the face center initialized in the first frame will be tracked frame by frame. Meanwhile, a head shoulder model based Chamfer matching method is proposed to estimate the head centroid. With the face center and the detected head centroid, the head pose is estimated. The experiments show the effectiveness and robustness of the proposed algorithm.


2019 ◽  
Vol 11 (9) ◽  
pp. 2518 ◽  
Author(s):  
Bausys ◽  
Cavallaro ◽  
Semenas

Currently, the European Union (EU) is focusing on a large-scale campaign dedicated to developing a competitive circular economy and expanding the single digital market. One of the main goals of this campaign is the implementation of the sustainability principles in the development and deployment cycle of the new generation technologies. This paper focuses on the fast-growing field of autonomous mobile robots and the harsh environment exploration problem. Currently, most state-of-the-art navigation methods are utilising the idea of evaluating candidate observation locations by combining different task-related criteria. However, these map building solutions are often designed for operating in near-perfect environments, neglecting such factors as the danger to the robot. In this paper, a new strategy that aims to address the safety and re-usability of the autonomous mobile agent by implementing the economic sustainability principles is proposed. A novel multi-criteria decision-making method of Weighted Aggregated Sum Product Assessment—Single-Valued Neutrosophic Sets, namely WASPAS-SVNS, and the weight selection method of Step-Wise Weights Assessment Ratio Analysis (SWARA) are applied to model a dynamic decision-making system. The experimental evaluation of the proposed strategy shows that increased survivability of the autonomous agent can be observed. Compared to the greedy baseline strategy, the proposed method forms the movement path which orients the autonomous agent away from dangerous obstacles.


2019 ◽  
Vol 16 (04) ◽  
pp. 1941003
Author(s):  
Chunsheng Guo ◽  
Jialuo Zhou ◽  
Wenlong Du ◽  
Xuguang Zhang

Human pose estimation is a fundamental but challenging task in computer vision. The estimation of human pose mainly depends on the global information of the keypoint type and the local information of the keypoint location. However, the consistency of the cascading process makes it difficult for each stacking network to form a differentiation and collaboration mechanism. In order to solve these problems, this paper introduces a new human pose estimation framework called Multi-Scale Collaborative (MSC) network. The pre-processing network forms feature maps of different sizes, and dispatches them to various locations of the stack network, with small-scale features reaching the front-end stacking network and large-scale features reaching the back-end stacking network. A new loss function is proposed for MSC network. Different keypoints have different weight coefficients of loss function at different scales, and the keypoint weight coefficients are dynamically adjusted from the top hourglass network to the bottom hourglass network. Experimental results show that the proposed method is competitive in MPII and LSP challenge leaderboard among the state-of-the-art methods.


2019 ◽  
Vol 2019 ◽  
pp. 1-14 ◽  
Author(s):  
Ting Lei ◽  
Xiao-Feng Liu ◽  
Guo-Ping Cai ◽  
Yun-Meng Liu ◽  
Pan Liu

This paper estimates the pose of a noncooperative space target utilizing a direct method of monocular visual simultaneous location and mapping (SLAM). A Large Scale Direct SLAM (LSD-SLAM) algorithm for pose estimation based on photometric residual of pixel intensities is provided to overcome the limitation of existing feature-based on-orbit pose estimation methods. Firstly, new sequence images of the on-orbit target are continuously inputted, and the pose of each current frame is calculated according to minimizing the photometric residual of pixel intensities. Secondly, frames are distinguished as keyframes or normal frames according to the pose relationship, and these frames are used to optimize the local map points. After that, the optimized local map points are added to the back-end map. Finally, the poses of keyframes are further enumerated and optimized in the back-end thread based on the map points and the photometric residual between the keyframes. Numerical simulations and experiments are carried out to prove the validity of the proposed algorithm, and the results elucidate the effectiveness of the algorithm in estimating the pose of the noncooperative target.


Sign in / Sign up

Export Citation Format

Share Document