scholarly journals Robust Bundle Adjustment for Structure from Motion

Author(s):  
Ji Zhang ◽  
Mireille Boutin ◽  
Daniel G. Aliaga
2018 ◽  
Vol 30 (4) ◽  
pp. 660-670 ◽  
Author(s):  
Akira Shibata ◽  
Yukari Okumura ◽  
Hiromitsu Fujii ◽  
Atsushi Yamashita ◽  
Hajime Asama ◽  
...  

Structure from motion is a three-dimensional (3D) reconstruction method that uses one camera. However, the absolute scale of objects cannot be reconstructed by the conventional structure from motion method. In our previous studies, to solve this problem by using refraction, we proposed a scale reconstructible structure from motion method. In our measurement system, a refractive plate is fixed in front of a camera and images are captured through this plate. To overcome the geometrical constraints, we derived an extended essential equation by theoretically considering the effect of refraction. By applying this formula to 3D measurements, the absolute scale of an object could be obtained. However, this method was verified only by a simulation under ideal conditions, for example, by not taking into account real phenomena such as noise or occlusion, which are necessarily caused in actual measurements. In this study, to robustly apply this method to an actual measurement with real images, we introduced a novel bundle adjustment method based on the refraction effect. This optimization technique can reduce the 3D reconstruction errors caused by measurement noise in actual scenes. In particular, we propose a new error function considering the effect of refraction. By minimizing the value of this error function, accurate 3D reconstruction results can be obtained. To evaluate the effectiveness of the proposed method, experiments using both simulations and real images were conducted. The results of the simulation show that the proposed method is theoretically accurate. The results of the experiments using real images show that the proposed method is effective for real 3D measurements.


2018 ◽  
Author(s):  
Carlos H Grohmann ◽  
Camila D Viana ◽  
Mariana TS Busarello ◽  
Guilherme PB Garcia

This work presents the development of a three-dimensional model of an outcrop of the Corumbataí Formation using Structure from Motion and Multi-View Stereo (SfM-MVS) techniques in order to provide a structural analysis of clastic dikes cutting through siltstone layers. Composed mainly of fine sand and silt, these dikes are formed by sand intrusions when a wet sandy layer is affected by earthquakes of at least 6.5 magnitude, being used as a record of such events.While traditional photogrammetry requires the user to input a series of parameters related to the camera orientation and its characteristics (such as focal distance), in SfM-MVS the scene geometry, camera position and orientations are automatically determined by a bundle adjustment, an iterative procedure based on a set of overlapping images. It is considered a low-cost technique in both hardware and software, also being able to provide point density and accuracy on par to the ones obtained with terrestrial laser scanner.The results acquired on this research have a good agreement with previous works, yielding a NNW main orientation for the dikes measured in the field and on the 3D model. The development of this work showed that SfM-MVS use and practice on geosciences still needs more studies on the optimization of the involved parameters (such as camera orientation, image overlap and angle of illumination), which, when accomplished, will result in less processing time and more accurate models.


2020 ◽  
Vol 12 (3) ◽  
pp. 351 ◽  
Author(s):  
Seyyed Meghdad Hasheminasab ◽  
Tian Zhou ◽  
Ayman Habib

Acquired imagery by unmanned aerial vehicles (UAVs) has been widely used for three-dimensional (3D) reconstruction/modeling in various digital agriculture applications, such as phenotyping, crop monitoring, and yield prediction. 3D reconstruction from well-textured UAV-based images has matured and the user community has access to several commercial and opensource tools that provide accurate products at a high level of automation. However, in some applications, such as digital agriculture, due to repetitive image patterns, these approaches are not always able to produce reliable/complete products. The main limitation of these techniques is their inability to establish a sufficient number of correctly matched features among overlapping images, causing incomplete and/or inaccurate 3D reconstruction. This paper provides two structure from motion (SfM) strategies, which use trajectory information provided by an onboard survey-grade global navigation satellite system/inertial navigation system (GNSS/INS) and system calibration parameters. The main difference between the proposed strategies is that the first one—denoted as partially GNSS/INS-assisted SfM—implements the four stages of an automated triangulation procedure, namely, imaging matching, relative orientation parameters (ROPs) estimation, exterior orientation parameters (EOPs) recovery, and bundle adjustment (BA). The second strategy— denoted as fully GNSS/INS-assisted SfM—removes the EOPs estimation step while introducing a random sample consensus (RANSAC)-based strategy for removing matching outliers before the BA stage. Both strategies modify the image matching by restricting the search space for conjugate points. They also implement a linear procedure for ROPs’ refinement. Finally, they use the GNSS/INS information in modified collinearity equations for a simpler BA procedure that could be used for refining system calibration parameters. Eight datasets over six agricultural fields are used to evaluate the performance of the developed strategies. In comparison with a traditional SfM framework and Pix4D Mapper Pro, the proposed strategies are able to generate denser and more accurate 3D point clouds as well as orthophotos without any gaps.


Author(s):  
A. Cefalu ◽  
N. Haala ◽  
D. Fritsch

Global image orientation techniques aim at estimating camera rotations and positions for a whole set of images simultaneously. One of the main arguments for these procedures is an improved robustness against drifting of camera stations in comparison to more classical sequential approaches. Usually, the process consists of computation of absolute rotations and, in a second step, absolute positions for the cameras. Either the first or both steps rely on the network of transformations arising from relative orientations between cameras. Therefore, the quality of the obtained absolute results is influenced by tensions in the network. These may e.g. be induced by insufficient knowledge of the intrinsic camera parameters. Another reason can be found in local weaknesses of image connectivity. We apply a hierarchical approach with intermediate bundle adjustment to reduce these effects. We adopt efficient global techniques which register image triplets based on fixed absolute camera rotations and scaled relative camera translations but do not involve scene structure elements in the fusion step. Our variant employs submodels of arbitrary size, orientation and scale, by computing relative rotations and scales between - and subsequently absolute rotations and scales for - submodels and is applied hierarchically. Furthermore we substitute classical bundle adjustment by a structureless approach based on epipolar geometry and augmented with a scale consistency constraint.


2019 ◽  
Vol 4 (2) ◽  
pp. 2164-2171
Author(s):  
Liyang Liu ◽  
Teng Zhang ◽  
Brenton Leighton ◽  
Liang Zhao ◽  
Shoudong Huang ◽  
...  

Author(s):  
J. Schneider ◽  
C. Stachniss ◽  
W. Förstner

Bundle adjustment is a central part of most visual SLAM and Structure from Motion systems and thus a relevant component of UAVs equipped with cameras. This paper makes two contributions to bundle adjustment. First, we present a novel approach which exploits trifocal constraints, i.e., constraints resulting from corresponding points observed in three camera images, which allows to estimate the camera pose parameters without 3D point estimation. Second, we analyze the quality loss compared to the optimal bundle adjustment solution when applying different types of approximations to the constrained optimization problem to increase efficiency. We implemented and thoroughly evaluated our approach using a UAV performing mapping tasks in outdoor environments. Our results indicate that the complexity of the constraint bundle adjustment can be decreased without loosing too much accuracy.


Sign in / Sign up

Export Citation Format

Share Document