Map-Enhanced UAV Image Sequence Registration and Synchronization of Multiple Image Sequences

Author(s):  
Yuping Lin ◽  
Gerard Medioni
2017 ◽  
Vol 5 (4) ◽  
pp. 861-879 ◽  
Author(s):  
Ellen Schwalbe ◽  
Hans-Gerd Maas

Abstract. This paper presents a comprehensive method for the determination of glacier surface motion vector fields at high spatial and temporal resolution. These vector fields can be derived from monocular terrestrial camera image sequences and are a valuable data source for glaciological analysis of the motion behaviour of glaciers. The measurement concepts for the acquisition of image sequences are presented, and an automated monoscopic image sequence processing chain is developed. Motion vector fields can be derived with high precision by applying automatic subpixel-accuracy image matching techniques on grey value patterns in the image sequences. Well-established matching techniques have been adapted to the special characteristics of the glacier data in order to achieve high reliability in automatic image sequence processing, including the handling of moving shadows as well as motion effects induced by small instabilities in the camera set-up. Suitable geo-referencing techniques were developed to transform image measurements into a reference coordinate system.The result of monoscopic image sequence analysis is a dense raster of glacier surface point trajectories for each image sequence. Each translation vector component in these trajectories can be determined with an accuracy of a few centimetres for points at a distance of several kilometres from the camera. Extensive practical validation experiments have shown that motion vector and trajectory fields derived from monocular image sequences can be used for the determination of high-resolution velocity fields of glaciers, including the analysis of tidal effects on glacier movement, the investigation of a glacier's motion behaviour during calving events, the determination of the position and migration of the grounding line and the detection of subglacial channels during glacier lake outburst floods.


Author(s):  
Hiroyuki Uchiyama ◽  
Daisuke Deguchi ◽  
Tomokazu Takahashi ◽  
Ichiro Ide ◽  
Hiroshi Murase

Author(s):  
J. Unger ◽  
F. Rottensteiner ◽  
C. Heipke

A hybrid bundle adjustment is presented that allows for the integration of a generalised building model into the pose estimation of image sequences. These images are captured by an Unmanned Aerial System (UAS) equipped with a camera flying in between the buildings. The relation between the building model and the images is described by distances between the object coordinates of the tie points and building model planes. Relations are found by a simple 3D distance criterion and are modelled as fictitious observations in a Gauss-Markov adjustment. The coordinates of model vertices are part of the adjustment as directly observed unknowns which allows for changes in the model. Results of first experiments using a synthetic and a real image sequence demonstrate improvements of the image orientation in comparison to an adjustment without the building model, but also reveal limitations of the current state of the method.


Author(s):  
T. Sieberth ◽  
R. Wackrow ◽  
J. H. Chandler

Unmanned aerial vehicles (UAVs) have become an interesting and active research topic in photogrammetry. Current research is based on image sequences acquired by UAVs which have a high ground resolution and good spectral resolution due to low flight altitudes combined with a high-resolution camera. One of the main problems preventing full automation of data processing of UAV imagery is the unknown degradation effect of blur caused by camera movement during image acquisition. <br><br> The purpose of this paper is to analyse the influence of blur on photogrammetric image processing, the correction of blur and finally, the use of corrected images for coordinate measurements. It was found that blur influences image processing significantly and even prevents automatic photogrammetric analysis, hence the desire to exclude blurred images from the sequence using a novel filtering technique. If necessary, essential blurred images can be restored using information of overlapping images of the sequence or a blur kernel with the developed edge shifting technique. The corrected images can be then used for target identification, measurements and automated photogrammetric processing.


2021 ◽  
Vol 87 (12) ◽  
pp. 913-922
Author(s):  
Ningning Zhu ◽  
Bisheng Yang ◽  
Zhen Dong ◽  
Chi Chen ◽  
Xia Huang ◽  
...  

To register mobile mapping system (MMS) lidar points and panoramic-image sequences, a relative orientation model of panoramic images (PROM) is proposed. The PROM is suitable for cases in which attitude or orientation parameters are unknown in the panoramic-image sequence. First, feature points are extracted and matched from panoramic-image pairs using the SURF algorithm. Second, these matched feature points are used to solve the relative attitude parameters in the PROM. Then, combining the PROM with the absolute position and attitude parameters of the initial panoramic image, the MMS lidar points and panoramic-image sequence are registered. Finally, the registration accuracy of the PROM method is assessed using corresponding points manually selected from the MMSlidar points and panoramic-image sequence. The results show that three types of MMSdata sources are registered accurately based on the proposed registration method. Our method transforms the registration of panoramic images and lidar points into image feature-point matching, which is suitable for diverse road scenes compared with existing methods.


2020 ◽  
Vol 119 ◽  
pp. 102744
Author(s):  
Albert Y. Chen ◽  
Yen-Lin Chiu ◽  
Meng-Hsiu Hsieh ◽  
Po-Wei Lin ◽  
Ohay Angah

2017 ◽  
Author(s):  
Ellen Schwalbe ◽  
Hans-Gerd Maas

Abstract. This paper presents a comprehensive method for the determination of motion vector fields of glaciers at high spatial and temporal resolution. These vector fields can be derived from monocular terrestrial camera image sequences and are a valuable data source for glaciological analysis of the motion behaviour of glaciers. The measurement concepts for the acquisition of image sequences are presented, and an automated monoscopic image sequence processing chain is developed. Motion vector fields can be derived with high precision by applying automatic sub-pixel-accuracy image matching techniques on grey value patterns in the image sequences. Well-established matching techniques have been adapted to the special characteristics of the glacier data in order to achieve high reliability in automatic image sequence processing, including the handling of moving shadows as well as motion effects induced by small instabilities in the camera setup. Suitable geo-referencing techniques were developed to transform image measurements into a reference coordinate system. The result of the monoscopic image sequence analysis is a dense raster of glacier surface point trajectories for each image sequence. Each translation vector component in these trajectories can be determined with an accuracy of some centimetres for points at a distance of several kilometres from the camera. Extensive practical validation experiments show that motion vector and trajectory fields derived from monocular image sequences can be used for the determination of high resolution velocity fields of glaciers, for the analysis of the effects of tides on glacier movement, for the investigation of a glacier's motion behaviour during calving events, for the determination of the position and migration of the grounding line and for the detection of sub glacial channels during glacier lake outburst floods.


Sign in / Sign up

Export Citation Format

Share Document