A coarse-to-fine automatic and robust registration method for multi-source remote sensing images based on Harris and phase information

2015 ◽  
Author(s):  
Haichao Li ◽  
Yiyun Man
Keyword(s):  
Remote Sensing ◽  
Phase Information ◽  
Remote Sensing Images ◽  
Registration Method ◽  
Coarse To Fine

scholarly journals An Image Registration Method Using Deep Residual Network Features for Multisource High-Resolution Remote Sensing Images

2021 ◽  
Vol 13 (17) ◽  
pp. 3425
Author(s):  
Xin Zhao ◽  
Hui Li ◽  
Ping Wang ◽  
Linhai Jing
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Image Registration ◽  
Feature Descriptor ◽  
Remote Sensing Images ◽  
Residual Network ◽  
Scale Invariant ◽  
Registration Method ◽  
Sensing Applications ◽  
Feature Based

Accurate registration for multisource high-resolution remote sensing images is an essential step for various remote sensing applications. Due to the complexity of the feature and texture information of high-resolution remote sensing images, especially for images covering earthquake disasters, feature-based image registration methods need a more helpful feature descriptor to improve the accuracy. However, traditional image registration methods that only use local features at low levels have difficulty representing the features of the matching points. To improve the accuracy of matching features for multisource high-resolution remote sensing images, an image registration method based on a deep residual network (ResNet) and scale-invariant feature transform (SIFT) was proposed. It used the fusion of SIFT features and ResNet features on the basis of the traditional algorithm to achieve image registration. The proposed method consists of two parts: model construction and training and image registration using a combination of SIFT and ResNet34 features. First, a registration sample set constructed from high-resolution satellite remote sensing images was used to fine-tune the network to obtain the ResNet model. Then, for the image to be registered, the Shi_Tomas algorithm and the combination of SIFT and ResNet features were used for feature extraction to complete the image registration. Considering the difference in image sizes and scenes, five pairs of images were used to conduct experiments to verify the effectiveness of the method in different practical applications. The experimental results showed that the proposed method can achieve higher accuracies and more tie points than traditional feature-based methods.

scholarly journals A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

2019 ◽  
Vol 11 (15) ◽  
pp. 1833 ◽  
Author(s):  
Han Yang ◽  
Xiaorun Li ◽  
Liaoying Zhao ◽  
Shuhan Chen
Keyword(s):  
Remote Sensing ◽  
Image Registration ◽  
Phase Correlation ◽  
Mean Square ◽  
Extended Phase ◽  
Registration Method ◽  
Coarse Registration ◽  
Feature Based ◽  
Coarse To Fine ◽  
Fine Registration

Automatic image registration has been wildly used in remote sensing applications. However, the feature-based registration method is sometimes inaccurate and unstable for images with large scale difference, grayscale and texture differences. In this manuscript, a coarse-to-fine registration scheme is proposed, which combines the advantage of feature-based registration and phase correlation-based registration. The scheme consists of four steps. First, feature-based registration method is adopted for coarse registration. A geometrical outlier removal method is applied to improve the accuracy of coarse registration, which uses geometric similarities of inliers. Then, the sensed image is modified through the coarse registration result under affine deformation model. After that, the modified sensed image is registered to the reference image by extended phase correlation. Lastly, the final registration results are calculated by the fusion of the coarse registration and the fine registration. High universality of feature-based registration and high accuracy of extended phase correlation-based registration are both preserved in the proposed method. Experimental results of several different remote sensing images, which come from several published image registration papers, demonstrate the high robustness and accuracy of the proposed method. The evaluation contains root mean square error (RMSE), Laplace mean square error (LMSE) and red–green image registration results.

scholarly journals UAV Remote Sensing Image Automatic Registration Based on Deep Residual Features

2021 ◽  
Vol 13 (18) ◽  
pp. 3605
Author(s):  
Xin Luo ◽  
Guangling Lai ◽  
Xiao Wang ◽  
Yuwei Jin ◽  
Xixu He ◽  
...  
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Rapid Development ◽  
Image Features ◽  
Automatic Registration ◽  
Remote Sensing Images ◽  
Registration Accuracy ◽  
Registration Method ◽  
Uav Images ◽  
High Level

With the rapid development of unmanned aerial vehicle (UAV) technology, UAV remote sensing images are increasing sharply. However, due to the limitation of the perspective of UAV remote sensing, the UAV images obtained from different viewpoints of a same scene need to be stitched together for further applications. Therefore, an automatic registration method of UAV remote sensing images based on deep residual features is proposed in this work. It needs no additional training and does not depend on image features, such as points, lines and shapes, or on specific image contents. This registration framework is built as follows: Aimed at the problem that most of traditional registration methods only use low-level features for registration, we adopted deep residual neural network features extracted by an excellent deep neural network, ResNet-50. Then, a tensor product was employed to construct feature description vectors through exacted high-level abstract features. At last, the progressive consistency algorithm (PROSAC) was exploited to remove false matches and fit a geometric transform model so as to enhance registration accuracy. The experimental results for different typical scene images with different resolutions acquired by different UAV image sensors indicate that the improved algorithm can achieve higher registration accuracy than a state-of-the-art deep learning registration algorithm and other popular registration algorithms.

scholarly journals Modality-Free Feature Detector and Descriptor for Multimodal Remote Sensing Image Registration

2020 ◽  
Vol 12 (18) ◽  
pp. 2937
Author(s):  
Song Cui ◽  
Miaozhong Xu ◽  
Ailong Ma ◽  
Yanfei Zhong
Keyword(s):  
Remote Sensing ◽  
Image Registration ◽  
Near Infrared ◽  
Feature Matching ◽  
Simulated Data ◽  
Remote Sensing Image ◽  
Surface Model ◽  
Phase Congruency ◽  
Remote Sensing Images ◽  
Registration Method

The nonlinear radiation distortions (NRD) among multimodal remote sensing images bring enormous challenges to image registration. The traditional feature-based registration methods commonly use the image intensity or gradient information to detect and describe the features that are sensitive to NRD. However, the nonlinear mapping of the corresponding features of the multimodal images often results in failure of the feature matching, as well as the image registration. In this paper, a modality-free multimodal remote sensing image registration method (SRIFT) is proposed for the registration of multimodal remote sensing images, which is invariant to scale, radiation, and rotation. In SRIFT, the nonlinear diffusion scale (NDS) space is first established to construct a multi-scale space. A local orientation and scale phase congruency (LOSPC) algorithm are then used so that the features of the images with NRD are mapped to establish a one-to-one correspondence, to obtain sufficiently stable key points. In the feature description stage, a rotation-invariant coordinate (RIC) system is adopted to build a descriptor, without requiring estimation of the main direction. The experiments undertaken in this study included one set of simulated data experiments and nine groups of experiments with different types of real multimodal remote sensing images with rotation and scale differences (including synthetic aperture radar (SAR)/optical, digital surface model (DSM)/optical, light detection and ranging (LiDAR) intensity/optical, near-infrared (NIR)/optical, short-wave infrared (SWIR)/optical, classification/optical, and map/optical image pairs), to test the proposed algorithm from both quantitative and qualitative aspects. The experimental results showed that the proposed method has strong robustness to NRD, being invariant to scale, radiation, and rotation, and the achieved registration precision was better than that of the state-of-the-art methods.

Sign in / Sign up

Export Citation Format

Share Document