scholarly journals Satellite-Borne Optical Remote Sensing Image Registration Based on Point Features

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2695
Author(s):  
Xinan Hou ◽  
Quanxue Gao ◽  
Rong Wang ◽  
Xin Luo
Keyword(s):  
Remote Sensing ◽  
Image Registration ◽  
Nearest Neighbor ◽  
Optical Remote Sensing ◽  
Image Splicing ◽  
Registration Accuracy ◽  
Scale Invariant ◽  
Subsequent Work ◽  
Harris Corner ◽  
Matching Strategy

Since technologies in image fusion, image splicing, and target recognition have developed rapidly, as the basis of many image applications, the performance of image registration directly affects subsequent work. In this work, for rich features of satellite-borne optical imagery such as panchromatic and multispectral images, the Harris corner algorithm is combined with the scale invariant feature transform (SIFT) operator for feature point extraction. Our rough matching strategy uses the K-D (K-Dimensional) tree combined with the BBF (Best Bin First) method, and the similarity measure is the nearest neighbor/the second-nearest neighbor ratio. Finally, a triangle-area representation (TAR) algorithm is utilized to eliminate false matches in order to ensure registration accuracy. The performance of the proposed algorithm is compared with existing popular algorithms. The experimental results indicate that for visible light and multi-spectral satellite remote sensing images of different sizes and different sources, the proposed algorithm in this work is excellent in accuracy and efficiency.

scholarly journals High-Resolution Optical Remote Sensing Image Registration via Reweighted Random Walk based Hyper-Graph Matching

2019 ◽  
Vol 11 (23) ◽  
pp. 2841 ◽  
Author(s):  
Wu ◽  
Di ◽  
Ming ◽  
Lv ◽  
Tan
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Image Registration ◽  
Graph Matching ◽  
Remote Sensing Image ◽  
Feature Point ◽  
Optical Remote Sensing ◽  
Scale Invariant ◽  
Matching Algorithm ◽  
Optical Remote Sensing Image

High-resolution optical remote sensing image registration is still a challenging task due to non-linearity in the intensity differences and geometric distortion. In this paper, an efficient method utilizing a hyper-graph matching algorithm is proposed, which can simultaneously use the high-order structure information and radiometric information, to obtain thousands of feature point pairs for accurate image registration. The method mainly consists of the following steps: firstly, initial matching by Uniform Robust Scale-Invariant Feature Transform (UR-SIFT) is carried out in the highest pyramid image level to derive the approximate geometric relationship between the images; secondly, two-stage point matching is performed to find the matches, that is, a rotation and scale invariant area-based matching method is used to derive matching candidates for each feature point and an efficient hyper-graph matching algorithm is applied to find the best match for each feature point; thirdly, a local quadratic polynomial constraint framework is used to eliminate match outliers; finally, the above process is iterated until finishing the matching in the original image. Then, the obtained correspondences are used to perform the image registration. The effectiveness of the proposed method is tested with six pairs of high-resolution optical images, covering different landscape types—such as mountain area, urban, suburb, and flat land—and registration accuracy of sub-pixel level is obtained. The experiments show that the proposed method outperforms the conventional matching algorithms such as SURF, AKAZE, ORB, BRISK, and FAST in terms of total number of correct matches and matching precision.

scholarly journals An Image Registration Method Using Deep Residual Network Features for Multisource High-Resolution Remote Sensing Images

2021 ◽  
Vol 13 (17) ◽  
pp. 3425
Author(s):  
Xin Zhao ◽  
Hui Li ◽  
Ping Wang ◽  
Linhai Jing
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Image Registration ◽  
Feature Descriptor ◽  
Remote Sensing Images ◽  
Residual Network ◽  
Scale Invariant ◽  
Registration Method ◽  
Sensing Applications ◽  
Feature Based

Accurate registration for multisource high-resolution remote sensing images is an essential step for various remote sensing applications. Due to the complexity of the feature and texture information of high-resolution remote sensing images, especially for images covering earthquake disasters, feature-based image registration methods need a more helpful feature descriptor to improve the accuracy. However, traditional image registration methods that only use local features at low levels have difficulty representing the features of the matching points. To improve the accuracy of matching features for multisource high-resolution remote sensing images, an image registration method based on a deep residual network (ResNet) and scale-invariant feature transform (SIFT) was proposed. It used the fusion of SIFT features and ResNet features on the basis of the traditional algorithm to achieve image registration. The proposed method consists of two parts: model construction and training and image registration using a combination of SIFT and ResNet34 features. First, a registration sample set constructed from high-resolution satellite remote sensing images was used to fine-tune the network to obtain the ResNet model. Then, for the image to be registered, the Shi_Tomas algorithm and the combination of SIFT and ResNet features were used for feature extraction to complete the image registration. Considering the difference in image sizes and scenes, five pairs of images were used to conduct experiments to verify the effectiveness of the method in different practical applications. The experimental results showed that the proposed method can achieve higher accuracies and more tie points than traditional feature-based methods.

scholarly journals Optical Remote Sensing Image Registration Using Spatial-Consistency and Average Regional Information Divergence Minimization via Quantum-Behaved Particle Swarm Optimization

2020 ◽  
Vol 12 (18) ◽  
pp. 3066
Author(s):  
Shuhan Chen ◽  
Bai Xue ◽  
Han Yang ◽  
Xiaorun Li ◽  
Liaoying Zhao ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Similarity Metrics ◽  
Optical Remote Sensing ◽  
Registration Accuracy ◽  
Swarm Optimization ◽  
Spatial Consistency ◽  
Optical Remote Sensing Image ◽  
Information Divergence ◽  
Consistent Feature ◽  
Divergence Minimization

Due to invariance to significant intensity differences, similarity metrics have been widely used as criteria for an area-based method for registering optical remote sensing image. However, for images with large scale and rotation difference, the robustness of similarity metrics can greatly determine the registration accuracy. In addition, area-based methods usually require appropriately selected initial values for registration parameters. This paper presents a registration approach using spatial consistency (SC) and average regional information divergence (ARID), called spatial-consistency and average regional information divergence minimization via quantum-behaved particle swarm optimization (SC-ARID-QPSO) for optical remote sensing images registration. Its key idea minimizes ARID with SC to select an ARID-minimized spatial consistent feature point set. Then, the selected consistent feature set is tuned randomly to generate a set of M registration parameters, which provide initial particle warms to implement QPSO to obtain final optimal registration parameters. The proposed ARID is used as a criterion for the selection of consistent feature set, the generation of initial parameter sets, and fitness functions used by QPSO. The iterative process of QPSO is terminated based on a custom-designed automatic stopping rule. To evaluate the performance of SC-ARID-QPSO, both simulated and real images are used for experiments for validation. In addition, two data sets are particularly designed to conduct a comparative study and analysis with existing state-of-the-art methods. The experimental results demonstrate that SC-ARID-QPSO produces better registration accuracy and robustness than compared methods.

Rotation and scale invariant target detection in optical remote sensing images based on pose-consistency voting

2016 ◽  
Vol 76 (12) ◽  
pp. 14461-14483 ◽  
Author(s):  
Yudong Lin ◽  
Hongjie He ◽  
Heng-Ming Tai ◽  
Fan Chen ◽  
Zhongke Yin
Keyword(s):  
Remote Sensing ◽  
Target Detection ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Scale Invariant

Reducing Shadow Effects on the Co-Registration of Aerial Image Pairs

2020 ◽  
Vol 86 (3) ◽  
pp. 177-186
Author(s):  
Matthew Plummer ◽  
Douglas Stow ◽  
Emanuel Storey ◽  
Lloyd Coulter ◽  
Nicholas Zamora ◽  
...  
Keyword(s):  
Image Registration ◽  
Image Data ◽  
Aerial Image ◽  
Registration Accuracy ◽  
Illumination Variation ◽  
Scale Invariant ◽  
Match Point ◽  
Linear Correction ◽  
Multi Temporal ◽  
Image Pairs

Image registration is an important preprocessing step prior to detecting changes using multi-temporal image data, which is increasingly accomplished using automated methods. In high spatial resolution imagery, shadows represent a major source of illumination variation, which can reduce the performance of automated registration routines. This study evaluates the statistical relationship between shadow presence and image registration accuracy, and whether masking and normalizing shadows leads to improved automatic registration results. Eighty-eight bitemporal aerial image pairs were co-registered using software called Scale Invariant Features Transform (<small>SIFT</small>) and Random Sample Consensus (<small>RANSAC</small>) Alignment (<small>SARA</small>). Co-registration accuracy was assessed at different levels of shadow coverage and shadow movement within the images. The primary outcomes of this study are (1) the amount of shadow in a multi-temporal image pair is correlated with the accuracy/success of automatic co-registration; (2) masking out shadows prior to match point select does not improve the success of image-to-image co-registration; and (3) normalizing or brightening shadows can help match point routines find more match points and therefore improve performance of automatic co-registration. Normalizing shadows via a standard linear correction provided the most reliable co-registration results in image pairs containing substantial amounts of relative shadow movement, but had minimal effect for pairs with stationary shadows.

Sign in / Sign up

Export Citation Format

Share Document