scholarly journals An Infrared-Visible Image Registration Method Based on the Constrained Point Feature

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1188
Author(s):  
Qingqing Li ◽  
Guangliang Han ◽  
Peixun Liu ◽  
Hang Yang ◽  
Huiyuan Luo ◽  
...  
Keyword(s):  
Image Registration ◽  
Evaluation Method ◽  
Detection Algorithm ◽  
Feature Descriptor ◽  
Registration Accuracy ◽  
Visible Image ◽  
Registration Method ◽  
Visible Images ◽  
Image Pairs ◽  
Point Feature

It is difficult to find correct correspondences for infrared and visible image registration because of different imaging principles. Traditional registration methods based on the point feature require designing the complicated feature descriptor and eliminate mismatched points, which results in unsatisfactory precision and much calculation time. To tackle these problems, this paper presents an artful method based on constrained point features to align infrared and visible images. The proposed method principally contains three steps. First, constrained point features are extracted by employing an object detection algorithm, which avoids constructing the complex feature descriptor and introduces the senior semantic information to improve the registration accuracy. Then, the left value rule (LV-rule) is designed to match constrained points strictly without the deletion of mismatched and redundant points. Finally, the affine transformation matrix is calculated according to matched point pairs. Moreover, this paper presents an evaluation method to automatically estimate registration accuracy. The proposed method is tested on a public dataset. Among all tested infrared-visible image pairs, registration results demonstrate that the proposed framework outperforms five state-of-the-art registration algorithms in terms of accuracy, speed, and robustness.

scholarly journals An Image Registration Method Using Deep Residual Network Features for Multisource High-Resolution Remote Sensing Images

2021 ◽  
Vol 13 (17) ◽  
pp. 3425
Author(s):  
Xin Zhao ◽  
Hui Li ◽  
Ping Wang ◽  
Linhai Jing
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Image Registration ◽  
Feature Descriptor ◽  
Remote Sensing Images ◽  
Residual Network ◽  
Scale Invariant ◽  
Registration Method ◽  
Sensing Applications ◽  
Feature Based

Accurate registration for multisource high-resolution remote sensing images is an essential step for various remote sensing applications. Due to the complexity of the feature and texture information of high-resolution remote sensing images, especially for images covering earthquake disasters, feature-based image registration methods need a more helpful feature descriptor to improve the accuracy. However, traditional image registration methods that only use local features at low levels have difficulty representing the features of the matching points. To improve the accuracy of matching features for multisource high-resolution remote sensing images, an image registration method based on a deep residual network (ResNet) and scale-invariant feature transform (SIFT) was proposed. It used the fusion of SIFT features and ResNet features on the basis of the traditional algorithm to achieve image registration. The proposed method consists of two parts: model construction and training and image registration using a combination of SIFT and ResNet34 features. First, a registration sample set constructed from high-resolution satellite remote sensing images was used to fine-tune the network to obtain the ResNet model. Then, for the image to be registered, the Shi_Tomas algorithm and the combination of SIFT and ResNet features were used for feature extraction to complete the image registration. Considering the difference in image sizes and scenes, five pairs of images were used to conduct experiments to verify the effectiveness of the method in different practical applications. The experimental results showed that the proposed method can achieve higher accuracies and more tie points than traditional feature-based methods.

scholarly journals A Methodology of Three-Dimensional Medical Image Registration Based on Conformal Geometric Invariant

2014 ◽  
Vol 2014 ◽  
pp. 1-8
Author(s):  
Liang Hua ◽  
Kean Yu ◽  
Lijun Ding ◽  
Juping Gu ◽  
Xinsong Zhang ◽  
...  
Keyword(s):  
Image Registration ◽  
Medical Image ◽  
Subjective Evaluation ◽  
Three Dimensional ◽  
Medical Image Registration ◽  
Geometric Invariant ◽  
Registration Accuracy ◽  
Registration Method ◽  
Cloud Data ◽  
Dual Vector

A three-dimensional multimodality medical image registration method using geometric invariant based on conformal geometric algebra (CGA) theory is put forward for responding to challenges resulting from many free degrees and computational burdens with 3D medical image registration problems. The mathematical model and calculation method of dual-vector projection invariant are established using the distribution characteristics of point cloud data and the point-to-plane distance-based measurement in CGA space. The translation operator and geometric rotation operator during registration operation are built in Clifford algebra (CA) space. The conformal geometrical algebra is used to realize the registration of 3D CT/MR-PD medical image data based on the dual vector geometric invariant. The registration experiment results indicate that the methodology proposed in this paper is of stronger commonality, less computation burden, shorter time consumption, and intuitive geometric meaning. Both subjective evaluation and objective indicators show that the methodology proposed here is of high registration accuracy and suitable for 3D medical image registration.

Reducing Shadow Effects on the Co-Registration of Aerial Image Pairs

2020 ◽  
Vol 86 (3) ◽  
pp. 177-186
Author(s):  
Matthew Plummer ◽  
Douglas Stow ◽  
Emanuel Storey ◽  
Lloyd Coulter ◽  
Nicholas Zamora ◽  
...  
Keyword(s):  
Image Registration ◽  
Image Data ◽  
Aerial Image ◽  
Registration Accuracy ◽  
Illumination Variation ◽  
Scale Invariant ◽  
Match Point ◽  
Linear Correction ◽  
Multi Temporal ◽  
Image Pairs

Image registration is an important preprocessing step prior to detecting changes using multi-temporal image data, which is increasingly accomplished using automated methods. In high spatial resolution imagery, shadows represent a major source of illumination variation, which can reduce the performance of automated registration routines. This study evaluates the statistical relationship between shadow presence and image registration accuracy, and whether masking and normalizing shadows leads to improved automatic registration results. Eighty-eight bitemporal aerial image pairs were co-registered using software called Scale Invariant Features Transform (<small>SIFT</small>) and Random Sample Consensus (<small>RANSAC</small>) Alignment (<small>SARA</small>). Co-registration accuracy was assessed at different levels of shadow coverage and shadow movement within the images. The primary outcomes of this study are (1) the amount of shadow in a multi-temporal image pair is correlated with the accuracy/success of automatic co-registration; (2) masking out shadows prior to match point select does not improve the success of image-to-image co-registration; and (3) normalizing or brightening shadows can help match point routines find more match points and therefore improve performance of automatic co-registration. Normalizing shadows via a standard linear correction provided the most reliable co-registration results in image pairs containing substantial amounts of relative shadow movement, but had minimal effect for pairs with stationary shadows.

scholarly journals A Coarse-to-Fine Registration Strategy for Multi-Sensor Images with Large Resolution Differences

2019 ◽  
Vol 11 (4) ◽  
pp. 470 ◽  
Author(s):  
Kai Li ◽  
Yongsheng Zhang ◽  
Zhenchao Zhang ◽  
Guangling Lai
Keyword(s):  
Reference Image ◽  
Registration Accuracy ◽  
Registration Method ◽  
Normalized Mutual Information ◽  
Sensing Applications ◽  
Validation Experiment ◽  
Image Pairs ◽  
Coarse To Fine ◽  
Fine Registration ◽  
Three Phases

Automatic image registration for multi-sensors has always been an important task for remote sensing applications. However, registration for images with large resolution differences has not been fully considered. A coarse-to-fine registration strategy for images with large differences in resolution is presented. The strategy consists of three phases. First, the feature-base registration method is applied on the resampled sensed image and the reference image. Edge point features acquired from the edge strength map (ESM) of the images are used to pre-register two images quickly and robustly. Second, normalized mutual information-based registration is applied on the two images for more accurate transformation parameters. Third, the final transform parameters are acquired through direct registration between the original high- and low-resolution images. Ant colony optimization (ACO) for continuous domain is adopted to optimize the similarity metrics throughout the three phases. The proposed method has been tested on image pairs with different resolution ratios from different sensors, including satellite and aerial sensors. Control points (CPs) extracted from the images are used to calculate the registration accuracy of the proposed method and other state-of-the-art methods. The feature-based preregistration validation experiment shows that the proposed method effectively narrows the value range of registration parameters. The registration results indicate that the proposed method performs the best and achieves sub-pixel registration accuracy of images with resolution differences from 1 to 50 times.

scholarly journals Feature-Based Retinal Image Registration Using D-Saddle Feature

2017 ◽  
Vol 2017 ◽  
pp. 1-15 ◽  
Author(s):  
Roziana Ramli ◽  
Mohd Yamani Idna Idris ◽  
Khairunnisa Hasikin ◽  
Noor Khairiah A. Karim ◽  
Ainuddin Wahid Abdul Wahab ◽  
...  
Keyword(s):  
Image Registration ◽  
Retinal Image ◽  
Retinal Diseases ◽  
Feature Points ◽  
Registration Accuracy ◽  
Gaussian Pyramid ◽  
Difference Of Gaussian ◽  
Lower Success Rate ◽  
Feature Based ◽  
Image Pairs

Retinal image registration is important to assist diagnosis and monitor retinal diseases, such as diabetic retinopathy and glaucoma. However, registering retinal images for various registration applications requires the detection and distribution of feature points on the low-quality region that consists of vessels of varying contrast and sizes. A recent feature detector known as Saddle detects feature points on vessels that are poorly distributed and densely positioned on strong contrast vessels. Therefore, we propose a multiresolution difference of Gaussian pyramid with Saddle detector (D-Saddle) to detect feature points on the low-quality region that consists of vessels with varying contrast and sizes. D-Saddle is tested on Fundus Image Registration (FIRE) Dataset that consists of 134 retinal image pairs. Experimental results show that D-Saddle successfully registered 43% of retinal image pairs with average registration accuracy of 2.329 pixels while a lower success rate is observed in other four state-of-the-art retinal image registration methods GDB-ICP (28%), Harris-PIIFD (4%), H-M (16%), and Saddle (16%). Furthermore, the registration accuracy of D-Saddle has the weakest correlation (Spearman) with the intensity uniformity metric among all methods. Finally, the paired t-test shows that D-Saddle significantly improved the overall registration accuracy of the original Saddle.

scholarly journals Fusion of Infrared and Visible Images Using Fast Global Smoothing Decomposition and Target-Enhanced Parallel Gaussian Fuzzy Logic

Sensors ◽  
2021 ◽  
Vol 22 (1) ◽  
pp. 40
Author(s):  
Chaowei Duan ◽  
Changda Xing ◽  
Yiliu Liu ◽  
Zhisheng Wang
Keyword(s):  
Fuzzy Logic ◽  
Image Fusion ◽  
Visual Saliency ◽  
Fusion Rule ◽  
Objective Evaluation ◽  
Saliency Map ◽  
Visible Image ◽  
Structure Information ◽  
Visible Images ◽  
Image Pairs

As a powerful technique to merge complementary information of original images, infrared (IR) and visible image fusion approaches are widely used in surveillance, target detecting, tracking, and biological recognition, etc. In this paper, an efficient IR and visible image fusion method is proposed to simultaneously enhance the significant targets/regions in all source images and preserve rich background details in visible images. The multi-scale representation based on the fast global smoother is firstly used to decompose source images into the base and detail layers, aiming to extract the salient structure information and suppress the halos around the edges. Then, a target-enhanced parallel Gaussian fuzzy logic-based fusion rule is proposed to merge the base layers, which can avoid the brightness loss and highlight significant targets/regions. In addition, the visual saliency map-based fusion rule is designed to merge the detail layers with the purpose of obtaining rich details. Finally, the fused image is reconstructed. Extensive experiments are conducted on 21 image pairs and a Nato-camp sequence (32 image pairs) to verify the effectiveness and superiority of the proposed method. Compared with several state-of-the-art methods, experimental results demonstrate that the proposed method can achieve more competitive or superior performances according to both the visual results and objective evaluation.

Sign in / Sign up

Export Citation Format

Share Document