scholarly journals A Full-Spectrum Registration Method for Zhuhai-1 Satellite Hyperspectral Imagery

Sensors ◽  
2020 ◽  
Vol 20 (21) ◽  
pp. 6298
Author(s):  
Jinjun Meng ◽  
Jiaqi Wu ◽  
Linlin Lu ◽  
Qingting Li ◽  
Qiang Zhang ◽  
...  
Keyword(s):  
Similarity Measure ◽  
Delaunay Triangulation ◽  
Affine Transformation ◽  
Hyperspectral Imagery ◽  
Geometric Transformation ◽  
Registration Accuracy ◽  
Full Spectrum ◽  
Differential Correction ◽  
Registration Method ◽  
Transformation Relation

Accurate registration is an essential prerequisite for analysis and applications involving remote sensing imagery. It is usually difficult to extract enough matching points for inter-band registration in hyperspectral imagery due to the different spectral responses for land features in different image bands. This is especially true for non-adjacent bands. The inconsistency in geometric distortion caused by topographic relief also makes it inappropriate to use a single affine transformation relationship for the geometric transformation of the entire image. Currently, accurate registration between spectral bands of Zhuhai-1 satellite hyperspectral imagery remains challenging. In this paper, a full-spectrum registration method was proposed to address this problem. The method combines the transfer strategy based on the affine transformation relationship between adjacent spectrums with the differential correction from dense Delaunay triangulation. Firstly, the scale-invariant feature transform (SIFT) extraction method was used to extract and match feature points of adjacent bands. The RANdom SAmple Consensus (RANSAC) algorithm and the least square method is then used to eliminate mismatching point pairs to obtain fine matching point pairs. Secondly, a dense Delaunay triangulation was constructed based on fine matching point pairs. The affine transformation relation for non-adjacent bands was established for each triangle using the affine transformation relation transfer strategy. Finally, the affine transformation relation was used to perform differential correction for each triangle. Three Zhuhai-1 satellite hyperspectral images covering different terrains were used as experiment data. The evaluation results showed that the adjacent band registration accuracy ranged from 0.2 to 0.6 pixels. The structural similarity measure and cosine similarity measure between non-adjacent bands were both greater than 0.80. Moreover, the full-spectrum registration accuracy was less than 1 pixel. These registration results can meet the needs of Zhuhai-1 hyperspectral imagery applications in various fields.

scholarly journals Improving Co-Registration for Sentinel-1 SAR and Sentinel-2 Optical Images

2021 ◽  
Vol 13 (5) ◽  
pp. 928
Author(s):  
Yuanxin Ye ◽  
Chao Yang ◽  
Bai Zhu ◽  
Liang Zhou ◽  
Youquan He ◽  
...  
Keyword(s):  
European Space Agency ◽  
Phase Correlation ◽  
Optical Data ◽  
Geometric Transformation ◽  
Interest Points ◽  
Registration Accuracy ◽  
Registration Method ◽  
Sensing Applications ◽  
Optical Images ◽  
Sentinel 2

Co-registering the Sentinel-1 Synthetic Aperture Radar (SAR) and Sentinel-2 optical data of the European Space Agency (ESA) is of great importance for many remote sensing applications. However, we find that there are evident misregistration shifts between the Sentinel-1 SAR and Sentinel-2 optical images that are directly downloaded from the official website. To address that, this paper presents a fast and effective registration method for the two types of images. In the proposed method, a block-based scheme is first designed to extract evenly distributed interest points. Then, the correspondences are detected by using the similarity of structural features between the SAR and optical images, where the three-dimensional (3D) phase correlation (PC) is used as the similarity measure for accelerating image matching. Lastly, the obtained correspondences are employed to measure the misregistration shifts between the images. Moreover, to eliminate the misregistration, we use some representative geometric transformation models such as polynomial models, projective models, and rational function models for the co-registration of the two types of images, and we compare and analyze their registration accuracy under different numbers of control points and different terrains. Six pairs of the Sentinel-1 SAR L1 and Sentinel-2 optical L1C images covering three different terrains are tested in our experiments. Experimental results show that the proposed method can achieve precise correspondences between the images, and the third-order polynomial achieves the most satisfactory registration results. Its registration accuracy of the flat areas is less than 1.0 10 m pixel, that of the hilly areas is about 1.5 10 m pixels, and that of the mountainous areas is between 1.7 and 2.3 10 m pixels, which significantly improves the co-registration accuracy of the Sentinel-1 SAR and Sentinel-2 optical images.

scholarly journals Non-Rigid Multi-Modal 3D Medical Image Registration Based on Foveated Modality Independent Neighborhood Descriptor

Sensors ◽  
2019 ◽  
Vol 19 (21) ◽  
pp. 4675 ◽  
Author(s):  
Feng Yang ◽  
Mingyue Ding ◽  
Xuming Zhang
Keyword(s):  
Image Registration ◽  
Similarity Measure ◽  
Energy Function ◽  
Medical Image ◽  
Medical Image Registration ◽  
Self Similarity ◽  
Registration Accuracy ◽  
Registration Method ◽  
Rigid Deformation ◽  
Transformation Parameters

The non-rigid multi-modal three-dimensional (3D) medical image registration is highly challenging due to the difficulty in the construction of similarity measure and the solution of non-rigid transformation parameters. A novel structural representation based registration method is proposed to address these problems. Firstly, an improved modality independent neighborhood descriptor (MIND) that is based on the foveated nonlocal self-similarity is designed for the effective structural representations of 3D medical images to transform multi-modal image registration into mono-modal one. The sum of absolute differences between structural representations is computed as the similarity measure. Subsequently, the foveated MIND based spatial constraint is introduced into the Markov random field (MRF) optimization to reduce the number of transformation parameters and restrict the calculation of the energy function in the image region involving non-rigid deformation. Finally, the accurate and efficient 3D medical image registration is realized by minimizing the similarity measure based MRF energy function. Extensive experiments on 3D positron emission tomography (PET), computed tomography (CT), T1, T2, and PD weighted magnetic resonance (MR) images with synthetic deformation demonstrate that the proposed method has higher computational efficiency and registration accuracy in terms of target registration error (TRE) than the registration methods that are based on the hybrid L-BFGS-B and cat swarm optimization (HLCSO), the sum of squared differences on entropy images, the MIND, and the self-similarity context (SSC) descriptor, except that it provides slightly bigger TRE than the HLCSO for CT-PET image registration. Experiments on real MR and ultrasound images with unknown deformation have also be done to demonstrate the practicality and superiority of the proposed method.

scholarly journals AUTOMATIC MRF-BASED REGISTRATION OF HIGH RESOLUTION SATELLITE VIDEO DATA

2016 ◽  
Vol III-1 ◽  
pp. 121-128 ◽  
Author(s):  
C. Platias ◽  
M. Vakalopoulou ◽  
K. Karantzalos
Keyword(s):  
High Resolution ◽  
Markov Random Fields ◽  
Video Data ◽  
Registration Accuracy ◽  
Registration Method ◽  
Computational Performance ◽  
Markov Random ◽  
Video Frames ◽  
Reference Map ◽  
The Cost

In this paper we propose a deformable registration framework for high resolution satellite video data able to automatically and accurately co-register satellite video frames and/or register them to a reference map/image. The proposed approach performs non-rigid registration, formulates a Markov Random Fields (MRF) model, while efficient linear programming is employed for reaching the lowest potential of the cost function. The developed approach has been applied and validated on satellite video sequences from Skybox Imaging and compared with a rigid, descriptor-based registration method. Regarding the computational performance, both the MRF-based and the descriptor-based methods were quite efficient, with the first one converging in some minutes and the second in some seconds. Regarding the registration accuracy the proposed MRF-based method significantly outperformed the descriptor-based one in all the performing experiments.

scholarly journals FAST REGISTRATION OF TERRESTRIAL LIDAR POINT CLOUD AND SEQUENCE IMAGES

2017 ◽  
Vol XLII-2/W7 ◽  
pp. 875-879
Author(s):  
J. Shao ◽  
W. Zhang ◽  
Y. Zhu ◽  
A. Shen
Keyword(s):  
Point Cloud ◽  
Engineering Application ◽  
Image Point ◽  
Color Information ◽  
Registration Accuracy ◽  
Registration Method ◽  
Terrestrial Lidar ◽  
The Rich ◽  
Ground Based Lidar

Image has rich color information, and it can help to promote recognition and classification of point cloud. The registration is an important step in the application of image and point cloud. In order to give the rich texture and color information for LiDAR point cloud, the paper researched a fast registration method of point cloud and sequence images based on the ground-based LiDAR system. First, calculating transformation matrix of one of sequence images based on 2D image and LiDAR point cloud; second, using the relationships of position and attitude information among multi-angle sequence images to calculate all transformation matrixes in the horizontal direction; last, completing the registration of point cloud and sequence images based on the collinear condition of image point, projective center and LiDAR point. The experimental results show that the method is simple and fast, and the stitching error between adjacent images is litter; meanwhile, the overall registration accuracy is high, and the method can be used in engineering application.

scholarly journals Use of Stereovision for Intraoperative Coregistration of a Spinal Surgical Field: A Human Feasibility Study

2017 ◽  
Vol 14 (1) ◽  
pp. 29-35 ◽  
Author(s):  
S Scott Lollis ◽  
Xiaoyao Fan ◽  
Linton Evans ◽  
Jonathan D Olson ◽  
Keith D Paulsen ◽  
...  
Keyword(s):  
Reconstruction Error ◽  
Computational Time ◽  
Registration Accuracy ◽  
Camera System ◽  
Cross Sectional ◽  
Registration Method ◽  
Current Form ◽  
Preoperative Ct ◽  
Cross Sectional Imaging ◽  
Surgical Field

AbstractBACKGROUNDThe use of image guidance during spinal surgery has been limited by several anatomic factors such as intervertebral segment motion and ineffective spine immobilization. In its current form, the surgical field is coregistered with a preoperative computed tomography (CT), often obtained in a different spinal confirmation, or with intraoperative cross-sectional imaging. Stereovision offers an alternative method of registration.OBJECTIVETo demonstrate the feasibility of stereovision-mediated coregistration of a human spinal surgical field using a proof-of-principle study, and to provide preliminary assessments of the technique's accuracy.METHODSA total of 9 subjects undergoing image-guided pedicle screw placement also underwent stereovision-mediated coregistration with preoperative CT imaging. Stereoscopic images were acquired using a tracked, calibrated stereoscopic camera system mounted on an operating microscope. Images were processed, reconstructed, and segmented in a semi-automated manner. A multistart registration of the reconstructed spinal surface with preoperative CT was performed. Registration accuracy, measured as surface-to-surface distance error, was compared between stereovision registration and a standard registration.RESULTSThe mean surface reconstruction error of the stereovision-acquired surface was 2.20 ± 0.89 mm. Intraoperative coregistration with stereovision was performed with a mean error of 1.48 ± 0.35 mm compared to 2.03 ± 0.28 mm using a standard point-based registration method. The average computational time for registration with stereovision was 95 ± 46 s (range 33-184 s) vs 10to 20 min for standard point-based registration.CONCLUSIONSemi-automated registration of a spinal surgical field using stereovision is possible with accuracy that is at least comparable to current landmark-based techniques.

scholarly journals A Methodology of Three-Dimensional Medical Image Registration Based on Conformal Geometric Invariant

2014 ◽  
Vol 2014 ◽  
pp. 1-8
Author(s):  
Liang Hua ◽  
Kean Yu ◽  
Lijun Ding ◽  
Juping Gu ◽  
Xinsong Zhang ◽  
...  
Keyword(s):  
Image Registration ◽  
Medical Image ◽  
Subjective Evaluation ◽  
Three Dimensional ◽  
Medical Image Registration ◽  
Geometric Invariant ◽  
Registration Accuracy ◽  
Registration Method ◽  
Cloud Data ◽  
Dual Vector

A three-dimensional multimodality medical image registration method using geometric invariant based on conformal geometric algebra (CGA) theory is put forward for responding to challenges resulting from many free degrees and computational burdens with 3D medical image registration problems. The mathematical model and calculation method of dual-vector projection invariant are established using the distribution characteristics of point cloud data and the point-to-plane distance-based measurement in CGA space. The translation operator and geometric rotation operator during registration operation are built in Clifford algebra (CA) space. The conformal geometrical algebra is used to realize the registration of 3D CT/MR-PD medical image data based on the dual vector geometric invariant. The registration experiment results indicate that the methodology proposed in this paper is of stronger commonality, less computation burden, shorter time consumption, and intuitive geometric meaning. Both subjective evaluation and objective indicators show that the methodology proposed here is of high registration accuracy and suitable for 3D medical image registration.

scholarly journals UAV Remote Sensing Image Automatic Registration Based on Deep Residual Features

2021 ◽  
Vol 13 (18) ◽  
pp. 3605
Author(s):  
Xin Luo ◽  
Guangling Lai ◽  
Xiao Wang ◽  
Yuwei Jin ◽  
Xixu He ◽  
...  
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Rapid Development ◽  
Image Features ◽  
Automatic Registration ◽  
Remote Sensing Images ◽  
Registration Accuracy ◽  
Registration Method ◽  
Uav Images ◽  
High Level

With the rapid development of unmanned aerial vehicle (UAV) technology, UAV remote sensing images are increasing sharply. However, due to the limitation of the perspective of UAV remote sensing, the UAV images obtained from different viewpoints of a same scene need to be stitched together for further applications. Therefore, an automatic registration method of UAV remote sensing images based on deep residual features is proposed in this work. It needs no additional training and does not depend on image features, such as points, lines and shapes, or on specific image contents. This registration framework is built as follows: Aimed at the problem that most of traditional registration methods only use low-level features for registration, we adopted deep residual neural network features extracted by an excellent deep neural network, ResNet-50. Then, a tensor product was employed to construct feature description vectors through exacted high-level abstract features. At last, the progressive consistency algorithm (PROSAC) was exploited to remove false matches and fit a geometric transform model so as to enhance registration accuracy. The experimental results for different typical scene images with different resolutions acquired by different UAV image sensors indicate that the improved algorithm can achieve higher registration accuracy than a state-of-the-art deep learning registration algorithm and other popular registration algorithms.

scholarly journals APPLICATION OF GEOMETRICAL TRANSFORMATIONS FOR THE ATACHMENT OF IMAGES TO GEOGRAPHICAL MAPS

2019 ◽  
Vol 31 (6) ◽  
pp. 1917-1922
Author(s):  
Teodora Petrova
Keyword(s):  
Coordinate System ◽  
Affine Transformation ◽  
Projective Transformation ◽  
Geometric Transformation ◽  
Reference Image ◽  
Earth Surface ◽  
Sar Images ◽  
Geographical Maps ◽  
The One

The development of surveillance instruments allows obtaining images of the one and same object or area of earth surface that have been taken at different times and with different sensors. The analysis of such images requires the use of geometric transformation to align them. In the paper the use of affine transformation for SAR images aligning and the use of projective transformation to register an image to the coordinate system of a map is studied. Aligning of images to maps allows using a map of the area as a reference image instead an orthoimage of this area.

Sign in / Sign up

Export Citation Format

Share Document