scholarly journals Image Registration Algorithm Based on Convolutional Neural Network and Local Homography Transformation

2020 ◽  
Vol 10 (3) ◽  
pp. 732 ◽  
Author(s):  
Yuanwei Wang ◽  
Mei Yu ◽  
Gangyi Jiang ◽  
Zhiyong Pan ◽  
Jiqiang Lin
Keyword(s):  
Neural Network ◽  
Image Registration ◽  
Convolutional Neural Network ◽  
Estimation Algorithm ◽  
Matrix Estimation ◽  
Registration Algorithm ◽  
Image Registration Algorithm ◽  
Different Types ◽  
Homography Transformation ◽  
Traditional Image

In order to overcome the poor robustness of traditional image registration algorithms in illuminating and solving the problem of low accuracy of a learning-based image homography matrix estimation algorithm, an image registration algorithm based on convolutional neural network (CNN) and local homography transformation is proposed. Firstly, to ensure the diversity of samples, a sample and label generation method based on moving direct linear transformation (MDLT) is designed. The generated samples and labels can effectively reflect the local characteristics of images and are suitable for training the CNN model with which multiple pairs of local matching points between two images to be registered can be calculated. Then, the local homography matrices between the two images are estimated by using the MDLT and finally the image registration can be realized. The experimental results show that the proposed image registration algorithm achieves higher accuracy than other commonly used algorithms such as the SIFT, ORB, ECC, and APAP algorithms, as well as another two learning-based algorithms, and it has good robustness for different types of illumination imaging.

scholarly journals Methods for Preventing Visual Attacks in Convolutional Neural Networks Based on Data Discard and Dimensionality Reduction

2021 ◽  
Vol 11 (11) ◽  
pp. 5235
Author(s):  
Nikita Andriyanov
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Network Inference ◽  
Recognition Accuracy ◽  
Network Architectures ◽  
Reduced Dimensions ◽  
Different Types ◽  
Rectangular Area ◽  
Noise Impulse ◽  
Selection Of

The article is devoted to the study of convolutional neural network inference in the task of image processing under the influence of visual attacks. Attacks of four different types were considered: simple, involving the addition of white Gaussian noise, impulse action on one pixel of an image, and attacks that change brightness values within a rectangular area. MNIST and Kaggle dogs vs. cats datasets were chosen. Recognition characteristics were obtained for the accuracy, depending on the number of images subjected to attacks and the types of attacks used in the training. The study was based on well-known convolutional neural network architectures used in pattern recognition tasks, such as VGG-16 and Inception_v3. The dependencies of the recognition accuracy on the parameters of visual attacks were obtained. Original methods were proposed to prevent visual attacks. Such methods are based on the selection of “incomprehensible” classes for the recognizer, and their subsequent correction based on neural network inference with reduced image sizes. As a result of applying these methods, gains in the accuracy metric by a factor of 1.3 were obtained after iteration by discarding incomprehensible images, and reducing the amount of uncertainty by 4–5% after iteration by applying the integration of the results of image analyses in reduced dimensions.

SAR Image Registration Using Ratio Mutual Information

2012 ◽  
Vol 241-244 ◽  
pp. 2630-2637
Author(s):  
Chun Rong Wei ◽  
Chu He ◽  
Hong Sun
Keyword(s):  
Image Registration ◽  
Mutual Information ◽  
Speckle Noise ◽  
Synthetic Aperture Radar Image ◽  
Reference Image ◽  
Sar Image ◽  
Local Maxima ◽  
Characteristic Quantity ◽  
Registration Algorithm ◽  
Image Registration Algorithm

In order to reduce the noise sensitivity of the SAR (synthetic aperture radar) image registration, a image registration algorithm which basing on the ratio mutual information (RatioMI) is proposed in this paper. Firstly, the ratio images of the reference image and the floating image are gotten by using the ratio operator, and then take the two ratio images as a similar characteristic quantity to construct the similarity measure function which was used in the optimization process of the image registration experiment. The experimental results of the SAR image registration show that the new registration algorithm which based on the RatioMI is effectively in avoiding the local maxima point problems causing by speckle noise.

Sign in / Sign up

Export Citation Format

Share Document