scholarly journals Single Remote Sensing Image Super-Resolution with an Adaptive Joint Constraint Model

Sensors ◽  
2020 ◽  
Vol 20 (5) ◽  
pp. 1276
Author(s):  
Lingli Fu ◽  
Chao Ren ◽  
Xiaohai He ◽  
Xiaohong Wu ◽  
Zhengyong Wang

Remote sensing images have been widely used in many applications. However, the resolution of the obtained remote sensing images may not meet the increasing demands for some applications. In general, the sparse representation-based super-resolution (SR) method is one of the most popular methods to solve this issue. However, traditional sparse representation SR methods do not fully exploit the complementary constraints of images. Therefore, they cannot accurately reconstruct the unknown HR images. To address this issue, we propose a novel adaptive joint constraint (AJC) based on sparse representation for the single remote sensing image SR. First, we construct a nonlocal constraint by using the nonlocal self-similarity. Second, we propose a local structure filter according to the local gradient of the image and then construct a local constraint. Next, the nonlocal and local constraints are introduced into the sparse representation-based SR framework. Finally, the parameters of the joint constraint model are selected adaptively according to the level of image noise. We utilize the alternate iteration algorithm to tackle the minimization problem in AJC. Experimental results show that the proposed method achieves good SR performance in preserving image details and significantly improves the objective evaluation indices.

2018 ◽  
Vol 232 ◽  
pp. 02040
Author(s):  
Fuzhen Zhu ◽  
Xin Huang ◽  
Yue Liu ◽  
Haitao Zhu

In order to obtain higher quality super-resolution reconstruction (SRR) of remote sensing images, an improved sparse representation remote sensing images SRR method is proposed in this paper. First, low-resolution image is processed by improved feature extract operator. The high-resolution image and low-resolution image blocks have the same sparse representation coefficient, so the SRR image with higher spatial resolution can be derived from the sparse representation coefficients which have been obtained from low-resolution image. The improved feature extraction operator is a method to get more detail and texture information from the training images. Experiment results show that more texture details can be obtained in the result of SRR remote sensing images subjectively. At the same time, the objective evaluation parameters are improved greatly. The peak PSNR is increased about 2.50dB and 0.50 dB, RMSE is decreased about 2.80 and 0.3 compared with bicubic interpolation algorithm and Ref[8] algorithm respectively.


2018 ◽  
Vol 232 ◽  
pp. 02037
Author(s):  
Fuzhen Zhu ◽  
Yue Liu ◽  
Xin Huang ◽  
Haitao Zhu

In order to obtain higher resolution remote sensing images with more details, an improved sparse representation remote sensing image super-resolution reconstruction(SRR) algorithm is proposed. First, remote sensing image is preprocessed to obtain the required training sample image; then, the KSVD algorithm is used for dictionary training to obtain the high-low resolution dictionary pairs; finally, the image feature extraction block is represented, which is improved by using adaptive filtering method. At the same time, the mean value filtering method is used to improve the super-resolution reconstruction iterative calculation. Experiment results show that, compared with the most advanced sparse representation super-resolution algorithm, the improved sparse representation super-resolution method can effectively avoid the loss of edge information of SRR image and obtain a better super-resolution reconstruction effect. The texture details are more abundant in subjective vision, the PSNR is increased about 1 dB, and the structure similarity (SSIM) is increased about 0.01.


2019 ◽  
Vol 11 (15) ◽  
pp. 1817 ◽  
Author(s):  
Jun Gu ◽  
Xian Sun ◽  
Yue Zhang ◽  
Kun Fu ◽  
Lei Wang

Recently, deep convolutional neural networks (DCNN) have obtained promising results in single image super-resolution (SISR) of remote sensing images. Due to the high complexity of remote sensing image distribution, most of the existing methods are not good enough for remote sensing image super-resolution. Enhancing the representation ability of the network is one of the critical factors to improve remote sensing image super-resolution performance. To address this problem, we propose a new SISR algorithm called a Deep Residual Squeeze and Excitation Network (DRSEN). Specifically, we propose a residual squeeze and excitation block (RSEB) as a building block in DRSEN. The RSEB fuses the input and its internal features of current block, and models the interdependencies and relationships between channels to enhance the representation power. At the same time, we improve the up-sampling module and the global residual pathway in the network to reduce the parameters of the network. Experiments on two public remote sensing datasets (UC Merced and NWPU-RESISC45) show that our DRSEN achieves better accuracy and visual improvements against most state-of-the-art methods. The DRSEN is beneficial for the progress in the remote sensing images super-resolution field.


2020 ◽  
Vol 13 (1) ◽  
pp. 62
Author(s):  
Linshu Hu ◽  
Mengjiao Qin ◽  
Feng Zhang ◽  
Zhenhong Du ◽  
Renyi Liu

Image enhancement (IE) technology can help enhance the brightness of remote-sensing images to obtain better interpretation and visualization effects. Convolutional neural networks (CNN), such as the Low-light CNN (LLCNN) and Super-resolution CNN (SRCNN), have achieved great success in image enhancement, image super resolution, and other image-processing applications. Therefore, we adopt CNN to propose a new neural network architecture with end-to-end strategy for low-light remote-sensing IE, named remote-sensing CNN (RSCNN). In RSCNN, an upsampling operator is adopted to help learn more multi-scaled features. With respect to the lack of labeled training data in remote-sensing image datasets for IE, we use real natural image patches to train firstly and then perform fine-tuning operations with simulated remote-sensing image pairs. Reasonably designed experiments are carried out, and the results quantitatively show the superiority of RSCNN in terms of structural similarity index (SSIM) and peak signal-to-noise ratio (PSNR) over conventional techniques for low-light remote-sensing IE. Furthermore, the results of our method have obvious qualitative advantages in denoising and maintaining the authenticity of colors and textures.


Photonics ◽  
2021 ◽  
Vol 8 (10) ◽  
pp. 431
Author(s):  
Yuwu Wang ◽  
Guobing Sun ◽  
Shengwei Guo

With the widespread use of remote sensing images, low-resolution target detection in remote sensing images has become a hot research topic in the field of computer vision. In this paper, we propose a Target Detection on Super-Resolution Reconstruction (TDoSR) method to solve the problem of low target recognition rates in low-resolution remote sensing images under foggy conditions. The TDoSR method uses the Enhanced Super-Resolution Generative Adversarial Network (ESRGAN) to perform defogging and super-resolution reconstruction of foggy low-resolution remote sensing images. In the target detection part, the Rotation Equivariant Detector (ReDet) algorithm, which has a higher recognition rate at this stage, is used to identify and classify various types of targets. While a large number of experiments have been carried out on the remote sensing image dataset DOTA-v1.5, the results of this paper suggest that the proposed method achieves good results in the target detection of low-resolution foggy remote sensing images. The principal result of this paper demonstrates that the recognition rate of the TDoSR method increases by roughly 20% when compared with low-resolution foggy remote sensing images.


Sign in / Sign up

Export Citation Format

Share Document