Evaluation of deep neural networks for single image super-resolution in a maritime context

2017 ◽  
Author(s):  
Robert P. J. Nieuwenhuizen ◽  
Maarten C. Kruithof ◽  
Klamer Schutte
Keyword(s):  
Neural Networks ◽  
Deep Neural Networks ◽  
Super Resolution ◽  
Single Image ◽  
Image Super Resolution ◽  
Single Image Super Resolution

scholarly journals SINGLE-IMAGE SUPER RESOLUTION FOR MULTISPECTRAL REMOTE SENSING DATA USING CONVOLUTIONAL NEURAL NETWORKS

2016 ◽  
Vol XLI-B3 ◽  
pp. 883-890 ◽  
Author(s):  
L. Liebel ◽  
M. Körner
Keyword(s):  
Remote Sensing ◽  
Neural Networks ◽  
Spatial Resolution ◽  
Super Resolution ◽  
Remote Sensing Data ◽  
Single Image ◽  
Sensing Data ◽  
Multispectral Remote Sensing ◽  
Image Super Resolution ◽  
Single Image Super Resolution

In optical remote sensing, spatial resolution of images is crucial for numerous applications. Space-borne systems are most likely to be affected by a lack of spatial resolution, due to their natural disadvantage of a large distance between the sensor and the sensed object. Thus, methods for <i>single-image super resolution</i> are desirable to exceed the limits of the sensor. Apart from assisting visual inspection of datasets, post-processing operations—e.g., segmentation or feature extraction—can benefit from detailed and distinguishable structures. In this paper, we show that recently introduced state-of-the-art approaches for single-image super resolution of conventional photographs, making use of <i>deep learning</i> techniques, such as <i>convolutional neural networks</i> (CNN), can successfully be applied to remote sensing data. With a huge amount of training data available, <i>end-to-end learning</i> is reasonably easy to apply and can achieve results unattainable using conventional handcrafted algorithms. <br><br> We trained our CNN on a specifically designed, domain-specific dataset, in order to take into account the special characteristics of multispectral remote sensing data. This dataset consists of publicly available SENTINEL-2 images featuring 13 spectral bands, a ground resolution of up to 10m, and a high radiometric resolution and thus satisfying our requirements in terms of quality and quantity. In experiments, we obtained results superior compared to competing approaches trained on generic image sets, which failed to reasonably scale satellite images with a high radiometric resolution, as well as conventional interpolation methods.

scholarly journals SINGLE-IMAGE SUPER RESOLUTION FOR MULTISPECTRAL REMOTE SENSING DATA USING CONVOLUTIONAL NEURAL NETWORKS

2016 ◽  
Vol XLI-B3 ◽  
pp. 883-890 ◽  
Author(s):  
L. Liebel ◽  
M. Körner
Keyword(s):  
Remote Sensing ◽  
Neural Networks ◽  
Spatial Resolution ◽  
Super Resolution ◽  
Remote Sensing Data ◽  
Single Image ◽  
Sensing Data ◽  
Multispectral Remote Sensing ◽  
Image Super Resolution ◽  
Single Image Super Resolution

In optical remote sensing, spatial resolution of images is crucial for numerous applications. Space-borne systems are most likely to be affected by a lack of spatial resolution, due to their natural disadvantage of a large distance between the sensor and the sensed object. Thus, methods for <i>single-image super resolution</i> are desirable to exceed the limits of the sensor. Apart from assisting visual inspection of datasets, post-processing operations—e.g., segmentation or feature extraction—can benefit from detailed and distinguishable structures. In this paper, we show that recently introduced state-of-the-art approaches for single-image super resolution of conventional photographs, making use of <i>deep learning</i> techniques, such as <i>convolutional neural networks</i> (CNN), can successfully be applied to remote sensing data. With a huge amount of training data available, <i>end-to-end learning</i> is reasonably easy to apply and can achieve results unattainable using conventional handcrafted algorithms. <br><br> We trained our CNN on a specifically designed, domain-specific dataset, in order to take into account the special characteristics of multispectral remote sensing data. This dataset consists of publicly available SENTINEL-2 images featuring 13 spectral bands, a ground resolution of up to 10m, and a high radiometric resolution and thus satisfying our requirements in terms of quality and quantity. In experiments, we obtained results superior compared to competing approaches trained on generic image sets, which failed to reasonably scale satellite images with a high radiometric resolution, as well as conventional interpolation methods.

scholarly journals Multi-Path Deep CNN with Residual Inception Network for Single Image Super-Resolution

Electronics ◽  
2021 ◽  
Vol 10 (16) ◽  
pp. 1979
Author(s):  
Wazir Muhammad ◽  
Zuhaibuddin Bhutto ◽  
Arslan Ansari ◽  
Mudasar Latif Memon ◽  
Ramesh Kumar ◽  
...  
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Computational Cost ◽  
Similarity Index ◽  
Super Resolution ◽  
Single Image ◽  
Index Matrix ◽  
Deep Cnn ◽  
Image Super Resolution ◽  
Single Image Super Resolution

Recent research on single-image super-resolution (SISR) using deep convolutional neural networks has made a breakthrough and achieved tremendous performance. Despite their significant progress, numerous convolutional neural networks (CNN) are limited in practical applications, owing to the requirement of the heavy computational cost of the model. This paper proposes a multi-path network for SISR, known as multi-path deep CNN with residual inception network for single image super-resolution. In detail, a residual/ResNet block with an Inception block supports the main framework of the entire network architecture. In addition, remove the batch normalization layer from the residual network (ResNet) block and max-pooling layer from the Inception block to further reduce the number of parameters to preventing the over-fitting problem during the training. Moreover, a conventional rectified linear unit (ReLU) is replaced with Leaky ReLU activation function to speed up the training process. Specifically, we propose a novel two upscale module, which adopts three paths to upscale the features by jointly using deconvolution and upsampling layers, instead of using single deconvolution layer or upsampling layer alone. The extensive experimental results on image super-resolution (SR) using five publicly available test datasets, which show that the proposed model not only attains the higher score of peak signal-to-noise ratio/structural similarity index matrix (PSNR/SSIM) but also enables faster and more efficient calculations against the existing image SR methods. For instance, we improved our method in terms of overall PSNR on the SET5 dataset with challenging upscale factor 8× as 1.88 dB over the baseline bicubic method and reduced computational cost in terms of number of parameters 62% by deeply-recursive convolutional neural network (DRCN) method.

scholarly journals Towards Compact Single Image Super-Resolution via Contrastive Self-distillation

2021 ◽  
Author(s):  
Yanbo Wang ◽  
Shaohui Lin ◽  
Yanyun Qu ◽  
Haiyan Wu ◽  
Zhizhong Zhang ◽  
...  
Keyword(s):  
Neural Networks ◽  
Knowledge Transfer ◽  
Explicit Knowledge ◽  
Super Resolution ◽  
Single Image ◽  
Computational Overhead ◽  
Resource Limited ◽  
Image Super Resolution ◽  
Single Image Super Resolution

Convolutional neural networks (CNNs) are highly successful for super-resolution (SR) but often require sophisticated architectures with heavy memory cost and computational overhead significantly restricts their practical deployments on resource-limited devices. In this paper, we proposed a novel contrastive self-distillation (CSD) framework to simultaneously compress and accelerate various off-the-shelf SR models. In particular, a channel-splitting super-resolution network can first be constructed from a target teacher network as a compact student network. Then, we propose a novel contrastive loss to improve the quality of SR images and PSNR/SSIM via explicit knowledge transfer. Extensive experiments demonstrate that the proposed CSD scheme effectively compresses and accelerates several standard SR models such as EDSR, RCAN and CARN. Code is available at https://github.com/Booooooooooo/CSD.

Sign in / Sign up

Export Citation Format

Share Document