scholarly journals Triple-Attention Mixed-Link Network for Single-Image Super-Resolution

2019 ◽  
Vol 9 (15) ◽  
pp. 2992 ◽  
Author(s):  
Xi Cheng ◽  
Xiang Li ◽  
Jian Yang
Keyword(s):  
Receptive Fields ◽  
Super Resolution ◽  
Feature Representation ◽  
Single Image ◽  
Deep Convolutional Neural Networks ◽  
Flow Topology ◽  
Image Super Resolution ◽  
Representational Power ◽  
Pass Through ◽  
Single Image Super Resolution

Single-image super-resolution is of great importance as a low-level computer-vision task. Recent approaches with deep convolutional neural networks have achieved impressive performance. However, existing architectures have limitations due to the less sophisticated structure along with less strong representational power. In this work, to significantly enhance the feature representation, we proposed triple-attention mixed-link network (TAN), which consists of (1) three different aspects (i.e., kernel, spatial, and channel) of attention mechanisms and (2) fusion of both powerful residual and dense connections (i.e., mixed link). Specifically, the network with multi-kernel learns multi-hierarchical representations under different receptive fields. The features are recalibrated by the effective kernel and channel attention, which filters the information and enables the network to learn more powerful representations. The features finally pass through the spatial attention in the reconstruction network, which generates a fusion of local and global information, lets the network restore more details, and improves the reconstruction quality. The proposed network structure decreases 50% of the parameter growth rate compared with previous approaches. The three attention mechanisms provide 0.49 dB, 0.58 dB, and 0.32 dB performance gain when evaluating on Set5, Set14, and BSD100. Thanks to the diverse feature recalibrations and the advanced information flow topology, our proposed model is strong enough to perform against the state-of-the-art methods on the benchmark evaluations.

scholarly journals A Lightweight Dense Connected Approach with Attention on Single Image Super-Resolution

Electronics ◽  
2021 ◽  
Vol 10 (11) ◽  
pp. 1234
Author(s):  
Lei Zha ◽  
Yu Yang ◽  
Zicheng Lai ◽  
Ziwei Zhang ◽  
Juan Wen
Keyword(s):  
Receptive Fields ◽  
Super Resolution ◽  
Feature Representation ◽  
Single Image ◽  
Deep Model ◽  
Benchmark Datasets ◽  
Rich Information ◽  
Image Super Resolution ◽  
Model Training ◽  
Single Image Super Resolution

In recent years, neural networks for single image super-resolution (SISR) have applied more profound and deeper network structures to extract extra image details, which brings difficulties in model training. To deal with deep model training problems, researchers utilize dense skip connections to promote the model’s feature representation ability by reusing deep features of different receptive fields. Benefiting from the dense connection block, SRDensenet has achieved excellent performance in SISR. Despite the fact that the dense connected structure can provide rich information, it will also introduce redundant and useless information. To tackle this problem, in this paper, we propose a Lightweight Dense Connected Approach with Attention for Single Image Super-Resolution (LDCASR), which employs the attention mechanism to extract useful information in channel dimension. Particularly, we propose the recursive dense group (RDG), consisting of Dense Attention Blocks (DABs), which can obtain more significant representations by extracting deep features with the aid of both dense connections and the attention module, making our whole network attach importance to learning more advanced feature information. Additionally, we introduce the group convolution in DABs, which can reduce the number of parameters to 0.6 M. Extensive experiments on benchmark datasets demonstrate the superiority of our proposed method over five chosen SISR methods.

scholarly journals Deep Residual Squeeze and Excitation Network for Remote Sensing Image Super-Resolution

2019 ◽  
Vol 11 (15) ◽  
pp. 1817 ◽  
Author(s):  
Jun Gu ◽  
Xian Sun ◽  
Yue Zhang ◽  
Kun Fu ◽  
Lei Wang
Keyword(s):  
Remote Sensing ◽  
State Of The Art ◽  
Super Resolution ◽  
Remote Sensing Image ◽  
Single Image ◽  
Remote Sensing Images ◽  
Deep Convolutional Neural Networks ◽  
Current Block ◽  
Image Super Resolution ◽  
Single Image Super Resolution

Recently, deep convolutional neural networks (DCNN) have obtained promising results in single image super-resolution (SISR) of remote sensing images. Due to the high complexity of remote sensing image distribution, most of the existing methods are not good enough for remote sensing image super-resolution. Enhancing the representation ability of the network is one of the critical factors to improve remote sensing image super-resolution performance. To address this problem, we propose a new SISR algorithm called a Deep Residual Squeeze and Excitation Network (DRSEN). Specifically, we propose a residual squeeze and excitation block (RSEB) as a building block in DRSEN. The RSEB fuses the input and its internal features of current block, and models the interdependencies and relationships between channels to enhance the representation power. At the same time, we improve the up-sampling module and the global residual pathway in the network to reduce the parameters of the network. Experiments on two public remote sensing datasets (UC Merced and NWPU-RESISC45) show that our DRSEN achieves better accuracy and visual improvements against most state-of-the-art methods. The DRSEN is beneficial for the progress in the remote sensing images super-resolution field.

Downscaling of Precipitation Forecasts Based on Single Image Super-Resolution

2020 ◽  
Author(s):  
Yan Ji ◽  
Xiefei Zhi ◽  
Ye Tian ◽  
Ting Peng ◽  
Ziqiang Huo ◽  
...  
Keyword(s):  
Spatial Information ◽  
Daily Precipitation ◽  
Regional Scale ◽  
Super Resolution ◽  
Ensemble Prediction ◽  
Generative Adversarial Networks ◽  
Single Image ◽  
Deep Convolutional Neural Networks ◽  
Image Super Resolution ◽  
Single Image Super Resolution

<p>High spatial resolution weather forecasts that capture regional-scale dynamics are important for natural hazards prevention, especially for the regions featured with large topographical variety and local climate. While deep convolutional neural networks have made great progress in single image super-resolution (SR) which learns mapping relationship between low- and high- resolution images, limited efforts have been made to explore the potential of downscaling in this way. In the study, three advanced SR deep learning frameworks including Super-Resolution Convolutional Neural Network (SRCNN), Super-Resolution Generative Adversarial Networks (SRGAN) and Enhanced Deep residual networks for Super-Resolution (EDSR) are proposed for downscaling forecasts of daily precipitation in southeast China (100°E -130°E, 15°N -35°N). The SR frameworks are designed to improve the horizontal resolution of daily precipitation forecasts from raw 1/2 degrees (~50km) to 1/4 degrees (~25km) and 1/8 degrees (~12.5km), respectively. For comparison, Bias Correction Spatial Disaggregation (BCSD) as a traditional SD method is also performed under the same framework. The precipitation forecasts used in our work are obtained from different Ensemble Prediction Systems (EPSs) including ECMWF, NCEP and JMA which are provided by TIGGE datasets. A group of metrics have been applied to assess the performance of the three SR models, including Root Mean Square Error (RMSE), Anomaly Correlation Coefficient (ACC) and Equitable Threat Score (ETS). Results show that three SR models can effectively capture the detailed spatial information of local precipitation that is ignored in global NWPs. Among the three SR models, EDSR obtains the optimum results with lower RMSE and higher ACC which shows better downscaling skills. Furthermore, the SR downscaling methods can be extended to the statistical downscaling for other predictors as well.</p>

scholarly journals Real-Time Environment Monitoring Using a Lightweight Image Super-Resolution Network

2021 ◽  
Vol 18 (11) ◽  
pp. 5890
Author(s):  
Qiang Yu ◽  
Feiqiang Liu ◽  
Long Xiao ◽  
Zitao Liu ◽  
Xiaomin Yang
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Super Resolution ◽  
Model Complexity ◽  
Practical Application ◽  
Single Image ◽  
Feature Maps ◽  
Benchmark Datasets ◽  
Image Super Resolution ◽  
Single Image Super Resolution

Deep-learning (DL)-based methods are of growing importance in the field of single image super-resolution (SISR). The practical application of these DL-based models is a remaining problem due to the requirement of heavy computation and huge storage resources. The powerful feature maps of hidden layers in convolutional neural networks (CNN) help the model learn useful information. However, there exists redundancy among feature maps, which can be further exploited. To address these issues, this paper proposes a lightweight efficient feature generating network (EFGN) for SISR by constructing the efficient feature generating block (EFGB). Specifically, the EFGB can conduct plain operations on the original features to produce more feature maps with parameters slightly increasing. With the help of these extra feature maps, the network can extract more useful information from low resolution (LR) images to reconstruct the desired high resolution (HR) images. Experiments conducted on the benchmark datasets demonstrate that the proposed EFGN can outperform other deep-learning based methods in most cases and possess relatively lower model complexity. Additionally, the running time measurement indicates the feasibility of real-time monitoring.

Compact and progressive network for enhanced single image super-resolution—ComPrESRNet

2021 ◽  
Author(s):  
Vishal Chudasama ◽  
Kishor Upla ◽  
Kiran Raja ◽  
Raghavendra Ramachandra ◽  
Christoph Busch
Keyword(s):  
Super Resolution ◽  
Single Image ◽  
Image Super Resolution ◽  
Single Image Super Resolution

scholarly journals Noisy Single Image Super-resolution Based on Local Fractal Feature Analysis

IEEE Access ◽  
2021 ◽  
pp. 1-1
Author(s):  
Kai Shao ◽  
Qinglan Fan ◽  
Yunfeng Zhang ◽  
Fangxun Bao ◽  
Caiming Zhang
Keyword(s):  
Super Resolution ◽  
Feature Analysis ◽  
Single Image ◽  
Image Super Resolution ◽  
Single Image Super Resolution
Sign in / Sign up

Export Citation Format

Share Document