scholarly journals Simultaneous Patch-Group Sparse Coding with Dual-Weighted ℓp Minimization for Image Restoration

Micromachines ◽  
2021 ◽  
Vol 12 (10) ◽  
pp. 1205
Author(s):  
Jiachao Zhang ◽  
Ying Tong ◽  
Liangbao Jiao

Sparse coding (SC) models have been proven as powerful tools applied in image restoration tasks, such as patch sparse coding (PSC) and group sparse coding (GSC). However, these two kinds of SC models have their respective drawbacks. PSC tends to generate visually annoying blocking artifacts, while GSC models usually produce over-smooth effects. Moreover, conventional ℓ1 minimization-based convex regularization was usually employed as a standard scheme for estimating sparse signals, but it cannot achieve an accurate sparse solution under many realistic situations. In this paper, we propose a novel approach for image restoration via simultaneous patch-group sparse coding (SPG-SC) with dual-weighted ℓp minimization. Specifically, in contrast to existing SC-based methods, the proposed SPG-SC conducts the local sparsity and nonlocal sparse representation simultaneously. A dual-weighted ℓp minimization-based non-convex regularization is proposed to improve the sparse representation capability of the proposed SPG-SC. To make the optimization tractable, a non-convex generalized iteration shrinkage algorithm based on the alternating direction method of multipliers (ADMM) framework is developed to solve the proposed SPG-SC model. Extensive experimental results on two image restoration tasks, including image inpainting and image deblurring, demonstrate that the proposed SPG-SC outperforms many state-of-the-art algorithms in terms of both objective and perceptual quality.

Author(s):  
Kai Song Zhang ◽  
Luo Zhong ◽  
Xuan Ya Zhang

Sparse representation has recently been extensively studied in the field of image restoration. Many sparsity-based approaches enforce sparse coding on patches with certain constraints. However, extracting structural information is a challenging task in the field image restoration. Motivated by the fact that structured sparse representation (SSR) method can capture the inner characteristics of image structures, which helps in finding sparse representations of nonlinear features or patterns, we propose the SSR approach for image restoration. Specifically, a generalized model is developed using structured restraint, namely, the group [Formula: see text]-norm of the coefficient matrix is introduced in the traditional sparse representation with respect to minimizing the differences within classes and maximizing the differences between classes for sparse representation, and its applications with image restoration are also explored. The sparse coefficients of SSR are obtained through iterative optimization approach. Experimental results have shown that the proposed SSR technique can significantly deliver the reconstructed images with high quality, which manifest the effectiveness of our approach in both peak signal-to-noise ratio performance and visual perception.


2020 ◽  
Vol 29 ◽  
pp. 7735-7750 ◽  
Author(s):  
Zhiyuan Zha ◽  
Xin Yuan ◽  
Bihan Wen ◽  
Jiachao Zhang ◽  
Jiantao Zhou ◽  
...  

2020 ◽  
Vol 2020 (1) ◽  
Author(s):  
Minhui Chang ◽  
Lei Zhang

Abstract In the image inpainting method based on sparse representation, the adaptability of over-complete dictionary has a great influence on the result of image restoration. If the over-complete dictionary cannot effectively reflect the differences between different local features, it may result in the loss of texture details, resulting in blurred or over-smooth phenomenon in restored images. In view of these problems, we propose an image restoration method based on sparse representation using feature classification learning. Firstly, we perform singular value decomposition on the local gradient vector. According to the relationship between the main orientation and the secondary orientation, we classify all the local patches into three categories: smooth patch, edge patch and texture patch. Secondly, we use K-Singular Value Decomposition method to learn over-complete dictionaries that adapt to different features. Finally, we use Orthogonal Matching Pursuit method to calculate the sparse coding of target patches with different local features on their corresponding over-complete dictionaries, and use the over-complete dictionary and corresponding sparse coding to restore the damaged pixels. A series of experiments on various restoration tasks show the superior performance of the proposed method.


Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3586
Author(s):  
Wenqing Wang ◽  
Han Liu ◽  
Guo Xie

The spectral mismatch between a multispectral (MS) image and its corresponding panchromatic (PAN) image affects the pansharpening quality, especially for WorldView-2 data. To handle this problem, a pansharpening method based on graph regularized sparse coding (GRSC) and adaptive coupled dictionary is proposed in this paper. Firstly, the pansharpening process is divided into three tasks according to the degree of correlation among the MS and PAN channels and the relative spectral response of WorldView-2 sensor. Then, for each task, the image patch set from the MS channels is clustered into several subsets, and the sparse representation of each subset is estimated through the GRSC algorithm. Besides, an adaptive coupled dictionary pair for each task is constructed to effectively represent the subsets. Finally, the high-resolution image subsets for each task are obtained by multiplying the estimated sparse coefficient matrix by the corresponding dictionary. A variety of experiments are conducted on the WorldView-2 data, and the experimental results demonstrate that the proposed method achieves better performance than the existing pansharpening algorithms in both subjective analysis and objective evaluation.


2014 ◽  
Vol 626 ◽  
pp. 32-37 ◽  
Author(s):  
Ajayan Lekshmi ◽  
C. Christopher Seldev

Shadows are viewed as undesired information that strongly affects images. Shadows may cause a high risk to present false color tones, to distort the shape of objects, to merge, or to lose objects. This paper proposes a novel approach for the detection and removal of shadows in an image. Firstly the shadow and non shadow region of the original image is identified by HSV color model. The shadow removal is based on exemplar based image inpainting. Finally, the border between the reconstructed shadow and the non shadow areas undergoes bilinear interpolation to yield a smooth transition between them. They would lead to a better fitting of the shadow and non shadow classes, thus resulting in a potentially better reconstruction quality.


2021 ◽  
Vol 336 ◽  
pp. 08013
Author(s):  
Zhaosheng Xu

Based on the author's research time, this paper studies the software credibility algorithm based on deep convolutional sparse coding. Firstly, it summarizes the convolutional sparse coding and trust classification system, and then constructs the algorithm from two aspects: factor processing based on deep convolution neural network and trust classification based on sparse representation.


2018 ◽  
Vol 296 ◽  
pp. 55-63 ◽  
Author(s):  
Zhiyuan Zha ◽  
Xinggan Zhang ◽  
Qiong Wang ◽  
Lan Tang ◽  
Xin Liu

Sign in / Sign up

Export Citation Format

Share Document