scholarly journals No-Reference Quality Assessment for 3D Synthesized Images Based on Visual-Entropy-Guided Multi-Layer Features Analysis

Entropy ◽  
2021 ◽  
Vol 23 (6) ◽  
pp. 770
Author(s):  
Chongchong Jin ◽  
Zongju Peng ◽  
Wenhui Zou ◽  
Fen Chen ◽  
Gangyi Jiang ◽  
...  
Keyword(s):  
Visual Perception ◽  
Quality Assessment ◽  
Image Quality Assessment ◽  
Geometric Distortion ◽  
Depth Image ◽  
Human Visual Perception ◽  
Top Down ◽  
Bottom Up ◽  
Geometric Distortions ◽  
Visual Entropy

Multiview video plus depth is one of the mainstream representations of 3D scenes in emerging free viewpoint video, which generates virtual 3D synthesized images through a depth-image-based-rendering (DIBR) technique. However, the inaccuracy of depth maps and imperfect DIBR techniques result in different geometric distortions that seriously deteriorate the users’ visual perception. An effective 3D synthesized image quality assessment (IQA) metric can simulate human visual perception and determine the application feasibility of the synthesized content. In this paper, a no-reference IQA metric based on visual-entropy-guided multi-layer features analysis for 3D synthesized images is proposed. According to the energy entropy, the geometric distortions are divided into two visual attention layers, namely, bottom-up layer and top-down layer. The feature of salient distortion is measured by regional proportion plus transition threshold on a bottom-up layer. In parallel, the key distribution regions of insignificant geometric distortion are extracted by a relative total variation model, and the features of these distortions are measured by the interaction of decentralized attention and concentrated attention on top-down layers. By integrating the features of both bottom-up and top-down layers, a more visually perceptive quality evaluation model is built. Experimental results show that the proposed method is superior to the state-of-the-art in assessing the quality of 3D synthesized images.

scholarly journals Quality Assessment on Authentically Distorted Images by Expanding Proxy Labels

Electronics ◽  
2020 ◽  
Vol 9 (2) ◽  
pp. 252 ◽  
Author(s):  
Xiaodi Guan ◽  
Fan Li ◽  
Lijun He
Keyword(s):  
Image Quality ◽  
Visual Perception ◽  
Quality Assessment ◽  
Image Quality Assessment ◽  
Image Features ◽  
Quality Score ◽  
Fine Tuning ◽  
Reference Image ◽  
Human Visual Perception ◽  
In The Wild

In this paper, we propose a no-reference image quality assessment (NR-IQA) approach towards authentically distorted images, based on expanding proxy labels. In order to distinguish from the human labels, we define the quality score, which is generated by using a traditional NR-IQA algorithm, as “proxy labels”. “Proxy” means that the objective results are obtained by computer after the extraction and assessment of the image features, instead of human judging. To solve the problem of limited image quality assessment (IQA) dataset size, we adopt a cascading transfer-learning method. First, we obtain large numbers of proxy labels which denote the quality score of authentically distorted images by using a traditional no-reference IQA method. Then the deep network is trained by the proxy labels, in order to learn IQA-related knowledge from the amounts of images with their scores. Ultimately, we use fine-tuning to inherit knowledge represented in the trained network. During the procedure, the mapping relationship fits in with human visual perception closer. The experimental results demonstrate that the proposed algorithm shows an outstanding performance as compared with the existing algorithms. On the LIVE In the Wild Image Quality Challenge database and KonIQ-10k database (two standard databases for authentically distorted image quality assessment), the algorithm realized good consistency between human visual perception and the predicted quality score of authentically distorted images.

scholarly journals A Regression-Based Family of Measures for Full-Reference Image Quality Assessment

2016 ◽  
Vol 16 (6) ◽  
pp. 316-325 ◽  
Author(s):  
Mariusz Oszust
Keyword(s):  
Image Quality ◽  
Visual Perception ◽  
Quality Assessment ◽  
Quality Evaluation ◽  
Image Quality Assessment ◽  
Human Subjects ◽  
Reference Image ◽  
Human Visual Perception ◽  
Full Reference ◽  
Highly Correlated

Abstract The advances in the development of imaging devices resulted in the need of an automatic quality evaluation of displayed visual content in a way that is consistent with human visual perception. In this paper, an approach to full-reference image quality assessment (IQA) is proposed, in which several IQA measures, representing different approaches to modelling human visual perception, are efficiently combined in order to produce objective quality evaluation of examined images, which is highly correlated with evaluation provided by human subjects. In the paper, an optimisation problem of selection of several IQA measures for creating a regression-based IQA hybrid measure, or a multimeasure, is defined and solved using a genetic algorithm. Experimental evaluation on four largest IQA benchmarks reveals that the multimeasures obtained using the proposed approach outperform state-of-the-art full-reference IQA techniques, including other recently developed fusion approaches.

scholarly journals Human Visual Perception-Based Multi-Exposure Fusion Image Quality Assessment

Symmetry ◽  
2019 ◽  
Vol 11 (12) ◽  
pp. 1494 ◽  
Author(s):  
Yueli Cui ◽  
Aihua Chen ◽  
Benquan Yang ◽  
Shiqing Zhang ◽  
Yang Wang
Keyword(s):  
Image Quality ◽  
Visual Perception ◽  
Quality Assessment ◽  
Image Quality Assessment ◽  
Human Visual Perception ◽  
Fusion Image ◽  
Perceptual Features ◽  
Exposure Fusion ◽  
Fused Image ◽  
Exposure Levels

Compared with ordinary single exposure images, multi-exposure fusion (MEF) images are prone to color imbalance, detail information loss and abnormal exposure in the process of combining multiple images with different exposure levels. In this paper, we proposed a human visual perception-based multi-exposure fusion image quality assessment method by considering the related perceptual features (i.e., color, dense scale invariant feature transform (DSIFT) and exposure) to measure the quality degradation accurately, which is closely related to the symmetry principle in human eyes. Firstly, the L1 norm of chrominance components between fused images and the designed pseudo images with the most severe color attenuation is calculated to measure the global color degradation, and the color saturation similarity is added to eliminate the influence of color over-saturation. Secondly, a set of distorted images under different exposure levels with strong edge information of fused image is constructed through the structural transfer, thus DSIFT similarity and DSIFT saturation are computed to measure the local detail loss and enhancement, respectively. Thirdly, Gauss exposure function is used to detect the over-exposure or under-exposure areas, and the above perceptual features are aggregated with random forest to predict the final quality of fused image. Experimental results on a public MEF subjective assessment database show the superiority of the proposed method with the state-of-the-art image quality assessment models.

Sign in / Sign up

Export Citation Format

Share Document