Virtual View Synthesis for Free Viewpoint Video and Multiview Video Compression using Gaussian Mixture Modelling

2018 ◽  
Vol 27 (3) ◽  
pp. 1190-1201 ◽  
Author(s):  
D. M. Motiur Rahaman ◽  
Manoranjan Paul
Keyword(s):  
Video Compression ◽  
Gaussian Mixture ◽  
View Synthesis ◽  
Mixture Modelling ◽  
Virtual View Synthesis ◽  
Virtual View ◽  
Multiview Video ◽  
Free Viewpoint Video ◽  
Multiview Video Compression

Virtual View Synthesis Based on Asymmetric Bidirectional DIBR for 3D Video and Free Viewpoint Video

2020 ◽  
Vol 10 (5) ◽  
pp. 1562 ◽  
Author(s):  
Xiaodong Chen ◽  
Haitao Liang ◽  
Huaiyuan Xu ◽  
Siyu Ren ◽  
Huaiyu Cai ◽  
...  
Keyword(s):  
Computational Cost ◽  
Depth Estimation ◽  
Objective Evaluation ◽  
3D Video ◽  
View Synthesis ◽  
Depth Image ◽  
Estimation Errors ◽  
Virtual View Synthesis ◽  
Virtual View ◽  
Free Viewpoint Video

Depth image-based rendering (DIBR) plays an important role in 3D video and free viewpoint video synthesis. However, artifacts might occur in the synthesized view due to viewpoint changes and stereo depth estimation errors. Holes are usually out-of-field regions and disocclusions, and filling them appropriately becomes a challenge. In this paper, a virtual view synthesis approach based on asymmetric bidirectional DIBR is proposed. A depth image preprocessing method is applied to detect and correct unreliable depth values around the foreground edges. For the primary view, all pixels are warped to the virtual view by the modified DIBR method. For the auxiliary view, only the selected regions are warped, which contain the contents that are not visible in the primary view. This approach reduces the computational cost and prevents irrelevant foreground pixels from being warped to the holes. During the merging process, a color correction approach is introduced to make the result appear more natural. In addition, a depth-guided inpainting method is proposed to handle the remaining holes in the merged image. Experimental results show that, compared with bidirectional DIBR, the proposed rendering method can reduce about 37% rendering time and achieve 97% hole reduction. In terms of visual quality and objective evaluation, our approach performs better than the previous methods.

High quality virtual view synthesis based on corrected surface mapping and image fusion

2009 ◽  
Vol 45 (1) ◽  
pp. 30 ◽  
Author(s):  
S.-X. Liu ◽  
P. An ◽  
Z.-Y. Zhang ◽  
Q. Zhang ◽  
L.-Q. Shen ◽  
...  
Keyword(s):  
Image Fusion ◽  
View Synthesis ◽  
High Quality ◽  
Surface Mapping ◽  
Virtual View Synthesis ◽  
Virtual View
Sign in / Sign up

Export Citation Format

Share Document