Improvement of Virtual View Rendering Based on Depth Image

2011 ◽  
Author(s):  
Dong Hu ◽  
Jianfei Sun ◽  
Ping Xu
Keyword(s):  
Depth Image ◽  
Virtual View ◽  
Virtual View Rendering

Depth Map Intra Coding Based on Virtual View Rendering Distortion Estimation

2011 ◽  
Vol 33 (11) ◽  
pp. 2541-2546 ◽  
Author(s):  
Qiu-wen Zhang ◽  
Ping An ◽  
Yan Zhang ◽  
Zhao-yang Zhang
Keyword(s):  
Depth Map ◽  
Intra Coding ◽  
Virtual View ◽  
Distortion Estimation ◽  
Virtual View Rendering

Virtual View Synthesis Based on Asymmetric Bidirectional DIBR for 3D Video and Free Viewpoint Video

2020 ◽  
Vol 10 (5) ◽  
pp. 1562 ◽  
Author(s):  
Xiaodong Chen ◽  
Haitao Liang ◽  
Huaiyuan Xu ◽  
Siyu Ren ◽  
Huaiyu Cai ◽  
...  
Keyword(s):  
Computational Cost ◽  
Depth Estimation ◽  
Objective Evaluation ◽  
3D Video ◽  
View Synthesis ◽  
Depth Image ◽  
Estimation Errors ◽  
Virtual View Synthesis ◽  
Virtual View ◽  
Free Viewpoint Video

Depth image-based rendering (DIBR) plays an important role in 3D video and free viewpoint video synthesis. However, artifacts might occur in the synthesized view due to viewpoint changes and stereo depth estimation errors. Holes are usually out-of-field regions and disocclusions, and filling them appropriately becomes a challenge. In this paper, a virtual view synthesis approach based on asymmetric bidirectional DIBR is proposed. A depth image preprocessing method is applied to detect and correct unreliable depth values around the foreground edges. For the primary view, all pixels are warped to the virtual view by the modified DIBR method. For the auxiliary view, only the selected regions are warped, which contain the contents that are not visible in the primary view. This approach reduces the computational cost and prevents irrelevant foreground pixels from being warped to the holes. During the merging process, a color correction approach is introduced to make the result appear more natural. In addition, a depth-guided inpainting method is proposed to handle the remaining holes in the merged image. Experimental results show that, compared with bidirectional DIBR, the proposed rendering method can reduce about 37% rendering time and achieve 97% hole reduction. In terms of visual quality and objective evaluation, our approach performs better than the previous methods.

scholarly journals Artifact Handling Based on Depth Image for View Synthesis

2019 ◽  
Vol 9 (9) ◽  
pp. 1834 ◽  
Author(s):  
Xiaodong Chen ◽  
Haitao Liang ◽  
Huaiyuan Xu ◽  
Siyu Ren ◽  
Huaiyu Cai ◽  
...  
Keyword(s):  
Objective Evaluation ◽  
Depth Image ◽  
Reference Image ◽  
Depth Information ◽  
Virtual Image ◽  
Hole Filling ◽  
Virtual View ◽  
Depth Image Based Rendering ◽  
Handling Method

The depth image based rendering (DIBR) is a popular technology for 3D video and free viewpoint video (FVV) synthesis, by which numerous virtual views can be generated from a single reference view and its depth image. However, some artifacts are produced in the DIBR process and reduce the visual quality of virtual view. Due to the diversity of artifacts, effectively handling them becomes a challenging task. In this paper, an artifact handling method based on depth image is proposed. The reference image and its depth image are extended to fill the holes that belong to the out-of-field regions. A depth image preprocessing method is applied to project the ghosts to their correct place. The 3D warping process is optimized by an adaptive one-to-four method to deal with the cracks and pixel overlapping. For disocclusions, we calculate depth and background terms of the filling priority based on depth information. The search for the best matching patch is performed simultaneously in the reference image and the virtual image. Moreover, adaptive patch size is used in all hole-filling processes. Experimental results demonstrate the effectiveness of the proposed method, which has better performance compared with previous methods in subjective and objective evaluation.

scholarly journals A New Virtual View Rendering Method based on Depth Map for 3DTV3DTV; virtual view rendering; depth; false contour; holes filling; image restoration

2011 ◽  
Vol 15 ◽  
pp. 1115-1119
Author(s):  
Linwei Zhu ◽  
Mei Yu ◽  
Gangyi Jiang ◽  
Xiangying Mao ◽  
Songyin Fu ◽  
...  
Keyword(s):  
Image Restoration ◽  
Depth Map ◽  
Virtual View ◽  
Virtual View Rendering

scholarly journals Fast Hole Filling for View Synthesis in Free Viewpoint Video

Electronics ◽  
2020 ◽  
Vol 9 (6) ◽  
pp. 906
Author(s):  
Hui-Yu Huang ◽  
Shao-Yu Huang
Keyword(s):  
Median Filter ◽  
Synthesis Method ◽  
Depth Map ◽  
View Synthesis ◽  
Depth Image ◽  
Virtual View Synthesis ◽  
Virtual View ◽  
Recent Emergence ◽  
The World ◽  
3D Content

The recent emergence of three-dimensional (3D) movies and 3D television (TV) indicates an increasing interest in 3D content. Stereoscopic displays have enabled visual experiences to be enhanced, allowing the world to be viewed in 3D. Virtual view synthesis is the key technology to present 3D content, and depth image-based rendering (DIBR) is a classic virtual view synthesis method. With a texture image and its corresponding depth map, a virtual view can be generated using the DIBR technique. The depth and camera parameters are used to project the entire pixel in the image to the 3D world coordinate system. The results in the world coordinates are then reprojected into the virtual view, based on 3D warping. However, these projections will result in cracks (holes). Hence, we herein propose a new method of DIBR for free viewpoint videos to solve the hole problem due to these projection processes. First, the depth map is preprocessed to reduce the number of holes, which does not produce large-scale geometric distortions; subsequently, improved 3D warping projection is performed collectively to create the virtual view. A median filter is used to filter the hole regions in the virtual view, followed by 3D inverse warping blending to remove the holes. Next, brightness adjustment and adaptive image blending are performed. Finally, the synthesized virtual view is obtained using the inpainting method. Experimental results verify that our proposed method can produce a pleasant visibility of the synthetized virtual view, maintain a high peak signal-to-noise ratio (PSNR) value, and efficiently decrease execution time compared with state-of-the-art methods.

Sign in / Sign up

Export Citation Format

Share Document