Holovideo: Real-time 3D range video encoding and decoding on GPU

2012 ◽  
Vol 50 (2) ◽  
pp. 280-286 ◽  
Author(s):  
Nikolaus Karpinsky ◽  
Song Zhang
Keyword(s):  
Real Time ◽  
Video Encoding

Passthrough+

2020 ◽  
Vol 3 (1) ◽  
pp. 1-17
Author(s):  
Gaurav Chaurasia ◽  
Arthur Nieuwoudt ◽  
Alexandru-Eugen Ichim ◽  
Richard Szeliski ◽  
Alexander Sorkine-Hornung
Keyword(s):  
Real Time ◽  
Video Encoding ◽  
View Synthesis ◽  
Performance Constraints ◽  
Trade Offs ◽  
Stereoscopic View ◽  
Target User ◽  
Spatio Temporal ◽  
And Performance ◽  
3D Scene

We present an end-to-end system for real-time environment capture, 3D reconstruction, and stereoscopic view synthesis on a mobile VR headset. Our solution allows the user to use the cameras on their VR headset as their eyes to see and interact with the real world while still wearing their headset, a feature often referred to as Passthrough. The central challenge when building such a system is the choice and implementation of algorithms under the strict compute, power, and performance constraints imposed by the target user experience and mobile platform. A key contribution of this paper is a complete description of a corresponding system that performs temporally stable passthrough rendering at 72 Hz with only 200 mW power consumption on a mobile Snapdragon 835 platform. Our algorithmic contributions for enabling this performance include the computation of a coarse 3D scene proxy on the embedded video encoding hardware, followed by a depth densification and filtering step, and finally stereoscopic texturing and spatio-temporal up-sampling. We provide a detailed discussion and evaluation of the challenges we encountered, as well as algorithm and performance trade-offs in terms of compute and resulting passthrough quality.;AB@The described system is available to users as the Passthrough+ feature on Oculus Quest. We believe that by publishing the underlying system and methods, we provide valuable insights to the community on how to design and implement real-time environment sensing and rendering on heavily resource constrained hardware.

Fast Motion Estimation Algorithm Based on Real Time Monitoring

2011 ◽  
Vol 383-390 ◽  
pp. 5028-5033
Author(s):  
Xue Mei Xu ◽  
Qin Mo ◽  
Lan Ni ◽  
Qiao Yun Guo ◽  
An Li
Keyword(s):  
Motion Estimation ◽  
Real Time ◽  
Computation Time ◽  
Estimation Algorithm ◽  
Video Encoding ◽  
Experimental Result ◽  
Fast Motion Estimation ◽  
Motion Activity ◽  
Search Patterns ◽  
Motion Estimation Algorithm

In the video encoding system, motion estimation plays an important role at the front-end of encoder, which can eliminate inter redundancy efficiently and improve encoding efficiency. However, traditional motion estimation algorithm can’t be used in real-time application like video monitoring due to its computational complexity. In order to improve real-time efficiency, an improved motion estimation algorithm is proposed in this paper. The essential ideas consist of early termination rules, prediction of initial search point, and determination of motion type. Furthermore, our algorithm adopts different search patterns for certain motion activity. Experimental result shows that the improved algorithm reduces the computation time significantly while maintaining the image quality, and satisfies real time requirement in monitoring system.

Design of Embedded Video Monitoring System Based on DM6437

2014 ◽  
Vol 1003 ◽  
pp. 249-253
Author(s):  
Hao Fang ◽  
Ai Hua Li ◽  
Yan Fei Liu
Keyword(s):  
Real Time ◽  
Monitoring System ◽  
Transmission Function ◽  
Video Signal ◽  
Video Encoding ◽  
Video Monitoring ◽  
Time Requirement ◽  
The Real ◽  
Monitoring Platform

To solve the difficulty of traditional video monitoring system in system upgrade and expansion, an solution of embedded video monitoring system based on DaVinci technology was put forward in this paper. By building the monitoring platform by DM6437 and DSP/BIOS in the solution, TVP5151 was used for receiving video signal in PAL/NTSC formats, and an JPEG Baseline Profile Encoder was integrated for video encoding, and the 10/100M Ethernet transmission function was realized based on NDK. Finally, the system is tested and the result shows that the system can capture and transmit D1 format signal in 25f/s and met the real-time requirement. At the same time, the system is easy to use and expand with a bright application prospect.

scholarly journals Cross-Layer Framework for Multiuser Real Time H.264/AVC Video Encoding and Transmission over Block Fading MIMO Channels Using Outage Probability

2014 ◽  
Vol 2014 ◽  
pp. 1-10 ◽  
Author(s):  
Slavche Pejoski ◽  
Venceslav Kafedziski
Keyword(s):  
Real Time ◽  
Fading Channels ◽  
Video Transmission ◽  
Single Layer ◽  
Rate Distortion ◽  
Wireless Channel ◽  
Video Encoding ◽  
Cross Layer ◽  
Mimo Channels ◽  
Channel Errors

We present a framework for cross-layer optimized real time multiuser encoding of video using a single layer H.264/AVC and transmission over MIMO wireless channels. In the proposed cross-layer adaptation, the channel of every user is characterized by the probability density function of its channel mutual information and the performance of the H.264/AVC encoder is modeled by a rate distortion model that takes into account the channel errors. These models are used during the resource allocation of the available slots in a TDMA MIMO communication system with capacity achieving channel codes. This framework allows for adaptation to the statistics of the wireless channel and to the available resources in the system and utilization of the multiuser diversity of the transmitted video sequences. We show the effectiveness of the proposed framework for video transmission over Rayleigh MIMO block fading channels, when channel distribution information is available at the transmitter.

Implementation of H.263 real-time video encoding based on DSP

2002 ◽  
Author(s):  
Feng Liu ◽  
XiuChang Zhu ◽  
Dong Hu
Keyword(s):  
Real Time ◽  
Video Encoding

Exploring high-order adder compressors for power reduction in sum of absolute differences architectures for real-time UHD video encoding

2020 ◽  
Vol 17 (5) ◽  
pp. 1735-1754
Author(s):  
Guilherme Paim ◽  
Gustavo M. Santana ◽  
Brunno A. Abreu ◽  
Leandro M. G. Rocha ◽  
Mateus Grellert ◽  
...  
Keyword(s):  
Real Time ◽  
Power Reduction ◽  
High Order ◽  
Video Encoding
Sign in / Sign up

Export Citation Format

Share Document