Color-Aware Packet Marking Based on H.264AVC Coder Extensions for Improved Video Quality

2014 ◽  
Vol 19 (2-3) ◽  
pp. 127-140
Author(s):  
Slawomir Przylucki

Abstract In recent years there is a noticeable trend to implement the video transmission systems based on shared IP networks. At the same time new generations of video codecs such as H.264 are used in industrial installations. This situation forces the need for consideration of methods for efficient video transmission in industrial networks such as surveillance, identification and control systems. The first part of the article discusses the features of modern video codecs, relevant to the streaming applications. Attention is focused on the extensions of the H.264 standard that increase the error-resilience, particularly Data Partitioning (DP) and Flexible Macroblock Ordering (FMO). Next, the principles of prioritization of the video traffic based on the DiffServ architecture is discussed. In this context, separated section presents in detail the rules for packets marking which enable appropriate forwarding the video data. This information is referenced to current recommendations and technical standards. Next the performance of several classical packet marking algorithms and their possible modifications using FMO- and DP-based errorresilience configurations of H.264 are verified in simulations.

Stroke ◽  
2016 ◽  
Vol 47 (suppl_1) ◽  
Author(s):  
Jason M Lippman ◽  
Zachary G Sutton ◽  
Timothy L McMurry ◽  
Brian Gunnell ◽  
Jack Cote ◽  
...  

Introduction: In-ambulance use of remote videoconferencing for prehospital stroke assessment (mobile telestroke) is an emerging innovation in acute stroke care. As a new technology, there is a dearth of technical standards to ensure transmission quality and guide deployment in various EMS settings. Hypothesis: Subjective video quality ratings during in-vehicle mobile telestroke assessment correlate to objective video data transmission metrics. Methods: We performed videoconferencing via a low-cost, utilitarian mobile telestroke platform: tablet endpoint, high-speed 4G LTE modem, external antennae, HIPAA-secure videoconferencing application, and portable bracket mounting. We held test calls along typical ambulance routes recording transmission quality by a stationary and a mobile rater. We used a standardized 6-point scale of video quality: rating ≥ 4 deemed acceptable for mobile telestroke assessment. We recorded jitter, the variance in transmission data reception order, as simultaneously reported by the videoconferencing application. Results: We completed five test runs yielding 64 data ratings. Average jitter for ratings 1 through 6 was 434.9ms (SD = 407), 106.1ms (SD = 110), 41.4ms (SD = 29), 35.3ms (SD = 15), 29.5ms (SD = 6), and 29.0ms (SD = 2) respectively. Analyzing the raw data yielded an R2 of 0.41. As seen in Chart 1, video quality decreased as average jitter increased, but jitter values as low as 30ms were still seen across video transmission of all qualities. Conclusion: These preliminary data suggest modest correlation of transmission variance with subjective quality ratings using a low-cost mobile telestroke platform along rural-based ambulance routes. However, average transmission variance correlated highly (R2 = 0.93) suggesting more data ratings may improve the correlation. Testing of our mobile telestroke platform to assess performance and clinical efficacy as well as incorporate live acute stroke encounters is ongoing.


2019 ◽  
Vol 17 (6) ◽  
pp. 2047-2063
Author(s):  
Taha T. Alfaqheri ◽  
Abdul Hamid Sadka

AbstractTransmission of high-resolution compressed video on unreliable transmission channels with time-varying characteristics such as wireless channels can adversely affect the decoded visual quality at the decoder side. This task becomes more challenging when the video codec computational complexity is an essential factor for low delay video transmission. High-efficiency video coding (H.265|HEVC) standard is the most recent video coding standard produced by ITU-T and ISO/IEC organisations. In this paper, a robust error resilience algorithm is proposed to reduce the impact of erroneous H.265|HEVC bitstream on the perceptual video quality at the decoder side. The proposed work takes into consideration the compatibility of the algorithm implementations with and without feedback channel update. The proposed work identifies and locates the frame’s most sensitive areas to errors and encodes them in intra mode. The intra-refresh map is generated at the encoder by utilising a grey projection method. The conducted experimental work includes testing the codec performance with the proposed work in error-free and error-prone conditions. The simulation results demonstrate that the proposed algorithm works effectively at high packet loss rates. These results come at the cost of a slight increase in the encoding bit rate overhead and computational processing time compared with the default HEVC HM16 reference software.


2020 ◽  
Vol 10 (14) ◽  
pp. 4923
Author(s):  
Zhe Liu ◽  
He Chen ◽  
Songlin Sun

In order to make video transmission more stable, various error-resilient mechanisms are proposed on video coding in the literature. However, the redundancy mechanism behind classical redundant coding algorithms is relatively simple and is not suitable for the network environment and video content in the context of screen content sequence with multiple abrupt frames and still frames. Motivated by this, a frame-level coding selection mechanism is proposed in this paper for the error-resilience transmission of screen content, where additional code stream or redundant information is considered to improve error-resilient performance with redundant coding and acceptable video quality is obtained in the case of frame transmission error. In addition, selective allocation redundancy is conducted to take the importance of the video frame ROI (region of interest) area into account in the co-encoding process. As a result, the redundancy insertion efficiency and the reliability are improved in return. The corresponding experiments validate the effectiveness of the schemes proposed in this paper.


Healthcare ◽  
2021 ◽  
Vol 9 (9) ◽  
pp. 1159
Author(s):  
Jingfang Liu ◽  
Caiying Lu ◽  
Shuangjinhua Lu

(1) Background: During the COVID-19 pandemic, users share and obtain COVID-19 information through video platforms, but only a few COVID-19 videos become popular among most audiences. Therefore, it is a very interesting and important research question to explore the influencing factors of the popularity of COVID-19 videos during the COVID-19 pandemic; (2) Our research collects video data related to the keyword “COVID-19” on video platform, the data are analyzed by content analysis and empirical analysis. We then constructed a theoretical model based on the information adoption model; (3) A total of 251 videos were divided into three categories. The least common category was the data and analysis category (11.2%), followed by the prevention and control status category (13.5%); the knowledge and general science category was the most common (75.3%). From the perspective of video quality, the information sources of most videos are relatively reliable, and the content of medical information is low. The research results showed that short video lengths, longer descriptions, more reliable video sources and lower medical information content were more popular with audiences. Audiences are more likely to be attracted to videos in the prevention and control status category and knowledge and general science category. Videos uploaded by uploaders who have a higher influence are more popular with audiences; (4) Conclusion: During the COVID-19 pandemic, information quality (video length, description length, video content type, and medical information and content index) and source credibility (information source reliability, influence and certification type) all significantly influence the popularity level of COVID-19 videos. Our research conclusions can provide management suggestions for the platform, make videos released by uploaders more popular with audiences, and help audiences better understand COVID-19 information and make prevention and control efforts.


2012 ◽  
Vol 2012 ◽  
pp. 1-11 ◽  
Author(s):  
Laith Al-Jobouri ◽  
Martin Fleury ◽  
Mohammed Ghanbari

Broadband wireless technology, though aimed at video services, also poses a potential threat to video services, as wireless channels are prone to error bursts. In this paper, an adaptive, application-layer Forward Error Correction (FEC) scheme protects H.264/AVC data-partitioned video. Data partitioning is the division of a compressed video stream into partitions of differing decoding importance. The paper determines whether equal error protection (EEP) through FEC of all partition types or unequal error protection (UEP) of the more important partition type is preferable. The paper finds that, though UEP offers a small reduction in bitrate, if EEP is employed, there are significant gains (several dBs) in video quality. Overhead from using EEP rather than UEP was found to be around 1% of the overall bitrate. Given that data partitioning already reduces errors through packet size reduction and differentiation of coding data, EEP with data partitioning is a practical means of protecting user-based video streaming. The gain from employing EEP is shown to be higher quality video to the user, which will result in a greater take-up of video services. The results have implications for other forms of prioritized video streaming.


Author(s):  
Ismail Ali ◽  
Sandro Moiron ◽  
Martin Fleury ◽  
Mohammed Ghanbari

Intra-refresh macroblocks and data partitioning are two error-resilience tools aimed at video streaming over wireless networks. Intra-refresh macroblocks avoids the repetitive delays associated with periodic intra-coded frames, while also arresting temporal error propagation. Data-partitioning divides a compressed data stream according to the data importance, allowing packet prioritization schemes to be designed. This chapter reviews these and other error-resilience tools from the H.264 codec. As an illustration of the use of these tools, the chapter demonstrates a wireless access scheme that selectively drops packets that carry intra-refresh macroblocks. This counter-intuitive scheme actually results in better video quality than if packets containing transform coefficients were to be selectively dropped. Dropping only occurs when in the presence of wireless network congestion, as at other times the intra-coded macroblocks protect the video against random bit errors. Any packet dropping takes place under IEEE 802.11e, which is a quality-of-service addition to the IEEE 802.11 standard for wireless LANs. The chapter shows that, by this scheme, when congestion occurs, it is possible to gain up to 2 dB in video quality over assigning a stream to a single IEEE 802.11e access category. The scheme is shown to be consistently advantageous in indoor and outdoor wireless scenarios over other ways of assigning the partitioned data packets to different access categories. The chapter also contains a review of other research ideas using intra-refresh macroblocks and data-partitioning, as well as a look at the research outlook, now that the High Efficiency Video Codec (HEVC) has been released.


2009 ◽  
Vol 2009 ◽  
pp. 1-7 ◽  
Author(s):  
Marie Ramon ◽  
François-Xavier Coudoux ◽  
Marc Gazalet

Systematic lossy error protection (SLEP) is a robust error resilient mechanism based on principles of Wyner-Ziv (WZ) coding for video transmission over error-prone networks. In an SLEP scheme, the video bitstream is separated into two parts: a systematic part consisting of a video sequence transmitted without channel coding, and additional information consisting of a WZ supplementary stream. This paper presents an adaptive SLEP scheme in which the WZ stream is obtained by frequency filtering in the transform domain. Additionally, error resilience varies adaptively depending on the characteristics of compressed video. We show that the proposed SLEP architecture achieves graceful degradation of reconstructed video quality in the presence of increasing transmission errors. Moreover, it provides good performances in terms of error protection as well as reconstructed video quality if compared to solutions based on coarser quantization, while offering an interesting embedded scheme to apply digital video format conversion.


Author(s):  
Martin Fleury ◽  
Laith Al-Jobouri

Data partitioning is a source-coding technique that has existed in one form or another in the standardized hybrid video codecs up to recent times. In essence, it is a method of prioritizing coding data, resulting in video layers that can be separately communicated across an error-prone network. The Chapter includes the background that has led to data partitioning being included in the standardized codecs. As this Chapter discusses, it differs from scalable video because the output from conventional, single-layer encoders can be converted to multi-layer form, rather than requiring specialist codec extensions. It is shown that the methods of forming the partitions so far employed are: dividing transformed, residual coefficients into two or more layers; and dividing coded data by function into headers, intra-, and inter-coded residuals to form three or more layers. It is also shown how layering naturally combines with protection by channel coding. Used as an error resilience tool, data partitioning presents a low overhead method, suitable for benign as well as bad channels. And in the three-layer variety, error concealment at the decoder can significantly aid the reconstruction of damaged video frames. The Chapter will be of particular interest to developers charged with making a mobile, low-latency, or interactive video streaming application robust, as they can select from the data-partitioning methods and apply them to open-source code of the recent High Efficiency Video Coding (HEVC) codec standard. Broadcast TV can also benefit from data partitioning. Developers of codecs additionally will find in this Chapter a guide to research and ideas about data partitioning which could be incorporated into future codecs.


Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4589
Author(s):  
Janusz Klink

Finding a proper balance between video quality and the required bandwidth is an important issue, especially in networks of limited capacity. The problem of comparing the efficiency of video codecs and choosing the most suitable one in a specific situation has become very important. This paper proposes a method of comparing video codecs while also taking into account objective quality assessment metrics. The author shows the process of preparing video footage, assessing its quality, determining the rate–distortion curves, and calculating the bitrate saving for pairs of examined codecs. Thanks to the use of the spline interpolation method, the obtained results are better than those previously presented in the literature, and more resistant to the quality metric used.


2019 ◽  
Vol 9 (10) ◽  
pp. 2003 ◽  
Author(s):  
Tung-Ming Pan ◽  
Kuo-Chin Fan ◽  
Yuan-Kai Wang

Intelligent analysis of surveillance videos over networks requires high recognition accuracy by analyzing good-quality videos that however introduce significant bandwidth requirement. Degraded video quality because of high object dynamics under wireless video transmission induces more critical issues to the success of smart video surveillance. In this paper, an object-based source coding method is proposed to preserve constant quality of video streaming over wireless networks. The inverse relationship between video quality and object dynamics (i.e., decreasing video quality due to the occurrence of large and fast-moving objects) is characterized statistically as a linear model. A regression algorithm that uses robust M-estimator statistics is proposed to construct the linear model with respect to different bitrates. The linear model is applied to predict the bitrate increment required to enhance video quality. A simulated wireless environment is set up to verify the proposed method under different wireless situations. Experiments with real surveillance videos of a variety of object dynamics are conducted to evaluate the performance of the method. Experimental results demonstrate significant improvement of streaming videos relative to both visual and quantitative aspects.


Sign in / Sign up

Export Citation Format

Share Document