A Testing Apparatus for Faster and More Accurate Subjective Assessment of Quality of Experience in Cloud Gaming

Author(s):  
Saeed Shafiee Sabet ◽  
Mahmoud Reza Hashemi ◽  
Mohammad Ghanbari
Author(s):  
André F. Marquet ◽  
Jânio M. Monteiro ◽  
Nuno J. Martins ◽  
Mario S. Nunes

In legacy television services, user centric metrics have been used for more than twenty years to evaluate video quality. These subjective assessment metrics are usually obtained using a panel of human evaluators in standard defined methods to measure the impairments caused by a diversity of factors of the Human Visual System (HVS), constituting what is also called Quality of Experience (QoE) metrics. As video services move to IP networks, the supporting distribution platforms and the type of receiving terminals is getting more heterogeneous, when compared with classical video distributions. The flexibility introduced by these new architectures is, at the same time, enabling an increment of the transmitted video quality to higher definitions and is supporting the transmission of video to lower capability terminals, like mobile terminals. In IP Networks, while Quality of Service (QoS) metrics have been consistently used for evaluating the quality of a transmission and provide an objective way to measure the reliability of communication networks for various purposes, QoE metrics are emerging as a solution to address the limitations of conventional QoS measuring when evaluating quality from the service and user point of view. In terms of media, compressed video usually constitutes a very interdependent structure degrading in a non-graceful manner when exposed to Binary Erasure Channels (BEC), like the Internet or wireless networks. Accordingly, not only the type of encoder and its major encoding parameters (e.g. transmission rate, image definition or frame rate) contribute to the quality of a received video, but also QoS parameters are usually a cause for different types of decoding artifacts. As a result of this, several worldwide standard entities have been evaluating new metrics for the subjective assessment of video transmission over IP networks. In this chapter we are especially interested in explaining some of the best practices available to monitor, evaluate and assure good levels of QoE in packet oriented networks for rich media applications like high quality video streaming. For such applications, service requirements are relatively loose or difficult to quantify and therefore specific techniques have to be clearly understood and evaluated. By the mid of the chapter the reader should have understood why even networks with excellent QoS parameters might have QoE issues, as QoE is a systemic approach that does not relate solely to QoS but to the ensemble of components composing the communication system.


2017 ◽  
Vol 9 (3) ◽  
pp. 340-344
Author(s):  
Vytautas Abromavičius

Development of new multimedia technologies allows us to receive better quality of audio and video content. Quality of Experience (QoE) evaluates given content from the consumer’s perspective. This measurement allows to evaluate not only visual and audible quality, but also general acceptability of provided service. QoE evaluation is getting popular between engineers, designers, retailers who wants to provide high quality content for consumers. QoE is generally evaluated subjectively by surveys. It is possible to find relationship between physiological signals measured while user is consuming audiovisual content and make the subjective evaluation of this experience. This paper investigates relationship between heart rate and QoE while user is watching 1 min duration video recordings on three different devices. Heart rate was calculated as mean RR interval for each recording. Mean RR intervals of 0.848 s, 0.869 s and 0.884 s were calculated for low, medium and high QoE device configurations, respectively. ANOVA analysis results indicates a relation between heart rate and QoE level. The results can help to develop further the investigations of QoE level and heart rate relationship for various subjective assessment, device configurations and content provided.


Author(s):  
Milos Ljubojevic ◽  
Vojkan Vaskovic ◽  
Srecko Stankovic ◽  
Jelena Vaskovic

<p>The main objective of this research is to investigate efficiency of use of supplementary video content in multimedia teaching. Integrating video clips in multimedia lecture presentations may increase students’ perception of important information and motivation for learning. Because of that, students can better understand and remember key points of a lecture. Those improvements represent some important learning outcomes. This research showed that segmentation of teaching materials with supplementary video clips may improve lecture organization and presentation in order to achieve effective teaching and learning. The context of the video content and the position of supplementary video clips in teaching material are important influences on factors for motivation and efficiency of learning. This research presents the effects of the use of supplementary videos with different context of content (entertainment and educational) as well as the effects of their position within the teaching material. The experimental results showed that the most efficient method of use of supplementary video is integration with educational video content in the middle of a lecture. This position of video insertion provides the best results. The context of video content influences efficiency of learning also. Entertainment video was not as efficient as educational, but it can be used to engage and motivate students for learning. The given results have been confirmed with a subjective assessment of students’ quality of experience with different methods of embedding video clips.</p>


2019 ◽  
Vol 21 (10) ◽  
pp. 2589-2602 ◽  
Author(s):  
Jing Li ◽  
Lukas Krasula ◽  
Yoann Baveye ◽  
Zhi Li ◽  
Patrick Le Callet

2020 ◽  
Vol 91 (7) ◽  
pp. 592-596
Author(s):  
Quinn Dufurrena ◽  
Kazi Imran Ullah ◽  
Erin Taub ◽  
Connor Leszczuk ◽  
Sahar Ahmad

BACKGROUND: Remotely guided ultrasound (US) examinations carried out by nonmedical personnel (novices) have been shown to produce clinically useful examinations, at least in small pilot studies. Comparison of the quality of such exams to those carried out by trained medical professionals is lacking in the literature. This study compared the objective quality and clinical utility of cardiac and pulmonary US examinations carried out by novices and trained physicians.METHODS: Cardiac and pulmonary US examinations were carried out by novices under remote guidance by an US expert and independently by US trained physicians. Exams were blindly evaluated by US experts for both a task-based objective score as well as a subjective assessment of clinical utility.RESULTS: Participating in the study were 16 novices and 9 physicians. Novices took longer to complete the US exams (median 641.5 s vs. 256 s). For the objective component, novices scored higher in exams evaluating for pneumothorax (100% vs. 87.5%). For the subjective component, novices more often obtained clinically useful exams in the assessment of cardiac regional wall motion abnormalities (56.3% vs. 11.1%). No other comparisons yielded statistically significant differences between the two groups. Both groups had generally higher scores for pulmonary examinations compared to cardiac. There was variability in the quality of exams carried out by novices depending on their expert guide.CONCLUSION: Remotely guided novices are able to carry out cardiac and pulmonary US examinations with similar, if not better, technical proficiency and clinical utility as US trained physicians, though they take longer to do so.Dufurrena Q, Ullah KI, Taub E, Leszczuk C, Ahmad S. Feasibility and clinical implications of remotely guided ultrasound examinations. Aerosp Med Hum Perform. 2020; 91(7):592–596.


2021 ◽  
Vol 20 (3) ◽  
pp. 1-25
Author(s):  
Elham Shamsa ◽  
Alma Pröbstl ◽  
Nima TaheriNejad ◽  
Anil Kanduri ◽  
Samarjit Chakraborty ◽  
...  

Smartphone users require high Battery Cycle Life (BCL) and high Quality of Experience (QoE) during their usage. These two objectives can be conflicting based on the user preference at run-time. Finding the best trade-off between QoE and BCL requires an intelligent resource management approach that considers and learns user preference at run-time. Current approaches focus on one of these two objectives and neglect the other, limiting their efficiency in meeting users’ needs. In this article, we present UBAR, User- and Battery-aware Resource management, which considers dynamic workload, user preference, and user plug-in/out pattern at run-time to provide a suitable trade-off between BCL and QoE. UBAR personalizes this trade-off by learning the user’s habits and using that to satisfy QoE, while considering battery temperature and State of Charge (SOC) pattern to maximize BCL. The evaluation results show that UBAR achieves 10% to 40% improvement compared to the existing state-of-the-art approaches.


IEEE Access ◽  
2021 ◽  
pp. 1-1
Author(s):  
Sajeeb Saha ◽  
Md. Ahsan Habib ◽  
Tamal Adhikary ◽  
Md. Abdur Razzaque ◽  
Md. Mustafizur Rahman ◽  
...  

2021 ◽  
Vol 48 (4) ◽  
pp. 41-44
Author(s):  
Dena Markudova ◽  
Martino Trevisan ◽  
Paolo Garza ◽  
Michela Meo ◽  
Maurizio M. Munafo ◽  
...  

With the spread of broadband Internet, Real-Time Communication (RTC) platforms have become increasingly popular and have transformed the way people communicate. Thus, it is fundamental that the network adopts traffic management policies that ensure appropriate Quality of Experience to users of RTC applications. A key step for this is the identification of the applications behind RTC traffic, which in turn allows to allocate adequate resources and make decisions based on the specific application's requirements. In this paper, we introduce a machine learning-based system for identifying the traffic of RTC applications. It builds on the domains contacted before starting a call and leverages techniques from Natural Language Processing (NLP) to build meaningful features. Our system works in real-time and is robust to the peculiarities of the RTP implementations of different applications, since it uses only control traffic. Experimental results show that our approach classifies 5 well-known meeting applications with an F1 score of 0.89.


2021 ◽  
Vol 48 (4) ◽  
pp. 37-40
Author(s):  
Nikolas Wehner ◽  
Michael Seufert ◽  
Joshua Schuler ◽  
Sarah Wassermann ◽  
Pedro Casas ◽  
...  

This paper addresses the problem of Quality of Experience (QoE) monitoring for web browsing. In particular, the inference of common Web QoE metrics such as Speed Index (SI) is investigated. Based on a large dataset collected with open web-measurement platforms on different device-types, a unique feature set is designed and used to estimate the RUMSI - an efficient approximation to SI, with machinelearning based regression and classification approaches. Results indicate that it is possible to estimate the RUMSI accurately, and that in particular, recurrent neural networks are highly suitable for the task, as they capture the network dynamics more precisely.


Sign in / Sign up

Export Citation Format

Share Document