Effects of frame rate for visualization of dynamic quantitative information in a head-mounted display

Author(s):  
Whang Yee Lai ◽  
H.B.-L. Duh
2020 ◽  
Vol 32 (3) ◽  
pp. 409-421
Author(s):  
Štefica Mrvelj ◽  
Marko Matulin ◽  
Sergo Martirosov

This paper reports on the results of subjective testing of user Quality of Experience (QoE) for omnidirectional video (ODV) streaming quality. The test was conducted among 20 test subjects who watched three ODVs using a Head Mounted Display (HMD) system. The length of the videos was between two and three minutes. The first video was used for training purposes and contained no quality degradations. The quality of the other two ODVs was degraded by manipulating the resolution or by introducing different frame drop patterns. While watching the pre-prepared videos the subjects indicated if they noticed the changes in the quality and then rated it. After watching each video, the subjects completed a separate questionnaire, which evaluated their level of enjoyment and discomfort with the video. The results showed that the degradation of both objective parameters (video resolution and frame rate) impacted the subjects’ perception of quality; however, the impact was somewhat alleviated in ODV which contained dynamic scenes and fast camera movements.


Author(s):  
Thomas Kersten ◽  
Daniel Drenkhan ◽  
Simon Deggim

AbstractTechnological advancements in the area of Virtual Reality (VR) in the past years have the potential to fundamentally impact our everyday lives. VR makes it possible to explore a digital world with a Head-Mounted Display (HMD) in an immersive, embodied way. In combination with current tools for 3D documentation, modelling and software for creating interactive virtual worlds, VR has the means to play an important role in the conservation and visualisation of cultural heritage (CH) for museums, educational institutions and other cultural areas. Corresponding game engines offer tools for interactive 3D visualisation of CH objects, which makes a new form of knowledge transfer possible with the direct participation of users in the virtual world. However, to ensure smooth and optimal real-time visualisation of the data in the HMD, VR applications should run at 90 frames per second. This frame rate is dependent on several criteria including the amount of data or number of dynamic objects. In this contribution, the performance of a VR application has been investigated using different digital 3D models of the fortress Al Zubarah in Qatar with various resolutions. We demonstrate the influence on real-time performance by the amount of data and the hardware equipment and that developers of VR applications should find a compromise between the amount of data and the available computer hardware, to guarantee a smooth real-time visualisation with approx. 90 fps (frames per second). Therefore, CAD models offer a better performance for real-time VR visualisation than meshed models due to the significant reduced data volume.


Symmetry ◽  
2020 ◽  
Vol 12 (9) ◽  
pp. 1491
Author(s):  
Rabia Shafi ◽  
Wan Shuai ◽  
Muhammad Usman Younus

360-degree video streaming is expected to grow as the next disruptive innovation due to the ultra-high network bandwidth (60–100 Mbps for 6k streaming), ultra-high storage capacity, and ultra-high computation requirements. Video consumers are more interested in the immersive experience instead of conventional broadband televisions. The visible area (known as user’s viewport) of the video is displayed through Head-Mounted Display (HMD) with a very high frame rate and high resolution. Delivering the whole 360-degree frames in ultra-high-resolution to the end-user significantly adds pressure to the service providers’ overall intention. This paper surveys 360-degree video streaming by focusing on different paradigms from capturing to display. It overviews different projections, compression, and streaming techniques that either incorporate the visual features or spherical characteristics of 360-degree video. Next, the latest ongoing standardization efforts for enhanced degree-of-freedom immersive experience are presented. Furthermore, several 360-degree audio technologies and a wide range of immersive applications are consequently deliberated. Finally, some significant research challenges and implications in the immersive multimedia environment are presented and explained in detail.


Sensors ◽  
2021 ◽  
Vol 21 (14) ◽  
pp. 4769
Author(s):  
Cristina Palmero ◽  
Abhishek Sharma ◽  
Karsten Behrendt ◽  
Kapil Krishnakumar ◽  
Oleg V. Komogortsev ◽  
...  

This paper summarizes the OpenEDS 2020 Challenge dataset, the proposed baselines, and results obtained by the top three winners of each competition: (1) Gaze prediction Challenge, with the goal of predicting the gaze vector 1 to 5 frames into the future based on a sequence of previous eye images, and (2) Sparse Temporal Semantic Segmentation Challenge, with the goal of using temporal information to propagate semantic eye labels to contiguous eye image frames. Both competitions were based on the OpenEDS2020 dataset, a novel dataset of eye-image sequences captured at a frame rate of 100 Hz under controlled illumination, using a virtual-reality head-mounted display with two synchronized eye-facing cameras. The dataset, which we make publicly available for the research community, consists of 87 subjects performing several gaze-elicited tasks, and is divided into 2 subsets, one for each competition task. The proposed baselines, based on deep learning approaches, obtained an average angular error of 5.37 degrees for gaze prediction, and a mean intersection over union score (mIoU) of 84.1% for semantic segmentation. The winning solutions were able to outperform the baselines, obtaining up to 3.17 degrees for the former task and 95.2% mIoU for the latter.


1997 ◽  
Vol 6 (6) ◽  
pp. 630-637 ◽  
Author(s):  
Benjamin Watson ◽  
Neff Walker ◽  
Larry F. Hodges ◽  
Martin Reddy

A paradigm for the design of systems that manage level of detail in virtual environments is proposed. As an example of the prototyping step in this paradigm, a user study was performed to evaluate the effectiveness of high-detail insets used with head-mounted displays. Ten subjects were given a simple search task that required the location and identification of a single target object. All subjects used seven different displays (the independent variable), varying in inset size and peripheral detail, to perform this task Frame rate, target location, subject input method, and order of display use were all controlled. Primary dependent measures were search time on trials with correct identification, and the percentage of all trials correctly identified. ANOVAs of the results showed that insetless, high-detail displays did not lead to significantly different search times or accuracies than displays with insets. In fact, only the insetless, low-detail display returned significantly different results. Further research is being performed to examine the effect of varying task complexity, inset size, and level of detail.


1965 ◽  
Vol 5 ◽  
pp. 120-130
Author(s):  
T. S. Galkina

It is necessary to have quantitative estimates of the intensity of lines (both absorption and emission) to obtain the physical parameters of the atmosphere of components.Some years ago at the Crimean observatory we began the spectroscopic investigation of close binary systems of the early spectral type with components WR, Of, O, B to try and obtain more quantitative information from the study of the spectra of the components.


Author(s):  
J.N. Chapman ◽  
P.E. Batson ◽  
E.M. Waddell ◽  
R.P. Ferrier

By far the most commonly used mode of Lorentz microscopy in the examination of ferromagnetic thin films is the Fresnel or defocus mode. Use of this mode in the conventional transmission electron microscope (CTEM) is straightforward and immediately reveals the existence of all domain walls present. However, if such quantitative information as the domain wall profile is required, the technique suffers from several disadvantages. These include the inability to directly observe fine image detail on the viewing screen because of the stringent illumination coherence requirements, the difficulty of accurately translating part of a photographic plate into quantitative electron intensity data, and, perhaps most severe, the difficulty of interpreting this data. One solution to the first-named problem is to use a CTEM equipped with a field emission gun (FEG) (Inoue, Harada and Yamamoto 1977) whilst a second is to use the equivalent mode of image formation in a scanning transmission electron microscope (STEM) (Chapman, Batson, Waddell, Ferrier and Craven 1977), a technique which largely overcomes the second-named problem as well.


Author(s):  
Jerrold L. Abraham

Inorganic particulate material of diverse types is present in the ambient and occupational environment, and exposure to such materials is a well recognized cause of some lung disease. To investigate the interaction of inhaled inorganic particulates with the lung it is necessary to obtain quantitative information on the particulate burden of lung tissue in a wide variety of situations. The vast majority of diagnostic and experimental tissue samples (biopsies and autopsies) are fixed with formaldehyde solutions, dehydrated with organic solvents and embedded in paraffin wax. Over the past 16 years, I have attempted to obtain maximal analytical use of such tissue with minimal preparative steps. Unique diagnostic and research data result from both qualitative and quantitative analyses of sections. Most of the data has been related to inhaled inorganic particulates in lungs, but the basic methods are applicable to any tissues. The preparations are primarily designed for SEM use, but they are stable for storage and transport to other laboratories and several other instruments (e.g., for SIMS techniques).


Author(s):  
R.D. Leapman ◽  
S.B. Andrews

Elemental mapping of biological specimens by electron energy loss spectroscopy (EELS) can be carried out both in the scanning transmission electron microscope (STEM), and in the energy-filtering transmission electron microscope (EFTEM). Choosing between these two approaches is complicated by the variety of specimens that are encountered (e.g., cells or macromolecules; cryosections, plastic sections or thin films) and by the range of elemental concentrations that occur (from a few percent down to a few parts per million). Our aim here is to consider the strengths of each technique for determining elemental distributions in these different types of specimen.On one hand, it is desirable to collect a parallel EELS spectrum at each point in the specimen using the ‘spectrum-imaging’ technique in the STEM. This minimizes the electron dose and retains as much quantitative information as possible about the inelastic scattering processes in the specimen. On the other hand, collection times in the STEM are often limited by the detector read-out and by available probe current. For example, a 256 x 256 pixel image in the STEM takes at least 30 minutes to acquire with read-out time of 25 ms. The EFTEM is able to collect parallel image data using slow-scan CCD array detectors from as many as 1024 x 1024 pixels with integration times of a few seconds. Furthermore, the EFTEM has an available beam current in the µA range compared with just a few nA in the STEM. Indeed, for some applications this can result in a factor of ~100 shorter acquisition time for the EFTEM relative to the STEM. However, the EFTEM provides much less spectral information, so that the technique of choice ultimately depends on requirements for processing the spectrum at each pixel (viz., isolated edges vs. overlapping edges, uniform thickness vs. non-uniform thickness, molar vs. millimolar concentrations).


Author(s):  
P. G. Kotula ◽  
D. D. Erickson ◽  
C. B. Carter

High-resolution field-emission-gun scanning electron microscopy (FESEM) has recently emerged as an extremely powerful method for characterizing the micro- or nanostructure of materials. The development of high efficiency backscattered-electron detectors has increased the resolution attainable with backscattered-electrons to almost that attainable with secondary-electrons. This increased resolution allows backscattered-electron imaging to be utilized to study materials once possible only by TEM. In addition to providing quantitative information, such as critical dimensions, SEM is more statistically representative. That is, the amount of material that can be sampled with SEM for a given measurement is many orders of magnitude greater than that with TEM.In the present work, a Hitachi S-900 FESEM (operating at 5kV) equipped with a high-resolution backscattered electron detector, has been used to study the α-Fe2O3 enhanced or seeded solid-state phase transformations of sol-gel alumina and solid-state reactions in the NiO/α-Al2O3 system. In both cases, a thin-film cross-section approach has been developed to facilitate the investigation. Specifically, the FESEM allows transformed- or reaction-layer thicknesses along interfaces that are millimeters in length to be measured with a resolution of better than 10nm.


Sign in / Sign up

Export Citation Format

Share Document