scholarly journals Demonstration of a low-crosstalk super multi-view light field display with natural depth cues and smooth motion parallax

2019 ◽  
Vol 27 (23) ◽  
pp. 34442 ◽  
Author(s):  
Peiren Wang ◽  
Xinzhu Sang ◽  
Xunbo Yu ◽  
Xin Gao ◽  
Binbin Yan ◽  
...  
2021 ◽  
Vol 12 (1) ◽  
Author(s):  
John You En Chan ◽  
Qifeng Ruan ◽  
Menghua Jiang ◽  
Hongtao Wang ◽  
Hao Wang ◽  
...  

AbstractA light field print (LFP) displays three-dimensional (3D) information to the naked-eye observer under ambient white light illumination. Changing perspectives of a 3D image are seen by the observer from varying angles. However, LFPs appear pixelated due to limited resolution and misalignment between their lenses and colour pixels. A promising solution to create high-resolution LFPs is through the use of advanced nanofabrication techniques. Here, we use two-photon polymerization lithography as a one-step nanoscale 3D printer to directly fabricate LFPs out of transparent resin. This approach produces simultaneously high spatial resolution (29–45 µm) and high angular resolution (~1.6°) images with smooth motion parallax across 15 × 15 views. Notably, the smallest colour pixel consists of only a single nanopillar (~300 nm diameter). Our LFP signifies a step towards hyper-realistic 3D images that can be applied in print media and security tags for high-value goods.


2015 ◽  
Vol 23 (20) ◽  
pp. 25950 ◽  
Author(s):  
Xunbo Yu ◽  
Xinzhu Sang ◽  
Xin Gao ◽  
Zhidong Chen ◽  
Duo Chen ◽  
...  

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4574
Author(s):  
Joshitha Ravishankar ◽  
Mansi Sharma ◽  
Pradeep Gopalakrishnan

To create a realistic 3D perception on glasses-free displays, it is critical to support continuous motion parallax, greater depths of field, and wider fields of view. A new type of Layered or Tensor light field 3D display has attracted greater attention these days. Using only a few light-attenuating pixelized layers (e.g., LCD panels), it supports many views from different viewing directions that can be displayed simultaneously with a high resolution. This paper presents a novel flexible scheme for efficient layer-based representation and lossy compression of light fields on layered displays. The proposed scheme learns stacked multiplicative layers optimized using a convolutional neural network (CNN). The intrinsic redundancy in light field data is efficiently removed by analyzing the hidden low-rank structure of multiplicative layers on a Krylov subspace. Factorization derived from Block Krylov singular value decomposition (BK-SVD) exploits the spatial correlation in layer patterns for multiplicative layers with varying low ranks. Further, encoding with HEVC eliminates inter-frame and intra-frame redundancies in the low-rank approximated representation of layers and improves the compression efficiency. The scheme is flexible to realize multiple bitrates at the decoder by adjusting the ranks of BK-SVD representation and HEVC quantization. Thus, it would complement the generality and flexibility of a data-driven CNN-based method for coding with multiple bitrates within a single training framework for practical display applications. Extensive experiments demonstrate that the proposed coding scheme achieves substantial bitrate savings compared with pseudo-sequence-based light field compression approaches and state-of-the-art JPEG and HEVC coders.


2020 ◽  
Vol 11 (1) ◽  
pp. 3
Author(s):  
Laura Gonçalves Ribeiro ◽  
Olli J. Suominen ◽  
Ahmed Durmush ◽  
Sari Peltonen ◽  
Emilio Ruiz Morales ◽  
...  

Visual technologies have an indispensable role in safety-critical applications, where tasks must often be performed through teleoperation. Due to the lack of stereoscopic and motion parallax depth cues in conventional images, alignment tasks pose a significant challenge to remote operation. In this context, machine vision can provide mission-critical information to augment the operator’s perception. In this paper, we propose a retro-reflector marker-based teleoperation aid to be used in hostile remote handling environments. The system computes the remote manipulator’s position with respect to the target using a set of one or two low-resolution cameras attached to its wrist. We develop an end-to-end pipeline of calibration, marker detection, and pose estimation, and extensively study the performance of the overall system. The results demonstrate that we have successfully engineered a retro-reflective marker from materials that can withstand the extreme temperature and radiation levels of the environment. Furthermore, we demonstrate that the proposed maker-based approach provides robust and reliable estimates and significantly outperforms a previous stereo-matching-based approach, even with a single camera.


2014 ◽  
Vol 313 ◽  
pp. 146-151 ◽  
Author(s):  
Xunbo Yu ◽  
Xinzhu Sang ◽  
Shujun Xing ◽  
Tianqi Zhao ◽  
Duo Chen ◽  
...  

2018 ◽  
Author(s):  
Reuben Rideaux ◽  
William J Harrison

ABSTRACTDiscerning objects from their surrounds (i.e., figure-ground segmentation) in a way that guides adaptive behaviours is a fundamental task of the brain. Neurophysiological work has revealed a class of cells in the macaque visual cortex that may be ideally suited to support this neural computation: border-ownership cells (Zhou, Friedman, & von der Heydt, 2000). These orientation-tuned cells appear to respond conditionally to the borders of objects. A behavioural correlate supporting the existence of these cells in humans was demonstrated using two-dimensional luminance defined objects (von der Heydt, Macuda, & Qiu, 2005). However, objects in our natural visual environments are often signalled by complex cues, such as motion and depth order. Thus, for border-ownership systems to effectively support figure-ground segmentation and object depth ordering, they must have access to information from multiple depth cues with strict depth order selectivity. Here we measure in humans (of both sexes) border-ownership-dependent tilt aftereffects after adapting to figures defined by either motion parallax or binocular disparity. We find that both depth cues produce a tilt aftereffect that is selective for figure-ground depth order. Further, we find the effects of adaptation are transferable between cues, suggesting that these systems may combine depth cues to reduce uncertainty (Bülthoff & Mallot, 1988). These results suggest that border-ownership mechanisms have strict depth order selectivity and access to multiple depth cues that are jointly encoded, providing compelling psychophysical support for their role in figure-ground segmentation in natural visual environments.SIGNIFICANCE STATEMENTSegmenting a visual object from its surrounds is a critical function that may be supported by “border-ownership” neural systems that conditionally respond to object borders. Psychophysical work indicates these systems are sensitive to objects defined by luminance contrast. To effectively support figure-ground segmentation, however, neural systems supporting border-ownership must have access to information from multiple depth cues and depth order selectivity. We measured border-ownership-dependent tilt aftereffects to figures defined by either motion parallax or binocular disparity and found aftereffects for both depth cues. These effects were transferable between cues, but selective for figure-ground depth order. Our results suggest that the neural systems supporting figure-ground segmentation have strict depth order selectivity and access to multiple depth cues that are jointly encoded.


Author(s):  
Martin Böcker ◽  
Detlef Runde ◽  
Lothar Mühlbach

The paper addresses the question whether reproducing motion parallax increases the extent of telepresence in videocommunications. Motion parallax is defined as the change of the view due to the observer's movements. It was hypothesized that reproducing motion parallax (a) leads to more precise depth judgments by providing further depth cues, (b) allows ‘interactive viewing’, i.e. the observer can actively explore the visual scene by changing his/her position, and (c) compensates for stereoscopic “apparent movements”. In a Human Factors study, two videoconferencing set-ups providing motion parallax (one stereoscopic and one monoscopic version) were compared with two set-ups (monoscopic and stereoscopic) without motion parallax. Each set-up was used and rated by 32 subjects. The results supported the hypotheses only in part. Even though there was some evidence for more “spatial presence” and for a greater explorability of the scene through motion parallax, the compensation of apparent movements could not be achieved.


2014 ◽  
Vol 41 (2) ◽  
pp. 0209011
Author(s):  
桑新柱 Sang Xinzhu ◽  
于迅博 Yu Xunbo ◽  
赵天奇 Zhao Tianqi ◽  
邢树军 Xing Shujun ◽  
高鑫 Gao Xin ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document