scholarly journals Computational Large Field-of-View RGB-D Integral Imaging System

Sensors ◽  
2021 ◽  
Vol 21 (21) ◽  
pp. 7407
Author(s):  
Geunho Jung ◽  
Yong-Yuk Won ◽  
Sang Min Yoon

The integral imaging system has received considerable research attention because it can be applied to real-time three-dimensional image displays with a continuous view angle without supplementary devices. Most previous approaches place a physical micro-lens array in front of the image, where each lens looks different depending on the viewing angle. A computational integral imaging system with a virtual micro-lens arrays has been proposed in order to provide flexibility for users to change micro-lens arrays and focal length while reducing distortions due to physical mismatches with the lens arrays. However, computational integral imaging methods only represent part of the whole image because the size of virtual lens arrays is much smaller than the given large-scale images when dealing with large-scale images. As a result, the previous approaches produce sub-aperture images with a small field of view and need additional devices for depth information to apply to integral imaging pickup systems. In this paper, we present a single image-based computational RGB-D integral imaging pickup system for a large field of view in real time. The proposed system comprises three steps: deep learning-based automatic depth map estimation from an RGB input image without the help of an additional device, a hierarchical integral imaging system for a large field of view in real time, and post-processing for optimized visualization of the failed pickup area using an inpainting method. Quantitative and qualitative experimental results verify the proposed approach’s robustness.

2011 ◽  
Vol 18 (4) ◽  
pp. 569-574 ◽  
Author(s):  
Masato Hoshino ◽  
Kentaro Uesugi ◽  
James Pearson ◽  
Takashi Sonobe ◽  
Mikiyasu Shirai ◽  
...  

An X-ray stereo imaging system with synchrotron radiation was developed at BL20B2, SPring-8. A portion of a wide X-ray beam was Bragg-reflected by a silicon crystal to produce an X-ray beam which intersects with the direct X-ray beam. Samples were placed at the intersection point of the two beam paths. X-ray stereo images were recorded simultaneously by a detector with a large field of view placed close to the sample. A three-dimensional wire-frame model of a sample was created from the depth information that was obtained from the lateral positions in the stereo image. X-ray stereo angiography of a mouse femoral region was performed as a demonstration of real-time stereo imaging. Three-dimensional arrangements of the femur and blood vessels were obtained.


2020 ◽  
Vol 49 (8) ◽  
pp. 20200005-20200005
Author(s):  
陈炳旭 Bingxu Chen ◽  
廖志远 Zhiyuan Liao ◽  
操超 Chao Cao ◽  
白瑜 Yu Bai ◽  
牟达 Da Mu

Author(s):  
Hongli Wang ◽  
Bin Guo ◽  
Jiaqi Liu ◽  
Sicong Liu ◽  
Yungang Wu ◽  
...  

Deep Neural Networks (DNNs) have made massive progress in many fields and deploying DNNs on end devices has become an emerging trend to make intelligence closer to users. However, it is challenging to deploy large-scale and computation-intensive DNNs on resource-constrained end devices due to their small size and lightweight. To this end, model partition, which aims to partition DNNs into multiple parts to realize the collaborative computing of multiple devices, has received extensive research attention. To find the optimal partition, most existing approaches need to run from scratch under given resource constraints. However, they ignore that resources of devices (e.g., storage, battery power), and performance requirements (e.g., inference latency), are often continuously changing, making the optimal partition solution change constantly during processing. Therefore, it is very important to reduce the tuning latency of model partition to realize the real-time adaption under the changing processing context. To address these problems, we propose the Context-aware Adaptive Surgery (CAS) framework to actively perceive the changing processing context, and adaptively find the appropriate partition solution in real-time. Specifically, we construct the partition state graph to comprehensively model different partition solutions of DNNs by import context resources. Then "the neighbor effect" is proposed, which provides the heuristic rule for the search process. When the processing context changes, CAS adopts the runtime search algorithm, Graph-based Adaptive DNN Surgery (GADS), to quickly find the appropriate partition that satisfies resource constraints under the guidance of the neighbor effect. The experimental results show that CAS realizes adaptively rapid tuning of the model partition solutions in 10ms scale even for large DNNs (2.25x to 221.7x search time improvement than the state-of-the-art researches), and the total inference latency still keeps the same level with baselines.


2020 ◽  
Vol 49 (3) ◽  
pp. 314002-314002
Author(s):  
单秋莎 Qiusha Shan ◽  
苏秀琴 Xiuqin Su ◽  
段晶 Jing Duan ◽  
周亮 Liang Zhou ◽  
刘凯 Kai Liu ◽  
...  

2019 ◽  
Vol 16 (6) ◽  
pp. 172988141989351
Author(s):  
Xi Zhang ◽  
Yuanzhi Xu ◽  
Haichao Li ◽  
Lijing Zhu ◽  
Xin Wang ◽  
...  

For the purpose of obtaining high-precision in stereo vision calibration, a large-size precise calibration target, which can cover more than half of the field of view is vital. However, large-scale calibration targets are very difficult to fabricate. Based on the idea of error tracing, a high-precision calibration method for vision system with large field of view by constructing a virtual 3-D calibration target with a laser tracker was proposed in this article. A virtual 3-D calibration target that covers the whole measurement space can be established flexibly and the measurement precision of the vision system can be traceable to the laser tracker. First, virtual 3-D targets by calculating rigid body transformation with unit quaternion method were constructed. Then, the high-order distortion camera model was taken into consideration. Besides, the calibration parameters were solved with Levenberg–Marquardt optimization algorithm. In the experiment, a binocular stereo vision system with the field of view of 4 × 3 × 2 m3 was built for verifying the validity and precision of the proposed calibration method. It is measured that the accuracy with the proposed method can be greatly improved comparing with traditional plane calibration method. The method can be widely used in industrial applications, such as in the field of calibrating large-scale vision-based coordinate metrology, and six-degrees of freedom pose tracking system for dimensional measurement of workpiece, as well as robotics geometrical accuracy detection and compensation.


2014 ◽  
Vol 898 ◽  
pp. 614-617
Author(s):  
Rui Hong Li ◽  
Yue Ping Han

The present paper reviews the X-ray grating imaging systems at home and abroad from the aspects of technological characterizations and the newest researching focus. First, not only the imaging principles and the frameworks of the typical X-ray grating imaging system based on Talbot-Lau interferometry method, but also the algorithms of retrieving the signals of attenuation, refraction and small-angle scattering are introduced. Second, the system optimizing methods are discussed, which involves mainly the relaxing the requirement of high positioning resolution and strict circumstances for gratings and designing large field of view with high resolution. Third, two and four-dimensional grating-based X-ray imaging techniques are introduced.


2017 ◽  
Author(s):  
Md. Ashraful Alam ◽  
Md. Sifatul Islam ◽  
Mohd. Zishan Tareque ◽  
Mahfuze Subhani ◽  
M. Rashidur Rahman Rafi ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document