scholarly journals Joint upsampling and noise reduction for real-time depth map enhancement

2014 ◽  
Author(s):  
Kazuki Matsumoto ◽  
Chiyoung Song ◽  
Francois de Sorbier ◽  
Hideo Saito
Keyword(s):  
Noise Reduction ◽  
Real Time ◽  
Depth Map

scholarly journals A Residual Network and FPGA Based Real-Time Depth Map Enhancement System

Entropy ◽  
2021 ◽  
Vol 23 (5) ◽  
pp. 546
Author(s):  
Zhenni Li ◽  
Haoyi Sun ◽  
Yuliang Gao ◽  
Jiao Wang
Keyword(s):  
Real Time ◽  
Super Resolution ◽  
Depth Map ◽  
Acquisition System ◽  
Depth Image ◽  
Fpga Design ◽  
Depth Sensing ◽  
Residual Network ◽  
Real Time Processing ◽  
Depth Maps

Depth maps obtained through sensors are often unsatisfactory because of their low-resolution and noise interference. In this paper, we propose a real-time depth map enhancement system based on a residual network which uses dual channels to process depth maps and intensity maps respectively and cancels the preprocessing process, and the algorithm proposed can achieve real-time processing speed at more than 30 fps. Furthermore, the FPGA design and implementation for depth sensing is also introduced. In this FPGA design, intensity image and depth image are captured by the dual-camera synchronous acquisition system as the input of neural network. Experiments on various depth map restoration shows our algorithms has better performance than existing LRMC, DE-CNN and DDTF algorithms on standard datasets and has a better depth map super-resolution, and our FPGA completed the test of the system to ensure that the data throughput of the USB 3.0 interface of the acquisition system is stable at 226 Mbps, and support dual-camera to work at full speed, that is, 54 fps@ (1280 × 960 + 328 × 248 × 3).

scholarly journals Stochastic-Depth Ambient Occlusion

2021 ◽  
Vol 4 (1) ◽  
pp. 1-15
Author(s):  
Jop Vermeer ◽  
Leonardo Scandolo ◽  
Elmar Eisemann
Keyword(s):  
Real Time ◽  
High Performance ◽  
Depth Map ◽  
Visual Quality ◽  
Ambient Light ◽  
Missing Information ◽  
Time Performance ◽  
Ambient Occlusion ◽  
Depth Buffer ◽  
Screen Space

Ambient occlusion (AO) is a popular rendering technique that enhances depth perception and realism by darkening locations that are less exposed to ambient light (e.g., corners and creases). In real-time applications, screen-space variants, relying on the depth buffer, are used due to their high performance and good visual quality. However, these only take visible surfaces into account, resulting in inconsistencies, especially during motion. Stochastic-Depth Ambient Occlusion is a novel AO algorithm that accounts for occluded geometry by relying on a stochastic depth map, capturing multiple scene layers per pixel at random. Hereby, we efficiently gather missing information in order to improve upon the accuracy and spatial stability of conventional screen-space approximations, while maintaining real-time performance. Our approach integrates well into existing rendering pipelines and improves the robustness of many different AO techniques, including multi-view solutions.

scholarly journals Robust hand gesture recognition using multiple shape-oriented visual cues

2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Samy Bakheet ◽  
Ayoub Al-Hamadi
Keyword(s):  
Real Time ◽  
Gesture Recognition ◽  
Pose Estimation ◽  
Depth Map ◽  
Hand Gesture Recognition ◽  
Support Vector ◽  
Hand Gesture ◽  
Hand Pose Estimation ◽  
Time Operation ◽  
Hand Pose

AbstractRobust vision-based hand pose estimation is highly sought but still remains a challenging task, due to its inherent difficulty partially caused by self-occlusion among hand fingers. In this paper, an innovative framework for real-time static hand gesture recognition is introduced, based on an optimized shape representation build from multiple shape cues. The framework incorporates a specific module for hand pose estimation based on depth map data, where the hand silhouette is first extracted from the extremely detailed and accurate depth map captured by a time-of-flight (ToF) depth sensor. A hybrid multi-modal descriptor that integrates multiple affine-invariant boundary-based and region-based features is created from the hand silhouette to obtain a reliable and representative description of individual gestures. Finally, an ensemble of one-vs.-all support vector machines (SVMs) is independently trained on each of these learned feature representations to perform gesture classification. When evaluated on a publicly available dataset incorporating a relatively large and diverse collection of egocentric hand gestures, the approach yields encouraging results that agree very favorably with those reported in the literature, while maintaining real-time operation.

scholarly journals Development and Evaluation of Light-Weight Active Noise Cancellation Earphones

2018 ◽  
Vol 8 (7) ◽  
pp. 1178 ◽  
Author(s):  
Sen Kuo ◽  
Yi-Rou Chen ◽  
Cheng-Yuan Chang ◽  
Chien-Wen Lai
Keyword(s):  
Noise Reduction ◽  
Real Time ◽  
Random Noise ◽  
Active Noise Control ◽  
Noise Cancellation ◽  
Experimental Results ◽  
Path Model ◽  
Light Weight ◽  
Active Noise ◽  
Natural Sound

This paper presents the development of active noise control (ANC) for light-weight earphones, and proposes using music or natural sound to estimate the critical secondary path model instead of extra random noise. Three types of light-weight ANC earphones including in-ear, earbud, and clip phones are developed. Real-time experiments are conducted to evaluate their performance using the built-in microphone inside KEMAR’s ear and to compare with commercially-available ANC headphones and earphones. Experimental results show that the developed light-weight ANC earphones achieve higher noise reduction than the commercial ANC headphones and earphones, and the in-ear ANC earphone has the best noise reduction performance.

Particle Swarm Optimization Algorithm with Mutation Operator for Particle Filter Noise Reduction in Mechanical Fault Diagnosis

2020 ◽  
Vol 34 (10) ◽  
pp. 2058012 ◽  
Author(s):  
Hanxin Chen ◽  
Dong Liang Fan ◽  
Lu Fang ◽  
Wenjian Huang ◽  
Jinmin Huang ◽  
...  
Keyword(s):  
Particle Swarm Optimization ◽  
Particle Filter ◽  
Noise Reduction ◽  
Real Time ◽  
Particle Swarm ◽  
Utilization Rate ◽  
Mutation Operator ◽  
Swarm Optimization ◽  
Running Time ◽  
Filter Noise

In this paper, a new particle swarm optimization particle filter (NPSO-PF) algorithm is proposed, which is called particle cluster optimization particle filter algorithm with mutation operator, and is used for real-time filtering and noise reduction of nonlinear vibration signals. Because of its introduction of mutation operator, this algorithm overcomes the problem where by particle swarm optimization (PSO) algorithm easily falls into local optimal value, with a low calculation accuracy. At the same time, the distribution and diversity of particles in the sampling process are improved through the mutation operation. The defect of particle filter (PF) algorithm where the particles are poor and the utilization rate is not high is also solved. The mutation control function makes the particle set optimization process happen in the early and late stages, and improves the convergence speed of the particle set, which greatly reduces the running time of the whole algorithm. Simulation experiments show that compared with PF and PSO-PF algorithms, the proposed NPSO-PF algorithm has lower root mean square error, shorter running time, higher signal-to-noise ratio and more stable filtering performance. It is proved that the algorithm is suitable for real-time filtering and noise reduction processing of nonlinear signals.

Sign in / Sign up

Export Citation Format

Share Document