FPGA implementation of a neural network for a real-time hand tracking system

2003 ◽  
Author(s):  
M. Krips ◽  
T. Lammert ◽  
A. Kummert
Keyword(s):  
Neural Network ◽  
Real Time ◽  
Tracking System ◽  
Fpga Implementation ◽  
Hand Tracking

scholarly journals Real-time object tracking system based on field-programmable gate array and convolution neural network

2016 ◽  
Vol 14 (1) ◽  
pp. 172988141668270 ◽  
Author(s):  
Congyi Lyu ◽  
Haoyao Chen ◽  
Xin Jiang ◽  
Peng Li ◽  
Yunhui Liu
Keyword(s):  
Neural Network ◽  
Image Processing ◽  
Object Tracking ◽  
Real Time ◽  
Field Programmable Gate Array ◽  
Tracking System ◽  
Convolution Neural Network ◽  
Processing Unit ◽  
Field Programmable ◽  
Gate Array

Vision-based object tracking has lots of applications in robotics, like surveillance, navigation, motion capturing, and so on. However, the existing object tracking systems still suffer from the challenging problem of high computation consumption in the image processing algorithms. The problem can prevent current systems from being used in many robotic applications which have limitations of payload and power, for example, micro air vehicles. In these applications, the central processing unit- or graphics processing unit-based computers are not good choices due to the high weight and power consumption. To address the problem, this article proposed a real-time object tracking system based on field-programmable gate array, convolution neural network, and visual servo technology. The time-consuming image processing algorithms, such as distortion correction, color space convertor, and Sobel edge, Harris corner features detector, and convolution neural network were redesigned using the programmable gates in field-programmable gate array. Based on the field-programmable gate array-based image processing, an image-based visual servo controller was designed to drive a two degree of freedom manipulator to track the target in real time. Finally, experiments on the proposed system were performed to illustrate the effectiveness of the real-time object tracking system.

Real Time Artificial Neural Network FPGA Implementation for Triple Coincidences Recovery in PET

2015 ◽  
Vol 62 (3) ◽  
pp. 824-831 ◽  
Author(s):  
Charles Geoffroy ◽  
Jean-Baptiste Michaud ◽  
Marc-Andre Tetrault ◽  
Julien Clerk-Lamalice ◽  
Charles-Antoine Brunet ◽  
...  
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Real Time ◽  
Fpga Implementation ◽  
Artificial Neural

scholarly journals Low-cost intelligent surveillance system based on fast CNN

2021 ◽  
Vol 7 ◽  
pp. e402
Author(s):  
Zaid Saeb Sabri ◽  
Zhiyong Li
Keyword(s):  
Neural Network ◽  
Real Time ◽  
Tracking System ◽  
Low Cost ◽  
Saliency Detection ◽  
Detection Algorithm ◽  
Raspberry Pi ◽  
Surveillance Systems ◽  
Single Board Computer ◽  
Computational Systems

Smart surveillance systems are used to monitor specific areas, such as homes, buildings, and borders, and these systems can effectively detect any threats. In this work, we investigate the design of low-cost multiunit surveillance systems that can control numerous surveillance cameras to track multiple objects (i.e., people, cars, and guns) and promptly detect human activity in real time using low computational systems, such as compact or single board computers. Deep learning techniques are employed to detect certain objects to surveil homes/buildings and recognize suspicious and vital events to ensure that the system can alarm officers of relevant events, such as stranger intrusions, the presence of guns, suspicious movements, and identified fugitives. The proposed model is tested on two computational systems, specifically, a single board computer (Raspberry Pi) with the Raspbian OS and a compact computer (Intel NUC) with the Windows OS. In both systems, we employ components, such as a camera to stream real-time video and an ultrasonic sensor to alarm personnel of threats when movement is detected in restricted areas or near walls. The system program is coded in Python, and a convolutional neural network (CNN) is used to perform recognition. The program is optimized by using a foreground object detection algorithm to improve recognition in terms of both accuracy and speed. The saliency algorithm is used to slice certain required objects from scenes, such as humans, cars, and airplanes. In this regard, two saliency algorithms, based on local and global patch saliency detection are considered. We develop a system that combines two saliency approaches and recognizes the features extracted using these saliency techniques with a conventional neural network. The field results demonstrate a significant improvement in detection, ranging between 34% and 99.9% for different situations. The low percentage is related to the presence of unclear objects or activities that are different from those involving humans. However, even in the case of low accuracy, recognition and threat identification are performed with an accuracy of 100% in approximately 0.7 s, even when using computer systems with relatively weak hardware specifications, such as a single board computer (Raspberry Pi). These results prove that the proposed system can be practically used to design a low-cost and intelligent security and tracking system.

Adaptive Kalman Filter Incorporated Eigenhand (AKFIE) for real-time hand tracking system

2014 ◽  
Vol 74 (21) ◽  
pp. 9231-9257 ◽  
Author(s):  
Mohd Shahrimie Mohd Asaari ◽  
Bakhtiar Affendi Rosdi ◽  
Shahrel Azmin Suandi
Keyword(s):  
Kalman Filter ◽  
Real Time ◽  
Tracking System ◽  
Hand Tracking ◽  
Adaptive Kalman Filter
Sign in / Sign up

Export Citation Format

Share Document