Accurate and Efficient Gesture Spotting via Pruning and Subgesture Reasoning

2005 ◽  
pp. 189-198 ◽  
Author(s):  
Jonathan Alon ◽  
Vassilis Athitsos ◽  
Stan Sclaroff
Keyword(s):  
Gesture Spotting

scholarly journals Dynamic Gesture Recognition System with Gesture Spotting Based on Self-Organizing Maps

2021 ◽  
Vol 11 (4) ◽  
pp. 1933
Author(s):  
Hiroomi Hikawa ◽  
Yuta Ichikawa ◽  
Hidetaka Ito ◽  
Yutaka Maeda
Keyword(s):  
Real Time ◽  
Gesture Recognition ◽  
Weight Vector ◽  
Recognition System ◽  
Self Organizing Map ◽  
Self Organizing Maps ◽  
Time Dynamic ◽  
System Input ◽  
Self Organizing ◽  
Gesture Spotting

In this paper, a real-time dynamic hand gesture recognition system with gesture spotting function is proposed. In the proposed system, input video frames are converted to feature vectors, and they are used to form a posture sequence vector that represents the input gesture. Then, gesture identification and gesture spotting are carried out in the self-organizing map (SOM)-Hebb classifier. The gesture spotting function detects the end of the gesture by using the vector distance between the posture sequence vector and the winner neuron’s weight vector. The proposed gesture recognition method was tested by simulation and real-time gesture recognition experiment. Results revealed that the system could recognize nine types of gesture with an accuracy of 96.6%, and it successfully outputted the recognition result at the end of gesture using the spotting result.

A Vision-Based Framework for Spotting and Segmentation of Gesture-Based Assamese Characters Written in the Air

2021 ◽  
Vol 14 (1) ◽  
pp. 70-91
Author(s):  
Ananya Choudhury ◽  
Kandarpa Kumar Sarma
Keyword(s):  
Character Recognition ◽  
Hand Gesture ◽  
Automatic Method ◽  
Physical Impairments ◽  
Statistical Feature ◽  
Hand Segmentation ◽  
Character Sequences ◽  
Continuous Character ◽  
Important Constituent ◽  
Gesture Spotting

The task of automatic gesture spotting and segmentation is challenging for determining the meaningful gesture patterns from continuous gesture-based character sequences. This paper proposes a vision-based automatic method that handles hand gesture spotting and segmentation of gestural characters embedded in a continuous character stream simultaneously, by employing a hybrid geometrical and statistical feature set. This framework shall form an important constituent of gesture-based character recognition (GBCR) systems, which has gained tremendous demand lately as assistive aids for overcoming the restraints faced by people with physical impairments. The performance of the proposed system is validated by taking into account the vowels and numerals of Assamese vocabulary. Another attribute to this proposed system is the implementation of an effective hand segmentation module, which enables it to tackle complex background settings.

scholarly journals Continuous Finger Gesture Recognition Based on Flex Sensors

Sensors ◽  
2019 ◽  
Vol 19 (18) ◽  
pp. 3986 ◽  
Author(s):  
Wei-Chieh Chuang ◽  
Wen-Jyi Hwang ◽  
Tsung-Ming Tai ◽  
De-Rong Huang ◽  
Yun-Jie Jhang
Keyword(s):  
Gesture Recognition ◽  
Recognition System ◽  
Maximum A Posteriori ◽  
Map Estimation ◽  
A Posteriori ◽  
Sensory Data ◽  
Robust Recognition ◽  
Flex Sensors ◽  
Gated Recurrent Unit ◽  
Gesture Spotting

The goal of this work is to present a novel continuous finger gesture recognition system based on flex sensors. The system is able to carry out accurate recognition of a sequence of gestures. Wireless smart gloves equipped with flex sensors were implemented for the collection of the training and testing sets. Given the sensory data acquired from the smart gloves, the gated recurrent unit (GRU) algorithm was then adopted for gesture spotting. During the training process for the GRU, the movements associated with different fingers and the transitions between two successive gestures were taken into consideration. On the basis of the gesture spotting results, the maximum a posteriori (MAP) estimation was carried out for the final gesture classification. Because of the effectiveness of the proposed spotting scheme, accurate gesture recognition was achieved even for complicated transitions between successive gestures. From the experimental results, it can be observed that the proposed system is an effective alternative for robust recognition of a sequence of finger gestures.

scholarly journals Finger Gesture Spotting from Long Sequences Based on Multi-Stream Recurrent Neural Networks

Sensors ◽  
2020 ◽  
Vol 20 (2) ◽  
pp. 528 ◽  
Author(s):  
Gibran Benitez-Garcia ◽  
Muhammad Haris ◽  
Yoshiyuki Tsuda ◽  
Norimichi Ukita
Keyword(s):  
Neural Network ◽  
Semantic Information ◽  
State Of The Art ◽  
Spatial Location ◽  
Depth Sensor ◽  
Stream Network ◽  
Neural Architecture ◽  
Network Merging ◽  
Automated Methods ◽  
Gesture Spotting

Gesture spotting is an essential task for recognizing finger gestures used to control in-car touchless interfaces. Automated methods to achieve this task require to detect video segments where gestures are observed, to discard natural behaviors of users’ hands that may look as target gestures, and be able to work online. In this paper, we address these challenges with a recurrent neural architecture for online finger gesture spotting. We propose a multi-stream network merging hand and hand-location features, which help to discriminate target gestures from natural movements of the hand, since these may not happen in the same 3D spatial location. Our multi-stream recurrent neural network (RNN) recurrently learns semantic information, allowing to spot gestures online in long untrimmed video sequences. In order to validate our method, we collect a finger gesture dataset in an in-vehicle scenario of an autonomous car. 226 videos with more than 2100 continuous instances were captured with a depth sensor. On this dataset, our gesture spotting approach outperforms state-of-the-art methods with an improvement of about 10% and 15% of recall and precision, respectively. Furthermore, we demonstrated that by combining with an existing gesture classifier (a 3D Convolutional Neural Network), our proposal achieves better performance than previous hand gesture recognition methods.

Sign in / Sign up

Export Citation Format

Share Document