scholarly journals Your Knock Is My Command: Binary Hand Gesture Recognition on Smartphone with Accelerometer

2020 ◽  
Vol 2020 ◽  
pp. 1-16
Author(s):  
Huixiang Zhang ◽  
Wenteng Xu ◽  
Chunlei Chen ◽  
Liang Bai ◽  
Yonghui Zhang
Keyword(s):  
Short Term Memory ◽  
Recognition Accuracy ◽  
Support Vector ◽  
Hand Gesture ◽  
Practical Applications ◽  
Imbalance Problem ◽  
High Recognition Accuracy ◽  
Dynamic Time ◽  
The One ◽  
User Friendly

Motion-based hand gesture is an important scheme to allow users to invoke commands on their smartphones in an eyes-free manner. However, the existing scheme is facing some problems. On the one hand, the expression ability of one single gesture is limited. As a result, a gesture set consisting of multiple gestures is typically adopted to represent different commands. Users must memorize all gestures in order to make interaction successfully. On the other hand, the design of gestures needs to be complicated to express diverse intensions. However, complex gestures are difficult to learn and remember. In addition, complex gestures set a high recognition barrier to smart APPs. This leads to an imbalance problem. Different gestures have different recognition accuracy levels, which may result in instability of recognition precision in practical applications. To address these problems, this paper proposes a novel scheme using binary motion gestures. Only two simple gestures are required to express bit “0” and “1,” and rich information can be expressed through the permutation and combination of the two binary gestures. Firstly, four kinds of candidate binary gestures are evaluated for eyes-free interactions. Then, an online signal cutting and merging algorithm is designed to split accelerometer signals sequence into multiple separate gesture signal segments. Next, five algorithms, including Dynamic Time Warping (DTW), Naive Bayes, Decision Tree, Support Vector Machine (SVM), and Bidirectional Long Short-Term Memory (BLSTM) Network, are adopted to recognize these segments of knock gestures. The BLSTM achieves the top performance in terms of both recognition accuracy and recognition imbalance. Finally, an Android application is developed to illustrate the usability of the proposed binary gestures. As binary gestures are much simpler than traditional hand gestures, they are more efficient and user-friendly. Our scheme eliminates the imbalance problem and achieves high recognition accuracy.

scholarly journals Electromyogram-based hand gesture recognition robust to various arm postures

2018 ◽  
Vol 14 (7) ◽  
pp. 155014771879075 ◽  
Author(s):  
Kiwon Rhee ◽  
Hyun-Chool Shin
Keyword(s):  
Gesture Recognition ◽  
Recognition Accuracy ◽  
Hand Gesture Recognition ◽  
Hand Gesture ◽  
Hand Gestures ◽  
Practical Applications ◽  
Electrode Positioning ◽  
Recognition Technique

In the recognition of electromyogram-based hand gestures, the recognition accuracy may be degraded during the actual stage of practical applications for various reasons such as electrode positioning bias and different subjects. Besides these, the change in electromyogram signals due to different arm postures even for identical hand gestures is also an important issue. We propose an electromyogram-based hand gesture recognition technique robust to diverse arm postures. The proposed method uses both the signals of the accelerometer and electromyogram simultaneously to recognize correct hand gestures even for various arm postures. For the recognition of hand gestures, the electromyogram signals are statistically modeled considering the arm postures. In the experiments, we compared the cases that took into account the arm postures with the cases that disregarded the arm postures for the recognition of hand gestures. In the cases in which varied arm postures were disregarded, the recognition accuracy for correct hand gestures was 54.1%, whereas the cases using the method proposed in this study showed an 85.7% average recognition accuracy for hand gestures, an improvement of more than 31.6%. In this study, accelerometer and electromyogram signals were used simultaneously, which compensated the effect of different arm postures on the electromyogram signals and therefore improved the recognition accuracy of hand gestures.

Learn the Temporal-Spatial Feature of sEMG via Dual-Flow Network

2019 ◽  
Vol 16 (04) ◽  
pp. 1941004 ◽  
Author(s):  
Runze Tong ◽  
Yue Zhang ◽  
Hongfeng Chen ◽  
Honghai Liu
Keyword(s):  
Gesture Recognition ◽  
Short Term Memory ◽  
Recognition Accuracy ◽  
Human Machine Interaction ◽  
Flow Network ◽  
Spatial Feature ◽  
Practical Applications ◽  
Long Short Term Memory ◽  
Machine Interaction ◽  
Semg Signals

Surface electromyography (sEMG) signals have been widely used in human–machine interaction, providing more nature control expedience for external devices. However, due to the instability of sEMG, it is hard to extract consistent sEMG patterns for motion recognition. This paper proposes a dual-flow network to extract the temporal-spatial feature of sEMG for gesture recognition. The proposed network model uses convolutional neural network (CNN) and long short-term memory methods (LSTM) to, respectively, extract the spatial feature and temporal feature of sEMG, simultaneously. These features extracted by CNN and LSTM are merged into temporal-spatial feature to form an end-to-end network. A dataset was constructed for testing the performance of the network. In this database, the average recognition accuracy by using our dual-flow model reached 78.31%, which was improved by 6.69% compared to the baseline CNN (71.67%). In addition, NinaPro DB1 is also used to evaluate the proposed methods, receiving 1.86% higher recognition accuracy than the baseline CNN classifier. It is believed that the proposed dual-flow network owns the merit in extracting stable sEMG feature for gesture recognition, and can be further applied into practical applications.

Fault Diagnosis of Pump Based on a Hybrid HMM/SVM Model

2011 ◽  
Vol 188 ◽  
pp. 629-635
Author(s):  
Xia Yue ◽  
Chun Liang Zhang ◽  
Jian Li ◽  
H.Y. Zhu
Keyword(s):  
Fault Diagnosis ◽  
Hybrid Model ◽  
Large Scale ◽  
Recognition Accuracy ◽  
Recognition Rate ◽  
Double Layers ◽  
Support Vector ◽  
Practical Applications ◽  
Average Recognition Rate ◽  
Svm Model

A hybrid support vector machine (SVM) and hidden Markov model (HMM) model was introduced into the fault diagnosis of pump. This model had double layers: the first layer used HMM to classify preliminarily in order to get the coverage of possible faults; the second layer utilized this information to activate the corresponding SVMs for improving the recognition accuracy. The structure of this hybrid model was clear and feasible. Especially the model had the potential of large-scale multiclass application in fault diagnosis because of its good scalability. The recognition experiments of 26 statuses on the ZLH600-2 pump showed that the recognition capability of this model was sound in multiclass problems. The recognition rate of one bearing eccentricity increased from SVM’s 84.42% to 89.61% while the average recognition rate of hybrid model reached 95.05%. Although some goals while model constructed did not be fully realized, this model was still very good in practical applications.

Study on Techniques of Hand Gesture Recognition

2012 ◽  
Vol 241-244 ◽  
pp. 1664-1667
Author(s):  
Shou Fang Mi ◽  
Ling Hua Li
Keyword(s):  
Feature Extraction ◽  
Gesture Recognition ◽  
Dynamic Bayesian Network ◽  
Hand Gesture Recognition ◽  
Support Vector ◽  
Hand Gesture ◽  
Time Warping ◽  
Language Interpretation ◽  
Dynamic Time ◽  
Main Ideas

This paper describes the study of techniques used in hand gesture recognition in sign language interpretation. The study is discussed from two aspects: the process of hand gesture recognition and the techniques of feature extraction in hand gesture recognition. The techniques of feature extraction in hand gesture recognition are grouped into five categories: Hidden Markov Model (HMM), Artificial Neural Networks (ANN), Support Vector Machines (SVM), Dynamic Bayesian Network (DBN), and Dynamic Time Warping (DTW). The main ideas and the application of each technique are described in detail.

scholarly journals Air Gesture Recognition Using WLAN Physical Layer Information

2020 ◽  
Vol 2020 ◽  
pp. 1-14
Author(s):  
Xiaochao Dang ◽  
Yang Liu ◽  
Zhanjun Hao ◽  
Xuhao Tang ◽  
Chenguang Shao
Keyword(s):  
Gesture Recognition ◽  
Recognition Accuracy ◽  
Wearable Sensors ◽  
Recognition System ◽  
Physical Layer ◽  
Support Vector ◽  
Depth Cameras ◽  
Indoor Scenes ◽  
Physical Layer Information ◽  
Dynamic Time

In recent years, the researchers have witnessed the important role of air gesture recognition in human-computer interactive (HCI), smart home, and virtual reality (VR). The traditional air gesture recognition method mainly depends on external equipment (such as special sensors and cameras) whose costs are high and also with a limited application scene. In this paper, we attempt to utilize channel state information (CSI) derived from a WLAN physical layer, a Wi-Fibased air gesture recognition system, namely, WiNum, which solves the problems of users’ privacy and energy consumption compared with the approaches using wearable sensors and depth cameras. In the process of recognizing the WiNum method, the collected raw data of CSI should be screened, among which can reflect the gesture motion. Meanwhile, the screened data should be preprocessed by noise reduction and linear transformation. After preprocessing, the joint of amplitude information and phase information is extracted, to match and recognize different air gestures by using the S-DTW algorithm which combines dynamic time warping algorithm (DTW) and support vector machine (SVM) properties. Comprehensive experiments demonstrate that under two different indoor scenes, WiNum can achieve higher recognition accuracy for air number gestures; the average recognition accuracy of each motion reached more than 93%, in order to achieve effective recognition of air gestures.

scholarly journals Classifying COVID-19 variants based on genetic sequences using deep learning models

2021 ◽  
Author(s):  
Sayantani Basu ◽  
Roy H. Campbell
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Sequence Data ◽  
Virus Disease ◽  
Class Imbalance ◽  
Fixed Number ◽  
Class Imbalance Problem ◽  
Imbalance Problem ◽  
Batch Sizes ◽  
The One

The COrona VIrus Disease (COVID-19) pandemic led to the occurrence of several variants with time. This has led to an increased importance of understanding sequence data related to COVID-19. In this chapter, we propose an alignment-free k-mer based LSTM (Long Short-Term Memory) deep learning model that can classify 20 different variants of COVID-19. We handle the class imbalance problem by sampling a fixed number of sequences for each class label. We handle the vanishing gradient problem in LSTMs arising from long sequences by dividing the sequence into fixed lengths and obtaining results on individual runs. Our results show that one- vs-all classifiers have test accuracies as high as 92.5% with tuned hyperparameters compared to the multi-class classifier model. Our experiments show higher overall accuracies for B.1.1.214, B.1.177.21, B.1.1.7, B.1.526, and P.1 on the one-vs-all classifiers, suggesting the presence of distinct mutations in these variants. Our results show that embedding vector size and batch sizes have insignificant improvement in accuracies, but changing from 2-mers to 3-mers mostly improves accuracies. We also studied individual runs which show that most accuracies improved after the 20th run, indicating that these sequence positions may have more contributions to distinguishing among different COVID-19 variants.

scholarly journals Research on a Pedestrian Crossing Intention Recognition Model Based on Natural Observation Data

Sensors ◽  
2020 ◽  
Vol 20 (6) ◽  
pp. 1776 ◽  
Author(s):  
Hongjia Zhang ◽  
Yanjuan Liu ◽  
Chang Wang ◽  
Rui Fu ◽  
Qinyu Sun ◽  
...  
Keyword(s):  
Short Term Memory ◽  
Recognition Accuracy ◽  
Sequence Data ◽  
Pedestrian Detection ◽  
Support Vector ◽  
Observation Data ◽  
Accurate Identification ◽  
Intention Recognition ◽  
Svm Model ◽  
Pedestrian Crossing

Accurate identification of pedestrian crossing intention is of great significance to the safe and efficient driving of future fully automated vehicles in the city. This paper focuses on pedestrian intention recognition on the basis of pedestrian detection and tracking. A large number of natural crossing sequence data of pedestrians and vehicles are first collected by a laser scanner and HD camera, then 1980 effective crossing samples of pedestrians are selected. Influencing parameter sets of pedestrian crossing intention are then obtained through statistical analysis. Finally, long short-term memory network with attention mechanism (AT-LSTM) model is proposed. Compared with the support vector machine (SVM) model, results show that when the pedestrian crossing intention is recognized 0 s prior to crossing, the recognition accuracy of the AT-LSTM model for pedestrian crossing intention is 96.15%, which is 6.07% higher than that of SVM model; when the pedestrian crossing intention is recognized 0.6 s prior, the recognition accuracy of AT-LSTM model is 90.68%, which is 4.85% higher than that of the SVM model. The determination of pedestrian crossing intention parameter set and the more accurate recognition of pedestrian intention provided in this work provide a foundation for future fully automated driving vehicles.

scholarly journals Intelligent Brushing Monitoring Using a Smart Toothbrush with Recurrent Probabilistic Neural Network

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1238
Author(s):  
Ching-Han Chen ◽  
Chien-Chun Wang ◽  
Yan-Zhen Chen
Keyword(s):  
Neural Network ◽  
Short Term Memory ◽  
Inertial Sensors ◽  
Recognition Accuracy ◽  
Probabilistic Neural Network ◽  
Time Signal ◽  
High Tech ◽  
Posture Recognition ◽  
High Recognition Accuracy ◽  
Computational Resources

Smart toothbrushes equipped with inertial sensors are emerging as high-tech oral health products in personalized health care. The real-time signal processing of nine-axis inertial sensing and toothbrush posture recognition requires high computational resources. This paper proposes a recurrent probabilistic neural network (RPNN) for toothbrush posture recognition that demonstrates the advantages of low computational resources as a requirement, along with high recognition accuracy and efficiency. The RPNN model is trained for toothbrush posture recognition and brushing position and then monitors the correctness and integrity of the Bass Brushing Technique. Compared to conventional deep learning models, the recognition accuracy of RPNN is 99.08% in our experiments, which is 16.2% higher than that of the Convolutional Neural Network (CNN) and 21.21% higher than the Long Short-Term Memory (LSTM) model. The model we used can greatly reduce the computing power of hardware devices, and thus, our system can be used directly on smartphones.

scholarly journals Detecting Deception from Gaze and Speech Using a Multimodal Attention LSTM-Based Framework

2021 ◽  
Vol 11 (14) ◽  
pp. 6393
Author(s):  
Ascensión Gallardo-Antolín ◽  
Juan M. Montero
Keyword(s):  
Short Term Memory ◽  
Deception Detection ◽  
Detection System ◽  
Support Vector ◽  
The Gaze ◽  
Combination Strategies ◽  
Speech Feature ◽  
Speech Features ◽  
The One ◽  
Modal Systems

The automatic detection of deceptive behaviors has recently attracted the attention of the research community due to the variety of areas where it can play a crucial role, such as security or criminology. This work is focused on the development of an automatic deception detection system based on gaze and speech features. The first contribution of our research on this topic is the use of attention Long Short-Term Memory (LSTM) networks for single-modal systems with frame-level features as input. In the second contribution, we propose a multimodal system that combines the gaze and speech modalities into the LSTM architecture using two different combination strategies: Late Fusion and Attention-Pooling Fusion. The proposed models are evaluated over the Bag-of-Lies dataset, a multimodal database recorded in real conditions. On the one hand, results show that attentional LSTM networks are able to adequately model the gaze and speech feature sequences, outperforming a reference Support Vector Machine (SVM)-based system with compact features. On the other hand, both combination strategies produce better results than the single-modal systems and the multimodal reference system, suggesting that gaze and speech modalities carry complementary information for the task of deception detection that can be effectively exploited by using LSTMs.

Using Machine Learning Algorithms on Prediction of Stock Price

2020 ◽  
Vol 12 (2) ◽  
pp. 84-99
Author(s):  
Li-Pang Chen
Keyword(s):  
Machine Learning ◽  
Stock Price ◽  
Short Term Memory ◽  
Machine Learning Algorithms ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Short Term ◽  
Learning Techniques ◽  
Historical Database ◽  
Long Short Term Memory

In this paper, we investigate analysis and prediction of the time-dependent data. We focus our attention on four different stocks are selected from Yahoo Finance historical database. To build up models and predict the future stock price, we consider three different machine learning techniques including Long Short-Term Memory (LSTM), Convolutional Neural Networks (CNN) and Support Vector Regression (SVR). By treating close price, open price, daily low, daily high, adjusted close price, and volume of trades as predictors in machine learning methods, it can be shown that the prediction accuracy is improved.

Sign in / Sign up

Export Citation Format

Share Document