A Continuous Hand Gestures Recognition Technique for Human-Machine Interaction Using Accelerometer and Gyroscope Sensors

2016 ◽  
Vol 16 (16) ◽  
pp. 6425-6432 ◽  
Author(s):  
Hari Prabhat Gupta ◽  
Haresh S. Chudgar ◽  
Siddhartha Mukherjee ◽  
Tanima Dutta ◽  
Kulwant Sharma
Keyword(s):  
Hand Gestures ◽  
Human Machine Interaction ◽  
Machine Interaction ◽  
Hand Gestures Recognition ◽  
Recognition Technique

scholarly journals Control of Robot Directions Based on Online Hand Gestures

2018 ◽  
Vol 14 (1) ◽  
pp. 41-50
Author(s):  
Mohammed Tawfeeq ◽  
Ayam Abbass
Keyword(s):  
Communication Technology ◽  
High Performance ◽  
Robotic Systems ◽  
Wireless System ◽  
Hand Gestures ◽  
Human Machine Interaction ◽  
Wheeled Robot ◽  
Short Time ◽  
Machine Interaction ◽  
Very High

The evolution of wireless communication technology increases human machine interaction capabilities especially in controlling robotic systems. This paper introduces an effective wireless system in controlling the directions of a wheeled robot based on online hand gestures. The hand gesture images are captured and processed to be recognized and classified using neural network (NN). The NN is trained using extracted features to distinguish five different gestures; accordingly it produces five different signals. These signals are transmitted to control the directions of the cited robot. The main contribution of this paper is, the technique used to recognize hand gestures is required only two features, these features can be extracted in very short time using quite easy methodology, and this makes the proposed technique so suitable for online interaction. In this methodology, the preprocessed image is partitioned column-wise into two half segments; from each half one feature is extracted. This feature represents the ratio of white to black pixels of the segment histogram. The NN showed very high accuracy in recognizing all of the proposed gesture classes. The NN output signals are transmitted to the robot microcontroller wirelessly using Bluetooth. Accordingly the microcontroller guides the robot to the desired direction. The overall system showed high performance in controlling the robot movement directions.

scholarly journals The Analysis of the Possibility of Using Viola-Jones Algorithm to Recognise Hand Gestures in Human-Machine Interaction

2017 ◽  
Vol 40 (1) ◽  
pp. 109-144
Author(s):  
Piotr Golański ◽  
Marek Szczekala
Keyword(s):  
Image Recognition ◽  
Wearable Computers ◽  
Hand Gestures ◽  
Human Machine Interaction ◽  
Specific Location ◽  
Computer Aided ◽  
Machine Interaction

AbstractThe article concerns the issue of applying computer-aided systems of the maintenance of technical objects in difficult conditions. Difficult conditions shall be understood as these in which the maintenance takes place in a specific location making it hard or even preventing from using a computer. In these cases computers integrated with workwear should be used, the so-called wearable computers, with which the communication is possible by using hand gestures. The results of the analysis of the usefulness of one of methods of image recognition based on Viola-Jones algorithm were described. This algorithm enables to obtain the model of recognised image which might be used as a pattern in the application programme detecting a certain image.

scholarly journals Analysis of Human-Machine Interaction Through Facial Expression and Hand-Gesture Recognition

2019 ◽  
Vol 8 (9S3) ◽  
pp. 1320-1328
Keyword(s):  
Facial Expression ◽  
Human Brain ◽  
Recent Work ◽  
Facial Expressions ◽  
Gesture Recognition ◽  
Oral Communication ◽  
Hand Gesture ◽  
Hand Gestures ◽  
Human Machine Interaction ◽  
Machine Interaction

This paper focuses on a review of recent work on facial expression and hand gesture recognitions. Facial expressions and hand gestures are used to express emotions without oral communication. The human brain has the ability to identify the emotions of persons using expressions or hand gestures within a fraction of a second. Research has been conducted on human–machine interactions (HMIs), and the expectation is that systems based on such HMI algorithms should respond similarly. Furthermore, when a person intends to express emotions orally, he or she automatically uses complementary facial expressions and hand gestures. Extant systems are designed to express these emotions through HMIs without oral communication. Other systems have added various combinations of hand gestures and facial expressions as videos or images. The meaning or emotions conveyed by particular hand gestures and expressions are predefined in these cases. Accordingly, the systems were trained and tested. Further, certain extant systems have separately defined the meanings of such hand gestures and facial expressions

Concise CNN model for face expression recognition

2021 ◽  
pp. 1-9
Author(s):  
Harshadkumar B. Prajapati ◽  
Ankit S. Vyas ◽  
Vipul K. Dabhi
Keyword(s):  
Network Architecture ◽  
Expression Recognition ◽  
Human Machine Interaction ◽  
Face Expression ◽  
Computational Overhead ◽  
Average Accuracy ◽  
Proposed Model ◽  
Face Expression Recognition ◽  
Expression Classification ◽  
Machine Interaction

Face expression recognition (FER) has gained very much attraction to researchers in the field of computer vision because of its major usefulness in security, robotics, and HMI (Human-Machine Interaction) systems. We propose a CNN (Convolutional Neural Network) architecture to address FER. To show the effectiveness of the proposed model, we evaluate the performance of the model on JAFFE dataset. We derive a concise CNN architecture to address the issue of expression classification. Objective of various experiments is to achieve convincing performance by reducing computational overhead. The proposed CNN model is very compact as compared to other state-of-the-art models. We could achieve highest accuracy of 97.10% and average accuracy of 90.43% for top 10 best runs without any pre-processing methods applied, which justifies the effectiveness of our model. Furthermore, we have also included visualization of CNN layers to observe the learning of CNN.

scholarly journals A Bibliometric Analysis of Human-Machine Interaction Methodology for Electric-Powered Wheelchairs Driving from 1998 to 2020

2021 ◽  
Vol 18 (14) ◽  
pp. 7567
Author(s):  
Xiaochen Zhang ◽  
Lanxin Hui ◽  
Linchao Wei ◽  
Fuchuan Song ◽  
Fei Hu
Keyword(s):  
The Elderly ◽  
Research Field ◽  
Future Research ◽  
Human Machine Interaction ◽  
Research Directions ◽  
The Past ◽  
Power Wheelchairs ◽  
The Disabled ◽  
Future Research Directions ◽  
Machine Interaction

Electric power wheelchairs (EPWs) enhance the mobility capability of the elderly and the disabled, while the human-machine interaction (HMI) determines how well the human intention will be precisely delivered and how human-machine system cooperation will be efficiently conducted. A bibliometric quantitative analysis of 1154 publications related to this research field, published between 1998 and 2020, was conducted. We identified the development status, contributors, hot topics, and potential future research directions of this field. We believe that the combination of intelligence and humanization of an EPW HMI system based on human-machine collaboration is an emerging trend in EPW HMI methodology research. Particular attention should be paid to evaluating the applicability and benefits of the EPW HMI methodology for the users, as well as how much it contributes to society. This study offers researchers a comprehensive understanding of EPW HMI studies in the past 22 years and latest trends from the evolutionary footprints and forward-thinking insights regarding future research.

Holistic, Context-sensitive Human-machine Interaction for Automated Vehicles

ATZ worldwide ◽  
2021 ◽  
Vol 123 (3) ◽  
pp. 46-49
Author(s):  
Tobias Hesse ◽  
Michael Oehl ◽  
Uwe Drewitz ◽  
Meike Jipp
Keyword(s):  
Automated Vehicles ◽  
Human Machine Interaction ◽  
Context Sensitive ◽  
Machine Interaction
Sign in / Sign up

Export Citation Format

Share Document