scholarly journals An Information Gain-Based Model and an Attention-Based RNN for Wearable Human Activity Recognition

Entropy ◽  
2021 ◽  
Vol 23 (12) ◽  
pp. 1635
Author(s):  
Leyuan Liu ◽  
Jian He ◽  
Keyan Ren ◽  
Jonathan Lungu ◽  
Yibin Hou ◽  
...  

Wearable sensor-based HAR (human activity recognition) is a popular human activity perception method. However, due to the lack of a unified human activity model, the number and positions of sensors in the existing wearable HAR systems are not the same, which affects the promotion and application. In this paper, an information gain-based human activity model is established, and an attention-based recurrent neural network (namely Attention-RNN) for human activity recognition is designed. Besides, the attention-RNN, which combines bidirectional long short-term memory (BiLSTM) with attention mechanism, was tested on the UCI opportunity challenge dataset. Experiments prove that the proposed human activity model provides guidance for the deployment location of sensors and provides a basis for the selection of the number of sensors, which can reduce the number of sensors used to achieve the same classification effect. In addition, experiments show that the proposed Attention-RNN achieves F1 scores of 0.898 and 0.911 in the ML (Modes of Locomotion) task and GR (Gesture Recognition) task, respectively.

2021 ◽  
Author(s):  
Ghabri Sawsen ◽  
Wael Ouarda ◽  
Houcine Boubaker ◽  
Mohamed Moncef Ben Khelifa ◽  
Adel Alimi

Deep-BEJT: A New Human Activity Recognition System basedon Beta Elliptical Joint Trajectory (BEJT) and Long Short TermMemory (LSTM)<div>New journal paper</div>


2021 ◽  
Author(s):  
Santosh Kumar Yadav ◽  
Kamlesh Tiwari ◽  
Hari Mohan Pandey ◽  
Shaik Ali Akbar

AbstractHuman activity recognition aims to determine actions performed by a human in an image or video. Examples of human activity include standing, running, sitting, sleeping, etc. These activities may involve intricate motion patterns and undesired events such as falling. This paper proposes a novel deep convolutional long short-term memory (ConvLSTM) network for skeletal-based activity recognition and fall detection. The proposed ConvLSTM network is a sequential fusion of convolutional neural networks (CNNs), long short-term memory (LSTM) networks, and fully connected layers. The acquisition system applies human detection and pose estimation to pre-calculate skeleton coordinates from the image/video sequence. The ConvLSTM model uses the raw skeleton coordinates along with their characteristic geometrical and kinematic features to construct the novel guided features. The geometrical and kinematic features are built upon raw skeleton coordinates using relative joint position values, differences between joints, spherical joint angles between selected joints, and their angular velocities. The novel spatiotemporal-guided features are obtained using a trained multi-player CNN-LSTM combination. Classification head including fully connected layers is subsequently applied. The proposed model has been evaluated on the KinectHAR dataset having 130,000 samples with 81 attribute values, collected with the help of a Kinect (v2) sensor. Experimental results are compared against the performance of isolated CNNs and LSTM networks. Proposed ConvLSTM have achieved an accuracy of 98.89% that is better than CNNs and LSTMs having an accuracy of 93.89 and 92.75%, respectively. The proposed system has been tested in realtime and is found to be independent of the pose, facing of the camera, individuals, clothing, etc. The code and dataset will be made publicly available.


2021 ◽  
Author(s):  
Ghabri Sawsen ◽  
Wael Ouarda ◽  
Houcine Boubaker ◽  
Mohamed Moncef Ben Khelifa ◽  
Adel Alimi

Deep-BEJT: A New Human Activity Recognition System basedon Beta Elliptical Joint Trajectory (BEJT) and Long Short TermMemory (LSTM)<div>New journal paper</div>


Sign in / Sign up

Export Citation Format

Share Document