scholarly journals An Intra-Subject Approach Based on the Application of HMM to Predict Concentration in Educational Contexts from Nonintrusive Physiological Signals in Real-World Situations

Sensors ◽  
2021 ◽  
Vol 21 (5) ◽  
pp. 1777
Author(s):  
Ana Serrano-Mamolar ◽  
Miguel Arevalillo-Herráez ◽  
Guillermo Chicote-Huete ◽  
Jesus G. G. Boticario
Keyword(s):  
Real World ◽  
Markov Models ◽  
Low Cost ◽  
High Accuracy ◽  
Physiological Signals ◽  
Detection Accuracy ◽  
Related Information ◽  
Additional Control ◽  
Affect Detection ◽  
Potential Use

Previous research has proven the strong influence of emotions on student engagement and motivation. Therefore, emotion recognition is becoming very relevant in educational scenarios, but there is no standard method for predicting students’ affects. However, physiological signals have been widely used in educational contexts. Some physiological signals have shown a high accuracy in detecting emotions because they reflect spontaneous affect-related information, which is fresh and does not require additional control or interpretation. Most proposed works use measuring equipment for which applicability in real-world scenarios is limited because of its high cost and intrusiveness. To tackle this problem, in this work, we analyse the feasibility of developing low-cost and nonintrusive devices to obtain a high detection accuracy from easy-to-capture signals. By using both inter-subject and intra-subject models, we present an experimental study that aims to explore the potential application of Hidden Markov Models (HMM) to predict the concentration state from 4 commonly used physiological signals, namely heart rate, breath rate, skin conductance and skin temperature. We also study the effect of combining these four signals and analyse their potential use in an educational context in terms of intrusiveness, cost and accuracy. The results show that a high accuracy can be achieved with three of the signals when using HMM-based intra-subject models. However, inter-subject models, which are meant to obtain subject-independent approaches for affect detection, fail at the same task.

scholarly journals An Intra-Subject Approach Based on the Application of HMM to Predict Concentration in Educational Contexts From Non-Intrusive Physiological Signals Inreal-World Situations

2021 ◽  
Author(s):  
Ana Serrano-Mamolar ◽  
Miguel Arevalillo-Herráez ◽  
Jesus G. Boticario
Keyword(s):  
Real World ◽  
Adaptive Learning ◽  
Markov Models ◽  
Low Cost ◽  
High Accuracy ◽  
Physiological Signals ◽  
Detection Accuracy ◽  
Practical Applications ◽  
Related Information ◽  
Wide Range

Emotion recognition is becoming very relevant in educational scenarios, since previous research has proven the strong influence of emotions on the student's engagement and motivation. There is no standard method for stating student's affect, but physiological signals have been widely used in educational contexts. Physiological signals have been proved to offer high accuracy in detecting emotions because they reflect spontaneous affect-related information, and which is fresh and do not require an additional control or interpretation. However, most proposed works use measuring equipment that limit its applicability in real-world scenarios because of their high cost and their intrusiveness. Expensive material means an economic challenge for schools and reduce the scalability of the experiments. Intrusive equipment can be uncomfortable for the students which can lead to errors in the collected data. In this work, we analyse the feasibility of developing a low-cost non-intrusive device that integrates easy-to-capture signals that guarantee high detection accuracy. The advantage of the approach also lies in using user’s centred information sources (intra-subject) in real-world situations, which provide better detection accuracy, by offering models adapted to each subject. To this end, we present an experimental study that aims to explore the potential application of Hidden Markov Models (HMM) to predict the concentration state from 4 commonly used physiological signals, namely heart rate, breath rate, skin conductance and skin temperature. We study the multi-fusion of every possible combination of these four signals and analyse their potential use in an educational context in terms of intrusiveness, cost and accuracy. Results show that a high accuracy can be achieved with three of the signals when using HMM-based intra-subject models. However, inter-subject models, which are meant to obtain subject-independent approaches for affect detection, fail at the same task. This work concludes that the implementation of a low-cost wrist-worn device for recognising relevant emotions from each student is possible and open the way to a wide range of practical applications in the context of adaptive learning systems.

scholarly journals Low-Cost Multisensor Integrated System for Online Walking Gait Detection

2021 ◽  
Vol 2021 ◽  
pp. 1-15
Author(s):  
Lingyun Yan ◽  
Guowu Wei ◽  
Zheqi Hu ◽  
Haohua Xiu ◽  
Yuyang Wei ◽  
...  
Keyword(s):  
Detection System ◽  
Low Cost ◽  
Detection Algorithm ◽  
High Accuracy ◽  
Integrated System ◽  
Heel Strike ◽  
Detection Accuracy ◽  
Time Error ◽  
Kinematic Data ◽  
Compact Size

A three-dimensional motion capture system is a useful tool for analysing gait patterns during walking or exercising, and it is frequently applied in biomechanical studies. However, most of them are expensive. This study designs a low-cost gait detection system with high accuracy and reliability that is an alternative method/equipment in the gait detection field to the most widely used commercial system, the virtual user concept (Vicon) system. The proposed system integrates mass-produced low-cost sensors/chips in a compact size to collect kinematic data. Furthermore, an x86 mini personal computer (PC) running at 100 Hz classifies motion data in real-time. To guarantee gait detection accuracy, the embedded gait detection algorithm adopts a multilayer perceptron (MLP) model and a rule-based calibration filter to classify kinematic data into five distinct gait events: heel-strike, foot-flat, heel-off, toe-off, and initial-swing. To evaluate performance, volunteers are requested to walk on the treadmill at a regular walking speed of 4.2 km/h while kinematic data are recorded by a low-cost system and a Vicon system simultaneously. The gait detection accuracy and relative time error are estimated by comparing the classified gait events in the study with the Vicon system as a reference. The results show that the proposed system obtains a high accuracy of 99.66% with a smaller time error (32 ms), demonstrating that it performs similarly to the Vicon system in the gait detection field.

scholarly journals CNN and LSTM-Based Emotion Charting Using Physiological Signals

Sensors ◽  
2020 ◽  
Vol 20 (16) ◽  
pp. 4551
Author(s):  
Muhammad Najam Dar ◽  
Muhammad Usman Akram ◽  
Sajid Gul Khawaja ◽  
Amit N. Pujari
Keyword(s):  
Real World ◽  
Affective Computing ◽  
Short Term Memory ◽  
Low Cost ◽  
Wearable Sensors ◽  
Classification Performance ◽  
Physiological Signals ◽  
Significant Feature ◽  
High Arousal ◽  
Emotion Elicitation

Novel trends in affective computing are based on reliable sources of physiological signals such as Electroencephalogram (EEG), Electrocardiogram (ECG), and Galvanic Skin Response (GSR). The use of these signals provides challenges of performance improvement within a broader set of emotion classes in a less constrained real-world environment. To overcome these challenges, we propose a computational framework of 2D Convolutional Neural Network (CNN) architecture for the arrangement of 14 channels of EEG, and a combination of Long Short-Term Memory (LSTM) and 1D-CNN architecture for ECG and GSR. Our approach is subject-independent and incorporates two publicly available datasets of DREAMER and AMIGOS with low-cost, wearable sensors to extract physiological signals suitable for real-world environments. The results outperform state-of-the-art approaches for classification into four classes, namely High Valence—High Arousal, High Valence—Low Arousal, Low Valence—High Arousal, and Low Valence—Low Arousal. Emotion elicitation average accuracy of 98.73% is achieved with ECG right-channel modality, 76.65% with EEG modality, and 63.67% with GSR modality for AMIGOS. The overall highest accuracy of 99.0% for the AMIGOS dataset and 90.8% for the DREAMER dataset is achieved with multi-modal fusion. A strong correlation between spectral- and hidden-layer feature analysis with classification performance suggests the efficacy of the proposed method for significant feature extraction and higher emotion elicitation performance to a broader context for less constrained environments.

A computer vision approach to identifying the manufacturer and model of anterior cervical spinal hardware

2019 ◽  
Vol 31 (6) ◽  
pp. 844-850 ◽  
Author(s):  
Kevin T. Huang ◽  
Michael A. Silva ◽  
Alfred P. See ◽  
Kyle C. Wu ◽  
Troy Gallerani ◽  
...  
Keyword(s):  
Computer Vision ◽  
Feature Detection ◽  
High Accuracy ◽  
Detection Accuracy ◽  
Data Sets ◽  
Visual Words ◽  
Fusion Systems ◽  
Kaze Feature ◽  
Applications Of Machine Learning ◽  
Cervical Plating

OBJECTIVERecent advances in computer vision have revolutionized many aspects of society but have yet to find significant penetrance in neurosurgery. One proposed use for this technology is to aid in the identification of implanted spinal hardware. In revision operations, knowing the manufacturer and model of previously implanted fusion systems upfront can facilitate a faster and safer procedure, but this information is frequently unavailable or incomplete. The authors present one approach for the automated, high-accuracy classification of anterior cervical hardware fusion systems using computer vision.METHODSPatient records were searched for those who underwent anterior-posterior (AP) cervical radiography following anterior cervical discectomy and fusion (ACDF) at the authors’ institution over a 10-year period (2008–2018). These images were then cropped and windowed to include just the cervical plating system. Images were then labeled with the appropriate manufacturer and system according to the operative record. A computer vision classifier was then constructed using the bag-of-visual-words technique and KAZE feature detection. Accuracy and validity were tested using an 80%/20% training/testing pseudorandom split over 100 iterations.RESULTSA total of 321 total images were isolated containing 9 different ACDF systems from 5 different companies. The correct system was identified as the top choice in 91.5% ± 3.8% of the cases and one of the top 2 or 3 choices in 97.1% ± 2.0% and 98.4 ± 13% of the cases, respectively. Performance persisted despite the inclusion of variable sizes of hardware (i.e., 1-level, 2-level, and 3-level plates). Stratification by the size of hardware did not improve performance.CONCLUSIONSA computer vision algorithm was trained to classify at least 9 different types of anterior cervical fusion systems using relatively sparse data sets and was demonstrated to perform with high accuracy. This represents one of many potential clinical applications of machine learning and computer vision in neurosurgical practice.

scholarly journals Low cost, high accuracy 1.5m2 heliostat

2020 ◽  
Author(s):  
Derek Schulte ◽  
Kyam Krieger ◽  
Carl W. Chin ◽  
Alexander Sonn
Keyword(s):  
Low Cost ◽  
High Accuracy

scholarly journals Applicability of Cork as Novel Modifiers to Develop Electrochemical Sensor for Caffeine Determination

Materials ◽  
2020 ◽  
Vol 14 (1) ◽  
pp. 37
Author(s):  
Mayra K. S. Monteiro ◽  
Djalma R. Da Silva ◽  
Marco A. Quiroz ◽  
Vítor J. P. Vilar ◽  
Carlos A. Martínez-Huitle ◽  
...  
Keyword(s):  
Electrochemical Sensor ◽  
Linear Response ◽  
High Performance ◽  
Low Cost ◽  
Pharmaceutical Formulations ◽  
Caffeine Concentration ◽  
Real Samples ◽  
Wide Range ◽  
Potential Use

This study aims to investigate the applicability of a hybrid electrochemical sensor composed of cork and graphite (Gr) for detecting caffeine in aqueous solutions. Raw cork (RAC) and regranulated cork (RGC, obtained by thermal treatment of RAC with steam at 380 °C) were tested as modifiers. The results clearly showed that the cork-graphite sensors, GrRAC and GrRGC, exhibited a linear response over a wide range of caffeine concentration (5–1000 µM), with R2 of 0.99 and 0.98, respectively. The limits of detection (LOD), estimated at 2.9 and 6.1 µM for GrRAC and GrRGC, suggest greater sensitivity and reproducibility than the unmodified conventional graphite sensor. The low-cost cork-graphite sensors were successfully applied in the determination of caffeine in soft drinks and pharmaceutical formulations, presenting well-defined current signals when analyzing real samples. When comparing electrochemical determinations and high performance liquid chromatography measurements, no significant differences were observed (mean accuracy 3.0%), highlighting the potential use of these sensors to determine caffeine in different samples.

scholarly journals Evaluation of a Low-Cost Commercial Actigraph and Its Potential Use in Detecting Cultural Variations in Physical Activity and Sleep

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3774
Author(s):  
Pavlos Topalidis ◽  
Cristina Florea ◽  
Esther-Sevil Eigl ◽  
Anton Kurapov ◽  
Carlos Alberto Beltran Leon ◽  
...  
Keyword(s):  
Physical Activity ◽  
Low Income ◽  
Large Scale ◽  
Low Cost ◽  
Low Income Countries ◽  
Time Data ◽  
Cultural Variations ◽  
Step Counts ◽  
Scale Step ◽  
Potential Use

The purpose of the present study was to evaluate the performance of a low-cost commercial smartwatch, the Xiaomi Mi Band (MB), in extracting physical activity and sleep-related measures and show its potential use in addressing questions that require large-scale real-time data and/or intercultural data including low-income countries. We evaluated physical activity and sleep-related measures and discussed the potential application of such devices for large-scale step and sleep data acquisition. To that end, we conducted two separate studies. In Study 1, we evaluated the performance of MB by comparing it to the GT3X (ActiGraph, wGT3X-BT), a scientific actigraph used in research, as well as subjective sleep reports. In Study 2, we distributed the MB across four countries (Austria, Germany, Cuba, and Ukraine) and investigated physical activity and sleep among these countries. The results of Study 1 indicated that MB step counts correlated highly with the scientific GT3X device, but did display biases. In addition, the MB-derived wake-up and total-sleep-times showed high agreement with subjective reports, but partly deviated from GT3X predictions. Study 2 revealed similar MB step counts across countries, but significant later wake-up and bedtimes for Ukraine than the other countries. We hope that our studies will stimulate future large-scale sensor-based physical activity and sleep research studies, including various cultures.

scholarly journals A Machine Vision Approach for Bioreactor Foam Sensing

2021 ◽  
pp. 247263032110088
Author(s):  
Jonas Austerjost ◽  
Robert Söldner ◽  
Christoffer Edlund ◽  
Johan Trygg ◽  
David Pollard ◽  
...  
Keyword(s):  
Machine Learning ◽  
Machine Vision ◽  
State Of The Art ◽  
Low Cost ◽  
High Accuracy ◽  
Consumer Electronics ◽  
Learning System ◽  
Automotive Applications ◽  
Fine Grained

Machine vision is a powerful technology that has become increasingly popular and accurate during the last decade due to rapid advances in the field of machine learning. The majority of machine vision applications are currently found in consumer electronics, automotive applications, and quality control, yet the potential for bioprocessing applications is tremendous. For instance, detecting and controlling foam emergence is important for all upstream bioprocesses, but the lack of robust foam sensing often leads to batch failures from foam-outs or overaddition of antifoam agents. Here, we report a new low-cost, flexible, and reliable foam sensor concept for bioreactor applications. The concept applies convolutional neural networks (CNNs), a state-of-the-art machine learning system for image processing. The implemented method shows high accuracy for both binary foam detection (foam/no foam) and fine-grained classification of foam levels.

scholarly journals Early Detection of Exposure to Toxic Chemicals Using Continuously Recorded Multi-Sensor Physiology

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3616
Author(s):  
Jan Ubbo van Baardewijk ◽  
Sarthak Agarwal ◽  
Alex S. Cornelissen ◽  
Marloes J. A. Joosen ◽  
Jiska Kentrop ◽  
...  
Keyword(s):  
Machine Learning ◽  
Early Detection ◽  
Physiological Signals ◽  
Machine Learning Techniques ◽  
Detection Accuracy ◽  
Chemical Agent ◽  
Counter Measures ◽  
Detection And Identification ◽  
Life Saving ◽  
Future Work

Early detection of exposure to a toxic chemical, e.g., in a military context, can be life-saving. We propose to use machine learning techniques and multiple continuously measured physiological signals to detect exposure, and to identify the chemical agent. Such detection and identification could be used to alert individuals to take appropriate medical counter measures in time. As a first step, we evaluated whether exposure to an opioid (fentanyl) or a nerve agent (VX) could be detected in freely moving guinea pigs using features from respiration, electrocardiography (ECG) and electroencephalography (EEG), where machine learning models were trained and tested on different sets (across subject classification). Results showed this to be possible with close to perfect accuracy, where respiratory features were most relevant. Exposure detection accuracy rose steeply to over 95% correct during the first five minutes after exposure. Additional models were trained to correctly classify an exposed state as being induced either by fentanyl or VX. This was possible with an accuracy of almost 95%, where EEG features proved to be most relevant. Exposure detection models that were trained on subsets of animals generalized to subsets of animals that were exposed to other dosages of different chemicals. While future work is required to validate the principle in other species and to assess the robustness of the approach under different, realistic circumstances, our results indicate that utilizing different continuously measured physiological signals for early detection and identification of toxic agents is promising.

Sign in / Sign up

Export Citation Format

Share Document