scholarly journals Multimodal Study of the Effects of Varying Task Load Utilizing EEG, GSR and Eye-Tracking

2019 ◽  
Author(s):  
Jannis Born ◽  
Babu Ram Naidu Ramachandran ◽  
Sandra Alejandra Romero Pinto ◽  
Stefan Winkler ◽  
Rama Ratnam
Keyword(s):  
Eye Tracking ◽  
Task Performance ◽  
Mental Workload ◽  
Cognitive Task ◽  
Physiological Data ◽  
Postal Code ◽  
Subjective Data ◽  
Task Load ◽  
Minimum Number ◽  
Participant Response

AbstractObjectiveThe effect of task load on performance is investigated by simultaneously collecting multi-modal physiological data and participant response data. Periodic response to a questionnaire is also obtained. The goal is to determine combinations of modalities that best serve as predictors of task performance.ApproachA group of participants performed a computer-based visual search task mimicking postal code sorting. A five-digit number had to be assigned to one of six different non-overlapping numeric ranges. Trials were presented in blocks of progressively increasing task difficulty. The participants’ responses were collected simultaneously with 32 channels of electroencephalography (EEG) data, eye-tracking data, and Galvanic Skin Response (GSR) data. The NASA Task-Load-Index self-reporting instrument was administered at discrete time points in the experiment.Main resultsLow beta frequency EEG waves (12.5-18 Hz) were more prominent as cognitive task load increased, with most activity in frontal and parietal regions. These were accompanied by more frequent eye blinks and increased pupillary dilation. Blink duration correlated strongly with task performance. Phasic components of the GSR signal were related to cognitive workload, whereas tonic components indicated a more general state of arousal. Subjective data (NASA TLX) as reported by the participants showed an increase in frustration and mental workload. Based on one-way ANOVA, EEG and GSR provided the most reliable correlation to perceived workload level and were the most informative measures (taken together) for performance prediction.SignificanceNumerous modalities come into play during task-related activity. Many of these modalities can provide information on task performance when appropriately grouped. This study suggests that while EEG is a good predictor of task performance, additional modalities such as GSR increase the likelihood of more accurate predictions. Further, in controlled laboratory conditions, the most informative or minimum number of modalities can be isolated for monitoring in real work environments.

scholarly journals Cognitive task performance under (combined) conditions of a metabolic and sensory stressor

2020 ◽  
Author(s):  
Charelle Bottenheft ◽  
Anne-Marie Brouwer ◽  
Ivo Stuldreher ◽  
Eric Groen ◽  
Jan van Erp
Keyword(s):  
Task Performance ◽  
Electrodermal Activity ◽  
Cognitive Task ◽  
Lower State ◽  
Subjective Data ◽  
Breakfast Skipping ◽  
Cognitive Task Performance ◽  
Underlying Mechanisms ◽  
Skipping Breakfast ◽  
Back Task

AbstractEffects of stressors on cognitive task performance have primarily been studied in isolation, and little is known about the combined effects of two or more stressors. This study examined how a metabolic stressor (skipping breakfast) and a sensory stressor (noise) affect cognitive task performance in isolation and combined. In addition to performance, we collected physiological and subjective data to get insight in the underlying mechanisms. Twenty participants came to the lab twice, once after skipping breakfast, and once after a standardized breakfast. They performed runs of the 2-back task and the International Shopping List Task, which were alternately presented with and without noise. During the 2-back task, electrocardiography (ECG), electrodermal activity (EDA), and electroencephalography (EEG) were recorded. Subjective ratings on effort and stress were also collected. No interaction effects between the two stressors on cognitive performance were found. Skipping breakfast did not cause hypoglycemia, but resulted in subjective discomfort and a lower state of arousal (as indicated by lower heart rate and EDA). These may underly the trend for more missed responses on the 2-back task after breakfast skipping. Noise appeared to generate arousal and increased attention (reflected in higher EDA and P300) in accordance with higher experienced load and stress. This is consistent with less missed 2-back responses in noise conditions. The results indicate that individuals spent extra effort to maintain task performance in the presence of noise. We propose to use a model that, besides additional effort, takes the effect of stressors on performance into account.

scholarly journals EEG Theta Power Activity Reflects Workload among Army Combat Drivers: An Experimental Study

2020 ◽  
Vol 10 (4) ◽  
pp. 199 ◽  
Author(s):  
Carolina Diaz-Piedra ◽  
María Victoria Sebastián ◽  
Leandro L. Di Stasi
Keyword(s):  
Power Spectrum ◽  
Mental Workload ◽  
Brain Activity ◽  
Subjective Data ◽  
Eeg Activity ◽  
The Road ◽  
Task Load ◽  
Eeg Power Spectrum ◽  
Dynamic Simulator ◽  
Eeg Power

We aimed to evaluate the effects of mental workload variations, as a function of the road environment, on the brain activity of army drivers performing combat and non-combat scenarios in a light multirole vehicle dynamic simulator. Forty-one non-commissioned officers completed three standardized driving exercises with different terrain complexities (low, medium, and high) while we recorded their electroencephalographic (EEG) activity. We focused on variations in the theta EEG power spectrum, a well-known index of mental workload. We also assessed performance and subjective ratings of task load. The theta EEG power spectrum in the frontal, temporal, and occipital areas were higher during the most complex scenarios. Performance (number of engine stops) and subjective data supported these findings. Our findings strengthen previous results found in civilians on the relationship between driver mental workload and the theta EEG power spectrum. This suggests that EEG activity can give relevant insight into mental workload variations in an objective, unbiased fashion, even during real training and/or operations. The continuous monitoring of the warfighter not only allows instantaneous detection of over/underload but also might provide online feedback to the system (either automated equipment or the crew) to take countermeasures and prevent fatal errors.

scholarly journals Classification of Drivers' Workload Using Physiological Signals in Conditional Automation

2021 ◽  
Vol 12 ◽  
Author(s):  
Quentin Meteier ◽  
Marine Capallera ◽  
Simon Ruffieux ◽  
Leonardo Angelini ◽  
Omar Abou Khaled ◽  
...  
Keyword(s):  
Secondary Task ◽  
Time Window ◽  
Mental Workload ◽  
Cognitive Task ◽  
Physiological Signals ◽  
Machine Learning Techniques ◽  
Physiological Data ◽  
Automated Driving ◽  
Physiological Indicators ◽  
High Level

The use of automation in cars is increasing. In future vehicles, drivers will no longer be in charge of the main driving task and may be allowed to perform a secondary task. However, they might be requested to regain control of the car if a hazardous situation occurs (i.e., conditionally automated driving). Performing a secondary task might increase drivers' mental workload and consequently decrease the takeover performance if the workload level exceeds a certain threshold. Knowledge about the driver's mental state might hence be useful for increasing safety in conditionally automated vehicles. Measuring drivers' workload continuously is essential to support the driver and hence limit the number of accidents in takeover situations. This goal can be achieved using machine learning techniques to evaluate and classify the drivers' workload in real-time. To evaluate the usefulness of physiological data as an indicator for workload in conditionally automated driving, three physiological signals from 90 subjects were collected during 25 min of automated driving in a fixed-base simulator. Half of the participants performed a verbal cognitive task to induce mental workload while the other half only had to monitor the environment of the car. Three classifiers, sensor fusion and levels of data segmentation were compared. Results show that the best model was able to successfully classify the condition of the driver with an accuracy of 95%. In some cases, the model benefited from sensors' fusion. Increasing the segmentation level (e.g., size of the time window to compute physiological indicators) increased the performance of the model for windows smaller than 4 min, but decreased for windows larger than 4 min. In conclusion, the study showed that a high level of drivers' mental workload can be accurately detected while driving in conditional automation based on 4-min recordings of respiration and skin conductance.

scholarly journals Problem solvers adjust cognitive offloading based on performance goals

2019 ◽  
Author(s):  
Patrick P. Weis ◽  
Eva Wiese
Keyword(s):  
Task Performance ◽  
Cognitive Processing ◽  
Mental Workload ◽  
Cognitive Task ◽  
Cognitive Strategies ◽  
Performance Goals ◽  
External Resource ◽  
Cognitive Offloading ◽  
Improved Performance ◽  
Problem Solvers

When incorporating the environment into mental processing (cf., cognitive offloading), one creates novel cognitive strategies that have the potential to improve task performance. Improved performance can, for example, mean faster problem solving, more accurate solutions, or even higher grades at university . Although cognitive offloading has frequently been associated with improved performance, it is yet unclear how flexible problem solvers are at matching their offloading habits with their current performance goals (can people improve goal-related instead of generic performance, e.g., when being in a hurry and aiming for a “quick and dirty” solution?). Here, we asked participants to solve a cognitive task, provided them with different goals – maximizing speed (SPD) or accuracy (ACC), respectively – and measured how frequently (Experiment 1) and how proficiently (Experiment 2) they made use of a novel external resource to support their cognitive processing. Experiment 1 showed that offloading behavior varied with goals: participants offloaded less in the SPD than in the ACC condition. Experiment 2 showed that this differential offloading behavior was associated with high goal-related performance: fast answers in the SPD, accurate answers in the ACC condition. Simultaneously, goal-unrelated performance was sacrificed: inaccurate answers in the SPD, slow answers in the ACC condition. The findings support the notion of humans as canny offloaders who are able to successfully incorporate their environment in pursuit of their current cognitive goals. Future efforts should be focused on the finding’s generalizability, e.g. to settings without feedback or with high mental workload.

On the Cost of Detection Response Task Performance on Cognitive Load

2020 ◽  
pp. 001872082093162 ◽  
Author(s):  
Francesco N. Biondi ◽  
Balakumar Balasingam ◽  
Prathamesh Ayare
Keyword(s):  
Cognitive Load ◽  
Task Performance ◽  
Pupil Diameter ◽  
Mental Workload ◽  
Measuring System ◽  
Cognitive Resources ◽  
Task Load ◽  
Detection Response ◽  
Response Task ◽  
The Cost

Objective This study investigates the cost of detection response task performance on cognitive load. Background Measuring system operator’s cognitive load is a foremost challenge in human factors and ergonomics. The detection response task is a standardized measure of cognitive load. It is hypothesized that, given its simple reaction time structure, it has no cost on cognitive load. We set out to test this hypothesis by utilizing pupil diameter as an alternative metric of cognitive load. Method Twenty-eight volunteers completed one of four experimental tasks with increasing levels of cognitive demand (control, 0-back, 1-back, and 2-back) with or without concurrent DRT performance. Pupil diameter was selected as nonintrusive metric of cognitive load. Self-reported workload was also recorded. Results A significant main effect of DRT presence was found for pupil diameter and self-reported workload. Larger pupil diameter was found when the n-back task was performed concurrently with the DRT, compared to no-DRT conditions. Consistent results were found for mental workload ratings and n-back performance. Conclusion Results indicate that DRT performance produced an added cost on cognitive load. The magnitude of the change in pupil diameter was comparable to that observed when transitioning from a condition of low task load to one where the 2-back was performed. The significant increase in cognitive load accompanying DRT performance was also reflected in higher self-reported workload. Application DRT is a valuable tool to measure operator’s cognitive load. However, these results advise caution when discounting it as cost-free metric with no added burden on operator’s cognitive resources.

scholarly journals Effects of Workload and Workload Transitions on Attention Allocation in a Dual-Task Environment: Evidence From Eye Tracking Metrics

2020 ◽  
Vol 14 (2) ◽  
pp. 132-151
Author(s):  
Nadine Marie Moacdieh ◽  
Shannon P. Devlin ◽  
Hussein Jundi ◽  
Sara Lu Riggs
Keyword(s):  
Eye Tracking ◽  
Dual Task ◽  
Secondary Task ◽  
High Performance ◽  
Mental Workload ◽  
Attention Allocation ◽  
Task Load ◽  
Significant Difference ◽  
High Workload ◽  
And Control

High mental workload, in addition to changes in workload, can negatively affect operators, but it is not clear how sudden versus gradual workload transitions influence performance and visual attention allocation. This knowledge is important as sudden shifts in workload are common in multitasking domains. The objective of this study was to investigate, using performance and eye tracking metrics, how constant versus variable levels of workload affect operators in the context of a dual-task paradigm. An unmanned aerial vehicle command and control simulation varied task load between low, high, gradually transitioning from low to high, and suddenly transitioning from low to high. Performance on a primary and secondary task and several eye tracking measures were calculated. There was no significant difference between sudden and gradual workload transitions in terms of performance or attention allocation overall; however, both sudden and gradual workload transitions changed participants’ strategy in dealing with the primary and secondary task as compared to low/high workload. Also, eye tracking metrics that are not frequently used, such as transition rate and stationary entropy, provided more insight into performance differences. These metrics can potentially be used to better understand operators’ strategies and could form the basis of an adaptive display.

scholarly journals Mobile Brain/Body Imaging of cognitive-motor impairment in multiple sclerosis: deriving EEG-based neuro-markers during a dual-task walking study

2019 ◽  
Author(s):  
Pierfilippo De Sanctis ◽  
Brenda R. Malcolm ◽  
Peter C. Mabie ◽  
Ana A. Francisco ◽  
Wenzhu B. Mowrey ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Task Performance ◽  
Dual Task ◽  
Cognitive Task ◽  
Motor Impairment ◽  
Event Related Potentials ◽  
Motor Dysfunction ◽  
Task Load ◽  
Dual Task Performance ◽  
Related Potentials

ABSTRACTIndividuals with a diagnosis of multiple sclerosis (MS) often present with deficits in the cognitive as well as the motor domain. The ability to perform tasks that rely on both domains may therefore be particularly impaired. Yet, behavioral studies designed to measure costs associated with performing two tasks at the same time such as dual-task walking have yielded mixed results. Patients may mobilize additional brain resources to sustain good levels of performance. To test this hypothesis, we acquired event-related potentials (ERP) in thirteen individuals with MS and fifteen healthy control (HC) participants performing a Go/NoGo response inhibition task while sitting (i.e., single task) or walking on a treadmill (i.e., dual-task). In previous work, we showed that the nogo-N2 elicited by the cognitive task was reduced when healthy adults are also asked to walk, and that nogo-N2 reduction was accompanied by sustained dual-task performance. We predicted that some MS patients, similar to their healthy peers, may mobilize N2-indexed brain resources and thereby reduce costs. Somewhat to our surprise, the HC group performed the Go/NoGo task more accurately while walking, thus showing a dual-task benefit, whereas, in line with expectation, the MS group showed a trend towards dual-task costs. The expected nogo-N2 reduction during dual-task walking was found in the HC group, but was not present at the group level in the MS group, suggesting that this group did not modulate the nogo-N2 process in response to higher task load. Regression analysis for the pooled sample revealed a robust link between nogo-N2 reduction and better dual-task performance. We conclude that impaired nogo-N2 adaptation reflects a neurophysiological marker of cognitive-motor dysfunction in MS.

scholarly journals WAUC: A Multi-Modal Database for Mental Workload Assessment Under Physical Activity

2020 ◽  
Vol 14 ◽  
Author(s):  
Isabela Albuquerque ◽  
Abhishek Tiwari ◽  
Mark Parent ◽  
Raymundo Cassani ◽  
Jean-François Gagnon ◽  
...  
Keyword(s):  
Physical Activity ◽  
Real World ◽  
Police Officers ◽  
Mental Workload ◽  
Activity Level ◽  
Physiological Data ◽  
Task Load ◽  
Skin Response ◽  
Nasa Task Load Index ◽  
Blood Volume Pulse

Assessment of mental workload is crucial for applications that require sustained attention and where conditions such as mental fatigue and drowsiness must be avoided. Previous work that attempted to devise objective methods to model mental workload were mainly based on neurological or physiological data collected when the participants performed tasks that did not involve physical activity. While such models may be useful for scenarios that involve static operators, they may not apply in real-world situations where operators are performing tasks under varying levels of physical activity, such as those faced by first responders, firefighters, and police officers. Here, we describe WAUC, a multimodal database of mental Workload Assessment Under physical aCtivity. The study involved 48 participants who performed the NASA Revised Multi-Attribute Task Battery II under three different activity level conditions. Physical activity was manipulated by changing the speed of a stationary bike or a treadmill. During data collection, six neural and physiological modalities were recorded, namely: electroencephalography, electrocardiography, breathing rate, skin temperature, galvanic skin response, and blood volume pulse, in addition to 3-axis accelerometry. Moreover, participants were asked to answer the NASA Task Load Index questionnaire after each experimental section, as well as rate their physical fatigue level on the Borg fatigue scale. In order to bring our experimental setup closer to real-world situations, all signals were monitored using wearable, off-the-shelf devices. In this paper, we describe the adopted experimental protocol, as well as validate the subjective, neural, and physiological data collected. The WAUC database, including the raw data and features, subjective ratings, and scripts to reproduce the experiments reported herein will be made available at: http://musaelab.ca/resources/.

scholarly journals Breakfast high in whey protein or carbohydrates improves coping with workload in healthy subjects

2013 ◽  
Vol 110 (9) ◽  
pp. 1712-1721 ◽  
Author(s):  
Nora Sihvola ◽  
Riitta Korpela ◽  
Andreas Henelius ◽  
Anu Holm ◽  
Minna Huotilainen ◽  
...  
Keyword(s):  
Heart Rate ◽  
Task Performance ◽  
Whey Protein ◽  
Healthy Subjects ◽  
Mental Workload ◽  
Controlled Study ◽  
Task Load ◽  
Plasma Tryptophan ◽  
Nasa Tlx ◽  
Nasa Task Load Index

Dietary components may affect brain function and influence behaviour by inducing the synthesis of neurotransmitters. The aim of the present study was to examine the influence of consumption of a whey protein-containing breakfast drink v. a carbohydrate drink v. control on subjective and physiological responses to mental workload in simulated work. In a randomised cross-over design, ten healthy subjects (seven women, median age 26 years, median BMI 23 kg/m2) participated in a single-blinded, placebo-controlled study. The subjects performed demanding work-like tasks after having a breakfast drink high in protein (HP) or high in carbohydrate (HC) or a control drink on separate sessions. Subjective states were assessed using the NASA Task Load Index (NASA-TLX), the Karolinska sleepiness scale (KSS) and the modified Profile of Mood States. Heart rate was recorded during task performance. The ratio of plasma tryptophan (Trp) to the sum of the other large neutral amino acids (LNAA) and salivary cortisol were also analysed. The plasma Trp:LNAA ratio was 30 % higher after the test drinks HP (median 0·13 (μmol/l)/(μmol/l)) and HC (median 0·13 (μmol/l)/(μmol/l)) than after the control drink (median 0·10 (μmol/l)/(μmol/l)). The increase in heart rate was smaller after the HP (median 2·7 beats/min) and HC (median 1·9 beats/min) drinks when compared with the control drink (median 7·2 beats/min) during task performance. Subjective sleepiness was reduced more after the HC drink (median KSS − 1·5) than after the control drink (median KSS − 0·5). There were no significant differences between the breakfast types in the NASA-TLX index, cortisol levels or task performance. We conclude that a breakfast drink high in whey protein or carbohydrates may improve coping with mental tasks in healthy subjects.

Short Vigilance Tasks are Hard Work Even If Time Flies

2016 ◽  
Vol 60 (1) ◽  
pp. 1367-1368 ◽  
Author(s):  
Victor S. Finomore ◽  
Christopher K. McClernon ◽  
Jason R. Amick ◽  
Derrick Pee ◽  
Gregory J. Funke ◽  
...  
Keyword(s):  
Task Performance ◽  
Mental Workload ◽  
Cognitive Task ◽  
Critical Role ◽  
Vigilance Task ◽  
Temporal Context ◽  
Potential Problems ◽  
Human Operators ◽  
Machine Systems ◽  
Manipulation Procedure

Vigilance research has found that observers find the task to be unpleasant and mentally demanding (Warm, Finomore, Vidulich, & Funke, 2015). However sustained attention plays a critical role in numerous operational settings where human operators must monitor automated human-machine systems in the event of potential problems. The current study extended the work from Dillard and his colleagues (Dillard, Warm, Funke, Vidulich, Nelson, Eggemeier, et al., 2013) who explored if there are other dimensions that might affect the workload associated with performing a vigilance task. The area that they explored was the temporal context of the vigilance task on its effects on task performance and perceived mental workload. Borrowing from a temporal manipulation procedure developed by Sackett and colleagues (Sackett, Meyvis, Nelson, Converse & Sackett, 2010) in which they manipulated perceived time progression (PTP) of the participant while they performed a cognitive task. Sackett et al., (2010) manipulated the PTP by developing their studies to deceive the participant into thinking the task they were performing was longer or shorter than the actual time. Upon completion of the task, participants filled out questionnaires related to the hedonic and temporal evaluation of the task. Participants that were told the task was longer than they actually participated for (time flies conditions) rated times as flying and the task more as more enjoyable.

Sign in / Sign up

Export Citation Format

Share Document