scholarly journals Investigating an Integrated Sensor Fusion System for Mental Fatigue Assessment for Demanding Maritime Operations

Sensors ◽  
2020 ◽  
Vol 20 (9) ◽  
pp. 2588
Author(s):  
Thiago Gabriel Monteiro ◽  
Guoyuan Li ◽  
Charlotte Skourup ◽  
Houxiang Zhang
Keyword(s):  
Sensor Fusion ◽  
Situational Awareness ◽  
Assessment Tool ◽  
Mental Fatigue ◽  
Single Subject ◽  
Detection Accuracy ◽  
Fusion System ◽  
Integrated Sensor ◽  
Fatigue Assessment ◽  
Maritime Operations

Human-related issues are currently the most significant factor in maritime causalities, especially in demanding operations that require coordination between two or more vessels and/or other maritime structures. Some of these human-related issues include incorrect, incomplete, or nonexistent following of procedures; lack of situational awareness; and physical or mental fatigue. Among these, mental fatigue is especially dangerous, due to its capacity to reduce reaction time, interfere in the decision-making process, and affect situational awareness. Mental fatigue is also especially hard to identify and quantify. Self-assessment of mental fatigue may not be reliable and few studies have assessed mental fatigue in maritime operations, especially in real time. In this work we propose an integrated sensor fusion system for mental fatigue assessment using physiological sensors and convolutional neural networks. We show, by using a simulated navigation experiment, how data from different sensors can be fused into a robust mental fatigue assessment tool, capable of achieving up to 100 % detection accuracy for single-subject classification. Additionally, the use of different sensors seems to favor the representation of the transition between mental fatigue states.

scholarly journals Optimizing CNN Hyperparameters for Mental Fatigue Assessment in Demanding Maritime Operations

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 40402-40412 ◽  
Author(s):  
Thiago Gabriel Monteiro ◽  
Charlotte Skourup ◽  
Houxiang Zhang
Keyword(s):  
Mental Fatigue ◽  
Fatigue Assessment ◽  
Maritime Operations

scholarly journals A Novel Approach to EEG Speech Activity Detection with Visual Stimuli and Mobile BCI

2021 ◽  
Vol 11 (2) ◽  
pp. 674
Author(s):  
Marianna Koctúrová ◽  
Jozef Juhár
Keyword(s):  
Visual Stimuli ◽  
Computer Interface ◽  
Single Subject ◽  
Detection Accuracy ◽  
The Novel ◽  
Activity Detection ◽  
Speech Activity ◽  
Novel Approach ◽  
Eeg Data ◽  
Speech Activity Detection

With the ever-progressing development in the field of computational and analytical science the last decade has seen a big improvement in the accuracy of electroencephalography (EEG) technology. Studies try to examine possibilities to use high dimensional EEG data as a source for Brain to Computer Interface. Applications of EEG Brain to computer interface vary from emotion recognition, simple computer/device control, speech recognition up to Intelligent Prosthesis. Our research presented in this paper was focused on the study of the problematic speech activity detection using EEG data. The novel approach used in this research involved the use visual stimuli, such as reading and colour naming, and signals of speech activity detectable by EEG technology. Our proposed solution is based on a shallow Feed-Forward Artificial Neural Network with only 100 hidden neurons. Standard features such as signal energy, standard deviation, RMS, skewness, kurtosis were calculated from the original signal from 16 EEG electrodes. The novel approach in the field of Brain to computer interface applications was utilised to calculated additional set of features from the minimum phase signal. Our experimental results demonstrated F1 score of 86.80% and 83.69% speech detection accuracy based on the analysis of EEG signal from single subject and cross-subject models respectively. The importance of these results lies in the novel utilisation of the mobile device to record the nerve signals which can serve as the stepping stone for the transfer of Brain to computer interface technology from technology from a controlled environment to the real-life conditions.

Multimodal Sensor Fusion for Indoor Occupancy Determination

2015 ◽  
Vol 764-765 ◽  
pp. 1319-1323
Author(s):  
Rong Shue Hsiao ◽  
Ding Bing Lin ◽  
Hsin Piao Lin ◽  
Jin Wang Zhou
Keyword(s):  
Bayesian Networks ◽  
Sensor Fusion ◽  
Dynamic Bayesian Networks ◽  
Sensor Nodes ◽  
Detection Accuracy ◽  
Multisensor Fusion ◽  
Fusion Algorithm ◽  
Improve Energy Efficiency ◽  
Occupancy Detection ◽  
Automation Systems

Pyroelectric infrared (PIR) sensors can detect the presence of human without the need to carry any device, which are widely used for human presence detection in home/office automation systems in order to improve energy efficiency. However, PIR detection is based on the movement of occupants. For occupancy detection, PIR sensors have inherent limitation when occupants remain relatively still. Multisensor fusion technology takes advantage of redundant, complementary, or more timely information from different modal sensors, which is considered an effective approach for solving the uncertainty and unreliability problems of sensing. In this paper, we proposed a simple multimodal sensor fusion algorithm, which is very suitable to be manipulated by the sensor nodes of wireless sensor networks. The inference algorithm was evaluated for the sensor detection accuracy and compared to the multisensor fusion using dynamic Bayesian networks. The experimental results showed that a detection accuracy of 97% in room occupancy can be achieved. The accuracy of occupancy detection is very close to that of the dynamic Bayesian networks.

Sign in / Sign up

Export Citation Format

Share Document