Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Jun;13(3):271-285.
doi: 10.1007/s11571-019-09523-2. Epub 2019 Jan 29.

Mental fatigue level detection based on event related and visual evoked potentials features fusion in virtual indoor environment

Hachem A Lamti  1 , Mohamed Moncef Ben Khelifa  2 , Vincent Hugel  1
Affiliations

Mental fatigue level detection based on event related and visual evoked potentials features fusion in virtual indoor environment

Hachem A Lamti et al. Cogn Neurodyn. 2019 Jun.

Abstract

The purpose of this work is to set up a model that can estimate the mental fatigue of users based on the fusion of relevant features extracted from Positive 300 (P300) and steady state visual evoked potentials (SSVEP) measured by electroencephalogram. To this end, an experimental protocol describes the induction of P300, SSVEP and mental workload (which leads to mental fatigue by varying time-on-task) in different scenarios where environmental artifacts are controlled (obstacles number, obstacles velocities, ambient luminosity). Ten subjects took part in the experiment (with two suffering from cerebral palsy). Their mission is to navigate along a corridor from a starting point A to a goal point B where specific flickering stimuli are introduced to perform the P300 task. On the other hand, SSVEP task is elicited thanks to 10 Hz flickering lights. Correlated features are considered as inputs to fusion block which estimates mental workload. In order to deal with uncertainties and heterogeneity of P300 and SSVEP features, Dempster-Shafer (D-S) evidential reasoning is introduced. As the goal is to assess the reliability for the estimation of mental fatigue levels, D-S is compared to multi layer perception and linear discriminant analysis. The results show that D-S globally outperforms the other classifiers (although its performance significantly decreases between healthy and palsied groups). Finally we discuss the feasibility of such a fusion proposal in real life situation.

Keywords: BCI; Evidential reasoning; Mental fatigue; P300; SSVEP.

PubMed Disclaimer

Conflict of interest statement

Compliance with ethical standardsAll procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Figures

Fig. 1
Fig. 1
P300 parameters (maximum, minimum amplitudes, latency and period)
Fig. 2
Fig. 2
The general fusion scheme based on D–S theory
Fig. 3
Fig. 3
Experimental platform: the main goal of this platform is to extract physiological indices that can measure motor, cognitive, ocular performance of the user through virtual navigation scenarios. In this manuscript we focus mainly on mental workload and fatigue
Fig. 4
Fig. 4
Experimental platform for P300 induction. The circles correspond to vertical pillars. Ellipses correspond to obstacles laying on the ground
Fig. 5
Fig. 5
Experimental platform for SSVEP induction. The circles correspond to vertical pillars. Ellipses correspond to obstacles laying on the ground. Yellow circles correspond to flashing lights
Fig. 6
Fig. 6
The average of navigation performance (obstacles collisions, navigation time) and subjective ratings for each 30 min chunk
Fig. 7
Fig. 7
EEG correlation illustrated by feature, band-wave,sensor and region
See this image and copyright information in PMC

References

    1. Banerjee S, Khajanchi S, Chaudhuri S. A mathematical model to elucidate brain tumor abrogation by immunotherapy with T11 target structure. PLoS ONE. 2015;40:e123611. - PMC - PubMed
    1. Chew LH, Teo J, Mountstephens J. Aesthetic preference recognition of 3D shapes using EEG. Cognit Neurodyn. 2015;10:165–173. doi: 10.1007/s11571-015-9363-z. - DOI - PMC - PubMed
    1. Cortese S, Ferrin M, Brandeis D, Buitelaar J, Daley D, Dittmann RW, Holtmann M, Santosh P, Stevenson J, Stringaris A, Zuddas A, Sonuga-Barke EJS. Cognitive training for attention-deficit/hyperactivity disorder: meta-analysis of clinical and neuropsychological outcomes from randomized controlled trials. J Am Acad Child Adolesc Psychiatry. 2015;54(3):164–174. doi: 10.1016/j.jaac.2014.12.010. - DOI - PMC - PubMed
    1. Crippa A, Maurits NM, Lorist MM, Roerdink JBTM. Visual computing in biology and medicine: graph averaging as a means to compare multichannel EEG coherence networks and its application to the study of mental fatigue and neurodegenerative disease. Comput Graph. 2011;35(2):265–274. doi: 10.1016/j.cag.2010.12.008. - DOI
    1. Crowley K, Sliney A, Pitt I, Murphy D (2010) Evaluating a brain–computer interface to categorise human emotional response. In: Proceedings of the 2010 10th IEEE International Conference on Advanced Learning Technologies, ICALT ’10. IEEE Computer Society, Washington, pp 276–278