Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Sep:224:106989.
doi: 10.1016/j.cmpb.2022.106989. Epub 2022 Jul 3.

COLET: A dataset for COgnitive workLoad estimation based on eye-tracking

Emmanouil Ktistakis  1 , Vasileios Skaramagkas  2 , Dimitris Manousos  3 , Nikolaos S Tachos  4 , Evanthia Tripoliti  5 , Dimitrios I Fotiadis  4 , Manolis Tsiknakis  2
Affiliations
Free article

COLET: A dataset for COgnitive workLoad estimation based on eye-tracking

Emmanouil Ktistakis et al. Comput Methods Programs Biomed. 2022 Sep.
Free article

Abstract

Background and objective: The cognitive workload is an important component in performance psychology, ergonomics, and human factors. Publicly available datasets are scarce, making it difficult to establish new approaches and comparative studies. In this work, COLET-COgnitive workLoad estimation based on Eye-Tracking dataset is presented.

Methods: Forty-seven (47) individuals' eye movements were monitored as they solved puzzles involving visual search activities of varying complexity and duration. The participants' cognitive workload level was evaluated with the subjective test of NASA-TLX and this score is used as an annotation of the activity. Extensive data analysis was performed in order to derive eye and gaze features from low-level eye recorded metrics, and a range of machine learning models were evaluated and tested regarding the estimation of the cognitive workload level.

Results: The activities induced four different levels of cognitive workload. Multi tasking and time pressure have induced a higher level of cognitive workload than the one induced by single tasking and absence of time pressure. Multi tasking had a significant effect on 17 eye features while time pressure had a significant effect on 7 eye features. Both binary and multi-class identification attempts were performed by testing a variety of well-known classifiers, resulting in encouraging results towards cognitive workload levels estimation, with up to 88% correct predictions between low and high cognitive workload.

Conclusions: Machine learning analysis demonstrated potential in discriminating cognitive workload levels using only eye-tracking characteristics. The proposed dataset includes a much higher sample size and a wider spectrum of eye and gaze metrics than other similar datasets, allowing for the examination of their relations with various cognitive states.

Keywords: Affective computing; Cognitive workload; Eye movements; Eye-tracking; Machine learning; Workload classification.

PubMed Disclaimer

Conflict of interest statement

Declaration of Competing Interest Conflict of Interest and Authorship Conformation Form Please check the following as appropriate:

LinkOut - more resources