Experiment data: Human-in-the-loop decision support in process control rooms

Abstract

These datasets contain measures from multi-modal data sources. They include objective and subjective measures commonly used to determine cognitive states of workload, situational awareness, stress, and fatigue using data collection tools such as NASA-TLX, SART, eye tracking, EEG, Health Monitoring Watch, a survey to assess training, and a think-aloud situational awareness assessment following the SPAM methodology. Also, data from a simulation formaldehyde production plant based on the interaction of the participants in a controlled control room experimental setting is included. The interaction with the plant is based on a human-in-the-loop alarm handling and process control task flow, which includes Monitoring, Alarm Handling, Recovery planning, and intervention (Troubleshooting, Control and Evaluation). Data was collected from 92 participants, split into four groups while they underwent the described task flow. Each participant tested three scenarios lasting 15-18 min with a -10-min survey completion and break period in between using different combinations of decision support tools. The decision support tools tested and varied for each group include alarm prioritisation vs. none, paper-based vs. Digitised screen-based procedures, and an AI recommendation system. This is relevant to compare current practices in the industry and the impact on operators' performance and safety. It is also applicable to validate proposed solutions for the industry. A statistical analysis was performed on the dataset to compare the outcomes of the different groups. Decision-makers can use these datasets for control room design and optimisation, process safety engineers, system engineers, human factors engineers, all in process industries, and researchers in similar or close domains.

Keywords: Biometrics; Decision support; Design of experiment; Human–machine interaction; Process industry; Safety; Simulated study; Surveys.

Fig. 1

Contents of the dataset (Hierarchy Diagram).

Fig. 2

Screenshot of screen recording.

Fig. 3

Example Screenshot of Watch Recording.

Fig. 4

Sample of the general information data.

Fig. 5

Training questionnaire data sample.

Fig. 6

Sample of the SPAM dataset.

Fig. 7

Sample of the NASA-TLX dataset.

Fig. 8

Sample of the SART dataset.

Fig. 9

Sample of the support system dataset.

Fig. 10

Sample of the AI question.

Fig. 11

Scenario 1 task flow and events (Amazu C. W. et al., 2023).

Fig. 12

Scenario 2 Task flow and events.

Fig. 13

Scenario 3 Task flow and events.