An ICEEMDAN and SAX-based method for determining English reading comprehension status using functional near-infrared spectroscopy signals

Abstract

Accurate, rapid, and objective reading comprehension assessments, which are critical in both daily and educational lives, can be effectively conducted using brain signals. In this study, we proposed an improved complementary ensemble empirical mode decomposition with adaptive noise (ICEEMDAN) and symbolic aggregate approximation (SAX)-based method for determining the whole text reading comprehension status in English using functional near-infrared spectroscopy (fNIRS) signals. A total of 450 trials were recorded from 15 healthy participants as they read English texts. To facilitate labeling, participants were asked to rate their comprehension of the text using self-assessment scores, followed by answering a multiple-choice question with four options that comprehensively covered the whole text's content. The proposed method consists of pre-processing, feature extraction, and classification stages. In the pre-processing stage, intrinsic mode functions of the signals were obtained using the ICEEMDAN algorithm. In the feature extraction stage, following the SAX algorithm, statistical features were calculated. The extracted features were classified using the k-NN classifier. The proposed method tested three different labeling strategies: first, labeling the trials according to the responses to multiple-choice questions; second, labeling the trials based on self-assessment scores; and third, labeling the trials using a double-validation labeling strategy based on the intersection sets of the first two strategies. For the three strategies, the k-NN classifier achieved mean classification accuracies of 74.67%, 66.37%, and 89.02%, respectively. The results indicated that the proposed method could assess whole-text reading comprehension status in English.

Fig 1. Experimental flowchart.

Fig 2. Detectors, sources, and channels.

Fig 3. fNIRS signals recording procedure.

Fig 4. Block diagram of the proposed method.

Fig 5. Labeling strategy.

Fig 6. Interpolated fNIRS signal.

Fig 7. Decomposition of the fNIRS signal using ICEEMDAN.

Fig 8. Triple window shifting operation.

Fig 9. PAM graph.

Fig 10. Comparison of mean CAs for DeoxyHb, OxyHb, and TotalHb trials across different IMFs in Strategy 1.

Fig 11. PAM graphs of the runs in Strategy 1.

Fig 12. Comparison of mean CAs for DeoxyHb, OxyHb, and TotalHb trials across different IMFs in Strategy 2.

Fig 13. Confusion matrices of Strategy 2 for DeoxyHb IMF3 trials across five runs.

Fig 14. Comparison of mean CAs for DeoxyHb, OxyHb, and TotalHb trials across different IMFs in Strategy 3.

Fig 15. PAM graphs of the runs in Strategy 3.