Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Feb 22:17:1132290.
doi: 10.3389/fnins.2023.1132290. eCollection 2023.

Single-trial P300 classification algorithm based on centralized multi-person data fusion CNN

Pu Du  1 , Penghai Li  1 , Longlong Cheng  1   2 , Xueqing Li  1 , Jianxian Su  1
Affiliations

Single-trial P300 classification algorithm based on centralized multi-person data fusion CNN

Pu Du et al. Front Neurosci. .

Abstract

Introduction: Currently, it is still a challenge to detect single-trial P300 from electroencephalography (EEG) signals. In this paper, to address the typical problems faced by existing single-trial P300 classification, such as complex, time-consuming and low accuracy processes, a single-trial P300 classification algorithm based on multiplayer data fusion convolutional neural network (CNN) is proposed to construct a centralized collaborative brain-computer interfaces (cBCI) for fast and highly accurate classification of P300 EEG signals.

Methods: In this paper, two multi-person data fusion methods (parallel data fusion and serial data fusion) are used in the data pre-processing stage to fuse multi-person EEG information stimulated by the same task instructions, and then the fused data is fed as input to the CNN for classification. In building the CNN network for single-trial P300 classification, the Conv layer was first used to extract the features of single-trial P300, and then the Maxpooling layer was used to connect the Flatten layer for secondary feature extraction and dimensionality reduction, thereby simplifying the computation. Finally batch normalisation is used to train small batches of data in order to better generalize the network and speed up single-trial P300 signal classification.

Results: In this paper, the above new algorithms were tested on the Kaggle dataset and the Brain-Computer Interface (BCI) Competition III dataset, and by analyzing the P300 waveform features and EEG topography and the four standard evaluation metrics, namely Accuracy, Precision, Recall and F1-score,it was demonstrated that the single-trial P300 classification algorithm after two multi-person data fusion CNNs significantly outperformed other classification algorithms.

Discussion: The results show that the single-trial P300 classification algorithm after two multi-person data fusion CNNs significantly outperformed the single-person model, and that the single-trial P300 classification algorithm with two multi-person data fusion CNNs involves smaller models, fewer training parameters, higher classification accuracy and improves the overall P300-cBCI classification rate and actual performance more effectively with a small amount of sample information compared to other algorithms.

Keywords: P300 classification; centralized collaborative BCI; convolutional neural networks; multi-person data fusion; single-trial.

PubMed Disclaimer

Conflict of interest statement

LC was employed by the China Electronics Cloud Brain (Tianjin) Technology Co., Ltd. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Figures

FIGURE 1
FIGURE 1
Structure of centralized collaborative brain-computer interfaces (cBCI) system.
FIGURE 2
FIGURE 2
P300 speller matrix and corresponding row/column labels.
FIGURE 3
FIGURE 3
Schematic diagram of parallel data fusion and serial data fusion of multi-person data.
FIGURE 4
FIGURE 4
P300 characteristic distribution. (A,B) Single-person model. (C) Centralized parallel data fusion. (D) Centralized serial data fusion.
FIGURE 5
FIGURE 5
Electroencephalographic topography. (A,B) Single-person model. (C) Centralized parallel data fusion. (D) Centralized serial data fusion.
FIGURE 6
FIGURE 6
Single-trial P300 classification results of a centralized multi-person data fusion convolutional neural network (CNN) for groups with different numbers of participants.
See this image and copyright information in PMC

References

    1. Cecotti H., Graser A. (2010). Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE Trans. Pattern Anal. Mach. Intell. 33 433–445. 10.1109/TPAMI.2010.125 - DOI - PubMed
    1. David C., Omar M., Antelis M. (2020). Single-option P300-BCI performance is affected by visual stimulation conditions. Sensors 20:7198. 10.3390/S20247198 - DOI - PMC - PubMed
    1. De Venuto D., Mezzina G. (2021). A single-trial P300 detector based on symbolized EEG and autoencoded-(1D) CNN to improve ITR performance in BCIs. Sensors 21:3961. 10.3390/S21123961 - DOI - PMC - PubMed
    1. Gao W., Yu T., Yu J., Gu Z., Li K., Huang Y., et al. (2021). Learning invariant patterns based on a convolutional neural network and big electroencephalography data for subject-independent P300 brain-computer interfaces. IEEE Trans. Neural Syst. Rehabil. Eng. 29 1047–1057. 10.1109/TNSRE.2021.3083548 - DOI - PubMed
    1. Gu B., Xu M., Xu L., Chen L., Ke Y., Wang K., et al. (2021). Optimization of task allocation for collaborative brain–computer interface based on motor imagery. Front. Neurosci. 15:683784. 10.3389/FNINS.2021.683784 - DOI - PMC - PubMed

LinkOut - more resources