Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Jan;36(1):1-8.
doi: 10.1097/WNP.0000000000000534.

Interrater and Intrarater Agreement in Neonatal Electroencephalogram Background Scoring

Shavonne L Massey  1   2   3 , Haochang Shou  4 , Robert Clancy  1   2   3 , Marissa DiGiovine  1   2   3 , Mark P Fitzgerald  1   2   3 , France W Fung  1   2   3 , John Farrar  2   4   5 , Nicholas S Abend  1   2   3   4
Affiliations

Interrater and Intrarater Agreement in Neonatal Electroencephalogram Background Scoring

Shavonne L Massey et al. J Clin Neurophysiol. 2019 Jan.

Abstract

Purpose: Many neonates undergo electroencephalogram (EEG) monitoring to identify and manage acute symptomatic seizures. Information about brain function contained in the EEG background data may also help predict neurobehavioral outcomes. For EEG background features to be useful as prognostic indicators, the interpretation of these features must be standardized across electroencephalographers. We aimed at determining the interrater and intrarater agreement among electroencephalographers interpreting neonatal EEG background patterns.

Methods: Five neonatal electroencephalographers reviewed 5-to-7.5-minute epochs of EEG from full-term neonates who underwent continuous conventional EEG monitoring. The EEG assessment tool used to classify background patterns was based on the American Clinical Neurophysiology Society's guideline for neonatal EEG terminology. Interrater and intrarater agreement were measured using Kappa coefficients.

Results: Interrater agreement was consistently highest for voltage (binary: substantial, kappa = 0.783; categorical: moderate, kappa = 0.562), seizure presence (fair-substantial; kappa = 0.375-0.697), continuity (moderate; kappa = 0.481), burst voltage (moderate; kappa = 0.574), suppressed background presence (moderate-substantial; kappa = 0.493-0.643), delta activity presence (fair-moderate; kappa = 0.369-0.432), theta activity presence (fair-moderate; kappa = 0.347-0.600), presence of graphoelements (fair; kappa = 0.381), and overall impression (binary: moderate, kappa = 0.495; categorical: fair-moderate, kappa = 0.347, 0.465). Agreement was poor or inconsistent for all other patterns. Intrarater agreement was variable, with highest average agreement for voltage (binary: substantial, kappa = 0.75; categorical: substantial, kappa = 0.714) and highest consistent agreement for continuity (moderate-substantial; kappa = 0.43-0.67) and overall impression (moderate-substantial; kappa = 0.42-0.68).

Conclusions: This study demonstrates substantial variability in neonatal EEG background interpretation across electroencephalographers, indicating a need for educational and technological strategies aimed at improving performance.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest and Source of Funding:

No declared conflicts of interest.

References

    1. Glass HC, Kan J, Bonifacio SL, Ferriero DM. Neonatal seizures: treatment practices among term and preterm infants. Pediatr Neurol 2012;46:111–5. - PMC - PubMed
    1. Boylan G, Burgoyne L, Moore C, O’Flaherty B, Rennie J. An international survey of EEG use in the neonatal intensive care unit. Acta Paediatr 2010;99:1150–5. - PubMed
    1. Filan PM, Inder TE, Anderson PJ, Doyle LW, Hunt RW. Monitoring the neonatal brain: a survey of current practice among Australian and New Zealand neonatologists. J Paediatr Child Health 2007;43:557–9. - PubMed
    1. Shellhaas RA, Chang T, Tsuchida T, et al. The American Clinical Neurophysiology Society’s Guideline on Continuous Electroencephalography Monitoring in Neonates. J Clin Neurophysiol 2011;28:611–7. - PubMed
    1. Holmes G, Rowe J, Hafford J, Schmidt R, Testa M, Zimmerman A. Prognostic value of the electroencephalogram in neonatal asphyxia. Electroencephalogr Clin Neurophysiol 1982;53:60–72. - PubMed