Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Jan;25(1):61-66.
doi: 10.5811/westjem.61059.

The Accuracy of Predictive Analytics in Forecasting Emergency Department Volume Before and After Onset of COVID-19

Anthony M Napoli  1 , Rachel Smith-Shain  1 , Timmy Lin  1 , Janette Baird  1
Affiliations

The Accuracy of Predictive Analytics in Forecasting Emergency Department Volume Before and After Onset of COVID-19

Anthony M Napoli et al. West J Emerg Med. 2024 Jan.

Abstract

Introduction: Big data and improved analytic techniques, such as triple exponential smoothing (TES), allow for prediction of emergency department (ED) volume. We sought to determine 1) which method of TES was most accurate in predicting pre-coronavirus 2019 (COVID-19), during COVID-19, and post-COVID-19 ED volume; 2) how the pandemic would affect TES prediction accuracy; and 3) whether TES would regain its pre-COVID-19 accuracy in the early post-pandemic period.

Methods: We studied monthly volumes of four EDs with a combined annual census of approximately 250,000 visits in the two years prior to, during the 25-month COVID-19 pandemic, and the 14 months following. We compared the accuracy of four models of TES forecasting by measuring the mean absolute percentage error (MAPE), mean square errors (MSE) and mean absolute deviation (MAD), comparing actual to predicted monthly volume.

Results: In the 23 months prior to COVID-19, the overall average MAPE across four forecasting methods was 3.88% ± 1.88% (range 2.41-6.42% across the four ED sites), rising to 15.21% ± 6.67% during the 25-month COVID-19 period (range 9.97-25.18% across the four sites), and falling to 6.45% ± 3.92% in the 14 months after (range 3.86-12.34% across the four sites). The 12-month Holt-Winter method had the greatest accuracy prior to COVID-19 (3.18% ± 1.65%) and during the pandemic (11.31% ± 4.81%), while the 24-month Holt-Winter offered the best performance following the pandemic (5.91% ± 3.82%). The pediatric ED had an average MAPE more than twice that of the average MAPE of the three adult EDs (6.42% ± 1.54% prior to COVID-19, 25.18% ± 9.42% during the pandemic, and 12.34% ± 0.55% after COVID-19). After the onset of the pandemic, there was no immediate improvement in forecasting model accuracy until two years later; however, these still had not returned to baseline accuracy levels.

Conclusion: We were able to identify a TES model that was the most accurate. Most of the models saw an approximate four-fold increase in MAPE after onset of the pandemic. In the months following the most severe waves of COVID-19, we saw improvements in the accuracy of forecasting models, but they were not back to pre-COVID-19 accuracies.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No author has professional or financial relationships with any companies that are relevant to this study. There are no conflicts of interest or sources of funding to declare.

Figures

Figure 1.
Figure 1.
Adult emergency department #1 trend in actual and forecasted patient volume over time. COVID-19, coronavirus 2019.
See this image and copyright information in PMC

References

    1. Jones S, Thomas A, Evans RS, et al. . Forecasting daily patient volumes in the emergency department. Acad Emerg Medi. 2008;15(2):159–70. - PubMed
    1. Tandberg D, Qualls C. Time series forecasts of emergency department patient volume, length of stay, and acuity. Ann Emerg Med. 1994;23(2):299–306. - PubMed
    1. Calegari R, Fogliatto FS, Lucini FR, et al. . Forecasting daily volume and acuity of patients in the emergency department. Comput Math Meth Med. 2016;2016:3863268. - PMC - PubMed
    1. Etu EE, Monplaisir L, Masoud S, et al. . A comparison of univariate and multivariate forecasting models predicting emergency department patient arrivals during the COVID-19 pandemic. Healthcare (Basel). 2022;10(6):1120. - PMC - PubMed
    1. Erkamp NS, van Dalen DH, de Vries E. Predicting emergency department visits in a large teaching hospital. Int J Emerg. 2021;14(1):34. - PMC - PubMed