Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 Mar 4;25(1):857.
doi: 10.1186/s12889-025-21998-9.

Evaluation of the epidemic intelligence from open sources (EIOS) system for the early detection of outbreaks and health emergencies in the African region

George Sie Williams  1   2 , Etien Luc Koua  1 , Philip Abdelmalik  3 , Freddy Kambale  4 , Emerencienne Kibangou  4 , Joyce Nguna  5 , Charles Okot  1 , Godwin Akpan  1 , Fleury Moussana  1 , Jean Paul Kimenyi  4 , Ramazani Zaza  5 , Raquel Medialdea Carerra  3 , Yasmin Rabiyan  3 , Mark Woolhouse  2 , Joseph Okeibunor  6 , Abdou Salam Gueye  1
Affiliations

Evaluation of the epidemic intelligence from open sources (EIOS) system for the early detection of outbreaks and health emergencies in the African region

George Sie Williams et al. BMC Public Health. .

Abstract

Introduction: Public health today is challenged by a wide array of hazards that threaten humans, often resulting in high rates of morbidity and mortality when they strike. These events should be detected and responded to as early as possible to save lives and minimize their impact. The Epidemic Intelligence from Open Sources (EIOS) system leverages natural language processing and machine learning techniques for the early detection of public health events from open-source information using an all-hazards approach. In this study, we quantitatively evaluate the performance of the EIOS system for the early detection of outbreaks and health emergencies in the African region.

Methods: We retrospectively searched the EIOS system to determine if a signal was found on the system for each public health event notified to WHO by the 47 countries in the African region from 2018 to 2023. We computed the proportion of public health event detected by the EIOS system, its sensitivity, harmonic mean, and timeliness. We assessed the association between selected predictors (year of report, hazard type, subregion, source type, and language of source) and early detection of public health events on the EIOS system using a multivariable logistic regression model.

Results: We found a detection proportion of 81.0% and a sensitivity of 47.4%, with a harmonic mean of 59.8%. The proportion of events detected steadily increased over the years and sensitivity increased from a baseline of 44.1% in 2018 to 47.3% in 2023. Signals for more than 80.0% of the public health events notified to WHO in 28 countries were detected on the EIOS system. In 22 countries, signals of at least 50% of the public health events were detected early, that is, before official notification from the National Authorities to WHO. The median time between detection on the EIOS system and notification to WHO was zero days. We found that the type of hazard (infectious and zoonotic), the subregion (West and Central Africa), and the type of source (medical and social media) were associated with early detection.

Conclusions: We conclude that the EIOS system performed well in detecting public health events in the African region early. However, some improvements are needed. We recommend increasing social media and local community radio sources on the EIOS system.

PubMed Disclaimer

Conflict of interest statement

Declarations. Ethical clearance: This is an analysis of programme data and does not require ethical clearance by our organization. Consent to publish: This analysis did not involve human participation and as such consent to publish is not applicable. Competing interests: The authors declare no competing interests.

Figures

Fig. 1
Fig. 1
Proportion of public health events in the African region detected by the EIOS systems by status (early, late, not detected), 2018–2023
Fig. 2
Fig. 2
Map showing detection status and detection rates of public health events on the EIOS system from 2018–2023
See this image and copyright information in PMC

References

    1. Baker RE, Mahmud AS, Miller IF, Rajeev M, Rasambainarivo F, Rice BL et al. Infectious disease in an era of global change. Nat Rev Microbiol [Internet]. 2022;20(4):193–205. Available from: https://www.nature.com/articles/s41579-021-00639-z - PMC - PubMed
    1. Murray CJL, King G, Lopez AD, Tomijima N, Krug EG. Armed conflict as a public health problem. Br Med J [Internet]. 2002;324(7333):346–9. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1122272/pdf/346.pdf - PMC - PubMed
    1. Suhr F, Steinert JI. Epidemiology of floods in sub-Saharan Africa: a systematic review of health outcomes. BMC Public Health [Internet]. 2022;22(1):1–15. Available from: 10.1186/s12889-022-12584-4 - PMC - PubMed
    1. WHO. Africa faces rising climate-linked health emergencies| WHO| Regional Office for Africa [Internet]. 2022. Available from: https://www.afro.who.int/news/africa-faces-rising-climate-linked-health-...
    1. Nweke OC, Sanders WH. Modern environmental health hazards: A public health issue of increasing significance in Africa. Environ Health Perspect [Internet]. 2009;117(6):863–70. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2702398/pdf/ehp-117-863.pdf - PMC - PubMed

Publication types

LinkOut - more resources