Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Jun 5:25:e43113.
doi: 10.2196/43113.

The Development of a Chatbot Technology to Disseminate Post-COVID-19 Information: Descriptive Implementation Study

Mayssam Nehme  1 , Franck Schneider  2 , Anne Perrin  3 , Wing Sum Yu  2 , Simon Schmitt  2 , Guillemette Violot  2 , Aurelie Ducrot  1 , Frederique Tissandier  2 , Klara Posfay-Barbe  3   4 , Idris Guessous  1   4
Affiliations

The Development of a Chatbot Technology to Disseminate Post-COVID-19 Information: Descriptive Implementation Study

Mayssam Nehme et al. J Med Internet Res. .

Abstract

Background: Post-COVID-19, or long COVID, has now affected millions of individuals, resulting in fatigue, neurocognitive symptoms, and an impact on daily life. The uncertainty of knowledge around this condition, including its overall prevalence, pathophysiology, and management, along with the growing numbers of affected individuals, has created an essential need for information and disease management. This has become even more critical in a time of abundant online misinformation and potential misleading of patients and health care professionals.

Objective: The RAFAEL platform is an ecosystem created to address the information about and management of post-COVID-19, integrating online information, webinars, and chatbot technology to answer a large number of individuals in a time- and resource-limited setting. This paper describes the development and deployment of the RAFAEL platform and chatbot in addressing post-COVID-19 in children and adults.

Methods: The RAFAEL study took place in Geneva, Switzerland. The RAFAEL platform and chatbot were made available online, and all users were considered participants of this study. The development phase started in December 2020 and included developing the concept, the backend, and the frontend, as well as beta testing. The specific strategy behind the RAFAEL chatbot balanced an accessible interactive approach with medical safety, aiming to relay correct and verified information for the management of post-COVID-19. Development was followed by deployment with the establishment of partnerships and communication strategies in the French-speaking world. The use of the chatbot and the answers provided were continuously monitored by community moderators and health care professionals, creating a safe fallback for users.

Results: To date, the RAFAEL chatbot has had 30,488 interactions, with an 79.6% (6417/8061) matching rate and a 73.2% (n=1795) positive feedback rate out of the 2451 users who provided feedback. Overall, 5807 unique users interacted with the chatbot, with 5.1 interactions per user, on average, and 8061 stories triggered. The use of the RAFAEL chatbot and platform was additionally driven by the monthly thematic webinars as well as communication campaigns, with an average of 250 participants at each webinar. User queries included questions about post-COVID-19 symptoms (n=5612, 69.2%), of which fatigue was the most predominant query (n=1255, 22.4%) in symptoms-related stories. Additional queries included questions about consultations (n=598, 7.4%), treatment (n=527, 6.5%), and general information (n=510, 6.3%).

Conclusions: The RAFAEL chatbot is, to the best of our knowledge, the first chatbot developed to address post-COVID-19 in children and adults. Its innovation lies in the use of a scalable tool to disseminate verified information in a time- and resource-limited environment. Additionally, the use of machine learning could help professionals gain knowledge about a new condition, while concomitantly addressing patients' concerns. Lessons learned from the RAFAEL chatbot will further encourage a participative approach to learning and could potentially be applied to other chronic conditions.

Keywords: COVID-19; PASC; caregiver; chatbot; children; communication; conversational agent; digital surveillance; disease management; dissemination; information; long COVID; medical technology; online platform; pediatric; postacute sequelae of SARS-CoV-2; post–COVID-19.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: None declared.

Figures

Figure 1
Figure 1
Chatbot algorithm and pathway from the initial user query to the final matching and answer. NLP: natural language processing.
See this image and copyright information in PMC

References

    1. A clinical case defintion of post COVID-19 condition by a Delphi consensus. World Health Organization. 2021. Oct 6, [2021-10-10]. https://apps.who.int/iris/bitstream/handle/10665/345824/WHO-2019-nCoV-Po... .
    1. Nehme M, Braillard O, Chappuis F, Courvoisier DS, Guessous I, CoviCare Study Team Prevalence of symptoms more than seven months after diagnosis of symptomatic COVID-19 in an outpatient setting. Ann Intern Med. 2021 Sep;174(9):1252–1260. doi: 10.7326/M21-0878. https://www.acpjournals.org/doi/abs/10.7326/M21-0878?url_ver=Z39.88-2003... - DOI - DOI - PMC - PubMed
    1. Logue JK, Franko NM, McCulloch DJ, McDonald D, Magedson A, Wolf CR, Chu HY. Sequelae in adults at 6 months after COVID-19 infection. JAMA Netw Open. 2021 Feb 01;4(2):e210830. doi: 10.1001/jamanetworkopen.2021.0830. https://europepmc.org/abstract/MED/33606031 2776560 - DOI - PMC - PubMed
    1. Borch L, Holm M, Knudsen M, Ellermann-Eriksen S, Hagstroem S. Long COVID symptoms and duration in SARS-CoV-2 positive children - a nationwide cohort study. Eur J Pediatr. 2022 Apr 09;181(4):1597–1607. doi: 10.1007/s00431-021-04345-z. https://europepmc.org/abstract/MED/35000003 10.1007/s00431-021-04345-z - DOI - PMC - PubMed
    1. Molteni E, Sudre CH, Canas LS, Bhopal SS, Hughes RC, Antonelli M, Murray B, Kläser K, Kerfoot E, Chen L, Deng J, Hu C, Selvachandran S, Read K, Capdevila Pujol J, Hammers A, Spector TD, Ourselin S, Steves CJ, Modat M, Absoud M, Duncan EL. Illness duration and symptom profile in symptomatic UK school-aged children tested for SARS-CoV-2. Lancet Child Adolesc Health. 2021 Oct;5(10):708–718. doi: 10.1016/S2352-4642(21)00198-X. https://linkinghub.elsevier.com/retrieve/pii/S2352-4642(21)00198-X S2352-4642(21)00198-X - DOI - PMC - PubMed

Publication types