Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2021 Aug;30(1):56-60.
doi: 10.1055/s-0041-1726490. Epub 2021 Apr 21.

Managing Pandemic Responses with Health Informatics - Challenges for Assessing Digital Health Technologies

Farah Magrabi  1 , Elske Ammenwerth  2 , Catherine K Craven  3 , Kathrin Cresswell  4 , Nicolet F De Keizer  5 , Stephanie K Medlock  5 , Philip J Scott  6 , Zoie Shui-Yee Wong  7 , Andrew Georgiou  1
Affiliations
Review

Managing Pandemic Responses with Health Informatics - Challenges for Assessing Digital Health Technologies

Farah Magrabi et al. Yearb Med Inform. 2021 Aug.

Abstract

Objectives: To highlight the role of technology assessment in the management of the COVID-19 pandemic.

Method: An overview of existing research and evaluation approaches along with expert perspectives drawn from the International Medical Informatics Association (IMIA) Working Group on Technology Assessment and Quality Development in Health Informatics and the European Federation for Medical Informatics (EFMI) Working Group for Assessment of Health Information Systems.

Results: Evaluation of digital health technologies for COVID-19 should be based on their technical maturity as well as the scale of implementation. For mature technologies like telehealth whose efficacy has been previously demonstrated, pragmatic, rapid evaluation using the complex systems paradigm which accounts for multiple sociotechnical factors, might be more suitable to examine their effectiveness and emerging safety concerns in new settings. New technologies, particularly those intended for use on a large scale such as digital contract tracing, will require assessment of their usability as well as performance prior to deployment, after which evaluation should shift to using a complex systems paradigm to examine the value of information provided. The success of a digital health technology is dependent on the value of information it provides relative to the sociotechnical context of the setting where it is implemented.

Conclusion: Commitment to evaluation using the evidence-based medicine and complex systems paradigms will be critical to ensuring safe and effective use of digital health technologies for COVID-19 and future pandemics. There is an inherent tension between evaluation and the imperative to urgently deploy solutions that needs to be negotiated.

PubMed Disclaimer

Conflict of interest statement

Disclosure The authors report no conflicts of interest in this work.

References

    1. Mahase E. Covid-19: What do we know about “long covid”? BMJ. 2020:370. - PubMed
    1. Grabowski D C, JoyntMaddox K E. Postacute Care Preparedness for COVID-19: Thinking Ahead. JAMA. 2020;323(20):2007–8. - PMC - PubMed
    1. Budd J, Miller B S, Manning E M, Lampos V, Zhuang M, Edelstein M. Digital technologies in the public-health response to COVID-19. Nat Med. 2020;26(08):1183–92. - PubMed
    1. Whitelaw S, Mamas M A, Topol E, VanSpall H GCl. Applications of digital technology in COVID-19 pandemic planning and response. Lancet Digit Health. 2020;2(08):e435–e440. - PMC - PubMed
    1. Li G, Fan G, Chen Y, Deng Z. What patients “see” doctors in online fever clinics during COVID-19 in Wuhan? J Am Med Inform Assoc. 2020;27(07):1067–71. - PMC - PubMed