Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Jan 27;10(1):e34038.
doi: 10.2196/34038.

Technology-Enabled, Evidence-Driven, and Patient-Centered: The Way Forward for Regulating Software as a Medical Device

Jane Elizabeth Carolan  1   2   3 , John McGonigle  3 , Andrea Dennis  3 , Paula Lorgelly  2 , Amitava Banerjee  1   4   5
Affiliations

Technology-Enabled, Evidence-Driven, and Patient-Centered: The Way Forward for Regulating Software as a Medical Device

Jane Elizabeth Carolan et al. JMIR Med Inform. .

Abstract

Artificial intelligence (AI) is a broad discipline that aims to understand and design systems that display properties of intelligence. Machine learning (ML) is a subset of AI that describes how algorithms and models can assist computer systems in progressively improving their performance. In health care, an increasingly common application of AI/ML is software as a medical device (SaMD), which has the intention to diagnose, treat, cure, mitigate, or prevent disease. AI/ML includes either "locked" or "continuous learning" algorithms. Locked algorithms consistently provide the same output for a particular input. Conversely, continuous learning algorithms, in their infancy in terms of SaMD, modify in real-time based on incoming real-world data, without controlled software version releases. This continuous learning has the potential to better handle local population characteristics, but with the risk of reinforcing existing structural biases. Continuous learning algorithms pose the greatest regulatory complexity, requiring seemingly continuous oversight in the form of special controls to ensure ongoing safety and effectiveness. We describe the challenges of continuous learning algorithms, then highlight the new evidence standards and frameworks under development, and discuss the need for stakeholder engagement. The paper concludes with 2 key steps that regulators need to address in order to optimize and realize the benefits of SaMD: first, international standards and guiding principles addressing the uniqueness of SaMD with a continuous learning algorithm are required and second, throughout the product life cycle and appropriate to the SaMD risk classification, there needs to be continuous communication between regulators, developers, and SaMD end users to ensure vigilance and an accurate understanding of the technology.

Keywords: Artificial intelligence; algorithm; informatics; machine learning; risk assessment; software.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: JC is employed by University College London (UCL) based at Perspectum Ltd through an Innovate UK grant: Knowledge Transfer Partnership (KTP). AB and PL receive research funding from the Perspectum/Innovate UK grant. AD and JMG are employees of Perspectum Ltd.

References

    1. Panch T, Szolovits P, Atun R. Artificial intelligence, machine learning and health systems. J Glob Health. 2018 Dec;8(2):020303. doi: 10.7189/jogh.08.020303. doi: 10.7189/jogh.08.020303.jogh-08-020303 - DOI - DOI - PMC - PubMed
    1. Chen S, Banerjee A. Machine learning: a long way from implementation in cardiovascular disease. Heart. 2020 Mar;106(5):318–320. doi: 10.1136/heartjnl-2019-316030.heartjnl-2019-316030 - DOI - PubMed
    1. IMDRF SaMD Working Group Software as a Medical Device (SaMD): Key Definitions. 2013. [2020-09-27]. http://www.imdrf.org/docs/imdrf/final/technical/imdrf-tech-131209-samd-k... .
    1. US Food and Drug Administration . Artificial Intelligence and Machine Learning in Software as a Medical Device. White Oak, MD: US Food and Drug Administration; 2019. [2022-01-18]. https://tinyurl.com/49w63ey6 .
    1. Turpin R, Hoefer E, Lewelling J, Baird P. Machine Learning AI in Medical Devices: Adapting Regulatory Frameworks and Standards to Ensure Safety and Performance. 2020. [2022-01-18]. https://tinyurl.com/49w63ey6 .

LinkOut - more resources