Is artificial intelligence for medical professionals serving the patients? : Protocol for a systematic review on patient-relevant benefits and harms of algorithmic decision-making
- PMID: 39242544
- PMCID: PMC11378383
- DOI: 10.1186/s13643-024-02646-6
Is artificial intelligence for medical professionals serving the patients? : Protocol for a systematic review on patient-relevant benefits and harms of algorithmic decision-making
Abstract
Background: Algorithmic decision-making (ADM) utilises algorithms to collect and process data and develop models to make or support decisions. Advances in artificial intelligence (AI) have led to the development of support systems that can be superior to medical professionals without AI support in certain tasks. However, whether patients can benefit from this remains unclear. The aim of this systematic review is to assess the current evidence on patient-relevant benefits and harms, such as improved survival rates and reduced treatment-related complications, when healthcare professionals use ADM systems (developed using or working with AI) compared to healthcare professionals without AI-related ADM (standard care)-regardless of the clinical issues.
Methods: Following the PRISMA statement, MEDLINE and PubMed (via PubMed), Embase (via Elsevier) and IEEE Xplore will be searched using English free text terms in title/abstract, Medical Subject Headings (MeSH) terms and Embase Subject Headings (Emtree fields). Additional studies will be identified by contacting authors of included studies and through reference lists of included studies. Grey literature searches will be conducted in Google Scholar. Risk of bias will be assessed by using Cochrane's RoB 2 for randomised trials and ROBINS-I for non-randomised trials. Transparent reporting of the included studies will be assessed using the CONSORT-AI extension statement. Two researchers will screen, assess and extract from the studies independently, with a third in case of conflicts that cannot be resolved by discussion.
Discussion: It is expected that there will be a substantial shortage of suitable studies that compare healthcare professionals with and without ADM systems concerning patient-relevant endpoints. This can be attributed to the prioritisation of technical quality criteria and, in some cases, clinical parameters over patient-relevant endpoints in the development of study designs. Furthermore, it is anticipated that a significant portion of the identified studies will exhibit relatively poor methodological quality and provide only limited generalisable results.
Systematic review registration: This study is registered within PROSPERO (CRD42023412156).
Keywords: ADM; Algorithmic decision-making; Artificial intelligence; Decision support; Healthcare professionals; Patient relevant.
© 2024. The Author(s).
Conflict of interest statement
The authors declare that they have no competing interests.
Similar articles
-
Benefits and harms associated with the use of AI-related algorithmic decision-making systems by healthcare professionals: a systematic review.Lancet Reg Health Eur. 2024 Dec 1;48:101145. doi: 10.1016/j.lanepe.2024.101145. eCollection 2025 Jan. Lancet Reg Health Eur. 2024. PMID: 39687669 Free PMC article.
-
Detecting Algorithmic Errors and Patient Harms for AI-Enabled Medical Devices in Randomized Controlled Trials: Protocol for a Systematic Review.JMIR Res Protoc. 2024 Jun 28;13:e51614. doi: 10.2196/51614. JMIR Res Protoc. 2024. PMID: 38941147 Free PMC article.
-
Beyond the black stump: rapid reviews of health research issues affecting regional, rural and remote Australia.Med J Aust. 2020 Dec;213 Suppl 11:S3-S32.e1. doi: 10.5694/mja2.50881. Med J Aust. 2020. PMID: 33314144
-
Should Artificial Intelligence be used to support clinical ethical decision-making? A systematic review of reasons.BMC Med Ethics. 2023 Jul 6;24(1):48. doi: 10.1186/s12910-023-00929-6. BMC Med Ethics. 2023. PMID: 37415172 Free PMC article.
-
Investigating the use of data-driven artificial intelligence in computerised decision support systems for health and social care: A systematic review.Health Informatics J. 2020 Sep;26(3):2138-2147. doi: 10.1177/1460458219900452. Epub 2020 Jan 22. Health Informatics J. 2020. PMID: 31964204
Cited by
-
Benefits and harms associated with the use of AI-related algorithmic decision-making systems by healthcare professionals: a systematic review.Lancet Reg Health Eur. 2024 Dec 1;48:101145. doi: 10.1016/j.lanepe.2024.101145. eCollection 2025 Jan. Lancet Reg Health Eur. 2024. PMID: 39687669 Free PMC article.
References
-
- Araujo T, Helberger N, Kruikemeier S, de Vreese CH. In AI we trust? Perceptions about automated decision-making by artificial intelligence. AI & Soc. 2020;35:611–23. 10.1007/s00146-019-00931-w. 10.1007/s00146-019-00931-w - DOI
MeSH terms
LinkOut - more resources
Full Text Sources