Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Observational Study
. 2023 Oct 16:25:e42384.
doi: 10.2196/42384.

Psychometric Properties of a Machine Learning-Based Patient-Reported Outcome Measure on Medication Adherence: Single-Center, Cross-Sectional, Observational Study

Virginie Korb-Savoldelli  1   2 , Yohann Tran  3   4 , Germain Perrin  1   5 , Justine Touchard  1 , Jean Pastre  6 , Adrien Borowik  1 , Corine Schwartz  1 , Aymeric Chastel  1 , Eric Thervet  7   8 , Michel Azizi  4   9 , Laurence Amar  4   9 , Benjamin Kably  4   10 , Armelle Arnoux  3   4   5 , Brigitte Sabatier  1   2   5
Affiliations
Observational Study

Psychometric Properties of a Machine Learning-Based Patient-Reported Outcome Measure on Medication Adherence: Single-Center, Cross-Sectional, Observational Study

Virginie Korb-Savoldelli et al. J Med Internet Res. .

Abstract

Background: Medication adherence plays a critical role in controlling the evolution of chronic disease, as low medication adherence may lead to worse health outcomes, higher mortality, and morbidity. Assessment of their patients' medication adherence by clinicians is essential for avoiding inappropriate therapeutic intensification, associated health care expenditures, and the inappropriate inclusion of patients in time- and resource-consuming educational interventions. In both research and clinical practices the most extensively used measures of medication adherence are patient-reported outcome measures (PROMs), because of their ability to capture subjective dimensions of nonadherence. Machine learning (ML), a subfield of artificial intelligence, uses computer algorithms that automatically improve through experience. In this context, ML tools could efficiently model the complexity of and interactions between multiple patient behaviors that lead to medication adherence.

Objective: This study aimed to create and validate a PROM on medication adherence interpreted using an ML approach.

Methods: This cross-sectional, single-center, observational study was carried out a French teaching hospital between 2021 and 2022. Eligible patients must have had at least 1 long-term treatment, medication adherence evaluation other than a questionnaire, the ability to read or understand French, an age older than 18 years, and provided their nonopposition. Included adults responded to an initial version of the PROM composed of 11 items, each item being presented using a 4-point Likert scale. The initial set of items was obtained using a Delphi consensus process. Patients were classified as poorly, moderately, or highly adherent based on the results of a medication adherence assessment standard used in the daily practice of each outpatient unit. An ML-derived decision tree was built by combining the medication adherence status and PROM responses. Sensitivity, specificity, positive and negative predictive values (NPVs), and global accuracy of the final 5-item PROM were evaluated.

Results: We created an initial 11-item PROM with a 4-point Likert scale using the Delphi process. After item reduction, a decision tree derived from 218 patients including data obtained from the final 5-item PROM allowed patient classification into poorly, moderately, or highly adherent based on item responses. The psychometric properties were 78% (95% CI 40%-96%) sensitivity, 71% (95% CI 53%-85%) specificity, 41% (95% CI 19%-67%) positive predictive values, 93% (95% CI 74%-99%) NPV, and 70% (95% CI 55%-83%) accuracy.

Conclusions: We developed a medication adherence tool based on ML with an excellent NPV. This could allow prioritization processes to avoid referring highly adherent patients to time- and resource-consuming interventions. The decision tree can be easily implemented in computerized prescriber order-entry systems and digital tools in smartphones. External validation of this tool in a study including a larger number of patients with diseases associated with low medication adherence is required to confirm its use in analyzing and assessing the complexity of medication adherence.

Keywords: Delphi; cross sectional; decision tree; long-term therapies; machine learning; medication adherence; mobile phone; patient-reported outcome measure; predict; psychometric.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: None declared.

Figures

Figure 1
Figure 1
Description of the Delphi process.
Figure 2
Figure 2
11-items FREEDOM questionnaire. FREEDOM: FREE Detection non Observance Medication.
Figure 3
Figure 3
Flowchart of the study.
Figure 4
Figure 4
5-item FREEDOM questionnaire. FREEDOM: FREE Detection non Observance Medication.
Figure 5
Figure 5
Decision tree to predict patients’ medication adherence.
See this image and copyright information in PMC

References

    1. Haynes RB, Taylor DW, Sackett DL, editors. Adherence in Health Care. Baltimore, MD: Johns Hopkins University Press; 1979.
    1. Eduardo SE, editor. Adherence to Long-Term Therapies. Evidence for Action. Geneva, Switzerland: World Health Organization; 2003. WHO report.
    1. Verdu-Rotellar JM, Vaillant-Roussel H, Abellana R, Jevsek LG, Assenova R, Lazic DK, Torsza P, Glynn LG, Lingner H, Demurtas J, Borgström B, Gibot-Boeuf S, Muñoz MA. Precipitating factors of heart failure decompensation, short-term morbidity and mortality in patients attended in primary care. Scand J Prim Health Care. 2020;38(4):473–480. doi: 10.1080/02813432.2020.1844387. https://www.tandfonline.com/doi/full/10.1080/02813432.2020.1844387 - DOI - DOI - PMC - PubMed
    1. Wang N, Farrell M, Hales S, Hanvey K, Robertson G, Sharp P, Tofler G. Prevalence and seasonal variation of precipitants of heart failure hospitalization and risk of readmission. Int J Cardiol. 2020;316:152–160. doi: 10.1016/j.ijcard.2020.04.084.S0167-5273(20)31144-X - DOI - PubMed
    1. Durand H, Hayes P, Morrissey EC, Newell J, Casey M, Murphy AW, Molloy GJ. Medication adherence among patients with apparent treatment-resistant hypertension: systematic review and meta-analysis. J Hypertens. 2017;35(12):2346–2357. doi: 10.1097/HJH.0000000000001502. - DOI - PubMed

Publication types

LinkOut - more resources