Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Oct 11:25:e46992.
doi: 10.2196/46992.

Digital Health Technology for Real-World Clinical Outcome Measurement Using Patient-Generated Data: Systematic Scoping Review

Affiliations

Digital Health Technology for Real-World Clinical Outcome Measurement Using Patient-Generated Data: Systematic Scoping Review

Evelyn Pyper et al. J Med Internet Res. .

Abstract

Background: Digital health technologies (DHTs) play an ever-expanding role in health care management and delivery. Beyond their use as interventions, DHTs also serve as a vehicle for real-world data collection to characterize patients, their care journeys, and their responses to other clinical interventions. There is a need to comprehensively map the evidence-across all conditions and technology types-on DHT measurement of patient outcomes in the real world.

Objective: We aimed to investigate the use of DHTs to measure real-world clinical outcomes using patient-generated data.

Methods: We conducted this systematic scoping review in accordance with the Joanna Briggs Institute methodology. Detailed eligibility criteria documented in a preregistered protocol informed a search strategy for the following databases: MEDLINE (Ovid), CINAHL, Cochrane (CENTRAL), Embase, PsycINFO, ClinicalTrials.gov, and the EU Clinical Trials Register. We considered studies published between 2000 and 2022 wherein digital health data were collected, passively or actively, from patients with any specified health condition outside of clinical visits. Categories for key concepts, such as DHT type and analytical applications, were established where needed. Following screening and full-text review, data were extracted and analyzed using predefined fields, and findings were reported in accordance with established guidelines.

Results: The search strategy identified 11,015 publications, with 7308 records after duplicates and reviews were removed. After screening and full-text review, 510 studies were included for extraction. These studies encompassed 169 different conditions in over 20 therapeutic areas and 44 countries. The DHTs used for mental health and addictions research (111/510, 21.8%) were the most prevalent. The most common type of DHT, mobile apps, was observed in approximately half of the studies (250/510, 49%). Most studies used only 1 DHT (346/510, 67.8%); however, the majority of technologies used were able to collect more than 1 type of data, with the most common being physiological data (189/510, 37.1%), clinical symptoms data (188/510, 36.9%), and behavioral data (171/510, 33.5%). Overall, there has been real growth in the depth and breadth of evidence, number of DHT types, and use of artificial intelligence and advanced analytics over time.

Conclusions: This scoping review offers a comprehensive view of the variety of types of technology, data, collection methods, analytical approaches, and therapeutic applications within this growing body of evidence. To unlock the full potential of DHT for measuring health outcomes and capturing digital biomarkers, there is a need for more rigorous research that goes beyond technology validation to demonstrate whether robust real-world data can be reliably captured from patients in their daily life and whether its capture improves patient outcomes. This study provides a valuable repository of DHT studies to inform subsequent research by health care providers, policy makers, and the life sciences industry.

Trial registration: Open Science Framework 5TMKY; https://osf.io/5tmky/.

Keywords: clinical intervention; digital biomarkers; digital health; digital health management; digital tools; electronic health record; health outcomes; mHealth; mobile health; mobile phone; patient-generated health data; real-world data; real-world evidence; wearables.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: EP is an employee of PicnicHealth, a patient-centric real-world data company. SM works at the Pharmaceutical Research and Manufacturers of America, a trade association representing US pharmaceutical companies in the innovative space. All other authors declare no other conflicts of interest.

Figures

Figure 1
Figure 1
PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram. DHT: digital health technology.
Figure 2
Figure 2
Number of included studies and those involving artificial intelligence (AI) by year.
Figure 3
Figure 3
Types of digital health technologies used in the included studies by year.
Figure 4
Figure 4
Included studies by therapeutic area and disease or condition. ALS: amyotrophic lateral sclerosis; CNS: central nervous system.
Figure 5
Figure 5
Method of data entry by therapeutic area. CNS: central nervous system.
Figure 6
Figure 6
Analytic applications by type of data. QoL: quality of life.
Figure 7
Figure 7
Collection of multiple types of patient-generated data by number of studies. QoL: quality of life.

Similar articles

Cited by

References

    1. Shapiro M, Johnston D, Wald J, Mon D. Patient-generated health data. RTI International. 2012. [2023-01-22]. https://www.rti.org/publication/patient-generated-health-data-white-paper .
    1. Coravos A, Goldsack JC, Karlin DR, Nebeker C, Perakslis E, Zimmerman N, Erb MK. Digital medicine: a primer on measurement. Digit Biomark. 2019 May 9;3(2):31–71. doi: 10.1159/000500413. doi: 10.1159/000500413.dib-0003-0031 - DOI - DOI - PMC - PubMed
    1. Marra C, Chen JL, Coravos A, Stern AD. Quantifying the use of connected digital products in clinical research. NPJ Digit Med. 2020 Apr 03;3(1):50. doi: 10.1038/s41746-020-0259-x. doi: 10.1038/s41746-020-0259-x.259 - DOI - DOI - PMC - PubMed
    1. Digital health technologies for remote data acquisition in clinical investigations. U.S. Food and Drug Administration. 2021. Dec, [2023-01-03]. https://www.fda.gov/media/155022/download .
    1. Makady A, de Boer A, Hillege H, Klungel O, Goettsch W, (on behalf of GetReal Work Package 1) What is real-world data? A review of definitions based on literature and stakeholder interviews. Value Health. 2017;20(7):858–65. doi: 10.1016/j.jval.2017.03.008. https://linkinghub.elsevier.com/retrieve/pii/S1098-3015(17)30171-7 S1098-3015(17)30171-7 - DOI - PubMed

Publication types

LinkOut - more resources