Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Aug 10;6(1):139.
doi: 10.1038/s41746-023-00886-9.

Incorporating digitally derived endpoints within clinical development programs by leveraging prior work

Affiliations

Incorporating digitally derived endpoints within clinical development programs by leveraging prior work

Amy Bertha et al. NPJ Digit Med. .

Abstract

Digital health technologies (DHTs) enable remote data collection, support a patient-centric approach to drug development, and provide real-time data in real-world settings. With increasing use of DHTs in clinical care and development, we expect a growing body of evidence supporting use of DHTs to capture endpoint data in clinical trials. As the body of evidence grows, it will be critical to ensure that available prior work can be leveraged. We propose a framework to reuse analytical and clinical validation, as well as verification data, generated for existing DHTs. We apply real life case studies to illustrate our proposal aimed at leveraging prior work, while applying the V3 framework (verification, analytical validation, clinical validation) and avoiding duplication. Utilizing our framework will enable stakeholders to share best practices and consistent approaches to employing these tools in clinical studies, build on each other’s work, and ultimately accelerate evidence generation demonstrating the reproducibility and value add of these new tools.

PubMed Disclaimer

Conflict of interest statement

The authors declare no competing non-financial interests but the following competing financial interests. R.A. is an employee and shareholder of Regeneron. I.B. and R.K. are employees and shareholders of F. Hoffmann-La Roche. M.K.D. is an employee and shareholder of Amgen. D.F. is an employee and shareholder of Janssen. L.O. is an employee and shareholder of Biogen. I.K. and H.-P.P. are employees and shareholders of Bayer. A.B., F.K., and S.R. are employees of Bayer. The views in this publication are that of the authors and do not express the position of our respective companies on the topics discussed.

Figures

Fig. 1
Fig. 1. A strategic approach to incorporating a digital health technology and digitally derived endpoint within a clinical development program.
To demonstrate that the digital health technology (DHT) is fit-for-purpose in regulatory decision making, all of the steps here should be completed, but the order of execution and when they are completed, in terms of drug development phases, may vary. Certain drug development programs may not follow the precise three-phase structure shown here, and some activities shown here may be completed in parallel with one another. In a regulatory context, the concept of interest is the aspect of an individual’s clinical, biological, physical, or functional state, or experience that the assessment is intended to capture (or reflect). Context of Use is a statement that fully and clearly describes the way the medical product development tool is to be used and the regulated product development and review-related purpose of the use. V3 framework refers to a three-stage process of Verifying, analytically Validating, and clinically Validating a Biometric Monitoring Tool (BioMeT) to demonstrate it is fit-for-purpose for gathering data in a clinical trial.
Fig. 2
Fig. 2. A Framework for leveraging prior work to demonstrate a digital health technology (DHT) and digitally derived endpoint are fit-for-purpose—an overview.
Prior Work can and should be leveraged in all scenarios where available and appropriate, shading indicates when additional work may or likely will be needed. The light gray shading indicates no additional work is needed. Sponsors can leverage prior work for all aspects of verification, validation, and usability. The medium gray shading indicates additional work may be needed. Sponsors will need to confirm what work can be leveraged, determine if additional work is needed, and perform needed work to support certain activities. The dark gray shading indicates additional work likely is needed. Sponsors will need to generate most data de novo.
Fig. 3
Fig. 3. A framework for leveraging prior work to demonstrate a digital health technology (DHT) and digitally derived endpoint is fit-for-purpose—the detail.
Prior Work can and should be leveraged in all scenarios where available and appropriate, shading indicates when additional work may or likely will be needed. The light gray shading indicates no additional work is needed. The medium gray shading indicates additional work may be needed. The dark gray shading indicates additional work likely is needed.
Fig. 4
Fig. 4. A framework for leveraging prior work to demonstrate a digital health technology (DHT) and digitally derived endpoint is fit-for-purpose—case study in remote monitoring sleep parameter in home setting.
Prior Work can and should be leveraged in all scenarios where available and appropriate, shading indicates when additional work may or likely will be needed. The light gray shading indicates no additional work is needed. The medium gray shading indicates additional work may be needed. The dark gray shading indicates additional work likely is needed.

References

    1. U.S. Food and Drug Administration. Draft Guidance for Industry: Investigators, and Other Stakeholders. Digital Health Technologies for Remote Data Acquisition in Clinical Investigations (2021) Guidance for Industry (fda.gov).
    1. Goldsack J, et al. Verification, analytical validation, and clinical validation (V3): the foundation of determining fit-for-purpose for Biometric Monitoring Technologies (BioMeTs) npj Digit. Med. 2020;3:55. doi: 10.1038/s41746-020-0260-4. - DOI - PMC - PubMed
    1. Crouthamel M, et al. Developing a novel measurement of sleep in rheumatoid arthritis: study proposal for approach and considerations. Digit Biomark. 2021;5:191–205. doi: 10.1159/000518024. - DOI - PMC - PubMed
    1. Izmailova E, et al. Evaluation of wearable digital devices in a phase I clinical trial. Clin. Transl. Sci. 2019;12:247–256. doi: 10.1111/cts.12602. - DOI - PMC - PubMed
    1. Godfrey A, et al. Fit-for-purpose biometric monitoring technologies: leveraging the laboratory biomarker experience. Clin. Transl. Sci. 2021;14:62–74. doi: 10.1111/cts.12865. - DOI - PMC - PubMed