Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2020 Mar 13:3:37.
doi: 10.1038/s41746-020-0237-3. eCollection 2020.

Modernizing and designing evaluation frameworks for connected sensor technologies in medicine

Andrea Coravos  1   2   3   4 , Megan Doerr  5 , Jennifer Goldsack  3 , Christine Manta  1   3 , Mark Shervey  1 , Beau Woods  4   6   7 , William A Wood  3   8
Affiliations
Review

Modernizing and designing evaluation frameworks for connected sensor technologies in medicine

Andrea Coravos et al. NPJ Digit Med. .

Erratum in

Abstract

This manuscript is focused on the use of connected sensor technologies, including wearables and other biosensors, for a wide range of health services, such as collecting digital endpoints in clinical trials and remotely monitoring patients in clinical care. The adoption of these technologies poses five risks that currently exceed our abilities to evaluate and secure these products: (1) validation, (2) security practices, (3) data rights and governance, (4) utility and usability; and (5) economic feasibility. In this manuscript we conduct a landscape analysis of emerging evaluation frameworks developed to better manage these risks, broadly in digital health. We then propose a framework specifically for connected sensor technologies. We provide a pragmatic guide for how to put this evaluation framework into practice, taking lessons from concepts in drug and nutrition labels to craft a connected sensor technology label.

Keywords: Health policy; Technology.

PubMed Disclaimer

Conflict of interest statement

Competing interestsJ.G. is an employee of HealthMode. M.D. is a co-inventor of the Cleveland Clinic’s MyLegacy intellectual property portfolio, now licensed to Family Care Path, Inc.; as part of this license, she is entitled to a share in both royalties and returns on equity. W.W., B.W. are advisors and equity-holders, and A.C., C.M., and M.S. are employees of Elektra Labs, a healthcare-security company working in digital medicine. W.W. is also an advisor for Koneksa Health, a consultant for Best Doctors, and has received research funding within the last 12 months from Pfizer and Genentech. The other authors declare no competing interests.

Figures

Fig. 1
Fig. 1. Current Evaluation Frameworks for Connected Sensor Technologies.
This figure illustrates many of the known evaluation frameworks for connected technologies, categorized by source, type, audience, scope and dimension. References are provided.
Fig. 2
Fig. 2. Proposed Evaluation Framework for Fit-For-Purpose Connected Sensor Technologies.
The proposed framework describes the key dimensions to be considered when evaluating connected sensor technologies. Dimensions can be grouped into broader categories of data and results; functionality and ease of use; and value and costs.
Fig. 3
Fig. 3. Connected sensor facts.
This is an example of a nutrition label-type visualization that includes the key dimensions of the evaluative framework for connected sensor technologies, and metrics related to facts within each dimension. This approach permits a user to have a concise but comprehensive picture of a sensor’s appropriateness and fitness for use.
Fig. 4
Fig. 4. Connected sensor comparison table.
This is an example of how sensors might be compared in a side by side visualization that incorporates dimensions from the proposed evaluative framework. In this illustrative visualization, additional detail and metrics are provided for the utility and usability dimension, in order to facilitate a rapid evaluation for appropriateness within an intended population.
See this image and copyright information in PMC

References

    1. Hailu, R. Fitbits and other wearables may not accurately track heart rates in people of color. https://www.statnews.com/2019/07/24/fitbit-accuracy-dark-skin/ (2019).
    1. Yazdi, D. The Apple Watch 4 is an iffy atrial fibrillation detector in those under age 55. https://www.statnews.com/2019/01/08/apple-watch-iffy-atrial-fibrillation... (2019).
    1. Brandom, R. UK hospitals hit with massive ransomware attack. https://www.theverge.com/2017/5/12/15630354/nhs-hospitals-ransomware-hac... (2017).
    1. Apple. ECG app and irregular heart rhythm notification available today on Apple Watch. https://www.apple.com/newsroom/2018/12/ecg-app-and-irregular-heart-rhyth... (2018).
    1. Sim I. Mobile devices and health. N. Engl. J. Med. 2019;381:956–968.. doi: 10.1056/NEJMra1806949. - DOI - PubMed