Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Apr 6;5(2):e10225.
doi: 10.1002/lrh2.10225. eCollection 2021 Apr.

Measuring engagement in a collaborative learning health system: The case of ImproveCareNow

David M Hartley  1   2 , Christian Keck  1 , Mary Havens  1 , Peter A Margolis  1   2 , Michael Seid  1   2
Affiliations

Measuring engagement in a collaborative learning health system: The case of ImproveCareNow

David M Hartley et al. Learn Health Syst. .

Abstract

Background: Collaborative learning health systems have demonstrated improved outcomes for a range of different chronic conditions. Patient and healthcare provider engagement in these systems is thought to be associated with improved outcomes. We have adapted an observational framework to measure, and track over time, engagement in ImproveCareNow, a collaborative learning health system for children with inflammatory bowel disease.

Introduction: We developed a categorical classification scheme for engagement in ImproveCareNow. Each tier is defined in terms of observable individual behaviors. When an individual completes one or more qualifying behavior, s/he is classified as engaged at that tier. Individuals are entered into a database, which is accessible to care centers throughout the ImproveCareNow network. Database records include fields for individual name, behavior type, time, place, and level of engagement.

Results: The resulting system is employed at 79 ImproveCareNow care centers in the United States. The system recognizes four levels of engagement. Behaviors are recorded in a managed vocabulary and recorded in an online database. The database is queried weekly for individual engagement behaviors, which are tracked longitudinally. Center- and network-level statistics are generated and disseminated to stakeholders.

Conclusion: It is possible to monitor longitudinal engagement in a collaborative learning health system, thereby charting progress toward engagement goals and enabling quantitative evaluation of interventions aimed at increasing engagement.

Keywords: collaboration; engagement; measurement; pediatrics.

PubMed Disclaimer

Conflict of interest statement

Michael Seid and Peter A. Margolis declare a financial interest in intellectual property licensed by CCHMC to Hive Networks, a company developing information technology to support collaborative learning health systems. Authors David M. Hartley, Christian Keck, and Mary Havens declare that they have no conflicts of interest.

Figures

FIGURE 1
FIGURE 1
Sequence of engagement behavior of a theoretical person in ICN, and the corresponding codes
FIGURE 2
FIGURE 2
Assessment of an interventions to increase engagement at four different care centers. Black: sign up numbers. Red: percent asked who signed up. Centers where affiliated with academic medical centers and had different sizes (estimated patient populations: A = 113, B = 518, C = 980, D = 774)
FIGURE 3
FIGURE 3
The growth of engagement tiers for the ICN network since August of 2017
See this image and copyright information in PMC

References

    1. Britto MT, Fuller SC, Kaplan HC, et al. Using a network organisational architecture to support the development of learning healthcare systems. BMJ Qual Saf. 2018;27(11):937‐946. - PMC - PubMed
    1. Olsen L, Aisner D, McGinnis J, eds. The Learning Healthcare System: Workshop Summary (IOM Roundtable on Evidence‐Based Medicine). Washington DC: National Academies Press; 2007. - PubMed
    1. Ramsey LB, Mizuno T, Vinks AA, Margolis PA. Learning health systems as facilitators of precision medicine. Clin Pharmacol Ther. 2017;101(3):359‐367. - PMC - PubMed
    1. Barnes EL, Long MD, Kappelman MD, Martin CF, Sandler RS. High patient activation is associated with remission in patients with inflammatory bowel disease. Inflamm Bowel Dis. 2019. Jun 18;25(7):1248‐1254. - PMC - PubMed
    1. Shah SL, Siegel CA. Increasing patient activation could improve outcomes for patients with inflammatory bowel disease. Inflamm Bowel Dis. 2015;21(12):2975‐2978. - PubMed

LinkOut - more resources