Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2013 Mar 14:13:40.
doi: 10.1186/1471-2288-13-40.

Advancing current approaches to disease management evaluation: capitalizing on heterogeneity to understand what works and for whom

Arianne M J Elissen  1 , John L Adams, Marieke Spreeuwenberg, Inge G P Duimel-Peeters, Cor Spreeuwenberg, Ariel Linden, Hubertus J M Vrijhoef
Affiliations

Advancing current approaches to disease management evaluation: capitalizing on heterogeneity to understand what works and for whom

Arianne M J Elissen et al. BMC Med Res Methodol. .

Abstract

Background: Evaluating large-scale disease management interventions implemented in actual health care settings is a complex undertaking for which universally accepted methods do not exist. Fundamental issues, such as a lack of control patients and limited generalizability, hamper the use of the 'gold-standard' randomized controlled trial, while methodological shortcomings restrict the value of observational designs. Advancing methods for disease management evaluation in practice is pivotal to learn more about the impact of population-wide approaches. Methods must account for the presence of heterogeneity in effects, which necessitates a more granular assessment of outcomes.

Methods: This paper introduces multilevel regression methods as valuable techniques to evaluate 'real-world' disease management approaches in a manner that produces meaningful findings for everyday practice. In a worked example, these methods are applied to retrospectively gathered routine health care data covering a cohort of 105,056 diabetes patients who receive disease management for type 2 diabetes mellitus in the Netherlands. Multivariable, multilevel regression models are fitted to identify trends in clinical outcomes and correct for differences in characteristics of patients (age, disease duration, health status, diabetes complications, smoking status) and the intervention (measurement frequency and range, length of follow-up).

Results: After a median one year follow-up, the Dutch disease management approach was associated with small average improvements in systolic blood pressure and low-density lipoprotein, while a slight deterioration occurred in glycated hemoglobin. Differential findings suggest that patients with poorly controlled diabetes tend to benefit most from disease management in terms of improved clinical measures. Additionally, a greater measurement frequency was associated with better outcomes, while longer length of follow-up was accompanied by less positive results.

Conclusions: Despite concerted efforts to adjust for potential sources of confounding and bias, there ultimately are limits to the validity and reliability of findings from uncontrolled research based on routine intervention data. While our findings are supported by previous randomized research in other settings, the trends in outcome measures presented here may have alternative explanations. Further practice-based research, perhaps using historical data to retrospectively construct a control group, is necessary to confirm results and learn more about the impact of population-wide disease management.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Study flow chart.
Figure 2
Figure 2
Overview of research variables (and registration in number of care groups).
Figure 3
Figure 3
Glycemic control (mmol/mol) from baseline to follow-up according to the target values of the Dutch care standard for type 2 diabetes mellitus.
See this image and copyright information in PMC

References

    1. Care Continuum Alliance. Care Continuum Alliance (CCA) definition of disease management. http://www.carecontinuumalliance.org/dm_definition.asp.
    1. Nolte E, Knai C, McKee M. Managing chronic conditions. Experience in eight countries. World Health Organization on behalf of the European Observatory on Health Systems and Policies: Copenhagen; 2008.
    1. Mattke S, Seid M, Ma S. Evidence for the effect of disease management: is $1 billion a year a good investment? Am J Manag Care. 2007;13(12):670–676. - PubMed
    1. Rothe U, Müller G, Schwarz PEH, Seifert M, Kunath H, Koch R, Bergmann S, Julius U, Bornstein SR, Hanefeld M, Schulze J. Evaluation of a diabetes management system based on practice guidelines, integrated care, and continuous quality management in a Federal State of Germany. A population-based approach to health care research. Diabetes Care. 2008;31(5):863–868. doi: 10.2337/dc07-0858. - DOI - PubMed
    1. Nolte E, Hinrichs S. DISMEVAL. Developing and validating disease management evaluation methods for European healthcare systems. Cambridge: RAND Europe; 2012.

Publication types

LinkOut - more resources