A systems approach to assessing complexity in health interventions: an effectiveness decay model for integrated community case management

Abstract

Complexity is inherent to any system or program. This is especially true of integrated interventions, such as integrated community case management (iCCM). iCCM is a child health strategy designed to provide services through community health workers (CHWs) within hard-to-reach areas of low-and-middle-income countries (LMICs). It is comprised of many interlinked program components, processes and stakeholders. Elucidating the complexity of such programs is essential to designing interventions that respond to local contexts and successfully plan for sustainable integration. A pragmatic approach has yet to be developed that holistically assesses the many dimensions of iCCM or other integrated programs, their alignment with local systems, and how well they provide effective care. We propose an accessible systems approach to both measuring systems effectiveness and assessing its underlying complexity using a combination of systems thinking tools. We propose an effectiveness decay model for iCCM implementation to measure where patient loss occurs along the trajectory of care. The approach uses process mapping to examine critical bottlenecks of iCCM processes, their influence on effectiveness decay, and their integration into local systems; regression analysis and structural equation modeling to determine effects of key indicators on programmatic outcomes; and qualitative analysis with causal loop diagramming to assess stakeholder dynamics and their interactions within the iCCM program. An accurate assessment of the quality, effectiveness, and strength of community-based interventions relies on more than measuring core indicators and program outcomes; it requires an exploration of how its actors and core components interact as part of a system. Our approach produces an interactive iCCM effectiveness decay model to understand patient loss in context, examines key systems issues, and uses a range of systems thinking tools to assess the dynamic interactions that coalesce to produce observed program outcomes.

Keywords: bottleneck analysis; data visualization; iCCM; process mapping; sankey diagram; systems thinking tools.

Figure 1.

Mechanisms of Effect (Hardware-Software) Framework.

Figure 2.

Decision tree model example.

Figure 3.

Sankey diagram example.

Figure 4.

Process map example.

Figure 5.

Example of a causal loop diagram modeling population growth.

Figure 6.

Generic model of systems effectiveness decay of iCCM^†.

Figure 7.

Assessment components of the systems approach of iCCM.