Innovations in Mixed Methods Evaluations

Abstract

Mixed methods research-i.e., research that draws on both qualitative and quantitative methods in varying configurations-is well suited to address the increasing complexity of public health problems and their solutions. This review focuses specifically on innovations in mixed methods evaluations of intervention, program or policy (i.e., practice) effectiveness, and implementation. The article begins with an overview of the structure, function, and process of different mixed methods designs and then provides illustrations of their use in effectiveness studies, implementation studies, and combined effectiveness-implementation hybrid studies. The article then examines four specific innovations: procedures for transforming (or "quantitizing") qualitative data, application of rapid assessment and analysis procedures in the context of mixed methods studies, development of measures to assess implementation outcomes, and strategies for conducting both random and purposive sampling, particularly in implementation-focused evaluation research. The article concludes with an assessment of challenges to integrating qualitative and quantitative data in evaluation research.

Keywords: effectiveness; evaluation; hybrid designs; implementation; methodology; mixed methods.

Figure 1

Illustration of the graphic output of concept mapping. Point and cluster map of all 73 strategies identified in the ERIC process. Source: Waltz et al. (88).

Figure 2

QCA as an approach and as an analytic technique Source: Kane et al. (44), with permission.

Figure 3

Team-based work flow for case analysis. Source: Damschroder and Lowery, (22).