Impact of a competency based curriculum on quality improvement among internal medicine residents

Abstract

Background: Teaching quality improvement (QI) principles during residency is an important component of promoting patient safety and improving quality of care. The literature on QI curricula for internal medicine residents is limited. We sought to evaluate the impact of a competency based curriculum on QI among internal medicine residents.

Methods: This was a prospective, cohort study over four years (2007-2011) using pre-post curriculum comparison design in an internal medicine residency program in Canada. Overall 175 post-graduate year one internal medicine residents participated. A two-phase, competency based curriculum on QI was developed with didactic workshops and longitudinal, team-based QI projects. The main outcome measures included self-assessment, objective assessment using the Quality Improvement Knowledge Assessment Tool (QIKAT) scores to assess QI knowledge, and performance-based assessment via presentation of longitudinal QI projects.

Results: Overall 175 residents participated, with a response rate of 160/175 (91%) post-curriculum and 114/175 (65%) after conducting their longitudinal QI project. Residents' self-reported confidence in making changes to improve health increased and was sustained at twelve months post-curriculum. Self-assessment scores of QI skills improved significantly from pre-curriculum (53.4 to 69.2 percent post-curriculum [p-value 0.002]) and scores were sustained at twelve months after conducting their longitudinal QI projects (53.4 to 72.2 percent [p-value 0.005]). Objective scores using the QIKAT increased post-curriculum from 8.3 to 10.1 out of 15 (p-value for difference <0.001) and this change was sustained at twelve months post-project with average individual scores of 10.7 out of 15 (p-value for difference from pre-curriculum <0.001). Performance-based assessment occurred via presentation of all projects at the annual QI Project Podium Presentation Day.

Conclusion: The competency based curriculum on QI improved residents' QI knowledge and skills during residency training. Importantly, residents perceived that their QI knowledge improved after the curriculum and this also correlated to improved QIKAT scores. Experiential QI project work appeared to contribute to sustaining QI knowledge at twelve months.

Figure 1

Impact of curriculum on self-assessment of QI skills in as measured by average difference in satisfaction index.

Figure 2

Impact of curriculum on objective assessment of QI knowledge in 2007/08–2010/11, as measured by average difference in individual scores. *There was a difference in average individual scores across time (F-statistic = 51.2; df = 2, 104; p < 0.001).