A Content Analysis of the ACGME Specialty Milestones to Identify Performance Indicators Pertaining to the Development of Residents as Educators

Abstract

Construct: For curriculum development purposes, this study examined how the development of residents as educators is reflected in the Accreditation Council for Graduate Medical Education (ACGME) Milestones. Background: Residents teach patients, families, medical students, physicians, and other health professionals during and beyond their training. Despite this expectation, it is unclear how the development of residents as educators is reflected in the specialty-specific Milestones. Approach: We performed a textual content analysis of 25 specialty Milestone documents available as downloads from the ACGME website in December 2015. Syntactical units of interest included developmental progressions that describe the development of educators over the course of residency training and 16 key terms identified during the analysis. We then categorized the terms by associated Milestone level, ACGME core competency, and targeted learner(s). Results: We identified 10 developmental progressions and 546 instances of the 16 key terms that describe the development of physician educators. The frequency of terms among specialties was quite variable (5-46 terms per specialty, Mdn = 21). The majority of education-related terms appeared at advanced Milestone levels; there were 139 (26%) such instances in Level 4 and 296 (54%) in Level 5. Education-related terms were identified in all six ACGME core competencies, with greatest frequency in Patient Care (157, 29%). Other residents were the learners most frequently targeted by education-related Milestones (211, 40%). Conclusions: The current ACGME Milestones largely imply that resident teaching is a high-level or aspirational goal, achieved without a clear or consistently assessed developmental progression. These findings run counter to the theoretical basis that underlies the development of the Milestones. Wide variation among specialties indicates lack of consensus around the ideal skill set of the resident educator and limits the utility of these documents for curriculum development in this domain.

Keywords: content analysis; graduate medical education; milestones; resident as teacher; teaching.