Comprehensive Multicenter Graduate Surgical Education Initiative Incorporating Entrustable Professional Activities, Continuous Quality Improvement Cycles, and a Web-Based Platform to Enhance Teaching and Learning

Abstract

Background: It is increasingly important for faculty to teach deliberately and provide timely, detailed, and formative feedback on surgical trainee performance. We initiated a multicenter study to improve resident evaluative processes and enhance teaching and learning behaviors while engaging residents in their education.

Study design: Faculty from 7 US postgraduate training programs rated resident operative performances using the perioperative briefing, intraoperative teaching, debriefing model, and rated patient visits/academic performances using the entrustable professional activities model via a web-based platform. Data were centrally analyzed and iterative changes made based on participant feedback, individual preferences, and database refinements, with trends addressed using the Plan, Do, Check, Act improvement methodology.

Results: Participants (92 surgeons, 150 residents) submitted 3,880 assessments during July 2014 through September 2017. Evidence of preoperative briefings improved from 33.9% ± 2.5% to 95.5% ± 1.5% between April and September 2014 compared with April and September 2017 (p < 0.001). Postoperative debriefings improved from 10.6% ± 2.7% to 90.2% ± 2.5% (p < 0.001) for the same period. Meaningful self-reflection by residents improved from 28.6% to 67.4% (p < 0.001). The number of assessments received per resident during a 6-month period increased from 6.4 ± 6.2 to 13.4 ± 10.1 (p < 0.003). Surgeon-entered assessments increased from 364 initially to 685 in the final period, and the number of resident assessments increased from 308 to 445. We showed a 4-fold increase in resident observed activities being rated.

Conclusions: By adopting recognized educational models with repeated Plan, Do, Check, Act cycles, we increased the quality of preoperative learning objectives, showed more frequent, detailed, and timely assessments of resident performance, and demonstrated more effective self-reflection by residents. We monitored trends, identified opportunities for improvement and successfully sustained those improvements over time, applying a team-based approach.