Association Between Flexible Duty Hour Policies and General Surgery Resident Examination Performance: A Flexibility in Duty Hour Requirements for Surgical Trainees (FIRST) Trial Analysis

Abstract

Background: Concerns persist about the effect of current duty hour reforms on resident educational outcomes. We investigated whether a flexible, less-restrictive duty hour policy (Flexible Policy) was associated with differential general surgery examination performance compared with current ACGME duty hour policy (Standard Policy).

Study design: We obtained examination scores on the American Board of Surgery In-Training Examination, Qualifying Examination (written boards), and Certifying Examination (oral boards) for residents in 117 general surgery residency programs that participated in the Flexibility in Duty Hour Requirements for Surgical Trainees (FIRST) Trial. Using bivariate analyses and regression models, we compared resident examination performance across study arms (Flexible Policy vs Standard Policy) for 2015 and 2016, and 1 year of the Qualifying Examination and Certifying Examination. Adjusted analyses accounted for program-level factors, including the stratification variable for randomization.

Results: In 2016, FIRST trial participants were 4,363 general surgery residents. Mean American Board of Surgery In-Training Examination scores for residents were not significantly different between study groups (Flexible Policy vs Standard Policy) overall (Flexible Policy: mean [SD] 502.6 [100.9] vs Standard Policy: 502.7 [98.6]; p = 0.98) or for any individual postgraduate year level. There was no difference in pass rates between study arms for either the Qualifying Examination (Flexible Policy: 90.4% vs Standard Policy: 90.5%; p = 0.99) or Certifying Examination (Flexible Policy: 86.3% vs Standard Policy: 88.6%; p = 0.24). Results from adjusted analyses were consistent with these findings.

Conclusions: Flexible, less-restrictive duty hour policies were not associated with differences in general surgery resident performance on examinations during the FIRST Trial. However, more years under flexible duty hour policies might be needed to observe an effect.