Otolaryngology Resident Reviewer Development Program: Lessons Learned from Cohort 1

Abstract

Objective: To implement a quality improvement project addressing the knowledge gap in the otolaryngology resident and fellow scientific peer review process.

Methods: The creation of the Resident Reviewer Development Program, cohort 1 outcomes, and subsequent lessons learned from the inaugural class are outlined using the plan-do-study-act model. Interested otolaryngology residents were paired with seasoned reviewers and conducted a minimum of 3 mentored peer reviews followed by an independent review test if competency was determined.

Results: Twenty-five residents (postgraduate years [PGYs] 2-5) were actively enrolled in cohort 1. At 24 months, 18 (72%) graduated, 6 remained actively enrolled, and 1 did not successfully complete the program. The median number of practice reviews prior to testing was 3 (range, 3-6). The median independent review score was 83 (overall journal mean = 78). Cohort 1 graduates continued on to review 130 articles with a mean score of 85. Five (28%) graduates achieved Star Reviewer status.

Discussion: The inaugural cohort demonstrated that the PGY-3 and PGY-4 class is ideal for enrollment given that completion of the program could take up to 24 months. Three mentored reviews were identified as the ideal minimum requirement for education. The accelerated achievement of Star Reviewer status (28%) and mean postgraduation score of 85 demonstrate successful and sustainable outcome measures.

Implications for practice: With appropriate mentorship and administrative support, scientific peer review can be formally incorporated into an educational program. Lessons learned during the educational program are sustained long term as demonstrated by review scores and Star Reviewer status.

Keywords: patient safety/quality improvement; peer review; resident education; scientific review.