Does the Physical Medicine and Rehabilitation Self-Assessment Examination for Residents Predict the Chances of Passing the Part 1 Board Certification Examination?

Abstract

Background: Each year, residents in accredited United States Physical Medicine and Rehabilitation (PMR) residency programs can take the American Academy of Physical Medicine and Rehabilitation (AAPM&R) Self-Assessment Examination for Residents (SAE-R). This 150-question, multiple-choice examination is intended for self-assessment of physiatric knowledge, but its predictive value for performance on the part 1 American Board of Physical Medicine and Rehabilitation Certification Examination (ABPMR-CE) is unknown.

Objective: To investigate the predictive value of the SAE-R in relation to the part 1 ABPMR-CE.

Design: Retrospective study.

Methods: Data were analyzed from first time takers of the part 1 ABPMR-CE during a 5-year period from 2010 through 2014 who took at least 1 SAE-R in the third or fourth postgraduate year (PGY) of residency.

Main outcome measurements: Raw scores from the SAE-R were compared with scaled scores on the part 1 examination. Regression models analyzed the predictive value of the SAE-R total score for each PGY level.

Results: SAE-R raw scores increased an average of 5.5 points between the PGY 3 and PGY 4 year. PGY3 SAE-R raw scores accounted for 24.8% and PGY4 SAE-R scores for 27.1% of the variance in part 1 ABPMR-CE scores (P < .0001). Residents who obtained a raw score greater than 80 (53% correct) on the SAE-R had an 80% or greater chance of passing the ABPMR-CE. Scores greater than 90 (60% correct) on the SAE-R were associated with a 95% chance of passing the ABPMR-CE.

Conclusion: The SAE-R scores provide some information regarding the likelihood of passing the part 1 certification examination. This study supports the SAE-R as a means of providing PMR residents with feedback regarding their level of knowledge.