Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Aug;15(4):469-474.
doi: 10.4300/JGME-D-22-00637.1.

Using a Consensus-Driven Approach to Incorporate Holistic Review Into an Internal Medicine Residency Program

Blair P Golden  1 , Robert Holland  2 , Laura Zakowski  3 , Jeremy Smith  2
Affiliations

Using a Consensus-Driven Approach to Incorporate Holistic Review Into an Internal Medicine Residency Program

Blair P Golden et al. J Grad Med Educ. 2023 Aug.

Abstract

Background: Despite growing interest in incorporating holistic review within residency admissions, implementation by residency programs remains challenging.

Objective: To incorporate holistic review into the internal medicine residency program at the University of Wisconsin and to report initial feasibility and acceptability data.

Methods: During the 2020-2021 application cycle, residency stakeholders performed a consensus-driven process to identify highly valued applicant attributes. We used a holistic review process to identify the presence of these attributes among applicants and updated our rank list algorithm to incorporate these attributes. We modified our interview screening criteria and rank list algorithm to de-emphasize other metrics. We surveyed stakeholders to assess time required for this process and compared our final rank list to what it would have been using our prior system.

Results: The final list of 10 prioritized applicant attributes included extraordinary leadership, community service, and grit, among others. Among 25 matched residents, 8 (32%) were recognized to have exceptional achievement within one of these 10 attributes. Four members of the incoming intern class (16%) would have been in a rank position lower than our historical matched resident cutoff had they not received additional points for these attributes. Faculty reported that holistic review of applications took an additional 3.8 minutes on average. It was felt that current application materials limit the ability to implement a fully holistic review.

Conclusions: The addition of holistic review to our residency admissions process was achieved using a consensus-driven approach and showed favorable feasibility and acceptability data.

PubMed Disclaimer

Conflict of interest statement

Conflict of interest: The authors declare they have no competing interests.

Figures

Figure
Figure
Application Review and Ranking Process Abbreviations: APD, associate program director; PD, program director; USMLE, United States Medical Licensing Examination; AOA, Alpha Omega Alpha Honor Society.
See this image and copyright information in PMC

References

    1. Pope AJ, Carter K, Ahn J. A renewed call for a more equitable and holistic review of residency applications in the era of COVID-19. AEM Educ Train . 2021;5(1):135–138. doi: 10.1002/aet2.10529. - DOI - PMC - PubMed
    1. Sungar WG, Angerhofer C, McCormick T, et al. . Implementation of holistic review into emergency medicine residency application screening to improve recruitment of underrepresented in medicine applicants. AEM Educ Train . 2021;5(suppl 1):10–18. doi: 10.1002/aet2.10662. - DOI - PMC - PubMed
    1. Marbin J, Rosenbluth G, Brim R, Cruz E, Martinez A, McNamara M. Improving diversity in pediatric residency selection: using an equity framework to implement holistic review. J Grad Med Educ . 2021;13(2):195–200. doi: 10.4300/JGME-D-20-01024.1. - DOI - PMC - PubMed
    1. Barcelo NE, Shadravan S, Wells CR, et al. . Reimagining merit and representation: promoting equity and reducing bias in GME through holistic review. Acad Psychiatry . 2021;45(1):34–42. doi: 10.1007/s40596-020-01327-5. - DOI - PubMed
    1. National Resident Matching Program. Results of the 2022 NRMP Program Director Survey. Published September 2022. Accessed May 4, 2023. https://www.nrmp.org/wp-content/uploads/2022/09/PD-Survey-Report-2022_FI....

LinkOut - more resources