Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 May 20;19(1):154.
doi: 10.1186/s12909-019-1605-z.

Multivariable analysis of factors associated with USMLE scores across U.S. medical schools

Arash Ghaffari-Rafi  1   2 , Rachel Elizabeth Lee  3 , Rui Fang  3 , J Douglas Miles  3
Affiliations

Multivariable analysis of factors associated with USMLE scores across U.S. medical schools

Arash Ghaffari-Rafi et al. BMC Med Educ. .

Abstract

Background: Gauging medical education quality has always remained challenging. Many studies have examined predictors of standardized exam performance; however, data sets do not distinguish by institution or curriculum. Our objective is to present a summary of variables associated with the United States Medical Licensing Examination (USMLE) scores, and thus identify institutions (and therefore curriculums) which deviate from trend lines by producing higher USMLE scores despite having lower entrance grade point averages and medical college admissions test (MCAT) scores.

Methods: Data was obtained from U.S. News and World Report's 2014 evaluation of allopathic U.S. medical schools. A univariate analysis was performed first for each variable using two sample t-test or Wilcoxon rank sum test for categorical variables, and Pearson or Spearman correlation coefficients for continuous variables. A multivariable linear regression model was developed to identify the factors contributing to USMLE scores. All statistical analyses were two-sided and performed using SAS software version 9.4 (SAS Institute Inc., Cary, NC).

Results: Univariate analysis reveals a significant association between USMLE Step 1 and 2 scores with medical college admissions test scores, grade point averages, school type (private vs. public), full-time faculty-to-student ratio, National Institute of Health funds, residency director assessment score, peer assessment score, and class size. Of these nine variables, MCAT scores and Step 1 scores display the strongest correlation (corr = 0.72, P < .0001). Multivariable analysis also supports a significant association between MCAT scores and Step scores, meanwhile National Institute of Health funding size demonstrates a negative correlation with USMLE Step 2 scores. Although MCAT scores and National Institute of Health funds are significantly associated with USMLE performance, six outlier institutions were identified, producing higher USMLE scores than trend line predictions.

Conclusions: Outlier institutions produce USMLE scores that do not follow expected trend lines. Their performance might be explainable by differences in curriculum. Having identified these institutions, their curriculums can be further studied to determine what factors enhance student learning.

Keywords: Assessment; Curriculum; Evaluation; Student learning; USMLE; United States medical licensing examination.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Fit Diagnostics for STEP1
Fig. 2
Fig. 2
Fit Diagnostics for STEP2
See this image and copyright information in PMC

References

    1. Kirch D, Prescott J. From rankings to Mission. Acad Med. 2013;88(8):1064–1066. doi: 10.1097/ACM.0b013e318299efd9. - DOI - PubMed
    1. Goldstein M, Lunn M, Peng L. What makes a top research medical school? A call for a new model to evaluate academic physicians and medical school performance. Acad Med. 2015;90(5):603–608. doi: 10.1097/ACM.0000000000000646. - DOI - PubMed
    1. Hendrix D. An analysis of bibliometric indicators, National Institutes of Health funding, and faculty size at Association of American Medical Colleges medical schools, 1997–2007. Journal of the Medical Library Association: JMLA. 2008;96(4):324–334. doi: 10.3163/1536-5050.96.4.007. - DOI - PMC - PubMed
    1. Hu Y, Martindale J, LeGallo R, White C, McGahren E, Schroen A. Relationships between preclinical course grades and standardized exam performance. Adv Health Sci Educ. 2015;21(2):389–399. doi: 10.1007/s10459-015-9637-6. - DOI - PubMed
    1. Torre D, Papp K, Elnicki M, Durning S. Clerkship directors’ practices with respect to preparing students for and using the National Board of medical examiners subject exam in medicine: results of a United States and Canadian survey. Acad Med. 2009;84(7):867–871. doi: 10.1097/ACM.0b013e3181a858ef. - DOI - PubMed

MeSH terms

LinkOut - more resources