Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 May;36(5):1271-1278.
doi: 10.1007/s11606-020-06320-0. Epub 2020 Oct 26.

Development of Resident-Sensitive Quality Measures for Inpatient General Internal Medicine

Benjamin Kinnear  1   2 , Matthew Kelleher  3   4 , Dana Sall  4 , Daniel P Schauer  4 , Eric J Warm  4 , Andrea Kachelmeyer  3 , Abigail Martini  3 , Daniel J Schumacher  3
Affiliations

Development of Resident-Sensitive Quality Measures for Inpatient General Internal Medicine

Benjamin Kinnear et al. J Gen Intern Med. 2021 May.

Abstract

Background: Graduate medical education (GME) training has long-lasting effects on patient care quality. Despite this, few GME programs use clinical care measures as part of resident assessment. Furthermore, there is no gold standard to identify clinical care measures that are reflective of resident care. Resident-sensitive quality measures (RSQMs), defined as "measures that are meaningful in patient care and are most likely attributable to resident care," have been developed using consensus methodology and piloted in pediatric emergency medicine. However, this approach has not been tested in internal medicine (IM).

Objective: To develop RSQMs for a general internal medicine (GIM) inpatient residency rotation using previously described consensus methods.

Design: The authors used two consensus methods, nominal group technique (NGT) and a subsequent Delphi method, to generate RSQMs for a GIM inpatient rotation. RSQMs were generated for specific clinical conditions found on a GIM inpatient rotation, as well as for general care on a GIM ward.

Participants: NGT participants included nine IM and medicine-pediatrics (MP) residents and six IM and MP faculty members. The Delphi group included seven IM and MP residents and seven IM and MP faculty members.

Main measures: The number and description of RSQMs generated during this process.

Key results: Consensus methods resulted in 89 RSQMs with the following breakdown by condition: GIM general care-21, diabetes mellitus-16, hyperkalemia-14, COPD-13, hypertension-11, pneumonia-10, and hypokalemia-4. All RSQMs were process measures, with 48% relating to documentation and 51% relating to orders. Fifty-eight percent of RSQMs were related to the primary admitting diagnosis, while 42% could also be related to chronic comorbidities that require management during an admission.

Conclusions: Consensus methods resulted in 89 RSQMs for a GIM inpatient service. While all RSQMs were process measures, they may still hold value in learner assessment, formative feedback, and program evaluation.

Keywords: assessment; competency-based medical education; graduate medical education; quality.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they do not have a conflict of interest.

Figures

Figure 1
Figure 1
Overview of the consensus process used to generate inpatient general internal medicine resident-sensitive quality measures.
See this image and copyright information in PMC

References

    1. Asch DA, Nicholson S, Srinivas S, Herrin J, Epstein AJ. Evaluating obstetrical residency programs using patient outcomes. Jama. 2009;302(12):1277–1283. doi: 10.1001/jama.2009.1356. - DOI - PubMed
    1. Bansal N, Simmons KD, Epstein AJ, Morris JB, Kelz RR. Using patient outcomes to evaluate general surgery residency program performance. JAMA Surg. 2016;151(2):111–119. doi: 10.1001/jamasurg.2015.3637. - DOI - PubMed
    1. Chen C, Petterson S, Phillips R, Bazemore A, Mullan F. Spending patterns in region of residency training and subsequent expenditures for care provided by practicing physicians for Medicare beneficiaries. Jama. 2014;312(22):2385–2393. doi: 10.1001/jama.2014.15973. - DOI - PubMed
    1. Sirovich BE, Lipner RS, Johnston M, Holmboe ES. The association between residency training and internists’ ability to practice conservatively. JAMA Intern Med. 2014;174(10):1640–1648. doi: 10.1001/jamainternmed.2014.3337. - DOI - PMC - PubMed
    1. Norcini JJ, Boulet JR, Opalek A, Dauphinee WD. Specialty board certification rate as an outcome metric for gme training institutions: a relationship with quality of care. Eval Health Prof. 2020;43(3):143-148. - PubMed

Publication types

LinkOut - more resources