Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Observational Study
. 2018 Aug;10(4):429-437.
doi: 10.4300/JGME-D-17-00762.1.

Influence of Clinical Competency Committee Review Process on Summative Resident Assessment Decisions

Daniel J Schumacher, Beth King, Michelle M Barnes, Sean P Elliott, Kathleen Gibbs, Jon F McGreevy, Javier Gonzalez Del Rey, Tanvi Sharma, Catherine Michelson, Alan Schwartz; Members of the APPD LEARN CCC Study Group
Observational Study

Influence of Clinical Competency Committee Review Process on Summative Resident Assessment Decisions

Daniel J Schumacher et al. J Grad Med Educ. 2018 Aug.

Abstract

Background: Clinical Competency Committees (CCCs) are charged with making summative assessment decisions about residents.

Objective: We explored how review processes CCC members utilize influence their decisions regarding residents' milestone levels and supervisory roles.

Methods: We conducted a multisite longitudinal prospective observational cohort study at 14 pediatrics residency programs during academic year 2015-2016. Individual CCC members biannually reported characteristics of their review process and Accreditation Council for Graduate Medical Education milestone levels and recommended supervisory role categorizations assigned to residents. Relationships among characteristics of CCC member reviews, mean milestone levels, and supervisory role categorizations were analyzed using mixed-effects linear regression, reported as mean differences with 95% confidence intervals (CIs), and Bayesian mixed-effects ordinal regression, reported as odds ratios (ORs) and 95% credible intervals (CrIs).

Results: A total of 155 CCC members participated. Members who provided milestones or other professional development feedback after CCC meetings assigned significantly lower mean milestone levels (mean 1.4 points; CI -2.2 to -0.6; P < .001) and were significantly less likely to recommend supervisory responsibility in any setting (OR = 0.23, CrI 0.05-0.83) compared with CCC members who did not. Members recommended less supervisory responsibility when they reviewed more residents (OR = 0.96, 95% CrI 0.94-0.99) and participated in more review cycles (OR = 0.22, 95% CrI 0.07-0.63).

Conclusions: This study explored the association between characteristics of individual CCC member reviews and their summative assessment decisions about residents. Further study is needed to gain deeper understanding of factors influencing CCC members' summative assessment decisions.

PubMed Disclaimer

Conflict of interest statement

Conflict of interest: The authors declare they have no competing interests. The views expressed in this article are those of the authors and do not necessarily reflect the official policy or position of the Department of the Navy, Department of Defense, or the US government.

Figures

Figure 1
Figure 1
Study Data Collection Process
Figure 2
Figure 2
Supervision Categories
See this image and copyright information in PMC

References

    1. Nasca TJ, Philibert I, Brigham T, et al. The next GME accreditation system—rationale and benefits. N Engl J Med. 2012;366(11):1051–1056. - PubMed
    1. Chahine S, Cristancho S, Padgett J, et al. How do small groups make decisions? A theoretical framework to inform the implementation and study of clinical competency committees. Perspect Med Educ. 2017;6(3):192–198. - PMC - PubMed
    1. Promes SB, Wagner MJ. Starting a clinical competency committee. J Grad Med Educ. 2014;6(1):163–164. - PMC - PubMed
    1. French JC, Dannefer EF, Colbert CY. A systematic approach toward building a fully operational clinical competency committee. J Surg Educ. 2014;71(6):e22–e27. - PubMed
    1. Hauer KE, Kohlwes J, Cornett P, et al. Identifying entrustable professional activities in internal medicine training. J Grad Med Educ. 2013;5(1):54–59. - PMC - PubMed

Publication types