Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Dec;28(1):2178913.
doi: 10.1080/10872981.2023.2178913.

Using learning analytics in clinical competency committees: Increasing the impact of competency-based medical education

Patricia A Carney  1 , Stefanie S Sebok-Syer  2 , Martin V Pusic  3 , Colleen C Gillespie  4 , Marjorie Westervelt  5 , Mary Ellen J Goldhamer  6
Affiliations

Using learning analytics in clinical competency committees: Increasing the impact of competency-based medical education

Patricia A Carney et al. Med Educ Online. 2023 Dec.

Abstract

Graduate medical education (GME) and Clinical Competency Committees (CCC) have been evolving to monitor trainee progression using competency-based medical education principles and outcomes, though evidence suggests CCCs fall short of this goal. Challenges include that evaluation data are often incomplete, insufficient, poorly aligned with performance, conflicting or of unknown quality, and CCCs struggle to organize, analyze, visualize, and integrate data elements across sources, collection methods, contexts, and time-periods, which makes advancement decisions difficult. Learning analytics have significant potential to improve competence committee decision making, yet their use is not yet commonplace. Learning analytics (LA) is the interpretation of multiple data sources gathered on trainees to assess academic progress, predict future performance, and identify potential issues to be addressed with feedback and individualized learning plans. What distinguishes LA from other educational approaches is systematic data collection and advanced digital interpretation and visualization to inform educational systems. These data are necessary to: 1) fully understand educational contexts and guide improvements; 2) advance proficiency among stakeholders to make ethical and accurate summative decisions; and 3) clearly communicate methods, findings, and actionable recommendations for a range of educational stakeholders. The ACGME released the third edition CCC Guidebook for Programs in 2020 and the 2021 Milestones 2.0 supplement of the Journal of Graduate Medical Education (JGME Supplement) presented important papers that describe evaluation and implementation features of effective CCCs. Principles of LA underpin national GME outcomes data and training across specialties; however, little guidance currently exists on how GME programs can use LA to improve the CCC process. Here we outline recommendations for implementing learning analytics for supporting decision making on trainee progress in two areas: 1) Data Quality and Decision Making, and 2) Educator Development.

Keywords: Clinical Competency Committees; Competency-based medical education; Learning Analytics; Ressident Assessment; graduate medical education.

PubMed Disclaimer

Conflict of interest statement

No potential conflict of interest was reported by the authors.

Figures

Figure 1.
Figure 1.
The Learning Analytics Landscape with Currently Existing Data Integration Failures.
See this image and copyright information in PMC

References

    1. Andolsek K, Padmore J, Hauer KE, et al. Accreditation Council for Graduate Medical Education (ACGME) Clinical Competency Committees a Guidebook for Programs 3rd Edition. Published 2020. Accessed May 14, 2022. https://www.acgme.org/globalassets/acgmeclinicalcompetencycommitteeguide...
    1. Ekpenyong A, Padmore JS, Hauer KE.. The Purpose, Structure, and Process of Clinical Competency Committees: guidance for Members and Program Directors. J Grad Med Educ. 2021;13(2s):45–7. - PMC - PubMed
    1. Frank JR, Snell LS, ten CO, et al. Competency-based medical education: theory to practice. Med Teach. 2010;32(8):638–645. - PubMed
    1. van Melle E, Hall AK, Schumacher DJ, et al. Capturing outcomes of competency-based medical education: the call and the challenge. Med Teach. 2021;43(7):794–800. DOI:10.1080/0142159X.2021.1925640 - DOI - PubMed
    1. van Melle E, Frank JR, Holmboe ES, et al. A Core Components Framework for Evaluating Implementation of Competency-Based Medical Education Programs. Acad Med. 2019;94(7):1002–1009. - PubMed

LinkOut - more resources