Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2010 Dec;2(4):523-9.
doi: 10.4300/JGME-D-10-00083.1.

Rubric evaluation of pediatric emergency medicine fellows

Deborah C Hsu, Charles G Macias

Rubric evaluation of pediatric emergency medicine fellows

Deborah C Hsu et al. J Grad Med Educ. 2010 Dec.

Abstract

Objectives: To develop and validate a rubric assessment instrument for use by pediatric emergency medicine (PEM) faculty to evaluate PEM fellows and for fellows to use to self-assess.

Methods: This is a prospective study at a PEM fellowship program. The assessment instrument was developed through a multistep process: (1) development of rubric format items, scaled on the modified Dreyfus model proficiency levels, corresponding to the 6 Accreditation Council for Graduate Medical Education core competencies; (2) determination of content and construct validity of the items through structured input and item refinement by subject matter experts and focus group review; (3) collection of data using a 61-item form; (4) evaluation of psychometrics; (5) selection of items for use in the final instrument.

Results: A total of 261 evaluations were collected from 2006 to 2007; exploratory factor analysis yielded 5 factors with Eigenvalues >1.0; each contained ≥4 items, with factor loadings >0.4 corresponding with the following competencies: (1) medical knowledge and practice-based learning and improvement, (2) patient care and systems-based practice, (3) interpersonal skills, (4) communication skills, and (5) professionalism. Cronbach α for the final 53-item instrument was 0.989. There was also significant responsiveness of the tool to the year of training.

Conclusion: A substantively and statistically validated rubric evaluation of PEM fellows is a reliable tool for formative and summative evaluation.

PubMed Disclaimer

Similar articles

See all similar articles

Cited by

  • The Arthroscopic Surgical Skill Evaluation Tool (ASSET).
    Koehler RJ, Amsdell S, Arendt EA, Bisson LJ, Braman JP, Butler A, Cosgarea AJ, Harner CD, Garrett WE, Olson T, Warme WJ, Nicandri GT. Koehler RJ, et al. Am J Sports Med. 2013 Jun;41(6):1229-37. doi: 10.1177/0363546513483535. Epub 2013 Apr 2. Am J Sports Med. 2013. PMID: 23548808 Free PMC article.

References

    1. Swing S. Assessing the ACGME general competencies: general considerations and assessment methods. Acad Emerg Med. 2002;9((11)):1278–1288. - PubMed
    1. Lynch D. C., Swing S. R. Accreditation Council for Graduate Medical Education. Key considerations for selecting assessment instruments and implementing assessment systems. Available at: http://www.acgme.org/outcome/assess/keyconsids.pdf. Accessed April 9, 2008.
    1. Silber C. G., Nasca T. J., Paskin D. L., Eiger G., Robeson M., Meloski J. J. Do global rating forms enable program directors to asses the ACGME competencies? Acad Med. 2004;79((6)):549–556. - PubMed
    1. Davis J., Inamdar S., Stone R. Inter-rater agreement and predictive validity of faculty ratings of pediatric fellows. J Med Educ. 1986;61:901–905. - PubMed
    1. Haber R., Avins A. Do ratings on the American Board of Internal Medicine Resident Evaluation Form detect differences in clinical competence? J Gen Intern Med. 1994;9:140–145. - PubMed

LinkOut - more resources