Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Mar;32(1):1-11.
doi: 10.3946/kjme.2020.148. Epub 2020 Mar 1.

The development of an evaluation tool to assess professional behavior and clinical competencies from the graduates' perspective

Mia Kusmiati  1   2 , Rafidah Bahari  2 , Suhaila Sanip  3 , Noor Aini Abdul Hamid  4 , Ova Emilia  5
Affiliations

The development of an evaluation tool to assess professional behavior and clinical competencies from the graduates' perspective

Mia Kusmiati et al. Korean J Med Educ. 2020 Mar.

Abstract

Purpose: This study was designed to develop an evaluation tool for assessing professional behavior and clinical competencies from the graduates' perspective.

Methods: This study employed mixed method in a sequential exploratory design. The semi-structured interviews were conducted with three graduates from different cohorts. The qualitative analysis of the interviews found six emerging themes for professional behavior and clinical competencies development. These themes were then developed into a 55-item questionnaire. The questionnaire was then distributed to 84 medical graduates for exploratory factor analysis (EFA) from February to April 2019. The quantitative data were analyzed using IBM SPSS ver. 21.0 (IBM Corp., Armonk, USA) for principal axis factoring. After conducting EFA, we proceeded with confirmatory factor analysis (CFA) with another 120 graduates to validate the tool.

Results: Eighty-four graduates completed the questionnaire for EFA. Upon completion of EFA, 35 out of 55 items of the questionnaire were found to be valid and reliable. The most appropriate fit was seven factors, which explained 58.18% of variance between them after 15 iterations with Cronbach's α of 0.916. The personal satisfaction factor was noted to be weak. It was therefore added to patient management factor due to its similar intention. The final EFA factor after the modification was six. The CFA found that 34 out of 35 items was valid and reliable that representation of the latent variables.

Conclusion: The questionnaire has achieved the desired construct validity score and can be used as an evaluation tool to assess professional behavior and clinical competencies from the graduates' perspective.

Keywords: Clinical competence; Evaluation study; Graduate; Professional competence.

PubMed Disclaimer

Conflict of interest statement

Conflicts of interest

No potential conflict of interest relevant to this article was reported.

Figures

Fig. 1.
Fig. 1.. Summary of the Steps Involved in the Study
Fig. 2.
Fig. 2.. Examples of the Questions for Semi-Structured Interview with the Graduates
UNISBA: Universitas Islam Bandung.
Fig. 3.
Fig. 3.. Result of Confirmatory Factor Analysis of Six Components on the Graduate's Instrument
(A) Item C1–C16. (B) Item C17–C35. hum: Humanity, cog: Cognitive competence, skl: Clinical skill competence, pro: Professional behavior, Pxm: Patient management, ips: Interpersonal skill, df: Degrees of freedom, RMSEA: Root mean square error of approximation.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Arnold L. Assessing professional behavior: yesterday, today, and tomorrow. Acad Med. 2002;77(6):502–515. - PubMed
    1. Hodges BD, Ginsburg S, Cruess R, et al. Assessment of professionalism: recommendations from the Ottawa 2010 Conference. Med Teach. 2011;33(5):354–363. - PubMed
    1. Adam J, Bore M, McKendree J, Munro D, Powis D. Can personal qualities of medical students predict in-course examination success and professional behaviour?: an exploratory prospective cohort study. BMC Med Educ. 2012;12:69. - PMC - PubMed
    1. Lynch DC, Surdyk PM, Eiser AR. Assessing professionalism: a review of the literature. Med Teach. 2004;26(4):366–373. - PubMed
    1. Mueller PS. Incorporating professionalism into medical education: the Mayo Clinic experience. Keio J Med. 2009;58(3):133–143. - PubMed

LinkOut - more resources