Development of an Instrument for Preceptor Evaluation of Medical Graduates' Performance: the Psychometric Properties
- PMID: 34457569
- PMCID: PMC8368111
- DOI: 10.1007/s40670-019-00774-6
Development of an Instrument for Preceptor Evaluation of Medical Graduates' Performance: the Psychometric Properties
Abstract
Background: A preceptor has a key role in evaluating medical graduate's performance in the clinical setting. This study is conducted to develop an instrument for preceptor evaluation of medical graduates' performance in the clinical setting.
Method: A mixed-method study design, sequential exploratory approach was chosen to develop the instrument. Initial semi-structured interviews were conducted with 4 preceptors at the teaching hospitals. Five main themes emerged from the interviews. The themes were developed into a 23-item questionnaire. Nineteen Head or Assistant Head of clinical departments were asked to review the relevance of the content. The questionnaire was later sent out to 34 preceptors and 35 paramedic staffs to participate in the construct validity study by conducting exploratory factor analysis (EFA). SPSS version 21 software was used to analyze the data and Varimax rotation method was performed to simplify and describe the data structure.
Result: Review of the factor structures suggested that the most appropriate fit was 5 factors. Most of the questionnaire items were relevant to assess performance (4.65 + 0.15), except in item 4 of the clinical skill factor. The 23 items of the evaluation instruments showed that five factors were extracted which explained 73.9% of the variance between them. Construct validity was achieved after the instrument was run for an iteration of eight times, with Cronbach's alpha of 0.951.
Discussion: The instrument has achieved the desired content and construct validity score. It can be used by other institutions to assess their medical graduates' performance in the clinical setting.
Keywords: Construct validity; Content validity; EFA; Preceptor.
© International Association of Medical Science Educators 2019.
Conflict of interest statement
Conflict of InterestThe authors declare that they have no conflict of interest.
Figures
Similar articles
-
The development of an evaluation tool to assess professional behavior and clinical competencies from the graduates' perspective.Korean J Med Educ. 2020 Mar;32(1):1-11. doi: 10.3946/kjme.2020.148. Epub 2020 Mar 1. Korean J Med Educ. 2020. PMID: 32130846 Free PMC article.
-
Development and validation of a questionnaire to determine medical orders non-adherence: a sequential exploratory mixed-method study.BMC Health Serv Res. 2021 Feb 12;21(1):136. doi: 10.1186/s12913-021-06147-3. BMC Health Serv Res. 2021. PMID: 33579267 Free PMC article.
-
Development and psychometric testing of the preceptors' orientation competence instrument (POCI).Nurse Educ Pract. 2022 Oct;64:103445. doi: 10.1016/j.nepr.2022.103445. Epub 2022 Aug 27. Nurse Educ Pract. 2022. PMID: 36088716
-
[Psychometric characteristics of questionnaires designed to assess the knowledge, perceptions and practices of health care professionals with regards to alcoholic patients].Encephale. 2004 Sep-Oct;30(5):437-46. doi: 10.1016/s0013-7006(04)95458-9. Encephale. 2004. PMID: 15627048 Review. French.
-
[Teacher's performance evaluation in medical specialties courses. An instrument validation].Rev Med Inst Mex Seguro Soc. 2008 Jul-Aug;46(4):375-82. Rev Med Inst Mex Seguro Soc. 2008. PMID: 19213208 Review. Spanish.
Cited by
-
The development of an evaluation tool to assess professional behavior and clinical competencies from the graduates' perspective.Korean J Med Educ. 2020 Mar;32(1):1-11. doi: 10.3946/kjme.2020.148. Epub 2020 Mar 1. Korean J Med Educ. 2020. PMID: 32130846 Free PMC article.
References
-
- Creswell JW. A concise introduction to mixed methods research. Lincoln: SAGE Publication; 2015. pp. 6–7.
-
- Creswell JW. In: Smith PA, editor. Educational research: planning, conducting, and evaluating quantitative and qualitative research. 4th ed: Pearson; 2012. p. 539–47.
LinkOut - more resources
Full Text Sources