Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Aug 23;16(8):e67640.
doi: 10.7759/cureus.67640. eCollection 2024 Aug.

Evaluating the Role of Objective Structured Clinical Examination as a Summative Assessment Tool in Undergraduate and Postgraduate Psychiatry Residents

Affiliations

Evaluating the Role of Objective Structured Clinical Examination as a Summative Assessment Tool in Undergraduate and Postgraduate Psychiatry Residents

Abhishek Pathak et al. Cureus. .

Abstract

Background: The Objective Structured Clinical Examination (OSCE) is the gold standard and universal format to assess medical students' clinical competence in a comprehensive, reliable, and valid manner. OSCE is gaining global popularity for assessing medical students in various specialties. Our country uses it in multiple disciplines, but its application in psychiatry remains limited. OSCE is a resource-demanding assessment method that can face numerous challenges. A comprehensive assessment of perceptions regarding OSCE can help identify areas that need improvement. Therefore, this study was conducted to assess the perceptions of students and examiners toward OSCE in psychiatry.

Aims and objectives: This study aims to evaluate the role of Objective Structured Clinical Examination as a summative assessment tool in assessing competency in undergraduate (as part of their ward leaving examinations in psychiatry) and postgraduate psychiatry residents (as part of their six-monthly assessments) and analyze the perceptions of students as well as of the faculty members regarding OSCE.

Methods: Six MD students and 49 MBBS students took the OSCE as part of their ward-level exams in psychiatry. In the presence of four faculty members of the psychiatry department, students completed their six-month summative exams. The OSCE was held at separate times for UG and PG students. UG and PG students utilized different stations (PG students had a harder level). A 10-item questionnaire was given to examiners and students at the end of the OSCE to get their opinions regarding the OSCE. Furthermore, data gathered from the faculty through an open-ended questionnaire was compiled and displayed thematically. Since the Likert scale survey generated ordinal data, the statistical analysis was conducted using the median, interquartile range (IQR), and chi-square test. The chi-square test was used to compare the variables. A P-value of less than 0.05 was deemed statistically noteworthy.

Results: Four faculty members and fifty-five students in all answered the questionnaire. Regarding the OSCE's characteristics, validity, reliability, and transparency, the majority of students expressed positive opinions. In a similar vein, most examiners had positive perceptions pertaining to OSCE's administration, structure, and procedures. Certain areas, such as "improved confidence in teaching clinical skills" and "improved confidence in giving students structured feedback," were also emphasized by thematic analysis of faculty members.

Conclusion: In general, both students and examiners had extremely favorable perceptions of and embraced the OSCE. Improved faculty orientation and student preparation for the OSCE may help allay anxiety and overcome hesitation related to the exam.

Keywords: assessment; competence; faculty perception; medical education; objective structured clinical examination; psychiatry; reliability; student perception; validity.

PubMed Disclaimer

Conflict of interest statement

Human subjects: Consent was obtained or waived by all participants in this study. HIMS Institutional Ethics Committee (IHEC-HIMSA/FA/RD-05/04-24) issued approval (IHEC-HIMSA/FA/RD-05/04-24). The Institutional Ethics Committee of Hind Institute of Medical Sciences, Sitapur, granted ethical approval for this research on April 12, 2024 (IHEC-HIMSA/FA/RD-05/04-24). Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue. Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following: Payment/services info: All authors have declared that no financial support was received from any organization for the submitted work. Financial relationships: All authors have declared that they have no financial relationships at present or within the previous three years with any organizations that might have an interest in the submitted work. Other relationships: All authors have declared that there are no other relationships or activities that could appear to have influenced the submitted work.

Figures

Figure 1
Figure 1. OSCE Feedback Questions and Scores (frequency (%) out of 55)
OSCE: objective structured clinical examination

Similar articles

References

    1. Validity and the OSCE. Hodges B. Med Teach. 2003;25:250–254. - PubMed
    1. The assessment of clinical skills/competence/performance. Miller GE. Acad Med. 1990;65:0–7.
    1. Examination of clinical examiners. Wilson GM, Lever R, Harden RM, Roberston JI, MacRitchie J. Lancet. 1969;1:37–40. - PubMed
    1. Dimensionality, internal consistency and interrater reliability of clinical performance ratings. Maxim BR, Dielman TE. Med Educ. 1987;21:130–137. - PubMed
    1. Objective Structured Clinical Examinations (OSCEs), psychiatry and the Clinical assessment of Skills and Competencies (CASC) same evidence, different judgement. Marwaha S. BMC Psychiatry. 2011;11:85. - PMC - PubMed

LinkOut - more resources