Experiences of using an OSCE protocol in clinical examinations of nursing students - A comparison of student and faculty assessments

Abstract

Peer-assessment in nursing education using an OSCE protocol is an increasing educational activity that complements that of teachers. However, little is known about how students' and teachers' assessments correspond. The study aimed to compare OSCE assessments made by student examiners and faculty examiners during examinations of clinical skills in undergraduate nursing education. Four cohorts of third-year nursing students participated between 2014 and 2016. The students underwent a clinical examination of the management of central venous catheters and totally implantable venous access devices. Students who performed the examinations were observed both by a faculty examiner and student examiner. Both observers used the same OSCE protocol for the assessment but independently. The OSCE protocols from both faculty and student examiners were reviewed and compared. Total agreement between the student and faculty examiner was reached in 127 of 135 (94%) paired protocols. The level of agreement was substantial with a kappa value of 0.79 (95% CI 0.65-0.93). The conclusion was that the level of agreement between student and faculty examiners was high when using an OSCE protocol in clinical examinations of two different clinical skill tasks. The structured checklist (OSCE protocol) was easy to use for the student examiners despite the lack of experience or training in advance.

Keywords: Clinical examination; Nursing education; OSCE protocol; Peer-assessment.