Real-world use of workplace based assessments in surgical training: A UK nationwide cross-sectional exploration of trainee perspectives and consensus recommendations from the Association of Surgeons in Training

Abstract

Background: Despite widespread uptake, the utility of Workplace Based Assessments (WBAs) is disputed and evidence underpinning their use is largely based upon their completion in ideal conditions, rather than the real-world setting.

Aim: To ascertain the real-world usage of WBAs, as perceived by UK surgical trainees.

Materials and methods: An anonymous online questionnaire conducted nationally via the Association of Surgeons in Training (ASiT). Evaluation of 906 completed trainee responses, across all surgical specialties and training levels, employed mixed methods to interpret quantitative and qualitative data.

Results: The sample permitted a 3.0% confidence level with acceptable internal consistency (Cronbach's alpha 0.755). Formative use was supported by 72.5% and summative use was rejected by almost as many (66.3%). WBA use was perceived to deviate markedly from that recommended by the Joint Committee on Surgical Training (JCST). Significant misuse was identified and elements perceived as inaccurate appear commonplace across the breadth of surgical specialties. Inaccurate completion was acknowledged by 89.6% of respondents and some trainers appear complicit, 147 individuals (16.2%) having reported this to trainers, 40.9% aware of 'unobserved sign-off', and 33.6% aware of 'password disclosure' by trainers. Furthermore, a majority of trainees felt the Annual Review of Competency Progression (ARCP) respected WBA quantity above quality (55.4%), and a third felt pressure to overstate the number completed (32.0%). Reasons for misuse appeared largely centred upon time restraints, lack of engagement and a will to achieve the required targets for career progression. 1.5 CONCLUSIONS: This study demonstrates that UK surgical trainees perceive that most trainees deviate from guidance in their use of WBAs. This is worrying in both the apparent frequency and nature of misuse and somewhat undermines existing evidence for their role in surgical training. Trainees perceive that required numbers of WBAs are too high, that training programmes fail to encourage their use as formative assessments, and that there is a lack of engagement by many trainees and trainers. We present consensus recommendations from ASiT for the improvement of WBA use in UK surgical training.

Keywords: Assessment; Medical education; Surgery; Surgical training; Workplace-based assessment.