Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Nov 13;9(6):e213.
doi: 10.1192/bjo.2023.582.

Assessing professionalism in mental health clinicians: development and validation of a situational judgement test

Lauren M E Aylott  1 , Gabrielle M Finn  2 , Paul A Tiffin  3
Affiliations

Assessing professionalism in mental health clinicians: development and validation of a situational judgement test

Lauren M E Aylott et al. BJPsych Open. .

Abstract

Background: Situational judgement test (SJT) scores have been observed to predict actual workplace performance. They are commonly used to assess non-academic attributes as part of selection into many healthcare roles. However, no validated SJT yet exists for recruiting into mental health services.

Aims: To develop and validate an SJT that can evaluate procedural knowledge of professionalism in applicants to clinical roles in mental health services.

Method: SJT item content was generated through interviews and focus groups with 56 professionals, patients and carers related to a large National Health Service mental health trust in England. These subject matter experts informed the content of the final items for the SJT. The SJT was completed by 73 registered nurses and 36 allied health professionals (AHPs). The primary outcome measure was supervisor ratings of professionalism and effectiveness on a relative percentile rating scale and was present for 69 of the participating nurses and AHPs. Personality assessment scores were reported as a secondary outcome.

Results: SJT scores statistically significantly predicted ratings of professionalism (β = 0.31, P = 0.01) and effectiveness (β = 0.32, P = 0.01). The scores demonstrated statistically significant incremental predictive validity over the personality assessment scores for predicting supervisor ratings of professionalism (β = 0.26, P = 0.03).

Conclusions: These findings demonstrate that a carefully designed SJT can validly assess important personal attributes in clinicians working in mental health services. Such assessments are likely to represent evidence based, cost-effective tools that can support values-based recruitment to mental health service roles.

Keywords: Mental health services; personnel selection; procedural knowledge; professionalism; situational judgement testing.

PubMed Disclaimer

Conflict of interest statement

None.

Figures

Fig. 1
Fig. 1
Flow diagram depicting the item selection process. Note: one item was marked as both ‘not plausible’ and ‘not realistic’ during stage 1; hence, the total of these values is 32, yet only 31 items were omitted. SME, subject matter expert.
Fig. 2
Fig. 2
Flow diagram of participation in the validation study. AHP, allied health professional.
See this image and copyright information in PMC

References

    1. Schwartz SH. An overview of the Schwartz theory of basic values. Online Readings Psychol Cult, 2012. (10.9707/2307-0919.1116). - DOI
    1. Health Education England. Evaluation of Values Based Recruitment (VBR) in the NHS: Analysis of VBR Activity Within NHS Trusts. NHS Health Education England, 2014. (https://www.hee.nhs.uk/our-work/values-based-recruitment [cited 19 Mar 2023]).
    1. Department of Health. No Secrets: Guidance on Developing and Implementing Multi-Agency Policies and Procedures to Protect Vulnerable Adults from Abuse. Department of Health, 2000. (updated 2015) (https://www.gov.uk/government/publications/no-secrets-guidance-on-protec... [cited 19 Mar 2023]).
    1. Department of Health. Transforming Care: A National Response to Winterbourne View Hospital: Department of Health Review: Final Report. Department of Health, 2012. (https://assets.publishing.service.gov.uk/government/uploads/system/uploa... [cited 19 Mar 2023]).
    1. Tiffin PA, Paton LW, Mwandigha LM, McLachlan JC, Illing J. Predicting fitness to practise events in international medical graduates who registered as UK doctors via the Professional and Linguistic Assessments Board (PLAB) system: a national cohort study. BMC Med 2017; 15: 66. - PMC - PubMed