Accuracy of individual and combined risk-scale items in the prediction of repetition of self-harm: multicentre prospective cohort study
- PMID: 33261707
- PMCID: PMC7791570
- DOI: 10.1192/bjo.2020.123
Accuracy of individual and combined risk-scale items in the prediction of repetition of self-harm: multicentre prospective cohort study
Abstract
Background: Individuals attending emergency departments following self-harm have increased risks of future self-harm. Despite the common use of risk scales in self-harm assessment, there is growing evidence that combinations of risk factors do not accurately identify those at greatest risk of further self-harm and suicide.
Aims: To evaluate and compare predictive accuracy in prediction of repeat self-harm from clinician and patient ratings of risk, individual risk-scale items and a scale constructed with top-performing items.
Method: We conducted secondary analysis of data from a five-hospital multicentre prospective cohort study of participants referred to psychiatric liaison services following self-harm. We tested predictive utility of items from five risk scales: Manchester Self-Harm Rule, ReACT Self-Harm Rule, SAD PERSONS, Modified SAD PERSONS, Barratt Impulsiveness Scale and clinician and patient risk estimates. Area under the curve (AUC), sensitivity, specificity, predictive values and likelihood ratios were used to evaluate predictive accuracy, with sensitivity analyses using classification-tree regression.
Results: A total of 483 self-harm episodes were included, and 145 (30%) were followed by a repeat presentation within 6 months. AUC of individual items ranged from 0.43-0.65. Combining best performing items resulted in an AUC of 0.56. Some individual items outperformed the scale they originated from; no items were superior to clinician or patient risk estimations.
Conclusions: No individual or combination of items outperformed patients' or clinicians' ratings. This suggests there are limitations to combining risk factors to predict risk of self-harm repetition. Risk scales should have little role in the management of people who have self-harmed.
Keywords: Risk assessment; rating scales; self-harm; statistical methodology; suicide.
Conflict of interest statement
D.G., K.H. and N.K. are members of the Department of Health's (England) National Suicide Prevention Strategy Advisory Group. N.K. chaired the National Institute for Health and Care Excellence (NICE) guideline development group for the longer-term management of self-harm and the NICE Topic Expert Group (which developed the quality standards for self-harm services). He is currently chair of the updated NICE guideline for Depression. K.H. and D.G. are Emeritus NIHR Senior Investigators. K.H. is also supported by the Oxford Health NHS Foundation Trust and N.K. by the Manchester Mental Health and Social Care Trust.
ICMJE forms are in the supplementary material, available online at
Figures



Similar articles
-
Predictive accuracy of risk scales following self-harm: multicentre, prospective cohort study.Br J Psychiatry. 2017 Jun;210(6):429-436. doi: 10.1192/bjp.bp.116.189993. Epub 2017 Mar 16. Br J Psychiatry. 2017. PMID: 28302702 Free PMC article.
-
Accuracy of risk scales for predicting repeat self-harm and suicide: a multicentre, population-level cohort study using routine clinical data.BMC Psychiatry. 2018 Apr 25;18(1):113. doi: 10.1186/s12888-018-1693-z. BMC Psychiatry. 2018. PMID: 29699523 Free PMC article.
-
Risk assessment scales to predict risk of hospital treated repeat self-harm: A cost-effectiveness modelling analysis.J Affect Disord. 2019 Apr 15;249:208-215. doi: 10.1016/j.jad.2019.02.036. Epub 2019 Feb 11. J Affect Disord. 2019. PMID: 30772749
-
Reducing self-harm in adolescents: the RISA-IPD individual patient data meta-analysis and systematic review.Health Technol Assess. 2024 Jul 10:1-42. doi: 10.3310/GTNT6331. Online ahead of print. Health Technol Assess. 2024. PMID: 39024118
-
Suicide and Self-Harm Risk Assessment: A Systematic Review of Prospective Research.Arch Suicide Res. 2022 Oct-Dec;26(4):1645-1665. doi: 10.1080/13811118.2021.1938321. Epub 2021 Jul 1. Arch Suicide Res. 2022. PMID: 34193026
References
-
- Department of Health. Preventing Suicide in England: Third Progress Report of the Cross-Government outcomes Strategy to Save Lives. Department of Health, 2017.
-
- Hawton K, Bergen H, Casey D, Simkin S, Palmer B, Cooper J, et al. Self-harm in England: a tale of three cities - Multicentre study of self-harm. Soc Psychiatry Psychiatr Epidemiol 2007; 42: 513–21. - PubMed
-
- Foster T, Gillespie K, McClelland R. Mental disorders and suicide in Northern Ireland. Br J Psychiatry 1997; 170: 447–52. - PubMed
-
- Zahl DL, Hawton K. Repetition of deliberate self-harm and subsequent suicide risk: long-term follow-up study of 11 583 patients. Br J Psychiatry 2004; 185: 70–5. - PubMed
-
- Hawton K, Bergen H, Cooper J, Turnbull P, Waters K, Ness J, et al. Suicide following self-harm: findings from the Multicentre Study of self-harm in England, 2000–2012. J Affect Disord 2015; 175: 147–51. - PubMed
Grants and funding
LinkOut - more resources
Full Text Sources