Examining concurrent validity and item selection of the Session Wants and Needs Outcome Measure (SWAN-OM) in a children and young people web-based therapy service
- PMID: 36846241
- PMCID: PMC9947788
- DOI: 10.3389/fpsyt.2023.1067378
Examining concurrent validity and item selection of the Session Wants and Needs Outcome Measure (SWAN-OM) in a children and young people web-based therapy service
Abstract
Background: Single-session mental health interventions are frequently attended by children and young people (CYP) in both web-based and face-to-face therapy settings. The Session "Wants" and "Needs" Outcome Measure (SWAN-OM) is an instrument developed in a web-based therapy service to overcome the challenges of collecting outcomes and experiences of single-session therapies (SSTs). It provides pre-defined goals for the session, selected by the young person prior to the intervention, on which progress toward achievement is scored at the end of the session.
Objective: The objective of this study was to evaluate the instrument's psychometric properties, including concurrent validity against three other frequently used outcome and experience measures, at a web-based and text-based mental health service.
Methods: The SWAN-OM was administered for a period of 6 months to 1,401 CYP (aged 10-32 years; 79.3% white; 77.59% female) accessing SST on a web-based service. Item correlations with comparator measures and hierarchical logistic regressions to predict item selection were calculated for concurrent validity and psychometric exploration.
Results: The most frequently selected items were "Feel better" (N = 431; 11.61%) and "Find ways I can help myself" (N = 411; 11.07%); unpopular items were "Feel safe in my relationships" (N = 53; 1.43%) and "Learn the steps to achieve something I want" (N = 58; 1.56%). The SWAN-OM was significantly correlated with the Experience of Service Questionnaire, particularly the item "Feel better" [rs(109) = 0.48, p < 0.001], the Youth Counseling Impact Scale, particularly the item "Learn the steps to achieve something I want" [rs(22) = 0.76, p < 0.001], and the Positive and Negative Affect Schedule, particularly the items "Learn how to feel better" [rs(22) = 0.72, p < 0.001] and "Explore how I feel" [rs(70) = -0.44, p < 0.001].
Conclusion: The SWAN-OM demonstrates good concurrent validity with common measures of outcome and experience. Analysis suggests that lesser-endorsed items may be removed in future iterations of the measure to improve functionality. Future research is required to explore SWAN-OM's potential to measure meaningful change in a range of therapeutic settings.
Keywords: SWAN-OM; concurrent validity; digital mental health; instrument evaluation; internet delivered psychological treatments; patient reported outcome measures (PROM); single session therapy (SST); web-based therapy.
Copyright © 2023 De Ossorno Garcia, Edbrooke-Childs, Salhi, Ruby, Sefi and Jacob.
Conflict of interest statement
SDOG, LS, and AS are researchers employed and receive honorarium by Kooth plc. JE-C, JJ, and FR work (or worked) on the CORC project, which encourages the use of idiographic and nomothetic outcomes, and experience measures. JE-C reports funding from NHS England and NHS Improvement outside of the submitted work. JE-C and JJ report funding from the Wellcome Trust outside of the submitted work. All procedures followed were in accordance with the ethical standards of the responsible professional body. Informed consent for research was obtained from all participants for being included in the audit when registered at Kooth.com.
Figures
Similar articles
-
The Session Wants and Need Outcome Measure: The Development of a Brief Outcome Measure for Single-Sessions of Web-Based Support.Front Psychol. 2021 Oct 29;12:748145. doi: 10.3389/fpsyg.2021.748145. eCollection 2021. Front Psychol. 2021. PMID: 34777142 Free PMC article.
-
One-session treatment compared with multisession CBT in children aged 7-16 years with specific phobias: the ASPECT non-inferiority RCT.Health Technol Assess. 2022 Oct;26(42):1-174. doi: 10.3310/IBCT0609. Health Technol Assess. 2022. PMID: 36318050 Free PMC article. Clinical Trial.
-
A Novel Multimodal Digital Service (Moderated Online Social Therapy+) for Help-Seeking Young People Experiencing Mental Ill-Health: Pilot Evaluation Within a National Youth E-Mental Health Service.J Med Internet Res. 2020 Aug 13;22(8):e17155. doi: 10.2196/17155. J Med Internet Res. 2020. PMID: 32788151 Free PMC article.
-
Development of the functional vision questionnaire for children and young people with visual impairment: the FVQ_CYP.Ophthalmology. 2013 Dec;120(12):2725-2732. doi: 10.1016/j.ophtha.2013.07.055. Epub 2013 Oct 10. Ophthalmology. 2013. PMID: 24120327
-
Improving the evaluation of therapeutic interventions in multiple sclerosis: development of a patient-based measure of outcome.Health Technol Assess. 2004 Mar;8(9):iii, 1-48. doi: 10.3310/hta8090. Health Technol Assess. 2004. PMID: 14982653 Review.
References
-
- Talmon M. Single-session therapy : maximizing the effect of the first (and often only) therapeutic encounter. Jossey-Bass; (1990). 176 p. Available online at: https://www.wiley.com/en-gb/Single$+$Session$+$Therapy%3A$+$Maximizing$+... (accessed September 10, 2020).
LinkOut - more resources
Full Text Sources