Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 May;12(3):435-446.
doi: 10.1177/21677026231172694. Epub 2023 Jun 1.

Machine-Learning-Based Prediction of Client Distress From Session Recordings

Patty B Kuo  1 , Michael J Tanana  1 , Simon B Goldberg  2 , Derek D Caperton  3   1 , Shrikanth Narayanan  4 , David C Atkins  5 , Zac E Imel  1
Affiliations

Machine-Learning-Based Prediction of Client Distress From Session Recordings

Patty B Kuo et al. Clin Psychol Sci. 2024 May.

Abstract

Natural language processing (NLP) is a subfield of machine learning that may facilitate the evaluation of therapist-client interactions and provide feedback to therapists on client outcomes on a large scale. However, there have been limited studies applying NLP models to client outcome prediction that have (a) used transcripts of therapist-client interactions as direct predictors of client symptom improvement, (b) accounted for contextual linguistic complexities, and (c) used best practices in classical training and test splits in model development. Using 2,630 session recordings from 795 clients and 56 therapists, we developed NLP models that directly predicted client symptoms of a given session based on session recordings of the previous session (Spearman's rho =0.32, p<.001). Our results highlight the potential for NLP models to be implemented in outcome monitoring systems to improve quality of care. We discuss implications for future research and applications.

Keywords: Machine learning; natural language processing; outcome prediction; psychotherapy.

PubMed Disclaimer

References

    1. Aguilera A, Bruehlman-Senecal E, Demasi O, & Avila P (2017). Automated Text Messaging as an Adjunct to Cognitive Behavioral Therapy for Depression: A Clinical Trial. Journal of Medical Internet Research, 19(5), e148. - PMC - PubMed
    1. Atkins DC, Steyvers M, Imel ZE, & Smyth P (2014). Scaling up the evaluation of psychotherapy: evaluating motivational interviewing fidelity via statistical text classification. Implementation Science: IS, 9, 49. - PMC - PubMed
    1. Barde, & Bainwad AM (2017). An overview of topic modeling methods and tools. 2017 International Conference on Intelligent Computing and Control Systems (ICICCS), 745–750. 10.1109/ICCONS.2017.8250563 - DOI
    1. Belinkov Y, Gehrmann S, & Pavlick E (2020, July). Interpretability and analysis in neural NLP. In Proceedings of the 58th annual meeting of the association for computational linguistics: tutorial abstracts (pp. 1–5).
    1. Boswell JF, Kraus DR, Miller SD, & Lambert MJ (2015). Implementing routine outcome monitoring in clinical practice: benefits, challenges, and solutions. Psychotherapy Research: Journal of the Society for Psychotherapy Research, 25(1), 6–19. - PubMed

LinkOut - more resources