Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Observational Study
. 2019 Sep;28(3):e1785.
doi: 10.1002/mpr.1785. Epub 2019 Jun 17.

Testing for response shift in treatment evaluation of change in self-reported psychopathology amongst secondary psychiatric care outpatients

Ingrid V E Carlier  1 , Wessel A van Eeden  1 , Kim de Jong  2 , Erik J Giltay  1 , Martijn S van Noorden  1 , Christina van der Feltz-Cornelis  3 , Frans G Zitman  1 , Henk Kelderman  4 , Albert M van Hemert  1
Affiliations
Observational Study

Testing for response shift in treatment evaluation of change in self-reported psychopathology amongst secondary psychiatric care outpatients

Ingrid V E Carlier et al. Int J Methods Psychiatr Res. 2019 Sep.

Abstract

Objectives: If patients change their perspective due to treatment, this may alter the way they conceptualize, prioritize, or calibrate questionnaire items. These psychological changes, also called "response shifts," may pose a threat to the measurement of therapeutic change in patients. Therefore, it is important to test the occurrence of response shift in patients across their treatment.

Methods: This study focused on self-reported psychological distress/psychopathology in a naturalistic sample of 206 psychiatric outpatients. Longitudinal measurement invariance tests were computed across treatment in order to detect response shifts.

Results: Compared with before treatment, post-treatment psychopathology scores showed an increase in model fit and factor loading, suggesting that symptoms became more coherently interrelated within their psychopathology domains. Reconceptualization (depression/mood) and reprioritization (somatic and cognitive problems) response shift types were found in several items. We found no recalibration response shift.

Conclusion: This study provides further evidence that response shift can occur in adult psychiatric patients across their mental health treatment. Future research is needed to determine whether response shift implies an unwanted potential bias in treatment evaluation or a desired cognitive change intended by treatment.

Keywords: Symptom Questionnaire-48 (SQ-48); longitudinal measurement invariance; mental health treatment; psychopathology; response shift.

PubMed Disclaimer

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Ahmed, S. , Sawatzky, R. , Levesque, J.‐F. , Ehrmann‐Feldman, D. , & Schwartz, C. E. (2014). Minimal evidence of response shift in the absence of a catalyst. Quality of Life Research, 23(9), 2421–2430. 10.1007/s11136-014-0699-3 - DOI - PubMed
    1. Barbosa‐Leiker, C. , McPherson, S. , Mamey, M. R. , Burns, G. L. , & Roll, J. (2014). Psychometric Properties of the Adjective Rating Scale for withdrawal across treatment groups, gender, and over time. Journal of Substance Abuse Treatment, 46(2), 251–256. 10.1016/j.jsat.2013.08.020 - DOI - PMC - PubMed
    1. Barclay, R. , & Tate, R. B. (2014). Response shift recalibration and reprioritization in health‐related quality of life was identified prospectively in older men with and without stroke. Journal of Clinical Epidemiology, 67(5), 500–507. 10.1016/j.jclinepi.2013.12.003 - DOI - PubMed
    1. Barclay‐Goddard, R. , Epstein, J. D. , & Mayo, N. E. (2009). Response shift: a brief overview and proposed research priorities. Quality of Life Research, 18, 335–346. 10.1007/s11136-009-9450-x - DOI - PubMed
    1. Beauducel, A. , & Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling, 13(2), 186–203. 10.1207/s15328007sem1302_2 - DOI

Publication types