A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: project FACTS study protocol

Rinad S Beidas¹, Johanna Catherine Maclean^{2

3

4}, Jessica Fishman^{5

6}, Shannon Dorsey⁷, Sonja K Schoenwald⁸, David S Mandell⁵, Judy A Shea⁹, Bryce D McLeod¹⁰, Michael T French¹¹, Aaron Hogue¹², Danielle R Adams⁵, Adina Lieberman⁵, Emily M Becker-Haimes⁵, Steven C Marcus¹³

Affiliations

¹ Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA. rbeidas@upenn.edu.
² Department of Economics, Temple University, Philadelphia, PA, USA.
³ National Bureau of Economic Research, Cambridge, MA, USA.
⁴ Institute for the Study of Labor (IZA), Bonn, Germany.
⁵ Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA.
⁶ Annenberg School for Communication, University of Pennsylvania, Philadelphia, PA, USA.
⁷ Department of Psychology, University of Washington, Seattle, WA, USA.
⁸ Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA.
⁹ Department of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
¹⁰ Department of Psychology, Virginia Commonwealth University, Richmond, VA, USA.
¹¹ Department of Health Sector Management and Policy and Department of Sociology, University of Miami, Coral Gables, FL, USA.
¹² The National Center on Addiction and Substance Abuse, New York, NY, USA.
¹³ School of Social Policy and Practice, University of Pennsylvania, Philadelphia, PA, USA.

PMID: 27633780
PMCID: PMC5025620
DOI: 10.1186/s12888-016-1034-z

Randomized Controlled Trial

A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: project FACTS study protocol

Rinad S Beidas et al. BMC Psychiatry. 2016.

. 2016 Sep 15;16(1):323.

doi: 10.1186/s12888-016-1034-z.

Authors

Affiliations

¹ Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA. rbeidas@upenn.edu.
² Department of Economics, Temple University, Philadelphia, PA, USA.
³ National Bureau of Economic Research, Cambridge, MA, USA.
⁴ Institute for the Study of Labor (IZA), Bonn, Germany.
⁵ Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA.
⁶ Annenberg School for Communication, University of Pennsylvania, Philadelphia, PA, USA.
⁷ Department of Psychology, University of Washington, Seattle, WA, USA.
⁸ Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA.
⁹ Department of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
¹⁰ Department of Psychology, Virginia Commonwealth University, Richmond, VA, USA.
¹¹ Department of Health Sector Management and Policy and Department of Sociology, University of Miami, Coral Gables, FL, USA.
¹² The National Center on Addiction and Substance Abuse, New York, NY, USA.
¹³ School of Social Policy and Practice, University of Pennsylvania, Philadelphia, PA, USA.

PMID: 27633780
PMCID: PMC5025620
DOI: 10.1186/s12888-016-1034-z

Abstract

Background: This randomized trial will compare three methods of assessing fidelity to cognitive-behavioral therapy (CBT) for youth to identify the most accurate and cost-effective method. The three methods include self-report (i.e., therapist completes a self-report measure on the CBT interventions used in session while circumventing some of the typical barriers to self-report), chart-stimulated recall (i.e., therapist reports on the CBT interventions used in session via an interview with a trained rater, and with the chart to assist him/her) and behavioral rehearsal (i.e., therapist demonstrates the CBT interventions used in session via a role-play with a trained rater). Direct observation will be used as the gold-standard comparison for each of the three methods.

Methods/design: This trial will recruit 135 therapists in approximately 12 community agencies in the City of Philadelphia. Therapists will be randomized to one of the three conditions. Each therapist will provide data from three unique sessions, for a total of 405 sessions. All sessions will be audio-recorded and coded using the Therapy Process Observational Coding System for Child Psychotherapy-Revised Strategies scale. This will enable comparison of each measurement approach to direct observation of therapist session behavior to determine which most accurately assesses fidelity. Cost data associated with each method will be gathered. To gather stakeholder perspectives of each measurement method, we will use purposive sampling to recruit 12 therapists from each condition (total of 36 therapists) and 12 supervisors to participate in semi-structured qualitative interviews.

Discussion: Results will provide needed information on how to accurately and cost-effectively measure therapist fidelity to CBT for youth, as well as important information about stakeholder perspectives with regard to each measurement method. Findings will inform fidelity measurement practices in future implementation studies as well as in clinical practice.

Trial registration: NCT02820623 , June 3rd, 2016.

Keywords: Cost-effectiveness; Evidence-based practice; Implementation; Treatment fidelity.

PubMed Disclaimer

Figures

See this image and copyright information in PMC

References

1. IOM (Institute of Medicine). Psychosocial interventions for mental and substance use disorders: A framework for establishing evidence-based standards. Washington: The National Academies Press; 2015. - PubMed
1. Perepletchikova F, Treat TA, Kazdin AE. Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. J Consult Clin Psych. 2007;75:829–841. doi: 10.1037/0022-006X.75.6.829. - DOI - PubMed
1. McLeod BD, Southam-Gerow MA, Tully CB, Rodriguez A, Smith MM. Making a case for treatment integrity as a psychosocial treatment quality indicator for youth mental health care. Clin Psychol-Sci Pr. 2013;20:14–32. doi: 10.1111/cpsp.12020. - DOI - PMC - PubMed
1. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38:4–23. doi: 10.1007/s10488-010-0327-7. - DOI - PMC - PubMed
1. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38:65–76. doi: 10.1007/s10488-010-0319-7. - DOI - PMC - PubMed

Publication types

Actions

MeSH terms

Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: project FACTS study protocol

Affiliations

A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: project FACTS study protocol

Authors

Affiliations

Abstract

Figures

References

Publication types

MeSH terms

Associated data

Grants and funding

LinkOut - more resources

Full Text Sources

Other Literature Sources

Medical