A Clinician-Controlled Just-in-time Adaptive Intervention System (CBT+) Designed to Promote Acquisition and Utilization of Cognitive Behavioral Therapy Skills in Bulimia Nervosa: Development and Preliminary Evaluation Study

Abstract

Background: Cognitive behavioral therapy (CBT) for bulimia nervosa (BN) is most effective when patients demonstrate adequate skill utilization (ie, the frequency with which a patient practices or uses therapeutic skills) and skill acquisition (ie, the ability to successfully perform a skill learned in treatment). However, rates of utilization and acquisition of key treatment skills (eg, regular eating, urge management skills, and mood management skills) by the end of the treatment are frequently low; as a result, outcomes from CBT for BN are affected. Just-in-time adaptive interventions (JITAIs) may improve skill acquisition and utilization by delivering real-time interventions during algorithm-identified opportunities for skill practice.

Objective: In this manuscript, we describe a newly developed JITAI system called CBT+ that is designed to facilitate the acquisition and utilization of CBT for BN treatment skills when used as a treatment augmentation. We also present feasibility, acceptability, and preliminary outcomes data from a small proof-of-concept pilot trial (n=5 patients and n=3 clinicians) designed to identify opportunities for iterative development of CBT+ ahead of a larger ongoing randomized controlled trial.

Methods: A total of 5 individuals with BN received 16 sessions of outpatient CBT for BN while using the CBT+ app. Data were collected from patients and clinicians to evaluate the feasibility (eg, app use and user adherence), acceptability (eg, qualitative patient and clinician feedback, including usefulness ratings of CBT+ on a 6-point Likert scale ranging from 1=extremely useless to 6=extremely useful), and preliminary outcomes (eg, improvements in skill utilization and acquisition and BN symptoms) of the CBT+ system.

Results: Patients reported that CBT+ was a relatively low burden (eg, quick and easy-to-use self-monitoring interface), and adherence to in-app self-monitoring was high (mean entries per day 3.13, SD 1.03). JITAIs were perceived as useful by both patients (median rating 5/6) and clinicians (median rating 5/6) for encouraging the use of CBT skills. Large improvements in CBT skills and clinically significant reductions in BN symptoms were observed post treatment. Although preliminary findings indicated that the CBT+ system was acceptable to most patients and clinicians, the overall study dropout was relatively high (ie, 2/5, 40% patients), which could indicate some moderate concerns regarding feasibility.

Conclusions: CBT+, the first-ever JITAI system designed to facilitate the acquisition and utilization of CBT for BN treatment skills when used as a treatment augmentation, was shown to be feasible and acceptable. The results indicate that the CBT+ system should be subjected to more rigorous evaluations with larger samples and should be considered for wider implementation if found effective. Areas for iterative improvement of the CBT+ system ahead of a randomized controlled trial are also discussed.

Keywords: cognitive behavioral therapy; eating disorders; mobile phone; smartphone; technology; telemedicine.

Figure 1

Screenshots of the home screen showing all the tabs CBT+ users can access.

Figure 2

Screenshots of the electronic self-monitoring form of the CBT+ smartphone app.

Figure 3

Screenshots of the delivered just-in-time adaptive interventions and follow-up questions.

Figure 4

Patient dashboard of the CBT+ clinicians’ portal.

Figure 5

Calendar feature of the CBT+ clinicians’ portal.

Figure 6

Change in frequency with which patients endorsed eating enough at regular eating episodes throughout treatment.

Figure 7

Change in frequency of reported urge management skill use throughout treatment.

Figure 8

Change in weekly Eating Disorder Examination Questionnaire restraint subscale score throughout treatment.

Figure 9

Change in score on the Difficulties in Emotion Regulation Scale item, “When I was upset, I had difficulty controlling my behaviors,” throughout treatment.