Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2018 Jun 6;20(6):e199.
doi: 10.2196/jmir.9275.

Beyond the Trial: Systematic Review of Real-World Uptake and Engagement With Digital Self-Help Interventions for Depression, Low Mood, or Anxiety

Theresa Fleming  1   2 , Lynda Bavin  2 , Mathijs Lucassen  3 , Karolina Stasiak  2 , Sarah Hopkins  2 , Sally Merry  2
Affiliations

Beyond the Trial: Systematic Review of Real-World Uptake and Engagement With Digital Self-Help Interventions for Depression, Low Mood, or Anxiety

Theresa Fleming et al. J Med Internet Res. .

Abstract

Background: Digital self-help interventions (including online or computerized programs and apps) for common mental health issues have been shown to be appealing, engaging, and efficacious in randomized controlled trials. They show potential for improving access to therapy and improving population mental health. However, their use in the real world, ie, as implemented (disseminated) outside of research settings, may differ from that reported in trials, and implementation data are seldom reported.

Objective: This study aimed to review peer-reviewed articles reporting user uptake and/or ongoing use, retention, or completion data (hereafter usage data or, for brevity, engagement) from implemented pure self-help (unguided) digital interventions for depression, anxiety, or the enhancement of mood.

Methods: We conducted a systematic search of the Scopus, Embase, MEDLINE, and PsychINFO databases for studies reporting user uptake and/or usage data from implemented digital self-help interventions for the treatment or prevention of depression or anxiety, or the enhancement of mood, from 2002 to 2017. Additionally, we screened the reference lists of included articles, citations of these articles, and the titles of articles published in Internet Interventions, Journal of Medical Internet Research (JMIR), and JMIR Mental Health since their inception. We extracted data indicating the number of registrations or downloads and usage of interventions.

Results: After the removal of duplicates, 970 papers were identified, of which 10 met the inclusion criteria. Hand searching identified 1 additional article. The included articles reported on 7 publicly available interventions. There was little consistency in the measures reported. The number of registrants or downloads ranged widely, from 8 to over 40,000 per month. From 21% to 88% of users engaged in at least minimal use (eg, used the intervention at least once or completed one module or assessment), whereas 7-42% engaged in moderate use (completing between 40% and 60% of modular fixed-length programs or continuing to use apps after 4 weeks). Indications of completion or sustained use (completion of all modules or the last assessment or continuing to use apps after six weeks or more) varied from 0.5% to 28.6%.

Conclusions: Available data suggest that uptake and engagement vary widely among the handful of implemented digital self-help apps and programs that have reported this, and that usage may vary from that reported in trials. Implementation data should be routinely gathered and reported to facilitate improved uptake and engagement, arguably among the major challenges in digital health.

Keywords: anxiety; depression; e-therapy; eHealth; mobile applications.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: TF, KS, ML, and SM are codevelopers of SPARX (a form of computerized therapy for depression cited in this paper). The intellectual property for SPARX is owned by Uniservices at the University of Auckland. The codevelopers can benefit financially from its commercialization outside New Zealand. The remaining authors have no conflicts of interest to declare.

Figures

Figure 1
Figure 1
Flow diagram of article selection.
See this image and copyright information in PMC

References

    1. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5(10):e13196. doi: 10.1371/journal.pone.0013196. http://dx.plos.org/10.1371/journal.pone.0013196 - DOI - DOI - PMC - PubMed
    1. Ebert DD, Zarski A, Christensen H, Stikkelbroek Y, Cuijpers P, Berking M, Riper H. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials. PLoS One. 2015;10(3):e0119895. doi: 10.1371/journal.pone.0119895. http://dx.plos.org/10.1371/journal.pone.0119895 - DOI - DOI - PMC - PubMed
    1. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012 Jun;32(4):329–42. doi: 10.1016/j.cpr.2012.02.004. - DOI - PubMed
    1. Rogers MA, Lemmen K, Kramer R, Mann J, Chopra V. Internet-delivered health interventions that work: systematic review of meta-analyses and evaluation of website availability. J Med Internet Res. 2017 Mar 24;19(3):e90. doi: 10.2196/jmir.7111. http://www.jmir.org/2017/3/e90/ - DOI - PMC - PubMed
    1. Fleming TM, de Beurs D, Khazaal Y, Gaggioli A, Riva G, Botella C, Baños RM, Aschieri F, Bavin LM, Kleiboer A, Merry S, Lau HM, Riper H. Maximizing the impact of e-therapy and serious gaming: time for a paradigm shift. Front Psychiatry. 2016;7:65. http://europepmc.org/abstract/MED/27148094 - PMC - PubMed

Publication types