Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Meta-Analysis
. 2019 Apr;114(4):609-619.
doi: 10.1111/add.14503. Epub 2018 Dec 21.

Compliance with ecological momentary assessment protocols in substance users: a meta-analysis

Andrew Jones  1   2 , Danielle Remmerswaal  3 , Ilse Verveer  3 , Eric Robinson  1   2 , Ingmar H A Franken  3 , Cheng K Fred Wen  4 , Matt Field  1   2
Affiliations
Meta-Analysis

Compliance with ecological momentary assessment protocols in substance users: a meta-analysis

Andrew Jones et al. Addiction. 2019 Apr.

Abstract

Background and aims: While there are considerable benefits to Ecological Momentary Assessment (EMA), poor compliance with assessment protocols has been identified as a limitation, particularly in substance users. Our aim was to identify the pooled compliance rate of EMA studies in substance users and examine variables that may influence compliance with EMA protocols, such as the length and frequency of assessments.

Design: A meta-analysis and meta-regression of all possible studies (randomized controlled trials and longitudinal) which incorporated EMA protocols, examining substance use.

Setting: Studies took place from 1998 to 2017, in numerous countries world-wide.

Participants: One hundred and twenty-six studies were identified, contributing a total of 19 431 participants (52.32% male, mean age = 28.86).

Measurements: Compliance data, the proportion of responses to the study protocol, were extracted from each study alongside prompt frequency, total length of assessment period, substance use population and device used to administer EMA prompts.

Findings: The pooled compliance rate across all studies was 75.06% [95% confidence interval (CI) = 72.37%, 77.65%]. There was no evidence that compliance rates were significantly associated with prompt frequency [Q(3) = 7.35, P = 0.061], length of assessment period [Q(2) = 2.40, P = 0.301], substance type [Q(3) = 6.30, P = 0.098] or device administration [Q(4) = 4.28, P = 0.369]. However, dependent samples (69.80%) had lower compliance rates than non-dependent samples [76.02%; Q(1) = 4.13, P = 0.042].

Conclusions: The pooled compliance rate for Ecological Momentary Assessment studies in substance-using populations from 1998 to 2017 was lower than the recommended rate of 80%, and was not associated with frequency or duration of assessments.

Keywords: Addiction; compliance; dependence; ecological momentary assessment; meta-analysis; substance use.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Flow‐chart of the search procedure and studies included in the analyses. *One article 70 contained two ecological momentary assessment (EMA) studies
Figure 2
Figure 2
Distribution of compliance rates across studies in meta‐analyses/regression (solid black vertical line represents pooled compliance rate of 75.06%)
See this image and copyright information in PMC

References

    1. Shiffman S., Stone A. A., Hufford M. R. Ecological momentary assessment. Annu Rev Psychol 2008; 4: 1–32. - PubMed
    1. Ellen L. H., Marieke W. No time like the present: discovering the hidden dynamics in intensive longitudinal data. Curr Dir Psychol Sci 2017; 26: 10–15.
    1. Burke L. E., Shiffman S., Music E., Styn M. A., Kriska A., Smailagic A. et al Ecological momentary assessment in behavioral research: addressing technological and human participant challenges. J Med Internet Res 2017; 19: e77. - PMC - PubMed
    1. Ginexi E. M., Riley W., Atienza A. A., Mabry P. L. The promise of intensive longitudinal data capture for behavioral health research. Nicotine Tob Res 2014; 16: S73–S75. - PMC - PubMed
    1. Jones A., Robinson E. The longitudinal associations between perceived descriptive peer norms and eating and drinking behavior: an initial examination in young adults. Front Psychol 2017; 8: 2. - PMC - PubMed

Publication types