Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2013 Oct 4;15(10):e224.
doi: 10.2196/jmir.2745.

Assessing the internal and external validity of mobile health physical activity promotion interventions: a systematic literature review using the RE-AIM framework

Kacie Ca Blackman  1 , Jamie Zoellner, Leanna M Berrey, Ramine Alexander, Jason Fanning, Jennie L Hill, Paul A Estabrooks
Affiliations

Assessing the internal and external validity of mobile health physical activity promotion interventions: a systematic literature review using the RE-AIM framework

Kacie Ca Blackman et al. J Med Internet Res. .

Abstract

Background: Mobile health (mHealth) interventions are effective in promoting physical activity (PA); however, the degree to which external validity indicators are reported is unclear.

Objective: The purpose of this systematic review was to use the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework to determine the extent to which mHealth intervention research for promoting PA reports on factors that inform generalizability across settings and populations and to provide recommendations for investigators planning to conduct this type of research.

Methods: Twenty articles reflecting 15 trials published between 2000 and 2012 were identified through a systematic review process (ie, queries of three online databases and reference lists of eligible articles) and met inclusion criteria (ie, implementation of mobile technologies, target physical activity, and provide original data). Two researchers coded each article using a validated RE-AIM data extraction tool (reach, efficacy/effectiveness, adoption, implementation, maintenance). Two members of the study team independently abstracted information from each article (inter-rater reliability >90%) and group meetings were used to gain consensus on discrepancies.

Results: The majority of studies were randomized controlled trials (n=14). The average reporting across RE-AIM indicators varied by dimension (reach=53.3%, 2.67/5; effectiveness/efficacy=60.0%, 2.4/4; adoption=11.1%, 0.7/6; implementation=24.4%, 0.7/3; maintenance=0%, 0/3). While most studies described changes in the primary outcome (effectiveness), few addressed the representativeness of participants (reach) or settings (adoption) and few reported on issues related to maintenance and degree of implementation fidelity.

Conclusions: This review suggests that more focus is needed on research designs that highlight and report on both internal and external validity indicators. Specific recommendations are provided to encourage future mHealth interventionists and investigators to report on representativeness, settings, delivery agents for planned interventions, the extent to which protocol is delivered as intended, and maintenance of effects at the individual or organizational level.

Keywords: generalizability; mobile technology; physical activity; review.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: None declared.

Figures

Figure 1
Figure 1
Flow diagram of study selection.
See this image and copyright information in PMC

References

    1. World Health Organization. 2008. Physical inactivity - a global public health problem http://www.who.int/dietphysicalactivity/factsheet_inactivity/en.
    1. Trojano RP, Berrigan D, Dodd KW, Mâsse LC, Tilert T, McDowell M. Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc. 2008 Jan;40(1):181–8. doi: 10.1249/mss.0b013e31815a51b3. - DOI - PubMed
    1. Tucker JM, Welk GJ, Beyler NK. Physical activity in U.S.: adults compliance with the Physical Activity Guidelines for Americans. Am J Prev Med. 2011 Apr;40(4):454–61. doi: 10.1016/j.amepre.2010.12.016. - DOI - PubMed
    1. Davies CA, Spence JC, Vandelanotte C, Caperchione CM, Mummery WK. Meta-analysis of internet-delivered interventions to increase physical activity levels. Int J Behav Nutr Phys Act. 2012;9:52. doi: 10.1186/1479-5868-9-52. http://www.ijbnpa.org/content/9//52 - DOI - PMC - PubMed
    1. Smith A. Pew Internet & American Life Project. 2010. Jul 07, Mobile Access 2010 http://pewinternet.org/Reports/2010/Mobile-Access-2010.aspx.