Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017 Aug 6;2(3):e000299.
doi: 10.1136/bmjgh-2017-000299. eCollection 2017.

Assessing the global reach and value of a provider-facing healthcare app using large-scale analytics

Vikas O'Reilly-Shah  1   2 , George Easton  3 , Scott Gillespie  4
Affiliations

Assessing the global reach and value of a provider-facing healthcare app using large-scale analytics

Vikas O'Reilly-Shah et al. BMJ Glob Health. .

Erratum in

Abstract

Background: The rapid global adoption of mobile health (mHealth) smartphone apps by healthcare providers presents challenges and opportunities in medicine. Challenges include ensuring the delivery of high-quality, up-to-date and optimised information. Opportunities include the ability to study global practice patterns, access to medical and surgical care and continuing medical education needs.

Methods: We studied users of a free anaesthesia calculator app used worldwide. We combined traditional app analytics with in-app surveys to collect user demographics and feedback.

Results: 31 173 subjects participated. Users were from 206 countries and represented a spectrum of healthcare provider roles. Low-income country users had greater rates of app use (p<0.001) and ascribed greater importance of the app to their practice (p<0.001). Physicians from low-income countries were more likely to adopt the app (p<0.001). The app was used primarily for paediatric patients. The app was used around the clock, peaking during times typical for first start cases.

Conclusions: This mHealth app is a valuable decision support tool for global healthcare providers, particularly those in more resource-limited settings and with less training. App adoption and use may provide a mechanism for measuring longitudinal changes in access to surgical care and engaging providers in resource-limited settings. In-app surveys and app analytics provide a window into healthcare provider behaviour at a breadth and level of detail previously impossible to achieve. Given the potentially immense value of crowdsourced information, healthcare providers should be encouraged to participate in these types of studies.

Keywords: analytics; anesthesiology; global health; mHealth; practice patterns.

PubMed Disclaimer

Conflict of interest statement

Competing interests: All authors declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous 3 years; no other relationships or activities that could appear to have influenced the submitted work. The app was initially released in 2011 by VO-S with advertising in the free version and a paid companion app to remove the ads. The app intellectual property was transferred to Emory University in 2015, and advertisements were subsequently removed, and the companion app to remove ads made freely available for legacy users not updating to the ad-free version. Following review by the Emory University Research Conflict of Interest Committee, VO-S has been released from any conflict of interest management plan or oversight.

Figures

Figure 1
Figure 1
Overall roadmap of the approach to analysis of the data. This indicates the dependent and independent variables that were examined (see Methods) and the number of study participants in each of these subsets. Subsets were combined to create various tables and figures, and the number of study participants with data in the combined subsets are shown.
Figure 2
Figure 2
Standard boxplots demonstrating frequency of app use as a function of key user characteristics (dots are outliers). N per category is shown. Negative binomial regression was used to assess the significance of the association between these factors. (A) User primary country World Bank income level and (B) provider role/provider type. NS, not significant.
Figure 3
Figure 3
Penetration of app into the physician workforce by country. The app adoption penetration index was calculated as the estimated number of physician app users per 1000 physicians in the country. WHO Global Health Observatory data were used to obtain the estimated total number of physicians in the country. (A) Choropleth map; no data for countries in white. (B) Standard boxplot showing the app adoption penetration index grouped by World Bank country income level. Number of countries in each category is shown. Negative binomial regression was used to test the significance of the association between country income level and the app adoption penetration index (see online supplementary appendix).
See this image and copyright information in PMC

References

    1. Rivera J, van der Meulen R. Gartner says annual smartphone sales surpassed sales of feature phones for the first time in 2013 (feb. 2014). 2015. http://www.webcitation.org/6dPWAR51k (accessed 29 Nov 2015).
    1. Number of apps available in leading app stores 2015 | Statistic. Statista 2015. http://www.webcitation.org/6dPd06FCB (accessed 19 Aug2015).
    1. Liu C, Zhu Q, Holroyd KA, et al. Status and trends of mobile-health applications for iOS devices: A developer's perspective. J Syst Softw 2011;84:2022–33. 10.1016/j.jss.2011.06.049 - DOI
    1. Introducing Amazon Mobile Analytics. 2016. http://www.webcitation.org/6im0lxPCw (accessed 5 Jul 2016).
    1. Google Analytics. 2016. http://www.webcitation.org/6im0miwiZ (accessed 5 Jul 2016).

LinkOut - more resources