Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2012 Jan-Feb;19(1):137-42.
doi: 10.1136/amiajnl-2011-000338. Epub 2011 Jul 4.

Commercial off-the-shelf consumer health informatics interventions: recommendations for their design, evaluation and redesign

Jenna L Marquard  1 , Teresa Zayas-Cabán
Affiliations

Commercial off-the-shelf consumer health informatics interventions: recommendations for their design, evaluation and redesign

Jenna L Marquard et al. J Am Med Inform Assoc. 2012 Jan-Feb.

Abstract

Objective: The goal of this paper is to describe the successful application of a use case-based evaluation approach to guide the effective design, evaluation and redesign of inexpensive, commercial, off-the-shelf consumer health informatics (CHI) interventions.

Design: Researchers developed four CHI intervention use cases representing two distinct patient populations (patients with diabetes with high blood pressure, post-bariatric surgery patients), two commercial off-the-shelf CHI applications (Microsoft HealthVault, Google Health), and related devices (blood pressure monitor, pedometer, weight scale). Three patient proxies tested each intervention for 10 days.

Measurements: The patient proxies recorded their challenges while completing use case tasks, rating the severity of each challenge based on how much it hindered their use of the intervention. Two independent evaluators categorized the challenges by human factors domain (physical, cognitive, macroergonomic).

Results: The use case-based approach resulted in the identification of 122 challenges, with 12% physical, 50% cognitive and 38% macroergonomic. Thirty-nine challenges (32%) were at least moderately severe. Nine of 22 use case tasks (41%) accounted for 72% of the challenges.

Limitations: The study used two patient proxies and addressed two specific patient populations and low-cost, off-the-shelf CHI interventions, which may not perfectly generalize to a larger number of proxies, actual patient populations, or other CHI interventions.

Conclusion: CHI designers can employ the use case-based evaluation approach to assess the fit of a CHI intervention with patients' health work, in the context of their daily activities and environment, which would be difficult or impossible to evaluate by laboratory-based studies.

PubMed Disclaimer

Conflict of interest statement

Competing interests: None.

Figures

Figure 1
Figure 1
Number of challenges identified by the patient proxies for each use case, by human factors domain.
See this image and copyright information in PMC

References

    1. Zayas-Cabán T, Marquard JL. A holistic human factors evaluation framework for the design of consumer health informatics interventions. Proceedings of the Human Factors and Ergonomics Society Annual Meeting; 2009 Oct 19–23. San Antonio, TX, Santa Monica, CA: Human Factors and Ergonomics Society, 2009:1003–7
    1. Zayas-Cabán T, Brennan PF. Human factors in home care. In: Carayon P, ed. Handbook of Human Factors and Ergonomics in Health Care and Patient Safety. Mahwah, NJ: Lawrence Erlbaum Associates, 2007:883–97
    1. Kaplan B, Brennan PF. Consumer informatics supporting patients as co-producers of quality. J Am Med Inform Assoc 2001;8:398–9 - PMC - PubMed
    1. Catwell L, Sheikh A. Evaluating eHealth interventions: the need for continuous systematic intervention. PLoS Med 2009;6:e1000126 http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.1000126 (accessed 10 Sep 2010). - DOI - PMC - PubMed
    1. Eysenbach G. Medicine 2.0: Social networking, collaboration, participation, apomediation, and openness. J Med Internet Res 2008;10:e22 http://www.jmir.org/2008/3/e22/ (accessed 10 Sep 2010). - PMC - PubMed

Publication types