Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2014 Mar 17:8:311-22.
doi: 10.2147/PPA.S57961. eCollection 2014.

Usability testing of a monitoring and feedback tool to stimulate physical activity

Sanne van der Weegen  1 , Renée Verwey  2 , Huibert J Tange  3 , Marieke D Spreeuwenberg  1 , Luc P de Witte  2
Affiliations

Usability testing of a monitoring and feedback tool to stimulate physical activity

Sanne van der Weegen et al. Patient Prefer Adherence. .

Abstract

Introduction: A MONITORING AND FEEDBACK TOOL TO STIMULATE PHYSICAL ACTIVITY, CONSISTING OF AN ACTIVITY SENSOR, SMARTPHONE APPLICATION (APP), AND WEBSITE FOR PATIENTS AND THEIR PRACTICE NURSES, HAS BEEN DEVELOPED: the 'It's LiFe!' tool. In this study the usability of the tool was evaluated by technology experts and end users (people with chronic obstructive pulmonary disease or type 2 diabetes, with ages from 40-70 years), to improve the user interfaces and content of the tool.

Patients and methods: THE STUDY HAD FOUR PHASES: 1) a heuristic evaluation with six technology experts; 2) a usability test in a laboratory by five patients; 3) a pilot in real life wherein 20 patients used the tool for 3 months; and 4) a final lab test by five patients. In both lab tests (phases 2 and 4) qualitative data were collected through a thinking-aloud procedure and video recordings, and quantitative data through questions about task complexity, text comprehensiveness, and readability. In addition, the post-study system usability questionnaire (PSSUQ) was completed for the app and the website. In the pilot test (phase 3), all patients were interviewed three times and the Software Usability Measurement Inventory (SUMI) was completed.

Results: After each phase, improvements were made, mainly to the layout and text. The main improvement was a refresh button for active data synchronization between activity sensor, app, and server, implemented after connectivity problems in the pilot test. The mean score on the PSSUQ for the website improved from 5.6 (standard deviation [SD] 1.3) to 6.5 (SD 0.5), and for the app from 5.4 (SD 1.5) to 6.2 (SD 1.1). Satisfaction in the pilot was not very high according to the SUMI.

Discussion: The use of laboratory versus real-life tests and expert-based versus user-based tests revealed a wide range of usability issues. The usability of the It's LiFe! tool improved considerably during the study.

Keywords: accelerometry; chronic obstructive pulmonary disease; diabetes mellitus type 2; heuristic evaluation; telemonitoring; thinking aloud.

PubMed Disclaimer

Figures

Figure 1
Figure 1
The It’s LiFe! tool. Abbreviation: app, application.
Figure 2
Figure 2
Timeline of the behavioral change consultations with practice nurse and dialogue sessions during the pilot. Abbreviation: app, application.
Figure 3
Figure 3
Post-study system usability questionnaire (PSSUQ) subscores for the smartphone app after phases 2 and 4. Note: Higher scores indicate better usability. Abbreviation: PSSUQ, post-study system usability questionnaire; app, application.
Figure 4
Figure 4
Post-study system usability questionnaire (PSSUQ) subscores for the website after phases 2 and 4. Note: Higher scores indicate better usability. Abbreviation: PSSUQ, post-study system usability questionnaire.
Figure 5
Figure 5
Results of the SUMI questionnaire, completed by 14 participants after the pilot in real life. Note: Usability is considered reasonable at 50. Abbreviation: SUMI, Software Usability Measurement Inventory.
Figure 6
Figure 6
Screenshots of the final prototype of the smartphone app. Notes: (A) Day view per hour from 6 am to 12 pm – “N” indicates summed activity between midnight and 6 am. (B) Day view – The yellow parts indicate high intense activities, blue indicates moderate intense activities, the red line “doel” is “goal”, and “minuten” is “minutes”. (C) Week view. (D) Month view. Abbreviation: app, application.
See this image and copyright information in PMC

References

    1. Haapanen N, Miilunpalo S, Vuori I, Oja P, Pasanen M. Association of leisure time physical activity with the risk of coronary heart disease, hypertension and diabetes in middle-aged men and women. Int J Epidemiol. 1997;26(4):739–747. - PubMed
    1. Fentem PH. ABC of sports medicine. Benefits of exercise in health and disease. BMJ. 1994;308(6939):1291–1295. - PMC - PubMed
    1. World Health Organisation . In: Global recommendations on physical activity for health. World Health Organisation, editor. WHO Press Switzerland; Geneva: 2010.
    1. Haskell WL, Lee IM, Pate RR, et al. Physical activity and public health: updated recommendation for adults from the American College of Sports Medicine and the American Heart Association. Circulation. 2007;116(9):1081–1093. - PubMed
    1. Schiller JS, Lucas JW, Ward BW, Peregoy JA. Summary health statistics for US adults: National Health Interview Survey, 2010. Vital Health Stat 10. 2012;(252):1–207. - PubMed