Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Dec 18;3(4):e15013.
doi: 10.2196/15013.

Web-Based Module for the Collection of Electronic Patient-Reported Outcomes in People Living With HIV in Nouvelle Aquitaine, France: Usability Evaluation

Diana Barger  1 , Olivier Leleux  1 , Valérie Conte  2 , Vincent Sapparrart  2 , Marie Gapillout  2 , Isabelle Crespel  3 , Marie Erramouspe  4 , Sandrine Delveaux  3 , Linda Wittkop  1   5 , François Dabis  1   3 , Fabrice Bonnet  1   3   6
Affiliations

Web-Based Module for the Collection of Electronic Patient-Reported Outcomes in People Living With HIV in Nouvelle Aquitaine, France: Usability Evaluation

Diana Barger et al. JMIR Form Res. .

Abstract

Background: Patient-reported outcomes (PROs) can be of great value for both research and chronic disease management. We developed a new module of the ANRS CO3 Aquitaine cohort study's Web-based data capture and visualization solution (APPEGE 2.0) for the collection of electronic PROs among people living with HIV cared for in Nouvelle Aquitaine, France.

Objective: This study aimed to evaluate the usability of 2 successively developed prototypes of ARPEGE 2.0's electronic PROs module before launching a pilot study, owing to the novelty of the proposed data collection method for our setting and specific characteristics of the target population.

Methods: A total of 2 sequential rounds of empirical, task-based usability evaluations were conducted, involving 8 research staff and then 7 people living with HIV. Evaluators provided written feedback during round 1 and oral feedback during round 2. Evaluators who completed the full set of tasks responded to the System Usability Scale (SUS). We assessed changes in SUS scores between rounds and concluded usability testing when SUS scores reached a ceiling effect, defining good usability a priori as a usability score of 70.

Results: Insights were generated regarding the visibility of system status and the match between the system and the real world that improved the module's usability. Research staff evaluators reported mean SUS scores of 65 (SD 18.87) and patient evaluators reported mean SUS scores of 85 (SD 5.4; P=.032).

Conclusions: Software modifications, informed by successive rounds of usability testing, resulted in sufficient gains in usability to undertake piloting. Insights generated during evaluations prompted us to find the appropriate balance between optimal security and ease of use.

Trial registration: ClinicalTrials.gov NCT03296202; https://clinicaltrials.gov/ct2/show/NCT03296202.

International registered report identifier (irrid): RR2-10.2196/10.2196/resprot.9439.

Keywords: patient generated health data; patient reported outcome measures; quality of life.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: DB has received a speaking fee from Gilead. FB declares to have received reimbursement for attending a symposium from ViiV Healthcare, Gilead, Bristol-Myers Squib, Merck and Janssen, speaking fee and consultancy fee from ViiV Healthcare, Gilead, Bristol-Myers Squib, Merck and Janssen, and funds for research from Gilead and ViiV Healthcare. The other authors do not have any conflict of interest to declare.

Figures

Figure 1
Figure 1
Initial log-in page (round 1).
Figure 2
Figure 2
Revised log-in page (round 2).
See this image and copyright information in PMC

References

    1. Deeks SG, Lewin SR, Havlir DV. The end of AIDS: HIV infection as a chronic disease. Lancet. 2013 Nov 2;382(9903):1525–33. doi: 10.1016/S0140-6736(13)61809-7. http://europepmc.org/abstract/MED/24152939 S0140-6736(13)61809-7 - DOI - PMC - PubMed
    1. INSIGHT START Study Group. Lundgren JD, Babiker AG, Gordin F, Emery S, Grund B, Sharma S, Avihingsanon A, Cooper DA, Fätkenheuer G, Llibre JM, Molina JM, Munderi P, Schechter M, Wood R, Klingman KL, Collins S, Lane HC, Phillips AN, Neaton JD. Initiation of antiretroviral therapy in early asymptomatic HIV infection. N Engl J Med. 2015 Aug 27;373(9):795–807. doi: 10.1056/NEJMoa1506816. http://europepmc.org/abstract/MED/26192873 - DOI - PMC - PubMed
    1. Rasmussen LD, Obel N. How do we preserve health among adults living with HIV? Lancet HIV. 2019 Feb;6(2):e69–70. doi: 10.1016/S2352-3018(18)30336-9.S2352-3018(18)30336-9 - DOI - PubMed
    1. Antiretroviral Therapy Cohort Collaboration Survival of HIV-positive patients starting antiretroviral therapy between 1996 and 2013: a collaborative analysis of cohort studies. Lancet HIV. 2017 Aug;4(8):e349–56. doi: 10.1016/S2352-3018(17)30066-8. https://linkinghub.elsevier.com/retrieve/pii/S2352-3018(17)30066-8 S2352-3018(17)30066-8 - DOI - PMC - PubMed
    1. Lazarus JV, Safreed-Harmon K, Barton SE, Costagliola D, Dedes N, Valero J, Gatell JM, Baptista-Leite R, Mendão L, Porter K, Vella S, Rockstroh JK. Beyond viral suppression of HIV - the new quality of life frontier. BMC Med. 2016 Jun 22;14(1):94. doi: 10.1186/s12916-016-0640-4. https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-016-0640-4 10.1186/s12916-016-0640-4 - DOI - DOI - PMC - PubMed

Associated data