Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 Feb 24:9:e66718.
doi: 10.2196/66718.

Improving the User Interface and Guiding the Development of Effective Training Material for a Clinical Research Recruitment and Retention Dashboard: Usability Testing Study

Leah Leslie Gardner  1 , Pezhman Raeisian Parvari  1 , Mark Seidman  1 , Richard J Holden  1   2   3   4 , Nicole R Fowler  1   2   4 , Ben L Zarzaur  5 , Diana Summanwar  6 , Cristina Barboi  7 , Malaz Boustani  1   2   4   8
Affiliations

Improving the User Interface and Guiding the Development of Effective Training Material for a Clinical Research Recruitment and Retention Dashboard: Usability Testing Study

Leah Leslie Gardner et al. JMIR Form Res. .

Abstract

Background: Participant recruitment and retention are critical to the success of clinical trials, yet challenges such as low enrollment rates and high attrition remain ongoing obstacles. RecruitGPS is a scalable dashboard with integrated control charts to address these issues by providing real-time data monitoring and analysis, enabling researchers to better track and improve recruitment and retention.

Objective: This study aims to identify the challenges and inefficiencies users encounter when interacting with the RecruitGPS dashboard. By identifying these issues, the study aims to inform strategies for improving the dashboard's user interface and create targeted, effective instructional materials that address user needs.

Methods: Twelve clinical researchers from the Midwest region of the United States provided feedback through a 10-minute, video-recorded usability test session, during which participants were instructed to explore the various tabs of the dashboard, identify challenges, and note features that worked well while thinking aloud. Following the video session, participants took a survey on which they answered System Usability Scale (SUS) questions, ease of navigation questions, and a Net Promoter Score (NPS) question.

Results: A quantitative analysis of survey responses revealed an average SUS score of 61.46 (SD 23.80; median 66.25) points, indicating a need for improvement in the user interface. The NPS was 8, with 4 of 12 (33%) respondents classified as promoters and 3 of 12 (25%) as detractors, indicating a slightly positive satisfaction. When participants compared RecruitGPS to other recruitment and study management tools they had used, 8 of 12 (67%) of participants rated RecruitGPS as better or much better. Only 1 of 12 (8%) participants rated RecruitGPS as worse but not much worse. A qualitative analysis of participants' interactions with the dashboard diagnosed a confusing part of the dashboard that could be eliminated or made optional and provided valuable insight for the development of instructional videos and documentation. Participants liked the dashboard's data visualization capabilities, including intuitive graphs and trend tracking; progress indicators, such as color-coded status indicators and comparison metrics; and the overall dashboard's layout and design, which consolidated relevant data on a single page. Users also valued the accuracy and real-time updates of data, especially the integration with external sources like Research Electronic Data Capture (REDCap).

Conclusions: RecruitGPS demonstrates significant potential to improve the efficiency of clinical trials by providing researchers with real-time insights into participant recruitment and retention. This study offers valuable recommendations for targeted refinements to enhance the user experience and maximize the dashboard's effectiveness. Additionally, it highlights navigation challenges that can be addressed through the development of clear and focused instructional videos.

Keywords: agile implementation; agile science; clinical research; human-computer interaction; recruitment strategies; research subject recruitment.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: MB serves as a chief scientific officer and cofounder of BlueAgilis and the chief health officer of DigiCare Realized. He has equity interest in Blue Agilis and DigiCare Realized; he has sold equity in Preferred Population Health Management and MyShift (previously known as RestUp). He serves as an advisory board member for Eli Lilly and Co, Eisai; Merck & Co; Biogen; and Genentech. These conflicts have been reviewed by Indiana University and have been appropriately managed to maintain objectivity.

Figures

Figure 1.
Figure 1.. The RecruitGPS dashboard interface evaluated during usability testing.
See this image and copyright information in PMC

References

    1. Campbell MK, Snowdon C, Francis D, et al. Recruitment to randomised trials: strategies for trial enrollment and participation study. The STEPS study. Health Technol Assess. 2007 Nov;11(48):iii, ix-105. doi: 10.3310/hta11480. doi. Medline. - DOI - PubMed
    1. Visanji EC, Oldham JA. Patient recruitment in clinical trials: a review of literature. Phys Ther Rev. 2001 Jun 1;6(2):141–150. doi: 10.1179/108331901786166532. doi. - DOI
    1. Toddenroth D, Sivagnanasundaram J, Prokosch HU, Ganslandt T. Concept and implementation of a study dashboard module for a continuous monitoring of trial recruitment and documentation. J Biomed Inform. 2016 Dec;64:222–231. doi: 10.1016/j.jbi.2016.10.010. doi. Medline. - DOI - PubMed
    1. Vadeboncoeur C, Foster C, Townsend N. Challenges of research recruitment in a university setting in England. Health Promot Int. 2018 Oct 1;33(5):878–886. doi: 10.1093/heapro/dax025. doi. Medline. - DOI - PMC - PubMed
    1. Lai YS, Afseth JD. A review of the impact of utilising electronic medical records for clinical research recruitment. Clin Trials. 2019 Apr;16(2):194–203. doi: 10.1177/1740774519829709. doi. Medline. - DOI - PubMed

LinkOut - more resources