Evaluating the Feasibility and Acceptability of a Prototype Hospital Digital Antibiotic Review Tracking Toolkit: A Qualitative Study Using the RE-AIM Framework

Abstract

Background: Internationally, digital health interventions have increasingly been adopted within hospital settings. Optimising their clinical implementation requires user involvement, but there is a lack of evidence regarding how this should be done. Objectives: This study was carried out to understand the acceptability and usability of a prototype Digital Antibiotic Review Tracking Toolkit and identify modifications required to optimise it ahead of a trial. Methods: The optimisation process involved online semi-structured interviews with a purposive sample of fifteen healthcare professionals recruited from Scotland and England, along with three service users, to gather feedback on the prototype's design, content and delivery. Participants' negative views were specifically sought to identify adaptations needed to ensure that the intervention's components aligned optimally with end-user needs. Data were analysed using Framework Analysis guided by the RE-AIM implementation science framework (Reach, Effectiveness, Adoption, Implementation, and Maintenance) to identify key themes. Results: Participants mostly voiced positive views regarding the prototype, finding it acceptable, feasible and engaging. They also identified concerns relating to its adoption, system functionality, accessibility and maintenance that needed to be addressed. Anticipated low adoption rates were linked to issues surrounding computer literacy. This detailed user feedback informed rapid adjustments to the intervention to enhance its acceptability, perceived future credibility and usability in hospitals. Conclusions: This novel study illustrates how to identify, modify and adapt a digital intervention quickly and efficiently using qualitative iterative methods. Findings highlight the critical importance of contextualising end-user experience with health interventions to facilitate future engagement, uptake, and long-term use. This study also demonstrates how core elements of the MRC framework can be operationalised to help refine prototype digital interventions pre-trial.

Keywords: antibiotic review; antimicrobial resistance; behaviour change; optimisation; person-centred research; qualitative design; user experience.

Figure 1

Methods applied in the development and optimisation of the DARTT intervention, with the details of intervention planning and development (Phase 1) fully reported elsewhere [25].

Figure 2

DARTT components developed in Phase 1.

Figure 3

Study recruitment process.

Figure 4

Low-fidelity prototype interfaces of the DARTT dashboard and mobile phone app used during interviews.