Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Nov 9:10:e47718.
doi: 10.2196/47718.

Developing an Audit and Feedback Dashboard for Family Physicians: User-Centered Design Process

Jennifer Shuldiner  1 , Tara Kiran  2   3   4   5 , Payal Agarwal  1   2 , Maryam Daneshvarfard  4 , Kirsten Eldridge  2 , Susie Kim  2   6 , Michelle Greiver  7 , Iffat Jokhio  8 , Noah Ivers  1   2   5
Affiliations

Developing an Audit and Feedback Dashboard for Family Physicians: User-Centered Design Process

Jennifer Shuldiner et al. JMIR Hum Factors. .

Abstract

Background: Audit and feedback (A&F), the summary and provision of clinical performance data, is a common quality improvement strategy. Successful design and implementation of A&F-or any quality improvement strategy-should incorporate evidence-informed best practices as well as context-specific end user input.

Objective: We used A&F theory and user-centered design to inform the development of a web-based primary care A&F dashboard. We describe the design process and how it influenced the design of the dashboard.

Methods: Our design process included 3 phases: prototype development based on A&F theory and input from clinical improvement leaders; workshop with family physician quality improvement leaders to develop personas (ie, fictional users that represent an archetype character representative of our key users) and application of those personas to design decisions; and user-centered interviews with family physicians to learn about the physician's reactions to the revised dashboard.

Results: The team applied A&F best practices to the dashboard prototype. Personas were used to identify target groups with challenges and behaviors as a tool for informed design decision-making. Our workshop produced 3 user personas, Dr Skeptic, Frazzled Physician, and Eager Implementer, representing common users based on the team's experience of A&F. Interviews were conducted to further validate findings from the persona workshop and found that (1) physicians were interested in how they compare with peers; however, if performance was above average, they were not motivated to improve even if gaps compared to other standards in their care remained; (2) burnout levels were high as physicians are trying to catch up on missed care during the pandemic and are therefore less motivated to act on the data; and (3) additional desired features included integration within the electronic medical record, and more up-to-date and accurate data.

Conclusions: We found that carefully incorporating data from user interviews helped operationalize generic best practices for A&F to achieve an acceptable dashboard that could meet the needs and goals of physicians. We demonstrate such a design process in this paper. A&F dashboards should address physicians' data skepticism, present data in a way that spurs action, and support physicians to have the time and capacity to engage in quality improvement work; the steps we followed may help those responsible for quality improvement strategy implementation achieve these aims.

Keywords: audit; audit and feedback; care; clinical performance; dashboard; design; development; family physician; feedback; implementation; primary care; user-centered; users.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: None declared.

Figures

Figure 1
Figure 1
Design process of the audit and feedback CareCanvas dashboard for family physicians.
Figure 2
Figure 2
Original prototype for diabetes indicators. A1c: hemoglobin A1c.
Figure 3
Figure 3
Priority personas developed and validated during the workshop.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O'Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6):CD000259. doi: 10.1002/14651858.CD000259.pub3. - DOI - PMC - PubMed
    1. Brown B, Gude WT, Blakeman T, van der Veer SN, Ivers N, Francis JJ, Lorencatto F, Presseau J, Peek N, Daker-White G. Clinical Performance Feedback Intervention Theory (CP-FIT): a new theory for designing, implementing, and evaluating feedback in health care based on a systematic review and meta-synthesis of qualitative research. Implement Sci. 2019;14(1):40. doi: 10.1186/s13012-019-0883-5. https://implementationscience.biomedcentral.com/articles/10.1186/s13012-... 10.1186/s13012-019-0883-5 - DOI - DOI - PMC - PubMed
    1. Brehaut JC, Colquhoun HL, Eva KW, Carroll K, Sales A, Michie S, Ivers N, Grimshaw JM. Practice feedback interventions: 15 suggestions for optimizing effectiveness. Ann Intern Med. 2016;164(6):435–441. doi: 10.7326/M15-2248. https://core.ac.uk/reader/79500925?utm_source=linkout 2494536 - DOI - PubMed
    1. Engaging primary care practices in quality improvement: strategies for practice facilitators. Agency for Healthcare Research and Quality. 2015. [2023-10-24]. https://www.ahrq.gov/sites/default/files/wysiwyg/ncepcr/tools/PCMH/qi-st... .
    1. Abras C, Maloney-Krichmar D, Preece J. User-centered design. In: Bainbridge WS, editor. Berkshire Encyclopedia of Human-Computer Interaction. Great Barrington, Massachusetts: Berkshire Publishing Group; 2004. pp. 445–456.

Publication types

LinkOut - more resources