Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Apr;11(2):e001741.
doi: 10.1136/bmjoq-2021-001741.

Indicators for implementation outcome monitoring of reporting and learning systems in hospitals: an underestimated need for patient safety

Silke Kuske  1 , Tabea Willmeroth  2 , Jörg Schneider  2 , Sandra Belibasakis  2 , Martina Roes  3 , Sandra Olivia Borgmann  2 , Maria Ines Cartes Febrero  4
Affiliations

Indicators for implementation outcome monitoring of reporting and learning systems in hospitals: an underestimated need for patient safety

Silke Kuske et al. BMJ Open Qual. 2022 Apr.

Abstract

Objective: We aimed to investigate the perception of the implementation success of reporting and learning systems in German hospitals, the perceived relevance of the implementation outcomes and whether and how these implementation outcomes are monitored. An reporting and learning system is a tool used worldwide for patient safety that identifies and analyses critical events, errors, risks and near misses in healthcare.

Methods: A pretested exploratory cross-sectional online survey was conducted with reporting and learning system experts from 51 acute care hospitals. For communicative validation, the results were discussed in person in an expert panel discussion (N=23).

Results: Fifty-three per cent (n=27) of the participants (N=51) of the online survey perceived that their reporting and learning system was being comprehensively and successfully implemented. However, no service or patient outcomes were reported to ultimately capture the concept of implementation success. Most of the participants reported a (high) relevance of the implementation outcomes' acceptability and sustainability. In total, 44 measures were provided to monitor implementation outcomes. However, most of the quantitative measures were based on the (relative) number of entered reports. Qualitative measures were reported in relation to the 'quality of the report'. In general, the measures were poorly specified.

Conclusion: There is an underestimated need to develop validated 'implementation patient safety indicator(s) (sets)' to monitor implementation outcomes of reporting and learning systems. We also identified a potential need to facilitate awareness of the concept of implementation success and its relevance for patient safety. Drafts of indicators that could be used as a starting point for the further development of 'implementation patient safety indicators' were provided.

Keywords: implementation science; incident reporting; outcome assessment; patient safety; risk management.

PubMed Disclaimer

Conflict of interest statement

Competing interests: None declared.

Figures

Figure 1
Figure 1
Core elements of improvement and implementation science.
Figure 2
Figure 2
Relevance of implementation outcomes (N=51).
See this image and copyright information in PMC

References

    1. Stavropoulou C, Doherty C, Tosey P. How effective are Incident-Reporting systems for improving patient safety? A systematic literature review. Milbank Q 2015;93:826–66. 10.1111/1468-0009.12166 - DOI - PMC - PubMed
    1. World Health Organization . Patient safety incident reporting and learning systems: technical report and guidance. WHO Press, World Health Organization, 2020: 1–72.
    1. Ramírez E, Martín A, Villán Y, et al. . Effectiveness and limitations of an incident-reporting system analyzed by local clinical safety leaders in a tertiary Hospital: prospective evaluation through real-time observations of patient safety incidents. Medicine 2018;97:e12509. 10.1097/MD.0000000000012509 - DOI - PMC - PubMed
    1. Health Quality Ontario . Patient safety learning systems: a systematic review and qualitative synthesis. Ont Health Technol Assess Ser 2017;17:1–23. - PMC - PubMed
    1. Proctor E, Silmere H, Raghavan R, et al. . Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health 2011;38:65–76. 10.1007/s10488-010-0319-7 - DOI - PMC - PubMed

Publication types