A mixed-methods evaluation of the MOREOB program in Ontario hospitals: participant knowledge, organizational culture, and experiences

Abstract

Background: MORE^OB (Managing Obstetrical Risk Efficiently) is a patient safety program for health care providers and administrators in hospital obstetric units. MORE^OB has been implemented widely in Canada and gradually spread to the United States. The main goal of MORE^OB is to build a patient safety culture and improve clinical outcomes. In 2013, 26 Ontario hospitals voluntarily accepted provincial funding to participate in MORE^OB. The purpose of our study was to assess the effect of MORE^OB on participant knowledge, organizational culture, and experiences implementing and participating in the program at these 26 Ontario hospitals.

Methods: A convergent parallel mixed-methods study in Ontario, Canada, with MORE^OB participants from 26 hospitals. The quantitative component used a descriptive pre-post repeated measures design to assess participant knowledge and perception of culture, administered pre-MORE^OB and after each of the three MORE^OB modules. Changes in mean scores were assessed using mixed-effects regression. The qualitative component used a qualitative descriptive design with individual semi-structured interviews. We used content analysis to code, categorize, and thematically describe data. A convergent parallel design was used to triangulate findings from data sources.

Results: 308 participants completed the knowledge test, and 329 completed the culture assessment at all four time points. Between baseline and post-Module 3, statistically significant increases on both scores were observed, with an increase of 7.9% (95% CI: 7.1 to 8.8) on the knowledge test and an increase of 0.45 (on a scale of 1-5, 95% CI: 0.38 to 0.52) on the culture assessment. Interview participants (n = 15) described improvements in knowledge, interprofessional communication, ability to provide safe care, and confidence in skills. Facilitators and barriers to program implementation and sustainability were identified.

Conclusions: Participants were satisfied with their participation in the MORE^OB program and perceived that it increased health care provider knowledge and confidence, improved safety for patients, and improved communication between team members. Additionally, mean scores on knowledge tests for obstetric content and culture assessment improved. The MORE^OB program can help organizations and individuals improve care by concentrating on the human and organizational aspects of patient safety. Further work to improve program implementation and sustainability is required.

Keywords: Obstetrics and gynecology; Patient safety; Qualitative research; Safety culture; Surveys.

Fig. 1

Quantitative and qualitative data sources

Fig. 2

Participant flow diagram

Fig. 3

Least square mean estimates and standard errors for Knowledge Tests (a), Culture Assessment Survey (b). ^*Pairwise statistical significance at the 1% level. ^**Differences in Knowledge Test are assessed as mean difference on score from 0 to 100, differences in Culture Assessment Survey scores are assessed as mean differences on score from 1 to 5

Fig. 4

Organization of themes and sub-themes