Prognosis Predictions by Families, Physicians, and Nurses of Patients with Severe Acute Brain Injury: Agreement and Accuracy

Abstract

Background: Effective shared decision-making relies on some degree of alignment between families and the medical team regarding a patient's likelihood of recovery. Patients with severe acute brain injury (SABI) are often unable to participate in decisions, and therefore family members make decisions on their behalf. The goal of this study was to evaluate agreement between prognostic predictions by families, physicians, and nurses of patients with SABI regarding their likelihood of regaining independence and to measure each group's prediction accuracy.

Methods: This observational cohort study, conducted from 01/2018 to 07/2020, was based in the neuroscience and medical/cardiac intensive care units of a single center. Patient eligibility included a diagnosis of SABI-specifically stroke, traumatic brain injury, or hypoxic ischemic encephalopathy-and a Glasgow Coma Scale ≤ 12 after hospital day 2. At enrollment, families, physicians, and nurses were asked separately to predict a patient's likelihood of recovering to independence within 6 months on a 0-100 scale, regardless of whether a formal family meeting had occurred. True outcome was based on modified Rankin Scale assessment through a family report or medical chart review. Prognostic agreement was measured by (1) intraclass correlation coefficient; (2) mean group prediction comparisons using paired Student's t-tests; and (3) prevalence of concordance, defined as an absolute difference of less than 20 percentage points between predictions. Accuracy for each group was measured by calculating the area under a receiver operating characteristic curve (C statistic) and compared by using DeLong's test.

Results: Data were collected from 222 patients and families, 45 physicians, and 103 nurses. Complete data on agreement and accuracy were available for 187 and 177 patients, respectively. The intraclass correlation coefficient, in which 1 indicates perfect correlation and 0 indicates no correlation, was 0.49 for physician-family pairs, 0.40 for family-nurse pairs, and 0.66 for physician-nurse pairs. The difference in mean predictions between families and physicians was 23.5 percentage points (p < 0.001), 25.4 between families and nurses (p < 0.001), and 1.9 between physicians and nurses (p = 0.38). Prevalence of concordance was 39.6% for family-physician pairs, 30.0% for family-nurse pairs, and 56.2% for physician-nurse pairs. The C statistic for prediction accuracy was 0.65 for families, 0.82 for physicians, and 0.76 for nurses. The p values for differences in C statistics were < 0.05 for family-physician and family-nurse groups and 0.18 for physician-nurse groups.

Conclusions: For patients with SABI, agreement in predictions between families, physicians, and nurses regarding likelihood of recovery is poor. Accuracy appears higher for physicians and nurses compared with families, with no significant difference between physicians and nurses.

Keywords: Brain injury; Communication; Neurocritical care; Outcomes; Palliative care; Prognosis.

Fig. 1

Bland–Altman plots for prediction agreement. Agreement between physicians and nurses appears higher when predictions are pessimistic (c, far left)

Fig. 1

Bland–Altman plots for prediction agreement. Agreement between physicians and nurses appears higher when predictions are pessimistic (c, far left)

Fig. 1

Bland–Altman plots for prediction agreement. Agreement between physicians and nurses appears higher when predictions are pessimistic (c, far left)

Fig. 2

Receiver operating characteristic curves for accuracy in predicting recovery to independence at 6 months. CI, confidence interval