Effects of patient-reported outcome assessment order

Abstract

Background: In clinical trials and clinical practice, patient-reported outcomes are almost always assessed using multiple patient-reported outcome measures at the same time. This raises concerns about whether patient responses are affected by the order in which the patient-reported outcome measures are administered.

Methods: This questionnaire-based study of order effects included adult cancer patients from five cancer centers. Patients were randomly assigned to complete questionnaires via paper booklets, interactive voice response system, or tablet web survey. Linear Analogue Self-Assessment, Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events, and Patient-Reported Outcomes Measurement Information System assessment tools were each used to measure general health, physical function, social function, emotional distress/anxiety, emotional distress/depression, fatigue, sleep, and pain. The order in which the three tools, and domains within tools, were presented to patients was randomized. Rates of missing data, scale scores, and Cronbach's alpha coefficients were compared by the order in which they were assessed. Analyses included Cochran-Armitage trend tests and mixed models adjusted for performance score, age, sex, cancer type, and curative intent.

Results: A total of 1830 patients provided baseline patient-reported outcome assessments. There were no significant trends in rates of missing values by whether a scale was assessed earlier or later. The largest order effect for scale scores was due to a large mean score at one assessment time point. The largest difference in Cronbach's alpha between the versions for the Patient-Reported Outcomes Measurement Information System scales was 0.106.

Conclusion: The well-being of a cancer patient has many different aspects such as pain, fatigue, depression, and anxiety. These are assessed using a variety of surveys often collected at the same time. This study shows that the order in which the different aspects are collected from the patient is not important.

Keywords: Assessment order; LASA; PRO-CTCAE; PROMIS.

Figure 1:

IVRS Percent of Missing Assessments by Assessment Order (Only assessments at the extremes are labeled)

Figure 2:

Mean LASA Pain Frequency by Assessment Order within Survey

Figure 3:

Mean Mental Health Scores by Assessment Order within Survey

Figure 4:

Mean Sleep Scores by Assessment Order within Survey

Figure 5:

Mean Fatigue Scores by Assessment Order within Survey