. 2016 Jun 15;6(6):e010938.

doi: 10.1136/bmjopen-2015-010938.

Design, implementation and reporting strategies to reduce the instance and impact of missing patient-reported outcome (PRO) data: a systematic review

Rebecca Mercieca-Bebber¹, Michael J Palmer², Michael Brundage², Melanie Calvert³, Martin R Stockler⁴, Madeleine T King¹

Affiliations

¹ Central Clinical School, Sydney Medical School, University of Sydney, Sydney, New South Wales, Australia Psycho-oncology Co-operative Research Group, School of Psychology, University of Sydney, Sydney, New South Wales, Australia.
² Department of Cancer Care and Epidemiology, Cancer Research Institute, Queen's University, Kingston, Ontario, Canada.
³ Institute of Applied Health Research, University of Birmingham, Birmingham, UK.
⁴ Central Clinical School, Sydney Medical School, University of Sydney, Sydney, New South Wales, Australia NHMRC Clinical Trials Centre, University of Sydney, Camperdown, New South Wales, Australia.

PMID: 27311907
PMCID: PMC4916640
DOI: 10.1136/bmjopen-2015-010938

Design, implementation and reporting strategies to reduce the instance and impact of missing patient-reported outcome (PRO) data: a systematic review

Rebecca Mercieca-Bebber et al. BMJ Open. 2016.

. 2016 Jun 15;6(6):e010938.

doi: 10.1136/bmjopen-2015-010938.

Authors

Rebecca Mercieca-Bebber¹, Michael J Palmer², Michael Brundage², Melanie Calvert³, Martin R Stockler⁴, Madeleine T King¹

Affiliations

¹ Central Clinical School, Sydney Medical School, University of Sydney, Sydney, New South Wales, Australia Psycho-oncology Co-operative Research Group, School of Psychology, University of Sydney, Sydney, New South Wales, Australia.
² Department of Cancer Care and Epidemiology, Cancer Research Institute, Queen's University, Kingston, Ontario, Canada.
³ Institute of Applied Health Research, University of Birmingham, Birmingham, UK.
⁴ Central Clinical School, Sydney Medical School, University of Sydney, Sydney, New South Wales, Australia NHMRC Clinical Trials Centre, University of Sydney, Camperdown, New South Wales, Australia.

PMID: 27311907
PMCID: PMC4916640
DOI: 10.1136/bmjopen-2015-010938

Abstract

Objectives: Patient-reported outcomes (PROs) provide important information about the impact of treatment from the patients' perspective. However, missing PRO data may compromise the interpretability and value of the findings. We aimed to report: (1) a non-technical summary of problems caused by missing PRO data; and (2) a systematic review by collating strategies to: (A) minimise rates of missing PRO data, and (B) facilitate transparent interpretation and reporting of missing PRO data in clinical research. Our systematic review does not address statistical handling of missing PRO data.

Data sources: MEDLINE and Cumulative Index to Nursing and Allied Health Literature (CINAHL) databases (inception to 31 March 2015), and citing articles and reference lists from relevant sources.

Eligibility criteria: English articles providing recommendations for reducing missing PRO data rates, or strategies to facilitate transparent interpretation and reporting of missing PRO data were included.

Methods: 2 reviewers independently screened articles against eligibility criteria. Discrepancies were resolved with the research team. Recommendations were extracted and coded according to framework synthesis.

Results: 117 sources (55% discussion papers, 26% original research) met the eligibility criteria. Design and methodological strategies for reducing rates of missing PRO data included: incorporating PRO-specific information into the protocol; carefully designing PRO assessment schedules and defining termination rules; minimising patient burden; appointing a PRO coordinator; PRO-specific training for staff; ensuring PRO studies are adequately resourced; and continuous quality assurance. Strategies for transparent interpretation and reporting of missing PRO data include utilising auxiliary data to inform analysis; transparently reporting baseline PRO scores, rates and reasons for missing data; and methods for handling missing PRO data.

Conclusions: The instance of missing PRO data and its potential to bias clinical research can be minimised by implementing thoughtful design, rigorous methodology and transparent reporting strategies. All members of the research team have a responsibility in implementing such strategies.

Keywords: health-related quality of life; methodology; missing data; patient-reported outcomes; quality assurance; systematic review.

Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

PubMed Disclaimer

Figures

**Figure 1**
PRISMA flow diagram. PRO, patient-reported outcome.

See this image and copyright information in PMC

Cited by

Implications of missing data on reported breast cancer mortality.
Plichta JK, Rushing CN, Lewis HC, Rooney MM, Blazer DG, Thomas SM, Hwang ES, Greenup RA. Plichta JK, et al. Breast Cancer Res Treat. 2023 Jan;197(1):177-187. doi: 10.1007/s10549-022-06764-4. Epub 2022 Nov 5. Breast Cancer Res Treat. 2023. PMID: 36334190 Free PMC article.
Stability Enhanced Variable Selection for a Semiparametric Model with Flexible Missingness Mechanism and Its Application to the ChAMP Study.
Yang Y, Zhao J, Wilding G, Kluczynski M, Bisson L. Yang Y, et al. J Appl Stat. 2020;47(5):827-843. doi: 10.1080/02664763.2019.1658727. Epub 2019 Aug 24. J Appl Stat. 2020. PMID: 33012943 Free PMC article.
Strategies to improve patient-reported outcome completion rates in longitudinal studies.
Nielsen LK, King M, Möller S, Jarden M, Andersen CL, Frederiksen H, Gregersen H, Klostergaard A, Steffensen MS, Pedersen PT, Hinge M, Frederiksen M, Jensen BA, Helleberg C, Mylin AK, Abildgaard N. Nielsen LK, et al. Qual Life Res. 2020 Feb;29(2):335-346. doi: 10.1007/s11136-019-02304-8. Epub 2019 Sep 23. Qual Life Res. 2020. PMID: 31549365 Free PMC article.
Implementation of an electronic patient-reported measure of barriers to antiretroviral therapy adherence with the Opal patient portal: Protocol for a mixed method type 3 hybrid pilot study at a large Montreal HIV clinic.
Engler K, Vicente S, Ma Y, Hijal T, Cox J, Ahmed S, Klein M, Achiche S, Pant Pai N, de Pokomandy A, Lacombe K, Lebouché B. Engler K, et al. PLoS One. 2021 Dec 30;16(12):e0261006. doi: 10.1371/journal.pone.0261006. eCollection 2021. PLoS One. 2021. PMID: 34969046 Free PMC article.
A systematic evaluation of compliance and reporting of patient-reported outcome endpoints in ovarian cancer randomised controlled trials: implications for generalisability and clinical practice.
Mercieca-Bebber R, Friedlander M, Calvert M, Stockler M, Kyte D, Kok PS, King MT. Mercieca-Bebber R, et al. J Patient Rep Outcomes. 2017;1(1):5. doi: 10.1186/s41687-017-0008-3. Epub 2017 Oct 4. J Patient Rep Outcomes. 2017. PMID: 29757300 Free PMC article.

See all "Cited by" articles

References

1. Cherny NI, Sullivan R, Dafni U et al. A standardised, generic, validated approach to stratify the magnitude of clinical benefit that can be anticipated from anti-cancer therapies: the European Society for Medical Oncology Magnitude of Clinical Benefit Scale (ESMO-MCBS). Ann Oncol 2015;26:1547–73. 10.1093/annonc/mdv249 - DOI - PubMed
1. Food and Drug Administration. Guidance for Industry: Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. FDA, 2009. http://www.fda.gov/downloads/Drugs/.../Guidances/UCM193282.pdf (accessed 10 Mar 2014). - PMC - PubMed
1. European Medicines Agency. Oncology Working Party. Draft Reflection Paper on the use of patient reported outcome (PRO) measures in oncology studies. EMA, 2014. http://www.ema.europa.eu/docs/en_GB/document_library/Scientific_guidelin... (accessed 2 Sept 2014). - PubMed
1. Little RJ, D'Agostino R, Cohen ML et al. The prevention and treatment of missing data in clinical trials. N Engl J Med 2012;367:1355–60. 10.1056/NEJMsr1203730 - DOI - PMC - PubMed
1. Bernhard J, Cella DF, Coates AS et al. Missing quality of life data in cancer clinical trials: serious problems and challenges. Stat Med 1998;17:517–32. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<517::AID-SIM799>3.0.CO;2-S - DOI - PubMed

Publication types

Actions

MeSH terms

Actions
Actions
Actions

LinkOut - more resources

Full Text Sources
Other Literature Sources
- scite Smart Citations
Miscellaneous
- NCI CPTAC Assay Portal

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

Design, implementation and reporting strategies to reduce the instance and impact of missing patient-reported outcome (PRO) data: a systematic review

Affiliations

Design, implementation and reporting strategies to reduce the instance and impact of missing patient-reported outcome (PRO) data: a systematic review

Authors

Affiliations

Abstract

Figures

Similar articles

Cited by

References

Publication types

MeSH terms

LinkOut - more resources

Full Text Sources

Other Literature Sources

Miscellaneous