Influence of data display formats on physician investigators' decisions to stop clinical trials: prospective trial with repeated measures
- PMID: 10356010
- PMCID: PMC27896
- DOI: 10.1136/bmj.318.7197.1527
Influence of data display formats on physician investigators' decisions to stop clinical trials: prospective trial with repeated measures
Abstract
Objective: To examine the effect of the method of data display on physician investigators' decisions to stop hypothetical clinical trials for an unplanned statistical analysis.
Design: Prospective, mixed model design with variables between subjects and within subjects (repeated measures).
Setting: Comprehensive cancer centre.
Participants: 34 physicians, stratified by academic rank, who were conducting clinical trials.
Interventions: PARTICIPANTS were shown tables, pie charts, bar graphs, and icon displays containing hypothetical data from a clinical trial and were asked to decide whether to continue the trial or stop for an unplanned statistical analysis.
Main outcome measure: Percentage of accurate decisions with each type of display.
Results: Accuracy of decisions was affected by the type of data display and positive or negative framing of the data. More correct decisions were made with icon displays than with tables, pie charts, and bar graphs (82% v 68%, 56%, and 43%, respectively; P=0.03) and when data were negatively framed rather than positively framed in tables (93% v 47%; P=0.004).
Conclusions: Clinical investigators' decisions can be affected by factors unrelated to the actual data. In the design of clinical trials information systems, careful consideration should be given to the method by which data are framed and displayed in order to reduce the impact of these extraneous factors.
Figures
Comment in
-
Same information, different decisions: format counts. Format as well as content matters in clinical information.BMJ. 1999 Jun 5;318(7197):1501-2. doi: 10.1136/bmj.318.7197.1501. BMJ. 1999. PMID: 10355983 Free PMC article. No abstract available.
-
Influence of data display formats on decisions to stop clinical trials. Paper is misleading, like a sheep dressed in a wolf's clothing.BMJ. 1999 Oct 16;319(7216):1070. doi: 10.1136/bmj.319.7216.1070. BMJ. 1999. PMID: 10521214 Free PMC article. No abstract available.
Similar articles
-
Is a picture worth a thousand medical words? A randomized trial of reporting formats for medical research data.Methods Inf Med. 1991 Apr;30(2):145-50. Methods Inf Med. 1991. PMID: 1857251 Clinical Trial.
-
Physicians' perception of alternative displays of clinical research evidence for clinical decision support - A study with case vignettes.J Biomed Inform. 2017 Jul;71S:S53-S59. doi: 10.1016/j.jbi.2017.01.007. Epub 2017 Jan 13. J Biomed Inform. 2017. PMID: 28089913 Free PMC article.
-
A randomized controlled trial of league tables and control charts as aids to health service decision-making.Int J Qual Health Care. 2004 Aug;16(4):309-15. doi: 10.1093/intqhc/mzh054. Int J Qual Health Care. 2004. PMID: 15252005 Clinical Trial.
-
Making Sense of Statistics in Clinical Trial Reports: Part 1 of a 4-Part Series on Statistics for Clinical Trials.J Am Coll Cardiol. 2015 Dec 8;66(22):2536-49. doi: 10.1016/j.jacc.2015.10.014. J Am Coll Cardiol. 2015. PMID: 26653629 Review.
-
Data display techniques.Appl Nurs Res. 1999 Aug;12(3):153-8. doi: 10.1016/s0897-1897(99)80067-6. Appl Nurs Res. 1999. PMID: 10457626 Review.
Cited by
-
The roulette wheel: an aid to informed decision making.PLoS Med. 2006 Jun;3(6):e137. doi: 10.1371/journal.pmed.0030137. PLoS Med. 2006. PMID: 16752950 Free PMC article.
-
Does Level of Numeracy and Graph Literacy Impact Comprehension of Quality Targets? Findings from a Survey of Home Care Nurses.AMIA Annu Symp Proc. 2018 Apr 16;2017:635-640. eCollection 2017. AMIA Annu Symp Proc. 2018. PMID: 29854128 Free PMC article.
-
Decision complexity affects the extent and type of decision support use.AMIA Annu Symp Proc. 2006;2006:724-8. AMIA Annu Symp Proc. 2006. PMID: 17238436 Free PMC article.
-
Using informatics to capture older adults' wellness.Int J Med Inform. 2013 Nov;82(11):e232-41. doi: 10.1016/j.ijmedinf.2011.03.004. Epub 2011 Apr 8. Int J Med Inform. 2013. PMID: 21482182 Free PMC article.
-
Framing Bias in the Interpretation of Quality Improvement Data: Evidence From an Experiment.Int J Health Policy Manag. 2019 May 1;8(5):307-314. doi: 10.15171/ijhpm.2019.08. Int J Health Policy Manag. 2019. PMID: 31204447 Free PMC article.
References
-
- Friedman LM, Furberg CD, DeMets DL. Fundamentals of clinical trials. 2nd ed. Littleton, MA: PSG Publishing; 1985.
-
- Cleveland WS, McGill R. Graphical perception: the visual decoding of quantitative material when on graphical displays of data. J R Stat Soc Ser A. 1987;150:192–229.
-
- Cochran WG. The comparison of percentages in matched samples. Biometrika. 1950;37:256–266. - PubMed
-
- McNemar Q. Note on the sampling error of the differences between correlated proportions or percentages. Psychometrika. 1947;12:153–157. - PubMed
-
- Elting LS, Bodey GP. Is a picture worth a thousand medical words? A randomized trial of reporting formats for medical research data. Methods Inf Med. 1991;30:145–150. - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical