Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2009 Dec;117(12):1809-13.
doi: 10.1289/ehp.0901194. Epub 2009 Oct 7.

Epidemiology, public health, and the rhetoric of false positives

Aaron Blair  1 , Rodolfo Saracci, Paolo Vineis, Pierluigi Cocco, Francesco Forastiere, Philippe Grandjean, Manolis Kogevinas, David Kriebel, Anthony McMichael, Neil Pearce, Miquel Porta, Jonathan Samet, Dale P Sandler, Adele Seniori Costantini, Harri Vainio
Affiliations

Epidemiology, public health, and the rhetoric of false positives

Aaron Blair et al. Environ Health Perspect. 2009 Dec.

Abstract

Background: As an observational science, epidemiology is regarded by some researchers as inherently flawed and open to false results. In a recent paper, Boffetta et al. [Boffetta P, McLaughlin JK, LaVecchia C, Tarone RE, Lipworth L, Blot WJ. False-positive results in cancer epidemiology: a plea for epistemological modesty. J Natl Cancer Inst 100:988-995 (2008)] argued that "epidemiology is particularly prone to the generation of false-positive results." They also said "the tendency to emphasize and over-interpret what appear to be new findings is commonplace, perhaps in part because of a belief that the findings provide information that may ultimately improve public health" and that "this tendency to hype new findings increases the likelihood of downplaying inconsistencies within the data or any lack of concordance with other sources of evidence." The authors supported these serious charges against epidemiology and epidemiologists with few examples. Although we acknowledge that false positives do occur, we view the position of Boffetta and colleagues on false positives as unbalanced and potentially harmful to public health.

Objective: We aim to provide a more balanced evaluation of epidemiology and its contribution to public health discourse.

Discussion: Boffetta and colleagues ignore the fact that false negatives may arise from the very processes that they tout as generating false-positive results. We further disagree with their proposition that false-positive results from a single study will lead to faulty decision making in matters of public health importance. In practice, such public health evaluations are based on all the data available from all relevant disciplines and never to our knowledge on a single study.

Conclusions: The lack of balance by Boffetta and colleagues in their evaluation of the impact of false-positive findings on epidemiology, the charge that "methodological vigilance is often absent" in epidemiologists' interpretation of their own results, and the false characterization of how epidemiologic findings are used in societal decision making all undermine a major source of information regarding disease risks. We reaffirm the importance of epidemiologic evidence as a critical component of the foundation of public health protection.

Keywords: epidemiologic methods; false negatives; false positives; hyped findings.

PubMed Disclaimer

Comment in

References

    1. Blair A, Hoar SK, Walrath J. Comparison of crude and smoking-adjusted standardized mortality ratios. J Occup Med. 1985;27:881–884. - PubMed
    1. Blair A, Stewart P, Forastiere F, Lubin J. Methodological issues regarding confounding and exposure misclassification in epidemiologic studies of occupational exposures. Am J Ind Med. 2007;50:199–207. - PubMed
    1. Boffetta P, McLaughlin JK, La Vecchia C, Tarone RE, Lipworth L, Blot WJ. False-positive results in cancer epidemiology: a plea for epistemological modesty. J Natl Cancer Inst. 2008;100:988–995. - PMC - PubMed
    1. Boffetta P, McLaughlin JK, La Vecchia C, Tarone RE, Lipworth L, Blot WJ. A further plea for adherence to the principles underlying science in general and the epidemiologic enterprise in particular. Int J Epidemiol. 2009a;38:678–679. - PubMed
    1. Boffetta P, McLaughlin JK, La Vecchia C, Tarone RE, Lipworth L, Blot WJ. Re: False-positive results in cancer epidemiology: a plea for epistemological modesty. J Natl Cancer Int. 2009b;101:213–214. - PMC - PubMed

Publication types