Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Comment
. 2023 Jan 10;120(2):e2218530120.
doi: 10.1073/pnas.2218530120. Epub 2023 Jan 3.

A universe of uncertainty hiding in plain sight

Per Engzell  1   2   3
Affiliations
Comment

A universe of uncertainty hiding in plain sight

Per Engzell. Proc Natl Acad Sci U S A. .
No abstract available

PubMed Disclaimer

Conflict of interest statement

The author declares no competing interest.

Figures

Fig. 1.
Fig. 1.
Variation in reported results from Brady and Finnigan (4) which Breznau et al. (1) replicate. Point estimates for 3 variables: percent foreign born, net migration, and change in percent foreign born. Total number of estimates n = 174. Just like in Breznau et al. (1), results span coefficients that are negative, positive, and indistinguishable from zero. Positive log odds ratios imply an association opposite of the hypothesized negative effect of immigration on support for social policy. Odds ratios as reported by Brady and Finnigan are not directly comparable with average marginal effects as reported by Breznau et al.
See this image and copyright information in PMC

Comment on

  • Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty.
    Breznau N, Rinke EM, Wuttke A, Nguyen HHV, Adem M, Adriaans J, Alvarez-Benjumea A, Andersen HK, Auer D, Azevedo F, Bahnsen O, Balzer D, Bauer G, Bauer PC, Baumann M, Baute S, Benoit V, Bernauer J, Berning C, Berthold A, Bethke FS, Biegert T, Blinzler K, Blumenberg JN, Bobzien L, Bohman A, Bol T, Bostic A, Brzozowska Z, Burgdorf K, Burger K, Busch KB, Carlos-Castillo J, Chan N, Christmann P, Connelly R, Czymara CS, Damian E, Ecker A, Edelmann A, Eger MA, Ellerbrock S, Forke A, Forster A, Gaasendam C, Gavras K, Gayle V, Gessler T, Gnambs T, Godefroidt A, Grömping M, Groß M, Gruber S, Gummer T, Hadjar A, Heisig JP, Hellmeier S, Heyne S, Hirsch M, Hjerm M, Hochman O, Hövermann A, Hunger S, Hunkler C, Huth N, Ignácz ZS, Jacobs L, Jacobsen J, Jaeger B, Jungkunz S, Jungmann N, Kauff M, Kleinert M, Klinger J, Kolb JP, Kołczyńska M, Kuk J, Kunißen K, Kurti Sinatra D, Langenkamp A, Lersch PM, Löbel LM, Lutscher P, Mader M, Madia JE, Malancu N, Maldonado L, Marahrens H, Martin N, Martinez P, Mayerl J, Mayorga OJ, McManus P, McWagner K, Meeusen C, Meierrieks D, Mellon J, Merhout F, Merk S, Meyer D, Micheli L, Mijs J, Moya C, Neunhoeffer M, Nüst D, Nygård O, Ochsenfeld F, Otte G, Pechenkina AO… See abstract for full author list ➔ Breznau N, et al. Proc Natl Acad Sci U S A. 2022 Nov;119(44):e2203150119. doi: 10.1073/pnas.2203150119. Epub 2022 Oct 28. Proc Natl Acad Sci U S A. 2022. PMID: 36306328 Free PMC article.

References

    1. Breznau N., et al. , Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty. Proc. Natl. Acad. Sci. U.S.A. 119, e2203150119 (2022). - PMC - PubMed
    1. Silberzahn R., et al. , Many analysts, one data set: Making transparent how variations in analytic choices affect results. Adv. Meth. Pract. Psychol. Sci. 1, 337–356 (2018).
    1. Huntington-Klein N., et al. , The influence of hidden researcher decisions in applied microeconomics. Econ. Inq. 59, 944–960 (2021).
    1. Brady D., Finnigan R., Does immigration undermine public support for social policy? Am. Sociol. Rev. 79, 17–42 (2014).
    1. Auspurg K., Brüderl J., Has the credibility of the social sciences been credibly destroyed? Reanalyzing the “Many Analysts, One Data Set” project. Socius 7, 23780231211024421 (2021).

LinkOut - more resources