doi: 10.1038/s41562-017-0189-z.
Redefine statistical significance
Daniel J Benjamin
1
, James O Berger
2
, Magnus Johannesson
3
, Brian A Nosek
4
5
, E-J Wagenmakers
6
, Richard Berk
7
8
, Kenneth A Bollen
9
, Björn Brembs
10
, Lawrence Brown
8
, Colin Camerer
11
, David Cesarini
12
13
, Christopher D Chambers
14
, Merlise Clyde
2
, Thomas D Cook
15
16
, Paul De Boeck
17
, Zoltan Dienes
18
, Anna Dreber
19
, Kenny Easwaran
20
, Charles Efferson
21
, Ernst Fehr
22
, Fiona Fidler
23
, Andy P Field
18
, Malcolm Forster
24
, Edward I George
8
, Richard Gonzalez
25
, Steven Goodman
26
, Edwin Green
27
, Donald P Green
28
, Anthony G Greenwald
29
, Jarrod D Hadfield
30
, Larry V Hedges
31
, Leonhard Held
32
, Teck Hua Ho
33
, Herbert Hoijtink
34
, Daniel J Hruschka
35
, Kosuke Imai
36
, Guido Imbens
37
, John P A Ioannidis
38
, Minjeong Jeon
39
, James Holland Jones
40
41
, Michael Kirchler
42
, David Laibson
43
, John List
44
, Roderick Little
45
, Arthur Lupia
46
, Edouard Machery
47
, Scott E Maxwell
48
, Michael McCarthy
49
, Don A Moore
50
, Stephen L Morgan
51
, Marcus Munafó
52
53
, Shinichi Nakagawa
54
, Brendan Nyhan
55
, Timothy H Parker
56
, Luis Pericchi
57
, Marco Perugini
58
, Jeff Rouder
59
, Judith Rousseau
60
, Victoria Savalei
61
, Felix D Schönbrodt
62
, Thomas Sellke
63
, Betsy Sinclair
64
, Dustin Tingley
65
, Trisha Van Zandt
66
, Simine Vazire
67
, Duncan J Watts
68
, Christopher Winship
69
, Robert L Wolpert
2
, Yu Xie
70
, Cristobal Young
71
, Jonathan Zinman
72
, Valen E Johnson
73
Affiliations
Affiliations
- 1 Center for Economic and Social Research and Department of Economics, University of Southern California, Los Angeles, CA, 90089-3332, USA. daniel.benjamin@gmail.com.
- 2 Department of Statistical Science, Duke University, Durham, NC, 27708-0251, USA.
- 3 Department of Economics, Stockholm School of Economics, Stockholm, SE-113 83, Sweden. magnus.johannesson@hhs.se.
- 4 University of Virginia, Charlottesville, VA, 22908, USA.
- 5 Center for Open Science, Charlottesville, VA, 22903, USA.
- 6 Department of Psychology, University of Amsterdam, Amsterdam, 1018 VZ, The Netherlands.
- 7 School of Arts and Sciences and Department of Criminology, University of Pennsylvania, Philadelphia, PA, 19104-6286, USA.
- 8 Department of Statistics, The Wharton School, University of Pennsylvania, Philadelphia, PA, 19104, USA.
- 9 Department of Psychology and Neuroscience, Department of Sociology, University of North Carolina Chapel Hill, Chapel Hill, NC, 27599-3270, USA.
- 10 Institute of Zoology - Neurogenetics, Universität Regensburg, Universitätsstrasse 31, 93040, Regensburg, Germany.
- 11 Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA.
- 12 Department of Economics, New York University, New York, NY, 10012, USA.
- 13 The Research Institute of Industrial Economics (IFN), Stockholm, SE-102 15, Sweden.
- 14 Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff, CF24 4HQ, UK.
- 15 Northwestern University, Evanston, IL, 60208, USA.
- 16 Mathematica Policy Research, Washington, DC, 20002-4221, USA.
- 17 Department of Psychology, Quantitative Program, Ohio State University, Columbus, OH, 43210, USA.
- 18 School of Psychology, University of Sussex, Brighton, BN1 9QH, UK.
- 19 Department of Economics, Stockholm School of Economics, Stockholm, SE-113 83, Sweden.
- 20 Department of Philosophy, Texas A&M University, College Station, TX, 77843-4237, USA.
- 21 Department of Psychology, Royal Holloway University of London, Egham Surrey, TW20 0EX, UK.
- 22 Department of Economics, University of Zurich, 8006, Zurich, Switzerland.
- 23 School of BioSciences and School of Historical & Philosophical Studies, University of Melbourne, Parkville, VIC, 3010, Australia.
- 24 Department of Philosophy, University of Wisconsin - Madison, Madison, WI, 53706, USA.
- 25 Department of Psychology, University of Michigan, Ann Arbor, MI, 48109-1043, USA.
- 26 Stanford University, General Medical Disciplines, Stanford, CA, 94305, USA.
- 27 Department of Ecology, Evolution and Natural Resources SEBS, Rutgers University, New Brunswick, NJ, 08901-8551, USA.
- 28 Department of Political Science, Columbia University in the City of New York, New York, NY, 10027, USA.
- 29 Department of Psychology, University of Washington, Seattle, WA, 98195-1525, USA.
- 30 Institute of Evolutionary Biology School of Biological Sciences, The University of Edinburgh, Edinburgh, EH9 3JT, UK.
- 31 Weinberg College of Arts & Sciences Department of Statistics, Northwestern University, Evanston, IL, 60208, USA.
- 32 Epidemiology, Biostatistics and Prevention Institute (EBPI), University of Zurich, 8001, Zurich, Switzerland.
- 33 National University of Singapore, Singapore, 119077, Singapore.
- 34 Department of Methods and Statistics, Universiteit Utrecht, Utrecht, 3584 CH, The Netherlands.
- 35 School of Human Evolution and Social Change, Arizona State University, Tempe, AZ, 85287-2402, USA.
- 36 Department of Politics and Center for Statistics and Machine Learning, Princeton University, Princeton, NJ, 08544, USA.
- 37 Stanford University, Stanford, CA, 94305-5015, USA.
- 38 Departments of Medicine, of Health Research and Policy, of Biomedical Data Science, and of Statistics and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, 94305, USA.
- 39 Advanced Quantitative Methods, Social Research Methodology, Department of Education, Graduate School of Education & Information Studies, University of California, Los Angeles, CA, 90095-1521, USA.
- 40 Department of Life Sciences, Imperial College London, Ascot, SL5 7PY, UK.
- 41 Department of Earth System Science, Stanford, CA, 94305-4216, USA.
- 42 Department of Banking and Finance, University of Innsbruck and University of Gothenburg, Innsbruck, A-6020, Austria.
- 43 Department of Economics, Harvard University, Cambridge, MA, 02138, USA.
- 44 Department of Economics, University of Chicago, Chicago, IL, 60637, USA.
- 45 Department of Biostatistics, University of Michigan, Ann Arbor, MI, 48109-2029, USA.
- 46 Department of Political Science, University of Michigan, Ann Arbor, MI, 48109-1045, USA.
- 47 Department of History and Philosophy of Science, University of Pittsburgh, Pittsburgh, PA, 15260, USA.
- 48 Department of Psychology, University of Notre Dame, Notre Dame, IN, 46556, USA.
- 49 School of BioSciences, University of Melbourne, Parkville, VIC, 3010, Australia.
- 50 Haas School of Business, University of California at Berkeley, Berkeley, CA, 94720-1900A, USA.
- 51 Johns Hopkins University, Baltimore, MD, 21218, USA.
- 52 MRC Integrative Epidemiology Unit, University of Bristol, Bristol, BS8 1TU, UK.
- 53 UK Centre for Tobacco and Alcohol Studies, School of Experimental Psychology, University of Bristol, Bristol, BS8 1TU, UK.
- 54 Evolution & Ecology Research Centre and School of Biological, Earth and Environmental Sciences, University of New South Wales, Sydney, NSW, 2052, Australia.
- 55 Department of Government, Dartmouth College, Hanover, NH, 03755, USA.
- 56 Department of Biology, Whitman College, Walla Walla, WA, 99362, USA.
- 57 Department of Mathematics, University of Puerto Rico, Rio Piedras Campus, San Juan, PR, 00936-8377, Puerto Rico.
- 58 Department of Psychology, University of Milan-Bicocca, Milan, 20126, Italy.
- 59 Department of Cognitive Sciences, University of California, Irvine, CA, 92617, USA.
- 60 Université Paris Dauphine, 75016, Paris, France.
- 61 Department of Psychology, The University of British Columbia, Vancouver, V6T 1Z4, BC, Canada.
- 62 Department Psychology, Ludwig-Maximilians-University Munich, Leopoldstraβe 13, 80802, Munich, Germany.
- 63 Department of Statistics, Purdue University, West Lafayette, IN, 47907-2067, USA.
- 64 Department of Political Science, Washington University in St. Louis, St. Louis, MO, 63130-4899, USA.
- 65 Government Department, Harvard University, Cambridge, MA, 02138, USA.
- 66 Department of Psychology, Ohio State University, Columbus, OH, 43210, USA.
- 67 Department of Psychology, University of California, Davis, CA, 95616, USA.
- 68 Microsoft Research, 641 Avenue of the Americas, 7th Floor, New York, NY, 10011, USA.
- 69 Department of Sociology, Harvard University, Cambridge, MA, 02138, USA.
- 70 Department of Sociology, Princeton University, Princeton, NJ, 08544, USA.
- 71 Department of Sociology, Stanford University, Stanford, CA, 94305-2047, USA.
- 72 Department of Economics, Dartmouth College, Hanover, NH, 03755-3514, USA.
- 73 Department of Statistics, Texas A&M University, College Station, TX, 77843, USA. vejohnson@exchange.tamu.edu.
- PMID: 30980045
- DOI: 10.1038/s41562-017-0189-z
Item in Clipboard
Redefine statistical significance
Daniel J Benjamin et al.
Nat Hum Behav.
2018 Jan.
Free article
Display options
Format
doi: 10.1038/s41562-017-0189-z.
Authors
Daniel J Benjamin
1
, James O Berger
2
, Magnus Johannesson
3
, Brian A Nosek
4
5
, E-J Wagenmakers
6
, Richard Berk
7
8
, Kenneth A Bollen
9
, Björn Brembs
10
, Lawrence Brown
8
, Colin Camerer
11
, David Cesarini
12
13
, Christopher D Chambers
14
, Merlise Clyde
2
, Thomas D Cook
15
16
, Paul De Boeck
17
, Zoltan Dienes
18
, Anna Dreber
19
, Kenny Easwaran
20
, Charles Efferson
21
, Ernst Fehr
22
, Fiona Fidler
23
, Andy P Field
18
, Malcolm Forster
24
, Edward I George
8
, Richard Gonzalez
25
, Steven Goodman
26
, Edwin Green
27
, Donald P Green
28
, Anthony G Greenwald
29
, Jarrod D Hadfield
30
, Larry V Hedges
31
, Leonhard Held
32
, Teck Hua Ho
33
, Herbert Hoijtink
34
, Daniel J Hruschka
35
, Kosuke Imai
36
, Guido Imbens
37
, John P A Ioannidis
38
, Minjeong Jeon
39
, James Holland Jones
40
41
, Michael Kirchler
42
, David Laibson
43
, John List
44
, Roderick Little
45
, Arthur Lupia
46
, Edouard Machery
47
, Scott E Maxwell
48
, Michael McCarthy
49
, Don A Moore
50
, Stephen L Morgan
51
, Marcus Munafó
52
53
, Shinichi Nakagawa
54
, Brendan Nyhan
55
, Timothy H Parker
56
, Luis Pericchi
57
, Marco Perugini
58
, Jeff Rouder
59
, Judith Rousseau
60
, Victoria Savalei
61
, Felix D Schönbrodt
62
, Thomas Sellke
63
, Betsy Sinclair
64
, Dustin Tingley
65
, Trisha Van Zandt
66
, Simine Vazire
67
, Duncan J Watts
68
, Christopher Winship
69
, Robert L Wolpert
2
, Yu Xie
70
, Cristobal Young
71
, Jonathan Zinman
72
, Valen E Johnson
73
Affiliations
- 1 Center for Economic and Social Research and Department of Economics, University of Southern California, Los Angeles, CA, 90089-3332, USA. daniel.benjamin@gmail.com.
- 2 Department of Statistical Science, Duke University, Durham, NC, 27708-0251, USA.
- 3 Department of Economics, Stockholm School of Economics, Stockholm, SE-113 83, Sweden. magnus.johannesson@hhs.se.
- 4 University of Virginia, Charlottesville, VA, 22908, USA.
- 5 Center for Open Science, Charlottesville, VA, 22903, USA.
- 6 Department of Psychology, University of Amsterdam, Amsterdam, 1018 VZ, The Netherlands.
- 7 School of Arts and Sciences and Department of Criminology, University of Pennsylvania, Philadelphia, PA, 19104-6286, USA.
- 8 Department of Statistics, The Wharton School, University of Pennsylvania, Philadelphia, PA, 19104, USA.
- 9 Department of Psychology and Neuroscience, Department of Sociology, University of North Carolina Chapel Hill, Chapel Hill, NC, 27599-3270, USA.
- 10 Institute of Zoology - Neurogenetics, Universität Regensburg, Universitätsstrasse 31, 93040, Regensburg, Germany.
- 11 Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA.
- 12 Department of Economics, New York University, New York, NY, 10012, USA.
- 13 The Research Institute of Industrial Economics (IFN), Stockholm, SE-102 15, Sweden.
- 14 Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff, CF24 4HQ, UK.
- 15 Northwestern University, Evanston, IL, 60208, USA.
- 16 Mathematica Policy Research, Washington, DC, 20002-4221, USA.
- 17 Department of Psychology, Quantitative Program, Ohio State University, Columbus, OH, 43210, USA.
- 18 School of Psychology, University of Sussex, Brighton, BN1 9QH, UK.
- 19 Department of Economics, Stockholm School of Economics, Stockholm, SE-113 83, Sweden.
- 20 Department of Philosophy, Texas A&M University, College Station, TX, 77843-4237, USA.
- 21 Department of Psychology, Royal Holloway University of London, Egham Surrey, TW20 0EX, UK.
- 22 Department of Economics, University of Zurich, 8006, Zurich, Switzerland.
- 23 School of BioSciences and School of Historical & Philosophical Studies, University of Melbourne, Parkville, VIC, 3010, Australia.
- 24 Department of Philosophy, University of Wisconsin - Madison, Madison, WI, 53706, USA.
- 25 Department of Psychology, University of Michigan, Ann Arbor, MI, 48109-1043, USA.
- 26 Stanford University, General Medical Disciplines, Stanford, CA, 94305, USA.
- 27 Department of Ecology, Evolution and Natural Resources SEBS, Rutgers University, New Brunswick, NJ, 08901-8551, USA.
- 28 Department of Political Science, Columbia University in the City of New York, New York, NY, 10027, USA.
- 29 Department of Psychology, University of Washington, Seattle, WA, 98195-1525, USA.
- 30 Institute of Evolutionary Biology School of Biological Sciences, The University of Edinburgh, Edinburgh, EH9 3JT, UK.
- 31 Weinberg College of Arts & Sciences Department of Statistics, Northwestern University, Evanston, IL, 60208, USA.
- 32 Epidemiology, Biostatistics and Prevention Institute (EBPI), University of Zurich, 8001, Zurich, Switzerland.
- 33 National University of Singapore, Singapore, 119077, Singapore.
- 34 Department of Methods and Statistics, Universiteit Utrecht, Utrecht, 3584 CH, The Netherlands.
- 35 School of Human Evolution and Social Change, Arizona State University, Tempe, AZ, 85287-2402, USA.
- 36 Department of Politics and Center for Statistics and Machine Learning, Princeton University, Princeton, NJ, 08544, USA.
- 37 Stanford University, Stanford, CA, 94305-5015, USA.
- 38 Departments of Medicine, of Health Research and Policy, of Biomedical Data Science, and of Statistics and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, 94305, USA.
- 39 Advanced Quantitative Methods, Social Research Methodology, Department of Education, Graduate School of Education & Information Studies, University of California, Los Angeles, CA, 90095-1521, USA.
- 40 Department of Life Sciences, Imperial College London, Ascot, SL5 7PY, UK.
- 41 Department of Earth System Science, Stanford, CA, 94305-4216, USA.
- 42 Department of Banking and Finance, University of Innsbruck and University of Gothenburg, Innsbruck, A-6020, Austria.
- 43 Department of Economics, Harvard University, Cambridge, MA, 02138, USA.
- 44 Department of Economics, University of Chicago, Chicago, IL, 60637, USA.
- 45 Department of Biostatistics, University of Michigan, Ann Arbor, MI, 48109-2029, USA.
- 46 Department of Political Science, University of Michigan, Ann Arbor, MI, 48109-1045, USA.
- 47 Department of History and Philosophy of Science, University of Pittsburgh, Pittsburgh, PA, 15260, USA.
- 48 Department of Psychology, University of Notre Dame, Notre Dame, IN, 46556, USA.
- 49 School of BioSciences, University of Melbourne, Parkville, VIC, 3010, Australia.
- 50 Haas School of Business, University of California at Berkeley, Berkeley, CA, 94720-1900A, USA.
- 51 Johns Hopkins University, Baltimore, MD, 21218, USA.
- 52 MRC Integrative Epidemiology Unit, University of Bristol, Bristol, BS8 1TU, UK.
- 53 UK Centre for Tobacco and Alcohol Studies, School of Experimental Psychology, University of Bristol, Bristol, BS8 1TU, UK.
- 54 Evolution & Ecology Research Centre and School of Biological, Earth and Environmental Sciences, University of New South Wales, Sydney, NSW, 2052, Australia.
- 55 Department of Government, Dartmouth College, Hanover, NH, 03755, USA.
- 56 Department of Biology, Whitman College, Walla Walla, WA, 99362, USA.
- 57 Department of Mathematics, University of Puerto Rico, Rio Piedras Campus, San Juan, PR, 00936-8377, Puerto Rico.
- 58 Department of Psychology, University of Milan-Bicocca, Milan, 20126, Italy.
- 59 Department of Cognitive Sciences, University of California, Irvine, CA, 92617, USA.
- 60 Université Paris Dauphine, 75016, Paris, France.
- 61 Department of Psychology, The University of British Columbia, Vancouver, V6T 1Z4, BC, Canada.
- 62 Department Psychology, Ludwig-Maximilians-University Munich, Leopoldstraβe 13, 80802, Munich, Germany.
- 63 Department of Statistics, Purdue University, West Lafayette, IN, 47907-2067, USA.
- 64 Department of Political Science, Washington University in St. Louis, St. Louis, MO, 63130-4899, USA.
- 65 Government Department, Harvard University, Cambridge, MA, 02138, USA.
- 66 Department of Psychology, Ohio State University, Columbus, OH, 43210, USA.
- 67 Department of Psychology, University of California, Davis, CA, 95616, USA.
- 68 Microsoft Research, 641 Avenue of the Americas, 7th Floor, New York, NY, 10011, USA.
- 69 Department of Sociology, Harvard University, Cambridge, MA, 02138, USA.
- 70 Department of Sociology, Princeton University, Princeton, NJ, 08544, USA.
- 71 Department of Sociology, Stanford University, Stanford, CA, 94305-2047, USA.
- 72 Department of Economics, Dartmouth College, Hanover, NH, 03755-3514, USA.
- 73 Department of Statistics, Texas A&M University, College Station, TX, 77843, USA. vejohnson@exchange.tamu.edu.
- PMID: 30980045
- DOI: 10.1038/s41562-017-0189-z
Item in Clipboard
Display options
Format
No abstract available
Comment in
-
Redefine or justify? Comments on the alpha debate.de Ruiter J. de Ruiter J. Psychon Bull Rev. 2019 Apr;26(2):430-433. doi: 10.3758/s13423-018-1523-9. Psychon Bull Rev. 2019. PMID: 30264238
-
Remove, rather than redefine, statistical significance.Amrhein V, Greenland S. Amrhein V, et al. Nat Hum Behav. 2018 Jan;2(1):4. doi: 10.1038/s41562-017-0224-0. Nat Hum Behav. 2018. PMID: 30980046 No abstract available.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources

