Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2018 Nov;89(6):1996-2009.
doi: 10.1111/cdev.13079. Epub 2018 May 7.

Promoting Replicability in Developmental Research Through Meta-analyses: Insights From Language Acquisition Research

Christina Bergmann  1   2 , Sho Tsuji  1   3 , Page E Piccinini  1 , Molly L Lewis  4   5 , Mika Braginsky  6 , Michael C Frank  7 , Alejandrina Cristia  1
Affiliations
Review

Promoting Replicability in Developmental Research Through Meta-analyses: Insights From Language Acquisition Research

Christina Bergmann et al. Child Dev. 2018 Nov.

Abstract

Previous work suggests that key factors for replicability, a necessary feature for theory building, include statistical power and appropriate research planning. These factors are examined by analyzing a collection of 12 standardized meta-analyses on language development between birth and 5 years. With a median effect size of Cohen's d = .45 and typical sample size of 18 participants, most research is underpowered (range = 6%-99%; median = 44%); and calculating power based on seminal publications is not a suitable strategy. Method choice can be improved, as shown in analyses on exclusion rates and effect size as a function of method. The article ends with a discussion on how to increase replicability in both language acquisition studies specifically and developmental research more generally.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Exclusion rate in percent by different methods. CF = central fixation; CondHT = conditioned headturn; FC = forced choice; HPP = headturn preference procedure; LwL = looking while listening; SA = stimulus alternation. Each point indicates a single study.
Figure 2
Figure 2
Effect size by different methods. CF = central fixation; CondHT = conditioned headturn; FC = forced choice; HPP = headturn preference procedure; LwL = looking while listening; SA = stimulus alternation. Each point indicates a single study.
Figure 3
Figure 3
For every meta‐analysis observed, effect size per study plotted against sample size. Each point indicates a single study.
See this image and copyright information in PMC

References

    1. American Psychological Association . (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
    1. Begg, C. B. , & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50, 1088–1101. 10.2307/2533446 - DOI - PubMed
    1. Bergmann, C. , & Cristia, A. (2016). Development of infants’ segmentation of words from native speech: A meta‐analytic approach. Developmental Science, 19, 901–917. 10.1111/desc.12341 - DOI - PubMed
    1. Bergmann, C. , Tsuji, S. , & Cristia, A. (2017). Top‐down versus bottom‐up theories of phonological acquisition: A big data approach. Proceedings of Interspeech, 2017, 2013–2016. 10.21437/Interspeech.2017-1443 - DOI
    1. Black, A. , & Bergmann, C. (2017). Quantifying infants’ statistical word segmentation: A meta‐analysis In Gunzelmann G., Howes A., Tenbrink T., & Davelaar E. (Eds.), Proceedings of the 39th annual conference of the Cognitive Science Society (pp. 124–129). Austin, TX: Cognitive Science Society.

LinkOut - more resources