Manuscript Review at the Journal of Pediatric Gastroenterology and Nutrition: The Impact of Reviewers on Editor Decisions
- PMID: 34173794
- DOI: 10.1097/MPG.0000000000003208
Manuscript Review at the Journal of Pediatric Gastroenterology and Nutrition: The Impact of Reviewers on Editor Decisions
Abstract
Objective: Given the importance of scholarly work in academic medicine, better understanding of the manuscript review process (MRP) is useful for authors, reviewers, and editorial boards. We aim to describe the MRP at the Journal of Pediatric Gastroenterology and Nutrition (JPGN), assess the correlation between editor decisions and reviewer recommendations, and provide transparency to this process.
Methods: All manuscripts submitted in 2018 to JPGN were included in this analysis. Data included reviewers' manuscript scores and recommendations, time spent on each review by reviewers, the editor's rating of the reviewers' reviews, the editor's first decision, and final outcome. Data were collated using the JPGN manuscript submission website, Editorial Manager.
Results: 1023 manuscripts were submitted to JPGN in 2018 and included in this analysis. Of these, 486 manuscripts had at least two peer reviewers. The recommendations of the two reviewers were in agreement 43% of the time. Intra-class correlation (ICC) between the two reviewers suggests moderate agreement (ICC = 0.40). When both reviewers agreed to Not Reject (289/486), the editor agreed in 93% of cases (269/289). When both reviewers agreed to Reject (55/486), the editor agreed 100% of the time (55/55). The reviewers disagreed in about one-third of submissions (142/486), and the editor recommended to Reject in two-thirds of these cases (95/142). Overall, inter-reviewer agreement strongly correlated with the editor's initial decision (P < 0.001).
Conclusions: The editor most often agreed with reviewers' assessments when there was concordance between the two reviewers' recommendations. About a third of peer reviews result in discordant recommendations between the two reviewers.
Copyright © 2021 by European Society for Pediatric Gastroenterology, Hepatology, and Nutrition and North American Society for Pediatric Gastroenterology, Hepatology, and Nutrition.
Conflict of interest statement
Conflicts of Interest: Current and past editors-in-chief for the North American and European editorial offices are authors on this work.
Similar articles
-
Editorial peer reviewers' recommendations at a general medical journal: are they reliable and do editors care?PLoS One. 2010 Apr 8;5(4):e10072. doi: 10.1371/journal.pone.0010072. PLoS One. 2010. PMID: 20386704 Free PMC article.
-
Reviewer selection biases editorial decisions on manuscripts.J Neurochem. 2018 Jan 27. doi: 10.1111/jnc.14314. Online ahead of print. J Neurochem. 2018. PMID: 29377133
-
A peek behind the curtain: peer review and editorial decision making at Stroke.Ann Neurol. 2014 Aug;76(2):151-8. doi: 10.1002/ana.24218. Epub 2014 Jul 16. Ann Neurol. 2014. PMID: 25043350
-
Assessment of variables that influence agreement between reviewers for Foot & Ankle International.Foot Ankle Surg. 2020 Jul;26(5):573-579. doi: 10.1016/j.fas.2019.07.007. Epub 2019 Jul 31. Foot Ankle Surg. 2020. PMID: 31416682 Review.
-
A primer: peer review process for Advances in Physiology Education.Adv Physiol Educ. 2024 Dec 1;48(4):932-935. doi: 10.1152/advan.00127.2024. Epub 2024 Sep 5. Adv Physiol Educ. 2024. PMID: 39236106 Review.
Cited by
-
Librarians and information specialists as methodological peer-reviewers: a case-study of the International Journal of Health Governance.Res Integr Peer Rev. 2024 Jan 19;9(1):1. doi: 10.1186/s41073-023-00142-4. Res Integr Peer Rev. 2024. PMID: 38238865 Free PMC article.
References
-
- Björk B-C. Acceptance rates of scholarly peer-reviewed journals: a literature survey. El profesional de la información 2019; 28:e280407 https://doi.org/10.3145/epi.2019.jul.07 - DOI
-
- Lowe NK. Peer review in scientific scholarship. J Obstet Gynecol Neonatal Nurs 2017; 46:799–800.
-
- Manchikanti L, Kaye AD, Boswell MV, et al. Medical journal peer review: process and bias. Pain Physician 2015; 18:E1–E14.
-
- Glonti K, Cauchi D, Cobo E, et al. A scoping review on the roles and tasks of peer reviewers in the manuscript review process in biomedical journals. BMC Med 2019; 17:118.
-
- Spier R. The history of the peer-review process. Trends Biotechnol 2002; 20:357–358.
MeSH terms
LinkOut - more resources
Full Text Sources