Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
[Preprint]. 2024 Jan 16:2024.01.15.575636.
doi: 10.1101/2024.01.15.575636.

Do organisms need an impact factor? Citations of key biological resources including model organisms reveal usage patterns and impact

Agata Piekniewska  1 , Nathan Anderson  1 , Martijn Roelandse  2 , K C Kent Lloyd  3 , Ian Korf  4 , S Randal Voss  5 , Giovanni de Castro  6 , Diogo M Magnani  6 , Zoltan Varga  7 , Christina James-Zorn  8 , Marko Horb  9 , Jeffery S Grethe  10 , Anita Bandrowski  11
Affiliations

Do organisms need an impact factor? Citations of key biological resources including model organisms reveal usage patterns and impact

Agata Piekniewska et al. bioRxiv. .

Update in

Abstract

Research resources like transgenic animals and antibodies are the workhorses of biomedicine, enabling investigators to relatively easily study specific disease conditions. As key biological resources, transgenic animals and antibodies are often validated, maintained, and distributed from university based stock centers. As these centers heavily rely largely on grant funding, it is critical that they are cited by investigators so that usage can be tracked. However, unlike systems for tracking the impact of papers, the conventions and systems for tracking key resource usage and impact lag behind. Previous studies have shown that about 50% of the resources are not findable, making the studies they are supporting irreproducible, but also makes tracking resources difficult. The RRID project is filling this gap by working with journals and resource providers to improve citation practices and to track the usage of these key resources. Here, we reviewed 10 years of citation practices for five university based stock centers, characterizing each reference into two broad categories: findable (authors could use the RRID, stock number, or full name) and not findable (authors could use a nickname or a common name that is not unique to the resource). The data revealed that when stock centers asked their communities to cite resources by RRID, in addition to helping stock centers more easily track resource usage by increasing the number of RRID papers, authors shifted from citing resources predominantly by nickname (~50% of the time) to citing them by one of the findable categories (~85%) in a matter of several years. In the case of one stock center, the MMRRC, the improvement in findability is also associated with improvements in the adherence to NIH rigor criteria, as determined by a significant increase in the Rigor and Transparency Index for studies using MMRRC mice. From this data, it was not possible to determine whether outreach to authors or changes to stock center websites drove better citation practices, but findability of research resources and rigor adherence was improved.

PubMed Disclaimer

Conflict of interest statement

Agata Piekniewska: AP is an analyst at SciCrunch Inc Nathan Anderson: NA is a curator at SciCrunch Inc Martijn Roelandse: MR serves as an independent contractor for SciCrunch. K. C. Kent Lloyd: None Ian Korf: None S. Randal Voss: None Giovanni de Castro: None Diogo M. Magnani: None Zoltan Varga: None Christina James-Zorn: None Marko Horb: None Jeffery S. Grethe: Part of this work was supported by the University of California, San Diego, Center for Research in Biological Systems and grants from NIH (Award #U24DK097771). Dr. Grethe has an equity interest in SciCrunch, Inc., a company that may potentially benefit from the research results. The terms of this arrangement have been reviewed and approved by the University of California, San Diego in accordance with its conflict of interest policies. Anita Bandrowski: Dr. Bandrowski is a co-founder and current CEO of SciCrunch, Inc., a company that may potentially benefit from the research results. The terms of this arrangement have been reviewed and approved by the University of California, San Diego in accordance with its conflict of interest policies.

Figures

Figure 1:
Figure 1:
A summary of a typical stock webpage for each stock center
Figure 1:
Figure 1:
A summary of a typical stock webpage for each stock center
Figure 2:
Figure 2:
The proportion of citations for each stock center by type
Figure 2:
Figure 2:
The proportion of citations for each stock center by type
Figure 3:
Figure 3:
Citations of research resources over time. Notable dates: Feb 1 2014 start of the RRID project (25 neuroscience journals), 2016 eLife and Cell Press joins the RRID initiative (Cell press does so by deploying the STAR tables), 2018 Nature joins the RRID initiative, 2016 MMRRC begins displaying RRIDs with copy function on website, 2017 NXR begins a campaign to ask xenopus community to use RRIDs, 2017 AGSC begins outreach campaign within salamander use community, ZIRC, 2020 NHPRR registers all antibodies to obtain RRIDs and begins campaign with users of the resource.
Figure 3:
Figure 3:
Citations of research resources over time. Notable dates: Feb 1 2014 start of the RRID project (25 neuroscience journals), 2016 eLife and Cell Press joins the RRID initiative (Cell press does so by deploying the STAR tables), 2018 Nature joins the RRID initiative, 2016 MMRRC begins displaying RRIDs with copy function on website, 2017 NXR begins a campaign to ask xenopus community to use RRIDs, 2017 AGSC begins outreach campaign within salamander use community, ZIRC, 2020 NHPRR registers all antibodies to obtain RRIDs and begins campaign with users of the resource.
Figure 3:
Figure 3:
Citations of research resources over time. Notable dates: Feb 1 2014 start of the RRID project (25 neuroscience journals), 2016 eLife and Cell Press joins the RRID initiative (Cell press does so by deploying the STAR tables), 2018 Nature joins the RRID initiative, 2016 MMRRC begins displaying RRIDs with copy function on website, 2017 NXR begins a campaign to ask xenopus community to use RRIDs, 2017 AGSC begins outreach campaign within salamander use community, ZIRC, 2020 NHPRR registers all antibodies to obtain RRIDs and begins campaign with users of the resource.
Figure 3:
Figure 3:
Citations of research resources over time. Notable dates: Feb 1 2014 start of the RRID project (25 neuroscience journals), 2016 eLife and Cell Press joins the RRID initiative (Cell press does so by deploying the STAR tables), 2018 Nature joins the RRID initiative, 2016 MMRRC begins displaying RRIDs with copy function on website, 2017 NXR begins a campaign to ask xenopus community to use RRIDs, 2017 AGSC begins outreach campaign within salamander use community, ZIRC, 2020 NHPRR registers all antibodies to obtain RRIDs and begins campaign with users of the resource.
Figure 4:
Figure 4:
The Rigor and Transparency Index a comparison of all papers published in a given year, vs the papers that refer to one of the stock centers analyzed.
See this image and copyright information in PMC

References

    1. Bandrowski A, Brush M, Grethe JS, Haendel MA, Kennedy DN, Hill S, Hof PR, Martone ME, Pols M, Tan S, Washington N, Zudilova-Seinstra E, Vasilevsky N; Resource Identification Initiative Members are listed here: https://www.force11.org/node/4463/members. The Resource Identification Initiative: A cultural shift in publishing. F1000Res. 2015. May 29;4:134. doi: 10.12688/f1000research.6555.2. - DOI - PMC - PubMed
    1. Bandrowski A. A decade of GigaScience: What can be learned from half a million RRIDs in the scientific literature? Gigascience. 2022. Jun 14;11:giac058. doi: 10.1093/gigascience/giac058. - DOI - PMC - PubMed
    1. Bergen WG. Pigs (Sus Scrofa) in Biomedical Research. Adv Exp Med Biol. 2022;1354:335–343. doi: 10.1007/978-3-030-85686-1_17. - DOI - PubMed
    1. Eckmann P, Bandrowski A (2023) PreprintMatch: A tool for preprint to publication detection shows global inequities in scientific publication. PLoS ONE 18(3): e0281659. 10.1371/journal.pone.0281659 - DOI - PMC - PubMed
    1. Errington TM, Denis A, Perfito N, Iorns E, Nosek BA. Challenges for assessing replicability in preclinical cancer biology. Elife. 2021. Dec 7;10:e67995. doi: 10.7554/eLife.67995. - DOI - PMC - PubMed

Publication types