Predicting citation impact from altmetric attention in clinical and translational research: Do big splashes lead to ripple effects?

Abstract

Publications are commonly used to evaluate the productivity and impact of research programs. Traditional metrics examine publication impact through slowly accumulating academic citations. "Altmetrics" are a new way to describe early publication influence in nonacademic media/community spheres (news, tweets, and blogs). Articles with significant altmetric attention make a big splash of immediate impact, whereas papers with high rates of academic citation reflect ripple effects of influence over time. Past research has found weak associations between altmetrics and academic citations. However, no previous research has focused on clinical/translational research, which aims to translate scientific discoveries to public use. Further, no previous research has assessed the relationship between altmetrics and modern citation impact factors like the National Institutes of Health (NIH)'s Relative Citation Ratio (RCR). It is also unclear whether publication in journals with higher journal impact factors (JIFs) may drive both public attention and academic impact. We investigated whether early altmetric indicators of splash predict citation ripples, beyond the effect of the JIF. For a portfolio of 2188 publications supported by the NIH's Georgia Clinical and Translational Science Alliance from 2007-2020, we collected 2020 Altmetric Attention Scores (AAS), 2020 JIFs, and 2021 RCRs. All three were significantly correlated with one another. Regression analyses revealed that AAS significantly predicts later RCR, controlling for JIF and publication year. Findings indicate that in clinical/translational science, articles that make a big splash of altmetric attention have ripple effects through increased citation influence, which is not entirely due to publication in higher impact journals. Altmetric attention may be a useful early indicator of eventual influence and potential for translational advancement.

FIGURE 1

Final regression model results for relationships among publication year, 2020 Journal Impact Factor (JIF), 2020 Altmetric Attention Score (AAS), and 2021 Relative Citation Ratio (RCR), in the Georgia CTSA‐supported publication portfolio; ^* p < 0.001