What's in a number? Issues in providing evidence of impact and quality of research(ers)

Abstract

One of the challenges facing qualitative researchers in a climate in which audit culture has permeated many facets of the institutions in which they research is how to establish the impact and quality of their research. When examining track records, granting institutions place significant emphasis on publication performance. Although the quality and impact of publications have traditionally been assessed by peer review, there is currently a global trend toward the development, refinement, and increased use of quantitative metrics, particularly citation analysis and journal impact factor. In this article, the authors share their experience of using the metrics citation analysis and journal impact factor in the preparation of an application for funding. Their aim is twofold: to raise awareness about potential issues in the practical application of these metrics; and to offer critique about and, they hope, "quality" to the writing and rhetoric concerning how to measure publication impact and quality.