Jargon and Readability in Plain Language Summaries of Health Research: Cross-Sectional Observational Study

Abstract

Background: The idea of making science more accessible to nonscientists has prompted health researchers to involve patients and the public more actively in their research. This sometimes involves writing a plain language summary (PLS), a short summary intended to make research findings accessible to nonspecialists. However, whether PLSs satisfy the basic requirements of accessible language is unclear.

Objective: We aimed to assess the readability and level of jargon in the PLSs of research funded by the largest national clinical research funder in Europe, the United Kingdom's National Institute for Health and Care Research (NIHR). We also aimed to assess whether readability and jargon were influenced by internal and external characteristics of research projects.

Methods: We downloaded the PLSs of all NIHR National Journals Library reports from mid-2014 to mid-2022 (N=1241) and analyzed them using the Flesch Reading Ease (FRE) formula and a jargon calculator (the De-Jargonizer). In our analysis, we included the following study characteristics of each PLS: research topic, funding program, project size, length, publication year, and readability and jargon scores of the original funding proposal.

Results: Readability scores ranged from 1.1 to 70.8, with an average FRE score of 39.0 (95% CI 38.4-39.7). Moreover, 2.8% (35/1241) of the PLSs had an FRE score classified as "plain English" or better; none had readability scores in line with the average reading age of the UK population. Jargon scores ranged from 76.4 to 99.3, with an average score of 91.7 (95% CI 91.5-91.9) and 21.7% (269/1241) of the PLSs had a jargon score suitable for general comprehension. Variables such as research topic, funding program, and project size significantly influenced readability and jargon scores. The biggest differences related to the original proposals: proposals with a PLS in their application that were in the 20% most readable were almost 3 times more likely to have a more readable final PLS (incidence rate ratio 2.88, 95% CI 1.86-4.45). Those with the 20% least jargon in the original application were more than 10 times as likely to have low levels of jargon in the final PLS (incidence rate ratio 13.87, 95% CI 5.17-37.2). There was no observable trend over time.

Conclusions: Most of the PLSs published in the NIHR's National Journals Library have poor readability due to their complexity and use of jargon. None were readable at a level in keeping with the average reading age of the UK population. There were significant variations in readability and jargon scores depending on the research topic, funding program, and other factors. Notably, the readability of the original funding proposal seemed to significantly impact the final report's readability. Ways of improving the accessibility of PLSs are needed, as is greater clarity over who and what they are for.

Keywords: accessibility; health communication; health literacy; health research; jargon; open science; patient and public involvement; plain language summary; public understanding of science; readability; reading; science communication.

Figure 1

Percentage of summaries with readability scores >50 (“fairly difficult to read” or better) and with jargon scores >95 (low level of jargon), by research topic, with 95% CIs. PLSs: plain language summaries.

Figure 2

Percentage of summaries with readability scores >50 (“fairly difficult to read” or better) and with jargon scores >95 (low level of jargon), by National Institute for Health and Care Research funding program, with 95% CIs. PLSs: plain language summaries.

Figure 3

Percentage of summaries with readability scores >50 (“fairly difficult to read” or better) and with jargon scores >95 (low level of jargon), by project size, with 95% CIs. PLSs: plain language summaries.

Figure 4

Percentage of summaries with readability scores >50 (“fairly difficult to read” or better) and with jargon scores >95 (low level of jargon), by readability scores or jargon scores (as appropriate: readability scores are categorized in relation to the readability score of the original funding proposal, and jargon scores are categorized in relation to the corresponding original jargon score) in original proposals, with 95% CIs. PLSs: plain language summaries.