Optimizing Readability and Format of Plain Language Summaries for Medical Research Articles: Cross-sectional Survey Study

Abstract

Background: Plain language summaries (PLSs) are intended to provide readers with a clear, nontechnical, and easily understandable overview of medical and scientific literature; however, audience preferences for specific PLS formats have yet to be fully explored.

Objective: This study aims to evaluate the preferred readability level and format for PLSs of medical research articles of different disease states via a web-based survey of audiences of different age groups.

Methods: Articles describing phase III clinical trials published in top-level, peer-reviewed journals between May 2016 and May 2018 were identified for 3 chronic disease states representing a range of adult patient age groups: (1) psoriasis, a skin disease representative of younger patients; (2) multiple sclerosis (MS), a neurological disease representative of middle-aged patients; and (3) rheumatoid arthritis (RA), a painful joint disease representative of older patients. Four PLSs were developed for each research article, of which 3 were text-only summaries (written with high, medium, and low complexity) and 1 was an infographic. To evaluate each of the 4 PLS formats, a 20-question open survey (specific to one of the 3 diseases) was sent to a representative sample selected via UK-based patient association websites, Twitter, and Facebook patient groups. A weighted-average calculation was applied to respondents' ranked preferences for each PLS format.

Results: For all 3 articles, the weighted-average preference scores showed that infographic (psoriasis 2.91, MS 2.71, and RA 2.78) and medium-complexity text-based PLS (reading age 14-17 years, US Grade 9-11; psoriasis 2.90; MS 2.47; RA 2.77) were the two most preferred PLS formats.

Conclusions: Audience preferences should be accounted for when preparing PLSs to accompany peer-reviewed original research articles. Oversimplified text can be viewed negatively, and graphical summaries or medium-complexity text-based summaries appear to be the most popular.

Plain language summary: Patients and caregivers should have the chance to read about medical research in a format they can understand. However, we do not know much about the formats that people with different illnesses or ages prefer. Researchers wanted to find out more about this. They selected 3 medical articles about illnesses that affect different age groups: psoriasis (younger patients), multiple sclerosis (middle-aged patients), and rheumatoid arthritis (older patients). They created 4 summaries of each article. One was a graphical summary, and the other 3 were words-only summaries of high, medium, and low complexity. Then, the researchers posted surveys on UK patient group websites and Facebook patient groups to ask people what they thought of the summaries. The surveys were taken by 167 people. These people were patients with psoriasis, multiple sclerosis, or rheumatoid arthritis, or their caregivers. Most were women, and about half had a university degree. For each illness, most people preferred the graphical summary. Among the word-only summaries, most people preferred the medium-complexity wording written for a reading age of 14 to 17 years. People felt that the graphical and medium-complexity summaries were clear and concise, while the others used jargon or were too simple. Authors of medical articles should remember these results when writing summaries for patients. More research is needed about the preferences of other people, such as those with other illnesses. (See Multimedia Appendix 1 for the graphical summary of the plain language summary.).

Keywords: biomedical research; health literacy; multiple sclerosis; plain language summary; psoriasis; rheumatoid arthritis.

Figure 1

Examples of various PLS formats used. (A) High-complexity text-only PLS, (B) medium-complexity text-only PLS, (C) low-complexity text-only PLS, and (D) infographic PLS format. Text complexity in each case was determined using an automated readability checker from Readabilityformulas website [24], using text from the main body only (ie, excluding title, authors, and funding statements) and omitting any parenthetical data. Full versions of the infographics analyzed are shown in Multimedia Appendices 1-3. PLS: plain language summary.

Figure 2

Demographics of survey respondents across different chronic disease states.

Figure 3

Respondents’ first-choice preference of PLS format for the different disease states. PLS: plain language summary.

Figure 4

Weighted mean scores for preferred PLS format. PLS: plain language summary.