Comparative Usability Analysis and Parental Preferences of Three Web-Based Knowledge Translation Tools: Multimethod Study

Abstract

Background: Connecting parents to research evidence is known to improve health decision making. However, guidance on how to develop effective knowledge translation (KT) tools that synthesize child-health evidence into a form understandable by parents is lacking.

Objective: The aim of this study was to conduct a comparative usability analysis of three Web-based KT tools to identify differences in tool effectiveness, identify which format parents prefer, and better understand what factors affect usability for parents.

Methods: We evaluated a Cochrane plain language summary (PLS), Blogshot, and a Wikipedia page on a specific child-health topic (acute otitis media). A mixed method approach was used involving a knowledge test, written usability questionnaire, and a semistructured interview. Differences in knowledge and usability questionnaire scores for each of the KT tools were analyzed using Kruskal-Wallis tests, considering a critical significance value of P=.05. Thematic analysis was used to synthesize and identify common parent preferences among the semistructured interviews. Key elements parents wanted in a KT tool were derived through author consensus using questionnaire data and parent interviews.

Results: In total, 16 parents (9 female) with a mean age of 39.6 (SD 11.9) years completed the study. Parents preferred the Blogshot over the PLS and Wikipedia page (P=.002) and found the Blogshot to be the most aesthetic (P=.001) and easiest to use (P=.001). Knowledge questions and usability survey data also indicated that the Blogshot was the most preferred and effective KT tool at relaying information about the topic. Four key themes were derived from thematic analysis, describing elements parents valued in KT tools. Parents wanted tools that were (1) simple, (2) quick to access and use, and (3) trustworthy, and which (4) informed how to manage the condition. Out of the three KT tools assessed, Blogshots were the most preferred tool by parents and encompassed these four key elements.

Conclusions: It is important that child health evidence be available in formats accessible and understandable by parents to improve decision making, use of health care resources, and health outcomes. Further usability testing of different KT tools should be conducted involving broader populations and other conditions (eg, acute vs chronic) to generate guidelines to improve KT tools for parents.

Keywords: child health; comparative study; health information,consumer; internet; knowledge translation; parents.

Figure 1

Participant flow diagram. Participants (n=16) were randomized to 1 of 3 groups: Cochrane plain language summary (n=5), Cochrane Blogshot (n=5), or Wikipedia Page (n=6). Participants had unlimited time to read the knowledge translation (KT) tool. Participants were then given a knowledge test without being able to refer back to the KT tool. Participants then completed a written usability questionnaire and semistructured interview focusing on the KT tool randomly assigned. Finally, participants were asked to read the other two KT tools, and a second semistructured interview was completed focusing on comparing the three tools and broader participant preferences for KT tools. All participants completed the study. KT: knowledge translation; PLS: plain language summary.

Figure 2

The honeycomb model of user experience.

Figure 3

Plain language summary, Blogshot, and Wikipedia ranked in order of most (Rank 1) to least (Rank 3) in categories of aesthetics, ease of use, credibility, and general preference. Dot area indicates number of participants placing each tool at a given rank (N=16). Asterisk indicates statistically significant difference in rank order between groups determined via a Friedman test (P<.05). PLS: plain language summary.