The Reliability and Quality of YouTube Videos as a Source of Public Health Information Regarding COVID-19 Vaccination: Cross-sectional Study

Abstract

Background: Recent emergency authorization and rollout of COVID-19 vaccines by regulatory bodies has generated global attention. As the most popular video-sharing platform globally, YouTube is a potent medium for the dissemination of key public health information. Understanding the nature of available content regarding COVID-19 vaccination on this widely used platform is of substantial public health interest.

Objective: This study aimed to evaluate the reliability and quality of information on COVID-19 vaccination in YouTube videos.

Methods: In this cross-sectional study, the phrases "coronavirus vaccine" and "COVID-19 vaccine" were searched on the UK version of YouTube on December 10, 2020. The 200 most viewed videos of each search were extracted and screened for relevance and English language. Video content and characteristics were extracted and independently rated against Health on the Net Foundation Code of Conduct and DISCERN quality criteria for consumer health information by 2 authors.

Results: Forty-eight videos, with a combined total view count of 30,100,561, were included in the analysis. Topics addressed comprised the following: vaccine science (n=18, 58%), vaccine trials (n=28, 58%), side effects (n=23, 48%), efficacy (n=17, 35%), and manufacturing (n=8, 17%). Ten (21%) videos encouraged continued public health measures. Only 2 (4.2%) videos made nonfactual claims. The content of 47 (98%) videos was scored to have low (n=27, 56%) or moderate (n=20, 42%) adherence to Health on the Net Foundation Code of Conduct principles. Median overall DISCERN score per channel type ranged from 40.3 (IQR 34.8-47.0) to 64.3 (IQR 58.5-66.3). Educational channels produced by both medical and nonmedical professionals achieved significantly higher DISCERN scores than those of other categories. The highest median DISCERN scores were achieved by educational videos produced by medical professionals (64.3, IQR 58.5-66.3) and the lowest median scores by independent users (18, IQR 18-20).

Conclusions: The overall quality and reliability of information on COVID-19 vaccines on YouTube remains poor. Videos produced by educational channels, especially by medical professionals, were higher in quality and reliability than those produced by other sources, including health-related organizations. Collaboration between health-related organizations and established medical and educational YouTube content producers provides an opportunity for the dissemination of high-quality information on COVID-19 vaccination. Such collaboration holds potential as a rapidly implementable public health intervention aiming to engage a wide audience and increase public vaccination awareness and knowledge.

Keywords: COVID-19; YouTube; infodemiology; public health; quality; reliability; social media; vaccination; vaccine; video; web-based health information.

Figure 1

Flow diagram for the results for searches on COVID-19 vaccine–related videos on YouTube and the video selection process for inclusion in the study. The 2 searches were performed on December 10, 2020.