Evolution of Cross-Sectional Survey Protocol Quality Over Time: A Case Series of Index U.S. REMS Knowledge Survey Protocols (2007-2020)
- PMID: 37697204
- DOI: 10.1007/s40264-023-01344-x
Evolution of Cross-Sectional Survey Protocol Quality Over Time: A Case Series of Index U.S. REMS Knowledge Survey Protocols (2007-2020)
Abstract
Introduction: Surveys are commonly used to assess effectiveness of FDA-required risk evaluation and mitigation strategies (REMS) for drugs and biologics in the United States.
Objective: The aim of this study was to assess the scientific rigor of REMS knowledge survey protocols submitted to FDA and compare protocols before and after FDA's 2012 public workshop and 2019 draft guidance.
Method: A content analysis of index survey protocols submitted to FDA (2007-2020) for single-product REMS with elements to assure safe use (39 programs, 78 protocols) was conducted. Each protocol was scored against 52 core essential elements (CEE), abstracted from FDA's guidance and grouped into six domains: study objective (n = 5), study design (n = 18), survey instrument (n = 9), participant recruitment (n = 7), survey administration (n = 9), and statistical analysis plan (n = 4). Scores were collected by time periods: (A) Oct 2007 to Jul 2012; (B) Aug 2012 to Feb 2019; (C) Mar 2019 to Dec 2020; and compared using logistic generalized linear mixed models adjusting for domain, survey population, vendor, program, and protocol.
Results: There were 30 (38.5%), 40 (51.3%), and 8 (10.3%) protocols submitted in time period A, B, and C, respectively. Adjusted marginal means of elements present (on the probability scale) by time period were 0.5816 (SE = 0.0242), 0.6429 (SE = 0.0229), and 0.7543 (SE = 0.0394). The likelihood of missing a CEE declined over time (adjusted p-value = 0.0094, time period A vs C). The statistical analysis plan domain had the most improvement; study design remained the weakest domain with the scientific justification CEE particularly underrepresented.
Conclusion: The rigor of REMS knowledge survey protocols improved over time consistent with FDA's efforts to advance regulatory science, but gaps remain.
© 2023. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.
Similar articles
-
Adaptation for Regulatory Application: A Content Analysis of FDA Risk Evaluation and Mitigation Strategies Assessment Plans (2014-2018) Using RE-AIM.Front Public Health. 2020 Feb 25;8:43. doi: 10.3389/fpubh.2020.00043. eCollection 2020. Front Public Health. 2020. PMID: 32158741 Free PMC article.
-
The US Food and Drug Administration's Risk Evaluation and Mitigation Strategy (REMS) Program - Current Status and Future Direction.Clin Ther. 2016 Dec;38(12):2526-2532. doi: 10.1016/j.clinthera.2016.11.007. Epub 2016 Nov 30. Clin Ther. 2016. PMID: 27914632
-
Pragmatic applications of implementation science frameworks to regulatory science: an assessment of FDA Risk Evaluation and Mitigation Strategies (REMS) (2014-2018).BMC Health Serv Res. 2021 Aug 6;21(1):779. doi: 10.1186/s12913-021-06808-3. BMC Health Serv Res. 2021. PMID: 34362367 Free PMC article.
-
Evaluation of the Extended-Release/Long-Acting Opioid Prescribing Risk Evaluation and Mitigation Strategy Program by the US Food and Drug Administration: A Review.JAMA Intern Med. 2020 Feb 1;180(2):301-309. doi: 10.1001/jamainternmed.2019.5459. JAMA Intern Med. 2020. PMID: 31886822 Review.
-
Pharmaceutical industry perspective on risk evaluation and mitigation strategies: manufacturer take heed.Expert Opin Drug Saf. 2012 Mar;11(2):299-314. doi: 10.1517/14740338.2012.650689. Epub 2012 Jan 10. Expert Opin Drug Saf. 2012. PMID: 22233294 Review.
Cited by
-
Using Mixed Methods to Evaluate Risk Minimisation Programs in Europe and the USA: An Innovative Blueprint.Drug Saf. 2025 Jul;48(7):821-838. doi: 10.1007/s40264-025-01533-w. Epub 2025 Mar 12. Drug Saf. 2025. PMID: 40075031 Free PMC article.
References
-
- United States Food and Drug Administration, “What We Do,” 2018. https://www.fda.gov/about-fda/what-we-do#missionhttps://www.fda.gov/abou... . Accessed 01 Feb 2023.
-
- United States Food and Drug Administration, “PDUFA REAUTHORIZATION PERFORMANCE GOALS AND PROCEDURES FISCAL YEARS 2023 THROUGH 2027,” 2022. [Online]. Available: https://www.fda.gov/media/151712/download . Accessed 01 Feb 2023.
-
- United States Food and Drug Administration, “Advancing Regulatory Science at FDA: FOCUS AREAS OF REGULATORY SCIENCE (FARS),” 2022. [Online]. Available: https://www.fda.gov/media/161381/download#:~:text=we%20identified%20prio... . Accessed 01 Feb 2023.
-
- United States Food and Drug Administration, “Risk Evaluation and Mitigation Strategies | REMS,” 2021. https://www.fda.gov/drugs/drug-safety-and-availability/risk-evaluation-a... . Accessed 01 Feb 2023.
-
- United States Food and Drug Administration, “FDA’s Role in Managing Medication Risks,” 2018. https://www.fda.gov/drugs/risk-evaluation-and-mitigation-strategies-rems... . Accessed 01 Feb 2023.
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Research Materials