Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Aug;32(8):910-917.
doi: 10.1002/pds.5624. Epub 2023 Apr 7.

Sensitivity and specificity in signal detection with the reporting odds ratio and the information component

Peter Trillenberg  1 , Andreas Sprenger  1   2 , Björn Machner  1
Affiliations

Sensitivity and specificity in signal detection with the reporting odds ratio and the information component

Peter Trillenberg et al. Pharmacoepidemiol Drug Saf. 2023 Aug.

Abstract

Purpose: As measures of association between an adverse drug reaction (ADR) and exposure to a drug the reporting odds ratio (ROR) and the information component (IC) can be used. We sought to test the reliability of signal detection with these.

Methods: We simulated ADR counts as binomially distributed random numbers for different expected ADR frequencies and theoretical reporting odds ratios (RORs). We then calculated the empirical IC and the empirical ROR and their confidence intervals. The rate of signals that was detected despite a theoretical ROR of 1 represented the false positive rate, and represented the sensitivity if the ROR was >1.

Results: For expected case counts below 1 the false positive rate oscillates from 0.01 to 0.1 even though 0.025 were intended. Even beyond expected case counts of 5 oscillations can cover a range of 0.018 to 0.035. The first n oscillations with the largest amplitude are eliminated if a minimum case count of n is required. To detect an ROR of 2 with a sensitivity of 0.8, a minimum of 12 expected ADRs are required. In contrast, 2 expected ADRs suffice to detect an ROR of 4.

Conclusion: Summaries of measures for disproportionality should include the expected number of cases in the group of interest if a signal was detected. If no signal was detected the sensitivity for the detection of a representative ROR or the minimum ROR that could be detected with probability 0.8 should be reported.

Keywords: ADR; disproportionality analysis.

PubMed Disclaimer

References

REFERENCES

    1. Faillie JL. Case-non-case studies: principle, methods, bias and interpretation. Therapie. 2019;74(2):225-232.
    1. Gould AL. Practical pharmacovigilance analysis strategies. Pharmacoepidemiol Drug Saf. 2003;12(7):559-574.
    1. Andreaggi CA, Novak EA, Mirabile ME, et al. Safety concerns reported by consumers, manufacturers and healthcare professionals: a detailed evaluation of opioid-related adverse drug reactions in the FDA database over 15 years. Pharmacoepidemiol Drug Saf. 2020;29(12):1627-1635.
    1. Guo Z, Ding Y, Wang M, Liu J, Zhai Q, Du Q. Safety of trastuzumab deruxtecan: a meta-analysis and pharmacovigilance study. J Clin Pharm Ther. 2022;47(11):1837-1844.
    1. Evans SJ, Waller PC, Davis S. Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiol Drug Saf. 2001;10(6):483-486.

LinkOut - more resources