Application of machine learning models to animal health pharmacovigilance: A proof-of-concept study

Abstract

Machine learning (ML) models were applied to pharmacovigilance (PV) data in a two-component proof-of-concept study. PV data were partitioned into Training, Validation, and Holdout datasets for model training and selection. During the first component ML models were challenged to identify factors in individual case safety reports (ICSRs) involving spinosad and neurological and ocular clinical signs. The target feature for the models were these clinical signs that were disproportionately reported for spinosad. The endpoints were normalized coefficient values representing the relationship between the target feature and ICSR free text fields. The deployed model accurately identified the risk factors "demodectic," "demodicosis," and "ivomec." In the second component, the ML models were trained to identify high quality and complete ICSRs free of confounders. The deployed model was presented with an external Test dataset of six ICSRs, one that was complete, of high quality, and devoid of confounders, and five that were not. The endpoints were model-generated probabilities for the ICSRs. The deployed ML model accurately identified the ICSR of interest with a greater than 10-fold higher probability score. Although narrow in scope, the study supports further investigation and potential application of ML models to animal health PV data.

Keywords: analytics use case; animal health; machine learning; pharmacovigilance; predictive use case.