Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Jul;12(7):953-962.
doi: 10.1002/psp4.12965. Epub 2023 Apr 24.

Synthetic Model Combination: A new machine-learning method for pharmacometric model ensembling

Affiliations

Synthetic Model Combination: A new machine-learning method for pharmacometric model ensembling

Alexander Chan et al. CPT Pharmacometrics Syst Pharmacol. 2023 Jul.

Abstract

When aiming to make predictions over targets in the pharmacological setting, a data-focused approach aims to learn models based on a collection of labeled examples. Unfortunately, data sharing is not always possible, and this can result in many different models trained on disparate populations, leading to the natural question of how best to use and combine them when making a new prediction. Previous work has focused on global model selection or ensembling, with the result of a single final model across the feature space. Machine-learning models perform notoriously poorly on data outside their training domain, however, due to a problem known as covariate shift, and so we argue that when ensembling models the weightings for individual instances must reflect their respective domains-in other words, models that are more likely to have seen information on that instance should have more attention paid to them. We introduce a method for such an instance-wise ensembling of models called Synthetic Model Combination (SMC), including a novel representation learning step for handling sparse high-dimensional domains. We demonstrate the use of SMC on an example with dosing predictions for vancomycin, although emphasize the applicability of the method to any scenario involving the use of multiple models.

PubMed Disclaimer

Conflict of interest statement

The authors declared no competing interests for this work.

Figures

FIGURE 1
FIGURE 1
Instance‐wise ensembles. (a) Here, we represent the density of the training features for three separate models: M1, M2, and M3. Given new test points A, B, and C, we need to construct predictions from these models. A is well‐represented by both M2 and M3, whereas B only has significant density under M3. C looks like none of the models will be able to make confident predictions. (b) Different models are useful for new patients. Population pharmacokinetic models are often trained on certain demographic groups given the studies that are designed for data collection. For a new patient who does not necessarily fit into one of the existing demographics, different models may be more or less relevant and accurate. Naive ensembles ignore this fact and always incorporate evenly the predictions of each model, SMC on the other hand aims to up‐weight the models that would appear to be more relevant. SMC, Synthetic Model Combination.
FIGURE 2
FIGURE 2
Synthetic Model Combination training algorithm. (a) Algorithm outlining the main steps in training for SMC. (b) Inference flow diagram. As a new case comes in, the first step is to calculate all of the individual models' predictions, using NONMEM, for example. Then, like with any model averaging algorithm the weights must be calculated. Performance‐based model averaging methods have a set of weights independent of the new case, whereas SMC maps the new case features to a latent space that is then used to calculate individual weights for that case. BMA, Bayesian Model Averaging; SMC, Synthetic Model Combination.
FIGURE 3
FIGURE 3
Methods based on varying information. A selection of methods from the spectrum of information available to a practitioner. SMC lies quite far toward the little information end, aiming to only take use of some demographic information from each of the models and not require any labeled training points. SMC, Synthetic Model Combination.

References

    1. Powell JR, Cook J, Wang Y, Peck RW, Weiner D. Drug dosing recommendations for all patients: a roadmap for change. Clin Pharm Ther. 2021;109:65‐72. - PMC - PubMed
    1. The Drug Disease Model Resources Foundation (DDMoRe) . https://www.ddmore.foundation. Accessed 12 August 2022.
    1. Vivli – Center for Global Clinical Research Data . https://vivli.org. Accessed 16 August 2022.
    1. Broeker A, Nardecchia M, Klinker KP, et al. Towards precision dosing of vancomycin: a systematic evaluation of pharmacometric models for Bayesian forecasting. Clin Microbiol Infect. 2019. Oct 1;25(10):1286‐e1. - PubMed
    1. Raftery AE, Madigan D, Hoeting JA. Bayesian model averaging for linear regression models. J Am Stat Assoc. 1997;92(437):179‐191.