Imputing response rates from means and standard deviations in meta-analyses

Abstract

The principle of intention-to-treat analysis must be strictly applied to both individual randomized controlled trial and meta-analysis but, in doing so, would involve imputation of some missing data. There is little literature on how to perform this in the case of meta-analysis. For dichotomous outcome measures, one possible strategy is to carry out a sensitivity analysis based on the so-called best case/worst case analyses. For continuous outcomes, it may be possible to achieve this if we can dichotomise the continuous outcomes. Here, we empirically examined the appropriateness of converting continuous outcomes (expressed as mean+/-SD) into dichotomous outcomes (expressed as response rates) in four completed meta-analyses of depression and anxiety, assuming normal distribution of the continuous outcome measures. The agreement between the actually observed versus the imputed raw numbers of responders was indicated by an intraclass correlation coefficient of 0.97 (95% confidence interval 0.95-0.98). The pooled relative risks of the four meta-analyses based on the imputed values were virtually identical to those based on the actually observed values. When individual trials report the means+/-SDs of their outcome measures but fail to report response rates, it may therefore be possible to impute the response rates based on the means+/-SDs, and then submit the meta-analysis to worst case/best case analyses. This would allow a more robust and clinically interpretable estimation of the true, underlying treatment effect to be made.