Volume 12 Supplement 1
Modelling multiple outcomes to improve the detection of causal mediation effects in complex intervention trials
© Casey et al; licensee BioMed Central Ltd. 2011
Published: 13 December 2011
In a trial to increase physical activity in sedentary adults, there was no evidence of effect on the primary outcome, though large significant effects amongst eight related SF36 measures of general health . How could such differences arise? Could they be: a true effect mediated through receiving the intervention, another systematic effect such as self-reporting bias, and/or chance? The aim was to develop reliable methods to investigate whether effects of the intervention on the SF36 outcomes were mediated through truly receiving the intervention delivered in intervention sessions.
We adopted a structural mean modelling approach with a two-stage least-squares estimation algorithm, in order to estimate mediation effects free from confounding bias . It involves predicting the mediator (number of sessions attended), and outcomes, from baseline covariates. Each individual has a personal predicted ‘counterfactual’ treatment-effect difference which is regressed on the predicted mediator using a dose-response model. Although reliably bias-free, typically these methods do not provide sufficiently precise estimates except for the simplest of models. A simulation study was designed to establish the factors driving the lack of precision. We extended the two-stage approach, using linear mixed effects and GEE modelling to enable multiple SF36 outcomes to contribute to estimation of a common mediation effect.
In this trial, attendance at sessions was invariably high, adversely affecting the precision of the estimates. From the simulation study, important factors affecting detection were identified to be the size of the trial effect and the degree to which the mediator is predictable from baseline covariates. The effect of analysing four SF36 outcomes to estimate an assumed common mediation effect was to reduce the standard error of the estimated effect by up to 40%, equivalent to offering an increase in power to detect mediation from 50% to 80%. The mediation effect was statistically significant.
The extension of bias-free estimation of a mediation effect from one to multiple related outcomes offered an appreciable improvement in the power to detect mediation effects and to estimate them more precisely. The significant effect through sessions indicates that some of the effect may well be genuinely connected with receipt of intervention material. The approach requires assumptions.
- Kinmonth AL, Wareham NJ, Hardeman W, Sutton S, Prevost AT, Fanshawe T, Williams KM, Ekelund U, Spiegelhalter D, Griffin SJ: Efficacy of a theory-based behavioural intervention to increase physical activity in an at-risk group in primary care (ProActive UK): a randomised trial. Lancet. 2008, 371: 41-48. 10.1016/S0140-6736(08)60070-7.View ArticlePubMedGoogle Scholar
- Dunn G, Bentall R: Modelling treatment-effect heterogeneity in randomized controlled trials of complex interventions (psychological treatments). Stat Med. 2007, 26: 4719-4745. 10.1002/sim.2891.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.