Skip to content


  • Oral presentation
  • Open Access

Biases in clinical trials with sequential monitoring

  • 1 and
  • 1
Trials201112(Suppl 1):A50

Published: 13 December 2011


  • Treatment Effect
  • Treatment Difference
  • Actual Information
  • Estimation Bias
  • Information Bias


It is well known that a sequentially monitored clinical trial that stops early for benefit has a crude treatment difference that overestimates the true treatment effect. This has led to extended debate in the literature, with some researchers arguing that early stopping is an important source of bias in meta-analyses of clinical trials. We therefore investigated the implications of excluding studies that stopped early, so-called truncated studies, from estimation of treatment effects.


The effect of excluding truncated studies was investigated by examining the statistical properties of sequentially monitored studies conditional on reaching the planned final analysis. Using theory and simulation we studied clinical trials with standard sequential rules for stopping early due to benefit. As well as estimation bias, we studied information bias measured as the difference between standard measures of the statistical information, such as sample size, and the actual information based on the conditional sampling distribution.


We found exclusion of truncated studies leads to both estimation bias and information bias. Treatment differences are underestimated and information is overestimated. Most importantly, the magnitude of information bias is an increasing function of the magnitude of estimation bias. This has important implications for meta-analyses that typically weight by sample size. In particular, it means that studies with the most biased treatment effect are the most overweighted studies in a meta-analysis. The magnitudes of both estimation and information biases can be practically significant. When all studies were included in meta-analyses, both truncated and non-truncated, the estimation of treatment effects was unbiased.


Crude methods of analysis for sequentially monitored studies can lead to underestimation bias if truncated studies are excluded from estimation of treatment effects. Furthermore, information bias resulting from this exclusion leads to a double whammy effect, in which the most biased studies are the most overweighted studies in a meta-analysis. Since exclusion of truncated studies is problematic, we advocate wider reporting of adjusted estimates of treatment effects that take account of any interim monitoring, and recommend that all studies, both truncated and non-truncated, are included in meta-analyses.

Authors’ Affiliations

Department of Statistics, Macquarie University, Sydney, Australia


© Schou and Marschner; licensee BioMed Central Ltd. 2011

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.