Skip to main content


  • Oral presentation
  • Open Access
  • Assessing the presence of selection bias in meta-analyses of randomised trials using baseline heterogeneity

    • 1,
    • 1,
    • 1,
    • 1,
    • 1,
    • 1,
    • 1,
    • 1,
    • 1,
    • 1 and
    • 1
    Trials201314 (Suppl 1) :O96

    • Published:


    • Public Health
    • Intervention Group
    • Internal Medicine
    • Systematic Review
    • Selection Bias


    To assess the likelihood of biased trials contained in 12 recently published meta-analyses.


    A review of component randomised controlled trials of systematic reviews with 12 meta analyses.

    Data sources

    12 recently published systematic reviews with 503 component randomised trials, which were published in the BMJ, Lancet, JAMA and The Annals of Internal Medicine up until May 2012.

    Eligibility criteria for selecting studies

    Systematic reviews were eligible for inclusion if they included only randomised controlled trials (RCTs). We obtained the full text for the component RCTs of the 12 systematic reviews. We excluded RCTs which were not available in English from our review and analysis.


    Five of the 12 meta-analyses exhibited heterogeneity (I2 >0.30) in age differences, when there should have been none, with two having significant or substantial heterogeneity (I2 > 0.50). In three meta-analyses we found that the age of intervention group was statistically significantly higher than in the control group. Two meta-analysis had a distribution of p-values that were inconsistent with chance. Meta-regression explained some of the observed heterogeneity in two meta-analyses as a consequence of poor allocation concealment.


    The majority of a sample of recent meta-analyses showed that there were signs of imbalance and or heterogeneity in ages between treatment groups, when there should have been none. Systematic reviewers might consider using the techniques described here to assess the validity of their findings.

    Authors’ Affiliations

    University of York, York, UK


    © Clark et al; licensee BioMed Central Ltd. 2013

    This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


    By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.