Skip to main content

Assessing and improving the reliability of meta-analyses of hazard ratios derived from published time-to-event data

Background

Trial design and conduct is informed by systematic reviews and meta-analyses (MAs). For time-to-event outcomes, they are typically based on hazard ratios (HRs). Ideally, these are calculated from individual patient data (IPD). Alternatively, they can be extracted from published aggregate data (AD) or estimated from other statistics or from Kaplan-Meier (KM) curves. As reporting and the reliability of each estimation method is likely variable, we investigate how HRs from AD and IPD compare.

Methods

We used 18 of our published IPD systematic reviews and MAs. For our primary outcome of overall survival, we extracted or estimated logHRs and standard errors (SEs) from eligible trials wherever possible. We compared HRs from AD and IPD at the trial and meta-analysis level, using Bland-Altman methods to assess agreement.

Results

Of 245 unique trials eligible for the meta-analyses, HRs were available from IPD for 199 (81%), and from AD for 155 (63%) including 75 (48%) based on KM curves. Trial logHRs from AD were biased towards benefit compared to IPD (5% on HR scale, p=0.009), and SEs were inflated (+0.23 SDs, p<0.001). Bias was not influenced by estimation method (p=0.84). Similar bias was seen in MA logHRs from AD (3.5% on HR scale, p=0.031), and again inflated SEs (+0.87 SDs, p<0.001). The level of bias varied by meta-analysis.

Conclusions

Although MAs of AD-derived HRs can be biased, their use is widespread and needed when the IPD approach is infeasible. We will present results on causes of these biases and guidance on overcoming them.

Author information

Authors and Affiliations

Authors

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver ( https://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Cite this article

Tierney, J., Fisher, D., Burdett, S. et al. Assessing and improving the reliability of meta-analyses of hazard ratios derived from published time-to-event data. Trials 14, O93 (2013). https://doi.org/10.1186/1745-6215-14-S1-O93

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/1745-6215-14-S1-O93

Keywords

  • Public Health
  • Standard Error
  • Systematic Review
  • Primary Outcome
  • Estimation Method