Skip to main content


Treatment success in pragmatic randomised controlled trials: a review of trials funded by the UK Health Technology Assessment programme


Equipoise implies that given a random unbiased sample of trials, no significant difference would be expected in the proportion favouring the new treatment to the proportion favouring the standard treatment [13]. Previous research reviewed treatment success and whether the collective uncertainty principle is met in RCTs in the US National Cancer Institute portfolio [46]. This paper classifies clinical trials funded by the UK HTA programme by results using the method applied to the US Cancer Institute trials, and compares the two portfolios [7].


Data on all completed randomised controlled trials funded by the HTA programme 1993-2008 were extracted. Each trial's primary results was classified into six categories; 1) statistically significant in favour of the new treatment, 2) statistically significant in favour of the control treatment 3) true negative, 4) truly inconclusive, 5) inconclusive in favour of new treatment or 6) inconclusive in favour of control treatment. Trials were classified by comparing the 95% confidence interval for the difference in primary outcome to the difference specified in the sample size calculation. The results were compared with Djulbegovic's analysis of NCI trials.


Data from 51 superiority trials were included, involving over 48,000 participants and a range of diseases and interventions. 85 primary comparisons were available because some trials had more than two randomised arms or had several primary outcomes. The new treatment had superior results (whether significant or not) in 61% of the comparisons (52/85 95% CI 49.9% to 71.6%). The results were conclusive in 46% of the comparisons (19% statistically significant in favour of the new treatment, 5% statistically significant in favour of the control and 22% true negative). The results were classified as truly inconclusive (i.e. failed to answer the question asked) for 24% of comparisons (20/85). HTA trials included fewer truly inconclusive and statistically significant results and more results rated as true negative than NCI trials.


The pattern of results in HTA trials is similar to that of the National Cancer Institute portfolio. Differences that existed were plausible given the differences in the types of trials -HTA trials are more pragmatic. The results indicate HTA trials are compatible with equipoise. This classification usefully summarises the results from clinical trials and enables comparisons of different portfolios of trials.


  1. 1.

    Kumar A, Soares H, Wells R, Clarke M, Hozo L, Bleyer A: Are experimental treatments for cancer in children superior to established treatments? Observational study of randomised controlled trials by the Children's Oncology Group. British Medical Journal. 2005, 331 (7528): 1295-1298B. 10.1136/bmj.38628.561123.7C.

  2. 2.

    Djulbegovic B: Articulating and responding to uncertainties in clinical research. Journal of Medicine and Philosophy. 2007, 32 (2): 79-98. 10.1080/03605310701255719.

  3. 3.

    Djulbegovic B: The paradox of equipoise: the principle that drives and limits therapeutic discoveries in clinical research. Cancer Control. 2009, 16 (4): 342-347.

  4. 4.

    Djulbegovic B, Kumar A, Soares HP, Hozo I, Bepler G, Clarke M: Treatment success in cancer. Archives of Internal Medicine. 2008, 168 (6): 632-42. 10.1001/archinte.168.6.632.

  5. 5.

    Joffe S, Harrington DP, George SL, Emanuel EJ, Budzinski LA, Weeks JC: Satisfaction of the uncertainty principle in cancer clinical trials: retrospective cohort analysis. BMJ. 2004, 328 (7454): 1463-10.1136/bmj.38118.685289.55.

  6. 6.

    Soares HP, Kumar A, Daniels S, Swann S, Cantor A, Hozo I: Evaluation of new treatments in radiation oncology: are they better than standard treatments?. JAMA. 2005, 293 (8): 970-978. 10.1001/jama.293.8.970.

  7. 7.

    Dent L, Raftery J: Treatment success in pragmatic randomised controlled trials: a review of trials funded by the UK Health Technology Assessment programme. Trials. 2011, 12: 109-10.1186/1745-6215-12-109.

Download references

Author information

Correspondence to Louise Dent.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Dent, L., Raftery, J. Treatment success in pragmatic randomised controlled trials: a review of trials funded by the UK Health Technology Assessment programme. Trials 12, A97 (2011).

Download citation


  • Randomise Control Trial
  • Control Treatment
  • Sample Size Calculation
  • Technology Assessment
  • Health Technology Assessment


By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.