Skip to main content

Association of trial registration with the results and conclusions of published trials of new oncology drugs



Registration of clinical trials has been introduced largely to reduce bias toward statistically significant results in the trial literature. Doubts remain about whether advance registration alone is an adequate measure to reduce selective publication, selective outcome reporting, and biased design. One of the first areas of medicine in which registration was widely adopted was oncology, although the bulk of registered oncology trials remain unpublished. The net influence of registration on the literature remains untested. This study compares the prevalence of favorable results and conclusions among published reports of registered and unregistered randomized controlled trials of new oncology drugs.


We conducted a cross-sectional study of published original research articles reporting clinical trials evaluating the efficacy of drugs newly approved for antimalignancy indications by the United States Food and Drug Administration (FDA) from 2000 through 2005. Drugs receiving first-time approval for indications in oncology were identified using the FDA web site and Thomson Centerwatch. Relevant trial reports were identified using PubMed and the Cochrane Library. Evidence of advance trial registration was obtained by a search of, WHO, ISRCTN, NCI-PDQ trial databases and corporate trial registries, as well as articles themselves. Data on blinding, results for primary outcomes, and author conclusions were extracted independently by two coders. Univariate and multivariate logistic regression identified associations between favorable results and conclusions and independent variables including advance registration, study design characteristics, and industry sponsorship.


Of 137 original research reports from 115 distinct randomized trials assessing 25 newly approved drugs for treating cancer, the 54 publications describing data from trials registered prior to publication were as likely to report statistically significant efficacy results and reach conclusions favoring the test drug (for results, OR = 1.77; 95% CI = 0.87 to 3.61) as reports of trials not registered in advance. In multivariate analysis, reports of prior registered trials were again as likely to favor the test drug (OR = 1.29; 95% CI = 0.54 to 3.08); large sample sizes and surrogate outcome measures were statistically significant predictors of favorable efficacy results at p < 0.05. Subgroup analysis of the main reports from each trial (n = 115) similarly indicated that registered trials were as likely to report results favoring the test drug as trials not registered in advance (OR = 1.11; 95% CI = 0.44 to 2.80), and also that large trials and trials with nonstringent blinding were significantly more likely to report results favoring the test drug.


Trial registration alone, without a requirement for full reporting of research results, does not appear to reduce a bias toward results and conclusions favoring new drugs in the clinical trials literature. Our findings support the inclusion of full results reporting in trial registers, as well as protocols to allow assessment of whether results have been completely reported.

Peer Review reports


The clinical trial literature is known to be a biased source of evidence on therapeutic efficacy. A number of potential mechanisms accounting for bias have been identified [1]. Selective publication of "statistically significant" results favoring new treatments is one well-established problem [27]. Intrinsic factors of trial design can also lead to bias in randomized controlled trials of drug efficacy [8, 9]. Specific design features that have been associated with bias in reported trials include blinding[8, 10, 11], sample size [9, 1113], and choice of comparator [1417]. Particular data handling and analysis procedures have been associated with bias [13, 18, 19] and also incomplete reporting of outcomes [2, 2022]. Trials and investigators supported by pharmaceutical companies are more likely to report results and conclusions favorable towards the sponsor's product compared to placebo [13, 14, 23, 24], or to the drugs of other manufacturers [11, 25], through mechanisms that remain incompletely characterized.

The public registration of clinical trials has been introduced, partly to satisfy ethical obligations of human experimentation [2630], and partly to reduce bias via several mechanisms (increasing scrutiny of design, encouraging publication, and encouraging full outcome reporting) [7, 3133]. United States Federal law in 1997 mandated a national registry, which was operational by 1999 [30]. However the registry was at first little used except in a few fields, notably oncology (where it facilitated patient recruitment) [34]. Since the International Committee of Medical Journal Editors instituted a policy requiring prior trial registration for publication in cooperating journals from late 2005 [29], registration has become much more common and may soon be a universal regulatory requirement [30, 35]. However, doubts remain about registration's adequacy in principle for preventing bias due to trial design [36, 37]. Furthermore, there is evidence that registration alone may not greatly influence biased outcome reporting: among registered trials in cardiology, rheumatology, and gastroenterology that have been published, many showed discrepancies between primary outcomes as reported and outcomes as registered, the vast majority of which tended to favor statistically significant results [37]. Similarly, advance registration of trials may not greatly discourage selective publication: the majority of registered trials across all fields remain unpublished, and are less likely to be published if industry sponsored [38].

One of the main goals of trial registration is to reduce bias in the literature through some combination of effects on the mechanisms favoring new treatments. Oncology is one field in which published results and conclusions have been found to exhibit a bias favoring new drugs, associated statistically with drugmaker sponsorship and with particular trial design features [39]. A minority of oncology trials registered before September 2004 have reached publication, indicating that the possibility of publication bias in this field also remains [40]. In oncology, high quality randomized clinical trials (those of the National Cancer Institute's Cooperative Oncology Groups) have in the long run favored new treatments very nearly as often as comparator treatments, making this field unusually advantageous for studying predictors of favorable outcomes in that conditions approximately consistent with equipoise have been demonstrated [41]. To assess whether registration is associated with any net difference in the prevalence of results and conclusions favoring new drugs in the clinical trial literature, we conducted a cross-sectional study of randomized clinical trial reports of oncology drugs approved by the United States Food and Drug Administration (FDA) from 2000 through 2005. We hypothesized that advance trial registration is associated with statistically non-significant efficacy outcomes in published trial reports, when controlling for other known predictors of reported results such as funding source, publication characteristics, and trial design characteristics.


Search strategy

We searched drug approvals by year on the FDA web site as well as Thomson CenterWatch We identified 25 relevant drugs granted first-time FDA approval for oncology indications in the 2000-2005 period, including both new molecular entities and older drugs receiving new indications. We electronically searched PubMed and the Cochrane Library in mid-October 2007 to identify reports of randomized controlled trials including these drugs. Search terms were the generic name(s) of the drugs of interest, in PubMed limited to "randomized" or "randomised", "clinical trials", and "humans". Our search included articles published in any language. The search was updated in late February 2009 to expand the sample so as to include reports published through the end of 2008. Thus trial reports on all drugs of interest were collected for a full nine-year interval surrounding FDA approval, except for those drugs approved in 2005, for which only eight years of literature was searched.

Published Articles

We reviewed abstracts of all citations and retrieved articles based on the following inclusion criteria: (1) prospective randomized controlled trial; (2) oncology drug of interest compared to a treatment arm not including that drug (e.g., placebo or active control); (3) efficacy measured in human cancer patients; (4) efficacy measured in terms of direct effects on malignancy (not treatment-related pathology or supportive care only); (5) original research, defined as studies that appeared to present original data and did not specifically state that they were reviews. Studies with the primary objective of assessing the effect of the oncology drug of interest combined with another treatment were included, so long as one treatment arm including the drug of interest was compared with an otherwise identical arm lacking it, or with another treatment in its place. In the case of oxaliplatin, approved in 2002 only in combination with 5-fluorouracil and leucovorin, oxaliplatin was defined as the chief drug of interest and only trials comparing the approved combination to a treatment arm not containing oxaliplatin were included.

The following exclusion criteria were used to screen all abstracts: (1) studies not evaluating clinical efficacy outcomes (e.g., pharmacodynamic studies); (2) editorials, letters-to-the-editor, commentaries, abstracts, reviews, studies only describing a trial but not results; (3) studies presenting only an economic analysis; (4) retrospective analysis of outcome predictors not reporting any new efficacy data; (5) studies in which the oncology drug of interest was present in all arms of the trial; (6) studies published more than four years before or after the year of the oncology drug's approval in the 2000 to 2005 interval; (7) studies presenting pooled data from multiple trials, where individual trial results are not interpretable separately; (8) studies in which the primary efficacy outcome is not assessed statistically or not reported sufficiently for statistical assessment; and (9) strictly biological or in vitro analyses. We did not identify any exact duplicate publications. As we were interested in published trial reports, we did include multiple publications from the same underlying trial if the publications reported different data. Where any doubt about a publication's eligibility for inclusion remained after reading the abstract, it was provisionally included for a full reading.

Data extraction

One investigator (N.R.) who was not blinded to author names and affiliations, funding sources, and financial disclosure extracted all data from each article. All data were extracted from articles before a search of the registration status of the underlying trial was conducted. A second coder (K.L.) who was blinded to registration status (except where it was stated in the publication) independently extracted data on blinding, identification and results of primary outcomes, and author conclusions. Inter-rater agreement was very good to excellent, with Kappa values ranging from 0.85 to 0.95 for double-coded items. In cases of disagreement the two coders discussed the papers and reached agreement.

We extracted data on trial registration status and publication characteristics that have been shown to be independently related to publication of favorable results or conclusions of drug studies, as follows [812, 23].

Registration status

For all articles the registration status of the underlying trial was sought by searching cancer type and drug names in key databases. These included the U.S. National Institutes of Health trial registry, the International Standard Randomized Controlled Trial Number Register, the WHO International Clinical Trials Registry platform, the U.S. National Cancer Institute PDQ Comprehensive Cancer database, and where available, the corporate trial registries and databases of the manufacturers of the drugs. Where the underlying trial could unambiguously be identified in a registry or registries (by therapy protocols, inclusion criteria, patient numbers, location, commencement date, etc.), the earliest recorded date and place of registration was noted. For analysis, only reports of trials registered in a year prior to the earliest year of publication of results were classified as registered. Some registered trial reports did not meet this condition, as registration became a precondition of publication in many journals during the interval studied and post-hoc registration was allowed to satisfy this requirement. Sixteen of the 83 papers coded as unregistered appeared to have been registered in the same year as the first report, thus presumably after trial completion.

Publication characteristics

Peer Review Status

Each article was classified as peer reviewed or non-peer reviewed based on information found on the website of the journal where the article was published. A publication was considered peer reviewed if the website mentioned that the journal had a peer review process or if it was stated that the manuscripts were evaluated by at least one external expert in the field; otherwise, a publication was considered non-peer reviewed.

Impact Factor

For each article, impact factor for the journal in the year of publication was obtained from the Institute for Scientific Information [42].

Main report

Trial reports were classified as 1) first or main reports, if they were the earliest article in a given drug's publication sampling interval reporting results on a particular trial's primary efficacy outcome measure in the full patient population, or 2) subsidiary reports if an earlier publication in the sampling interval had disclosed results of the primary outcome measure.

Study design characteristics

Comparison group

The comparator for the primary outcome was classified as 1) placebo controlled, or 2) drug versus other treatment only. In drug versus other treatment comparisons involving two different oncology drugs of interest, the "test" drug was defined as the newer drug (most recent FDA approval date) and the older drug as the "comparator".

If a trial included multiple treatment arms, the placebo arm was treated as the comparator arm if present. If trials included multiple arms differing in dosage of the oncology drug of interest, the arm specifying the higher cumulative dosage was treated as the "test" arm whenever possible. If a publication reported results from multiple trials, the trial with the largest number of patients randomized was coded.

Equivalency or Superiority trial

Articles were classified as 1) equivalency/noninferiority trial if stated in the publication or 2) superiority trial.

Type of primary outcome measures

The preferred efficacy outcome measure recommended by the FDA for trials of antimalignancy therapies in this period was overall survival [43]. We classified the primary efficacy outcome reported in a publication as 1) overall survival or an equivalent measure (e.g. time to death) or 2) surrogate, if a surrogate measure was specified as the primary outcome. If no primary efficacy outcome was stated, or more than one "primary" outcome, the most emphasized efficacy outcome in the publication was designated the main outcome and treated as primary. In such cases we operationalized "most emphasized" according to word count in the results section, or if word count was about equal, the outcome discussed first. Identification of primary outcome measure was double-coded with high agreement (although kappa cannot be calculated because the number of possible outcome measures is indefinite).


Blinding of treatment group allocation was classified on a scale of 0 to 3 based on the scheme of Chalmers et al. [44], with one point each for procedures assuring that patients were unaware of their allocation, that treating physicians and other patient care personnel were unaware, and that those evaluating the primary efficacy endpoint were unaware. If papers stated only that they were "double blind" without specifying procedures, they were classified with only one point. For analysis, we dichotomized blinding into "stringent" (score of 2 or 3) or "nonstringent" (score of 0 or 1).

Sample Size

We recorded the total number of patients randomized to all treatments as described in the article, or total number enrolled if number randomized was not stated.

Statistical Significance of Primary Outcome

For each report, the results described for the primary efficacy outcome were categorised as 1) favorable if the result was statistically significant (p < 0.05 unless more stringent criteria were specified) and in the direction of the test drug being more efficacious, or 2) inconclusive if the result did not reach statistical significance, or 3) unfavorable if the result was statistically significant in the direction of the comparator treatment being more efficacious. If a paper explicitly stated that it was designed as a non-inferiority or equivalency study and no significant efficacy difference between the two comparison treatments was reported, the result was coded as favorable. For analysis, conclusions were dichotomised as favorable or not (combining inconclusive and unfavorable).


The overall conclusions reached in the published reports were categorised as 1) favorable, if the test drug was preferred to comparator, 2) equivalent if the test drug was described as about equal to comparator, or 3) unfavorable, if the comparator was preferred to the test drug. If an article did not clearly state that one of the treatments was better or if the comparison treatments had different but balanced advantages, the conclusion was coded as "test drug equivalent to comparator". If a study explicitly stated that it was designed as a non-inferiority or equivalency trial and the comparison treatments were said to be about equal, the conclusion was coded as favorable. For analysis, conclusions were dichotomized as favorable or not (combining equivalent and unfavorable).

Sponsorship information

Funding source

The funding source(s) of the published reports were categorized as 1) industry, 2) private non-profit, 3) government, 4) other, 5) no funding, 6) none disclosed.

Financial ties

Data about the financial ties of each author were extracted and coded for 1) whether or not there were ties of employment, research funding, consulting, stock ownership, or honoraria disclosed with the sponsor of the study (yes, no, or none disclosed), and 2) whether or not there were these same financial ties disclosed with any other company (yes, no, or none disclosed).

For analysis these categories were collapsed into two classes of sponsorship status, 1) sponsored by the test drug maker, if such a funding source for the trial was acknowledged explicitly, or where any author listed a relevant corporate address or employment, and 2) not commercially sponsored, if neither of the preceding categories applied. Supply of materials, or consulting or honoraria (etc.) on the part of authors did not in themselves qualify as sponsorship. Only one study was sponsored by the manufacturer of the comparator [45], and for analysis the paper was recoded as if the comparator (in fact an even newer drug) were the test drug.


We report frequencies of the different characteristics of each article by registration status of the trial. Proportions of reports with favorable results or conclusions were first analyzed using univariate logistic regression to identify associations between independent variables and favorable results and conclusions. Although impact factor and sample size were continuous variables, they were modeled categorically by quartile because their effects were clearly non-linear. An exploration of interactions between trial and publication characteristics revealed no interactions except between trial sample size and journal impact factor (see Results, below).

To control for multiple variables simultaneously, we carried out multivariate logistic regression analysis and calculated odds ratios. These models included registration status as our primary predictor and all factors statistically associated either in the literature or in our univariate models with favorable results or conclusions. The natural log of sample size was treated as a numeric predictor. For our primary analysis, we conducted the multivariate regression on our full sample (n = 137). We carried out pre-planned subgroup analyses of industry-sponsored studies only (n = 109), and first or main reports only (i.e., one report per trial, n = 115). We also assessed sensitivity of our results to our definition of registration by repeating the primary multivariate analysis with both less stringent definitions of advance trial registration (any evidence of registration) and more stringent (evidence of registration in a year at least two years prior to publication). Data were analyzed with SAS software (version 9.1, SAS Institute, Cary, NC, USA).


As designed this study required a sample of 116 included reports to achieve 80% power, assuming that 50% of reports from registered trials would describe favorable results and 75% from unregistered trials, and equal numbers of the two categories. Our actual full sample consisted of 137 trial reports meeting inclusion criteria (see Figure 1), and provided 85% power to distinguish the expected proportions. The sample characteristics are shown in Table 1. Thirty-nine percent (54/137) described trials registered prior to the year of the first publication. The majority of both registered and unregistered trial reports were published in peer reviewed journals, did not describe stringent blinding, reported on a surrogate primary efficacy outcome measure, and were sponsored by the test drug maker. Fifty-eight percent (80/137) of the trial reports described results that were statistically significant in favor of the test drug for the primary efficacy outcome. Seventy-two percent (98/137) had conclusions that favored the test drug.

Table 1 Characteristics of included articles by registration status (n = 137)
Figure 1
figure 1

Identification of trial reports for inclusion.

Table 2 shows the results of univariate analysis of the full sample. Reports of trials with large sample sizes were significantly more likely to describe results and conclusions favoring the test drug, as were reports published in higher impact journals. Reports of trials sponsored by the maker of a test drug were significantly more likely to reach conclusions favoring the drug than non-sponsored trial reports. We found no statistically significant difference in results or conclusions between registered and non-registered trial reports. Published reports of registered trials were as likely to describe primary outcome results (OR = 1.77; 95% CI = 0.87 to 3.61) and conclusions (OR = 1.99; 95% CI = 0.89 to 4.45) favoring the test drug compared to reports of non-registered trials.

Table 2 Association between characteristics of articles and statistically significant results or conclusions that favor the test drug: Univariate logistic regression (n = 137).

In addition to registration status, we included industry sponsorship and sample size in our multivariate analysis because of their statistical significance in the univariate analysis. We also included stringency of blinding, outcome measure type, and comparator treatment type as these trial characteristics had been associated with direction of results in similar studies [9, 11, 13, 46]. Journal impact factor was dropped from multivariate analysis because interaction testing found that its correlation with favorable results was accounted for by sample size. There was no interaction between stringency of blinding and surrogate outcome measure, or among any other variables. In the multivariate analysis (Table 3), reports of registered trials were again as likely to describe results favoring the test drug (OR = 1.29; 95% CI = 0.54 to 3.08), and to reach favorable conclusions (OR = 1.56; 95% CI = 0.60 to 4.05). Reports of trials with surrogate outcome measures and large sample sizes (natural log) were significantly more likely to describe results favoring the test drug (p = 0.027 and p < 0.001 respectively). Large sample size was a significant predictor of conclusions favoring the test drug (p = 0.006) in the multivariate analysis.

Table 3 Association between characteristics of articles and statistically significant outcome or conclusions that favor the test drug: Multivariate logistic regression (full sample, n = 137)

For the subset of trial reports sponsored by the test drug makers (n = 109), results were essentially the same as for the full set, reports of registered trials being as likely to describe favorable results (OR = 1.37; 95% CI = 0.54 to 3.44). We also conducted a multivariate analysis for the subgroup of first or main reports (n = 115), including only one report per underlying trial (Table 4). As with the full set of publications, we did not find a statistically significant difference between registered and non-registered trials in the reporting of favorable results or conclusions. Published registered trials were as likely to report results favoring the test drug (OR = 1.11; 95% CI = 0.44 to 2.80). Results only differed from the full sample multivariate analysis in that published trials with nonstringent blinding were significantly more likely to report results favoring the test drug (p = 0.028), whereas surrogate outcome measure no longer reached significance as a predictor of results, indicating that this latter trial characteristic was over-represented among multiply-published trials.

Table 4 Association between characteristics of trials and statistically significant outcome or conclusions favoring the test drug: Multivariate logistic regression (first/main reports only, n = 115)

A sensitivity analysis of our definition of prior registration yielded qualitatively similar results for the different definitions. The more stringent definition of prior registration (two years or more before first publication year) in our multivariate model indicated that reports of registered trials were at least as likely to describe favorable results (OR = 1.58; 95% CI = 0.65 to 3.86) as compared with our basic definition. The less stringent definition (any evidence of registration) had an effect in the opposite direction (OR = 0.72; 95% CI = 0.30 to 1.72), suggesting that the timing of trial registration may be a variable worthy of further study.


We examined the association of trial registration and the results and conclusions of published randomized controlled trials of new oncology drugs. We found, contrary to expectations, that published reports of pre-registered trials were as likely to describe results favoring the test drug as non-registered trials, even when controlling for other important predictors of statistical significance of results, including trial sample size, blinding, and industry sponsorship. Reports of registered trials in our sample actually appear more likely to favor new drugs (though not significantly); if so, one possible explanation is that trials expected to reflect favorably on new drugs were registered early.

Our findings argue for measures in addition to trial registration alone to ensure that statistically non-significant results are fully reported. Public access to statistically non-significant results is essential for conducting valid meta-analysis, advancing science, and enabling clinical decisions based on complete evidence [4749]. Issues about the quality, assessment and presentation of non-peer-reviewed data in trial registers must be resolved, along with commercial concerns, without undue delay [30, 48]. However, given the evidence that particular trial design features were associated with reported results, notwithstanding registration, our findings also suggest that results access through registries alone may never entirely eliminate the bias favoring new drugs in the clinical trial literature.

It might be argued that many registered "negative" trials of these recent oncology drugs have not yet been completed, or not yet submitted for publication, or that they have been rejected multiple times by journals. However, previous studies suggest that authors' decisions not to submit manuscripts, rather than journal rejection, account for the majority of unpublished studies with statistically insignificant results [2, 3, 50, 51]

Our study has several limitations. We focused on oncology drugs because they were most likely to include a sample of registered trials. Thus, our findings may not be generalizable to other classes of drugs. We were not able to examine trials of drugs that were never approved by the FDA as this list of drugs is not provided by the FDA. Our study design did not allow us to assess trials that were not published. In addition, to focus on trials of new therapies, we excluded studies published more than four years before or after the year of the oncology drug's approval in the 2000-2005 interval. Since trials with positive results are published significantly earlier than trials with negative results (4.3 yrs vs 6.5 yrs, respectively) [4], we may have failed to identify some studies yet to be published on the more recently approved drugs. However, these latter two limitations apply equally to prior registered and non-registered trials. We examined only the primary efficacy outcomes of the trials, and thus cannot determine whether trial registration might influence the reporting of secondary outcomes or safety outcomes. Lastly, trial registration has become increasingly common. Thus, our cross-sectional study offers only an early look at the effects of trial registration on results and conclusions in a particular sample of registered and unregistered trial reports. However, subsequent studies on the association of registration with reported results will be constrained to a before/after design and its attendant shortcomings.


Trial registration alone, without a requirement for full reporting of research results, does not appear to reduce a bias toward results and conclusions favoring new drugs in the clinical trials literature. Our findings support the inclusion of full results reporting in trial registers, as well as measures to allow assessment of whether results have been completely reported. However, bias related to study design may remain. Possible policy solutions for design bias include advance review of trial protocols, compliance with existing reporting requirements, and adherence to best research practices.


  1. Ioannidis JP: Why most published research findings are false. PLoS Med. 2005, 2: e124-10.1371/journal.pmed.0020124.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Dickersin K, Chan S, Chalmers TC, Sacks HS, Smith H: Publication bias and clinical trials. Control Clin Trials. 1987, 8: 343-353. 10.1016/0197-2456(87)90155-3.

    Article  CAS  PubMed  Google Scholar 

  3. Dickersin K: The existence of publication bias and risk factors for its occurrence. Jama. 1990, 263: 1385-1389. 10.1001/jama.263.10.1385.

    Article  CAS  PubMed  Google Scholar 

  4. Ioannidis JP: Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. Jama. 1998, 279: 281-286. 10.1001/jama.279.4.281.

    Article  CAS  PubMed  Google Scholar 

  5. Liss H: Publication bias in the pulmonary/allergy literature: effect of pharmaceutical company sponsorship. Isr Med Assoc J. 2006, 8: 451-454.

    PubMed  Google Scholar 

  6. Rasmussen N: The drug industry and clinical research in interwar America: three types of physician collaborator. Bull Hist Med. 2005, 79: 50-80. 10.1353/bhm.2005.0036.

    Article  PubMed  Google Scholar 

  7. Abaid LN, Grimes DA, Schulz KF: Reducing publication bias through trial registration. Obstet Gynecol. 2007, 109: 1434-1437.

    Article  PubMed  Google Scholar 

  8. Colditz GA, Miller JN, Mosteller F: How study design affects outcomes in comparisons of therapy. I: Medical. Stat Med. 1989, 8: 441-454. 10.1002/sim.4780080408.

    Article  CAS  PubMed  Google Scholar 

  9. Ioannidis JP, Cappelleri JC, Sacks HS, Lau J: The relationship between study design, results, and reporting of randomized clinical trials of HIV infection. Control Clin Trials. 1997, 18: 431-444. 10.1016/S0197-2456(97)00097-4.

    Article  CAS  PubMed  Google Scholar 

  10. Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. Jama. 1995, 273: 408-412. 10.1001/jama.273.5.408.

    Article  CAS  PubMed  Google Scholar 

  11. Bero L, Oostvogel F, Bacchetti P, Lee K: Factors associated with findings of published trials of drug-drug comparisons: why some statins appear more efficacious than others. PLoS Med. 2007, 4: e184-10.1371/journal.pmed.0040184.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Ioannidis JP, Polycarpou A, Ntais C, Pavlidis N: Randomised trials comparing chemotherapy regimens for advanced non-small cell lung cancer: biases and evolution over time. Eur J Cancer. 2003, 39: 2278-2287. 10.1016/S0959-8049(03)00571-9.

    Article  CAS  PubMed  Google Scholar 

  13. Als-Nielsen B, Chen W, Gluud C, Kjaergard LL: Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events?. Jama. 2003, 290: 921-928. 10.1001/jama.290.7.921.

    Article  PubMed  Google Scholar 

  14. Rochon PA, Gurwitz JH, Simms RW, Fortin PR, Felson DT, Minaker KL, Chalmers TC: A study of manufacturer-supported trials of nonsteroidal anti-inflammatory drugs in the treatment of arthritis. Arch Intern Med. 1994, 154: 157-163. 10.1001/archinte.154.2.157.

    Article  CAS  PubMed  Google Scholar 

  15. Johansen HK, Gotzsche PC: Problems in the design and reporting of trials of antifungal agents encountered during meta-analysis. Jama. 1999, 282: 1752-1759. 10.1001/jama.282.18.1752.

    Article  CAS  PubMed  Google Scholar 

  16. Djulbegovic B, Lacevic M, Cantor A, Fields KK, Bennett CL, Adams JR, Kuderer NM, Lyman GH: The uncertainty principle and industry-sponsored research. Lancet. 2000, 356: 635-638. 10.1016/S0140-6736(00)02605-2.

    Article  CAS  PubMed  Google Scholar 

  17. Safer DJ: Design and reporting modifications in industry-sponsored comparative psychopharmacology trials. J Nerv Ment Dis. 2002, 190: 583-592. 10.1097/00005053-200209000-00002.

    Article  PubMed  Google Scholar 

  18. Porta N, Bonet C, Cobo E: Discordance between reported intention-to-treat and per protocol analyses. J Clin Epidemiol. 2007, 60: 663-669. 10.1016/j.jclinepi.2006.09.013.

    Article  PubMed  Google Scholar 

  19. Gravel J, Opatrny L, Shapiro S: The intention-to-treat approach in randomized controlled trials: are authors saying what they do and doing what they say?. Clin Trials. 2007, 4: 350-356. 10.1177/1740774507081223.

    Article  PubMed  Google Scholar 

  20. Chan AW, Krleza-Jeric K, Schmid I, Altman DG: Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research. Cmaj. 2004, 171: 735-740.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Chan AW, Hrobjartsson A, Haahr MT, Gotzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. Jama. 2004, 291: 2457-2465. 10.1001/jama.291.20.2457.

    Article  CAS  PubMed  Google Scholar 

  22. Chan AW, Altman DG: Identifying outcome reporting bias in randomised trials on PubMed: review of publications and survey of authors. Bmj. 2005, 330: 753-10.1136/bmj.38356.424606.8F.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Lexchin J, Bero LA, Djulbegovic B, Clark O: Pharmaceutical industry sponsorship and research outcome and quality: systematic review. Bmj. 2003, 326: 1167-1170. 10.1136/bmj.326.7400.1167.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Bekelman JE, Li Y, Gross CP: Scope and impact of financial conflicts of interest in biomedical research: a systematic review. Jama. 2003, 289: 454-465. 10.1001/jama.289.4.454.

    Article  PubMed  Google Scholar 

  25. Heres S, Davis J, Maino K, Jetzinger E, Kissling W, Leucht S: Why olanzapine beats risperidone, risperidone beats quetiapine, and quetiapine beats olanzapine: an exploratory analysis of head-to-head comparison studies of second-generation antipsychotics. Am J Psychiatry. 2006, 163: 185-194. 10.1176/appi.ajp.163.2.185.

    Article  PubMed  Google Scholar 

  26. Fries JF, Krishnan E: Equipoise, design bias, and randomized controlled trials: the elusive ethics of new drug development. Arthritis Res Ther. 2004, 6: R250-255. 10.1186/ar1170.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Chalmers I: Underreporting research is scientific misconduct. Jama. 1990, 263: 1405-1408. 10.1001/jama.263.10.1405.

    Article  CAS  PubMed  Google Scholar 

  28. Rennie D: Fair conduct and fair reporting of clinical trials. Jama. 1999, 282: 1766-1768. 10.1001/jama.282.18.1766.

    Article  CAS  PubMed  Google Scholar 

  29. Krleza-Jeric K, Chan AW, Dickersin K, Sim I, Grimshaw J, Gluud C: Principles for international registration of protocol information and results from human trials of health related interventions: Ottawa statement (part 1). Bmj. 2005, 330: 956-958. 10.1136/bmj.330.7497.956.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Zarin DA, Ide NC, Tse T, Harlan WR, West JC, Lindberg DA: Issues in the registration of clinical trials. Jama. 2007, 297: 2112-2120. 10.1001/jama.297.19.2112.

    Article  CAS  PubMed  Google Scholar 

  31. Simes RJ: Publication bias: the case for an international registry of clinical trials. J Clin Oncol. 1986, 4: 1529-1541.

    CAS  PubMed  Google Scholar 

  32. Egger M, Smith GD: Bias in location and selection of studies. Bmj. 1998, 316: 61-66.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  33. Chalmers I: Unbiased, relevant, and reliable assessments in health care: important progress during the past century, but plenty of scope for doing better. Bmj. 1998, 317: 1167-1168.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. Dickersin K, Rennie D: Registering clinical trials. Jama. 2003, 290: 516-523. 10.1001/jama.290.4.516.

    Article  PubMed  Google Scholar 

  35. Levin LA, Palmer JG: Institutional review boards should require clinical trial registration. Arch Intern Med. 2007, 167: 1576-1580. 10.1001/archinte.167.15.1576.

    Article  PubMed  Google Scholar 

  36. Doucet M, Sismondo S: Evaluating solutions to sponsorship bias. J Med Ethics. 2008, 34: 627-630. 10.1136/jme.2007.022467.

    Article  CAS  PubMed  Google Scholar 

  37. Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P: Comparison of registered and published primary outcomes in randomized controlled trials. Jama. 2009, 302: 977-984. 10.1001/jama.2009.1242.

    Article  CAS  PubMed  Google Scholar 

  38. Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM: Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis. PLoS Med. 2009, 6: e1000144-10.1371/journal.pmed.1000144.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Peppercorn J, Blood E, Winer E, Partridge A: Association between pharmaceutical involvement and outcomes in breast cancer clinical trials. Cancer. 2007, 109: 1239-1246. 10.1002/cncr.22528.

    Article  PubMed  Google Scholar 

  40. Ramsey S, Scoggins J: Commentary: practicing on the tip of an information iceberg? Evidence of underpublication of registered clinical trials in oncology. Oncologist. 2008, 13: 925-929. 10.1634/theoncologist.2008-0133.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Djulbegovic B, Kumar A, Soares HP, Hozo I, Bepler G, Clarke M, Bennett CL: Treatment success in cancer: new cancer treatment successes identified in phase 3 randomized controlled trials conducted by the National Cancer Institute-sponsored cooperative oncology groups, 1955 to 2006. Arch Intern Med. 2008, 168: 632-642. 10.1001/archinte.168.6.632.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Institute for Scientific Information: Science Citation Index: Journal Citation Reports. 2005, Philadelphia, PA: Institute for Scientific Information

    Google Scholar 

  43. Dagher R, Johnson J, Williams G, Keegan P, Pazdur R: Accelerated approval of oncology products: a decade of experience. J Natl Cancer Inst. 2004, 96: 1500-1509.

    Article  PubMed  Google Scholar 

  44. Chalmers I, Adams M, Dickersin K, Hetherington J, Tarnow-Mordi W, Meinert C, Tonascia S, Chalmers TC: A cohort study of summary reports of controlled trials. Jama. 1990, 263: 1401-1405. 10.1001/jama.263.10.1401.

    Article  CAS  PubMed  Google Scholar 

  45. Kantarjian H, Pasquini R, Hamerschlak N, Rousselot P, Holowiecki J, Jootar S, Robak T, Khoroshko N, Masszi T, Skotnicki A, Hellmann A, Zaritsky A, Golenkov A, Radich J, Hughes T, Countouriotis A, Shah N: Dasatinib or high-dose imatinib for chronic-phase chronic myeloid leukemia after failure of first-line imatinib: a randomized phase 2 trial. Blood. 2007, 109: 5143-5150. 10.1182/blood-2006-11-056028.

    Article  CAS  PubMed  Google Scholar 

  46. Rochon PA, Binns MA, Litner JA, Litner GM, Fischbach MS, Eisenberg D, Kaptchuk TJ, Stason WB, Chalmers TC: Are randomized control trial outcomes influenced by the inclusion of a placebo group?: a systematic review of nonsteroidal antiinflammatory drug trials for arthritis treatment. J Clin Epidemiol. 1999, 52: 113-122. 10.1016/S0895-4356(98)00149-8.

    Article  CAS  PubMed  Google Scholar 

  47. Ioannidis JP, Lau J: Improving safety reporting from randomised trials. Drug Saf. 2002, 25: 77-84. 10.2165/00002018-200225020-00002.

    Article  PubMed  Google Scholar 

  48. Sim I, Detmer DE: Beyond trial registration: a global trial bank for clinical trial reporting. PLoS Med. 2005, 2: e365-10.1371/journal.pmed.0020365.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Salvi VS: Research trials: registration, reporting and publication. J Postgrad Med. 2005, 51: 83-84.

    PubMed  Google Scholar 

  50. Dickersin K, Min YI, Meinert CL: Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. Jama. 1992, 267: 374-378. 10.1001/jama.267.3.374.

    Article  CAS  PubMed  Google Scholar 

  51. Lee KP, Boyd EA, Holroyd-Leduc JM, Bacchetti P, Bero LA: Predictors of publication: characteristics of submitted manuscripts associated with acceptance at major biomedical journals. Med J Aust. 2006, 184: 621-626.

    PubMed  Google Scholar 

Download references


The project described was supported in part by grant KL2 RR024130 to Dr Lee from the National Center for Research Resources (NCRR), a component of the National Institutes of Health (NIH), and by grant DP0984694 to Dr Rasmussen from the Australian Research Council. The content is solely the responsibility of the authors and does not necessarily represent the official view of the NCRR or the National Institutes of Health or the Australian Research Council. The granting agencies had no role in the design and conduct of the study; collection, management, analysis and interpretation of the data; and preparation, submission, review or approval of the manuscript.

We thank Erika Campbell (UCSF) for administrative assistance and Peter Bacchetti, Ph.D., Chengshi Jin (both at UCSF) and Frances Garden (Sydney University) for help with statistical analyses. All were compensated for their work.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Nicolas Rasmussen.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

All three authors contributed to the conception and design of the study, acquisition of data, and analysis and interpretation of data. LB and NR drafted the manuscript, and all authors provided critical revision. All authors have had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Rasmussen, N., Lee, K. & Bero, L. Association of trial registration with the results and conclusions of published trials of new oncology drugs. Trials 10, 116 (2009).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: