Do trialists endorse clinical trial registration? Survey of a Pubmed sample
© Reveiz et al; licensee BioMed Central Ltd. 2007
Received: 22 March 2007
Accepted: 23 October 2007
Published: 23 October 2007
Despite intense interest in trial registration, there is a wide gap between theoretical postulates on trial registration and its implementation worldwide.
We aimed to evaluate trialists views about current international guidelines on trial registration, including the World Health Organization's (WHO) International Clinical Trials Registry Platform (ICTRP) policies and the Ottawa Statement, as well as their intention to register any future clinical trials they conduct.
We identified all 40,158 PUBMED-indexed clinical trials published from May 2005 to May 2006 using an advanced search strategy. From a random sample of 500 confirmed clinical trials, corresponding authors with e-mail contact addresses were surveyed.
A total of 275 (60%) questionnaires from 45 countries were completed. 31% of the respondents had received only nonindustry funding during the past ten years, while 5% and 61% had received only industry or mixed funding respectively. Approximately two third of participants supported registration of all 20 WHO Data Set items, and endorsed the Ottawa Statement part 1 and part 2. Delayed public disclosure of some essential data in instances where they may be considered sensitive for competitive commercial reasons was supported by 30% of the participants, whereas immediate disclosure was supported by 53%. Only 21% of participants had registered all of their ongoing trials since 2005, while 47% stated that they would provide the 20 WHO Data Set items to a publicly accessible register for all their future clinical trials; a significantly higher proportion of participants who received only nonindustry funding (62%) was found among those who would always provide the 20 WHO items for future trials, compared to 42% of participants who received mixed or only industry funding. Among those who were undecided about endorsing registration. One third of participants expressed a lack of sufficient knowledge as the primary reason.
Although disagreement was apparent on certain issues, our findings illustrate that trial registration is gradually becoming part of the current research paradigm internationally. Our results also suggest that researchers require more knowledge to inform their decision to comply with the International standards at this early stage of voluntary trial registration.
Over the past few years, several key initiatives have enabled substantial progress in the public registration of clinical trials worldwide. Major registers such as ClinicalTrials.gov and Controlled Clinical trials-ISRCTN have been recording trial protocol information since 2000, and the number of registered trials increased dramatically in 2005 after the requirement for registration was introduced by several medical journals, led by the International Committee of Medical Journal Editors (ICMJE) [1, 2]. The World Health Organization's International Clinical Trials Registry Platform (WHO ICTRP) is currently leading international efforts to implement global standards for trial registration and results reporting [2–4]. Based on both ethical and scientific reasons for trial registration, WHO is urging investigators, research institutions and companies to register all trials that prospectively test the effects of healthcare interventions on humans.
Furthermore, the Ottawa Group, an international group of individuals and organizations from the international medical research community, developed two consensus documents – the Ottawa Statement Part 1 on the principles of trial registration, and the Ottawa Statement Part 2 on the principles of its implementation The Ottawa group supported the WHO initiative as a good initial step, but called for more details of trial protocols to be prospectively registered [5–7]. The Institute of Medicine report endorses the ICJME requirement to prospectively register clinical trials as a condition for publication, as well as the pharmaceutical industry's commitment to register and post clinical trials results .
Nevertheless, despite intense interest in this topic in recent years, there is a wide gap between theoretical postulates on trial registration and its implementation worldwide. This gap may be due to differing interests of the various stakeholders involved, including researchers, patients, pharmaceutical industry, funders, governments, registries, bio-medical journal editors, and the public [9–11]. One of the biggest barriers to comprehensive trial registration is the lack of awareness by researchers about the importance of the problem . According to the Ottawa Statement part 1, "the principal investigator has a responsibility to ensure that the sponsor(s) obtains a Unique Identification number and registers his or her contact information, the protocol information and the trial results" .
Minimum data set that should be recorded for clinical trial registration, according to the International Standards launched by the World Health Organization, in 2006 (items felt to be commercially sensitive are highlighted)
Primary register trial number
Name of Primary Register, and the unique ID number assigned by the Primary Register to this trial.
Trial registration date
Date when trial was officially registered in the Primary Register.
Other identifying numbers and issuing authorities besides the Primary Register, if any
Source(s) of monetary or material support
Major source(s) of monetary or material support for the trial
The individual, organization, group or other legal entity which takes responsibility for initiating, managing and/or financing a study.
Additional individuals, organizations or other legal persons, if any, that have agreed with the primary sponsor to take on responsibilities of sponsorship.
Contact for public queries
Email address, telephone number, or postal address of the contact who will respond to general queries, including information about current recruitment status
Contact for scientific queries
Email address, telephone number, or postal address, and affiliation of the person to contact for scientific queries about the trial
Public title (of the study)
Title intended for the lay public in easily understood language.
Scientific title of the study as it appears in the protocol submitted for funding and ethical review
Countries of recruitment
The countries from which participants will be, are intended to be, or have been recruited.
Health condition or problems studied
Primary health condition(s) or problem(s) studied
Specific name of the intervention(s) and the comparator/control(s) being studied
Key inclusion and exclusion criteria
Inclusion and exclusion criteria for participant selection, including age and sex.
A single arm study is one in which all participants are given the same intervention. Trials in which participants are assigned to receive one of two or more interventions are NOT single arm studies. Crossover trials are NOT single arm studies.
A trial is "randomized" if participants are assigned to intervention groups using a method based on chance (e.g., random number table, random computer-generated sequence, minimization, adaptive randomization).
Date of the first enrollment (anticipated or actual date of the enrollment of the first study participant)
If the trial is being registered after recruitment of the first participant record actual date of Anticipated date of enrollment of the first participant.
Target sample size
Number of participants that this trial plans to enroll.
Recruitment status of the trial.
Outcomes are events, variables, or experiences that are measured because it is believed that they may be influenced by the intervention. The Primary Outcome should be the outcome used in sample size calculations, or the main outcome(s) used to determine the effects of the intervention(s).
Key secondary outcomes
Secondary outcomes are events, variables, or experiences that are of secondary interest or that are measured at timepoints of secondary interest.
The aim of our study is to evaluate trialists' views about the global standards proposed by WHO and the Ottawa Statements, as well as their intention to register any future clinical trials they conduct.
Materials and methods
We used PUBMED to identify a sample of investigators authoring clinical trial reports published from May 2005 to May 2006. The structured search filter included the following terms: "Randomized controlled trial" [PT] OR "controlled clinical trial" [PT] OR "randomized controlled trials" [MeSH] OR "random allocation" [MeSH] OR "double-blind method" [MeSH] OR "single-blind method" [MeSH] OR "clinical trial" [PT] OR "clinical trials" [MeSH] OR "clinical trial" [TW] OR "randomized trial" [TW] OR "randomised trial" [TW]. The strategy focused on humans studies and was not limited by language or type of intervention.
For this exploratory survey, we identified 40,158 references, from which a random sample of 500 clinical trials with e-mail contact addresses was selected. Titles and abstracts identified from the sample were screened by one reviewer (LR). A previous study showed that approximately 25% of articles found by the search are clinical trials and cite the e-mail of one author . The sample size was calculated assuming that 5% of emails would not reach their intended recipient. In addition, Web-based surveys have variable response rates (9 to 96%), depending on the topic, methods and participants [13, 14]. The a priori response rate was estimated to be 75%. In the absence of previous data, we estimated the proportion of trialists who would endorse registration to be 50%, yielding a sample size of 500 with a 95% confidence interval of -5% to 5%. The primary outcomes of our study were the proportion of trialists endorsing the following principles: trial registration overall, registration of all secondary outcomes, immediate public disclosure of registered protocol items, and public disclosure of trial results.
The survey was piloted on 50 participants. For the full sample, each participant was sent a survey by email containing links to the WHO ICTRP and the Ottawa Group websites [see Additional file 1]. Up to four reminders were sent. We collected the following information: country of origin, gender, age, type of funding for clinical trials over the past 10 years, main research institution, number of ongoing trials, proportion of ongoing trials registered in public databases, knowledge and support for the WHO Registration Data Set, as well as attitudes towards the Ottawa Statements (part 1 and part 2), registration of key versus all secondary outcomes, timing of public disclosure of protocol items, and disclosure of trial results.
Data were analyzed using SPSS 12.0. Chi-square tests were used to determine associations between categorical variables.
Out of 500 e-mail questionnaires, forty-two (8%) email addresses were invalid (bounced back or out-of-office autoreply). We received 275/458 (60%) replies from 45 countries. The median age of participants was 45 years (10th-90th percentiles: 33 – 57) and 70% were men. The largest number of respondents was from the United States (15%), Italy (9%), United Kingdom (6%), France (5%) and Germany (5%). However 20% of participants did not include their country of origin in the survey, which made the evaluation of response rate by country difficult.
Characteristics of respondents N = 275
n = 82
n = 193
Source of trial funding received over the past ten years
Main institution of respondents
Industry (eg. pharmaceutical, device, biologics, etc)
Trial registration issues
One third of trialists stated that they were experts or very knowledgeable about issues related to trial registration, while 56% reported having mild to moderate knowledge; 12% reported having no relevant knowledge.
64% of investigators supported registration of all 20 items of the WHO Data Set, while 6% did not support any. 65% and 63% already had or planned to endorse the Ottawa Statements (part 1 and part 2) respectively; 3% and 3% did not support the statements, while 31% and 34% respectively were undecided. The attitudes of respondents were similar regarding the Ottawa Statements and the WHO standards.
The median number of ongoing clinical trials per respondent was 3 (10th-90th percentile range: 0 – 7). Only 21% of participants had registered all of their ongoing trials. In addition only 47% of respondents stated that they would provide all 20 items of the WHO Data Set to a publicly accessible register for future clinical trials.
Between respondents receiving only non-industry funding compared to those receiving only industry or mixed funding, there were no significant differences for the proportion endorsing trial registration overall, registration of secondary outcomes, delayed disclosure of protocol items, or results registration. A significantly higher proportion of participants who received only nonindustry funding (62%) was found among those who would always provide the 20 WHO items for future trials, compared to 42% of participants who received mixed or only industry funding (X2 = 8.59; df 1, p = 0.0034).
57% of participants did not provide their names; no significant difference regarding registration of future trials was found among anonymous respondents compared to those who included their names (X2 = 12.4; df 7, p = 0.087). However more women (70%) were anonymous compared to men (47%) (X2 = 6.03; df 1, p = 0.014).
Summary of trialists' concerns regarding trial registration
We received a wide range of open comments. Common concerns were expressed related to (a) the lack of time to complete "bureaucratic" tasks (4%), (b) the possibility that registration of early (phase I) trials could deter research as their results may be misinterpreted (2%), and (c) that the results of poorly-designed trials might be confusing (1%). Three trialists expressed concern that the Ottawa Statement or the WHO initiative offers no protection from other competing investigators who may copy the trial, recruit faster and publish sooner. In addition, they mentioned the administrative burden of handling additional public queries as well as contractual obligations to sponsors would be difficult to handle. Other participants stated that some countries have limited internet access, and that registration should be a tool for protecting the patient's rights rather than yet another means of over-burdening researchers.
Our survey provides useful information about trialists' attitudes towards clinical trial registration. Although more than 60% of respondents support both the WHO 20-item Data Set and the Ottawa Statements (parts 1 and 2), only 47% declared that they would always provide the WHO Data Set to a publicly accessible register for future clinical trials. In addition a third of participants were undecided regarding trial registration while a small minority rejected it outright.
The proposal by WHO and the Ottawa Group to submit protocol information at trial inception as well as results to a freely accessible public register is a crucial step towards promoting research transparency. However, countries have different legal requirements and most do not require public registration of all clinical trials. They also have diverse levels of public disclosure of information. For example all entities conducting clinical trials of experimental treatments for serious or life-threatening conditions or diseases in the United States (US) are required to submit certain information to the ClinicalTrials.gov register, which is a publicly accessible database. However the US legislation does not include other type of diseases, and does not require the registration of all 20 items suggested by WHO. Furthermore, information on Phase I trials of drugs and devices is not publicly available unless they have been approved by the US Food and Drug Administration . It is evident that there is a need for comprehensive legislation on trial registration. Otherwise, when ongoing or completed trials remain hidden, researchers may be unknowingly and inappropriately duplicating trials on similar interventions that had already been shown in previous trials to have serious adverse events or no benefit.
Our survey demonstrated greater support for immediate rather than delayed disclosure of information submitted to trial registers (53% vs. 30%), Figure 1. However, some researchers argue that confidentiality issues and contractual obligations with sponsors would be difficult to handle if they decided to register all clinical trials in a publicly accessible register. Some stakeholders also claim that disclosure of all 20 WHO data set items may sometimes endanger proprietary rights. However others argue that delayed disclosure would facilitate registration of incomplete information for a given trial, and hidden trial information would not meet ethical and scientific standards [4, 16–18]. In addition, trial participants are already informed about a given study as part of the informed consent process, and intelligence companies provide detailed data about pipeline drugs at a cost; thus this information is not secret [19, 20]. Furthermore, informed choice about which particular trial to join requires that information about all ongoing trials be available to each potential trial participant.
A universal requirement for clinical trial registration as a condition of ethics approval would level the playing field and address concerns over competitive disadvantage . In the interim, voluntary registration of clinical trial information remains an important first step, and dissemination strategies to inform researchers about trial registration are thus needed, particularly in developing countries.
More participants supported registration and disclosure of only key rather than all secondary outcomes. Use of the adjective "key" introduces subjectivity in its definition, as outcomes may be considered as non-key by some researchers but essential by others.
Some concerns have been raised regarding Web based surveys including coverage bias or bias due to sampled individuals not having or choosing not to access the Internet [22–24]. There was selection bias due to less than half of the authors having e-mail addresses listed in the publication. For example there were 8 publications from Russia but no electronic addresses were available. Furthermore a substantial percentage of those with valid email addresses did not respond. There are also limitations related to PubMed. Although the MEDLINE database indexes more than 3500 biomedical journals, it excludes many existing trials and authors worldwide. In addition PUBMED may be biased toward English-language journals and has poorer coverage of European journals than compared to other databases. Considering that 74% of respondents were from non-English speaking countries, there was unlikely to be language bias from the survey being in English.
It should also be noted that there were few participants from commercial or government institutions.
At the same time, participants who had some knowledge about trial registration may have been more able to respond. It is highly probable that a number of respondents may have needed more knowledge about trial registration to answer specific questions, although we provided links to relevant information on the Internet.
It is disappointing that although 64% of participants endorsed trial registration, only 47% stated that they would always provide at least all 20 WHO Data Set items for future trials. This finding may reflect their concerns over academic or commercial interests.
Selective reporting of information about ongoing and completed trials is harmful for society as it violates ethical and scientific responsibilities, and distorts the body of evidence available for clinical decision-making. Voluntary registration of clinical trial information is an important and complex initial step that has the support of almost half of trialists. Dissemination strategies to inform researchers about the process and benefits of trial registration are needed to improve compliance.
The authors thank Enrique Hernandez for his technical assistance for performing the Web Questionnaire.
- De Angelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJ, Schroeder TV, Sox HC, Van Der Weyden MB: International Committee of Medical Journal Editors. Is this clinical trial fully registered? A statement from the International Committee of Medical Journal Editors. Ann Intern Med. 2004, 141: 477-8. Accessed 19 February 2007.http://www.icmje.org/clin_trialup.htmView ArticlePubMed
- DeAngelis C, Drazen JM, Frizelle FA, Haud C, Hoey J, Horton R: Clinical trial registration: a statement from the International Committee of Medical Journal Editors. N Engl J Med. 2004, 351: 1250-1. 10.1056/NEJMe048225.View Article
- World Health Organization (2005) World Health Organization international clinical trials registry platform: New standards for registration of human medical research. Geneva: World Health Organization, Accessed 17 October 2006.http://www.who.int/ictrp/en/
- Sim I, Chan AW, Gulmezoglu AM, Evans T, Pang T: Clinical trial registration: transparency is the watchword. Lancet. 2006, 367 (9523): 1631-3. 10.1016/S0140-6736(06)68708-4.View ArticlePubMed
- Krleza-Jeric K, Chan AW, Dickersin K, Sim I, Grimshaw J, Gluud C, (for the Ottawa group): Principles for international registration of protocol information and results from human trials of health related interventions: Ottawa statement (part 1). BMJ. 2005, 330 (7497): 956-8. 10.1136/bmj.330.7497.956.PubMed CentralView ArticlePubMed
- The Ottawa Group: The Ottawa Statement, Part one: Principles for international registration of protocol information and results from human trials of health related interventions. Accessed 17 October 2006. http://ottawagroup.ohri.ca/
- The Ottawa Group: Draft – The Ottawa Statement, Part Two: Principles of operationalisation for international trial registration. N Engl J Med. 2005, 352 (23): 2436-8. Accessed 17 October 2006. Jun 9http://ottawagroup.ohri.ca/statement2.htmlView Article
- Committee on the Assessment of the US Drug Safety System: The Future of Drug Safety: Promoting and Protecting the Health of the Public. Accessed in June 2007.http://www.nap.edu/catalog/11750.html#toc
- Dickersin K, Rennie D: Registering Clinical Trials. JAMA. 2003, 290: 516-523. 10.1001/jama.290.4.516.View ArticlePubMed
- KrleŽa-Jerić K: Clinical Trial Registration: The Differing Views of Industry, the WHO, and the Ottawa Group. PLoS Med. 2005, 2 (11): e378-10.1371/journal.pmed.0020378.PubMed CentralView ArticlePubMed
- Reveiz L, Delgado MB, Urrutia G, Ortiz Z, Garcia Dieguez M, Marti-Carvajal A: The Latin American Ongoing Clinical Trial Register (LATINREC). Rev Panam Salud Publica. 2006, 19 (6): 417-22. 10.1590/S1020-49892006000600014.View ArticlePubMed
- Reveiz L, Cardona AF, Ospina EG, de Aguiar S: An e-mail survey identified unpublished studies for systematic reviews. J Clin Epidemiol. 2006, 59 (7): 755-8. 10.1016/j.jclinepi.2005.11.022.View ArticlePubMed
- Braithwaite D, Emery J, De Lusignan S, Sutton S: Using the Internet to conduct surveys of health professionals: a valid alternative?. Fam Pract. 2003, 20 (5): 545-51. 10.1093/fampra/cmg509.View ArticlePubMed
- Eysenbach G, Wyatt J: Using the Internet for surveys and health research. J Med Internet Res. 2002, 4 (2): E13-10.2196/jmir.4.2.e13.PubMed CentralView ArticlePubMed
- Turner EH: A Taxpayer-Funded Clinical Trials Registry and Results Database. PLoS Med. 2004, 1 (3): e60-10.1371/journal.pmed.0010060.PubMed CentralView ArticlePubMed
- Lemmens T, Bouchard R: Comments on the Legal, Regulatory and Ethical Aspects of the WHO Clinical Trial Registry Platform. Submitted as part of the Formal Consultation on Disclosure Timing Policy. Accessed in November 2006.http://www.who.int/ictrp/011_Lemmens_Bouchard_5April06.pdf
- Laine C, Horton R, DeAngelis C, Drazen J, Frizelle F, Godlee F, Haug C, Hebert P, Kotzin S, Marusic A, Sahni P, Schroeder T, Sox H, Van der Weyden M, Verheugt F: International Committee of Medical Journal Editors (ICMJE). Clinical trial registration: looking back and moving ahead. N Engl J Med. 2007, 356 (26): 2734-6. 10.1056/NEJMe078110.View ArticlePubMed
- Gotzsche P: Disclosures should not be delayed. Accessed in November 2006.http://www.who.int/ictrp/006-Peter_Gotzsche_31March06.pdf
- Pharmaceutical R&D Pipeline News.http://www.Pharmaprojects.com
- BioPharm Insight.http://www.infinata5.com/biopharmfree
- Godlee F: An international standard for disclosure of clinical trial information. BMJ. 2006, 332: 1107-1108. 10.1136/bmj.332.7550.1107.PubMed CentralView ArticlePubMed
- Eysenbach G, Wyatt J: Using the Internet for surveys and health research. J Med Internet Res. 2002, 4 (2): E13-10.2196/jmir.4.2.e13.PubMed CentralView ArticlePubMed
- Schleyer TK, Forrest JL: Methods for the design and administration of web-based surveys. J Am Med Inform Assoc. 2000, 7 (4): 416-25.PubMed CentralView ArticlePubMed
- Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I, Cooper R: Methods to increase response rates to postal questionnaires. Cochrane Database of Systematic Reviews. 2007, Art. No.: MR000008.DOI: 10.1002/14651858, 2View Article
- International Clinical Trials Registry Platform (ICTRP).http://www.who.int/ictrp/data_set/en/
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.