- Open Access
- Open Peer Review
Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal 'Instructions to Authors'
© Hopewell et al; licensee BioMed Central Ltd. 2008
- Received: 21 January 2008
- Accepted: 18 April 2008
- Published: 18 April 2008
The CONSORT Statement provides recommendations for reporting randomized controlled trials. We assessed the extent to which leading medical journals that publish reports of randomized trials incorporate the CONSORT recommendations into their journal and editorial processes.
This article reports on two observational studies. Study 1: We examined the online version of 'Instructions to Authors' for 165 high impact factor medical journals and extracted all text mentioning the CONSORT Statement or CONSORT extension papers. Any mention of the International Committee of Medical Journal Editors (ICMJE) or clinical trial registration were also sought and extracted. Study 2: We surveyed the editor-in-chief, or editorial office, for each of the 165 journals about their journal's endorsement of CONSORT recommendations and its incorporation into their editorial and peer-review processes.
Study 1: Thirty-eight percent (62/165) of journals mentioned the CONSORT Statement in their online 'Instructions to Authors'; of these 37% (23/62) stated this was a requirement, 63% (39/62) were less clear in their recommendations. Very few journals mentioned the CONSORT extension papers. Journals that referred to CONSORT were more likely to refer to ICMJE guidelines (RR 2.16; 95% CI 1.51 to 3.08) and clinical trial registration (RR 3.67; 95% CI 2.36 to 5.71) than those journals which did not.
Study 2: Thirty-nine percent (64/165) of journals responded to the on-line survey, the majority were journal editors. Eighty-eight percent (50/57) of journals recommended authors comply with the CONSORT Statement; 62% (35/56) said they would require this. Forty-one percent (22/53) reported incorporating CONSORT into their peer-review process and 47% (25/53) into their editorial process. Eighty-one percent (47/58) reported including CONSORT in their 'Instructions to Authors' although there was some inconsistency when cross checking information on the journal's website. Sixty-nine percent (31/45) of journals recommended authors comply with the CONSORT extension for cluster trials, 60% (27/45) for harms and 42% (19/45) for non-inferiority and equivalence trials. Few journals mentioned these extensions in their 'Instructions to Authors'.
Journals should be more explicit in their recommendations and expectations of authors regarding the CONSORT Statement and related CONSORT extensions papers.
- Journal Editor
- Reporting Guideline
- Consort Statement
- Equivalence Trial
- Clinical Trial Registration
It is over ten years since the CONSORT (Consolidated Standards of Reporting Trials) Statement was first published in 1996  providing recommendations for reporting parallel group randomized controlled trials (RCTs). CONSORT provides recommendations for authors regarding how to prepare reports of trial findings, facilitating their complete and transparent reporting, and aiding their critical appraisal and interpretation. It has been endorsed by the World Association of Medical Editors (WAME), the International Committee of Medical Journal Editors (ICMJE), the Council of Science Editors (CSE), and well over 200 journals worldwide . The revised CONSORT Statement of 2001  has been translated into several languages and cited in journals over 1,300 times.
In addition to the CONSORT Statement, which provides recommendations for reporting parallel group randomized trials, extensions have been developed to give additional guidance for randomized trials with specific designs, data and interventions. These included the CONSORT extensions for cluster trials , non-inferiority and equivalence trials , herbal interventions , non-pharmacological interventions , abstracts  and harms .
Several studies have assessed the impact of using the CONSORT Statement to improve the reporting of RCTs in journal articles. Eight studies were summarized in a systematic review by Plint and colleagues , who concluded that journal adoption of the CONSORT Statement is associated with improved reporting of randomized trials although poor reporting remains common.
In 2003, Altman conducted a study of journal endorsement of the CONSORT Statement and found that seven years following its initial publication, and two years after its update, only 22% of 166 high impact factor journals provided any mention of CONSORT in their published 'Instructions to Authors' . Four years have elapsed since this journal endorsement survey and we believe it is again timely to assess the impact of the CONSORT Statement and determine the extent to which journals that publish reports of randomized trials incorporate the CONSORT recommendations into their journal and editorial processes.
We set out to determine the extent to which leading medical journals incorporate the CONSORT Statement and related extension papers in their published 'Instructions to Authors'. We also sought to survey journal editors' opinions about endorsement of the CONSORT Statement and related CONSORT extension papers and their incorporation into the editorial and peer-review process.
Journals were selected using the strategy adopted by Altman . Using citation impact factors (via ISI Web of Knowledge) for 2006, we identified the top five journals from each of the 33 medical specialties and the top 15 journals for general and internal medicine. Journals that did not publish clinical research (based on explicit statement or inspection of journal contents) were excluded and replaced by the next one on the list.
Survey of journals' published 'Instructions to Authors'
For each of the journals in the sample, we examined the 'Instructions to Authors' published on the journal's website (searched between July and October 2007) and extracted all text mentioning CONSORT or CONSORT extension papers (cluster, non-inferiority and equivalence, herbal and harms). Any mention of the ICMJE's 'Uniform Requirements for Manuscripts Submitted to Biomedical Journals' or reference to clinical trial registration were also sought and extracted.
Survey of journal editors
For each of the journals in the sample, we contacted via email the editor-in-chief, or editorial office if contact details for this person were not available (depending on the contact information included on the journal website), asking them to complete a short on-line survey (conducted between 6 August and 8 October 2007 using Survey Monkey). Two email reminders were sent to encourage editors to complete the on-line survey. The survey asked about their journal's endorsement of the CONSORT Statement, whether CONSORT is included in their 'Instructions to Authors', and if it is incorporated into their editorial and peer-review processes and, if so, how. Journal editors were also asked whether they recommended or required authors to comply with any of the CONSORT extension papers (cluster, non-inferiority and equivalence, herbal and harms). The on-line survey of journal editors' endorsement of CONSORT allows a direct comparison with what is reported in their journal's published 'Instructions to Authors' on their journal's website.
One hundred and eighty journals were identified, of which 15 were duplicates (i.e. listed in another medical speciality) and excluded; 165 journals were included in our sample.
Survey of journals' published 'Instructions to Authors'
Of the 165 journals, 62 (38%) mentioned the CONSORT Statement in their 'Instructions to Authors' published on their journal's website. This is a relative increase of 73% from the survey in 2003 , when 36 (22%) of the 166 journals provided any mention of CONSORT. One-hundred and twenty-one journals were included in both the 2003 and 2007 samples; of these, 32 (26%) of 121 journals in 2003 provided any mention of CONSORT compared to 47 (39%) in 2007, a relative increase of 50%.
Mentioned in journals published 'Instructions to Authors'
N = 165 (%)
Submit with checklist
2001 journal article
2001 exploratory article
Article citing 2001 article
1996 journal article (out-of-date)
Non-inferiority and equivalence extension
Suitable reference (article > 2000)
Obsolete reference (article < 2000)
Cites WHO International Clinical Trial Registry Platform
Cites a combination of the above
The majority of journals (n = 46) mentioning the CONSORT Statement gave the web address , while 18 referred to the latest version of the publication. Only one journal referred to the full explanatory publication , however, and six journals still referred to the out-of-date 1996 Statement .
Of the 165 journals, 69 (42%) referred to the ICMJE guidelines in their published 'Instructions to Authors'. This is a slight decrease from when this survey was last carried out in 2003, when 72 of the 166 (43%) journals referred to the ICMJE guidelines. The majority of journals (n = 48) referred to ICMJE the web address, including three which also referred to a recent publication. The remaining 15 journals cited an obsolete journal publication (i.e. published before 2000), while six included no reference. Journals that referred to CONSORT were much more likely to refer to the ICMJE guidelines (39/62; 63%) than those journals that did not refer to CONSORT (30/103; 29%) (relative risk 2.16; 95% confidence interval (CI) 1.51 to 3.08).
Sixty-one (37%) of the 165 journals mentioned clinical trial registration in their 'Instruction to Authors', of which 44 specifically stated that all recent clinical trials must be registered as a requirement of submission to that journal. A further 17 journals were less clear in their recommendations and, while they encouraged clinical trial registration, this was not a specific requirement. Cited sources of information about trial registration included the ICMJE web address (n = 23), ClinicalTrials.gov (n = 9) and the WHO International Clinical Trials Registry Platform (n = 4); the other 10 journals cited a combination of these sources. Again, journals that referred to CONSORT were much more likely to mention clinical trial registration (42/62; 68%) than those journals that did not refer to CONSORT (19/103; 18%) (relative risk 3.67; 95% CI 2.36 to 5.71).
Those journals which provided some mention of the CONSORT Statement in their 'Instructions to Authors' were also much more likely to include information about other reporting guidelines. These included QUOROM (13/165; 8%), MOOSE (7/165; 4%), REMARK (1/165; 1%), STROBE 4/165; 2%) and TREND (1/165; 1%); all mentioned CONSORT in their 'Instructions to Authors'.
Survey of journal editors
Survey of journals editors' endorsement of the CONSORT Statement
N = 64* (%)
Person completing survey
Editor in chief
Journal recommends authors comply with the CONSORT Statement
Journal requires authors comply with the CONSORT Statement
Journal mentions the CONSORT Statement in its 'Instructions to Authors'
Journal incorporates the CONSORT Statement in its peer review process
Journal incorporates the CONSORT Statement in its editorial process
For 50 (50/57; 88%) journals, responders said that their journal recommended that authors comply with the CONSORT Statement; for 35 (35/56; 62%) journals this was a requirement (Table 2). Most respondents (47/58; 81%) also said that their journal mentioned the CONSORT Statement in its 'Instructions to Authors'. However, there is some inconsistency, as when subsequently cross checking the information provided on the journal's website under 'Instructions to Authors', 11 of the 47 journals provided no mention of the CONSORT Statement despite indicating in the on-line survey that they did.
Just under half of journals (22/53; 41%) said that they incorporated the CONSORT Statement into their peer-review process. A similar proportion of journals (25/53; 47%) said that they incorporated the CONSORT Statement into their editorial process. Examples of how this was achieved include "requiring authors to include a CONSORT flow diagram and completed checklist with their manuscript submission", "editors pre-screening and returning non compliant manuscripts directly to the authors", "including the CONSORT checklist for download on the peer review website alongside the submitted manuscript", "including information about the CONSORT Statement in the instructions for peer review", and "including the CONSORT Statement as part of the editorial checklist".
Survey of journals editors' endorsement of extensions to the CONSORT Statement *
Journal recommends authors comply with the CONSORT
Non-inferiority and equivalence extension
Journal requires authors comply with the CONSORT
Non-inferiority and equivalence extension
Journal mentions CONSORT extension in its 'Instructions to Authors'
Non-inferiority and equivalence extension
Despite journal editors' responses about extensions to the CONSORT Statement, few actually mentioned these extensions in their 'Instructions to Authors' (Table 3).
The CONSORT Statement aims to improve the quality of reports of randomized trials. It is encouraging that over a third (38%) of high impact factor journals, assessed in our study, refer to the CONSORT Statement in their published 'Instruction to Authors'. This represents a relative increase of 73% since this study was last conducted in 2003 when only 22% of journals mentioned CONSORT in their 'Instruction to Authors' . Some journals, however, still refer to the superseded 1996 version of the CONSORT Statement and we would encourage journals to keep their 'Instructions to Authors' up-to-date.
There is, however, still ambiguity in the wording of some journals' published 'Instructions to Authors' as to whether they require, or recommend, that authors comply with the CONSORT Statement . We believe that journals should provide a clear message to their authors and recommend authors submit a completed CONSORT flow diagram and checklist as a requirement to submission in an endorsing journal. Only by endorsement of the CONSORT Statement by more journals, and greater editorials efforts to ensure that authors comply, can the quality of reporting of randomized trials published in leading journals be improved .
In September 2004, the members of the ICMJE published a joint editorial stating that they would only consider a trial for publication if it has been registered before the enrolment of the first patient . In our study, over a third (37%) of journals required recent clinical trials to be registered as a requirement of submission to that journal. Disappointingly, a number of these journals did not provide the same endorsement of the CONSORT Statement despite recognising the importance of trial registration which, by itself, is not the best marker of trial quality.
It is also disappointing that so few journals endorse the recent extensions to the CONSORT Statement [4–6, 9]. These extensions reflect a considerable amount of work and were developed to improve the reporting and transparency of trials using specific designs and types of data. Other CONSORT extensions have very recently been published [7, 8] and others are being developed. We would recommend that journals reference these extensions in their 'Instructions to Authors' thereby helping authors wanting to improve the reporting of their randomized trials.
One obvious limitation of our study is that, despite several electronic reminders, there was a poor response rate (39%) to the on-line survey of journal editors' endorsement of CONSORT. As might be expected journals which endorsed CONSORT were more likely to respond (61%) to the survey than those journals which did not (39%). However, despite this limitation the results of this survey are still of interest, in particular, to those journals who said they would require, or recommend, authors comply with the CONSORT Statement but do not mention this in their 'Instructions to Authors'. This is particularly apparent for CONSORT extensions. In response to the survey two journal editors said that they were in the process of updating their journals' 'Instructions to Authors'. It is possible that these instructions were updated during the study period; however, the numbers are very small and would not affect our results. We note however, that there was inconsistency between editors' responses and the information on the journal's website under 'Instructions to Authors', especially in relation to the support of extensions to CONSORT.
Similar to the CONSORT Statement for reporting the results of randomized trials, other reporting guidelines exist which provide advice on how to report research methods and findings for other types of study designs. In our study journals which endorsed the CONSORT Statement were more likely to endorse other reporting guidelines, although the numbers were very low. The EQUATOR Network  is a new initiative which aims to increase awareness of good reporting guidelines in health research and thus improve the quality of scientific publications. We hope the work of this initiative will lead to better endorsement by journals of these important reporting guidelines.
In summary, we believe that the CONSORT Statement, and its related extensions papers, will only continue to improve the quality of reports of randomized trials, if more journals endorse this initiative and, most importantly, require authors to comply as a condition of publication. The most obvious route through which this could be achieved is for journals to incorporate the CONSORT checklist and flow diagram into their editorial and peer-review processes and reflect this requirement in their published 'Instructions to Authors'. Without wide endorsement of the CONSORT Statement it cannot fully yield the benefits for which it was intended.
We are very grateful to all those who responded to the on-line survey. The CONSORT website and list of CONSORT endorsing journals has recently been updated as a result of this study. This study has been carried out as part of a grant to support the work of the CONSORT Group, funded by the National Coordinating Centre for Research Methodology on behalf of the Department of Health in the UK. DM is funded by a University of Ottawa Research Chair.
- Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D, Schulz KF, Simel D, Stroup DF: Improving the quality of reporting of randomized controlled trials: the CONSORT statement. JAMA. 1996, 276 (8): 637-639. 10.1001/jama.276.8.637.View ArticlePubMedGoogle Scholar
- Altman DG: Endorsement of the CONSORT statement by high impact medical journals : survey of instructions for authors. BMJ. 2005, 330 (7499): 1056-1057. 10.1136/bmj.330.7499.1056.View ArticlePubMedPubMed CentralGoogle Scholar
- Moher D, Schulz KF, Altman DG, for the CONSORT Group: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001, 357 (9263): 1191-1194. 10.1016/S0140-6736(00)04337-3.View ArticlePubMedGoogle Scholar
- Campbell MK, Elbourne DR, Altman DG, for the CONSORT Group: CONSORT statement: extension to cluster randomised trials. BMJ. 2004, 328 (7441): 702-708. 10.1136/bmj.328.7441.702.View ArticlePubMedPubMed CentralGoogle Scholar
- Piaggio G, Elbourne DR, Altman DG, Pocock SJ, Evans SJW, for the CONSORT Group: Reporting of noninferiority and equivalence randomized trials: an extension of the CONSORT statement. JAMA. 2006, 295 (10): 1152-1160. 10.1001/jama.295.10.1152.View ArticlePubMedGoogle Scholar
- Gagnier JJ, Boon H, Rochon P, Moher D, Barnes J, Bombardier C, for the CONSORT Group: Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement. Ann Intern Med. 2006, 144 (5): 364-367.View ArticlePubMedGoogle Scholar
- Boutron I, Moher D, Altman DG, Schulz K, Ravaud P, for the CONSORT Group: Extending the CONSORT Statement to randomized trials of nonpharmacologic treatment: an explanation and elaboration. Ann Intern Med. 2008, 148: 295-309.View ArticlePubMedGoogle Scholar
- Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, and the CONSORT Group: CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med. 2008, 5 (1): e20-10.1371/journal.pmed.0050020.View ArticlePubMedPubMed CentralGoogle Scholar
- Ioannidis JP, Evans SJ, Gotzsche PC, O'Neill RT, Altman DG, Schulz K, Moher D, for the CONSORT Group: Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004, 141 (10): 781-788.View ArticlePubMedGoogle Scholar
- Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006, 185 (5): 263-267.PubMedGoogle Scholar
- CONSORT: transparent reporting of trials. Accessed 20 February 2008, http://www.consort-statement.org
- Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gøtzsche PC, Lang T, for the CONSORT Group: The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001, 134 (8): 663-694.View ArticlePubMedGoogle Scholar
- De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Marusic A, Sahni P, Schroeder TV, Sox HC, Van der Weyden MB, Verheugt FW: Clinical trial registration: a statement from the International Committee of Medical Journal Editors. Ann Intern Med. 2004, 141 (6): 477-478.View ArticlePubMedGoogle Scholar
- EQUATOR Network: Enhancing the QUAlity and Transparency Of health Research. Accessed 20 February 2008, http://www.equator-network.org
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.