The COMET Initiative database: progress and activities from 2011 to 2013
© Gargon et al.; licensee BioMed Central Ltd. 2014
Received: 12 March 2014
Accepted: 27 June 2014
Published: 10 July 2014
The Core Outcome Measures in Effectiveness Trials (COMET) Initiative database is an international repository of studies relevant to the development of core outcome sets. By the end of 2013, it included a unique collection of 306 studies. The website is increasingly being used, with more than 12,000 visits in 2013 (a 55% increase over 2012), 8,369 unique visitors (a 53% increase) and 6,844 new visitors (a 48% increase). There has been a rise in visits from outside the United Kingdom, with 2,405 such visits in 2013 (30% of all visits). By December 2013, a total of 4,205 searches had been completed, with 2,139 in 2013 alone.
KeywordsCore outcome set Database Resources
In January 2014, The Lancet published a series of papers addressing the important issue of waste in research that may be due to important outcomes not being assessed  or to selective reporting of outcomes . Selective reporting or nonreporting of studies and outcomes may mean that decisions made about health care and research design may not be fully informed, which in turn may lead to wasting of valuable health-care resources. The Core Outcome Measures in Effectiveness Trials (COMET) Initiative was set up to try to improve the usefulness of outcomes in research and to tackle these problems . COMET brings together people interested in the development, reporting and application of core outcome sets (COSs). These sets represent the minimum that should be measured and reported in all clinical trials of a specific condition and are also suitable for use in other types of research and clinical audit . The expectation is that the core outcomes will always be collected and reported and that researchers might also include other outcomes of particular relevance to their specific study. The existence or use of a COS does not imply that outcomes in a particular trial should be restricted to those in the relevant set. The use of COSs will make it easier for the results of trials to be compared, contrasted and combined as appropriate, thereby reducing waste in research.
The members of the COMET Initiative aim to collate and stimulate relevant resources (both applied and methodological), to facilitate the exchange of ideas and information and to foster methodological research in the area of COSs by bringing relevant material together, thus making it more accessible. For COSs to be an effective solution, they need to be easily accessible by researchers and other key groups. To date, however, it has been difficult to identify COSs because they are hard to find in the literature. This may mean that they are not used in new studies or that there is unnecessary duplication of effort in developing new COSs. The COMET Initiative seeks to tackle this problem and to reduce the possibility of waste in research by bringing these resources together in one place . The types of studies included in the database are those in which COSs have been developed, as well as studies relevant to COS development, including systematic reviews of outcomes and patients’ views. Individuals and groups who are planning or developing a COS, who have completed one or who have identified one in an ad hoc way can submit it for inclusion. The website and database were launched in August 2011, and in this letter we outline activities and progress related to the COMET website and database up to 31 December 2013 (source of data usage: Google Analytics). We provide data on the value and use of the COMET materials, as well as interest in COSs, above and beyond what might be gleaned from information on, for example, the citation of key articles.
Activity and content
Usage statistics, 2011 through 2013
Number of visits
Number of unique visitors
Number of new visitors
The majority of visits to the website were direct or via a search engine. Sixteen percent of all visits were referrals, including Twitter (14%), MRC Network of Hubs for Trials Methodology Research (7%), the Cochrane Collaboration (The Cochrane Library (5%) and the http://www.cochrane.org website (4%)), the EQUATOR Network (3%), the National Institute for Health Research (2%), BMJ blogs (2%) and the SPIRIT statement website (2%). Analyses of the website data show that half of the visitors went beyond the page on which they landed and that the most common interaction in both 2012 and 2013 was to complete a search in the COMET database. Other first interactions included moving to the page that provides an overview of the COMET Initiative, accessing the database but without completing a search and visiting the pages containing details of the COMET II or COMET III meeting or collated resources about COMET.
As noted above, a total of 4,205 searches were completed in the database from its launch in August 2011 to December 2013. The search allows the user to take a structured approach to finding COS. The most frequently applied search criteria were disease category (81%), disease name (69%), status of COS (53%), methods used (29%), stakeholders involved (24%) and type of intervention (20%). The most commonly searched terms were cancer (n = 256), consensus (n = 218) and mental health (n = 204).
Plans for the future
Several processes are underway to ensure that the COMET database is comprehensive and up-to-date. Individuals and groups who are planning or developing a COS can continue to submit it for inclusion. A systematic review designed to identify studies was recently completed and published . This review involved extensive searches of the health literature to identify studies in which the investigators sought to determine which outcomes or domains to measure in all clinical trials of a specific condition. Studies that were not already included in the COMET database are being added to it (and thus did not contribute to the number of studies reported here), and an annual search of the literature will take place to keep the database current. We are also planning a review of methodological papers to include in the COMET database. The content of the website will continue to be updated regularly, and we plan to extend the patient and public involvement resources on the website beyond the plain language summary that is currently available. We will continue to increase awareness outside the United Kingdom at meetings in Europe and the United States. The next COMET meeting (COMET IV) will be held in Rome later this year. Growing awareness of the need for COSs and increased knowledge of the COMET Initiative should continue to be reflected in the website and database usage figures, which will continue to be monitored and assessed annually.
Core Outcome Measures in Effectiveness Trials
Core outcome set(s).
We have received funding from the Medical Research Council Methodology Research Panel (grant MR/J004847/1) and the European Union Seventh Framework Programme (FP7/2007-2013 and FP7/2007-2011) under grant agreement 305081.
- Macleod MR, Michie S, Roberts I, Dirnagl U, Chalmers I, Ioannidis JPA, Al-Shahi Salman R, Chan A-W, Glasziou P: Biomedical research: increasing value, reducing waste. Lancet. 2014, 383: 101-104.View ArticlePubMed
- Chan AW, Song F, Vickers A, Jefferson T, Dickersin K, Gøtzsche PC, Krumholz HM, Ghersi D, van der Worp HB: Increasing value and reducing waste: addressing inaccessible research. Lancet. 2014, 383: 257-266.PubMed CentralView ArticlePubMed
- COMET Initiative. [http://www.comet-initiative.org] (accessed 8 July 2014)
- Clarke M: Standardising outcomes for clinical trials and systematic reviews. Trials. 2007, 8: 39-PubMed CentralView ArticlePubMed
- Williamson PR, Altman DG, Blazeby JM, Clarke M, Devane D, Gargon E, Tugwell P: Developing core outcome sets for clinical trials: issues to consider. Trials. 2012, 13: 132-PubMed CentralView ArticlePubMed
- Gargon E, Gurung B, Medley N, Altman DG, Blazeby JM, Clarke M, Williamson PR: Choosing important health outcomes for comparative effectiveness research: a systematic review. PLoS One. 2014, 9: e99111-PubMed CentralView ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.