- Open Access
The COMET Initiative database: progress and activities update (2015)
Trials volume 18, Article number: 54 (2017)
This letter describes the substantial activity on the Core Outcome Measure in Effectiveness Trials (COMET) website in 2015, updating our earlier progress reports for the period from the launch of the COMET website and database in August 2011 to December 2014. As in previous years, 2015 saw further increases in the annual number of visits to the website, the number of pages viewed and the number of searches undertaken. The sustained growth in use of the website and database suggests that COMET is continuing to gain interest and prominence, and that the resources are useful to people interested in the development of core outcome sets.
As the New Year bells were ringing and the fireworks were exploding to welcome 2016 in cities such as Fray Bentos in South America, an Internet user in Tianjin, China ran the 10,000th search of the Core Outcome Measures in Effectiveness Trials (COMET) database. They were looking for information about non-small-cell lung cancer (NSCLC), and will have been shown details of two core outcome sets (COS) recently added to the database [1, 2]. This letter describes the substantial activity on the COMET website  in the 365 days before that search. We update our earlier progress since the launch of the COMET website and database in August 2011 to December 2014 [4, 5].
Activity and content
A total of 720 studies relevant to the development of COS were included in the COMET database at the end of December 2015, with 147 added during the year. This included 32 reports relating to 29 COS identified in the most recent update to the systematic review of COS , which had originally been performed in 2013 .
As in previous years, 2015 saw further increases in the annual number of visits to the website (Table 1) and although the proportional change declined in 2015, the absolute numbers continue to increase. For instance, the proportional increase in new visitors from 2014 to 2015 was 33%, compared to 43% for 2013 to 2014; but the absolute increase from 2014 to 2015 was 3269 compared to 2936 for 2013 to 2014. Most visitors to the website arrived either via links following an organic search using a search engine, such as Google (68%), or direct (20%) (Fig. 1). However, new for 2015, were arrivals from links in emails, which is in large part attributable to the move of the COMET newsletter from a PDF format to an email format.
Social media also leads many people to the website and Twitter accounted for 89% of social referrals to the COMET website in 2015 (Table 2). The COMET Twitter account is monitored by the research team and tweets are sent when new COS papers are published, to announce relevant presentations at conferences and to retweet COS-related tweets from others that we follow. The COMET account has more than 1300 followers and the Twitter page links to the COMET website.
The highest proportions of referrals were from the Core Outcomes in Women’s Health (CROWN) Initiative (10%), the University of Liverpool (6%), Trials journal (5%), MRC Hubs for Trials Methodology Research (5%), Cochrane Canada (5%) and the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) initiative (4%). CROWN is an international initiative to harmonise outcome reporting in women’s health research. More than 70 journals have committed to encouraging the development and reporting of COS in this area and CROWN advises all COS developers to register with COMET . Trials has published several COS papers which generated referrals to the COMET website, including ‘Developing core outcome sets for clinical trials: issues to consider’ , the special collection of the meeting proceedings and abstracts from the 4th COMET meeting in Rome in November 2014, and the report of the first meeting to discuss Trial Forge . The 5th COMET meeting was jointly hosted with Cochrane Canada in Calgary in May 2015, hence the large number of referrals from Cochrane Canada, and the more than doubling in the annual number of visits from Canada, from 624 in 2014 to 1449 in 2015 (Table 3). The referrals from SPIRIT reflect that initiative’s encouragement of trial investigators to consider measuring the outcomes in a COS in their trial as part of their effort to improve the quality of clinical trial protocols by defining an evidence-based set of items to address in a protocol.
In 2015, there were a total 80,799 page views, a 10% increase from 73,617 in 2014. Analyses of the COMET website data show that 56% of visitors went beyond the page on which they landed in 2015, similar to 2014 and, as in previous years, the most common first interaction was to search the COMET database. Other first interactions included moving to the overview of the COMET Initiative, accessing the database without completing a search, and checking the resources page. This Core Resource Pack is once again the second most highly accessed resource on the website (after the database), with 1372 page views in 2015, compared to 1064 in 2014 (29% increase).
The total number of visits increased by 25% in 2015 compared to 2014.The number of unique visitors also increased by 25%, and the number of new visitors increased by 33%. Full details are provided in Table 1. Visitors came from 127 countries, with 53% of visits now coming from outside the UK, an increase of 2% from 8565/16,768 in 2014 to 11,090/20,952 in 2015 (Table 3).
By the end of December 2015 in the time zone of the COMET website, a total of 9999 searches had been undertaken in the COMET database, with 3411 in 2015 alone (a 43% increase from 2014). The most frequently used search criteria were consistent with previous years with the most frequently searched category being Disease Category. The ‘top 10’ searched for terms are shown in Table 4. In 2014, the most commonly searched term was ‘cancer’ (n = 129) and although this increased to 137 searches in 2015, it was superseded in 2015 by ‘pregnancy and childbirth’ (n = 193).
In 2015, we conducted a pop-up survey to find out why people were searching in the COMET database. The survey appeared at the beginning of each search during a 1-month period, asking people to select single response to give their reason for searching in the COMET database. Full details of the survey have been published  but, in summary, it showed that the most common reasons for searching the database were to inform decision-making about developing a COS, or to inform the outcomes in planning a clinical trial. The pop-up survey also confirmed the importance of keeping the contents of the database up to date, if it is to help researchers to avoid unnecessary duplication of effort and minimise waste .
The sustained growth in use of the website and database suggests that COMET is continuing to gain interest and prominence, and that the resources are useful to people interested in COS development. To help ensure that the content is kept up to date a second update of the systematic review of COS [1, 2] is underway and the COMET website and database usage figures will continue to be monitored and assessed annually.
Core Outcome Measures in Effectiveness Trials
Core outcome set(s)
Core Outcomes in Women’s Health
Non-small-cell lung cancer
Standard Protocol Items: Recommendations for Interventional Trials
Gargon E, et al. Choosing important health outcomes for comparative effectiveness research: a systematic review. PLoS One. 2014;9(6):e99111.
Gorst SL, et al. Choosing important health outcomes for comparative effectiveness research: an updated review and user survey. PLoS One. 2016;11(1):e0146444.
COMET. Core Outcome Measures in Effectiveness Trials. Available from: www.comet-initiative.org. Accessed 27 Jan 2017.
Gargon E, et al. The COMET Initiative database: progress and activities from 2011 to 2013. Trials. 2014;15(1):279.
Gargon E, et al. The COMET Initiative database: progress and activities update (2014). Trials. 2015;16(1):515.
Khan K. The CROWN Initiative: journal editors invite researchers to develop core outcomes in women’s health. J Ovarian Res. 2015;8(1):6.
Williamson PR, et al. Developing core outcome sets for clinical trials: issues to consider. Trials. 2012;13(1):132.
Treweek S, et al. Making randomised trials more efficient: report of the first meeting to discuss the Trial Forge platform. Trials. 2015;16:261.
Ioannidis JPA, et al. Increasing value and reducing waste in research design, conduct, and analysis. Lancet. 2014;383(9912):166–75.
Ms. Mel Major, Associate Professor Marike vander Schaaf and Professor Dale Needham consent for their Twitter profiles and tweets to be used in this manuscript.
This work was supported by the MRC North West Hub for Trials Methodology Research (MR/K025635/1), and the NIHR Senior Investigators Award (NF-SI_0513-10025).
Availability of data and materials
Not applicable (but data used to prepare the tables is available from the authors).
EG and MC conceived the idea for these periodic reports. EG performed the analysis. EG, PW, MC, JB, ST and DA interpreted data. EG wrote the manuscript. All authors read and approved the final manuscript.
DA, JB, MC, ST and PW are members of the COMET Management Group and coapplicants on grants to support COMET and related work. EG is a member of the COMET Management Group and is the COMET project coordinator.
Consent for publication
Ethics approval and consent to participate
About this article
Cite this article
Gargon, E., Williamson, P.R., Altman, D.G. et al. The COMET Initiative database: progress and activities update (2015). Trials 18, 54 (2017). https://doi.org/10.1186/s13063-017-1788-8
- Core outcome set