SCORE-IT (Selecting Core Outcomes for Randomised Effectiveness trials In Type 2 diabetes): a systematic review of registered trials

Background Outcomes measured in clinical trials should be meaningful to patients, healthcare professionals and researchers, yet there is heterogeneity in the outcomes used across trials. This inconsistency impacts on the ability to compare findings and may mean that the results have little importance to healthcare professionals and the patients that they care for. The aim of the present study is to review the outcomes used in registered trials of therapies for type 2 diabetes mellitus as the first step in the development of a core outcome set for effectiveness trials in type 2 diabetes. Methods A systematic review of clinicaltrials.gov entries was completed for randomised, open (actively recruiting or in follow-up period), phase 3 and 4 trials of type 2 diabetes mellitus in adults. Trials of the treatment of diabetes complications, co-morbidities, prevention and surgery were excluded. Each trial was screened for eligibility and outcomes extracted from the primary and secondary outcomes data fields and free text study information. The outcomes were recorded verbatim and classified into core outcome domains according to the COMET taxonomy. Results A total of 354 trial registrations were reviewed for eligibility and 138 trials included. In total, 1444 outcomes were extracted with a median of eight outcomes per trial (range = 1–60). Outcomes were categorised into 30 different outcome domains according to the COMET taxonomy, but no single domain or outcome was measured in 100% of trials. The majority of trials (88%) included outcomes in the ‘metabolism and nutrition’ domain, such as lipids and lipoproteins (21%), HbA1c (18%), hypoglycaemia (14%), fasting plasma/blood glucose (11%), glycaemic variability (8%), postprandial response (8%) and insulin sensitivity (5%). Only 10% of trials included one or more patient reported outcomes; of these, 29% included the Diabetes Treatment Satisfaction Questionnaire. Conclusions There is marked heterogeneity in the outcomes measured in registered therapeutic intervention trials for type 2 diabetes. The use of an agreed set of core outcomes will improve the consistency of reporting in clinical trials for type 2 diabetes. Trial registration The core outcome set study, of which this is a part, is registered in the COMET database, http://www.comet-initiative.org/studies/details/956. Registered on 24 January 2017. Electronic supplementary material The online version of this article (doi:10.1186/s13063-017-2317-5) contains supplementary material, which is available to authorized users.


Background (150-200)
Type 2 diabetes mellitus accounts for over 90% of all diabetes. It is characterised by abnormal glucose metabolism brought about by resistance to insulin action and an inadequate compensatory insulin secretory response [1,2]. The resulting hyperglycaemia, if left untreated, can lead to both macrovascular and microvascular complications which may be further exacerbated by obesity, elevated blood pressure and dyslipidaemia that are also often associated with type 2 diabetes mellitus [3].
Systematic reviews of glucose lowering treatments for type 2 diabetes have identified inconsistency in the outcomes measured and reported and while many routinely report glycated haemoglobin, other measures of glycaemic control and outcomes relating to hypoglycaemia, mortality, diabetes-related complications and quality of life are less frequently reported, if at all [3][4][5][6][7][8]. The heterogeneity in the outcomes used may impact on the translatability of trials into benefits for patients [9,10]. The World Health Organization (WHO) International Classification of Functioning, Disability and Health (ICF) core set for diabetes mellitus contains 85 second level categories; 28 of these are included in the brief ICF core set that the ICF state can be used for the assessment of patients with diabetes participating in a clinical trial [11,12]. However, not only is it impractical to measure all 28 outcomes in the brief ICF core set in all trials, there is also an issue that it just includes outcomes related to function. Using only the brief ICF core set in clinical trials could mean that other outcomes important to patients and healthcare professionals are not measured.
One suggestion to improve the relevance and consistency of trial outcomes includes the development of a core outcome set (COS) that represents the minimum set of outcomes that should be measured and reported in any clinical trial for a given condition, in this case type 2 diabetes [13][14][15]. To ensure that no COS for trials of type 2 diabetes existed or was in development by another group, a review of entries in the Core Outcome Measures in Effectiveness Trials (COMET) initiative database was completed before commencing this project ((http://www.comet-initiative.org/), on 21 October 2016 and again before manuscript submission on 14 September 2017). No published or ongoing COS for the treatment of type 2 diabetes without co-morbidity was identified (Additional file 1).
Here we aim to describe the outcomes used in trials, currently recruiting, that evaluate therapeutic interventions for type 2 diabetes, registered in a large international public clinical trial registry, as the first step in the development of a COS for type 2 diabetes [15].

Search strategy
On 20 October 2016, the ClinicalTrials.gov database (www.clinicaltrials.gov) was searched using the following search terms: Type 2 diabetes; Type II diabetes; noninsulin dependent diabetes; Open studies; Interventional studies; Phase 3, 4; Studies received from 10/11/2007. In the context of the clinicaltrials.gov registry, an 'open' study is one that is currently recruiting participants or will be recruiting participants in the future.
Clinicaltrials.gov was chosen as this registry allows outcomes to be easily identified and extracted and was the main source of trials in a previous study using trial registries to identify outcomes [7]. Trials registered before 10 November 2007 have been reported elsewhere [7].

Eligibility criteria
Phase 3 and 4 trials of therapeutic interventions for patients with type 2 diabetes were included. Trials were excluded if they met any of the following criteria: phase 1 and 2 trials (including entries listed as phase 2/phase 3); prevention trials; trials of treatment for diabetic foot ulcers, diabetic retinopathy or for diabetic nephropathy; trials of bariatric surgery; and trials of treatment for any other co-morbidity including non-alcoholic fatty liver disease and cardiovascular disease (trials assessing cardiovascular safety of glucose lowering drugs are eligible for inclusion). When trials were registered more than once, only the initial registration was included.

Assessment of trial eligibility
NH and RJ reviewed the first 40 trials together with full discussion about inclusion and exclusion of trials and outcome extraction. A further 5% of trials was then randomly selected and independently reviewed in parallel by the reviewers to ensure consistency. Where disagreement was noted, the reviewers discussed the study before reaching a decision. No study required third reviewer arbitration.

Data extraction
Data on study characteristics was extracted by NH that included trial phase, region, design, type of intervention (pharmaceutical, nutritional, educational/lifestyle or device) and duration of follow-up. Data on outcomes listed in the clinicaltrials.gov protocol registration entry were extracted by NH and RJ from the specific outcomes fields and from the study information free text. Where composite outcomes were used, all component outcomes were included. Where an outcome was reported in terms of the measurement instrument used, for example a particular questionnaire, the instrument was reviewed and outcomes extracted.

Outcome classification
NH categorised each outcome according to the COMET taxonomy of core domains [submitted for publication]. This taxonomy comprises 38 domains under five areas (death, physiological/clinical, life impact, resource use and adverse events). Functional outcomes were also categorised according to the ICF top level domains (http://www.who.int/classifications/icf/en/). A random check of categorisation was completed on 30% of outcomes by JW, discrepancies were resolved through consensus and discussion with a third reviewer (PRW) where necessary.

Search results and study characteristics
The search returned 675 entries in the clinicaltrials.gov database; after duplicates were removed, 354 trials were screened for eligibility, of which 138 were included (trial registration numbers of included trials are available in Additional file 2). The flow of included trials is shown in Fig. 1.

Classification of trial outcomes COMET taxonomy
A total of 1444 individual outcomes were extracted with a median of eight outcomes per trial (range = 1-60). Each outcome was reviewed and categorised using the COMET taxonomy ( Table 2).
The most frequently included domain was 'metabolism and nutrition' with 87% of trials measuring one or more outcomes in this domain and 92 (67%) trials including an outcome from this domain as their primary outcome.
Nearly half of the studies (47%) included outcomes categorised as 'general outcomes' (outcomes that affect the whole body and cannot be attributed to a certain body system) which included outcomes related to body weight (42%), adiposity (17%), other anthropometric measures (11%), clinical chemistry not attributed to one Fig. 1 Flow of included trials particular body function or system (11%), physical activity (5%), fatigue (3%) and non-specific pain (3%). The remaining 10% of outcomes in the 'general outcomes' category included vital signs, non-specific patient reported outcomes (those with no detail provided in the clinicaltrials.gov entry other than 'patient-reported outcome'), general health, smoking status, morbidity and global effectiveness.

Use of patient-reported outcome measures
Fourteen (10%) studies listed one or more patientreported outcome measures (PROMs). Twenty-three PROMs were identified which measured 68 outcomes ( Table 3). The use of PROMs was varied and of the 23 PROMs, 87% were used in only one study. The most frequently used PROM was the Diabetes Treatment Satisfaction Questionnaire used by four (29%) of the studies reporting PROMs.

ICF core set and outcomes used in registered trials
Of the 1444 individual outcomes, 80 (5.5%) did not fit with any of the ICF categories. These outcomes included unspecified adverse events (n = 44), treatment preference or satisfaction (n = 5), mortality (n = 2), pharmacokinetics (n = 1) and general physiological or laboratory measures (n = 27). Ten categories in the ICF brief set and an additional 46 categories in the ICF full core set were not associated with any outcomes being measured in the trials. The breakdown of outcomes according to the ICF core set is provided in Additional files 3 and 4.

Discussion
There is heterogeneity in the outcomes used across registered open trials for type 2 diabetes. While some outcomes are commonly measured and are expected in trials that aim to treat hyperglycaemia, there is no consensus on which outcomes should be routinely measured and reported, with no single outcome or outcome domain being measured in all trials.
Reaney et al. have recently reviewed PROMs used in published phase 3 type 2 diabetes mellitus trials of GLP-1 receptor agonists, novel insulins, SGLT-2 inhibitors and DPP-4 inhibitors [16]. The identified PROMs in the included studies were mixed and varied compared to those identified in the present review, with overlap of only four measurement instruments (DTSQ, EQ5D, SF-36 and HFS-11 worry scale). The diabetes treatment satisfaction questionnaire (DTSQ) was the most frequently used PROM in both the review by Reaney et al. and in the present study which may be due to the recommendations made by the WHO to encourage psychological wellbeing in patients with diabetes [17]. In the present study, only 10% of trials included a PROM; this is comparable with the study by Barsdorf et al. in 2012 who found that only 7.5% of phase 3 pharmaceutical interventions for type 2 diabetes, registered with clinical trials.gov, included a PROM [18]. Gandhi et al. [7] considered patient important outcomes in registered trials, described as outcomes that affect the way patients feel, function or survive [8]. In the present study, over half (51%) of trials included one or more outcomes meeting this definition. However, this definition was not developed with input from patients with type 2 diabetes and so may not truly reflect outcomes of treatment that they consider to be the most important.