- Study protocol
- Open Access
A core outcome set for evaluating self-management interventions in people with comorbid diabetes and severe mental illness: study protocol for a modified Delphi study and systematic review
Trials volume 18, Article number: 70 (2017)
People with diabetes and comorbid severe mental illness (SMI) form a growing population at risk of increased mortality and morbidity compared to those with diabetes or SMI alone. There is increasing interest in interventions that target diabetes in SMI in order to help to improve physical health and reduce the associated health inequalities. However, there is a lack of consensus about which outcomes are important for this comorbid population, with trials differing in their focus on physical and mental health. A core outcome set, which includes outcomes across both conditions that are relevant to patients and other key stakeholders, is needed.
This study protocol describes methods to develop a core outcome set for use in effectiveness trials of self-management interventions for adults with comorbid type-2 diabetes and SMI. We will use a modified Delphi method to identify, rank, and agree core outcomes. This will comprise a two-round online survey and multistakeholder workshops involving patients and carers, health and social care professionals, health care commissioners, and other experts (e.g. academic researchers and third sector organisations). We will also select appropriate measurement tools for each outcome in the proposed core set and identify gaps in measures, where these exist.
The proposed core outcome set will provide clear guidance about what outcomes should be measured, as a minimum, in trials of interventions for people with coexisting type-2 diabetes and SMI, and improve future synthesis of trial evidence in this area. We will also explore the challenges of using online Delphi methods for this hard-to-reach population, and examine differences in opinion about which outcomes matter to diverse stakeholder groups.
COMET registration: http://www.comet-initiative.org/studies/details/911. Registered on 1 July 2016
Severe mental illness (SMI) is a term used to describe illnesses in which psychosis occurs (e.g. schizophrenia, schizoaffective disorder, and bipolar disorder). Diabetes is two to three times more common in people with SMI compared to the general population , and is associated with worse health outcomes . Higher prevalence and poor management of diabetes is thought to contribute significantly to the lower life expectancy of people with SMI , which is around 15 years lower than the general population [4, 5]. Poor diabetes management leads to complications including heart disease, stroke, foot ulceration and amputation, eye and kidney disease , many of which can be prevented with better diabetes care. In England, it is estimated that approximately 50,000 people with SMI also have diabetes , a figure that is expected to grow in line with the growing numbers of people with both diabetes and mental illness; recent evidence suggests that prevalence of diabetes is increasing at a faster rate in people with SMI than in people without .
Various pharmacological and behavioural interventions to prevent diabetes or to improve its outcomes have been tested in people with SMI [8–11]. Many of these target metabolic and cardiovascular risk factors, with the majority focusing on the metabolic side effects of antipsychotic medications, such as olanzapine and clozapine, which are commonly prescribed in SMI . Interventions typically include physical activity and weight loss programmes [12, 13]; behaviour change techniques that seek to promote positive lifestyle changes (e.g. problem solving and goal setting) [14, 15]; antidiabetic and weight loss medications [16, 17]; switching to, or adding, an antipsychotic medication associated with fewer metabolic side effects [18, 19]; and other drugs (e.g. hypnotics and antiepileptic medications) [20, 21], which are thought to alter metabolic functioning, anthropological markers, or other important risk factors (e.g. blood pressure, lipid levels).
While few studies have focused specifically on people with coexisting diabetes and SMI , several published trials include people with both conditions, and there is a growing interest in developing interventions targeting this comorbidity . Systematic reviews of the evidence consistently find incomplete reporting of outcomes and poor study quality [8–11], due in part to the lack of consensus about what outcomes are important for diabetes comorbid with SMI. This makes it difficult to build an evidence base about what works in this population, with studies differing in their focus on physical and mental health, and their selection of diabetes-related outcomes. For example, in a meta-analysis of lifestyle interventions for people with SMI , only eight of 25 included studies measured the effect on glycaemic parameters and only four measured depressive symptoms, despite the fact that diabetes is associated with increased depression and distress . Another systematic review of pharmacological and behavioural interventions reported similar results, with only eight of 33 studies measuring glucose control strategies . This makes it difficult to pool results of different studies and draw conclusions about how to improve diabetes outcomes.
A standardized set of outcomes for interventions targeting comorbid diabetes and SMI is, therefore, required. Core outcome sets, defined as ‘an agreed standardized collection of outcomes … which should be measured and reported in all trials for a specific clinical area’  have already been developed for several conditions and interventions . As well as offering the potential to reduce outcome reporting bias in trials and to enable better aggregation of results across multiple studies, a core outcome set aims to include outcomes that are important to all relevant stakeholders, such as patients, carers, health care professionals, and commissioners , and will, therefore, include outcomes beyond purely clinical measurements (e.g. patient-reported outcomes or reports from caregivers).
Previous studies have employed various approaches to determine which outcomes to consider for inclusion in a core outcome set, (e.g. systematic reviews and qualitative inquiry), and to reach consensus about the outcomes that are most important (e.g. ranking methods such as Delphi and Nominal Ranking Technique) . A recent systematic review that aimed to increase understanding about the methods used in the growing number of core outcome set studies found no completed studies relevant to either the SMI or diabetes populations . Five pertinent studies are currently registered on the Core Outcome Measures in Effectiveness Trials (COMET) database . There are two ongoing studies aiming to develop a core outcome set: one for the treatment of type-2 diabetes in adults , and the other for people with schizophrenia and bipolar disorder living in the community . Two studies have focused on identifying outcomes already employed in trials. One examined the first 10,000 trials on the Cochrane Schizophrenia Group’s Register and found that 2194 instruments were used to measure outcomes of 1940 different interventions . Another examined whether diabetes trials included outcomes important to people with diabetes such as death and quality of life; 201 of 436 trials included them as a primary or secondary outcome . The final study sought patient preferences about diabetes outcomes. Reducing risk of death was selected as the most important outcome (followed by reducing glycosylated haemoglobin (HbA1c)), but preventing kidney failure and need for dialysis was the most frequently endorsed .
Other work relevant to identifying important diabetes outcomes includes the American Association of Diabetes Educators’ (AADE) Diabetes Education Outcomes Project, which provides a framework for benchmarking and universal measurement of diabetes self-management education (DSME) interventions . The DSME Outcomes Continuum includes immediate (e.g. knowledge, skills); intermediate (e.g. healthy eating, physical activity); post-intermediate (e.g. HbA1c, Body Mass Index (BMI)); and long-term outcomes (e.g. quality of life), which, while particularly pertinent for DSME programmes, are also relevant to self-management of other long-term conditions. Knowledge and skills, improved quality of life, and biomedical markers were also highlighted in a systematic review of stakeholder views of self-management outcomes . The review identified other important outcomes as well, including independence, relationships with health care providers, wellbeing, and managing stress. Additionally, the review highlighted a lack of consensus between people with diabetes, carers, and health professionals.
While these studies help to inform the identification of outcomes that are relevant for people with either SMI or diabetes, simply combining outcomes for diabetes and SMI may not capture what is most important for people living with both conditions together . Self-management is the cornerstone of good diabetes management . However, people with SMI have motivational, cognitive, and psychological deficits that may impact on their ability to manage their diabetes. Outcomes of self-management interventions in this population may, therefore, be different from those without SMI. Additionally, diabetes is associated with an increased risk of depression and distress, which is an especially important consideration for people who already have an underlying mental illness . Coexisting physical and mental illness is likely to affect people in ways that are different from having one condition alone, including the medication they take, and how they interact with health services and manage their health on a daily basis . Relevant outcomes are, therefore, likely to cover multiple health domains, including functional, physical, cognitive, and emotional.
Our group is currently undertaking a programme of research to develop and evaluate a DSME programme tailored for people with coexisting type-2 diabetes and SMI, the ‘Diabetes and Mental Illness – Improving Outcomes and Services (DIAMONDS)’ programme. No DSME intervention has been tested previously in this population, and to date only one published randomised controlled trial has specifically targeted people with both diabetes and SMI . To support the DIAMONDS programme of work, a necessary first step is to develop a core outcome set for DSME interventions targeting people with coexisting type-2 diabetes and SMI. The purpose is to ensure that evidence about what works for this population can be developed and aggregated to offer meaningful conclusions for patients, carers, clinicians, policy-makers, and health care commissioners.
Aims and objectives
This study aims to develop a core outcome set for self-management interventions targeting adults (age 18 years and over) with coexisting type-2 diabetes and SMI, which captures important domains and is acceptable to people living with both of these conditions and for those who support them.
The study has four objectives, to:
Identify potential outcomes to consider from existing evidence and through a multistakeholder workshop and service user panel meeting
Rank outcomes to include in the core outcome set through a two-round online survey with all relevant stakeholders
Agree which outcomes to include in the set during a multistakeholder consensus workshop
Select appropriate measurement tools for each outcome in the core outcome set through systematically searching the trials literature, and identify gaps in measures where these exist
Using a modified Delphi method, this study will employ a three-stage process to (1) Identify, (2) Rank, and (3) Agree core outcomes. The study will comprise a two-round e-Delphi survey and multistakeholder workshops involving patients and carers, clinical professionals, health care commissioners, and other experts (e.g. academic researchers and third sector organisations). In a fourth stage, the study will review existing trials literature to (4) Select appropriate measurement tools for each outcome in the core outcome set and identify gaps where these exist.
This study draws on learning from the OMERACT (Outcome Measures for Rheumatology) collaboration ; the COMET Initiative ; and a review of methods employed in studies of this type , to select appropriate consensus methods for developing the core outcome set, and for ensuring meaningful input from patients and carers. The study will be registered on the COMET website to alert others to our work, and to share learning from our study.
Step 1: Identify outcomes
Identify potential outcomes to consider from existing evidence and through a multistakeholder workshop and service user panel meeting
Review of existing evidence
We will identify systematic reviews of trials and other experimental studies in people with diabetes and SMI and extract information about outcome measures used in included studies. Only outcomes measured in large studies (more than 20 participants) will be selected, as we seek to identify those practicable to measure in a large trial. We will also incorporate outcomes from the AADE DSME Outcomes Continuum  and the systematic review of self-management outcomes that are important to people living with the conditions, carers, and health professionals , to form a list of potential outcomes for stakeholders to review.
Multistakeholder workshop and service user panel meeting
A multistakeholder workshop will be held, attended by health care professionals and other relevant stakeholders as well as the research group (n = 20). Participants will be asked to work in small groups to identify outcomes that are potentially relevant and important. Findings from the review of existing evidence will then be presented, followed by further small group work to identify duplicate and overlapping outcomes, and to develop a final ‘long-list’ of potential outcomes to include in a core outcome set. Following the workshop, the long-list will be presented to a panel of service users with diabetes and SMI and their carers (the DIAMONDS PPI Panel), who will also be given an opportunity to add new outcomes that have not already been identified.
Step 2: Rank outcomes
Rank outcomes to include in the core outcome set through a two-round online survey with all relevant stakeholders
An online survey will be administered to determine which outcomes in the list developed in step 1 are important to different stakeholder groups. The purpose of the Delphi study is to reduce the list of potential outcomes to a smaller core set based on the collated responses of participants, but also taking into account the potentially differing views between diverse stakeholder groups and enabling participants to change their views as part of developing a group consensus . Unlike methods like Nominal Ranking Technique, a Delphi study does not require participants to interact to reach a consensus, and instead provides all participants with an equal opportunity to input directly and anonymously. This study draws on methods employed in other relevant studies [29, 41, 42], and also takes into account the potential burden on patient and health and social care professional participants of taking part in a study involving several stages. Although potential participants will be encouraged to take part in the online survey, a paper version will be available to ensure that patients and carers in particular are able to take part.
The following stakeholders will be purposively sampled to ensure good representation across the different groups:
Adults with coexisting SMI (which for this study we define as illnesses in which psychosis occurs including schizophrenia, schizoaffective disorder, bipolar disorder and severe depression) and type-2 diabetes living in the community (n = 5–10)
Carers/supporters (expected to be a spouse, other family member or close friend providing regular care or support to a person with SMI and diabetes) (n = 5–10)
Health and social care staff (to include GPs, diabetologists, psychiatrists, psychologists, nurses, mental health care co-ordinators, social workers, and other staff supporting this patient group) (n = 15–20)
Health service managers and commissioners (n = 5–10)
Academic experts in diabetes, mental illness, primary care and outcome measurement (n = 15–25)
Sample sizes vary across Delphi studies; based on previous work  and taking into account the small target patient population, this study will aim to recruit between 50 and 75 participants to the first round. To ensure good representation of patients, the DIAMONDS PPI Panel will also be invited to take part in the Delphi study (n = 5–10).
Patients and carers will be recruited through Community Mental Health Teams (CMHTs) based in participating mental health NHS trusts in one region of England, using care co-ordinators (mental health nurses, occupational therapists, social workers, and support workers who case manage individuals with SMI) to identify and invite eligible patients on their caseloads whom they assess as having capacity to consent. Other participants will be recruited through NHS and third sector organisations involved in the wider research programme. Participants will be informed that there will be two stages in the survey. We will also seek endorsement for this work from professional organisations to assist with recruitment for the Delphi study and also adoption of the core outcome set into research and practice.
Delphi round-1 survey
The survey will be designed and administered using Qualtrics , a secure web-based survey tool used successfully in research with mental health service users  and staff supporting people with SMI . All participants will be assigned a unique identifier and basic demographics will be collected to assist with the analysis and collation of responses. During round 1, all potential outcomes will be presented to participants, who will be asked to rate the importance of each outcome on a scale with anchors ranging from 1, being not important to 9, being of critical importance.
Using free-text boxes participants will have an opportunity to provide written feedback about their choices, and to suggest additional outcomes that they believe are important. Participants will be given 4 weeks to complete the survey – response rates will be monitored throughout to ensure good representation across the participant groups. If a stakeholder group is under-represented in the survey (fewer than five participants), a further attempt to recruit additional participants will be made.
Data will be analysed by stakeholder group and for all participants together. For each outcome, the number of respondents and distribution of scores will be summarised and analysed. The proportion of participants scoring 1–3, 4–6, and 7–9 for each outcome will also be calculated. Text data provided by participants in the free text fields will be reviewed by the research team to identify new outcomes to include in round 2 of the Delphi study survey and delete or merge duplicate or overlapping concepts.
Delphi round-2 survey
Participants from round 1 will be invited to participate in round 2. As outlined above, we will take precautions to reduce dropout for this second stage, including clearly informing participants of the two stages in the survey. If respondents from the first round cannot participate in the second, we will seek to recruit additional participants from the same stakeholder group if they are under-represented.
Participants will be presented with the following findings from round 1: ranking of outcomes for the whole group, ranking of outcomes for their own stakeholder group, and their individual scores. Participants will then be asked to rate each outcome again using the same Likert scale so that participants can adjust their scores, and to allow for comparisons between round 1 and round 2.
Drawing on consensus methods used in similar studies , data will be analysed by stakeholder group and for the whole group to determine for each outcome, the percentage of respondents who have scored 1–3, 4–6, and 7–9.
Each outcome will be categorised as one of the following:
‘Consensus In’ (i.e. the outcome should be included in the core outcome set): more than 70% of participants score the outcome as 7–9 (important) and fewer than 25% score the outcome as 1–3 (not important)
‘Consensus Out’ (i.e. the outcome should not be included in the core outcome set): more than 70% score the outcome as 1–3 (not important) and fewer than 15% score the outcome as 7–9 (important)
‘No Consensus’ (i.e. there is no strong consensus about the importance of the outcome): any other distribution of scores
We will analyse in detail the consistency of these results within groups as well as across groups to make statements about the relevance of the outcomes across all participating stakeholders, and to ensure that no voices remain unheard and that minority stakeholders are not over-ruled by the majority.
Step 3: Agree outcomes
Agree which outcomes to include in the core outcome set during a multistakeholder consensus workshop
Delphi consensus workshop
The detailed results from the survey will be presented at a Delphi workshop to be attended by people with SMI and type-2 diabetes, carers, health and social care professionals, health care commissioners, and other relevant stakeholders as well as the research group (n = 20). We anticipate that patients may prioritise outcomes in the Delphi study that practitioners or commissioners may not, and vice versa. It is, therefore, important that we include the views of all relevant stakeholders in this workshop to reach a decision about outcomes for which there was no clear consensus in the Delphi study. To ensure that we have meaningful input across participant groups, people participating in the Delphi study will be invited to attend the workshop, and for groups that are difficult to recruit for this part of the study we will make efforts to seek their views in advance of the workshop. We will also consult with the DIAMONDS PPI Panel separately prior to the workshop so that their views about the results of the Delphi study can be incorporated into the final selection process.
The purpose of the consensus workshop is to agree a final set of outcomes for the core outcome set, using the detailed findings from the survey. This is a key element of the modified Delphi method which combines self-administered questionnaires and physical meetings . All outcomes will be discussed. Each ‘Consensus In’ outcome will be discussed to ensure that it is measurable and feasible to include in the core set. Each ‘Consensus Out’ and ‘No Consensus’ outcome will be assessed to ensure that key outcomes that are commonly used to make policy or commissioning decisions about adoption have not been excluded from the set (e.g. outcomes used for cost-effectiveness analyses). The detailed results for each ‘No Consensus’ outcome will be discussed to determine whether they should be included in the final set. To ensure that there is no duplication in the final proposed set, each outcome will be discussed to ensure that it relates to a distinct construct and to start identifying existing measurement tools (and key validation studies of measurement tools) in preparation for step 4.
Finally, workshop participants will be asked to select the two outcomes that they consider most important to assess for diabetes and SMI populations from the proposed core outcome set.
Step 4: Identify instruments to measure outcomes
Select appropriate measurement tools for each outcome in the core outcome set, and identify gaps in measures where these exist
We will adopt a pragmatic approach to identify measurement tools as follows:
Discussion during the final consensus workshop to identify commonly used tools that are well validated (e.g. some outcomes will be measured consistently with one tool which has been validated in a key paper). Key papers for identified outcomes will be assessed against the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) Checklist  which uses a rating scale to assess the quality of measurement properties
For the remaining outcomes, a systematic review of published studies on the properties of all available measurement instruments that aim to measure the particular construct will be conducted. Study criteria and methods for the systematic review will be adapted depending on the final core outcome set. A search strategy comprising text words and index terms will be developed using a search filter for outcome measure properties  and search terms for each of the outcomes in the final core outcome set. Results identified from the search will be screened by two researchers independently, first by title and abstract to remove irrelevant studies, and second by full text to identify all papers that provide details of potentially matching measurement tools. The measurement and psychometric properties of all potentially matching tools will be assessed using the COSMIN Checklist  before selecting which tools to include for outcomes in the core outcome set
Outcomes for which no matching validated measurement tool is identified will be highlighted in the review to inform future research priorities.
To ensure that evidence about what works for particular populations can inform policy and practice and improve the quality and effectiveness of health care, evaluation research must measure what matters to people living with the condition and those who support them and commission health services, as well as to researchers. Developing core outcome sets using appropriately adapted consensus and trials literature review methods facilitates this, and helps to increase consistency of measurement in future research thereby enhancing the potential to combine trials for evidence synthesis. The proposed core outcome set for this study will provide clear guidance about what outcomes should be measured, as a minimum, in trials of self-management interventions for people with coexisting type-2 diabetes and SMI, and help to improve future aggregation of trial evidence in this area.
There are several challenges that we are likely to encounter. First, the study risks not including representation across stakeholder groups, in particular patients and carers. People with SMI are a hard-to-reach group; however, working with mental health care co-ordinators to identify and recruit participants is an approach used successfully in other research . People with SMI are also less likely than the general population to have regular access to the Internet , which is a prerequisite for completing an online survey. The Delphi study will therefore, as needed, be administered by post, telephone or in person, as well as online. To promote continued engagement we will endeavour to make sure that the survey is easy to complete by piloting this with the DIAMONDS PPI Panel, and we will recruit additional participants if we experience dropout in this or other stakeholder groups. There is a risk that during the consensus workshop, the voice of patients and carers is not present or is under-represented. The DIAMONDS PPI Panel members have expressed their desire to meet separately and to have their views presented at the workshop instead of attending in person. To ensure that other patient and carer participants are able to contribute to this process, we will use a skilled facilitator during the workshop and also provide them with an opportunity to meet separately with a researcher if they prefer.
Second, we may find differences in opinion between diverse stakeholder groups as they seek to achieve consensus about which outcomes are important. Core outcome sets are a relatively new construct in research, and methods for reaching consensus are evolving as studies begin to reflect on their successes and limitations . A key feature of the Delphi survey is building consensus by including more than one round, and sharing the results of each round with participants, so that these can inform the choices that individuals subsequently make. However, there are likely to be multiple outcomes that do not reach consensus, and the modified Delphi method provides an opportunity to resolve areas of disagreement between different stakeholder groups and ensure that all groups are represented in this process. There are examples in the trials literature where outcomes that are discarded by consensus are included in a core outcome set or vice versa . While this may be contentious, a flexible and pragmatic approach allows for decisions to be taken which are based on the consensus opinion but also take account of the necessity to include measurable and appropriate outcomes.
A flexible approach that acknowledges the expert in the final selection process also helps to address a third challenge, which all research of this type will face in the context of rapidly developing medical technologies and expanding psychometric and epidemiological evidence: the accuracy and stability of the concepts guiding our research (SMI and diabetes). For example, current research into the nature of SMI questions the meaningfulness of existing diagnostic categories, both aetiologically [52, 53] and phenomenologically . Thus, the appropriateness of grouping together SMI conditions that display similar and overlapping genetic aetiology and symptomatology, but have different illness trajectories and treatments, continues to be debated . In diabetes, although supporting self-management has been the cornerstone of good diabetes care for many years, it is a multidimensional concept that is individualised by those living with diabetes and, therefore, challenging to measure reliably [55, 56]. Concerns about increasing prevalence of diabetes and associated costs are fuelling the development of new treatments and therapies, which introduces a slightly different set of questions about the management of diabetes and the potential outcomes that capture this.
A fourth challenge relates to patient-reported outcomes, which are commonly used to evaluate the effectiveness of interventions. Psychometric assessments of these have shown that such measures overlap in content , and the incremental value of using multiple measures might, therefore, be questionable . While the development of these measures is informed and partly motivated by their value as an accepted outcome criterion in care and trials , the pressure on researchers to provide evidence on the mechanisms that drive change in an intervention has risen . This complex landscape necessitates detailed reviews of outcome assessment strategies as well as sophisticated strategies to define informative, relevant and sufficiently independent sets of outcome criteria. To assess this, potential outcome measures can be categorised according to their functional relationship in an intervention, in other words to differentiate whether an outcome measure could serve as an immediate outcome of the intervention itself (e.g., content learned); whether it is a mediator that is meant to change a primary or distal outcome (e.g., self-management skills); or whether it could serve as a primary outcome in a trial (e.g., measures of glycaemic control and/or psychological distress). This exercise could also draw on existing frameworks such as the DSME Outcomes Continuum  and standardised approaches for the evaluation of interventions .
Finally, there are challenges to ensuring that the core outcome set we develop is feasible to implement and accessible to those involved in research in this area. It is quite possible that the core outcome set will include outcomes for which we identify no appropriate measurement tool, or one that has not been adequately validated. If this occurs, we will seek funding to carry out this work or work in collaboration with others to validate tools that already exist. Historically, research has been poor at disseminating to different audiences and translating evidence into practice . To ensure that the core outcome set we develop is accessible, we will update the COMET website in a timely manner, and make sure that the core outcome set is publicly available and disseminated through our mental health and diabetes research and practice networks.
At the time of manuscript submission the status of the core outcome set study is ongoing. Participant recruitment for the Delphi study has not yet commenced.
Reilly S, Olier I, Planner C, Doran T, Reeves D, Ashcroft DM, et al. Inequalities in physical comorbidity: a longitudinal comparative cohort study of people with severe mental illness in the UK. BMJ Open. 2015;5(12):e009010. doi:10.1136/bmjopen-2015-009010.
Vinogradova Y, Coupland C, Hippisley-Cox J, Whyte S, Penny C. Effects of severe mental illness on survival of people with diabetes. Br J Psychiatry. 2010;197(4):272–7. doi:10.1192/bjp.bp.109.074674.
Ward M, Druss B. The epidemiology of diabetes in psychotic disorders. Lancet Psychiatry. 2015;2(5):431–51. doi:10.1016/S2215-0366(15)00007-3.
Brown S, Kim M, Mitchell C, Inskip H. Twenty-five year mortality of a community cohort with schizophrenia. Br J Psychiatry. 2010;196(2):116–21. doi:10.1192/bjp.bp.109.067512.
Chang CK, Hayes RD, Perera G, Broadbent MT, Fernandes AC, Lee WE, et al. Life expectancy at birth for people with serious mental illness and other major disorders from a secondary mental health care case register in London. PLoS One. 2011;6(5):e19590. doi:10.1371/journal.pone.0019590.
Kontopantelis E, Springate DA, Reeves D, Ashcroft DM, Rutter M, Buchan I, et al. Glucose, blood pressure and cholesterol levels and their relationships to clinical outcomes in type 2 diabetes: a retrospective cohort study. Diabetologia. 2015;58(3):505–18. doi:10.1007/s00125-014-3473-8.
Health and Social Care Information Centre. Quality and Outcomes Framework (QOF) – 2014–15. 2015. http://content.digital.nhs.uk/qof. Accessed 07 Feb 2017.
McGinty EE, Baller J, Azrin ST, Juliano-Bult D, Daumit GL. Interventions to address medical conditions and health-risk behaviors among persons with serious mental illness: a comprehensive review. Schizophr Bull. 2016;42(1):96–124. doi:10.1093/schbul/sbv101.
Gierisch JM, Nieuwsma JA, Bradford DW, Wilder CM, Mann-Wrobel MC, McBroom AJ, et al. Pharmacologic and behavioral interventions to improve cardiovascular risk factors in adults with serious mental illness: a systematic review and meta-analysis. J Clin Psychiatry. 2014;75(5):e424–40. doi:10.4088/JCP.13r08558.
Mizuno Y, Suzuki T, Nakagawa A, Yoshida K, Mimura M, Fleischhacker WW, et al. Pharmacological strategies to counteract antipsychotic-induced weight gain and metabolic adverse effects in schizophrenia: a systematic review and meta-analysis. Schizophr Bull. 2014;40(6):1385–403. doi:10.1093/schbul/sbu030.
Bruins J, Jorg F, Bruggeman R, Slooff C, Corpeleijn E, Pijnenborg M. The effects of lifestyle interventions on (long-term) weight management, cardiometabolic risk and depressive symptoms in people with psychotic disorders: a meta-analysis. PLoS One. 2014;9(12):e112276. doi:10.1371/journal.pone.0112276.
Cordes J, Thunker J, Regenbrecht G, Zielasek J, Correll CU, Schmidt-Kraepelin C, et al. Can an early weight management program (WMP) prevent olanzapine (OLZ)-induced disturbances in body weight, blood glucose and lipid metabolism? Twenty-four- and 48-week results from a 6-month randomized trial. World J Biol Psychiatry. 2014;15(3):229–41. doi:10.3109/15622975.2011.592546.
Daumit GL, Dickerson FB, Wang NY, Dalcin A, Jerome GJ, Anderson CA, et al. A behavioral weight-loss intervention in persons with serious mental illness. N Engl J Med. 2013;368(17):1594–602. doi:10.1056/NEJMoa1214530.
Weber M, Wyne K. A cognitive/behavioral group intervention for weight loss in patients treated with atypical antipsychotics. Schizophr Res. 2006;83(1):95–101.
Attux C, Martini LC, Elkis H, Tamai S, Freirias A, Camargo M, et al. A 6-month randomized controlled trial to test the efficacy of a lifestyle intervention for weight gain management in schizophrenia. BMC Psychiatry. 2013;13:60. doi:10.1186/1471-244X-13-60.
Jarskog LF, Hamer RM, Catellier DJ, Stewart DD, Lavange L, Ray N, et al. Metformin for weight loss and metabolic control in overweight outpatients with schizophrenia and schizoaffective disorder. Am J Psychiatry. 2013;170(9):1032–40. doi:10.1176/appi.ajp.2013.12010127.
Henderson DC, Fan X, Copeland PM, Borba CP, Daley TB, Nguyen DD, et al. A double-blind, placebo-controlled trial of sibutramine for clozapine-associated weight gain. Acta Psychiatr Scand. 2007;115(2):101–5. doi:10.1111/j.1600-0447.2006.00855.x.
Stroup TS, McEvoy JP, Ring KD, Hamer RH, LaVange LM, Swartz MS, et al. A randomized trial examining the effectiveness of switching from olanzapine, quetiapine, or risperidone to aripiprazole to reduce metabolic risk: comparison of antipsychotics for metabolic problems (CAMP). Am J Psychiatry. 2011;168(9):947–56. doi:10.1176/appi.ajp.2011.10111609.
Fleischhacker WW, Heikkinen ME, Olie JP, Landsberg W, Dewaele P, McQuade RD, et al. Effects of adjunctive treatment with aripiprazole on body weight and clinical efficacy in schizophrenia patients treated with clozapine: a randomized, double-blind, placebo-controlled trial. Int J Neuropsychopharmacol. 2010;13(8):1115–25. doi:10.1017/s1461145710000490.
McElroy SL, Winstanley E, Mori N, Martens B, McCoy J, Moeller D, et al. A randomized, placebo-controlled study of zonisamide to prevent olanzapine-associated weight gain. J Clin Psychopharmacol. 2012;32(2):165–72. doi:10.1097/JCP.0b013e3182488758.
Borba CP, Fan X, Copeland PM, Paiva A, Freudenreich O, Henderson DC. Placebo-controlled pilot study of ramelteon for adiposity and lipids in patients with schizophrenia. J Clin Psychopharmacol. 2011;31(5):653–8. doi:10.1097/JCP.0b013e31822bb573.
Cimo A, Stergiopoulos E, Cheng C, Bonato S, Dewa CS. Effective lifestyle interventions to improve type II diabetes self-management for those with schizophrenia or schizoaffective disorder: a systematic review. BMC Psychiatry. 2012;12:24. doi:10.1186/1471-244x-12-24.
Chwastiak LA, Freudenreich O, Tek C, McKibbin C, Han J, McCarron R, et al. Clinical management of comorbid diabetes and psychotic disorders. Lancet Psychiatry. 2015;2(5):465–76. doi:10.1016/S2215-0366(15)00105-4.
Snoek FJ, Bremmer MA, Hermanns N. Constructs of depression and distress in diabetes: time for an appraisal. Lancet Diabetes Endocrinol. 2015;3(6):450–60. doi:10.1016/S2213-8587(15)00135-7.
Williamson PR, Altman DG, Blazeby JM, Clarke M, Devane D, Gargon E et al. Developing core outcome sets for clinical trials: issues to consider. Trials. 2012;13:132. doi: 10.1186/745-6215-13-132. doi:10.1186/1745-6215-13-132.
Gargon E, Gurung B, Medley N, Altman DG, Blazeby JM, Clarke M, et al. Choosing important health outcomes for comparative effectiveness research: a systematic review. PLoS One. 2014;9(6):e99111. doi:10.1371/journal.pone.0099111.
The COMET Initiative. The COMET (Core Outcome Measures in Effectiveness Trials) Initiative. 2015. http://www.comet-initiative.org/. Accessed 11 June 2016.
Harman N, Williamson P, Demotes-Mainard J, Terwee C, Raess M, Garattini S, et al. Development of a core outcome set for type 2 diabetes effectiveness trials. 2017. http://www.comet-initiative.org/studies/details/956. Accessed 7 Feb 2017.
Keeley T, Khan H, Pinfold V, Williamson P, Mathers J, Davies L, et al. Core outcome sets for use in effectiveness trials involving people with bipolar and schizophrenia in a community-based setting (PARTNERS2): study protocol for the development of two core outcome sets. Trials. 2015;16:47. doi:10.1186/s13063-015-0553-0.
Miyar J, Adams CE. Content and quality of 10,000 controlled trials in schizophrenia over 60 years. Schizophr Bull. 2013;39(1):226–9. doi:10.1093/schbul/sbr140.
Gandhi GY, Murad MH, Fujiyoshi A, Mullan RJ, Flynn DN, Elamin MB, et al. Patient-important outcomes in registered diabetes trials. JAMA. 2008;299(21):2543–9. doi:10.1001/jama.299.21.2543.
Murad MH, Shah ND, Van Houten HK, Ziegenfuss JY, Deming JR, Beebe TJ, et al. Individuals with diabetes preferred that future trials use patient-important outcomes and provide pragmatic inferences. J Clin Epidemiol. 2011;64(7):743–8. doi:10.1016/j.jclinepi.2010.08.005.
Peeples M, Tomky D, Mulcahy K, Peyrot M, Siminerio L. Evolution of the American Association of Diabetes Educators’ diabetes education outcomes project. Diabetes Educ. 2007;33(5):794–817. doi:10.1177/0145721707307615.
Boger E, Ellis J, Latter S, Foster C, Kennedy A, Jones F, et al. Self-management and self-management support outcomes: a systematic review and mixed research synthesis of stakeholder views. PLoS One. 2015;10(7):e0130990. doi:10.1371/journal.pone.0130990.
Holt RI, Mitchell AJ. Diabetes mellitus and severe mental illness: mechanisms and clinical implications. Nat Rev Endocrinol. 2014. doi:10.1038/nrendo.2014.203.
Norris SL, Engelgau MM, Narayan KM. Effectiveness of self-management training in type 2 diabetes: a systematic review of randomized controlled trials. Diabetes Care. 2001;24(3):561–87.
Reilly S, Planner C, Gask L, Hann M, Knowles S, Druss B, et al. Collaborative care approaches for people with severe mental illness. Cochrane Database Syst Rev. 2013;11:Cd009531. doi:10.1002/14651858.CD009531.pub2.
McKibbin CL, Patterson TL, Norman G, Patrick K, Jin H, Roesch S, et al. A lifestyle intervention for older schizophrenia patients with diabetes mellitus: a randomized controlled trial. Schizophr Res. 2006;86(1–3):36–44. doi:10.1016/j.schres.2006.05.010.
Boers M, Kirwan JR, Wells G, Beaton D, Gossec L, d'Agostino MA, et al. Developing core outcome measurement sets for clinical trials: OMERACT filter 2.0. J Clin Epidemiol. 2014;67(7):745–53. doi:10.1016/j.jclinepi.2013.11.013.
Sinha IP, Smyth RL, Williamson PR. Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. PLoS Med. 2011;8(1):e1000393. doi:10.1371/journal.pmed.1000393.
Chiarotto A, Terwee CB, Deyo RA, Boers M, Lin CW, Buchbinder R, et al. A core outcome set for clinical trials on non-specific low back pain: study protocol for the development of a core domain set. Trials. 2014;15:511. doi:10.1186/1745-6215-15-511.
Moza A, Benstoem C, Autschbach R, Stoppe C, Goetzenich A. A core outcome set for all types of cardiac surgery effectiveness trials: a study protocol for an international eDelphi survey to achieve consensus on what to measure and the subsequent selection of measurement instruments. Trials. 2015;16:545. doi:10.1186/s13063-015-1072-8.
Qualtrics. Qualtrics. 2017. http://www.qualtrics.com. Accessed 07 Feb 2017.
Woods A, Jones N, Alderson-Day B, Callard F, Fernyhough C. Experiences of hearing voices: analysis of a novel phenomenological survey. Lancet Psychiatry. 2015;2(4):323–31. doi:10.1016/S2215-0366(15)00006-1.
Soundy A, Stubbs B, Probst M, Hemmings L, Vancampfort D. Barriers to and facilitators of physical activity among persons with schizophrenia: a survey of physical therapists. Psychiatr Serv. 2014;65(5):693–6. doi:10.1176/appi.ps.201300276.
Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS One. 2011;6(6):e20476. doi:10.1371/journal.pone.0020476.
Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de Vet HC. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21(4):651–7. doi:10.1007/s11136-011-9960-1.
Terwee CB, Jansma EP, Riphagen II, de Vet HC. Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Qual Life Res. 2009;18(8):1115–23. doi:10.1007/s11136-009-9528-5.
Gardner-Sood P, Lally J, Smith S, Atakan Z, Ismail K, Greenwood K, et al. Cardiovascular risk factors and metabolic syndrome in people with established psychotic illnesses: baseline data from the IMPaCT randomized controlled trial. Psychol Med. 2015;45(12):2619–29.
Ben-Zeev D, Davis KE, Kaiser S, Krzsos I, Drake RE. Mobile technologies among people with serious mental illness: opportunities for future services. Adm Policy Ment Health. 2013;40(4):340–3. doi:10.1007/s10488-012-0424-x.
Chiarotto A, Deyo RA, Terwee CB, Boers M, Buchbinder R, Corbin TP, et al. Core outcome domains for clinical trials in non-specific low back pain. Eur Spine J. 2015;24(6):1127–42. doi:10.1007/s00586-015-3892-3.
Lee SH, Ripke S, Neale BM, Faraone SV, Purcell SM, Perlis RH, et al. Genetic relationship between five psychiatric disorders estimated from genome-wide SNPs. Nat Genet. 2013;45(9):984–94. doi:10.1038/ng.2711.
Jablensky A. Psychiatric classifications: validity and utility. World Psychiatry. 2016;15(1):26–31. doi:10.1002/wps.20284.
Reininghaus U, Bohnke JR, Hosang G, Farmer A, Burns T, McGuffin P, et al. Evaluation of the validity and utility of a transdiagnostic psychosis dimension encompassing schizophrenia and bipolar disorder. Br J Psychiatry. 2016;209(2):107–13. doi:10.1192/bjp.bp.115.167882.
Frost J, Garside R, Cooper C, Britten N. A qualitative synthesis of diabetes self-management strategies for long term medical outcomes and quality of life in the UK. BMC Health Serv Res. 2014;14:348. doi:10.1186/1472-6963-14-348.
Shrivastava SR, Shrivastava PS, Ramasamy J. Role of self-care in management of diabetes mellitus. J Diabetes Metab Disord. 2013;12(1):14. doi:10.1186/2251-6581-12-14.
Reininghaus U, Priebe S. Measuring patient-reported outcomes in psychosis: conceptual and methodological review. Br J Psychiatry. 2012;201(4):262–7. doi:10.1192/bjp.bp.111.107615.
Böhnke JR, Lutz W, Delgadillo J. Negative affectivity as a transdiagnostic factor in patients with common mental disorders. J Affect Disord. 2014;166:270–8. http://dx.doi.org/10.1016/j.jad.2014.05.023.
Bansal D, Bhagat A, Schifano F, Gudala K. Role of patient-reported outcomes and other efficacy endpoints in the drug approval process in Europe (2008–2012). J Epidemiol Glob Health. 2015;5(4):385–95. doi:10.1016/j.jegh.2015.04.006.
Insel TR. The NIMH Research Domain Criteria (RDoC) Project: precision medicine for psychiatry. Am J Psychiatry. 2014;171(4):395–7. doi:10.1176/appi.ajp.2014.14020138.
Rossi PH, Lipsey MW, Freeman HE. Evaluation: a systematic approach. Thousand Oaks, London, New Delhi: Sage Publications; 2004.
Wilson PM, Petticrew M, Calnan MW, Nazareth I. Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks. Implement Sci. 2010;5(1):91. doi:10.1186/1748-5908-5-91.
DIAMONDS Research Group. Meet the DIAMONDS research group. 2016. http://www.diamonds.nihr.ac.uk/Meet-The-Team. Accessed 13 June 2016.
NIHR CLAHRC Yorkshire and Humber. Mental health and comorbidity. 2016. http://clahrc-yh.nihr.ac.uk/our-themes/mental-health-co-morbidities. Accessed 13 June 2016.
The DIAMONDS Research Group and PPI Panel  have provided input on the design of the study and will help to develop and agree the core outcome set. This research was supported by NIHR CLAHRC Yorkshire and Humber .
This project is funded through a National Institute for Health Research (NIHR) Programme Development Grant (reference RP-DG-1214-10002). The views expressed in this document are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.
Sponsor’s role: the sponsor is Bradford District Care NHS Foundation Trust. The sponsor and the funding agency had no role and the authors retained full autonomy in the preparation of this manuscript.
Availability of data and materials
JT and NS conceived of the study and helped to draft the manuscript and approved the final manuscript. JB, JW, SA, IK, TH and RH participated in the design of the study, and contributed to and approved the final manuscript. All authors read and approved the final manuscript.
The authors are part of the DIAMONDS Research Group (www.diamonds.nihr.ac.uk); an NIHR CLAHRC Yorkshire and Humber collaboration which aims to improve health outcomes and services for people living with SMI and diabetes.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The study has been approved by a National Research Ethics Committee (East Midlands – Leicester Central, REC reference 16/EM/0149) and has obtained the necessary approvals from the English Health Research Authority to conduct the study (IRAS reference 199333). Informed consent will be obtained from all participants in the study.
About this article
Cite this article
Taylor, J., Böhnke, J.R., Wright, J. et al. A core outcome set for evaluating self-management interventions in people with comorbid diabetes and severe mental illness: study protocol for a modified Delphi study and systematic review. Trials 18, 70 (2017). https://doi.org/10.1186/s13063-017-1805-y
- Severe mental illness
- Bipolar disorder
- Core outcome set
- Complex interventions