Skip to main content

Standardised outcomes in nephrology – Haemodialysis (SONG-HD): study protocol for establishing a core outcome set in haemodialysis



Chronic kidney disease is a significant contributor to mortality and morbidity worldwide, and the number of people who require dialysis or transplantation continues to increase. People on dialysis are 15 times more likely to die than the general population. Dialysis is also costly, intrusive, and time-consuming and imposes an enormous burden on patients and their families. This escalating problem has spurred a proliferation of trials in dialysis, yet health and quality of life remain poor. The reasons for this are complex and varied but are attributable in part to problems in the design and reporting of studies, particularly outcome selection. Problems related to outcomes include use of unvalidated surrogates, outcomes of little or no relevance to patients, highly variable outcome selection limiting comparability across studies, and bias in reporting outcomes. The aim of the Standardised Outcomes in Nephrology-Haemodialysis (SONG-HD) study is to establish a core outcome set for haemodialysis trials, to improve the quality of reporting, and the relevance of trials conducted in people on haemodialysis.


SONG-HD is a five-phase project that includes the following: a systematic review to identify outcomes that have been reported in haemodialysis systematic reviews and trials; nominal group technique with patients and caregivers to identify, rank, and describe reasons for their choices; qualitative stakeholder interviews with patients, caregivers, clinicians, researchers, and policy makers to elicit individual values and perspectives on outcomes for haemodialysis trials; a three-round Delphi survey with stakeholder groups to distil and generate a prioritised list of core outcomes; and a consensus workshop to establish a core outcome set for haemodialysis trials.


Establishing a core outcome set to be consistently measured and reported in haemodialysis trials will improve the integrity, transparency, usability, and contribution of research relevant to patients requiring haemodialysis; ensure that outcomes of relevance to all stakeholders are consistently reported across trials; and mitigate against outcome reporting bias. Ultimately, patients will be more protected from potential harm, patients and clinicians will be better able to make informed decisions about treatment, and researchers and policy makers will be more able to maximise the value of research to the public

Peer Review reports


Chronic kidney disease (CKD) is a leading contributor to mortality and morbidity [13]. Globally, the number of people depending on kidney replacement therapy in the form of kidney transplant or dialysis continues to increase [4, 5]. Dialysis consumes a disproportionately high proportion of the health-care budget in many countries [69]. Patients on dialysis have a 15 % annual mortality rate, which is 15–100 times higher than that of the general population [1013]. Most patients receiving kidney replacement therapy receive a form of dialysis, requiring many hours of treatment each week. Patients must also endure treatment burdens associated with polypharmacy, invasive procedures, and difficult diet and fluid restrictions, all of which profoundly disrupt nearly all aspects of life. Studies have consistently shown that patients requiring dialysis report a significant decrement in quality of life, even lower than that reported in patients with metastatic cancer and other chronic diseases [14, 15].

This escalating burden has spurred an increase in randomised trials and other forms of research in the dialysis setting. From 2004 to 2014, 1500 reports of randomised controlled trials (RCTs) (2000 including conference abstracts) in haemodialysis were identified in the Cochrane Renal Group Specialised Register [16]. Yet there has been no substantial improvement in clinical, quality of life, and mortality outcomes for patients on dialysis [17, 18]. The reasons for this are multiple and complex but may be attributed in part to fundamental problems in the design and reporting of these studies, particularly outcome selection. Problems relating to outcomes include highly variable outcome selection, outcome reporting bias, using outcomes of little patient relevance, and the use of unvalidated surrogate outcomes [1922]. Most trials that have assessed survival have not shown significant improvements in mortality; and studies typically measure biochemical parameters, so it is unclear whether the interventions improve outcomes that are clinically relevant and important to patients.

Clinical trials aim to evaluate whether interventions are safe and efficacious for patients by comparing their relative effects on outcomes chosen by the investigators. The heterogeneity in outcomes measured and reported in trials often renders the combination and comparison of trial results impossible [23]. This creates difficulties in interpreting the observed treatment effect and in making evidence-based health-care decisions. For example, standard approaches to evidence synthesis such as meta-analysis cannot be used because of heterogeneity in trial outcomes.

Outcome reporting bias can also threaten the validity of meta-analysis and reliability of evidence [24, 25]. This occurs when there is selective reporting within studies, at the level of individual outcomes, based upon observed favourable outcomes for the intervention [26]. Also, omitting or inaccurately reporting outcomes, such as adverse events, misleads and misinforms patients and clinicians, and this may result in patient harm.

A preoccupation with mortality may preclude study of outcomes that are relevant to patients in living their life. All researchers would regard mortality as an important outcome, but an emphasis on mortality may detract from other outcomes that impact a patient’s quality of life. This is particularly important in a setting like dialysis where very few interventions have been shown to improve survival. The absence of mortality as a priority outcome in research prioritisation activities undertaken from patients’ perspectives has been observed in cancer, mental health, and pulmonary disease [27, 28]. Two research priority setting partnerships in CKD conducted in Australia and Canada, patients, caregivers, and health professionals participated in facilitated discussion and prioritisation surveys to identify, rank and deliberate on research priorities [29, 30] also found there was minimal discussion about mortality. Outcomes determined to be most relevant to the top 10 haemodialysis research questions included quality of life, satisfaction, anxiety, fatigue, employment, interdialytic weight gain, and capacity for self-management [29]. This strongly suggests that patients focus on living well with CKD rather than dying from it.

Most studies do not report endpoints that are relevant, meaningful, and important for patients, because patients have not been included in planning of the studies. Instead, study investigators from academia and industry typically define the outcomes to be measured in research [22, 31]. Surrogate or composite endpoints based on investigators’ input are frequently selected in trials to reduce the cost, time, and sample size requirements and to facilitate rapid market access of new drugs. There is compelling evidence of the dangers of relying on surrogate endpoints in trials [32]. For example, erythropoietin was approved to treat anaemia in patients with CKD on the basis of improvements in haemoglobin, but targeting normal haemoglobin levels was later found to increase mortality [32, 33] but without a significant increase in quality of life [34].

The lack of patient involvement in a research priority setting in CKD in general and in establishing research outcomes more specifically is problematic given the observed mismatch of priorities between patients and clinicians in CKD [29, 3539]. For example, patients on dialysis are willing to sacrifice survival for freedom to travel and prioritise caregiver respite [36, 37], outcomes which are not “typically” assessed in research. Patients attach a plethora of different values to outcomes, such as empowerment, control, independence, social acceptance, family, guilt, normality, equity, freedom, flexibility, productivity, and security [36, 4044]. Patient-centred care involves shared decision making and disease management between a patient and their clinician which take into account the patient’s priorities and values and which ultimately can encourage adherence to treatment and improve patient-centred outcomes [45]. Delivering patient-centred care requires an understanding of outcomes that are important and relevant to patients.

In 2014, the Lancet reported that 85 % of the US$240 billion expended on health research in 2010 was wasted because of problems in the design, conduct, analysis, and reporting of research [20]. That article emphasised that “waste is caused when potential users’ needs are ignored” [20] (that is, when researchers do not assess the effects of interventions in terms of functional, social, and emotional well-being or adverse reactions and long-term outcomes). This is important given that much of research is publicly funded and that it is allocated with the ultimate aim to improve the health and well-being of populations.

Globally, there are increasing calls to develop core outcome sets to ensure that trials include outcomes that are relevant and important to stakeholders. The Outcome Measures in Rheumatology (OMERACT) initiative was formed in 1992 to identify and improve relevant health outcome domains in rheumatology through an iterative consensus process involving relevant stakeholder groups, including patients [19, 46, 47]. OMERACT outcomes have been endorsed by the World Health Organization (WHO) and the US Food and Drug Administration and have improved the reporting and relevance of outcomes in rheumatology trials [47, 48]. The OMERACT methodology has been applied successfully in cancer [49], otitis media [50], eczema [51], and chronic pain [52]. In 2010, the international Core Outcome Measures in Effectiveness Trials (COMET) organisation was launched to facilitate the development and application of “core outcome sets” [53, 54]. Core outcome sets represent the minimum that should be measured and reported in all clinical trials for a specific condition; however, they are not meant to be definitive [53]. The intention is that the core outcomes be collected and reported to allow the results of trials and other studies to be compared, contrasted, and combined as appropriate; researchers are at liberty to collect and explore other outcomes. A core outcome set does not exist for CKD.

This project will initially focus on haemodialysis as it is the predominant dialysis treatment modality worldwide. The ultimate aim of SONG is to develop a core outcome set across the treatment spectrum of CKD, including early-stage CKD (non-dialysis-dependent), haemodialysis, peritoneal dialysis, and kidney transplantation. The specific aim of SONG-HD is to establish a core outcome set which is for haemodialysis trials and which will be used in other forms of research. This is particularly important in CKD, where registries of people on dialysis or who have been transplanted are standard practice. To achieve this aim, the following specific objectives will be addressed: (1) to describe the scope, quality, and consistency of outcomes used in haemodialysis trials; (2) to identify outcomes that are important to patients, caregivers, clinicians, and policy makers; (3) to ascertain the attitudes, values, and beliefs underpinning their priorities for outcomes; (4) to generate an evidence-informed, consensus-based prioritised list of core outcome domains; and (5) to establish a core outcome set for haemodialysis trials.


SONG-HD is a five-phase multi-method project that includes systematic reviews, nominal group technique/focus groups, semi-structured interviews, Delphi surveys with best-worst/choice experiments, and a consensus workshop. Our methodological framework is based on validated processes developed by the OMERACT initiative [19] that is endorsed by the WHO as a “successful approach” for identifying core outcomes [55].

Phase 1: Systematic review of outcome domains reported in haemodialysis trials

A systematic review will identify and compare outcomes reported in systematic reviews and RCTs of interventions for adults on haemodialysis.

Search strategy

A comprehensive search will be conducted in the Cochrane Central Register of Controlled Trials without time and language restrictions.

Types of studies and interventions

Cochrane systematic reviews and RCTs will be included. For feasibility, the sampling frame for RCTs will be limited to RCTs included in published Cochrane systematic reviews as data extraction will be conducted at the trial level. Any intervention used to manage and treat patients on haemodialysis will be included.

Types of participants

Adult patients (age of at least 18 years) on haemodialysis.

Exclusion criteria

Studies that exclude patients on haemodialysis.

Eligibility of studies

Two reviewers will independently assess all records obtained. Full copies of all potentially relevant systematic reviews and RCTs will be assessed independently by the two reviewers, and any disagreement on the eligibility of included studies will be resolved through discussion.

Assessment of methodological quality

An assessment of methodological quality will be undertaken by using the Harman (2013) [50] appraisal framework which addresses the rationale, selection, and reporting of outcomes. This will be assessed independently by two reviewers.

Data extraction

From each RCT, details of the author, year of publication, population (that is, only haemodialysis), number and age of participants, and the intervention and comparator will be recorded. From each study, all outcomes will be extracted by two authors. All outcomes will be extracted unless it is specifically stated in the RCT that the outcomes were measured and reported in the non-HD patients only.

Data analysis and presentation

All eligible systematic reviews and RCTs will be tabulated. The outcomes will be initially classified according to the broad OMERACT categories of (i) mortality, (ii) life impact, (iii) pathophysiological manifestations, (iv) resource use and economic impact, and (v) toxicity, side effects, and adverse events. Within each category, the outcomes will be grouped into more specific outcome domains. These domains will be reviewed by the Executive Committee to assess the appropriateness of the domain name and grouping of outcomes. The frequency of outcomes reported across systematic reviews and RCTs will be assessed, and the scope and consistency of outcome reporting will be evaluated.

Phase 2: Nominal group technique with patients and caregivers

To ensure that patient-centred outcomes are identified, patients and caregivers will be asked to identify and rank outcomes that are considered relevant and important to them and to discuss reasons for their choices. A combined focus group/nominal group technique will ensure that the outcome domains important to the patients and caregivers be grounded in their own accounts of what matters to them about haemodialysis. The nominal group technique is a transparent process of consensus development based on structured group discussion [27, 56, 57]. This technique is useful for generating ideas and priorities, prevents dominant participants from controlling the discussion, and allows participants the opportunity to raise views and suggestions without direct criticism or rejection of other participants [56].

Participants and recruitment

Patients and caregivers who have direct experience with haemodialysis will be invited to participate. Approximately 12 nominal groups (involving 8–12 participants, total n = 144) will be convened, though the final number of groups will depend on when theoretical saturation, defined as the point when few or no new outcomes or issues are emerging, is reached. Participants will be recruited from participating centres in Australia and Canada in the first instance and purposively sampled to achieve maximum diversity of demographic (age, gender, socioeconomic status, ethnicity, location, and educational attainment) and clinical characteristics (in-centre versus home haemodialysis, diagnosis, duration on dialysis, wait-listing status, and comorbidities) to capture a breadth of opinion. Informed consent will be obtained from all participants.

Data collection

The nominal groups will be 2 hours in duration and convened in a centrally located venue external to the hospital to minimise the possibility of participants feeling disempowered. All discussions will be audiotaped and transcribed verbatim, and a researcher will record the contextual details around the discussion. The question guide will be developed from the guide we designed to successfully elicit outcomes in kidney transplant recipients [38] and includes the following:

  1. i.

    Welcome and introduction (5 min)

  2. ii.

    Focus group discussion (45 min) – Participants will deliberate and discuss experiences of HD and perceived benefits, harms, and complications of haemodialysis and haemodialysis-related interventions.

  3. iii.

    Nominal group technique (70 min) – Participants will individually identify outcomes they believe are important and relevant. These outcomes will be written on the flipchart and then augmented with outcomes identified from the systematic review (phase 1) and in previous nominal groups. The list of outcomes will be discussed and clarified. A copy of the consolidated list will be printed for participants to individually rank all of the outcomes in order of perceived importance, from 1 (most important) to X (least important). Similarities and differences in ranking will be discussed among the group.

Data analysis

Nominal group ranking: The highest ranked outcome for each respondent will be assigned a value of 10 through to the least important, which will be assigned a value of 1. Outcomes not ranked in the top 10 will be assigned a value of zero. A mean priority score for each outcome across all groups will be obtained by summing ranking scores and dividing this by the maximum possible ranking score for that item. The maximum possible ranking score for a given outcome will be calculated by multiplying the number of participants who considered the outcome by 10 (the maximum rank). If all participants who ranked an outcome scored it as the most important, the priority score is 100 %, whereas a score of 0 % means that all participants who ranked that outcome did not score it in the top 10 most important outcomes. Mean priority scores and the number of times an outcome was voted in the top 10 will be calculated for all participants. Mean priority scores will also be calculated separately for demographic and clinical characteristics, and differences in mean scores will be assessed by using analysis of variance.

Qualitative analysis: Using an adapted grounded theory approach, as outlined by Corbin and Strauss [58], the transcript will be imported into HyperRESEARCH and reviewed line by line to identify concepts and themes, compared within and across groups, and developed into a coding scheme. The preliminary themes will be discussed with two other investigators to ensure that the full range and depth of data are captured (investigator triangulation). Through a process of constant comparisons between individuals and groups, analytical themes will be developed. The final themes will reflect the beliefs, values, attitudes, and reasons underpinning the participants’ choices and ranking of outcomes.

Phase 3: Stakeholder interviews

Semi-structured interviews will be conducted to elicit a range and depth of individual values, beliefs, and attitudes toward outcomes, not to quantify frequency of opinion [44, 59]. Reporting will be based on the Consolidated Criteria for Reporting Qualitative Health Research (COREQ) [60].

Participants and recruitment

Interviews will be conducted with the following stakeholder groups internationally: (i) patients and caregivers, (ii) health-care providers (nephrologists, surgeons, nurses, psychologists, nurses, social workers, and dietitians), and (iii) representatives from research, funding, policy, industry, and other stakeholder organisations. A minimum of 30 patients and 30 caregivers will be recruited from participating centres and via consumer organisations worldwide (including Australia, Canada, Europe, New Zealand, the UK, and the US). A minimum of 60 health-care providers, policy makers, and health professionals from national and international stakeholder organisations will be identified from the investigator’s networks. Participants will be “purposively” identified to obtain a maximum variation of representation in demographics, clinical characteristics (patients), and professional experience and responsibilities (health-care providers and representatives from stakeholder organisations). Recruitment will continue until theoretical saturation has been achieved in each stakeholder group. Informed consent will be obtained from all participants.

Data collection

The interview guide will incorporate the results from the systematic review and phase 2. Participants will be asked to reflect and talk about (1) the experiences of living with haemodialysis (patients) or caring for patients on haemodialysis (caregivers/health-care providers), (2) benefits and harms of haemodialysis/haemodialysis-related treatment, (3) outcomes believed to be relevant and important to include in haemodialysis trials and why, and (4) the results obtained in phase 2. Face-to-face interviews will be conducted, but if this is not possible, Skype or telephone interviews will be conducted. Each interview will be 30–45 min in duration, and all interviews will be recorded and transcribed verbatim.

Data analysis

From the transcripts, a list of outcomes mentioned by the participants will be extracted. Also, grounded theory and thematic analysis (as detailed in phase 2) will be used to analyze and describe the reasons for their priorities, and a comparison will be made across stakeholder groups.

Phase 4: Delphi consensus survey

An international Delphi survey will be conducted to collect opinions and distil the number of outcomes to a prioritised list. The Delphi method is an iterative consensus technique comprising sequential surveys answered anonymously by a panel of participants with relevant knowledge and expertise and gives equal influence to all who participate [57, 61].

Participants and recruitment

There is no standard sample size required in Delphi processes, though Delphi studies in core outcome development have reported participant numbers ranging from 13 to 222. For this study, the Delphi panel will include a minimum target sample size of at least 400 respondents with patients/caregivers comprising at least half of the total sample size to ensure a numerical balance between patients/caregivers and health professionals. Thus, the aim is to recruit patients (n = 100), caregivers (n = 100), clinicians (nephrologists [n = 100], vascular surgeons [n = 20], and nurses [n = 20]), allied health professionals (psychologists, social workers, and dieticians) (n = 20), researchers (n = 20), and policy makers (n = 20), and researchers and policy makers (n = 30). To ensure maximum variation in sampling, participants will be recruited by using a similar strategy detailed in phase 3, and approximately one third from each stakeholder group with be recruited from participating countries/regions, including Australia, the US, Canada, the UK, continental Europe, and Asia.

Participants will be recruited through participating hospital/university institutions and patient/consumer organisations. All participants will be asked to register their email on prior to the survey launch. Informed consent will be obtained from all participants.

Data collection

The list of outcomes will be obtained from phases 1–3. For feasibility, the outcomes will be listed individually but grouped under a relevant domain. The survey will be reviewed by the Executive Committee and piloted. The surveys will be completed online by using a unique identifier based on their name and email address to enable identification of participants completing all three rounds of the Delphi survey. At least three reminders will be sent to participants during the Delphi rounds.

Round 1: Participants will be asked to rate each of the outcomes (approximately 30 outcomes) by using the (GRADE) process, which recommends a nine-point Likert scale to rank their importance [62]. Rankings of 7–9 indicate outcomes of critical importance, rankings of 4–6 indicate outcomes that are important but not critical, and rankings of 1–3 indicate outcomes of limited importance. All outcomes will be randomised to minimise ordering bias. Participants can suggest additional outcomes and provide reasons for their rankings. The additional outcomes will be re-coded and grouped by two members of the investigator team (AT and RS) and reviewed by the Executive Committee. All outcomes will be carried through to round 2 with the distribution of scores displayed for each outcome (rather than cutoff scores) to avoid masking any major disagreement within the group [61].

Round 2: Participants will review the group scores and their own score for each outcome and will re-rank the outcomes (including additional outcomes identified in round 1) by using the nine-point scale and explain reasons for any changes to their scoring.

Round 3: Participants will be shown their own score and the distribution of scores for each outcome across all stakeholder groups and for separate stakeholder groups. A summary of the results from phases 2 and 3 will also be provided. Participants will be asked to re-rank all outcomes and to indicate whether they should be included in the core outcomes set. After the GRADE rankings, a number of questions based on a novel priority setting approach using choice experiment methods (for example, best-worst scaling (case 1) [63]) will also be included. Participants will be presented with multiple scenarios that present varying combinations of 4–5 outcomes, developed by using a balanced incomplete block design. They will choose the most important and least important in each scenario. By presenting multiple scenarios to respondents, a full ranking of all attributes, based upon the choices that respondents make, can be estimated.

Data analysis

For each outcome, the number of participants who scored the outcome and the distribution of scores will be summarised together. Results of the stakeholder group responses will be compared with the whole group response, and the percentage agreement will be used to determine the structure and focus of the consensus conference. Each outcome will be classified according to Table 1. This pre-specified definition is used by OMERACT and other similar initiatives [19, 50, 51] and minimises the chance of consensus being defined post hoc in such a way as to bias the results toward the beliefs of the research team. The choice experiment questions will be analysed initially by using a multinomial logit model for all respondents and also by stakeholder group. More complex model specifications such as a mixed logit model [64], a generalised multinomial logit model [65], or latent class models will also be examined. The overall rankings of outcomes generated from this new method will also be compared to determine its consistency with the widely accepted Delphi approach.

Table 1 Delphi consensus definition

Phase 5: Consensus workshop

A face-to-face consensus conference will be held for stakeholders to review, comment on, and endorse the core outcomes set. This conference will be chaired by members of the Executive Committee. Approximately 60 participants will be invited and at least half will be patients/caregivers (n = 30). Other participants will include nephrologists, nursing and allied health professionals, researchers, and policy makers. This number is based on the OMERACT consensus workshop. Purposive sampling will be undertaken to ensure maximum variation of demographic and clinical characteristics. Informed consent will be obtained from all participants. All discussions will be audiotaped and transcribed. The conference program is outlined below, though details will depend on the results obtained in phases 2–4.

  1. 1.

    Presentation of results: Detailed results from phases 2, 3, and 4 will be distributed to the participants 2 weeks prior to the conference to allow participants time to reflect and enhance their ability to deliberate and contribution to the discussions. The results will be presented during a plenary session of the consensus workshop, and the outcomes will also be shown according to the consensus classification (Table 1).

  2. 2.

    Breakout group discussion: Participants will be divided into six groups of approximately 10 participants. A trained facilitator will moderate a group discussion on the results from phases 3 and 4, consensus classification of outcomes, similarities and differences across stakeholder groups, and the resolution of any disagreement, uncertainties, or issues identified.

  3. 3.

    Plenary discussion: Each breakout group will present a summary of their discussion. The conference chair will moderate discussion.

  4. 4.

    Endorsement of core outcome set: Participants will be asked to formally endorse (sign off) the core outcomes set, which will include the outcomes classified as “consensus in”.


The Western Sydney Local Health District, Sydney, New South Wales, Australia (HREC2009/6/4.15); Monash Health, Melbourne, Victoria, Australia (13082B); the University of Calgary, Calgary, AB, Canada (REB15-0708); and the University of Sydney (2015/228) provided ethical approval for this study.


The international SONG-HD initiative will generate a core outcome set for haemodialysis trials that is based on the shared priorities of patients, clinicians, researchers, policy makers, and relevant stakeholders. The outcome domains will inform subsequent work in the development of outcome measures (that is, specific tools and thresholds) for evaluating outcomes that are meaningful and relevant to users of the research, who are primarily patients and their clinicians.

The core outcome set will be implemented in systematic reviews and trials via the investigator’s existing links with international and national research and policy organisations. Specifically, this will be achieved by prioritising research that addresses core outcomes and integrating core outcome sets into proposal and protocol templates for trials, guidelines, and systematic reviews. Thus, this project will improve the integrity, transparency, usability, and impact of research relevant to patients requiring haemodialysis; ensure that outcomes of relevance to all stakeholders are consistently reported across trials; and minimise outcome reporting bias. Ultimately, patients will be protected from potential harm, patients and clinicians will be able to make informed decisions about treatment, and researchers and policy makers will be able maximise the value of research to the public.

Trial status

Recruitment and data collection have commenced.



Chronic kidney disease


Outcome Measures Rheumatoid Arthritis Clinical Trials


Randomised controlled trial


Standardised Outcomes in Nephrology-Haemodialysis


World Health Organization


  1. Go AS, Chertow GM, Fan D, McCulloch CE, Hsu CY. Chronic kidney disease and the risks of death, cardiovascular events, and hospitalization. N Eng J Med. 2004;351:1296–305.

    Article  CAS  Google Scholar 

  2. Levey AS, Atkins R, Coresh J, Cohen EP, Collins AJ, Eckardt KU, et al. Chronic kidney disease as a global public health problem: approaches and initiatives - a position statement from Kidney Disease Improving Global Outcomes. Am J Kidney Dis. 2007;72:247–59.

    CAS  Google Scholar 

  3. Coresh J, Turin TC, Matsushita K, Sang Y, Ballew SH, Appel LJ, et al. Decline in estimated glomerular filtration rate and subsequent risk of end-stage renal disease and mortality. JAMA. 2014;311:2518–31.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Australian Institute of Health and Welfare. Projections of the prevalence of treated end-stage kidney disease in Australia 2012–2020. Canberra, Australia: Australian Institute of Health and Welfare; 2014.

    Google Scholar 

  5. Hallan SI, Dahl K, Oien CM, Grootendorst DC, Aasberg A, Holmen J, et al. Screening strategies for chronic kidney disease in the general population: follow-up of cross sectional health survey. BMJ. 2006;333:1047.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Klarenbach S, Manns B. Economic evaluation of dialysis therapies. Semin Nephrol. 2009;29:524–32.

    Article  PubMed  Google Scholar 

  7. Pai AB, Cardone KE, Manley HJ, St Peter WL, Shaffer R, Somers M, et al. Medication reconciliation and therapy management in dialysis-dependent patients: need for a systematic approach. Clin J Am Soc Nephrol. 2013;8:1988–99.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Australian Institute for Health and Welfare. Health care expenditure on chronic kidney disease 2004–05. Canberra, Australia: Australian Institute for Health and Welfare; 2009.

    Google Scholar 

  9. Karopadi AN, Mason G, Rettore E, Ronco C. The role of economies of scale in the cost of dialysis across the world: a macroeconomic perspective. Nephrol Dial Transplant. 2014;29:885–92.

    Article  PubMed  Google Scholar 

  10. Neovius M, Jacobson SH, Eriksson JK, Elinder CG, Hylander B. Mortality in chronic kidney disease and renal replacement therapy: a population-based cohort study. BMJ Open. 2014;4:e004251.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Robinson BM, Zhang J, Morgenstern H, Bradbury BD, Ng LJ, McCullough KP, et al. Worldwide, mortality risk is high soon after initiation of hemodialysis. Kidney Int. 2014;85:158–65.

    Article  PubMed  Google Scholar 

  12. de Jager DJ, Grootendorst DC, Jager KJ, van Dijk PC, Tomas LM, Ansell D, et al. Cardiovascular and noncardiovascular mortality among patients starting dialysis. JAMA. 2009;302:1782–89.

    Article  PubMed  Google Scholar 

  13. ANZDATA. The 36th Annual Report. Adelaide, Australia: Australian and New Zealand Dialysis and Transplantation Registry; 2013.

    Google Scholar 

  14. Wong G, Howard K, Chapman JR, Pollock C, Chadban SC, Salkeld G, et al. How do people with chronic kidney disease value cancer-related quality of life? Nephrology. 2012;17:32–41.

    Article  PubMed  Google Scholar 

  15. Wyld M, Morton RL, Hayen A, Howard K, Webster AC. A systematic review and meta-analysis of utility-based quality of life in chronic kidney disease treatments. PLoS Med. 2012;9:e1001307.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Jones A, Edwards L, Higgins GY, Webster AC, Craig JC. Cochrane Renal Group. About the Cochrane Collaboration (Cochrane Review Groups (CRGS)). Accessed 31 March 2015.

  17. Inrig JK, Califf RM, Tasneem A, Vegunta RK, Molina C, Stanifer JW, et al. The landscape of clinical trials in nephrology: a systematic review of Am J Kidney Dis. 2014;63:771–80.

    Article  PubMed  Google Scholar 

  18. Nissenson AR. Improving outcomes for ESRD patients: shifting the quality paradigm. Clin J Am Soc Nephrol. 2014;9:430–34.

    Article  PubMed  Google Scholar 

  19. Boers M, Kirwan JR, Tugwell P, Beaton D, Bingham III CO, Conaghan PG, et al. The OMERACT Handbook. Ottowa, ON, Canada: OMERACT; 2014.

    Google Scholar 

  20. Chalmers I, Bracken MB, Djulbegovic B, Garattini S, Grant J, Gülmezoglu AM, et al. How to increase value and reduce waste when research priorities are set. Lancet. 2014;383:156–65.

    Article  PubMed  Google Scholar 

  21. Gargon E, Gurung B, Medley N, Altman DG, Blazeby JM, Clarke M, et al. Choosing important health outcomes for comparative effectiveness research: a systematic review. PLoS One. 2014;9:e99111.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Ghandi GY. Patient-important outcomes in registered diabetes trials. JAMA. 2008;299:2543–49.

    Article  Google Scholar 

  23. Williamson PR, Altman D, Blazeby JM, Clarke M, Devane D, Gargon E, et al. Developing core outcomes sets for clinical trials: issues to consider. Trials. 2012;13:132.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Dwan K, Gamble C, Williamson PR, Kirkham JJ. Systematic review of the empirical evidence of study publication bias and outcome reporting bias - an updated review. PLoS One. 2013;8:e66844.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Hart B, Lundh A, Bero L. Effect of reporting bias on meta-analyses of drug trials: reanalysis of meta-analyses. BMJ. 2012;344:d7202.

    Article  PubMed  Google Scholar 

  26. Saini P, Loke YK, Gamble C, Altman DG, Williamson PR, Kirkham JJ. Selective reporting bias of harm outcomes within studies: findings from a cohort of systematic reviews. BMJ. 2014;349:g6501.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Corner J, Wright D, Hopkinson J, Gunaratnam Y, McDonald JW, Foster C. The research priorities of patients attending UK cancer treatment centres: findings from a modified nominal group study. Br J Cancer. 2007;96:875–81.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Owens C, Ley A, Aitken P. Do different stakeholder groups share mental health research priorities? A four-arm Delphi study. Health Expect. 2008;11:418–31.

    Article  PubMed  Google Scholar 

  29. Tong A, Crowe S, Chando S, Cass A, Chadban SJ, Chapman JR, et al. Research priorities in chronic kidney disease for Australia: report of a conference. Am J Kidney Dis. Am J Kidney Dis. 2015;66:212–22.

    Article  PubMed  Google Scholar 

  30. Manns B, Hemmelgarn B, Lillie E, Dip SC, Cyr A, Gladish M, et al. Setting research priorities for patients on or nearing dialysis. Clin J Am Soc Nephrol. 2014;9:1813–21.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Yudkin JS, Lipska KJ, Montori VM. The idolatory of the surrogate. BMJ. 2011;343:d7995.

    Article  PubMed  Google Scholar 

  32. Svensson S, Menkes DB, Lexchin J. Surrogate outcomes in clinical trials: a cautionary tale. JAMA Intern Med. 2013;173:612–12.

    Article  Google Scholar 

  33. Phrommintikul A, Haas SJ, Elsik M, Krum H. Mortality and target haemoglobin concentrations in anaemic patients with chronic kidney disease treated with erythropoietin: a meta-analysis. Lancet. 2007;369:381–88.

    Article  CAS  PubMed  Google Scholar 

  34. Clement FM, Klarenbach S, Tonelli M, Johnson JA, Manns BJ. The impact of selecting a high hemoglobin target level on health-related quality of life for patients with chronic kidney disease: a systematic review and meta-analysis. Arch Intern Med. 2009;169:1104–12.

    Article  CAS  PubMed  Google Scholar 

  35. Morton RL, Snelling P, Webster AC, Rose J, Masterson R, Johnson DW, et al. Dialysis modality preference of patients with CKD and family caregivers: a discrete-choice study. Am J Kidney Dis. 2012;60:102–11.

    Article  PubMed  Google Scholar 

  36. Morton RL, Tong A, Howard K, Snelling P, Webster AC. The views of patients and carers in treatment decision making for chronic kidney disease: systematic review and thematic synthesis of qualitative studies. BMJ. 2010;340:c112.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. Morton RL, Tong A, Webster AC, Snelling P, Howard K. Characteristics of dialysis important to patients and family caregivers: a mixed methods approach. Nephrol Dial Transplant. 2011;26:4038–46.

    Article  PubMed  Google Scholar 

  38. Howell M, Tong A, Wong G, Craig JC, Howard K. Important outcomes for kidney transplant recipients: a nominal group and qualitative study. Am J Kidney Dis. 2012;60:186–96.

    Article  PubMed  Google Scholar 

  39. Tong A, Chando S, Crowe S, Manns B, Winkelmayer WC, Hemmelgarn B, et al. Research priority setting in kidney disease. Am J Kidney Dis. 2015;65:674–83.

    Article  PubMed  Google Scholar 

  40. Tong A, Jesudason S, Craig JC, Winkelmayer WC. Perspectives on pregnancy in women with chronic kidney disease: systematic review of qualitative studies. Nephrol Dial Transplant. 2015;30:652–61.

    Article  PubMed  Google Scholar 

  41. Tong A, Lesmana B, Johnson DW, Wong G, Campbell D, Craig JC. The perspectives of adults living with peritoneal dialysis: thematic synthesis of qualitative studies. Am J Kidney Dis. 2013;61:873–88.

    Article  PubMed  Google Scholar 

  42. Tong A, Palmer S, Manns B, Craig JC, Ruospo M, Gargano L, et al. The beliefs and expectations of patients and caregivers about home haemodialysis: an interview study. BMJ Open. 2013;3:e002148.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Tong A, Sainsbury P, Carter SM, Hall B, Harris DC, Walker RG, et al. Patients’ priorities for health research: focus group study of patients with chronic kidney disease. Nephrol Dial Transplant. 2008;23:3206–14.

    Article  PubMed  Google Scholar 

  44. Tong A, Winkelmayer WC, Craig JC. Qualitative research in CKD: an overview of methods and applications. Am J Kidney Dis. 2014;64:338–46.

    Article  PubMed  Google Scholar 

  45. Bauman AE, Fardy JH, Harris PG. Getting it right: why bother with patient-centred care? MJA. 2003;179:253–56.

    PubMed  Google Scholar 

  46. Boers M, Kirwan JR, Wells G, Beaton D, Gossec L, d’Agostino MA, et al. Developing core outcome measurement sets for clinical trials: OMERACT filter 2.0. J Clin Epidemiol. 2014;67:745–53.

    Article  PubMed  Google Scholar 

  47. Kirkham JJ, Boers M, Tugwell P, Clarke M, Williamson PR. Outcome measures in rheumatoid arthritis randomised trials over the last 50 years. Trials. 2013;14:324.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Kirkham JJ, Gargon E, Clarke M, Williamson PR. Can a core outcome set improve the quality of systematic reviews?–a survey of the Co-ordinating Editors of Cochrane Review Groups. Trials. 2013;14:21.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Waters AM, Tudur Smith C, Young B, Jones TM. The CONSENSUS study: protocol for a mixed methods study to establish which outcomes should be included in a core outcome set for oropharyngeal cancer. Trials. 2014;15:168.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Harman NL, Bruce IA, Callery P, Tierney S, Sharif MO, O’Brien K, et al. MOMENT--Management of Otitis Media with Effusion in Cleft Palate: protocol for a systematic review of the literature and identification of a core outcome set using a Delphi survey. Trials. 2013;14:70.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Schmitt J, Spuls PI, Thomas KS, Simpson E, Furue M, Deckert S, et al. The Harmonising Outcome Measures for Eczema (HOME) statement to assess clinical signs of atopic eczema in trials. J Allergy Clin Immunol. 2014;134:800–7.

    Article  PubMed  Google Scholar 

  52. Chiarotto A, Terwee CB, Deyo RA, Boers M, Lin CW, Buchbinder R, et al. A core outcome set for clinical trials on non-specific low back pain: study protocol for the development of a core domain set. Trials. 2014;15:511.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Prinsen CA, Vohra S, Rose MR, King-Jones S, Ishaque S, Bhaloo Z. Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome measurement instruments for outcomes included in a ‘core outcome set’. Trials. 2014;15:247.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Clark M. Standardising outcomes for clinical trials and systematic reviews. Trials. 2007;8:39.

    Article  Google Scholar 

  55. Stucki G, Boonen A, Tugwell P, Cieza A, Boers M. The World Health Organisation International Classification of Functioning, Disability and Health: a conceptual model and interface for the OMERACT process. J Rheumatol. 2007;34:600–6.

    PubMed  Google Scholar 

  56. Black N. Consensus development methods. Qualitative research in health care. Malden, MA: Blackwell Publishing; 2006.

    Google Scholar 

  57. Jones J, Hunter D. Qualitative research: consensus methods for medical and health services research. BMJ. 1995;311:376–80.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  58. Corbin F, Strauss A. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. Los Angeles, CA: Sage; 2008.

    Book  Google Scholar 

  59. Kuper A, Reeves S, Levinson W. An introduction to reading and appraising qualitative research. Br Med J. 2008;337:a288.

    Article  Google Scholar 

  60. Tong A, Sainsbury P, Craig JC. Consolidated criteria for reporting qualitative research (COREQ): a 32 item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19:249–57.

    Article  Google Scholar 

  61. Sinha IP, Smyth RL, Williamson PR. Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. PLoS Med. 2011;8:e1000393.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Schunemann H, Brozek J, Oxman AD. GRADE handbook for grading quality of evidence and strength of recommendation. 2009.

  63. Louviere JJ, Flynn TN. Using best-worst scaling choice experiments to measure public perceptions and prefernces for healthcare reform in Australia. Patient. 2010;3:275–83.

    Article  PubMed  Google Scholar 

  64. Hensher DA, Rose JM, Greene WH. Applied Choice Analysis: A Primer. Cambridge, UK: Cambridge University Press; 2005.

    Book  Google Scholar 

  65. Fiebig D, Keane M, Louviere J, Wasi N. The generalized multinomial logit model: Accounting for scale and coefficient heterogeneity. Mark Sci. 2010;29:393–421.

    Article  Google Scholar 

Download references


This project was supported by a National Health and Medical Research Council Grant (1092957). AT is funded by a National Health and Medical Research Council Fellowship (ID1037162). BH is supported by the Roy and Vi Baay Chair in Kidney Research. DWJ is funded by a Queensland Government Health Research Fellowship. The funding bodies do not have a role in the design, collection, analysis, and interpretation of data; in the writing of the manuscript; or in the decision to submit the manuscript for publication.

Author information

Authors and Affiliations



Corresponding author

Correspondence to Allison Tong.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

AT conceived the study, contributed to the design of the study, collected and analysed the data, and drafted the manuscript and is a member of the SONG-HD Executive Committee. BM contributed to the design and coordination of the study and collected and analysed the data and is a member of the SONG-HD Executive Committee. BH and SC contributed to the design of the study and collected and analysed the data and are members of the SONG-HD Executive Committee. DCW contributed to the design and coordination of the study and participated in data collection and is a member of the SONG-HD Executive Committee. KH contributed to the design of the study, in particular the Delphi Survey, and participated in data collection and analysis. PT, WCW, and WvB contributed to the design of the study and participated in data collection and analysis and are members of the SONG-HD Executive Committee. PGK, KRP, CP, CMH, DWJ, SPM, and MPG contributed to the design of the study and participated in data collection and analysis. RU-S participated in the coordination of the study, data collection, and analysis. JCC conceived the study, contributed to the design of the study and data analysis, and drafted the manuscript and is a member of the SONG-HD Executive Committee. All authors provided important intellectual input and revised and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tong, A., Manns, B., Hemmelgarn, B. et al. Standardised outcomes in nephrology – Haemodialysis (SONG-HD): study protocol for establishing a core outcome set in haemodialysis. Trials 16, 364 (2015).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: