Skip to main content

COHESION: core outcomes in neonatal encephalopathy (protocol)



Neonatal encephalopathy is a complex syndrome in infants that predominantly affects the brain and other organs. The leading cause is a lack of oxygen in the blood reaching the brain. Neonatal encephalopathy can result in mortality or complications later in life, including seizures, movement disorders and cerebral palsy. Treatment options for neonatal encephalopathy are limited mainly to therapeutic hypothermia, although other potential treatments are emerging. However, evaluations of the effectiveness of treatments are challenging because of heterogeneity and inconsistency in outcomes measured and reported between trials. In this paper, we detail how we will develop a core outcome set to standardise outcomes measured and reported upon for interventions for the treatment of neonatal encephalopathy.


We will systematically review the literature to identify outcomes reported previously in randomised trials and systematic reviews of randomised trials. We will identify outcomes important to parents or caregivers of infants diagnosed with and who have received treatment for neonatal encephalopathy. We will do this by conducting in person or by video teleconferencing interviews with parents or caregivers in high-income and low- to middle-income countries. Stakeholders with expertise in neonatal encephalopathy (parents/caregivers, healthcare providers and researchers) will rate the importance of identified outcomes in an online Delphi survey using either a three-round Delphi survey or a “Real-Time” Delphi survey to which stakeholders will be allocated at random. Consensus meetings will take place by video conference to allow for an international group of stakeholder representatives to discuss and vote on the outcomes to include in the final core outcome set (COS).


More research is needed on treatments for neonatal encephalopathy. Standardising outcomes measured and reported in evaluations of the effectiveness of interventions for the treatment of neonatal encephalopathy will improve evidence synthesis and improve results reported in systematic reviews and meta-analysis in this area. Overall, this COS will allow for improved treatments to be identified, heterogeneity in research to be reduced, and overall patient care to be enhanced.

Trial registration

This study is registered in the Core Outcome Measures for Effectiveness (COMET) database

Peer Review reports


Neonatal encephalopathy is an umbrella term encompassing a complex neurological syndrome in infants born at 35 weeks of gestation or later (as reported by the American College of Obstetricians and Gynecologists’ Task Force on Neonatal Encephalopathy [1]). Lee et al. [2] estimated that, in 2010, approximately 1.15 million infants globally had developed neonatal encephalopathy associated with intrapartum events, of which 96% were born in low- and middle-income countries. It was also estimated that around 287,000 babies with neonatal encephalopathy died in 2010, while 414,000 survived with varying neurodevelopmental impairments [2].

Neonatal encephalopathy is associated in the early days after birth with seizures, an altered state of consciousness, depression of tone and reflexes and difficulty in maintaining normal respiration [3]. Neonatal encephalopathy is also associated with early mortality in the newborn and with long-term morbidity, including poor neurodevelopmental outcomes [4,5,6]. Neonatal encephalopathy is associated with a range of maternal risk factors including hypertension and pre-eclampsia, hypothyroidism [7], foetal growth restriction [8], diabetes [9], prolonged labour [10], bleeding in pregnancy, hypoxia, acute intrapartum events [8] and placental complications [11, 12]. Foetal and neonatal risk factors include hypoxic ischaemia, giving rise to hypoxic ischaemic encephalopathy [8, 13], systemic infection, intracranial infections (viral or bacterial) [14], metabolic disorders (including mitochondrial disorders and organic acidaemias) [15], neonatal stroke [16], genetic and epigenetic risk factors [17], intracranial haemorrhage, epileptic syndromes and neurodegenerative disorders [16] among others [3].

Hypoxic ischaemic encephalopathy (HIE) is a subgroup of neonatal encephalopathy [18] that develops primarily as a result of hypoxic ischaemia in the newborn. However, hypoxic ischaemia may be present in some form as a secondary event in infants with neonatal encephalopathy [18]. Hypoxia refers to diminished oxygen in the tissues secondary to asphyxia (altered gas exchange), and ischaemia refers to a deficiency in the flow of blood available for perfusion. Both can cause profound neurological damage when brain cells are affected. Badawi et al. [8] estimate that hypoxic ischaemia (asphyxia) is a contributing factor in approximately 29% of neonatal encephalopathy cases and the leading factor in a further 4% of cases.

The impact on parents caring for an infant with neonatal encephalopathy was investigated by Lemmon et al. [19], as part of a longitudinal cohort study from 2011 to 2014. Twenty interviews were conducted with parents of infants who received therapeutic hypothermia. These parents described a sense of loss (i.e. due to complications in the perinatal period, disrupted bonding with the infant, etc.), a disrupted way of life (i.e. job loss, time given to attend medical appointments, etc.) and a sense of loss of how they perceived their life should have been. Families also described feeling a sense of guilt or regret surrounding the balance of maternal health decisions, infant treatment, wider familial needs/ priorities, and financial responsibilities. Many parents also described how their role as a parent had evolved into that of an advocate for their child. Interventions for the treatment of neonatal encephalopathy vary depending on the underlying cause of encephalopathy. Therapeutic hypothermia for the treatment of neonates with moderate to severe HIE improves prognosis. A Cochrane systematic review including 11 randomised controlled trials with 1505 late preterm (35 to 37 weeks) and term infants with moderate to severe encephalopathy demonstrated that therapeutic hypothermia reduced death and neurodevelopmental disability in survivors by 25% [20, 21]. It is, therefore, now used as the standard treatment for moderate to severe HIE in many countries worldwide [22, 23]. However, its narrow therapeutic window means it needs to be initiated within the first 6 h after hypoxic ischaemia to optimise therapeutic benefit. Therefore, an early diagnosis is crucial for this therapy to be most efficient [24] and additional treatment options are needed.

In addition to therapeutic hypothermia, other agents are being investigated for their neuroprotective properties as either an adjuvant to therapeutic hypothermia and other treatments, or as a stand-alone therapy. Melatonin and erythropoietin are both emerging as potential adjuvant therapies to therapeutic hypothermia to improve neurodevelopmental outcomes in newborns with neonatal encephalopathy [25,26,27,28]. A study by El Farargy and Soliman [29] showed that magnesium sulphate (MgSO4) administered in combination with melatonin showed a positive effect in reducing brain injury when administered to infants diagnosed with HIE.

However, a significant difficulty in evaluating the effectiveness of new therapies to improve neurodevelopmental outcomes and overall neonatal health is the lack of standardisation of the outcomes reported in these trials. Heterogeneity in outcomes measured and reported frequently hinders comparing and contrasting findings across multiple studies. It also leads to waste in research when findings cannot be used to inform the best care for patients [30, 31]. For example, Jacobs et al. [21] conducted a Cochrane systematic review of 11 trials (1505 infants) evaluating the effectiveness of therapeutic hypothermia in encephalopathic asphyxiated newborn infants but were unable to analyse several a priori secondary outcomes because these were not reported in the included trials. Likewise, in a review by Ruegger et al. [32] investigating xenon as an adjuvant to therapeutic hypothermia, they judged the risk of attrition bias in the primary outcome as “unclear” due to incomplete outcome reporting. A lack of standardisation in trials limits the ability of researchers and healthcare providers to improve patient treatment and care as any actual benefits or harms of the therapy are not clear due to the substantial differences in outcomes between trials.

One way to address this problem is to develop and apply agreed standardised sets of outcomes, known as “core outcome sets” (COS) [31]. A COS represents the minimum set of outcomes to be measured and reported in all trials, and other studies, on a specific condition, while accepting that if outcomes outside of the COS are also important in the context of the individual study they should also be measured for that study [31]. This use of the COS as a minimum set of outcomes to be measured and reported across an entire research area would allow for the results of trials and other studies to be effectively compared, contrasted and combined, as appropriate. However, the successful uptake of a COS will depend ultimately on overcoming certain barriers including involvement of relevant stakeholders, a well-structured consensus process for prioritising outcomes and a plan for dissemination of the COS when complete [33].

The COHESION study will develop a COS for use in randomised trials, and other studies, for evaluating the effectiveness of interventions for the treatment of neonatal encephalopathy.


The development of this COS will adhere to recommendations set out by the COMET initiative [31]. In the development of this protocol, we adhere to the Core Outcome Set-STAndards for Development (COS-STAD) recommendation [34], and follow the COS-STAP statement (Core Outcome Set-STAndardised Protocol Items) [35] (See Appendix A), for developing a COS protocol.

We will develop the COS through five discrete, yet complementary phases (see Fig. 1):

  • Phase 1: A systematic review of the literature to identify outcomes that have been reported in randomised trials and systematic reviews of randomised trials of interventions for the treatment of neonatal encephalopathy;

  • Phase 2: A qualitative component using interviews to obtain the views of parents whose infants have been diagnosed with, and received treatment for, neonatal encephalopathy or other family members who may care for the infant, on critical outcomes they feel should be measured to determine the effect of treatment(s) for neonatal encephalopathy;

  • Phase 3: Development of a preliminary COS (informed by Phases 1 & 2) through stratified randomisation of key stakeholders to one of two web-based, Delphi surveys;

  • Phase 4: Consensus meeting to discuss and agree on the final neonatal encephalopathy COS;

  • Phase 5: Dissemination and Implementation strategy for the final COS.

Fig. 1
figure 1

Schematic of COS development

The steering group for COHESION consists of neonatologists, obstetricians, midwives, a neonatal nurse practitioner, parents (i.e. public and patient involvement (PPI) representatives), experts in COS development and researchers with expertise in neonatal encephalopathy. The collective knowledge of this group will inform the development of this COS.

Phase 1: Systematic review

Research question: what are the outcomes reported in studies for the treatment of neonatal encephalopathy?

We will carry out a systematic review of randomised trials and systematic reviews of randomised trials evaluating the effectiveness of interventions for the treatment of neonatal encephalopathy to identify and collate reported outcomes.

Inclusion criteria

Types of studies

The types of studies are randomised trials and systematic reviews of randomised trials (with and without meta-analyses) evaluating the effectiveness of interventions for the treatment of neonatal encephalopathy.

Types of participants

Patients will include infants treated for neonatal encephalopathy or HIE, greater than or equal to 35 weeks gestation. Where there is a mixed gestational age reported, at least 80% of infants must be greater than, or equal to, 35 weeks gestation.

Types of interventions

The types of interventions are any intervention used for the treatment of neonatal encephalopathy or HIE. Comparison(s) include any comparator intervention(s) for the treatment of neonatal encephalopathy. This may involve an alternative treatment, standard care, a placebo treatment or no treatment.

Types of outcomes

All of the outcomes reported in the included studies will be recorded, along with the timing of the outcomes.

Search methodology

We will perform two separate searches for:

  • Randomised Controlled Trials, through


    • MEDLINE and Embase

  • Systematic Reviews of Randomised Controlled Trials, through

    • Cochrane Database of Systematic Reviews (CDSR)

    • MEDLINE and Embase

In addition, the World Health Organization’s International Clinical Trials Registry Platform (WHO-ICTRP) will also be searched for ongoing trials.

Assessment for eligibility

The titles and abstracts of citations identified from our search will be screened and reviewed independently by two reviewers (FAQ and DD or PH). Full texts of potentially relevant studies will be assessed to determine their eligibility. If there is uncertainty among the reviewers regarding the inclusion of a study or its relevance at the screening stage, a third reviewer (DD or PH) will be consulted.

Data extraction

Data will be extracted from each study on study design, author details, year and journal of publication, the country in which the study was conducted, targeted condition, criteria for the diagnosis of neonatal encephalopathy, interventions under investigation and all outcomes as they are reported in the studies (including measurement time-points). Extracting this data ensures the inclusion criteria are met for included studies. Extracting the country in which the study was conducted will allow us to assess any potential differences in outcomes between high- and low- to middle-income countries that may emerge from the interviews with parents. One review author (FAQ) will extract data while a second reviewer (DD or PH) will complete an analysis and verification check of 50% of the outcomes extracted. If there are discrepancies found, all extracted outcomes will be verified by the second reviewer (DD or PH). Disagreement will be resolved through discussion with a third reviewer (DD or PH).

Data analysis and presentation

Data will be tabulated using Excel so that each study is listed, and all outcomes measured in each study are displayed separately. Outcomes identified from the systematic review will be reviewed by the COHESION Steering Group, which includes PPI representatives. Outcomes will be grouped under major domains (e.g., maternal outcomes, neonatal, infant, child and adult outcomes, and others, e.g. health economic consequences), as pre-determined by the Steering Group. Domains will then be reviewed by the Steering Group to discuss where gaps are in important domains.

Phase 2: Qualitative exploration of outcomes important to parents/caregivers whose infants have been diagnosed with, and received treatment for, neonatal encephalopathy

Research question

What are the outcomes regarded as potentially important in neonates diagnosed with, and treated for, neonatal encephalopathy from the perspective and experiences of parents or other family members who may care for the infant?

Systematic reviews are more likely to highlight outcomes identified as important by researchers [31]. We will carry out interviews to obtain the views of mothers, their partners and other family members who may care for the infant, on critical outcomes that they feel should be measured to determine the effect of interventions for the treatment of neonatal encephalopathy.


This phase will be informed by descriptive qualitative research design, using interviews, to obtain the perspectives of parents or other family members who may care for the infant, on outcomes they judge important for inclusion in the Delphi survey in Phase 3. Descriptive qualitative research allows the perspective of those experiencing the phenomenon (in healthcare research, this often directly relates to the experiences of a patient) to be captured [36, 37]. As we cannot conduct interviews with the patients (neonates) in this study, we will use qualitative research to elicit the perspective of women, their partners, and other family members who may care for the infant, on outcomes they judge important. We will report this qualitative phase following reporting recommendations for qualitative research methods in COS development as outlined by Jones et al. [38] (Table 1).

Table 1 Reporting recommendations for qualitative research methods in COS development, as developed by Jones et al. [38]



We will recruit stakeholders for one-to-one interviews from high-income countries (Ireland, Australia, United Kingdom and United States) and low- to middle-income countries (Kenya, India and Pakistan).


Potential participants will be invited to join this study. The participants are parents whose infants have been diagnosed with and received treatment for neonatal encephalopathy, or other family members who may care for the infant from each country (i.e. caregivers). Infants will have been born at 35 weeks gestation or later, with a birth weight considered healthy for each location. In low- to middle-income countries, a diagnosis of birth asphyxia and/or neonatal encephalopathy will be accepted. If it is not possible to recruit enough parents or caregivers of infants who have been diagnosed with and received treatment for birth asphyxia or neonatal encephalopathy, we will try to recruit parents of infants with neonatal encephalopathy who did not receive treatment. We will recruit a minimum of five parents per country initially, but final participant numbers will be determined by data saturation, i.e. the point in which no additional outcomes are being suggested [39].


Steering group members will identify Gatekeepers in each respective country. Gatekeepers will consist of researchers, healthcare professionals working in the field of neonatal encephalopathy, and PPI representatives from voluntary organisations supporting parents of children with neonatal encephalopathy. The Gatekeepers will act to identify potential participants through their local knowledge in their particular country. A purposive sampling strategy will be employed in which the Gatekeeper will identify participants through any one of the following means: professional organisations, advocacy groups, parent support groups, previous participation in related research (and where consent permits contact as proposed).

Interview format

One-to-one interviews will be the primary method of data collection. Interviews have been used in obtaining patient/user-important outcomes previously [40,41,42]. The benefit of one-to-one interviews is that it allows study participants who may not speak freely in a group setting to participate and share their views without the influence of other people’s opinions.

The one-to-one interviews will focus on obtaining the views of parents/caregivers whose infants have been diagnosed with and treated for neonatal encephalopathy (or birth asphyxia), on critical outcomes that should be measured to determine the effect of interventions for the treatment of neonatal encephalopathy. The interviews will follow a semi-structured format, where participants will initially be prompted by open questions to encourage discussion. PPI representatives on the COHESION steering group will give guidance on developing and reviewing the interview guide. The interview guide may develop iteratively during the interview process.

High-income countries

As English is spoken widely in both of these countries, one-to-one interviews will be offered through video conferencing, which will be available through any computer or handheld device including mobile phones. Once the participants have been identified, they will be sent an information pack via email (outlining the purpose, expectations of participants, benefits and harms to participation in this study, how data will be used, right to withdraw, voluntary participation and an offer to answer any questions). Potential participants will be invited to respond directly to the lead researcher (FAQ) if they want to participate. Once consent is received from the participant to take part in the interview, these interviews will be carried out by Steering Group members (FAQ and LB).

Low- to middle-income countries

The Gatekeepers will recruit local researchers with experience in interviewing to conduct the interviews. We have considered the need to ensure that potential participants are given sufficient information on which to base a decision on whether or not they would like to participate in the interview. We cannot be confident that potential participants, in low- to middle-income countries, in particular, will have the literacy levels necessary to read and understand a participant information leaflet and consent form. For example, approx. 40% of the Kenyan population are illiterate but regional literacy varies widely from, for example, approx. 87% in Nairobi to 8% in North Eastern Province (see: Interviewers (local researcher or healthcare professional) will speak both English and the local dialect of participants fluently. The interviewer will pre-record a verbal explanation of the contents of the information pack (i.e. the purpose of the project, expectations of participants, benefits and harms to participation in this study, how data will be used, right to withdraw, voluntary participation and an offer to answer any questions which may also be directed to the lead researcher (FAQ) to answer) for participants to listen to if they have low literacy levels. Alternatively, they can read the Participant Information Leaflet themselves. Participants who agree to participate will sign (either through signing their signature or an “X”) on the consent form indicating that they have given their consent to take part. A copy of the signed consent form will be sent to the COHESION research team at the earliest opportunity. The interviewer will conduct the interviews in the native language using a semi-structured interview schedule. The Participant Information Leaflet, Consent Form and Interview Guide will be forward- and back-translated and compared against the original English-language document and any discrepancies will be resolved before the interviews commence. The interview will be audio-recorded, and the recording will be transcribed. Transcripts will be translated into English by the interviewer and then returned to the COHESION research team.

Data analysis

Using the principles of thematic analysis, the interview data will be coded to describe the content in terms of outcomes; patterns will then be established across the codes to identify the themes noted by the participants as important measures to determine the effect of treatment(s) for neonatal encephalopathy. The context of why the outcome was important to the participant will also be identified and noted. This will allow for clarification of the importance of the outcomes in subsequent phases of the COS development such as the development of plain-language summaries of outcomes for the Delphi surveys and justification of outcomes going forward to the consensus meeting(s). As highlighted by Williamson et al. [43] and Keeley et al. [44], qualitative interviews are also beneficial for improving the language used to describe outcomes for the Delphi survey and also allow for the scope of the outcomes as described by parents, to be better captured.

Phase 3: Delphi surveys

Consensus must be reached among stakeholders on the final outcomes included in the COS. In COS development, the use of Delphi surveys, in combination with other consensus methods such as focus groups or interviews among other techniques, or as the primary method of consensus building, is common [45].


We will recruit stakeholders with expertise in neonatal encephalopathy to participate in our Delphi survey. Stakeholders will be identified through email invitations, electronic discussion lists, individuals who have contributed to work or research in this area previously, other experts in the field of neonatal encephalopathy who have publications in this field as identified through carrying out the systematic review and qualitative interviews, through international professional organisations, and support networks. Stakeholders will be grouped into three broad groups: (a) parents/caregivers of infants who have been diagnosed with, and received treatment for, neonatal encephalopathy, (b) healthcare providers, including policymakers and (c) researchers with expertise in the area of neonatal encephalopathy.


In this part of the COS development process, we are incorporating a randomised trial to identify whether different outcomes are prioritised when using a Real-Time Delphi method compared with a Multi-Round Delphi method in the development of a COS on interventions for the treatment of neonatal encephalopathy. Participants will be randomised to participate in one of two Delphi surveys. One survey will involve a three-round approach, while the other involves a single-round, Real-Time Delphi survey. In both surveys, stakeholders will be asked to rate the importance of the same list of outcomes that emerge from the interviews with parents/caregivers and the systematic review. In both surveys, participants will be asked to rate the importance of each outcome on a 9-point Likert scale (i.e. 1–3 limited importance, 4–6 important but not critical and 7–9 critical) [31]. In the Multi-Round Delphi, feedback will be given to participants at the end of each round. Participants will be given the opportunity to change how they rated outcomes in rounds 2 and 3 based on this feedback. Participants who have taken part in the first round of the survey will be invited to participate in the second round. Likewise, those who have participated in the second round will be invited to participate in the final round of the survey. In the single-round “Real-Time” Delphi, feedback will be available to participants in 'real-time' when they enter the survey. This will give the participants the opportunity to review the outcomes and modify how they rate the outcome if they wish. They will also be reminded by email to re-visit and re-rate outcomes before the survey ends. The feedback given in both surveys will consist of the individual respondents’ rating and the proportion of people scoring each point in the 9-point Likert scale for each outcome, for (a) each stakeholder group (i.e. parents/caregivers; healthcare providers, including policy makers, and researchers with expertise in the area of neonatal encephalopathy) and, (b) overall, across all groups as defined by Table 2. All unique outcomes that emerge at the end of both survey arms will be combined and brought forward to the consensus meeting(s). For more information on the method used in this trial, please see the In-press protocol that accompanies this paper “Multi-round compared to Real-Time Delphi for consensus in Core Outcome Set (COS) development: A randomised trial”.

Table 2 Consensus classification

Phase 4: Consensus meeting(s)


The objective of the consensus meeting is to achieve agreement on the final COS through an online meeting of international key stakeholders with expertise in neonatal encephalopathy.


Stakeholders in the consensus meeting(s) will include at least two representatives of parents or caregivers whose infants have been diagnosed with or treated for neonatal encephalopathy, healthcare providers and researchers/academics with expertise in neonatal encephalopathy treatment. We aim to have a global spread of stakeholders participating in the consensus meeting(s). This will be accommodated by facilitating multiple meetings via “Zoom” teleconference.


The outcomes emerging from the Multi-Round Delphi survey and the Real-Time Delphi survey will be pooled and duplicates removed. This combined list of unique outcomes will be put forward to the consensus meeting(s). Outcomes voted as “consensus out” will be presented as an independent set and stakeholders will be asked if they accept the omission of these outcomes. Outcomes voted as “consensus in” (Table 2) will then be presented independently and discussed individually, and stakeholders will be asked to vote on the inclusion of these outcomes in the COS. Any outcomes that were voted neither “consensus in” nor “consensus out” will be discussed, and the stakeholders will vote if any of these outcomes should be included.


Materials will be distributed in advance of the meeting(s) to inform discussions. A non-voting facilitator will ensure that each meeting is (i) collaborative; (ii) cooperative and non-competitive; (iii) egalitarian, providing equal input from all participants; (iv) inclusive with all participants contributing to discussions and (v) participatory.

As highlighted by Gargon et al. [46], there are often difficulties in having an international representation at the consensus meeting to determine the final COS. Some of the obstacles mentioned in having an international consensus meeting include financial and human resources [46]. We propose to conduct the consensus meeting for COHESION via video conference. To optimise international representation to decide on the final COS, multiple meetings may need to be held, with corresponding time zones taken into account. The unique outcomes from these consensus meeting(s) will be pooled and used to populate an online discussion forum. Using this online forum, stakeholders who attended the consensus meeting(s) can discuss outcomes and cast their final vote for an outcome to be included in the final COS. The outcomes emerging from this online voting will make up the final COS for neonatal encephalopathy.

Phase 5: Dissemination and implementation strategy

The dissemination and implementation strategy for COHESION is guided by the Health Research Board (HRB, Ireland), knowledge transfer strategy: (i) Monitor; (ii) Inform; (iii) Knowledge Exchange; (iv) Persuade; (v) Network and (vi) Support. Our proposed methods of dissemination and implementation include, but not limited to:

  • Targeting key stakeholders with interest in neonatal encephalopathy such as survey participants, health care providers in maternity hospitals, neonatal encephalopathy and maternity care researchers, Colleges of Physicians, Colleges of Obstetrics and Gynaecologists’, national and international societies and organisations for circulating to their members such as:

    • The Cochrane Pregnancy and Childbirth Group

    • CROWN (Core Outcomes in Women’s and Newborn Health) Initiative

    • Society for Reproductive Investigation (SRI)

    • Perinatal Society of Australia and New Zealand (PSANZ)

    • British Association of Perinatal Medicine (BAPM)

    • Paediatric Academic Society (PAS)

    • Paediatric Research Society (PRS)

    • European Society for Paediatric Research (ESPR)

    • International Confederation of Midwives (ICM)

    • International Federation of Gynecology and Obstetrics (FIGO)

    • Irish Paediatric Association (IPA)

    • Irish Neonatal Health Alliance (INHA)

    • Global Alliance for Newborn Care (GLANCE)

    • Miracle Babies Foundation (MBF)

    • Life’s Little Treasure Foundation (LLTF)

    • Council of International Neonatal Nurses (COINN)

    • European Foundation for the Care of Newborn Infants (EFONI)

    • Union of European Neonatal & Perinatal Societies (UENPS)

    • Hope For HIE

  • Establishing networks and collaborations with an interest in COS development (COMET (Core Outcome Measures in Effectiveness Trials) team for inclusion in the database of COS (

  • Engagement with research funders, national insurers, guideline developers, trial registries and guideline developers.

Ways in which will achieve dissemination to the target audience include open access publications, presentations at relevant conferences, website updates (, posters, events, research briefs, newsletters, press release, podcasts and social media updates.


Interventions for the treatment of neonatal encephalopathy vary depending on the underlying cause of encephalopathy. Therapeutic hypothermia has become the most common treatment for neonates with neonatal encephalopathy caused by hypoxic ischaemia. Therapeutic hypothermia is not without its limitations. As mentioned, it is a time-limited treatment most beneficial when initiated before 6 h, and its optimal way to provide cooling is uncertain [21]. Other interventions are emerging as adjuvant treatments with therapeutic hypothermia or as stand-alone treatments. As these new treatment interventions are evaluated in trials, it is important that the same core outcomes are used to determine the effect of the treatment. This will help minimise heterogeneity and provide greater opportunity for synthesising evidence from different trials.

Currently, there is no published COS for studies evaluating the effects of interventions for the treatment of neonatal encephalopathy. The development of this COS will ensure there is transparency surrounding the collection and reporting of a minimum dataset that is agreed by key stakeholder consensus. This should help to reduce inconsistencies and heterogeneity in outcomes reported in trials involving neonatal encephalopathy treatment.

Availability of data and materials

All datasets used and/or analysed during the COHESION study will be held by COHESION team as



Core outcome set


Hypoxic ischaemic encephalopathy


Core Outcome Measures in Effectiveness Trials


Public and patient involvement


Core Outcome Set-STAndardised Protocol Items


Core Outcome Set-STAndards for Development


Fiona Anne Quirke


Declan Devane


Patricia Healy


Linda Biesty


Cochrane Central Register of Controlled Trials


Cochrane Database of Systematic Reviews


World Health Organization’s International Clinical Trials Registry Platform


  1. Executive summary: Neonatal encephalopathy and neurologic outcome, second edition. Report of the American College of Obstetricians and Gynecologists’ task force on neonatal encephalopathy. Obstet Gynecol 2014;123(4):896–901.

  2. Lee AC, Kozuki N, Blencowe H, Vos T, Bahalim A, Darmstadt GL, et al. Intrapartum-related neonatal encephalopathy incidence and impairment at regional and global levels for 2010 with trends from 1990. Pediatr Res. 2013;74(Suppl 1):50–72.

    PubMed  PubMed Central  Article  Google Scholar 

  3. Volpe JJ. Neonatal encephalopathy: an inadequate term for hypoxic-ischemic encephalopathy. Ann Neurol. 2012;72(2):156–66.

    PubMed  Article  Google Scholar 

  4. Al-Macki N, Miller SP, Hall N, Shevell M. The spectrum of abnormal neurologic outcomes subsequent to term intrapartum asphyxia. Pediatr Neurol. 2009;41(6):399–405.

    PubMed  Article  Google Scholar 

  5. Barnett A, Mercuri E, Rutherford M, Haataja L, Frisone MF, Henderson S, et al. Neurological and perceptual-motor outcome at 5–6 years of age in children with neonatal encephalopathy: relationship with neonatal brain MRI. Neuropediatrics. 2002;33(5):242–8.

    CAS  PubMed  Article  Google Scholar 

  6. Douglas-Escobar M, Weiss MD. Hypoxic-ischemic encephalopathy: a review for the clinician. JAMA Pediatr. 2015;169(4):397–403.

    PubMed  Article  Google Scholar 

  7. Nelson KB, Bingham P, Edwards EM, Horbar JD, Kenny MJ, Inder T, et al. Antecedents of neonatal encephalopathy in the Vermont Oxford Network Encephalopathy Registry. Pediatrics. 2012;130(5):878–86.

    PubMed  PubMed Central  Article  Google Scholar 

  8. Badawi N, Kurinczuk JJ, Keogh JM, Alessandri LM, O’Sullivan F, Burton PR, et al. Antepartum risk factors for newborn encephalopathy: the Western Australian case-control study. BMJ. 1998;317(7172):1549–53.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  9. Cnattingius S, Lindam A, Persson M. Risks of asphyxia-related neonatal complications in offspring of mothers with type 1 or type 2 diabetes: the impact of maternal overweight and obesity. Diabetologia. 2017;60(7):1244–51.

    PubMed  PubMed Central  Article  Google Scholar 

  10. Torbenson VE, Tolcher MC, Nesbitt KM, Colby CE, El-Nashar SA, Gostout BS, et al. Intrapartum factors associated with neonatal hypoxic ischemic encephalopathy: a case-controlled study. BMC Pregnancy Childbirth. 2017;17(1):415.

    PubMed  PubMed Central  Article  Google Scholar 

  11. Wintermark P, Boyd T, Gregas MC, Labrecque M, Hansen A. Placental pathology in asphyxiated newborns meeting the criteria for therapeutic hypothermia. Am J Obstet Gynecol. 2010;203(6):579.e1–9.

    Article  Google Scholar 

  12. McDonald DG, Kelehan P, McMenamin JB, Gorman WA, Madden D, Tobbia IN, et al. Placental fetal thrombotic vasculopathy is associated with neonatal encephalopathy. Hum Pathol. 2004;35(7):875–80.

    PubMed  Article  Google Scholar 

  13. Thiebes S, Scheidt D, Schmidt-Kraepelin M, Sunyaev A. Paving the way for real-time Delphi in information systems research: a synthesis of survey instrument designs and feedback mechanisms. Portsmouth: 26th European Conference of Information Systems; 2018.

    Google Scholar 

  14. Nelson KB, Grether JK. Potentially asphyxiating conditions and spastic cerebral palsy in infants of normal birth weight. Am J Obstet Gynecol. 1998;179(2):507–13.

    CAS  PubMed  Article  Google Scholar 

  15. Uziel G, Ghezzi D, Zeviani M. Infantile mitochondrial encephalopathy. Semin Fetal Neonatal Med. 2011;16(4):205–15.

    PubMed  Article  Google Scholar 

  16. Ramaswamy V, Miller SP, Barkovich AJ, Partridge JC, Ferriero DM. Perinatal stroke in term infants with neonatal encephalopathy. Neurology. 2004;62(11):2088–91.

    CAS  PubMed  Article  Google Scholar 

  17. Calkavur S, Akisu M, Olukman O, Balim Z, Berdeli A, Cakmak B, et al. Genetic factors that influence short-term neurodevelopmental outcome in term hypoxic-ischaemic encephalopathic neonates. J Int Med Res. 2011;39(5):1744–56.

    CAS  PubMed  Article  Google Scholar 

  18. Molloy EJ, Beaer C. Neonatal encephalopathy versus hypoxic-ischemic encephalopathy. Pediatr Res. 2018;84:574.

    PubMed  Article  Google Scholar 

  19. Lemmon ME, Donohue PK, Parkinson C, Northington FJ, Boss RD. Parent experience of neonatal encephalopathy. J Child Neurol. 2017;32(3):286–92.

    PubMed  Article  Google Scholar 

  20. Azzopardi D, Strohm B, Marlow N, Brocklehurst P, Deierl A, Eddama O, et al. Effects of hypothermia for perinatal asphyxia on childhood outcomes. N Engl J Med. 2014;371(2):140–9.

    CAS  PubMed  Article  Google Scholar 

  21. Jacobs SE, Berg M, Hunt R, Tarnow-Mordi WO, Inder TE, Davis PG. Cooling for newborns with hypoxic ischaemic encephalopathy. Cochrane Database Syst Rev. 2013;2013(1):Cd003311.

    PubMed Central  Google Scholar 

  22. Shankaran S, Laptook AR, Pappas A, McDonald SA, Das A, Tyson JE, et al. Effect of depth and duration of cooling on deaths in the NICU among neonates with hypoxic ischemic encephalopathy: a randomized clinical trial. JAMA. 2014;312(24):2629–39.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  23. Yildiz EP, Ekici B, Tatli B. Neonatal hypoxic ischemic encephalopathy: an update on disease pathogenesis and treatment. Expert Rev Neurother. 2017;17(5):449–59.

    CAS  PubMed  Article  Google Scholar 

  24. Thoresen M, Tooley J, Liu X, Jary S, Fleming P, Luyt K, et al. Time is brain: starting therapeutic hypothermia within three hours after birth improves motor outcome in asphyxiated newborns. Neonatology. 2013;104(3):228–33.

    PubMed  Article  Google Scholar 

  25. Welin AK, Svedin P, Lapatto R, Sultan B, Hagberg H, Gressens P, et al. Melatonin reduces inflammation and cell death in white matter in the mid-gestation fetal sheep following umbilical cord occlusion. Pediatr Res. 2007;61(2):153–8.

    CAS  PubMed  Article  Google Scholar 

  26. Pandi-Perumal SR, Srinivasan V, Maestroni GJ, Cardinali DP, Poeggeler B, Hardeland R. Melatonin: Nature's most versatile biological signal? Fed Eur Biochem Soc J. 2006;273(13):2813–38.

    CAS  Google Scholar 

  27. Zhu C, Kang W, Xu F, Cheng X, Zhang Z, Jia L, et al. Erythropoietin improved neurologic outcomes in newborns with hypoxic-ischemic encephalopathy. Pediatrics. 2009;124(2):e218–26.

    PubMed  Article  Google Scholar 

  28. Elmahdy H, El-Mashad AR, El-Bahrawy H, El-Gohary T, El-Barbary A, Aly H. Human recombinant erythropoietin in asphyxia neonatorum: pilot trial. Pediatrics. 2010;125(5):e1135–42.

    PubMed  Article  Google Scholar 

  29. El Farargy MS, Soliman NA. A randomized controlled trial on the use of magnesium sulfate and melatonin in neonatal hypoxic ischemic encephalopathy. J Neonatal-Perinatal Med. 2019;12:379–84.

    PubMed  Article  Google Scholar 

  30. Chan AW, Song F, Vickers A, Jefferson T, Dickersin K, Gotzsche PC, et al. Increasing value and reducing waste: addressing inaccessible research. Lancet. 2014;383(9913):257–66.

    PubMed  PubMed Central  Article  Google Scholar 

  31. Williamson PR, Altman DG, Bagley H, Barnes KL, Blazeby JM, Brookes ST, et al. The COMET Handbook: version 1.0. Trials. 2017;18(Suppl 3):280.

    PubMed  PubMed Central  Article  Google Scholar 

  32. Ruegger CM, Davis PG, Cheong JL. Xenon as an adjuvant to therapeutic hypothermia in near-term and term newborns with hypoxic-ischaemic encephalopathy. Cochrane Database of Syst Rev. 2018;8:Cd012753.

    Google Scholar 

  33. Akinremi A, Turnbull AE, Chessare CM, Bingham CO 3rd, Needham DM, Dinglas VD. Delphi panelists for a core outcome set project suggested both new and existing dissemination strategies that were feasibly implemented by a research infrastructure project. J Clin Epidemiol. 2019;114:104–7.

    PubMed  Article  Google Scholar 

  34. Kirkham JJ, Davis K, Altman DG, Blazeby JM, Clarke M, Tunis S, et al. Core outcome set-STAndards for development: the COS-STAD recommendations. PLoS Med. 2017;14(11):e1002447.

    PubMed  PubMed Central  Article  Google Scholar 

  35. Kirkham JJ, Gorst S, Altman DG, Blazeby JM, Clarke M, Tunis S, et al. Core outcome set-STAndardised protocol items: the COS-STAP statement. Trials. 2019;20(1):116.

    PubMed  PubMed Central  Article  Google Scholar 

  36. Colorafi KJ, Evans B. Qualitative descriptive methods in health science research. Health Environ Res Des J. 2016;9(4):16–25.

    Google Scholar 

  37. Magilvy JK, Thomas E. A first qualitative project: qualitative descriptive design for novice researchers. J Spec Pediatr Nurs. 2009;14(4):298–300.

    PubMed  Article  Google Scholar 

  38. Jones JE, Jones LL, Keeley TJ, Calvert MJ, Mathers J. A review of patient and carer participation and the use of qualitative research in the development of core outcome sets. PLoS One. 2017;12(3):e0172937.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  39. Morse JM. Determining sample size. Qual Health Res. 2000;10:3–5.

    Article  Google Scholar 

  40. MacLennan S, Williamson PR, Bekema H, Campbell M, Ramsay C, N'Dow J, et al. A core outcome set for localised prostate cancer effectiveness trials. Br J Urol Int. 2017;120(5B):E64–79.

    Article  Google Scholar 

  41. Srikandarajah N, Noble AJ, Wilby M, Clark S, Williamson PR, Marson AG. Protocol for the development of a core outcome set for cauda equina syndrome: systematic literature review, qualitative interviews, Delphi survey and consensus meeting. BMJ Open. 2019;9(4):e024002.

    PubMed  PubMed Central  Article  Google Scholar 

  42. Alkhaffaf B, Glenny AM, Blazeby JM, Williamson P, Bruce IA. Standardising the reporting of outcomes in gastric cancer surgery trials: protocol for the development of a core outcome set and accompanying outcome measurement instrument set (the GASTROS study). Trials. 2017;18(1):370.

    PubMed  PubMed Central  Article  Google Scholar 

  43. Williamson PR, Blazeby JM, Brookes ST, Clarke M, Terwee CB, Young B. Comments on Chevance et al Improving the generalizability and credibility of core outcome sets (COS) by a large and international participation of diverse stakeholders. J Clin Epidemiol. 2020;

  44. Keeley T, Williamson P, Callery P, Jones LL, Mathers J, Jones J, et al. The use of qualitative methods to inform Delphi surveys in core outcome set development. Trials. 2016;17(1):230.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  45. Biggane AM, Brading L, Ravaud P, Young B, Williamson PR. Survey indicated that core outcome set development is increasingly including patients, being conducted internationally and using Delphi surveys. Trials. 2018;19(1):113.

    PubMed  PubMed Central  Article  Google Scholar 

  46. Gargon E, Williamson PR, Young B. Improving core outcome set development: qualitative interviews with developers provided pointers to inform guidance. J Clin Epidemiol. 2017;86:140–52.

    PubMed  PubMed Central  Article  Google Scholar 

Download references


We would like to acknowledge the generosity of a number of parent advocacy groups who have offered to help us recruit parents for interviews in high-income countries. We would like to thank specifically the Irish Neonatal Health Alliance (INHA) in Ireland, Hope for HIE (global), Miracle Babies Foundation (Australia) and Life’s Little Treasures Foundation (Australia).


This research was funded by the Health Research Board, Neonatal Encephalopathy PhD Training Network (HRB-NEPTuNE).

Author information

Authors and Affiliations



All authors (FAQ, PH, ENíB, MD, LB, TH, KW, SM, DMH, FHB, JJK, EJM and DD) made substantial contributions to the conception and design of the Core Outcome Set. FAQ, JK, PH, LB and DD drafted the manuscript. All authors commented on revisions to draft versions of the manuscript and read, commented on, and approved the final manuscript. All authors are members of the overall COHESION study team.

Corresponding author

Correspondence to Fiona A. Quirke.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was obtained for the COHESION study from the National University of Ireland, Galway Research Ethics Committee (reference number: 19-Apr-14). Participation in interviews and the Delphi surveys is optional, and each participant will be required to provide informed consent. Additional ethical approval was obtained in LMiC settings for face-to-face interviews. In Kenya, ethical approval was granted by Moi University and Moi Teaching and Referral Hospital, Institutional Research and Ethics Committee (IREC) (reference: IREC/2016/243; approval number 0001974). Ethical approval for Pakistan is pending.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.



Table 3 Core outcome set-STAndardised protocol items

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Quirke, F.A., Healy, P., Bhraonáin, E.N. et al. COHESION: core outcomes in neonatal encephalopathy (protocol). Trials 22, 125 (2021).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI:


  • Core outcome set
  • High-income countries
  • Low- to middle-income countries
  • Delphi
  • Real-time Delphi
  • PPI
  • Neonatal encephalopathy
  • Outcomes