Outcomes for Pressure Ulcer Trials (OUTPUTs): protocol for the development of a core domain set for trials evaluating the clinical efficacy or effectiveness of pressure ulcer prevention interventions

Abstract

Background

Core outcome sets (COS) are being developed in many clinical areas to increase the quality and comparability of clinical trial results as well as to ensure their relevance for patients. A COS represents an agreed standardized set of outcomes that describes the minimum that should be consistently reported in all clinical trials of a defined area. It comprises a core domain set (defining what core outcomes should be measured) and a core measurement set (defining measurement/assessment instruments for each core domain). For pressure ulcer prevention trials a COS is lacking. The great heterogeneity of reported outcomes in this field indicates the need for a COS.

Methods/design

The first part of this project aims to develop a core domain set by following established methods, which incorporates four steps: (1) definition of the scope, (2) conducting a scoping review, (3) organizing facilitated workshops with service users, (4) performing Delphi surveys and establishing consensus in a face-to-face meeting with different stakeholders.

Discussion

After achieving consensus on the core domain set, further work will be undertaken to determine a corresponding core measurement set. This will lead to better pressure ulcer prevention research in the future. There are a number of methodological challenges in the field of COS development. To meet these challenges and to ensure a high-quality COS, the OUTPUTS project affiliates to current standards and works in close collaboration with international experts and with existing international service user groups.

Trial registration

The OUTPUTs project is registered in the COMET database: (http://www.comet-initiative.org/studies/details/283). Registered on 2015.

Background

Results of clinical trials are critical for the development of evidence-based guidelines and decision-making at various levels of health care delivery. The selection of trial outcomes affects the validity, precision and clinical applicability of the trial findings. Trial outcomes should be biologically plausible, clinically meaningful and perceived as relevant from multiple perspectives, e.g. patients, informal caregivers, health professionals, policy-makers or manufacturers [1]. Further, these outcomes need to be measured with low risk of bias [2]. However, meta-epidemiological data indicate that outcomes and measurement methods often vary across trials for the same condition [3, 4], are of unclear clinical relevance [5, 6] or show selective reporting [3, 7]. Single trials often lack standards about the selection and measurement of outcomes and thus preclude meaningful summaries of evidence for a given health intervention.

To improve the rigour of single trials, and to facilitate meaningful evidence syntheses, standardising trial outcomes via the development of core outcome sets (COS) was recommended [8]. These are intended to represent “the minimum that should be measured and reported in all clinical trials of a specific condition” [9] and include a core set of outcome domains (core domain set) and a core set of measurement instruments to measure these outcomes (core measurement set) [10]. Thus, COS address questions about what to measure and how to measure it.

To date, COS have been developed for various medical conditions, such as rheumatologic conditions [11], hip fractures [12], atopic eczema [13] and incontinence-associated dermatitis [14]. An online database of COS projects has been established by the Core Outcome Measures in Effectiveness Trials (COMET) initiative [9], which is growing continuously [15]. The use of the COMET database is actively endorsed by the Cochrane Skin–Core Outcome Set Initiative (CS-COUSIN), which began in 2014 and comprises international, multidisciplinary researchers in the field of dermatology. The aim of this initiative is to support the development and to strengthen the quality of COS in dermatology, skin and soft tissue research by providing methodological advice, implementing tools for COS development and promoting exchange between the COS development groups in the field [16].

Pressure ulcers (PU) are lesions of the skin and underlying soft tissues caused by prolonged and/or elevated exposure to compressive and shearing forces. In the conceptual framework of Coleman et al. [17], immobility, impaired perfusion and skin/PU status (comprising existing and previous PU and general skin status) are proposed to be direct causal factors for PU development. There are a number of other indirect causal factors such as compromised sensory perception, diabetes mellitus, moisture and poor nutrition, which often occur in frail or critically ill people [17].

PUs are classified according to the visible depth of skin and tissue damage, ranging from non-blanchable erythema (category 1) to full thickness tissue loss involving muscle tissue and juxtaposed structures (category 4) [18]. Worldwide, the prevalence of PUs ranges from 0.3 to 46%, with highest prevalence in advanced age [19,20,21]. PUs can cause symptoms including pain [22,23,24], exudate and odour and compromise all areas of patient functioning, which consequently reduce quality of life [25, 26]. Moreover, patients with PUs are at high risk for further complications, such as nosocomial infections and sepsis, and they experience longer lengths of hospital stay [27]. Consequently, PUs represent a significant financial burden to healthcare organisations [28,29,30]. As PUs are considered to be largely preventable with good assessment and care, their occurrence is widely used as a quality indicator/patient safety parameter [31], and much effort is afforded to their prevention in clinical practice.

PU prevention comprises different interventions to reduce and/or eliminate the exposure of the patient’s skin to pressure, e.g. by allocation of pressure-redistributing support surfaces, regular repositioning and off-loading of highly vulnerable body sites, such as heels. Other preventive interventions target the promotion of the skin barrier, e.g. by good skin care, the reduction of shear and friction forces, e.g. via moving and handling activities, application of preventive dressings or the administration of nutritional supplementation.

An important outcome of PU prevention trials is the measurement of PU occurrence. However, substantial cross-trial variance and within-trial risk of bias have been noted with regard to this outcome measure [32, 33]. Trials show variations regarding PU classifications or methods used to determine the presence or absence of a PU (e.g. PU confirmation based on externally reviewed photographs or independent second skin inspection by one or multiple experts) [32]. In a meta-analysis by Shi et al., investigating the effect of support surfaces in reducing PU incidence, 57% of the included trials were rated as having serious or very serious limitations [34].

Furthermore, at present there is no consensus on how to report PUs. Often, measures of PU occurrence, such as incidence rates, include PUs across several categories (e.g. categories 1 to 4 or categories 2 to 4), thus combining superficial (category 1 and 2) and deep (category 3 and 4) PUs in one outcome measure. However, such combined estimates ignore the different etiological pathways of PU development and the targets of the preventive actions under experimental evaluation, e.g. interventions which mainly reduce friction forces may have a greater impact on superficial ulcers rather than deep ulcers [35].

Many other PU outcomes are also reported in trials, such as outcomes of pathophysiological changes, including tissue oxygenation and skin barrier changes, which have the potential to facilitate early prediction of a prevention strategy’s efficacy [36,37,38,39], or outcomes related to health care procedures and resource use. Patient-reported outcomes such as pain, experienced due to the preventive intervention or emerging before the development of a PU, are also important [40]. However, there are no agreed standards for which outcomes are of most importance and which measurement instruments or methods should be favoured. This not only complicates the synthesis of trial results, but also hinders the development of clear-cut evidence-based recommendations for PU prevention and, thus, evidence-based decision-making in clinical practice.

The overall aim of the Outcomes for Pressure Ulcer Trials (OUTPUTs) project is to improve methodological standards by developing a COS for the evaluation of the clinical efficacy, effectiveness and safety of PU prevention strategies. The focus of this protocol paper is the first part of this work, to develop a core domain set. The development of the corresponding core measurement set will be addressed in a separate publication.

Methods/design

The process of this project follows general guidance and standards of COS development [10] and is part of the Cochrane Skin–Core Outcome Set Initiative [16]. This project complies with the methodological standards of this group [41] and also addresses the Core Outcome Set–Standards for Development (COS-STAD) recommendations by e.g. involving service users and other stakeholders during the consensus building process [42]. The core domain set will be developed by means of four main steps: (1) defining the scope, (2) conducting a scoping review, (3) organizing workshops with service users, and (4) undertaking Delphi surveys and establishing consensus at a face-to-face meeting with different stakeholders.

Project management and stakeholders involved

All steps will be planned and led by a project team (Table 1). The members of the project team have experience in clinical and epidemiological studies, evidence summaries, structured consensus methods and guideline development in the field of PU prevention and/or in involving service users’ perspective in PU prevention research.

Table 1 Project management

To ensure that all steps are properly addressed, a Methodological Advisory Board was established to provide methodological advice and guidance. Members are advanced experts of clinical research in PU prevention, COS development (e.g. representatives of the CS-COUSIN), evidence syntheses on PU prevention (e.g. representatives of the Cochrane Skin or Wound Groups), outcome assessment, service user involvement in COS development and statistics (Table 1).

Stakeholders participating in the Delphi surveys and the face-to-face meeting will incorporate service users, physicians and other health professionals representing various settings of health care, researchers, representatives of the health care management and manufacturers. Service users are people who have experience of being exposed to elevated PU risk and/or suffering from a PU, or have acted, or do currently act, as an informal caregiver for a person at risk or with existing PU [43]. Given the prominent role of patients’ perspective for the validity and clinical relevance of trial findings [44, 45], early and systematic involvement of service users as defined above is considered crucial for COS development [46, 47]. Therefore, representatives of the Pressure Ulcer Service User Network (PURSUN) [48] from Leeds (UK) will be regularly involved throughout the OUTPUTs project, e.g. by inviting them to service user workshops or to participate in Delphi surveys (see corresponding sections below).

Scope specification

Through structured discussion within the project team and the methodological advisory board, the applicability of the intended COS was defined as follows: the COS should be applicable to all types of clinical trials investigating the clinical efficacy or effectiveness of all types of PU prevention interventions. The COS should be applicable to studies including adult patients aged ≥ 18 years. There should be no restriction concerning the health care setting or geographical areas.

Scoping review

The project team will undertake a scoping review to identify and classify outcomes that may be important in clinical trials [49]. The main characteristic of a scoping review is that an overview of a broad topic is given, examining the extent and variety of the evidence on a topic. Compared to a systematic review, a scoping review allows a more general question and has less depth, but can cover a broader conceptual range [50, 51]. Systematic searches will be carried out in following electronic databases: Cochrane Wounds Group/Cochrane Skin Group Cochrane Wounds Group Specialised Register, Cochrane Central Register of Controlled Trials, Ovid MEDLINE, Ovid EMBASE, EBSCO CINAHL, PsychINFO, British Nursing Index, Allied and Complementary Medicine Database, Web of Knowledge, Clinical Trials.gov and the WHO International Clinical Trials Registry Platform Search Portal.

Any intervention claimed to prevent PU, including PU risk assessment, will be eligible for inclusion. This scoping review will include two information sources: (i) controlled trials and systematic reviews on the efficacy, effectiveness and/or safety of any PU prevention intervention; and (ii) primary studies and systematic reviews specifically exploring patient-reported outcomes related to PUs or PU prevention. In addition, full health economic evaluations and any kind of white or position papers on outcomes relevant to the science or practice of PU prevention will be included. Trials reporting PU-related outcomes only as a secondary or safety outcome of interventions which primarily target conditions other than PU risk will be excluded from this review. As the main objective of this review is to ideally cover the full scope of outcomes used in previous studies, and not to evaluate the quality of study results, no formal critical appraisal of study quality will be conducted. The target material will not be limited to specific health care settings or target populations. For feasibility reasons, only papers published in the English language will be included. No restrictions will be applied in terms of publication date, except for the primary studies on patient-reported outcomes, which will only be considered for inclusion if they were published after 2008, as the time period before that date is covered by a systematic review [25].

References will be imported into the Covidence platform (https://www.covidence.org/), which will be used for the study selection procedures. After removal of duplicates, the remaining references will be assessed for eligibility by two members of the project team using a two-step approach (title and abstract screening followed by full-text screening). Cases of disagreement will be solved within the project team through discussion.

Data extraction will be carried out by two members of the project team and cross-checked by another project team member. Among other characteristics the following details will be extracted: (a) bibliographic data (first author, year of publication, country), (b) study design, (c) setting, (d) type of interventions under evaluation, (e) outcomes used to assess the efficacy or effectiveness of the preventive measure, including the operational definition, if presented by the authors, as well as (f) safety and (g) economical outcomes. Outcomes will be extracted as presented in the primary studies and reviews.

Extracted outcomes will be classified into core areas and associated domains following a newly developed outcome classification system for COS [52]. A core area reflects “an aspect of health or health condition that needs to be measured” to assess the effects of a health intervention [53]. It is usually understood to represent this aspect at the most abstract level, e.g. physiological outcomes or life impact outcomes [52], comprising several domains which reflect the various dimensions of the condition of interest, e.g. with regard to the affected body structure, function or area of life impact. The project team will develop, based on the scoping review, a preliminary and classified longlist of domains considered relevant for PU prevention trials, i.e. a preliminary core domain set. Together with a complete overview of the review results, this preliminary core domain set will be presented to the Methodological Advisory Board for further discussion.

Service user domain workshops

At least two facilitated workshops with service users will take place in Leeds, UK. These workshops serve a dual purpose. Firstly we aim to test out approaches to describing and discussing COS development within this group, which will inform our approach during the later stages of the project. Secondly we will begin to collect data around which outcomes are important from a service user perspective. Specifically we aim to explore service users’ views on the preliminary results of the scoping review, identify potentially relevant outcomes not identified via the scoping review and gain a greater understanding of why specified outcomes are important to service users. Participants of the workshops are from an established Pressure Ulcer Research Service User Network (PURSUN UK; http://www.pursun.org.uk/) who comprise patients and carers with direct experience of living with PU or PU risk.

PURSUN was set up to improve the quality of patient and public involvement (PPI) in PU research. Collectively the workshops provide the opportunity to capture a wide range of service user perspectives to inform the domains.

During the workshops, we will present an overview of the OUTPUTs project, explaining the aims, methods and preliminary results. This will be developed by an experienced PPI officer and presented in lay terms using an accessible format. It will be supported by information about COS highlighted in the COMET information leaflet ‘Involving patients and the public in improving research’ [54] to explain what an outcome is and how this could translate to PU prevention research. The group will then split into subgroups to discuss the service users’ understanding of each outcome/domain identified by the scoping review, its relevance for PU prevention trials and likely concerns about measurement. In order to clarify possible uncertainties and to record the conversation in written form, each subgroup discussion will be facilitated by a project member. After re-convening to the full group, further discussion will take place and this discussion will be audio recorded and transcribed. The researcher will listen to the audio tapes and read the transcripts to ensure completeness. The data will be coded with categories based on the domains identified in the scoping review, in keeping with directed content analysis [55]. Further codes can be added as they emerge from the data. A summary report of the meeting will be written and reviewed by the facilitators and service user participants to ensure it reflects group discussions. We will seek feedback from participants at the end of the session and at a separate PURSUN meeting. People will be asked to consider how well the project was explained, whether they felt able to contribute meaningfully and how best to gain service users perspectives throughout the Delphi survey and face to face consensus meeting.

Delphi surveys

Delphi studies are an established method for formal consensus development [56], consisting of iterative surveys among a representative sample of stakeholders who are asked to express their views both quantitatively and qualitatively [57, 58]. Based on the results of the scoping review and the workshops with service users, an international Delphi study will be conducted over a minimum of two rounds in order to achieve preliminary consensus about the importance of outcome domains identified so far. A broad geographical coverage of participating stakeholders (service users, physicians and other health professionals, researchers, representatives of the health care management and manufacturers) will be targeted via links with existing professional and service user groups.

Prior to the first Delphi round, a draft version of the survey and supporting materials (e.g. overview of the review results) will be discussed with the service users group and the Methodological Advisory Board. Based on discussions, the survey and supporting material will be refined, followed by a pilot test with regard to the feasibility of the survey, involving members of the service user group.

Data will be collected via an online survey platform, ‘COMET Delphi Manager’ [59], allowing participants to rate the relevance of the core outcome domains identified in the previous project steps on a nine-step numeric rating scale, inspired by the GRADE working group: scores 1 to 3 indicate outcomes of limited importance, 4 to 6 indicate outcomes of non-critical importance, and 7 to 9 indicate outcomes of critical importance [60,61,62]. The presentation of the outcomes to the participants will be randomized in order to minimize risk of bias. The participants will have the possibility to add comments on each of the proposed outcomes. They will also be invited to list additional relevant outcomes not included in the survey.

The decision regarding which outcome should be included in the preliminary core domain set will follow a consensus definition already used in previous COS projects [13, 63] and favoured by the OMERACT (Outcome Measures in Rheumatology) initiative [53, 64]. According to this decision rule, each outcome may fall into one of three categories: (a) consensus that the outcome should be part of the COS (≥ 70% participants scoring 7 to 9 and ≤ 15% participants scoring 1 to 3); (b) consensus that the outcome should not be part of the COS (≥ 70% participants scoring 1 to 3 and ≤ 15% participants scoring 7 to 9); (c) no consensus (any other scoring distributions) [10]. After the first Delphi round, a summary of the stakeholder group’s scores and newly added outcomes will be presented to the participants. The summary will be reviewed by service users to ensure it is accessible and clear to lay people. The feedback of the results of Delphi round 1 gives the participants the opportunity to contemplate and revise their own opinions by rerating all outcomes in round 2. This may result in a better agreement between the participants [65, 66]. At the end of Delphi round 2 each outcome will be classified according to the consensus definition described above. All of the outcomes falling into category (a) will be included in the preliminary core domain set. Outcomes falling into category (b) will be excluded and thus will not be followed further. In case of outcomes falling into category (c) a third Delphi round will be conducted. At the end of each Delphi round, qualitative and quantitative data will be descriptively analyzed. Qualitative data analysis will follow established methods of descriptive analyses in qualitative research [67, 68]. All quantitative analyses will be conducted using IBM SPSS Statistics 23 software. For each outcome domain descriptive statistics will be determined: frequency distribution, median and interquartile range (IQR), both for the total sample and stratified per stakeholder group. The same weight will be attributed to each participant irrespective of the stakeholder group. To allow descriptive analyses, the following socio-demographic data will be gathered in the first Delphi round: (a) stakeholder group, to which the person belongs to (b) country, (c) age and gender, (d) highest degree of education, (e) experience in preventing PU.

Face-to-face meeting

Upon completion of the Delphi surveys, a face-to-face meeting will be organized in order to reach final consensus about inclusion in the core domain set. The face-to-face meeting will be planned in accordance with COMET guidance [69] and principles established in previous consensus/servicer user engagement work [70] to ensure it is accessible to service users as well as professionals. This includes organizing the meeting well in advance, holding it at an accessible venue, using an expert facilitator to lead the meeting and ensuring support for service users before, during and after the meeting to facilitate their contribution [71]. The outcomes of unclear importance, and those rated as being critically important, will be subject to structured discussions. Participants of the Delphi surveys who have completed all rounds will be invited to join the face-to-face meeting, which will take place at the annual meeting of European Pressure Ulcer Advisory Panel in 2020. A summary of previous results, including an overview of how each stakeholder group has scored the relevant outcomes, will be presented. The participants will have the opportunity to discuss each outcome, exchange their views and convince others. After discussion, each outcome under debate will be scored by the participants anonymously with the nine-step numeric rating scale described above. To include an outcome in the core domain set, at least 70% of the participants need to score it as critically important [10, 72].

Discussion

The planned project follows current guidance to develop a high-quality COS in the field of PU prevention and deals with the first stage on developing a core domain set. A number of methodological challenges in the field of COS development in general [73,74,75,76], and specifically for COS, which focus on prevention.

So far only a small number of COS exist for trials investigating preventive strategies [77,78,79]. In general it seems to be more complicated to define preventive effects compared to treatment effects. One challenge will be to ensure that all participants will have a correct understanding of the task. It may be challenging to make clear to service users and clinicians that the outcomes under discussion refer to clinical interventions with the major goal of “non-occurrence”, or prevention of deterioration. Confusion may be possible as a clear distinction between preventive and treatment measures cannot always be made. Many interventions targeting prevention of PUs, or preventing the deterioration of an existing PU, are also important for treatment, e.g. repositioning or the use of pressure-redistributing surfaces. This overlap between prevention and treatment interventions is described by other developers of COS for prevention trials as well [77, 80]. It is hoped that work in the preceding service user domain workshops will facilitate clarity about these potential areas of confusion. In addition it will be important to impart to the participants of the service user workshops and to the stakeholders taking part in the Delphi surveys that a COS aims to define outcomes for clinical trials research rather than for clinical practice.

Further, there is a range of different PU prevention strategies and the relevance of some outcomes is bound to the type of intervention. For example trials analyzing the administration of nutritional supplements often report the outcomes total serum protein or weight gain, which are outcomes plausible just for this type of intervention. It may be difficult to develop a COS which meets the complexity and diversity of PU preventive strategies as a whole. At the present time it is not entirely clear whether ‘generic’ core outcomes will be developed or whether the development of intervention-specific core outcomes will be required [41].

In general, there is discussion of how specified outcomes should be defined in a COS. Besides the determination of outcomes/domains and the corresponding measurement instrument, the time frame of the outcome measurement and the compilation of results (e.g. means, proportions) are important as well. Moreover, uncertainty remains about at what level of abstraction domains should be defined (e.g. adverse events in general versus a specific adverse event like falls or itching) [75]. To meet all these challenges properly it is important to follow the prescribed process of current standards step by step. One critical factor in this process is to include content and method experts and to integrate the experience of service users as well as of other stakeholders. Only a high-quality COS can improve the quality of trial results and promote evidence-based recommendations.

Limitations

The aim of the OUTPUTs project is to develop a global COS. As the project team is Europe centred (Germany and UK), we endeavoured to widen the geographical distribution within the Methodological Advisory Board. However, representatives of Africa and Asia are missing. Thus, an effort will be made to ensure a wide geographical coverage within the Delphi surveys. As only papers in the English language will be included in the scoping review, a possible language bias may occur. Further, although the literature search will be conducted in most relevant electronic databases, including the largest trial registry database, some publications might not be identified.

Future research plan

After the development of a core domain set, inquiries for reaching evidence-based consensus on preferred measurement tools for the defined core outcomes are planned. This step will consist of three stages: a systematic review, guided workshops with service users and a consensus-building process based on the Nominal group technique. The aim is the publication of a COS comprising a full list of included outcomes and of corresponding measurement instruments.

Trial status

The development of the core domain set is active and ongoing in the phase of data extraction for the scoping review.