Skip to main content

Development of an internationally agreed minimal dataset for juvenile dermatomyositis (JDM) for clinical and research use

Abstract

Background

Juvenile dermatomyositis (JDM) is a rare autoimmune inflammatory disorder associated with significant morbidity and mortality. International collaboration is necessary to better understand the pathogenesis of the disease, response to treatment and long-term outcome. To aid international collaboration, it is essential to have a core set of data that all researchers and clinicians collect in a standardised way for clinical purposes and for research. This should include demographic details, diagnostic data and measures of disease activity, investigations and treatment. Variables in existing clinical registries have been compared to produce a provisional data set for JDM. We now aim to develop this into a consensus-approved minimum core dataset, tested in a wider setting, with the objective of achieving international agreement.

Methods/Design

A two-stage bespoke Delphi-process will engage the opinion of a large number of key stakeholders through Email distribution via established international paediatric rheumatology and myositis organisations. This, together with a formalised patient/parent participation process will help inform a consensus meeting of international experts that will utilise a nominal group technique (NGT). The resulting proposed minimal dataset will be tested for feasibility within existing database infrastructures. The developed minimal dataset will be sent to all internationally representative collaborators for final comment. The participants of the expert consensus group will be asked to draw together these comments, ratify and ‘sign off’ the final minimal dataset.

Discussion

An internationally agreed minimal dataset has the potential to significantly enhance collaboration, allow effective communication between groups, provide a minimal standard of care and enable analysis of the largest possible number of JDM patients to provide a greater understanding of this disease. The final approved minimum core dataset could be rapidly incorporated into national and international collaborative efforts, including existing prospective databases, and be available for use in randomised controlled trials and for treatment/protocol comparisons in cohort studies.

Peer Review reports

Background

It is recognised that an internationally agreed core dataset for use in routine clinical care could have numerous potential benefits for patients with this rare disease, with the additional advantage of informing future research [1]. The goals of this study are to reach international consensus on a minimal dataset (clinical, laboratory and patient/parent reported measures) for patients with juvenile dermatomyositis (JDM), which are practical, but cover the key variables that allow accurate assessment of disease activity and would measure change, such as response to treatment. Such a core set could then be rapidly incorporated into national and international collaborative efforts. To date, 2 distinct but overlapping core sets for JDM have been developed for use in clinical trials by the International Myositis and Clinical Studies (IMACS) group [24] and the Paediatric Rheumatology International Trials Organisation (PRINTO) [57]. These excellent tools have been principally designed for research and can be difficult to use in routine clinical practice due to time constraints. Our aim is to compliment these core sets with a separate internationally agreed minimal dataset for use in clinical practice. The key achievable objective of this study is for the developed minimal dataset to be recognised and accepted internationally to allow data collection over time on sufficient numbers of JDM patients. In order to achieve this, a formal consensus-driven methodology is required of all stakeholders.

Background work to this proposal is described elsewhere [1]. In brief, a working group of five JDM experts (CP, LW, AH, AR, LM) from the UK, Italy and Canada, representative of the major groups studying JDM and maintaining databases, scrutinised clinical and laboratory variables contained within current national and international collaborative databases. Variables contained within 2 or more databases were considered for inclusion in the provisional minimal dataset, informed by a literature search and detailed analysis of the UK Juvenile Dermatomyositis Cohort and Biomarker Study (JDCBS) [1, 8].

Details of this project have been included in the Core Outcome Measures in Effectiveness Trials (COMET) initiative database [9, 10]. In addition to close collaboration with COMET, our group has sought advice from senior members of the OMERACT (Outcome Measures in Rheumatology) collaboration, who are renowned for their work relating to outcome standardisation [11, 12].

Methods/Design

A provisional dataset for JDM, developed through a formal process [1] has been used as a template to aid a structured multi-stage consensus process. The Delphi technique [1315] has been used to gain the opinion of large groups of internationally representative clinicians caring for children and young people with JDM. This, together with a stepwise approach to gain the opinion of patients/parents, will help inform a detailed face-to-face nominal group consensus process by internationally representative JDM experts.

Stage 1a – Delphi process to gain clinician opinion

A 2-stage survey technique (Delphi 1 and Delphi 2; with each stage building on the proceeding one) has been adopted, so that anonymous responses are obtained with equal influence to all individual participants [1315]. An initial list of all potential variables was obtained from the provisional minimal database produced by this group [1] with outcomes listed individually but grouped under the relevant domain to aid interpretation by clinicians. Outcomes identified as patient/parent reported outcome measures or validated tools of muscle strength measurement [16] were presented within the appropriate domain as use of the tool rather than as individual components of the tool. However, in order to avoid discussions at this stage around which tool/instrument is better for measurement as opposed to another tool, an initial question asked participants how important they rate the use of a tool (without specifying which tool) to measure a certain domain, such as muscle strength or skin involvement. If they considered a tool to be important, they were asked which tool they favoured.

The list of variables was reviewed and approved by all authors as well as the research steering committee or leading representatives of each of the principal partner organisations (detailed in Table 1), including the International Myositis and Clinical Studies group – IMACS [4], Childhood Arthritis and Rheumatology Research Alliance – CARRA [17], Juvenile Dermatomyositis Research Group – JDRG (UK and Ireland), [18], Paediatric Rheumatology European Society – PReS JDM working party [19], and the Paediatric Rheumatology INternational Trials Organisation – PRINTO [7]. After modifications addressing feedback from these groups, the list (shown in Table 2) was formatted into a bespoke electronic questionnaire. The UK Paediatric Rheumatology Trainees’ Group and individuals from outside the UK selected by members of the JDM Minimal Dataset Steering Committee, piloted the questionnaire to determine average time taken to complete and readability of the questions.

Table 1 Details of collaborative groups and partner organisations
Table 2 Summary of questions asked in clinician survey compared to the parent and patient questionnaires

Participant details

Participation for the Delphi surveys was invited via membership of IMACS, CARRA, JDRG, PReS JDM working party and PRINTO; representative of international paediatric rheumatology and myositis specialty groups. These organisations include clinicians (clinical academic and non-academic), scientists and allied health professionals with expertise in paediatric rheumatological conditions and juvenile-onset and adult-onset myositis (Table 1). The entire membership was contacted by Email and invited to participate in the two web-based questionnaires using a bespoke Delphi system. The only exception to this was the PRINTO membership. In view of the fact that PRINTO is a large and heterogeneous organisation with over 900 individual members, the PRINTO directors (approximately 400 members) were contacted. PRINTO directors represent all of the major paediatric rheumatology centres among member countries. Many Email recipients are part of more than one research organisation and in this case, they were asked to complete each survey round once only and identify which other groups they are members of (and, therefore, potentially part of more than one mailing).

Delphi round 1

The study objectives were clearly stated including what was expected of each participant. Participants were reminded of the importance of completing the entire Delphi process and asked to complete each round within 6weeks of receipt of Email. Reminder Emails were sent on a fortnightly basis to aid completion of each round, with phrasing of reminders considered to maximise the response rates [20]. Participants who agreed to take part were asked to register, allowing a unique identifier to be allocated to enable tracking of attrition at each round and identification of the research group that the participant was responding from (IMACS, CARRA, PRINTO, PReS JDM working group or the UK JDRG). Contributors were asked to specify their predominant clinical role (clinician/scientist/allied health professional/trainee), their specialty (specialist or major interest in rheumatology/ neurology/dermatology/immunology/other), the age of patient that they predominantly care for (adult/paediatric) their experience in the specialty/condition (≥ or < 10 years), and their region/country of practice. Participants were encouraged to answer the web-based survey to reflect their individual practice. However, in recognition that some respondents (particularly PRINTO directors) may answer on behalf of their centre, a question was asked to ascertain if they were answering as an individual reflecting their own practice, or on behalf of their department/centre (stating name of centre). Participants were not able to identify other participants or individual responses. Owing to their involvement in the study design and Delphi exercise, members of the JDM Minimal Dataset Steering Committee were not asked to participate in the Delphi surveys themselves, but encouraged maximal engagement and participation of individuals within the international research groups that they represented.

Survey format

The outcome of this process will be to determine which variables clinicians perceive are important to include in one single minimal dataset that will be useful for clinical purposes and also inform research. However, within the survey, this question was divided into two separate sections, asking participants to rate in a structured format the importance of each variable for use in clinical practice, and separately, for its benefit in research. Each participant will be asked to score each of the outcomes listed using the Grade of Recommendations Assessment, Development and Evaluation (GRADE) scale of 1–9, with 1–3 labelled as “of low importance,” 4–6 labelled as “important but not critical for decision making” and 7–-9 labelled as “critical for decision making” [21]. Participants will have the option of selecting “unable to score” if they feel unable to comment based on their clinical experience, but they will be forced to answer each question before they move to the next stage of the questionnaire. For questions relating to investigations, in Delphi 1, participants will be asked whether each variable is accessible (easily available) to them in routine clinical practice in their hospital/country; given the option “yes,” “no” or “unable to comment”.

Participants who save an incomplete questionnaire will be contacted to encourage completion. Each participant will be given the opportunity to submit details of additional data items that they think should be included for clinical or research reasons (and reasons why) that are not part of the provisional data set. They will also be given the opportunity to submit written comments regarding those that have been included, including their opinion as to whether variables have been included that they perceive unnecessary, and if so, why.

Analysis of round 1

Any additional outcomes suggested by participants in Delphi 1 will be carefully reviewed and coded by investigators to determine if they represent new outcomes not already incorporated in the questionnaire. Any identified will be added to the questionnaire for Delphi 2. For each outcome, the number of participants who have scored the outcome and the distribution of scores (as percentage who have scored each GRADE level) will be summarised. In view of the fact that the web-linked processes will involve participants with varying experience in JDM, any variables thought not to be useful will be noted at this stage but not specifically removed; respondents’ opinions will be recorded to help inform subsequent processes. The number of participants responding will be assessed following Delphi closure and results presented as total number of registrations, total number who completed the round and total number compared to potential respondents.

Delphi round 2

Participants registering during part 1 will be invited to participate in the Delphi 2 survey and will thereby form the denominator for expected responses in round 2. In round 2, participants will be shown their score from round1 for each question (highlighted in every row of the Delphi 2) in addition to the total number of respondents for each question and the percentage of people responding to each ranking of importance (1–9) of the 9-point Likert scale. They will be asked to consider responses from the group and asked to verify that their round-1 response did indeed reflect their opinion, or given the opportunity to change or expand their response by re-scoring the outcome. Any changes to scores will be documented.

Analysis of round 2

Round-1 responses will be compared between those who responded to both Delphi round1 and round2 against those who responded to Delphi round 1 only (but failed to respond to round2) to look for response bias. The total number of respondents to round2 will be recorded. For each outcome, the number of participants who have scored the outcome and the distribution of scores will be summarised. Content analysis will be used to code and describe written comments and responses. During the analysis of round2, results will be prepared for presentation at the consensus meeting within 3 groups: “consensus in,” “consensus out” or equivocal.

Definition of consensus

  1. 1.

    “Consensus in” - consensus that the outcome should be included in the minimal dataset; defined as greater than 70 % of participants scoring 7–9; “critical for decision making”.

  2. 2.

    “Consensus out” - consensus that the outcome should not be included in the minimal dataset; defined as greater than 70 % of participants scoring as 1–3; “low importance”.

  3. 3.

    All other combinations will be presented as “equivocal”.

Seventy percent consensus has been chosen as a pre-defined cut off for this stage. The OMERACT handbook and COMET management group use this consensus definition.

Sample size

There is currently no standard method for sample size calculation in Delphi processes and sample size estimates for this study have been carried out by a pragmatic approach considering responses from similar studies using a Delphi web-based survey distributed via rheumatological collaborations. Summating the current estimated membership of each collaborative working group (IMACS, CARRA, PRINTO, PReS JDM working party, JDRG) totals over 1000 members, but it is recognised that the majority of members will belong to more than one organisation and membership lists include retired or non-active members. Some organisations, such as IMACS, include many specialists in adult myositis who may feel less inclined to respond to a paediatric-focused study. Based on observed response rate from similar processes in paediatric rheumatology (49.8–84 %) [2226] and attrition rate between 1.6 and 33 % [2426], with less attrition in recent years, it is anticipated that the response rate for round1 will be approximately 150–200 participants with a 10 % attrition rate between rounds 1 and 2.

Stage 1b – patient/parent engagement/consultation

A formal stepwise process for patient/parent participation will take place, distinct but alongside the Delphi process engaging clinicians and healthcare professionals, with both processes feeding into the nominal group consensus meeting of experts.

Currently, there is very little research published in JDM engaging patient/parent opinion. Our group has sought advice from senior members of COMET [9] and OMERACT [11] and consumer representatives of the National Institute for Health Research (NIHR) Clinical Research Network (CRN): Children/Arthritis Research UK Paediatric Rheumatology Clinical Studies Group (CSG) [27]. A sub-group of this organisation is the JDM Topic Specific Group (TSG), within which members of our group have been working to engage patients and parents in JDM research. Through this infrastructure, the opinions of young people with JDM and their parents/carers have been obtained, including checking and commenting on study information leaflets and patient/parent questionnaires. Our group is working directly with patient/parent groups within the UK and North America; Myositis UK [28] and Cure JM Foundation [29], who have agreed to distribute an electronic patient/parent questionnaire via their websites. In the UK, the research infrastructure within the JDRG allows patients and parents to be approached by the clinicians/healthcare professionals caring for them within their local centre [8, 18]. An attempt will be made by our collaborators to replicate the UK model in other counties to ensure international representation as far as is possible. Translation will take place as appropriate.

Patient and Parent Questionnaire

The Delhi survey (sent to clinicians and healthcare professionals) has been reviewed by members of the JDM minimal dataset management committee and steering committee for relevance to patients and parents. There are many variables within this matrix that are not directly of interest to patients and parents (such as demographics) but others (such as patient/parent reported outcome measures) that are particularly relevant. Hence, a separate provisional questionnaire was designed for patients/parents to complete (Table 2), including some specific variables on school/quality of life felt to be important by young people when commenting on the questionnaires. A similar format for scoring responses to answers has been used as within the Delphi survey (GRADE scale) but simplified into three categories: “not that important,” “important,” or “really important”. Questionnaires were designed for screen-based modes of administration as well as paper format, depending on patient/parent preference. Electronic entry will be encouraged but patients/parents can choose to complete a paper questionnaire that will subsequently be entered into the electronic system by research staff.

Information leaflets were prepared for parents and for children/young people aged 8–11 years, 12–15 years, and 16+ years of age. Readability scores were used to check age appropriateness of the questionnaire and information leaflets [30, 31]. In addition, to ensure that the study documents were understandable to patients and parents, opinions were sought within the UK from the COMET [9] Patient and Public Involvement Coordinator, research nurses experienced in patient/parent involvement, consumer representatives of the Medicines for Children Research Network (MCRN) Clinical Studies Group [27], the Parent Group of the British Society for Paediatric and Adolescent Rheumatology (BSPAR) [32], young people participating in the NIHR CRN Young Person’s Advisory Group [33] and young people with JDM participating in a newly formed UK JDM Young Person’s Group, linked to the JDM TSG [27]. Subsequently, the final questionnaire, age-appropriate information leaflets, consent forms and assent forms were submitted to the NHS Integrated Research Application System and approved. The parent information leaflets make it clear that parents can either consent to be involved in the study themselves and/or consent for their child to participate in the study.

Participants

Participation will be open to the following groups:

  1. a.

    Any child or young person with JDM

  2. b.

    Any adult who had JDM as a child

  3. c.

    Any parent of a child with JDM

There is no restriction in numbers and no exclusions within these groups. However, it is anticipated that children younger than 8 years of age are likely to be represented by their parents/carers and it is recognised that reliability or validity of child-reported measures at this age are often questionable [30]. Every effort will be made to translate information/questionnaires into the language of participants if needed or to engage translators. Patients with adult-onset myositis will not be allowed to participate, as there are significant differences in the disease processes and prognosis between adult-onset and juvenile-onset myositis. Adult-onset disease is defined in the UK as occurring after 16 years of age, and in the USA as occurring after 18 years of age.

Distribution of questionnaires

Information about the study and questionnaires will be distributed in the UK as follows:

  1. a)

    Following site-specific ethics approval for this study at each major paediatric rheumatology centre already participating in the Juvenile Dermatomyositis Cohort and Biomarker Study (UK and Ireland) [8], parents and patients will be approached by their local doctors/nurses and asked whether they would be interested in taking part in this study. These doctors and nurses are part of the JDRG [18], including 14 major paediatric rheumatology centres in the UK, and are fully informed about the study and trained in Good Clinical Practice (GCP). After allowing time for consideration and the opportunity to ask questions, patients and or parents will be asked to complete a questionnaire when they come for their clinic appointment or at home.

  2. b)

    An advert will be submitted to patient/parent myositis organisations [28, 29] inviting participation. Patients and parents will be asked to complete a secure web-based questionnaire once they have confirmed that they have read the information leaflets and signed the consent form.

  3. c)

    Individuals who have previously expressed an interest in becoming involved in future research in JDM by contacting the UK Juvenile Dermatomyositis Research Group and/or by participation in parent/young peoples’ groups will be contacted by Email and invited to participate in this project.

Informed consent will be taken from each participant. Collaborators in Italy and the Netherlands will attempt to replicate this process (with country-specific ethics approval and translation as needed). Patients and parents in North America or elsewhere will be able to participate via electronic links provided by collaboration with patient and parent groups – Myositis UK [28] and Cure JM [29], with the recognised limitation that the questionnaires will only be provided in English-language format.

Currently, a number of patient and parent reported outcome measures are used in clinical practice and research in JDM [2, 3, 5, 6, 16, 34, 35]. Many of these tools have been developed for other rheumatological conditions (such as arthritis) rather than specifically for JDM. More recently, a JDM-specific tool – the Juvenile Dermatomyositis Multidimensional Assessment Report – has been developed and is currently being validated [36]. Young people with JDM participating in a newly formed UK JDM Young Person’s Group, linked to the JDM TSG [27], will be invited to participate in a focus group asking them to specifically consider various Patient Reported Outcome Measures currently available to determine if there is a preference for particular tools. Likewise, parents participating in a newly formed UK Parent Group, linked to the JDM TSG [27], will be asked to consider Parent Reported Outcome Measures. A detailed summary of the opinions of patients/parents will be prepared for participants of the consensus meeting and presented, with individual comments anonymised, to the group prior to and during the meeting.

All patient/parent participants completing the questionnaire will be asked if they would be willing to potentially participate in further stages of the study, and if so, asked to provide their contact details. Following analysis of the Delphi survey, they may be asked to consider specific questions or issues relating to the acceptability of completing variables in clinical practice, to help inform the consensus meeting, such as:

  1. 1.

    Time taken to complete each variable for the patient/parent.

  2. 2.

    Ways of completing variables that may make them more acceptable (for example, use of web-based questionnaires that can be complete before clinic).

  3. 3.

    Practical implications of completing each variable (for example, volume of blood needed for the test if extra blood tests indicated).

  4. 4.

    Consideration of validated patient/parent reported outcome measures that may form part of a minimal dataset to determine if there is a preference for particular patient/parent reported measures.

Consideration will be given to direct patient/parent involvement and representation during the nominal group consensus meeting, particularly if there are a few patient/parent representatives who stand out in being able to represent views of the group. If patients/parents are involved in the consensus meeting they will be fully supported throughout the process by the COMET Patient and Public Involvement Coordinator.

Analysis of data

For each questionoutcome, the number (percentage) of participants who have scored the outcome as important and the distribution of scores will be summarised. Content analysis will be used to code and describe written comments with individual comments anonymised. A detailed summary of the opinions of patients/parents will be prepared for participants of the consensus meeting. Participants of the consensus meeting will be sent this information prior to the meeting and also be reminded of specific points relevant to variables during the meeting.

Other studies that members of our group are involved with are also engaging patient/parent participation that may be relevant to our study. For example, the European-wide FP7 funded SHARE (Single Hub and Access Point for Paediatric Rheumatology in Europe) project [37] led by Professor Nico Wulffraat, Utrecht, Netherlands, which aims to define a standard of care for paediatric rheumatology throughout Europe, includes a JDM work-stream. Thus, findings from this will also be summarized and be available for review by members of the nominal group consensus meeting.

Stage 2 – Consensus meeting using the nominal group technique

The results of the Delphi exercise and patient/parent opinion will be used to inform Stage 2 of the study; a 2-day international consensus meeting of senior representative international experts in JDM tasked with undertaking nominal group consensus formation.

Participants

The consensus meeting will include 15–20 healthcare professionals/scientists who are experts in JDM; many of whom are experienced in NGT. Patient/parent representation will be considered, as above. The total number of participants has come from recommendations for ideal NGT consensus group size [38] and suggestions from the COMET [9]/OMERACT [11] collaborative groups.

Individual experts have been chosen by the JDM steering committee with consideration of the following criteria:

  1. 1.

    Individual expertise: each individual is a recognised expert in the field of myositis.

  2. 2.

    Consideration of the wider groups that they lead or represent – ensuring that the final group includes representation from all international paediatric rheumatology and myositis expert groups.

  3. 3.

    Geographically internationally representative of the international paediatric rheumatology community.

  4. 4.

    Representative of the sub-specialty groups that care for children with JDM including paediatric rheumatology, neurology, dermatology and adult rheumatology.

Structure of meeting

Analysis of the Delphi surveys will determine which variables were thought to be important to include in a minimal dataset by the wider group (“consensus in”) and which variables (“equivocal”) need more discussion within the expert consensus meeting. Summative feedback from the parent/patient questionnaires will be presented along with results of the Delphi (clinician opinion) for each variable to all participants of the consensus process prior to and during the meeting. Initially, members of the expert group will be presented with those variables judged as “consensus in” within the Delphi process to check for consensus agreement within the expert group before proceeding. It is anticipated that a quick decision can be made for a number of the variables in this way, but that certain items will need more detailed discussion to obtain consensus.

Nominal group technique (NGT) is a structured group meeting that follows a prescribed sequence of problem-solving steps [15], forcing equal participation among members in generating information and achieving outcomes. One non-voting participant, experienced in NGT but neutral to the study, will act as a facilitator and ensure that the process is not taken over by any one individual with strong views.

During the NGT process, the facilitator will frame the question to be discussed and show data from the Delphi surveys and patient/parent involvement relevant to that question. Each participant will have the opportunity to discuss his/her opinion for 1–2 minutes without interruption. Responses will be recorded and detailed notes taken. Participants will be given the opportunity to vote for their preferred response to each question. An agreement of ≥ 80 % consensus of all attendees will be required to consider each question as solved. If there is < 80 % consensus, participants will once again be given the opportunity to talk for 1–2 minutes. After discarding answers that are clearly not preferred, there will be another round of voting. The process will continue until there is consensus or lack of consensus achieved for each question. The NGT process will attempt to take into account feasibility of including individual variables (determined by results of the Delphi survey and patient/parent participation process) as well as the validity reliability of variables (from published literature) and the acceptability of the format of the dataset including definitions/glossary (defined in the provisional minimal dataset). Agreement with statements will be summarised by percentage agreement statistics.

Stage 3 – Testing the dataset in real-life clinical practice

The proposed minimal dataset developed in Stage 2 will be tested for feasibility in Stage 3 of the study. This is to ensure that each outcome variable is feasible to complete in clinical practice and will directly inform clinical care as well as having a research rationale. Clinicians will be asked to enter anonymised data prospectively over time on at least 2 cases of JDM under their care via already-established internationally accessible secure web-databases [8, 39, 40] that will be adapted to incorporate questions asked within the developed minimal dataset. Each centre (hospital) has access to its own data with coded information from the complete database accessible with research steering committee approval. Each patient is assigned a unique identification number for research purposes and de-identified from personal information such as name, address, and hospital number. Data are protected by login and password and transfer of data encrypted. After allowing 6 months for data entry into collaborating databases, coded data on JDM patients will be made available for analysis. The study statistician will develop an algorithm to scan the dataset, flagging all missing observations, outlier and ill-coded variables to allow completion/data cleaning. In this way, Stage 3 will carefully assess whether the data entered into prospective data collections by clinicians (who are not necessarily experts in JDM) in real-world environments, is complete and accurate, as defined by the provisional dataset definitions/glossary [1] or whether clearer definition of variables are required. Definitions of variables will be refined by the JDM minimal dataset steering committee if needed, by Email or telephone consensus, after data analysis. The developed minimal dataset will be sent to the Chairs of all principal partner organisations’ (IMACS, CARRA, PReS, PRINTO, JDRG) individual research steering committees for final comment. The NGT group will be asked to draw together these comments and ratify and “sign off” the final minimal dataset.

Ethical approval

Ethical approval has been obtained from the IPHS Research Ethics Committee (reference IPHS-1314-321). NHS Research Ethics Committee approval has also been obtained from the NRES Committee East Midlands (reference 14/EM/1259; IRAS project ID 160667).

Ethical considerations

  • Stage 1a (Delphi survey) does not involve patient data and simply involves consensus among clinicians

  • Stage 1b (patient/parent involvement) will be canvasing opinion from patients (aged < 16 years of age) and their parents, as well as patients (>16 years of age) who have or previously had juvenile-onset myositis and parents of children with JDM. NHS Research Ethics approval obtained

  • Stage 2 (nominal group consensus) does not involve patient data and simply involves consensus among experts in myositis

  • Stage 3 will involve analysis of anonymised data after piloting the minimal dataset in a proportion of patients over a restricted period of time (6 months) via already established databases. Ethical approval for this stage is country specific, and although it will involve anonymised patient data, it is required for some collaborators. Ethical approval is already obtained for data collection within most of the organisations that may collaborate at this stage including the UK JDCBS, Euromyositis, the Gaslini Institute and CARRA. Other participants will be able to enter data via Euromyositis or obtain their own IRB approval. However, the study is not dependent on IRB approval of these individual countries, as sufficient patient numbers should be achieved via use of established databases that already include ethical approval. Our group will only have access, through research steering committee application, to secondary anonymised data collected within these individual databases.

Discussion

The Delphi process has the advantage of allowing information to be exchanged between numerous individuals who may be geographically dispersed [38]. However, the advantage of face-to-face interaction is that it allows identification of the reasons for disagreements between individuals [38]. By using a combination of Delphi web-based surveys and face-to-face interaction in an NGT consensus group process, this study will obtain widespread opinion from a large number of clinicians in addition to the judgment of a small group of internationally renowned and representative group of experts in JDM. Patient and parent participation will be ensured via a structured process, including widespread distribution of a questionnaire and more detailed discussion within established patient/parent groups in the UK. The use of focus groups will allow stimulation of discussion and comparison of experiences across participants, whereas individual questionnaire responses will allow obtainment of opinions without influence from peers [30, 41]. In addition, consideration will be given to a small number of patient/parent representatives participating in the consensus meeting, representing the views of this group.

An internationally agreed minimal dataset has the potential to significantly enhance collaboration, allow effective communication between groups, provide a minimal standard of care and enable analysis of the largest possible number of JDM patients to provide a greater understanding of this disease. A consensus-driven, internationally approved minimum core dataset could be rapidly incorporated into national and international collaborative efforts, including existing prospective clinical databases, and be available for use in randomised controlled trials and for treatment/protocol comparisons in cohort studies.

Study status

Currently at Stage 3: Delphi survey of clinicians and consensus meeting completed. Patient/parent questionnaires ongoing.

Abbreviations

CRN:

Clinical Research Network

CSG:

Clinical Studies Group

BSPAR:

British Society for Paediatric and Adolescent Rheumatology

CARRA:

Childhood Arthritis and Rheumatology Research Alliance

COMET:

Core Outcome Measures in Effectiveness Trials initiative

GCP:

Good Clinical Practice

GRADE:

Grade of Recommendations Assessment, Development and Evaluation

JDCBS:

Juvenile Dermatomyositis Cohort Biomarker Study and Repository (UK and Ireland)

JDM:

juvenile dermatomyositis

JDRG:

Juvenile Dermatomyositis Research Group (UK and Ireland)

IMACS:

International Myositis and Clinical Studies group

MCRN:

Medicines for Children Research Network

NIHR:

National Institute for Health Research

NGT:

nominal group technique

OMERACT:

Outcome Measures in Rheumatology

PReS:

Paediatric Rheumatology European Society

PRINTO:

Paediatric Rheumatology INternational Trials Organisation

SHARE:

Single Hub and Access Point for Paediatric Rheumatology in Europe

TSG:

Topic Specific Group

References

  1. McCann LJ, Arnold K, Pilkington CA, Huber AM, Ravelli A, Beard L, et al. Developing a provisional, international Minimal Dataset for Juvenile Dermatomyositis: for use in clinical practice to inform research. Pediatr. Rheumatol. 2014;12:31.

    Google Scholar 

  2. Rider LG, Giannini EH, Harris-Love M, Joe G, Isenberg D, Pilkington C, et al. Defining clinical improvement in adult and juvenile myositis. J Rheumatol. 2003;30:603–17.

    PubMed  Google Scholar 

  3. Rider LG, Giannini EH, Brunner HI, Ruperto N, James-Newton L, Reed AM, et al. International consensus on preliminary definitions of improvement in adult and juvenile myositis. Arthritis Rheum. 2004;50:2281–90.

    Article  PubMed  Google Scholar 

  4. International Myositis Assessment and Clinical Studies Group, IMACS. http://www.niehs.nih.gov/research/resources/imacs

  5. Ruperto N, Ravelli A, Pistorio A, Ferriani V, Calvo I, Ganser G, et al. The provisional Paediatric Rheumatology International Trials Organisation/American College of Rheumatology/European League Against Rheumatism Disease activity core set for the evaluation of response to therapy in juvenile dermatomyositis: a prospective validation study. Arthritis Rheum. 2008;59:4–13.

    Article  PubMed  Google Scholar 

  6. Ruperto N, Pistorio A, Ravelli A, Rider LG, Pilkington C, Oliveira S, et al. The Paediatric Rheumatology International Trials Organisation provisional criteria for the evaluation of response to therapy in juvenile dermatomyositis. Arthritis Care Res (Hoboken). 2010;62:1533–41.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Paediatric Rheumatology INternational Trials Organisation, PRINTO. http://www.printo.it/.

  8. Martin N, Krol P, Smith S, Murray K, Pilkington CA, Davidson JE, et al. A national registry for juvenile dermatomyositis and other paediatric idiopathic inflammatory myopathies: 10 years' experience; the Juvenile Dermatomyositis National (UK and Ireland) Cohort Biomarker Study and Repository for Idiopathic Inflammatory Myopathies. Rheumatology (Oxford). 2011;50:137–45.

    Article  PubMed  Google Scholar 

  9. Core Outcome Measures in Effectiveness Trials (COMET) Initiative database http://www.cometinitiative.org.

  10. Gargon E, Williamson PR, Altman DG, Blazeby JM, Clarke M. The COMET Initiative database: progress and activities from 2011–2013. Trials. 2014;15:279.

    Article  PubMed  PubMed Central  Google Scholar 

  11. OMERACT (Outcome Measures in Rheumatology) collaboration. http://www.omeract.org/.

  12. Boers M, Kirwan JR, Wells G, Beaton D, Gossec L, d’Agostino MA, et al. Developing Core Outcome Measurement Sets for clinical trials: OMERACT Filter 2.0. J Clin Epidemiol. 2013;67(7):745–53.

    Article  Google Scholar 

  13. Sinha IP, Smyth RL, Williamson PR. Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. PLoS Med. 2011;8(1), e1000393.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Jones J, Hunter D. Qualitative research: consensus methods for medical and health services research. BMJ. 1995;311(7001):376–80.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Cantrill JA, Sibbald B, Buetow S. The Delphi and nominal group techniques in health services research. Int J Pharm Pract. 1996;4(2):67–74.

    Article  Google Scholar 

  16. Rider LG, Werth VP, Huber AM, Alexanderson H, Rao AP, Ruperto N, et al. Measures of adult and juvenile dermatomyositis, polymyositis, and inclusion body myositis: Physician and Patient/Parent Global Activity, Manual Muscle Testing (MMT), Health Assessment Questionnaire (HAQ)/Childhood Health Assessment Questionnaire (C-HAQ), Childhood Myositis Assessment Scale (CMAS), Myositis Disease Activity Assessment Tool (MDAAT), Disease Activity Score (DAS), Short Form 36 (SF-36), Child Health Questionnaire (CHQ), physician global damage, Myositis Damage Index (MDI), Quantitative Muscle Testing (QMT), Myositis Functional Index-2 (FI-2), Myositis Activities Profile (MAP), Inclusion Body Myositis Functional Rating Scale (IBMFRS), Cutaneous Dermatomyositis Disease Area and Severity Index (CDASI), Cutaneous Assessment Tool (CAT), Dermatomyositis Skin Severity Index (DSSI), Skindex, and Dermatology Life Quality Index (DLQI). Arthritis Care Res (Hoboken). 2011;63 Suppl 11:S118–57.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Childhood Arthritis and Rheumatology Research Alliance, CARRA. www.carragroup.org.

  18. Juvenile Dermatomyositis Research Group UK and Ireland, JDRG. http://www.juveniledermatomyositis.org.uk.

  19. Paediatric Rheumatology European Society, PReS. http://www.pres.org.uk/.

  20. Dillman DA, Smythe JD, Christian LM. Mail and internet surveys: the tailored design method. 2nd ed. Hoboken, NJ: Wiley; 2007.

    Google Scholar 

  21. Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, et al. GRADE guidelines: 2 Framing the question and deciding on important outcomes. J Clin Epidemiol. 2011;64(4):395–400.

    Article  PubMed  Google Scholar 

  22. Rider LG, Koziol D, Giannini EH, Jain MS, Smith MR, Whitney-Mahoney K, et al. Validation of manual muscle testing and a subset of eight muscles (MMT8) for adult and juvenile idiopathic inflammatory myopathies. Arthritis Care Res. 2010;62(4):465–72.

    Article  Google Scholar 

  23. Stringer E, Bohnsack J, Bowyer SL, Griffin TA, Huber AM, Lang B, et al. Treatment approaches to juvenile dermatomyositis (JDM) across North America: The Childhood Arthritis and Rheumatology Research Alliance (CARRA) JDM Treatment Survey. J Rheumatol. 2010;37(9):1953–61.

    Article  CAS  PubMed  Google Scholar 

  24. Brown VE, Pilkington CA, Feldman BM, Davidson JE, on behalf of the Network for Juvenile Dermatomyositis, a working party of the Paediatric Rheumatology European Society (PReS). An international consensus survey of the diagnostic criteria for juvenile dermatomyositis (JDM). Rheumatology. 2006;45:990–3.

    Article  CAS  PubMed  Google Scholar 

  25. Brunner HI, Mina R, Pilkington C, Beresford MW, Reiff A, Levy DM, et al. Preliminary criteria for global flares in childhood-onset systemic lupus erythematosus. Arthritis Care Res (Hoboken). 2011;63(9):1213–23.

    Article  Google Scholar 

  26. Ruperto N, Hanrahan LM, Alarcón GS, Belmont HM, Brey RL, Brunetta P, et al. International consensus for a definition of disease flare in lupus. Lupus. 2011;20(5):453–62.

    Article  CAS  PubMed  Google Scholar 

  27. NIHR CRN: Children/Arthritis Research UK Paediatric Rheumatology Clinical Studies Group. http://www.arthritisresearchuk.org/research/our-clinical-study-groups-and-research-strategies/paediatric-rheumatology.aspx.

  28. Myositis UK. http://www.myositis.org.uk/.

  29. Cure JM Foundation. http://www.curejm.org/.

  30. Matza LS, Patrick DL, Riley AW, Alexander JJ, Rajmil L, Pleil AM, et al. Pediatric patient-reported outcome instruments for research to support medical product labeling: report of the ISPOR PRO good research practices for the assessment of children and adolescents task force. Value Health. 2013;16(4):461–79.

    Article  PubMed  Google Scholar 

  31. SMOG (simplified measure of gobbledygook) grading. http://www.niace.org.uk/misc/SMOG-calculator/smogcalc.php.

  32. The British Society for Paediatric and Adolescent Rheumatology (BSPAR). http://www.bspar.org.uk/.

  33. National Institute for Health Research (NIHR) Clinical Research Network (CRN) Young Person’s Advisory Group. http://www.crn.nihr.ac.uk/children/pcpie/young-persons-advisory-group/.

  34. Ruperto N, Ravelli A, Murray KJ, Lovell DJ, Andersson-Gare B, Feldman BM, et al. Preliminary core sets of measures for disease activity and damage assessment in juvenile systemic lupus erythematosus and juvenile dermatomyositis. Rheumatology. 2003;42:1452–9.

    Article  PubMed  Google Scholar 

  35. Nugent J, Ruperto N, Grainger J, Machado C, Sawhney S, Baildam E, et al. The British version of the Childhood Health Assessment Questionnaire (CHAQ) and the Child Health Questionnaire (CHQ). Clin Exp Rheumatol. 2001;2001(19):S163–7.

    Google Scholar 

  36. Varnier GC, Ferrari C, Consolaro A, Marafon D, Pilkington C, Maillard S, et al. Introducing a new approach to the care of juvenile dermatomyositis: the juvenile dermatomyositis multidimensional assessment report. Pediatr Rheumato. 2013;11 Suppl 2:25.

    Article  Google Scholar 

  37. Wulffraat NM, Vastert B, the SHARE consortium. Time to share. Pediatr Rheumatol. 2013;11(5) http://www.ped-rheum.com/content/11/1/5.

  38. Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, Marteau T. Consensus development methods, and their use in clinical guideline development: a review. Health Technology Assessment. 1998. 2 (3).

  39. Euromyositis. http://Euromyositis.eu

  40. Lundberg IE, Svensson J. Registries in idiopathic inflammatory myopathies. Curr Opin Rheumatol. 2013;25:729–34.

    Article  PubMed  Google Scholar 

  41. Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, et al. Content validity – establishing and reporting the evidence in newly developed Patient-Reported Outcomes (PRO) instruments for medical product evaluation: ISPOR PRO Good Research Practices Task Force Report: Part 1 –Eliciting concepts for a new PRO instrument. Value Health. 2011;14:967–77.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This work was supported by Arthritis Research UK [grant number 20417]. We would like to acknowledge the Euromyositis Research Steering Committee for their collaboration and impetus for this work, in particular Professor Ingrid Lundberg, Dr Hector Chinoy, Professor Jiri Vencovsky and Niels Steen Krogh. We acknowledge the IMACS, CARRA, PRINTO and PReS working groups for their support and collaboration. In particular, we would like to acknowledge the following collaborators who represent these groups: Dr Lisa Rider, Professor Charles Spencer, Dr Nicola Ruperto and Dr Annet van Royen-Kerkhof. We acknowledge the support of OMERACT and in particular, would like to thank Professor Maarten Boers for his advisory role. We would like to acknowledge our collaborators within the COMET group, in particular, Heather Bagley, Patient and Public Involvement Coordinator. We would also like to acknowledge the help and advice of Professor Bridget Young, Olivia Lloyd and Helen Hanson and the Clinical Studies Group consumer representatives and BSPAR Parent Group, particularly Sharon Douglas. We would like to thank young people from NIHR Young Person’s Advisory Group and the JDM Young Person’s Group, for their advice on patient questionnaires and information leaflets. We acknowledge the support and collaboration of patient/parent support groups, Cure JM and Myositis UK. We would like to thank Katie Arnold, Lawrence Brown, Kath Forrest and Karen Barnes for their administrative support for this work. The UK JDM Cohort and Biomarker study has been supported by generous grants from the Wellcome Trust UK (085860), Action Medical Research UK, (SP4252), The Myositis Support Group UK, Arthritis Research UK (14518), The Henry Smith Charity. LWs work is supported in part by Great Ormond Street Children’s Charity, the GOSH/ICH NIHR funded Biomedical research Centre (BRC) and Arthritis Research UK. The JDM Cohort study is adopted onto the Comprehensive Research Network through the Medicines for Children Research Network (www.mcrn.org.uk) and is supported by the GOSH/ICH Biomedical Research Centre. A full list of contributors to the JDCBS can be found on the JDRG website http://www.juveniledermatomyositis.org.uk.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Liza J. McCann.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contribution

All authors have been directly involved in developing the methodology for this study. LM has led all parts of the study including background work, preparation of the protocol, ethics submissions, content of Delphi survey and patient/parent questionnaires, planning of consensus meeting and writing of the manuscript. JK participated in the design of the study, was responsible for testing the Delphi system, performed the statistical analysis and helped prepare for the consensus meeting. LW, CP, AH and AR have provided intellectual input and practical help into all parts of the study including background work, protocol development, Delphi survey and planning of the consensus meeting. DA developed the bespoke Delphi system and provided IT support for the study including data analysis. PW has provided expert advice on the study methodology and analysis. MB has been responsible for intellectual and financial overview of the study and input into the protocol development, Delphi survey and consensus meeting. All authors have read and approved the final manuscript.

Authors’ information

Dr Liza McCann is a consultant in paediatric rheumatology at Alder Hey Children’s NHS Foundation Trust, UK, with a research interest in juvenile dermatomyositis.

Dr Jamie Kirkham is a lecturer in biostatistics at the University of Liverpool, Institute of Translational Medicine, UK.

Professor Lucy Wedderburn is Professor of Paediatric Rheumatology at the Institute of Child Health, University College London; consultant at Great Ormond Street Hospital; Chief Investigator of the Juvenile Dermatomyositis Cohort and Biomarker Study, (JDCBS) UK and Ireland and Director of Arthritis Research UK Centre for Adolescent Rheumatology at UCL.

Dr Clarissa Pilkington is a consultant in paediatric and adolescent rheumatology at Great Ormond Street and University College Hospital, London, UK; President of the British Society for Paediatric and Adolescent Rheumatology. She has a special interest in juvenile dermatomyositis and systemic lupus erythematosis.

Dr Adam Huber is a paediatric rheumatologist at the IWK Health Centre and Associate Professor at Dalhousie University, with a particular research interest in juvenile myositis.

Professor Angelo Ravelli is Associate Professor of Paediatrics at the University of Genoa and Istituto Giannina Gaslini, Genoa, Italy. His research interests include juvenile myositis.

Dr Duncan Appelbe is the Information Systems Manager at the MCRN Clinical Trials Unit, University of Liverpool Institute of Translational Medicine, UK.

Professor Paula Williamson is Head of Department and Director of the Clinical Trials Research Centre at the University of Liverpool Institute of Translational Medicine.

Professor Michael W Beresford is Brough Chair and Professor of Child Health, University of Liverpool; Academic Lead in the Clinical Academic Department of Paediatric Rheumatology at Alder Hey Children’s NHS Foundation Trust, Liverpool UK and Chair of the UK’s National Institute of Health Research Clinical Research Network: Children/Arthritis Research UK Paediatric Rheumatology Clinical Studies Group.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

McCann, L.J., Kirkham, J.J., Wedderburn, L.R. et al. Development of an internationally agreed minimal dataset for juvenile dermatomyositis (JDM) for clinical and research use. Trials 16, 268 (2015). https://doi.org/10.1186/s13063-015-0784-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-015-0784-0

Keywords