Skip to main content

Safety and efficacy of belimumab after B cell depletion therapy in systemic LUPUS erythematosus (BEAT-LUPUS) trial: statistical analysis plan

Abstract

Background

There is limited evidence that rituximab, a B cell depletion therapy, is an effective treatment for systemic lupus erythematosus (SLE). Data on the mechanisms of B cell depletion in SLE indicate that the combination of rituximab and belimumab may be more effective than rituximab alone. The safety and efficacy of belimumab after B cell depletion therapy in systemic LUPUS erythematosus (BEAT-LUPUS) trial aims to determine whether belimumab is superior to placebo, when given 4–8 weeks after treatment with rituximab. This article describes the statistical analysis plan for this trial as an update to the published protocol. It is written prior to the end of patient follow-up, while the outcome of the trial is still unknown.

Design and methods

BEAT-LUPUS is a randomised, double-blind, phase II trial of 52 weeks of belimumab versus placebo, initiated 4–8 weeks after rituximab treatment. The primary outcome is anti-dsDNA antibodies at 52 weeks post randomisation. Secondary outcomes include lupus flares and damage, adverse events, doses of concomitant medications, quality of life, and clinical biomarkers. We describe the trial’s clinical context, outcome measures, sample size calculation, and statistical modelling strategy, and the supportive analyses planned to evaluate for mediation of the treatment effect through changes in concomitant medication doses and bias from missing data.

Discussion

The analysis will provide detailed information on the safety and effectiveness of belimumab. It will be implemented from July 2020 when patient follow-up and data collection is complete.

Trial registration

ISRCTN: 47873003. Registered on 28 November 2016.

EudracT: 2015-005543-14. Registered on 19 November 2018.

Peer Review reports

Trial summary and clinical context

Clinical background and rationale

Systemic lupus erythematosus (SLE) is a chronic systemic autoimmune disease with a prevalence of 40–200 per 100,000 people, mainly affecting women of child-bearing age. There is a substantial morbidity and mortality associated with SLE, with standardised mortality ratios ranging from 2 to 5 [1]. There is also a lack of novel treatments for patients with severe SLE. Due to the lack of effective alternative therapies, many patients require high-dose glucocorticoid therapy which is associated with serious adverse effects including increased infections, cataracts, diabetes mellitus, and osteoporosis [2]. Both the disease itself and steroid exposure lead to increased rates of cardiovascular disease [3].

A key objective for treatment of severe SLE is disease remission induction and then prevention of “flare”; the worsening of lupus signs and symptoms in one or more systems of the body. It is expected that flares will be too rare in this phase II trial for any difference between treatment arms to be reliably detected, so anti-dsDNA antibody levels, which are a sensitive marker of immune system activity associated with flares [4], are the primary outcome instead. Clinical flares are a secondary outcome.

The biologic rituximab is currently the treatment of choice for refractory cases of SLE where other treatments have not succeeded, although no randomised controlled trials (RCTs) have demonstrated its effectiveness [5]. Previous studies have found that anti-dsDNA levels can increase in a proportion of patients treated with rituximab who then flare, leading us to hypothesise two effects of the medication: B cell depletion, which reduces flare risk; but also increasing levels of serum B cell activating factor/B lymphocyte stimulator (BAFF/BLyS) in certain patients, which increases the flare risk [6]. These opposing effects may explain the lack of significant efficacy found in the previous RCTs of rituximab.

Belimumab may be an effective addition to rituximab in this context, as it reduces BAFF levels. We therefore designed an early-phase clinical trial testing the safety and efficacy of rituximab followed by belimumab compared to rituximab alone [7]. Anti-dsDNA is a useful surrogate outcome to provide an early indication of the effectiveness of belimumab as an adjunct to rituximab, as it is correlated both with BAFF as well as flare activity.

Another marker of treatment effectiveness is a reduction in the patient’s steroid dose. Patients participating in BEAT-LUPUS will typically be on steroids or both steroids and immunosuppressants at the time of enrolment. During the trial, patients may take the steroid prednisolone and one immunosuppressant (either azathioprine, methotrexate, or mycophenolate). In usual care, their doctor will reduce their steroid dose if their condition improves and increase the dose if their condition deteriorates. Doctors participating in BEAT-LUPUS are asked to safely reduce their patient’s steroid dose if it is over 10 mg/day following administration of rituximab and belimumab/placebo. Differences between treatment arms in the extent to which steroid dose is actually reduced, and then maintained at a lower dose, will be partly determined by whether the treating clinician considers that this is safe and tolerable based on clinical symptoms following administration of belimumab or placebo.

Trial objectives

The primary objective of BEAT-LUPUS is to compare anti-dsDNA levels 52 weeks after randomisation between a 52-week regime of either belimumab or placebo amongst patients treated with rituximab 4–8 weeks before randomisation. Lupus flares, incidence of adverse events, and changes in dosing of prednisolone are secondary outcomes. A supportive analysis will seek to examine whether any observed reductions in anti-dsDNA are mediated by changes in the prednisolone dose during follow-up.

Study methods

Design, randomisation, outcomes, and interim stopping rules

BEAT-LUPUS is a multicentre, phase II, randomised, double-blind, placebo-controlled clinical trial comparing safety and efficacy of a monthly regime of either belimumab or placebo commencing 4–8 weeks after B cell depletion therapy (rituximab). The total treatment period (on belimumab or placebo) is 52 weeks. There is an additional follow-up appointment at 56 weeks and a pregnancy check at 68 weeks. Full details of the interventions and study design are published in the trial protocol [7].

From March 2017 to March 2019, 52 patients were recruited and randomised 1:1 to receive either belimumab or placebo for 52 weeks after completing treatment with rituximab at one of 16 participating centres in the UK. Follow-up ended in April 2020, with the statistical analysis starting immediately afterwards.

Randomisation was done using minimisation incorporating a random element to ensure unpredictability in treatment allocations. Factors minimised include the CD19 count at randomisation (< 0.01 × 109/l vs ≥ 0.01 × 109/l) to account for variability in B cell depletion from rituximab, which would affect response; anti-dsDNA (positive or negative at first screen before rituximab); and whether patients have active renal disease at their first screen.

The primary analysis will utilise an analysis of covariance (ANCOVA) model, which will examine the treatment difference at 52 weeks and test for superiority. The measurement taken closest to 52-week follow up point will be used, with measurements taken up to 2 months before or after 52 weeks being eligible for inclusion in the analysis.

No formal interim analyses will be done. An Independent Data Monitoring Committee (IDMC) meet annually to review safety data, and may recommend stopping the trial if they judge the results are likely to convince a broad range of clinicians that one arm is clearly contraindicated.

Sample size calculation

Sample size calculations were performed using STATA 13 [8]. The calculation assumed that anti-dsDNA binding antibody levels are log normally distributed, assumed that an ANCOVA model would be used to evaluate the difference in mean log anti-dsDNA between treatment arms at 52 weeks [9], and made additional adjustment for expected losses to follow-up.

The standard deviation of anti-dsDNA and the correlation structure were based on two sets of data: the study of 35 participants by Carter et al. [6]; and data provided by Professor David Isenberg of University College Hospital for 67 participants before and 6 months after B cell depletion therapy.

Based on the data presented in Table 1, the standard deviation of the final log anti-dsDNA measurements was assumed to be 1.7, and the correlation between baseline and final measurements was assumed to be 0.55. Twenty-two evaluable participants per group would be sufficient to detect a difference of 1.2 in log anti-dsDNA at 5% significance with 80% power. We assumed that 20% of participants would fail to attend the 12-month follow-up visit, so aimed to recruit 28 participants per group.

Table 1 Standard deviations and correlations for log anti-dsDNA

The study’s power to detect a difference of 1.2 in log anti-dsDNA is equivalent to being able to detect a difference of 232% between arms (equivalent to multiplying by exp.(1.2)). To put this in context, Carter et al. found that the log difference between participants who did and did not flare was 1.928, corresponding to a 588% increase in anti-dsDNA in those who flared [6].

Statistical principles

Two-sided p-values and 95% confidence intervals will be reported for all statistical tests. There is one pre-specified primary analysis, which will use a p-value threshold of 5% to reject the null to ensure that the probability of a type I error does not exceed 5%. Log anti-dsDNA will be used to account for skewness in anti-dsDNA measurements.

Adherance to the protocol requires that the patient receives their randomised treatment for 52 weeks, does not exceed the pre-specified maximum doses of concomitant medication at enrolment, and also does not increase their doses of concomitant medications during follow up. Patients are encouraged to continue to provide follow-up measurements, even if they stop adhering to the protocol before 52 weeks.

The percentages of patients who fully adhere to the protocol and patients who do not adhere but do provide a 52-week measurement will be reported. The primary outcome analysis will be intention to treat; all patients who provide baseline and 52-week anti-dsDNA measurements will be included regardless of adherence to the protocol. Secondary analyses of the primary outcome will only include patients who adhered to the protocol.

Trial population

The full eligibility criteria for enrolment into BEAT-LUPUS are listed in the published trial protocol [7] and Additional File 1: Inclusion and exclusion criteria.

Counts of patients screened but not enrolled in the trial and the reason for exclusion will be reported, and recruitment to the trial will be presented by centre and calendar month. The number of patients who withdraw or are unwilling to continue follow-up will be reported by the last follow-up visit attended and treatment arm. Reasons for patient withdrawals will be tabulated by treatment arm. The full throughput of patients from screening to analysis will be summarised in a CONSORT flowchart [10].

Baseline characteristics of patients in BEAT-LUPUS will be summarised by treatment arm (Additional File 1, Dummy Tables). Characteristics described will include screening anti-dsDNA, CD19 count, presence of renal disease, age, and sex. Characteristics at randomisation will also be reported: biomarker levels including anti-dsDNA, CD19 levels, and current doses of concomitant medications. Characteristics will be summarised using means and standard deviations for (approximately) normally distributed continuous variables, geometric means and 95% confidence intervals for (approximately) log normally distributed continuous variables, medians and interquartile ranges for non-normally distributed variables, and frequencies and percentages for categorical variables.

Outcomes

Primary and secondary outcomes

The primary outcome measure is log anti-dsDNA antibody levels at 52 weeks. Secondary outcomes are as follows:

  1. 1.

    Log anti-dsDNA antibody levels at 12 and 24 weeks

  2. 2.

    Proportion of participants with any adverse events and proportion with any serious adverse events

  3. 3.

    Proportion of participants with any infections

  4. 4.

    Proportion of participants with any severe flare (severe flare: a British Isles Lupus Assessment Group (BILAG-2004) A score due to items which are “new” or “worse” [11,12,13]; or, in the renal or haematological systems, an A score due to items that did not result in an A score last month) by 24 and 52 weeks, and time to severe flare

  5. 5.

    Proportion of participants with any severe flare or a moderate flare (moderate flare: two BILAG B scores due to items which are either “new” or “worse”; or, in the renal or haematological systems, B scores due to items that did not result in a B score last month) by 24 and 52 weeks, and time to severe or moderate flare

  6. 6.

    Proportion of participants with any severe flare, moderate flare, or mild flare (mild flare: a single BILAG B score due to items which are “new” or “worse”; or, for the renal or haematological systems, a B score due to items that did not result in a B score last month) by 24 and 52 weeks, and time to severe, moderate, or mild flare

  7. 7.

    Proportion of participants with any severe or moderate flare accompanied by an increase in concomitant lupus medication (glucocorticoids, mycophenolate, azathioprine, or methotrexate) by 24 and 52 weeks, and time to flare

  8. 8.

    Systemic Lupus Erythematosus Disease Activity Index 2000 (SLEDAI-2000) at 52 weeks [14]

  9. 9.

    Systemic Lupus International Collaborating Clinics/American College of Rheumatology (SLICC/ACR) damage index at 52 weeks [15]

  10. 10.

    Visual analogue scale (VAS) Subject Global Assessment of Disease Activity (SGADA) at 52 weeks

  11. 11.

    Complement C3 at 52 weeks

  12. 12.

    Immunoglobulin levels at 52 weeks

  13. 13.

    Cumulative steroid and immunosuppressant doses during treatment from randomisation to 52 weeks

  14. 14.

    Proportion of participants successfully reducing their steroid dose at the time of randomisation: decreasing their steroid dose by 50% without flaring; if below 10 mg/day at randomisation, reducing the steroid dose to 5 mg/day; or discontinue steroids with stable disease

  15. 15.

    Proportion of participants with a prednisolone dose ≤ 7.5 mg/day at both weeks 48 and 52

  16. 16.

    Lupus Quality of Life (Lupus QoL), Short Form 36 Health Survey (SF-36), and EQ-5D-5 L at 52 weeks [16,17,18]

  17. 17.

    Columbia Suicide Severity Rating Scale (C-SSRS) to assess suicide risk at 52 weeks [19]

  18. 18.

    Stanford HAQ 20-item Disability Scale (HAQ) at 52 weeks [20]

Scoring and description of derived outcome measures

British Isles Lupus Assessment Group (BILAG-2004) index

The BILAG-2004 index questionnaire comprises 97 questions on lupus activity in the past 4 weeks compared to the previous 4 weeks, divided among 9 systems of the body [21]. Individual items are recorded either on a 0–4 ordinal scale from 0 = “not present” to 4 = “new”, or as real numbers (e.g. systolic blood pressure). An algorithm is then applied to determine an overall categorical score for each system depending on which items are present and how they are recorded; A = severe disease activity, B = moderate disease activity, C = mild disease, D = inactive disease but previously affected, and E = system never involved. Additional criteria are applied to identify A and B scores which are new manifestations of a flare of the disease. “Severe” flare occurs if there is at least one A score due to items which are “new” or “worse” on the BILAG questionnaire; or, in the renal and haematological systems, due to questionnaire items which last month did not result in an A score (i.e. which were less severe). A “moderate” flare occurs if at least two new B scores occur which are due to items which are “new” or “worse”, or, in the renal and haematological systems, due to items which last month did not result in a B score (i.e. were less severe). A “mild” flare occurs if there is only one B score which meets these conditions.

The subset of BILAG flares which are accompanied by an increase in one of the medications used to control the disease will also be evaluated. This allows evaluation of only those flares that were severe enough in the clinician’s judgement to modify the treatment regime.

The Systemic Lupus Erythematosus Disease Activity Index 2000 (SLEDAI-2000)

The SLEDAI Responder Index determines improvement in lupus activity based on 24 items in 9 organs in the previous 30 days [14]. The scores from the different systems are weighted in proportion to their hazard (i.e. central nervous system items are weighted as twice that of joint pain and kidney items) and combined into one final score from 0 to 105.

Patient global assessments of lupus activity on a 10-cm visual analogue scale (VAS)

This VAS is a BEAT-LUPUS-specific measure of disease activity developed for this trial. Patients are presented with a line labelled 0–10, and point to the number on the line which best matches their own assessment of lupus activity in terms of lupus-associated symptoms in the past 4 weeks (0 = not active at all, 10 = extremely active).

The Systemic Lupus International Collaborating Clinics/American College of Rheumatology (SLICC/ACR) damage Index for systemic lupus erythematosus

The SLICC/ACR Damage Index (SDI) provides a measure of accumulated damage in the body since the onset of lupus [22]. This summary score is based on damage across 12 different organ systems. For each system, a variety of different possible types of damage are listed, each scoring 1 point, and for some items a score or 2 is given if there has been more than one occurrence of the item, and for renal failure requiring renal replacement therapy a maximum score of 3 is given, and other renal items no longer score. The summary score for the whole body is the sum of all the individual scores.

LupusQoL

The LupusQol measure is a lupus-specific health-related quality of life measure [16]. It comprises 34 questions that each ask about effects of lupus on day-to-day physical and emotional health, body image, pain, planning, fatigue, intimate relationship, and burden to others. Patients answer each question on a scale from 1 = “all of the time” to 5 = “never”. Average scores for each domain are mapped to a 0–100 score. So long as 50% of data items for a domain are completed, a 0–100 score will be calculated, in line with guidance from the authors of the questionnaire [16]. The mean score across domains is then calculated as the average of the domain-specific scores.

The Short Form 36 Health Survey (SF-36)

The SF-36 is a survey of patient health in eight sections: vitality, physical functioning, bodily pain, general health perceptions, physical role functioning, emotional role function, social role functioning, and mental health [17]. Each section has a score that is a weighted sum of the questions in that section, directly transformed into a 0–100 score, with lower scores indicating more disability. Unanswered questions are excluded; the average for all items on the scale that the respondent answered is used instead. A standardised composite score of health is then generated from each of the eight scores.

EQ-5D-5 L

The EQ-5D-5 L assesses the current health state across five dimensions — mobility, self-care, usual activities, pain/discomfort, and anxiety/depression — with five levels (each scored 1–5, with higher scores indicating worse health state) [18]. EQ-5D dimension scores will be converted to index scores using UK population values. EQ-5D index scores range from − 1 = worse than death, and then 0 = worst to 1 = best health state. The EQ-5D additionally includes a visual analogue scale (EQ VAS), which allows patients to record their overall current health status on a scale ranging from 0 = worst to 100 = best health state.

If any dimension score is missing, the EQ-5D index score will be set to missing. If the entirety of one component of the questionnaire (dimension score or VAS) has not been completed, the associated component score will be set to missing. If the entire questionnaire has not been completed, both the EQ-5D index score and EQ-5D VAS at that visit will be set to missing.

Columbia Suicide Severity Rating Scale (C-SSRS)

The C-SSRS questionnaire provides summary measures of suicidal ideation and behaviour. These are strongly associated with the risk of an individual completing suicide [19]. The ideation and behaviour sections can be scored separately and also combined into one summary score [23]. Ideation is scored at each visit from 1 = “wish to be dead” to 5 = “active suicidal ideation with specific plan and intent”; behaviour is scored from 6 = “preparatory acts or behaviour” to 10 = “completed suicide”. Imputation of missing values is not done; if any data are missing for a domain, its score is not calculated.

The Stanford HAQ 20-item Disability Scale (HAQ)

This questionnaire summarises patient disability based on the extent of difficulty within eight domains; dressing and grooming, arising, eating, walking, hygiene, reach, grip, and activities [20]. The total score is the mean score of the eight category scores. If more than two of the categories are missing, the score is not calculated. If only one category is missing, the mean of the other seven category scores is used as the total score.

Statistical analysis

The results of the analyses will be reported following the principle of the ICH E3 guidelines on the Structure and Content of Clinical Study Reports. All analyses will be performed using STATA 15 [8]. In addition, the primary analysis of the primary outcome, mediation, and other secondary analyses of the primary outcome will also be done, and results for the primary outcome will be presented by levels of the stratifying variables adjusted for in the primary analysis, as an exploratory subgroup analysis. For all analyses done using linear regression models, diagnostic checks will be done using residual plots and the data will be transformed and re-analysed if necessary. The results will be presented (Additional File 1, Dummy tables).

Primary analysis of the primary outcome

A linear regression ANCOVA model will be fitted to evaluate the difference in 52-week anti-dsDNA between treatment arms, adjusting for CD19 count at randomisation (< 0.01 × 109/l vs ≥ 0.01 × 109/l), previous renal involvement (yes/no) at screening, log anti-dsDNA levels at screening, and also log anti-dsDNA levels measured at randomisation. Patients who provide these measurements will be included in the model and analysed according to their randomised treatment, regardless of treatment adherence. The model will be specified as follows, where Yi,j is the anti-dsDNA of patient j at time i:

$$ \log \left({\mathrm{Y}}_{52,j}\right)={\beta}_0+{\beta}_1\left({\mathrm{treatment}}_j\right)+{\beta}_2\left(\mathrm{CD}{19}_j\right)+{\beta}_3\left(\log \left({\mathrm{Y}}_{0,j}\right)\right)+{\beta}_4\left({\mathrm{renal}}_j\right)+{\beta}_4\left(\log\ \left({\mathrm{screenDNA}}_j\right)\right)+{\varepsilon}_j $$

where treatmentj = 1 if belimumab and 0 if placebo, and εij is a normal error distribution. The primary outcome will be estimated by exp(β1) as the difference in anti-dsDNA amongst patients randomised to belimumab compared to the placebo group at 52 weeks, expressed as a percentage of the average in the placebo group at 52 weeks.

Supportive analyses of the primary outcome

Analysis of log anti-dsDNA at 12 and 24 weeks

The model structure used for the primary analysis will also be repeated with the outcome changed to log anti-dsDNA at 12 and 24 weeks to evaluate differences between treatment arms at these time points. These analyses will be done on the intention-to-treat basis, the same as the primary analysis.

Per-protocol repeated-measures analysis of anti-dsDNA at 52 weeks

Repeated-measures linear regression will be used to analyse the difference between arms in anti-dsDNA using the randomisation and all follow-up measurements in the same model. Measurements will be excluded after the point a patient stops adhering to the protocol; either the day after the patient fails to take their randomised treatment as scheduled, or from the second day after they increase the dose of one of the allowed concomitant medications (whichever comes first). This model will estimate the mechanistic effect of belimumab on anti-dsDNA.

In the model, Patient ID will be included as a random effect to account for correlation between measurements on the same patient at different points of follow-up. The model for anti-dsDNA at 52 weeks, where yij is the anti-dsDNA of patient j at time i, is:

$$ {y}_{ij}={\beta}_{0j}+{\beta}_1\left({\mathrm{time}}_i\right)+{\beta}_2\left({\mathrm{time}}_i\times {\mathrm{treatment}}_j\right)+{\beta}_3\left(\mathrm{CD}{19}_j\right)+{\beta}_4\left({\mathrm{renal}}_j\right) $$

where β0j = β0 + u0j + εij, u0j ~ N(\( {\sigma}_{u0}^2 \), 0), εij ~ N(0, σ2), and treatmentj = 1 if belimumab and 0 if placebo.

The average treatment difference at 52 weeks will be estimated by β2 × 52. Log-transformation of anti-dsDNA or fractional polynomials for the effect of time will be considered if plots of residuals or likelihood ratio tests indicate that these will improve the model fit.

Mediation analysis of the effect of prednisolone on anti-dsDNA at 52 weeks

If material differences (p < 0.1) between treatment arms are found in the cumulative prednisolone dose between randomisation and 52 weeks, an exploratory causal mediation analysis will be done to evaluate the extent to which this may mediate any effect of allocation to belimumab on anti-dsDNA at 52 weeks [24]. The direct effect of belimumab (i.e. the effect of taking belimumab instead of placebo, had the cumulative steroid dose been the same in both conditions) and the average causal mediation effect (i.e. the effect of the cumulative steroid dose patients would have taken on belimumab instead of the dose they would have taken on placebo, had they actually taken belimumab in both conditions) will be estimated using the STATA mediation package [25].

Sensitivity analysis for informative loss to follow-up

If over 10% of patients fail to provide a 52-week anti-dsDNA measurement, a sensitivity analysis will be done using multiple imputation to evaluate whether the primary analysis and the repeated-measures per-protocol analysis are biased by missing data. Missing anti-dsDNA measurements will be imputed using all variables in the primary analysis model and data on concomitant medications, flares, and time to flare, all available anti-dsDNA measurements from other scheduled visits, and any anti-dsDNA measurements taken at point of flare/withdrawal. A number of imputation datasets sufficient to give a power reduction of < 1% compared to using n = 100 will be produced [26]; the analysis models will be run on each of these datasets; and estimates and confidence intervals will be combined using Rubin’s rules [27]. The concordance of results between the non-imputation (complete case) and imputation models will be assessed.

Analysis of the secondary outcomes

The percentage of patients with the following characteristics will be compared between treatment arms using Fisher’s exact test:

  1. I.

    BILAG severe flare

  2. II.

    BILAG severe or moderate flare

  3. III.

    BILAG severe, moderate, or mild flare

  4. IV.

    BILAG severe or moderate flare which was accompanied by an increase in one or more concomitant medication

  5. V.

    Any serious adverse event

  6. VI.

    Any infection

  7. VII.

    Any adverse events

  8. VIII.

    Completed 52 weeks of follow-up

  9. IX.

    Completed 52 weeks of treatment

For each of the SLEDAI, SLICC, VAS, C3, immunoglobulin levels, LupusQoL, SF-36, and EQ-5D-DL, assessments at 52 weeks will be compared between arms using linear regression models which include the stratifying variables and the value of the variable at screening (for the HAQ and SLICC) or randomisation (for all others). Time to disease flare will be visually displayed using Kaplan–Meier curves, and difference between arms in hazard of flare will be tested using Cox models that include the stratifying variables. For the BILAG flare scores, an ordinal logistic regression model will also be fitted to compare maximum disease flare severity experienced during follow-up (severe, moderate, mild, or no flare), also adjusted for the stratifying variables.

The following steroid dose summary measures will be compared between the arms:

  1. i)

    Cumulative steroid dose from randomisation to 52 weeks using a two-sample t test

  2. ii)

    Proportion of participants successfully reducing their steroid dose, using Fisher’s exact test

  3. iii)

    Proportion of patients taking ≤ 7.5 mg of prednisolone at weeks 48 and 52

The following quantities taken from the C-SSRS will be compared between treatment arms:

  1. i)

    Average C-SSRS score at 52 weeks

  2. ii)

    Percentage of patients with a C-SSRS score which increased to > 5 at any point during follow-up

For the questionnaires completed at each follow-up visit (BILAG, VAS, and C-SSRS), if the questionnaire is not completed at one visit, then the result from the previous month will be carried forward for 1 month only (unless it is missing due to withdrawal/flare since the previous visit, in which case data captured at that point will be used).

Discussion

This update to the published protocol describes the pre-specified statistical analysis plan for BEAT-LUPUS. By publishing it we aim to increase transparency of the data analysis, and demonstrate appropriate approaches for the challenges of: evaluating lupus activity; concomitant medications, which can vary between treatment arms post randomisation due to the trial treatment given and affect the primary outcome; and high expected loss to follow-up, a common feature of trials on severe SLE. By evaluating several measures of lupus activity, and using up-to-date statistical techniques to evaluate mediation of the treatment effect through changes in prednisolone dose and bias from missing data, we will return comprehensive and robust information on the safety and effectiveness of belimumab compared to placebo.

Availability of data and materials

The protocol has previously been published [7]. Following completion of the trial analysis, the results will be published, and additional available data can be obtained by contacting the chief investigator (MRE). The study team retain exclusive use until publication of major outputs has been completed.

Abbreviations

BAFF:

B cell activating factor

BILAG:

British Isles Lupus Assessment Group

C3:

Complement component 3

C-SSRS:

Columbia Suicide Severity Rating Scale

ICH:

International Conference on Harmonisation

IDMC:

Independent Data Monitoring Committee

SAP:

Statistical Analysis Plan

SDI:

SLICC/ACR Damage Index

SLE:

Systemic lupus erythematosus

SLEDAI:

Systemic Lupus Erythematosus Disease Activity Index

UCL:

University College London

UCLH:

University College Hospital

References

  1. 1.

    Thomas G, Mancini J, Jourde-Chiche N, Sarlon G, Amoura Z, Harle JR, et al. Mortality associated with systemic lupus erythematosus in France assessed by multiple-cause-of-death analysis. Arthritis Rheumatol (Hoboken, NJ). 2014;66(9):2503–11.

    Article  Google Scholar 

  2. 2.

    Ruiz-Irastorza G, Danza A, Khamashta M. Glucocorticoid use and abuse in SLE. Rheumatology (Oxford). 2012;51(7):1145–53.

    CAS  Article  Google Scholar 

  3. 3.

    Ahmad Y, Shelmerdine J, Bodill H, Lunt M, Pattrick MG, Teh LS, et al. Subclinical atherosclerosis in systemic lupus erythematosus (SLE): the relative contribution of classic risk factors and the lupus phenotype. Rheumatology (Oxford). 2007;46(6):983–8.

    CAS  Article  Google Scholar 

  4. 4.

    Lazarus MN, Turner-Stokes T, Chavele K-M, Isenberg DA, Ehrenstein MR. B-cell numbers and phenotype at clinical relapse following rituximab therapy differ in SLE patients according to anti-dsDNA antibody levels. Rheumatology (Oxford, England). 2012;51(7):1208–15.

    CAS  Article  Google Scholar 

  5. 5.

    Favas C, Isenberg DA. B-cell-depletion therapy in SLE—what are the current prospects for its acceptance? Nat Rev Rheumatol. 2009;5(12):711–6.

    CAS  Article  Google Scholar 

  6. 6.

    Carter LM, Isenberg DA, Ehrenstein MR. Elevated serum BAFF levels are associated with rising anti-double-stranded DNA antibody levels and disease flare following B cell depletion therapy in systemic lupus erythematosus. Arthritis Rheum. 2013;65(10):2672–9.

    CAS  PubMed  Google Scholar 

  7. 7.

    Jones A, Muller P, Dore CJ, Ikeji F, Caverly E, Chowdhury K, et al. Belimumab after B cell depletion therapy in patients with systemic lupus erythematosus (BEAT Lupus) protocol: a prospective multicentre, double-blind, randomised, placebo-controlled, 52-week phase II clinical trial. BMJ Open. 2019;9(12):e032569.

    Article  Google Scholar 

  8. 8.

    Stata Corp. Stata Statistical software: Release 15. College Station: StataCorp LLC; 2017.

  9. 9.

    Borm GF, Fransen J, Lemmens WA. A simple sample size formula for analysis of covariance in randomized clinical trials. J Clin Epidemiol. 2007;60(12):1234–8.

    Article  Google Scholar 

  10. 10.

    Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMJ (Clinical research ed). 2010;340:c332.

  11. 11.

    Yee C-S, Cresswell L, Farewell V, Rahman A, Teh L-S, Griffiths B, et al. Numerical scoring for the BILAG-2004 index. Rheumatology (Oxford, England). 2010;49(9):1665–9.

    Article  Google Scholar 

  12. 12.

    Isenberg DA, Allen E, Farewell V, D'Cruz D, Alarcón GS, Aranow C, et al. An assessment of disease flare in patients with systemic lupus erythematosus: a comparison of BILAG 2004 and the flare version of SELENA. Ann Rheum Dis. 2011;70(1):54–9.

    CAS  Article  Google Scholar 

  13. 13.

    Isenberg D, Sturgess J, Allen E, Aranow C, Askanase A, Sang-Cheol B, et al. Study of flare assessment in systemic lupus erythematosus based on paper patients. Arthritis Care Res. 2018;70(1):98–103.

    CAS  Article  Google Scholar 

  14. 14.

    Bombardier C, Gladman DD, Urowitz MB, Caron D, Chang CH, Austin A, et al. Derivation of the SLEDAI. A disease activity index for lupus patients. Arthritis Rheum. 1992;35(6):630–40.

    CAS  Article  Google Scholar 

  15. 15.

    Gladman DD, Urowitz MB, Goldsmith CH, Fortin P, Ginzler E, Gordon C, et al. The reliability of the Systemic Lupus International Collaborating Clinics/American College of Rheumatology damage index in patients with systemic lupus erythematosus. Arthritis Rheum. 1997;40(5):809–13.

    CAS  Article  Google Scholar 

  16. 16.

    McElhone K, Abbott J, Shelmerdine J, Bruce IN, Ahmad Y, Gordon C, et al. Development and validation of a disease-specific health-related quality of life measure, the LupusQol, for adults with systemic lupus erythematosus. Arthritis Care Res. 2007;57(6):972–9.

    Article  Google Scholar 

  17. 17.

    Rand Corporation. 36-Item Short Form Survey (SF-36). Santa Monica: RAND Corporation; 1988.

  18. 18.

    Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36.

    CAS  Article  Google Scholar 

  19. 19.

    Posner K, Brown GK, Stanley B, Brent DA, Yershova KV, Oquendo MA, et al. The Columbia–Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatr. 2011;168(12):1266–77.

    Article  Google Scholar 

  20. 20.

    Bruce B, Fries JF. The Stanford Health Assessment Questionnaire: dimensions and practical applications. Health Qual Life Outcomes. 2003;1:20.

    Article  Google Scholar 

  21. 21.

    Gordon C, Sutcliffe N, Skan J, Stoll T, Isenberg DA. Definition and treatment of lupus flares measured by the BILAG index. Rheumatology. 2003;42(11):1372–9.

    CAS  Article  Google Scholar 

  22. 22.

    Gladman D, Ginzler E, Goldsmith C, Fortin P, Liang M, Sanchez-Guerrero J, et al. The development and initial validation of the Systemic Lupus International Collaborating Clinics/American College of Rheumatology damage index for systemic lupus erythematosus. Arthritis Rheum. 1996;39(3):363–9.

    CAS  Article  Google Scholar 

  23. 23.

    Columbia-Suicide Severity Rating Scale scoring and data analysis guide. Columbia University: The Columbia Lighthouse Project; 2013.

  24. 24.

    Imai K, Keele L, Tingley D. A general approach to causal mediation analysis. Psychol Methods. 2010;15(4):309–34.

    Article  Google Scholar 

  25. 25.

    Hicks R, Tingley D. Causal mediation analysis. Stata J. 2011;11(4):605–19.

    Article  Google Scholar 

  26. 26.

    Graham JW, Olchowski AE, Gilreath TD. How many imputations are really needed? Some practical clarifications of multiple imputation theory. Prev Sci. 2007;8(3):206–13.

    Article  Google Scholar 

  27. 27.

    Carpenter J, Kenward M. Multiple imputation and its application. Chichester: Wiley; 2013.

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank Versus Arthritis (grant number 20873) and the UCLH Biomedical Research Centre (BRC) for funding the trial, and GSK for providing belimumab free of charge and for additional funding.

The authors thank the BEAT-LUPUS Independent Data Monitoring Committee (Dr Richard Watts (Chair), Prof. Vern Farewell, Prof. Robert Moots) for insightful discussion and feedback on the statistical analysis plan. They would also like to thank the BEAT-LUPUS Trial Management Group (Ms Felicia Ikeji, Ms Emilia Caverly, Mrs Nazma Begum-Ali, Ms Alexa King), the Trial Steering Committee (Prof. Raashid Luqmani (Chair), Dr Michael John Bankart, Dr Ceril Rhys-Dillon), and all of the patients participating in the trial or involved in its development. The authors are indebted to the BEAT-LUPUS Trial Collaborators at the recruiting sites, the British Isles Lupus Assessment Group (BILAG), and the NIHR Musculoskeletal Translational Research Collaboration for their advice and support.

Funding

This trial is supported by Versus Arthritis (grant number 20873) and the UCLH Biomedical Research Centre (BRC). GSK are providing belimumab free of charge, as well as additional funding. The MRC (MASTERPLANS CONSORTIUM) is supporting some of the experimental medicine applied to samples from this trial. GSK had no role in the design of this study and will not have any role during its execution, analyses, interpretation of the data, or decision to submit results. Versus Arthritis and the MRC reviewed the relevant grant proposals and monitor progress of relevant aspects of the study, but will not play any role in the analyses, interpretation of data, or decision to submit results.

Author information

Affiliations

Authors

Contributions

PM prepared the Statistical Analysis Plan (SAP) and manuscript. KC, CG, MRE, and CJD contributed to drafting and editing the SAP. MRE conceived the trial, obtained funding for it, and provided oversight on the trial design and protocol. CJD provided oversight on the development of the SAP and other statistical aspects of the trial. CG provided oversight on the measurement and quality assurance of lupus activity. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Patrick Muller.

Ethics declarations

Ethics approval and consent to participate

Ethical approval for this study has been obtained and is overseen by the National Research Ethics Service Committee (London, Hampstead, 16/LO/1024). The authors have obtained informed consent from all participants in the study.

Consent for publication

Not applicable.

Competing interests

None.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Inclusion and exclusion criteria for BEAT-LUPUS, and dummy tables showing the planned format and contents of the tables for the final statistical report.

Additional file 2.

BEAT-LUPUS CTU signed-off version of the SAP, containing further administrative details.

Additional file 3.

Guidelines for the Content of Statistical Analysis Plans in Clinical Trials Checklist (as specified in Gamble et al, JAMA, 2017, and recommended by the EQUATOR Network).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Muller, P., Chowdhury, K., Gordon, C. et al. Safety and efficacy of belimumab after B cell depletion therapy in systemic LUPUS erythematosus (BEAT-LUPUS) trial: statistical analysis plan. Trials 21, 652 (2020). https://doi.org/10.1186/s13063-020-04391-2

Download citation

Keywords

  • Statistical analysis plan
  • Systemic lupus erythematosus
  • Rituximab
  • Belimumab
  • Anti-dsDNA
  • Flare
  • British Isles Lupus Assessment Group
  • Causal mediation
  • Randomised controlled trial