Skip to main content

Advertisement

Protocol update and statistical analysis plan for CADENCE-BZ: a randomized clinical trial to assess the efficacy of sodium benzoate as an adjunctive treatment in early psychosis

Article metrics

The Study protocol to this article has been published in Trials 2017 18:165

Abstract

Background

CADENCE-BZ is a multi-centre, parallel-group, double-blind randomized controlled trial designed to examine the clinical efficacy and safety of an accessible food preservative, sodium benzoate, as an add-on treatment for patients with early psychosis. The original study protocol was published in 2017. Here, we describe the updated protocol along with the Statistical Analysis Plan (SAP) for the CADENCE-BZ trial prior to study completion.

Methods and materials

Two important changes were made to the original protocol: (1) improvements to our statistical analysis plan permitted a reduction in sample size; and (2) a revision in the secondary outcomes with the intent of reducing redundancy and excluding those measures that were not appropriate as outcomes.

Conclusions

We provide the updated SAP prior to the completion of the study with the intent of increasing the transparency of the data analyses for CADENCE-BZ. The final participants are currently completing the study and the results will be published in the near future.

Trial registration

Australian New Zealand Clinical Trials Registry (ACTRN12615000187549). Registered on 26th February 2015.

Background

This paper provides the detailed statistical analysis plan (SAP) and outlines changes to the CADENCE–BZ study protocol. The original detailed protocol has been previously published [1]. CADENCE-BZ is a multi-centre, parallel-group, double-blind randomized controlled trial designed to examine the clinical efficacy and safety of an accessible food preservative, sodium benzoate, as an add-on treatment for patients with early psychosis. The trial was approved by the Metro South Hospital and Health Services Human Research Ethics Committee (HREC reference number HREC/14/QPAH/598). The primary objective was to determine if 12-week treatment with 1000 mg (500 mg twice daily (BD)) of sodium benzoate improves the Positive and Negative Syndrome Scale (PANSS) total score [2] compared to placebo.

The last participant was recruited in August 2018 with the final follow-up visit anticipated to be completed in October 2018. This protocol update and SAP were written to prevent outcome reporting bias [3], selective reporting [4], and data-driven results.

Revised secondary outcomes

Eleven outcomes were listed in the original study protocol. This includes the primary outcome, the PANSS total score, and the secondary outcomes: (1) the Global Assessment of Functioning (GAF), (2) the Clinical Global Impression (CGI), (3) the Hamilton Depression Rating Scale (HDRS), (4) the Assessment of Quality of Life (AQoL), (5) the Opiate Treatment Index (OTI), (6) the Activity and Participation Questionnaire (APQ-6), (7) the International Physical Activity Questionnaire (IPAQ), (8) the Simple Physical Activity Questionnaire (SIMPAQ), (9) the Physical Activity Questionnaire (PAQ), and (10) the Patient Global Impression (PGI-I).

The following secondary outcomes will be excluded from the protocol: (i) APQ6, which is a measure of vocational activity and community participation—no studies have demonstrated the APQ6 has sensitivity to change [5]. By contrast, the AQoL, a 12-item measure of functioning and quality of life which was included in the original protocol, was used previously in a study of sodium benzoate in participants with chronic schizophrenia [6]. As both the AQoL and the APQ6 measure similar domains, it was decided to exclude the APQ6. (ii) IPAQ, SIMPAQ, PAQ—these three scales measure physical activity and were only collected at baseline. They are therefore unable to be used as outcomes and have thus been excluded. (iii) The Opiate Treatment Index (OTI) is a comprehensive evaluation tool that assesses drug and alcohol use over the previous month. Drug and alcohol use were considered as confounding variables rather than outcomes and the OTI was therefore excluded.

Updated sample size and power

Our original sample size was based on two-sample t-test and utilised the conservative assumptions that there are few or no correlations between the baseline and follow-up measures, and that there are perfect correlations between follow-up measures [7]. Our sample size was reduced from 160 to 100 after we adjusted our SAP. We recalculated our sample size by revising our assumptions regarding the correlations for a variety of covariance structures and the number of repeated measures. This strategy has advantages from an ethical perspective (i.e., fewer patients need to be randomized, less exposure to potential adverse events or lack of efficacy) and with regard to cost-effectiveness (the study can be completed earlier). Using a two-tailed test with alpha set at 0.05 and 90% power, to detect a minimum clinical meaningful difference in total PANSS score of at least 5 units (SD = 14.3) between both treatment arms, we determined that we needed a sample of 39 persons in each group. This assumes the correlation between baseline and follow-up measurements is at least 0.6 and the correlation between various follow-up measurements is at most 0.5. Over a 12-week period, we predicted an attrition rate of 20%. Thus, we revised our sample size down to randomize 100 subjects and this amendment was recorded in the Australian New Zealand Clinical Trials Registry.

Statistical analysis plan

Data analysis and reporting

Data analysis and reporting will be done in accordance to the CONSORT guideline [8]. The CONSORT diagram comprising the number of participants who were screened, eligible, randomized, receiving their allocated treatment, withdrawn from/lost to follow-up along with reasons will be provided. All statistical tests will be carried out at the 5% (two-sided) significance level unless otherwise specified. Estimates along with 95% confidence intervals and associated p values will be reported. All analysis will be carried out using the SAS software version 9.4. Other software such as R may be used if required.

Definition of intention-to-treat and per-protocol population

The analysis will be performed based on intention-to-treat. This will include all randomized participants who complied with the study protocol through the duration of the clinical trial, as well as participants who deviated from the study protocol. We defined treatment compliance as the average number of pills taken per day divided by daily protocol dosage (in this case, two pills per day). The analysis will be performed in the per-protocol population by including participants (1) that stayed on the trial for 12 weeks and (2) whose treatment compliance was ≥ 80% (3) with absence of major protocol violation.

Missing values

A recent simulation study has revealed that mixed-effects model repeated measures (MMRM) analysis is robust in maintaining statistical properties of a test when compared to the multiple imputation method in handling missing values [9], assuming that participants dropping out of the study is unrelated to outcome conditioned on the study covariates (missing at random assumption). We will not be imputing missing data in the study outcomes.

Comparison of characteristics at baseline

Comparisons of participants at baseline will be undertaken for the outcome measures and for the following characteristics: sex, age, living situation, waist circumference, height, blood pressure, and body mass index. Continuous data will be summarized by means and standard deviation. Categorical data will be summarized by number and percentages. Significant test (χ2, t-test) will be computed to compare both treatment groups for each baseline characteristic. These baseline characteristics will be included as a covariate in the multivariable analysis to account for any imbalance that may have occurred by chance between the treatment groups. It is recommended that these variables are adjusted in assessing the primary outcome [10, 11].

Analysis of primary outcome

The primary outcome measure is the total score of PANSS. Primary outcome will be analysed using MMRM [12]. We will include treatment group, week, and treatment–week interaction as fixed effects and intercept as random effects in the model. We will use the first order autoregressive (AR) as the covariance structure of the MMRM model. The AR structure has the following characteristics: (1) it has homogenous variances and correlations that decline exponentially with time (i.e., two measurements that are in closer proximity in time are more strongly correlated (conditioned on ρ) than those that are more distant in time); and (2) it is appropriate when time periods are evenly spaced. We will also examine the residual to assess model assumptions and goodness-of-fit.

Analysis of secondary outcomes

Table 1 provides a summary of methods of analysis for each secondary outcome. We will use the Bonferroni method [13] to appropriately adjust for the overall level of significance for multiple secondary outcomes. There are no pre-planned subgroup analyses.

Table 1 Variables/measures and method of analysis

Safety outcomes

The number of treatment-related adverse events (AE) and serious adverse events (SAE) will be reported by their relationship as ‘definitely’, ‘probably’, and ‘possibly’ related to treatment. The number (and percentage) of participants with each AE/SAE will be presented for each treatment arm categorised by (1) preferred term (2), body system, (3) severity. The number (and percentage) of occurrences of each AE/SAE will also be presented for each treatment arm. No formal statistical testing will be undertaken.

Conclusions

This update contains the SAP for the CADENCE-BZ trial to avoid the risk of outcome reporting bias and data-driven results. By publishing this where we pre-specify our methods and analyses, it is hoped that the results will be as robust and transparent as possible.

Abbreviations

AQoL:

Assessment of Quality of Life

AR (1):

First order autoregressive

CGI:

Clinical Global Impression (CGI)

CONSORT:

Consolidated standards of reporting trials

GAF:

Global Assessment of Functioning

GLMM:

Generalized linear mixed model

HDRS:

Hamilton Depression Rating Scale

IPAQ:

International Physical Activity Questionnaire

MMRM:

Mixed-effects model repeated measures

OTI:

Opiate Treatment Index

PANSS:

Positive and Negative Syndrome Scale

PAQ:

Physical Activity Questionnaire

PGI-I:

Patient global impression

SAP:

Statistical analysis plan

SAS:

Statistical analysis system

SIMPAQ:

Simple Physical Activity Questionnaire

References

  1. 1.

    Ryan A, Baker A, Dark F, et al. The efficacy of sodium benzoate as an adjunctive treatment in early psychosis - CADENCE-BZ: study protocol for a randomized controlled trial. Trials. 2017;18:165.

  2. 2.

    Kay SR, Fiszbein A, Opler LA. The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13:261–76.

  3. 3.

    Ioannidis JP, Caplan AL, Dal-Ré R. Outcome reporting bias in clinical trials: why monitoring matters. BMJ. 2017;356:j408.

  4. 4.

    Jones CW, Keil LG, Holland WC, et al. Comparison of registered and published outcomes in randomized controlled trials: a systematic review. BMC Med. 2015;13:282.

  5. 5.

    Coombs T, Nicholas A, Pirkis J. A review of social inclusion measures. Aust N Z J Psychiatry. 2013;47:906–19.

  6. 6.

    Lane HY, Lin CH, Green MF, et al. Add-on treatment of benzoate for schizophrenia: a randomized, double-blind, placebo-controlled trial of D-amino acid oxidase inhibitor. JAMA Psychiatry. 2013;70:1267–75.

  7. 7.

    Morgan TM, Case LD. Conservative sample size determination for repeated measures analysis of covariance. Ann Biom Biostat. 2013;1:1002.

  8. 8.

    Schulz KF, Altman DG, Moher D, et al. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med. 2010;7:e1000251.

  9. 9.

    Siddiqui O. MMRM versus MI in dealing with missing data--a comparison based on 25 NDA data sets. J Biopharm Stat. 2011;21:423–36.

  10. 10.

    Steyerberg EW, Bossuyt PM, Lee KL. Clinical trials in acute myocardial infarction: should we adjust for baseline characteristics? Am Heart J. 2000;139:745–51.

  11. 11.

    Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869

  12. 12.

    Detry MA, Ma Y. Analyzing repeated measurements using mixed models. JAMA. 2016;315:407–8.

  13. 13.

    Armstrong RA. When to use the Bonferroni correction. Ophthalmic Physiol Opt. 2014;34:502–8.

Download references

Acknowledgements

We acknowledge contributions from members of the Cadence Working Group: Justin Chapman, Susan Patterson, Saveena Singh, Bryan Mowry, Linda Tracy, Michael Duhig, Amy Machin, Elizabeth Troman, Shuichi Suetani, Thomas Dinala, Lucinda Burton, Peter Cosgrove and Clare Gamble. We also acknowledge the support of Alison Bowers (West Moreton Human Research Ethics Committee) and Rebecca Lacey (Metro South Human Research Ethics Committee).

Funding

JJM received the John Cade Fellowship APP1056929 from the National Health and Medical Research Council and the Niels Bohr Professorship from the Danish National Research Foundation. JGS is supported by a National Health and Medical Research Council Practitioner Fellowship (Grant APP1105807). MB is supported by a NHMRC Senior Principal Research Fellowship (1059660 and 1156072).

Availability of data and materials

No additional data available.

Author information

JJM, JGS, OD, and MB designed the study. The protocol update was discussed and approved by JJM, JGS, and CL. The draft SAP was written by CL and was subsequently reviewed, discussed, and approved by SS, JGS, and JJM. All authors reviewed and approved the final version.

Correspondence to James Scott.

Ethics declarations

Ethics approval and consent to participate

This amendment to the statistical analysis was approved by the Metro South Human Research Ethics Committee and by the independent Data Safety Monitoring Board established for the conduct of the trial. The trial was funded by the National Health and Medical Research Council (NHMRC) John Cade Fellowship APP1056929 who did not require us to submit a protocol. The NHMRC are updated of the study progress in annual progress reports of the studies. Consent was not applicable for this amendment.

Consent for publication

Not applicable.

Competing interests

MB has received grant support from NIH, Simons Autism Foundation, Cancer Council of Victoria, CRC for Mental Health, Stanley Medical Research Foundation, MBF, NHMRC, Beyond Blue, Geelong Medical Research Foundation, Bristol Myers Squibb, Eli Lilly, GlaxoSmithKline, Organon, Novartis, Mayne Pharma, and Servier. MB has been a speaker for Astra Zeneca, Bristol Myers Squibb, Eli Lilly, GlaxoSmithKline, Janssen Cilag, Lundbeck, Merck, Pfizer, Sanofi Synthelabo, Servier, and Solvay and Wyeth and served as a consultant to Astra Zeneca, Bristol Myers Squibb, Eli Lilly, GlaxoSmithKline, Janssen Cilag, Lundbeck, and Servier. JGS has served on advisory boards of Roche, Lundbeck, Otsuka, and Janssen Cilag. JGS has been a speaker for Lundbeck, Otsuka, Servier, and Janssen Cilag. OMD is a R.D. Wright NHMRC Biomedical Research Fellow and has received grant support from the Brain and Behavior Foundation, Simons Autism Foundation, Stanley Medical Research Institute, Deakin University, Lilly, NHMRC, and ASBDD/Servier. She has also received kind support from BioMedica Nutracuticals, NutritionCare, and Bioceuticals. FD has no conflict of interest for this protocol but she received honoraria from Lundbeck and Janssen in the last 2 years. The other authors have no conflicts to declare.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Lim, C., Baker, A., Saha, S. et al. Protocol update and statistical analysis plan for CADENCE-BZ: a randomized clinical trial to assess the efficacy of sodium benzoate as an adjunctive treatment in early psychosis. Trials 20, 203 (2019) doi:10.1186/s13063-019-3232-8

Download citation

Keywords

  • Statistical analysis plan
  • Early psychosis
  • Randomized clinical trial
  • Sodium benzoate
  • PANSS
  • RCT

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.