- Open Access
- Open Peer Review
Protocol update and statistical analysis plan for CADENCE-BZ: a randomized clinical trial to assess the efficacy of sodium benzoate as an adjunctive treatment in early psychosis
Trials volume 20, Article number: 203 (2019)
The Study protocol to this article has been published in Trials 2017 18:165
CADENCE-BZ is a multi-centre, parallel-group, double-blind randomized controlled trial designed to examine the clinical efficacy and safety of an accessible food preservative, sodium benzoate, as an add-on treatment for patients with early psychosis. The original study protocol was published in 2017. Here, we describe the updated protocol along with the Statistical Analysis Plan (SAP) for the CADENCE-BZ trial prior to study completion.
Methods and materials
Two important changes were made to the original protocol: (1) improvements to our statistical analysis plan permitted a reduction in sample size; and (2) a revision in the secondary outcomes with the intent of reducing redundancy and excluding those measures that were not appropriate as outcomes.
We provide the updated SAP prior to the completion of the study with the intent of increasing the transparency of the data analyses for CADENCE-BZ. The final participants are currently completing the study and the results will be published in the near future.
Australian New Zealand Clinical Trials Registry (ACTRN12615000187549). Registered on 26th February 2015.
This paper provides the detailed statistical analysis plan (SAP) and outlines changes to the CADENCE–BZ study protocol. The original detailed protocol has been previously published . CADENCE-BZ is a multi-centre, parallel-group, double-blind randomized controlled trial designed to examine the clinical efficacy and safety of an accessible food preservative, sodium benzoate, as an add-on treatment for patients with early psychosis. The trial was approved by the Metro South Hospital and Health Services Human Research Ethics Committee (HREC reference number HREC/14/QPAH/598). The primary objective was to determine if 12-week treatment with 1000 mg (500 mg twice daily (BD)) of sodium benzoate improves the Positive and Negative Syndrome Scale (PANSS) total score  compared to placebo.
The last participant was recruited in August 2018 with the final follow-up visit anticipated to be completed in October 2018. This protocol update and SAP were written to prevent outcome reporting bias , selective reporting , and data-driven results.
Revised secondary outcomes
Eleven outcomes were listed in the original study protocol. This includes the primary outcome, the PANSS total score, and the secondary outcomes: (1) the Global Assessment of Functioning (GAF), (2) the Clinical Global Impression (CGI), (3) the Hamilton Depression Rating Scale (HDRS), (4) the Assessment of Quality of Life (AQoL), (5) the Opiate Treatment Index (OTI), (6) the Activity and Participation Questionnaire (APQ-6), (7) the International Physical Activity Questionnaire (IPAQ), (8) the Simple Physical Activity Questionnaire (SIMPAQ), (9) the Physical Activity Questionnaire (PAQ), and (10) the Patient Global Impression (PGI-I).
The following secondary outcomes will be excluded from the protocol: (i) APQ6, which is a measure of vocational activity and community participation—no studies have demonstrated the APQ6 has sensitivity to change . By contrast, the AQoL, a 12-item measure of functioning and quality of life which was included in the original protocol, was used previously in a study of sodium benzoate in participants with chronic schizophrenia . As both the AQoL and the APQ6 measure similar domains, it was decided to exclude the APQ6. (ii) IPAQ, SIMPAQ, PAQ—these three scales measure physical activity and were only collected at baseline. They are therefore unable to be used as outcomes and have thus been excluded. (iii) The Opiate Treatment Index (OTI) is a comprehensive evaluation tool that assesses drug and alcohol use over the previous month. Drug and alcohol use were considered as confounding variables rather than outcomes and the OTI was therefore excluded.
Updated sample size and power
Our original sample size was based on two-sample t-test and utilised the conservative assumptions that there are few or no correlations between the baseline and follow-up measures, and that there are perfect correlations between follow-up measures . Our sample size was reduced from 160 to 100 after we adjusted our SAP. We recalculated our sample size by revising our assumptions regarding the correlations for a variety of covariance structures and the number of repeated measures. This strategy has advantages from an ethical perspective (i.e., fewer patients need to be randomized, less exposure to potential adverse events or lack of efficacy) and with regard to cost-effectiveness (the study can be completed earlier). Using a two-tailed test with alpha set at 0.05 and 90% power, to detect a minimum clinical meaningful difference in total PANSS score of at least 5 units (SD = 14.3) between both treatment arms, we determined that we needed a sample of 39 persons in each group. This assumes the correlation between baseline and follow-up measurements is at least 0.6 and the correlation between various follow-up measurements is at most 0.5. Over a 12-week period, we predicted an attrition rate of 20%. Thus, we revised our sample size down to randomize 100 subjects and this amendment was recorded in the Australian New Zealand Clinical Trials Registry.
Statistical analysis plan
Data analysis and reporting
Data analysis and reporting will be done in accordance to the CONSORT guideline . The CONSORT diagram comprising the number of participants who were screened, eligible, randomized, receiving their allocated treatment, withdrawn from/lost to follow-up along with reasons will be provided. All statistical tests will be carried out at the 5% (two-sided) significance level unless otherwise specified. Estimates along with 95% confidence intervals and associated p values will be reported. All analysis will be carried out using the SAS software version 9.4. Other software such as R may be used if required.
Definition of intention-to-treat and per-protocol population
The analysis will be performed based on intention-to-treat. This will include all randomized participants who complied with the study protocol through the duration of the clinical trial, as well as participants who deviated from the study protocol. We defined treatment compliance as the average number of pills taken per day divided by daily protocol dosage (in this case, two pills per day). The analysis will be performed in the per-protocol population by including participants (1) that stayed on the trial for 12 weeks and (2) whose treatment compliance was ≥ 80% (3) with absence of major protocol violation.
A recent simulation study has revealed that mixed-effects model repeated measures (MMRM) analysis is robust in maintaining statistical properties of a test when compared to the multiple imputation method in handling missing values , assuming that participants dropping out of the study is unrelated to outcome conditioned on the study covariates (missing at random assumption). We will not be imputing missing data in the study outcomes.
Comparison of characteristics at baseline
Comparisons of participants at baseline will be undertaken for the outcome measures and for the following characteristics: sex, age, living situation, waist circumference, height, blood pressure, and body mass index. Continuous data will be summarized by means and standard deviation. Categorical data will be summarized by number and percentages. Significant test (χ2, t-test) will be computed to compare both treatment groups for each baseline characteristic. These baseline characteristics will be included as a covariate in the multivariable analysis to account for any imbalance that may have occurred by chance between the treatment groups. It is recommended that these variables are adjusted in assessing the primary outcome [10, 11].
Analysis of primary outcome
The primary outcome measure is the total score of PANSS. Primary outcome will be analysed using MMRM . We will include treatment group, week, and treatment–week interaction as fixed effects and intercept as random effects in the model. We will use the first order autoregressive (AR) as the covariance structure of the MMRM model. The AR structure has the following characteristics: (1) it has homogenous variances and correlations that decline exponentially with time (i.e., two measurements that are in closer proximity in time are more strongly correlated (conditioned on ρ) than those that are more distant in time); and (2) it is appropriate when time periods are evenly spaced. We will also examine the residual to assess model assumptions and goodness-of-fit.
Analysis of secondary outcomes
Table 1 provides a summary of methods of analysis for each secondary outcome. We will use the Bonferroni method  to appropriately adjust for the overall level of significance for multiple secondary outcomes. There are no pre-planned subgroup analyses.
The number of treatment-related adverse events (AE) and serious adverse events (SAE) will be reported by their relationship as ‘definitely’, ‘probably’, and ‘possibly’ related to treatment. The number (and percentage) of participants with each AE/SAE will be presented for each treatment arm categorised by (1) preferred term (2), body system, (3) severity. The number (and percentage) of occurrences of each AE/SAE will also be presented for each treatment arm. No formal statistical testing will be undertaken.
This update contains the SAP for the CADENCE-BZ trial to avoid the risk of outcome reporting bias and data-driven results. By publishing this where we pre-specify our methods and analyses, it is hoped that the results will be as robust and transparent as possible.
Assessment of Quality of Life
- AR (1):
First order autoregressive
Clinical Global Impression (CGI)
Consolidated standards of reporting trials
Global Assessment of Functioning
Generalized linear mixed model
Hamilton Depression Rating Scale
International Physical Activity Questionnaire
Mixed-effects model repeated measures
Opiate Treatment Index
Positive and Negative Syndrome Scale
Physical Activity Questionnaire
Patient global impression
Statistical analysis plan
Statistical analysis system
Simple Physical Activity Questionnaire
Ryan A, Baker A, Dark F, et al. The efficacy of sodium benzoate as an adjunctive treatment in early psychosis - CADENCE-BZ: study protocol for a randomized controlled trial. Trials. 2017;18:165.
Kay SR, Fiszbein A, Opler LA. The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13:261–76.
Ioannidis JP, Caplan AL, Dal-Ré R. Outcome reporting bias in clinical trials: why monitoring matters. BMJ. 2017;356:j408.
Jones CW, Keil LG, Holland WC, et al. Comparison of registered and published outcomes in randomized controlled trials: a systematic review. BMC Med. 2015;13:282.
Coombs T, Nicholas A, Pirkis J. A review of social inclusion measures. Aust N Z J Psychiatry. 2013;47:906–19.
Lane HY, Lin CH, Green MF, et al. Add-on treatment of benzoate for schizophrenia: a randomized, double-blind, placebo-controlled trial of D-amino acid oxidase inhibitor. JAMA Psychiatry. 2013;70:1267–75.
Morgan TM, Case LD. Conservative sample size determination for repeated measures analysis of covariance. Ann Biom Biostat. 2013;1:1002.
Schulz KF, Altman DG, Moher D, et al. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med. 2010;7:e1000251.
Siddiqui O. MMRM versus MI in dealing with missing data--a comparison based on 25 NDA data sets. J Biopharm Stat. 2011;21:423–36.
Steyerberg EW, Bossuyt PM, Lee KL. Clinical trials in acute myocardial infarction: should we adjust for baseline characteristics? Am Heart J. 2000;139:745–51.
Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869
Detry MA, Ma Y. Analyzing repeated measurements using mixed models. JAMA. 2016;315:407–8.
Armstrong RA. When to use the Bonferroni correction. Ophthalmic Physiol Opt. 2014;34:502–8.
We acknowledge contributions from members of the Cadence Working Group: Justin Chapman, Susan Patterson, Saveena Singh, Bryan Mowry, Linda Tracy, Michael Duhig, Amy Machin, Elizabeth Troman, Shuichi Suetani, Thomas Dinala, Lucinda Burton, Peter Cosgrove and Clare Gamble. We also acknowledge the support of Alison Bowers (West Moreton Human Research Ethics Committee) and Rebecca Lacey (Metro South Human Research Ethics Committee).
JJM received the John Cade Fellowship APP1056929 from the National Health and Medical Research Council and the Niels Bohr Professorship from the Danish National Research Foundation. JGS is supported by a National Health and Medical Research Council Practitioner Fellowship (Grant APP1105807). MB is supported by a NHMRC Senior Principal Research Fellowship (1059660 and 1156072).
Availability of data and materials
No additional data available.
Ethics approval and consent to participate
This amendment to the statistical analysis was approved by the Metro South Human Research Ethics Committee and by the independent Data Safety Monitoring Board established for the conduct of the trial. The trial was funded by the National Health and Medical Research Council (NHMRC) John Cade Fellowship APP1056929 who did not require us to submit a protocol. The NHMRC are updated of the study progress in annual progress reports of the studies. Consent was not applicable for this amendment.
Consent for publication
MB has received grant support from NIH, Simons Autism Foundation, Cancer Council of Victoria, CRC for Mental Health, Stanley Medical Research Foundation, MBF, NHMRC, Beyond Blue, Geelong Medical Research Foundation, Bristol Myers Squibb, Eli Lilly, GlaxoSmithKline, Organon, Novartis, Mayne Pharma, and Servier. MB has been a speaker for Astra Zeneca, Bristol Myers Squibb, Eli Lilly, GlaxoSmithKline, Janssen Cilag, Lundbeck, Merck, Pfizer, Sanofi Synthelabo, Servier, and Solvay and Wyeth and served as a consultant to Astra Zeneca, Bristol Myers Squibb, Eli Lilly, GlaxoSmithKline, Janssen Cilag, Lundbeck, and Servier. JGS has served on advisory boards of Roche, Lundbeck, Otsuka, and Janssen Cilag. JGS has been a speaker for Lundbeck, Otsuka, Servier, and Janssen Cilag. OMD is a R.D. Wright NHMRC Biomedical Research Fellow and has received grant support from the Brain and Behavior Foundation, Simons Autism Foundation, Stanley Medical Research Institute, Deakin University, Lilly, NHMRC, and ASBDD/Servier. She has also received kind support from BioMedica Nutracuticals, NutritionCare, and Bioceuticals. FD has no conflict of interest for this protocol but she received honoraria from Lundbeck and Janssen in the last 2 years. The other authors have no conflicts to declare.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Lim, C., Baker, A., Saha, S. et al. Protocol update and statistical analysis plan for CADENCE-BZ: a randomized clinical trial to assess the efficacy of sodium benzoate as an adjunctive treatment in early psychosis. Trials 20, 203 (2019) doi:10.1186/s13063-019-3232-8
- Statistical analysis plan
- Early psychosis
- Randomized clinical trial
- Sodium benzoate