Skip to content


  • Poster presentation
  • Open Access

Challenges in the design and analysis of a factorial-design cluster randomised trial

  • 1,
  • 3,
  • 2,
  • 1,
  • 2 and
  • 3, 4
Trials201516 (Suppl 2) :P149

  • Published:


  • Multilevel Model
  • Generalise Linear Mixed Model
  • Intensive Care Patient
  • Cluster Randomise Trial
  • Intervention Effect Estimate


Optimising sedation quality in mechanically ventilated intensive care patients is important because excessive sedation is associated with increased hospital acquired infections, longer intensive care (ICU) and hospital stay, and possibly higher mortality. The Development and Evaluation of Strategies to Improve Sedation Quality in InTensive Care (DESIST) study aims to optimise sedation practice. Here we focus on the study design, statistical analysis plan, performing the analysis and issues that occurred. DESIST randomised eight ICUs in pairs to four different combinations of sedation-related quality improvement interventions. The primary outcome assessed optimum sedation within each 12 hour nursing shift (referred to as a DESIST care period). This resulted in a three-level hierarchical data structure: DESIST care periods within admissions, within ICU.


The detailed analysis plan specified a generalised linear mixed model for the analysis of the primary outcome. Due to the complex hierarchical data structure, we used MLwiN which is specifically designed for the analysis of multilevel models. We will illustrate the use of the STATA runmlwin command which allows MLwiN to be run from within STATA.

Modelling ICU as both a fixed and random effect resulted in difficulties in model convergence and estimating the ICU level variance. There was non-normality of residuals and high auto-correlation within MCMC chains.


The small number of ICUs and lack of evidence of ICU-level clustering caused difficulties in fitting the three-level multilevel model. Fitting a simpler two-level model was feasible, gave similar intervention effect estimates and was justified by the lack of ICU-level clustering.

Authors’ Affiliations

Edinburgh Clinical Trials Unit, University of Edinburgh, Edinburgh, UK
Anaesthetics, Critical Care and Pain Medicine, University of Edinburgh, Edinburgh, UK
Centre for Population Health Sciences, University of Edinburgh, Edinburgh, UK
Edinburgh Health Services Research Unit, Edinburgh, UK


© Stephen et al. 2015

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.


By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.