Skip to content


  • Poster presentation
  • Open Access

The potential of the multivariate multilevel model for analysing correlated multiple outcomes: a simulation study

  • 1, 2,
  • 1 and
  • 1
Trials201516(Suppl 2):P151

Published: 16 November 2015


  • Small Sample Size
  • Intervention Effect
  • Primary Outcome
  • Repeated Measure
  • Simulation Study

In clinical trials, multiple primary outcomes are often needed to assess the effectiveness of an intervention as a single primary outcome can be insufficient to describe all aspects of a complex disorder. These outcomes are often correlated. Many procedures for addressing multiple outcomes have been introduced; however, most of the commonly used methods do not make use of the correlations among the outcomes. The multivariate multilevel model (MMM) can be used to analyse multiple primary outcomes. The MMM views multiple outcomes as repeated measures clustered within individuals, consequently, missing data is automatically taken into account through the correlations among the outcomes.

This simulation study assesses the type I error and power to detect true intervention effects when using the MMM compared to using a separate model for each outcome and performing appropriate adjustments to the p-values, including the Bonferroni, Holm, Hommel and Hochberg adjustments. Simulation scenarios include varying the number of outcomes, between outcome correlations, and the degree and pattern of missingness.

The simulation study shows that power gains can be obtained when using the MMM if the outcomes are correlated. Consequently, if the MMM is used, a smaller sample size may be required to obtain the required level of power. We are currently investigating the use of a combination of the MMM and another method to adjust the type I error to provide an optimal analysis. MMM shows potential, particularly when there is missing data (including missing not at random data).

Authors’ Affiliations

Department of Statistical Science, University College London, London, UK
Marie Curie Palliative Care Research Department, University College London, London, UK


© Vickerstaff et al. 2015

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.


By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.