Update on the Preventive Antibiotics in Stroke Study (PASS): a randomised controlled phase 3 clinical trial
Trials volume 15, Article number: 133 (2014)
Stroke is a leading cause of death worldwide. Infections after stroke occur in 30% of stroke patients and are strongly associated with unfavourable outcome. Preventive antibiotic therapy lowers infection rate in patients after stroke, however, the effect of preventive antibiotic treatment on functional outcome after stroke has not yet been investigated.The Preventive Antibiotics in Stroke Study (PASS) is an ongoing, multicentre, prospective, randomised, open-label, blinded end point trial of preventive antibiotic therapy in acute stroke. Patients are randomly assigned to either ceftriaxone at a dose of 2 g, given every 24 hours intravenously for four-days, in addition to stroke-unit care, or standard stroke-unit care without preventive antibiotic therapy. Aim of the study is to assess whether preventive antibiotic treatment improves functional outcome at three months by preventing infections.
To date, 2,470 patients have been included in PASS. Median stroke severity of the first 2,133 patients (second interim analysis) is 5 (IQR 3 to 9) on the National Institutes of Health Stroke Scale (NIHSS). Due to the PROBE design, no outcome data are available yet. In the initial trial protocol we proposed a dichotomisation of the mRS as primary analysis of outcome and ordinal regression analysis as secondary analysis of primary outcome, requiring a sample size of 3,200 patients. However, ordinal analysis of outcome data is becoming increasingly more common in acute stroke trials, as it increases statistical power. For PASS, funding is insufficient for inclusion of 3,200 patients with the overall inclusion rate of 15 patients per week. Therefore we change the analysis of our primary outcome from dichotomisation to ordinal regression analysis on the mRS. Power analysis showed that with similar assumptions 2,550 patients are needed using ordinal regression analysis. We expect to complete follow-up in June 2014. A full statistical analysis plan will be submitted for publication before treatment allocation will be unblinded.
The data from PASS will establish whether preventive antibiotic therapy in acute stroke improves functional outcome by preventing infection. In this update, we changed our primary outcome analysis from dichotomisation to ordinal regression analysis.
Current controlled trials; ISRCTN66140176. Date of registration: 6 April 2010.
Preventive Antibiotics in Stroke Study (PASS)
Stroke is a leading cause of death worldwide. Infections after stroke occur in 30% of stroke patients and are strongly associated with unfavourable outcome [1, 2]. Preventive antibiotic therapy lowers infection rate in patients after stroke; however, the effect of preventive antibiotic treatment on functional outcome after stroke has not yet been investigated [3, 4].
The aim of PASS is to investigate whether preventive use of the antibiotic ceftriaxone improves functional outcome in patients with stroke. PASS is an ongoing, multicentre Prospective, Randomised, Open-label, Blinded End point trial (PROBE) of standard care with preventive ceftriaxone treatment which is compared with standard care without preventive ceftriaxone. Adult patients with stroke (both ischaemic and haemorrhagic) and a score ≥ 1 on the National Institutes of Health Stroke Scale will be included. Patients are randomly assigned to either ceftriaxone at a dose of 2 g, given every 24 hours intravenously for four-days, in addition to stroke-unit care, or standard stroke-unit care without preventive antibiotic therapy. All items from the World Health Organization Trial Registration Data Set are shown in Table 1. For description of the entire study protocol, including study procedures and data collection, assessment of infections and outcomes, allocation and blinding procedures, we refer to the initial trial protocol publication . Changes to the protocol since the first version are shown in Table 2. Medical-ethical approval of the protocol and amendments was obtained by the medical ethical committee of the AMC. All participating centres are shown in Table 3.
The primary end point of the PASS is functional outcome at three-month follow-up on the modified Rankin Scale (mRS), a well-validated functional outcome scale in stroke patients . In the protocol publication, the primary efficacy end point has been defined as the functional outcome at the three-month follow-up, as assessed by the mRS dichotomised as a favourable outcome (mRS 0 to 2) or as an unfavourable outcome (mRS 3 to 6). The proportional odds model was defined as the secondary analysis of the primary end point . Secondary outcome measures were death rate at discharge and three-months, infection rate during hospital admission, length of hospital admission, volume of post-stroke care, use of antibiotics during follow-up, Quality-adjusted life years (QALYs); and costs. In this update publication of PASS, we change our primary outcome analysis from dichotomisation to ordinal regression analysis on the mRS. We also change the secondary outcome of use of antibiotics during follow-up into use of antibiotics during hospital stay.
Change in primary analysis of primary outcome and adaptation of sample size
The modified Rankin Scale is a well-validated functional scale for assessing outcome after stroke. Analysis on a dichotomisation in favourable versus unfavourable outcome delivers easily comprehensible results. However, cut-off is arbitrarily and solely based on improvement beyond this one cut-off point. A secondary analysis including 55 datasets of stroke trials showed that statistical analysis based on the ordered nature of functional outcome data versus dichotomisation was more efficient and more likely to deliver reliable results . Although there were some annotations regarding this publication, more and more studies are using ordinal regression analysis [8–10].
In the design of PASS, both dichotomisation and ordinal regression analysis were described as analysis of the primary outcome . We based our initial sample size calculation on the dichotomised outcome (favourable versus unfavourable outcome). Dichotomisation was chosen as primary analysis of efficacy because of the widespread use in stroke trials [5, 11]. However, trial completion will take an unrealistically long time with excessive costs with the current inclusion rate of 15 patients per week. Therefore, we now propose a switch in primary analysis of the primary outcome using an ordinal outcome analysis. The primary outcome will remain to be assessed on the mRS. The primary outcome with dichotomisation will be presented as secondary analysis of primary outcome. Using ordinal regression analysis for PASS enables us to preserve the assumptions of the strength of the treatment effect with a lower total sample size.
We based our initial sample size calculation on the dichotomised outcome (favourable versus unfavourable outcome). With the assumption of reduction of unfavourable outcome of 5%, with a power of 80% and P-value of 0.05, we aimed to include 3,200 patients.
We now propose a new sample size of 2,550 patients, which is based on the ordinal regression analysis of the primary outcome. For this analysis we will use the ‘proportional odds model’, also known as the ‘cumulative logit model’ . The assumption for the distribution on mRS in the control-arm is based on the control-arm in the Paracetamol (Acetaminophen) In Stroke (PAIS) trial, which had almost similar inclusion criteria as PASS . We assumed a proportional odds ratio of 0.818 between all pairs of category groups, similar to the assumption in the original sample size calculation (odds ratio of 0.818 for mRS 0 to 2 versus mRS 3 to 6). Figure 1 shows the expected distribution of the two treatment arms. Using the method of Whitehead, with alpha 0.05 and power 80%, the desired sample size in the proportional odds model is estimated at a total of 2,410 patients . Given an expected rate of patients lost to follow-up and/or patients with incomplete data of 5%, a conservative estimate for the new sample size with the primary end point analysed on all categories of the mRS is 2,531 patients. We will therefore adapt the sample size to 2,550 patients; a reduction of 650 patients compared to the original sample size estimate based on a dichotomous outcome on the mRS. This decision has been made by the researchers without any knowledge of outcome data per treatment group.
By 12 February 2014, 2,470 patients were included in the PASS. Up-to-date statistics can be found at http://www.passamc.nl. With a stable weekly inclusion rate of 15 patients, follow-up of the last included patient is expected in June 2014.
Definitions of infection
Infection rate during hospital admission will be assessed in two ways. First, clinical diagnosis according to the treating physician will be recorded. Second, diagnosis of infection will be judged by two experienced infectious diseases specialists, blinded for treatment allocation, using the modified criteria of the United States Centres for Disease Control and Prevention . This will be done in all patients who developed fever or a new onset delirium during admission, in patients in whom there was suspicion of infection but no diagnostics were performed, and in patients in a palliative care setting. One important issue that needs to be addressed is the risk of performance and detection bias. Since the treating physician is aware of the treatment allocation, this could influence decisions on non-scheduled treatment. For the PASS, the most important issue to address is the detection and treatment of infection. A physician could be more or less likely to order investigations or start treatment for a possible infection depending on the treatment allocation. By giving recommendations for diagnostic procedures in the previously mentioned subgroups of patients, and by collecting results of these procedures in standardized case record forms, we try to limit this form of bias.
Monitoring of antibiotic resistance
One of the most important mechanisms of resistance against third generation cephalosporins is forming of extended-spectrum-β-lactamase (ESBL), an enzyme that renders antibiotics ineffective, in Enterobacteriaceae. In our study we monitor the prevalence of ESBL-producing bacteria in both treatment arms. We therefore collect stool specimens at admission and discharge in a subgroup of patients. To date, samples have been obtained in 300 patients.
Development of the statistical analysis plan
Currently, the statistical analysis plan is being finalised, without insight in to the unblinded data. It will be published before the randomisation code is broken in late 2014. The statistical analysis plan describes the analysis of primary outcome with ordinal regression analysis and a secondary dichotomised analysis into detail. It also describes a small number of prespecified subgroup analyses, and a larger number of exploratory secondary analyses, that will be performed, as well as treatment of missing values.
The PASS aims to investigate whether preventive antibiotic therapy improves functional outcome by preventing infections. The results of a trial examining the effect of preventive antibiotic therapy on functional outcome are urgently warranted. Infection after stroke is common and infection has repeatedly been shown to worsen outcome [1, 2, 16, 17]. Since previous studies on preventive antibiotic therapy were too small, heterogeneous, or did not investigate functional outcome, no sufficient information is available on the role of preventive antibiotic therapy in acute stroke .
With this update of the protocol, we present a change in primary analysis of the primary outcome on the mRS from a dichotomised analysis to an ordinal regression analysis. Ordinal analysis of outcome data is increasingly common in acute stroke trials as well as in other trials, for example on traumatic brain injury [7, 18]. Data is used more efficiently with ordinal analysis as compared to a dichotomised analysis. For example the ECASS-II trial failed to show an effect of treatment in the dichotomised approach, but did show an affect with ordinal shift analysis .
Different approaches can be used for the analysis of ordinal outcome data. In the PASS we chose the ordinal regression analysis as primary analysis of outcome, which was already described as a secondary analysis of primary outcome in the original protocol. The proportional odds model provides additional information from ordinal outcome data, as it takes into account improvements at any point on the mRS . This method is highly efficient when compared to a dichotomised approach, but also when compared to other ordinal approaches . A possible disadvantage of this approach is the assumption of proportional odds across all groups. In PASS, we chose this method because we expected a similar effect of preventive antibiotic treatment across all outcomes, and therefore expect to meet the assumptions of the proportional odds model.
With the new sample size of 2,550 patients we expect completion of inclusion of patients in PASS in June 2014.
Academic Medical Centre
extended-spectrum-β-lactamase, mRS, modified Rankin Scale
National Institutes of Health Stroke Scale
Preventive Antibiotics in Stroke Study
Prospective, Randomised, Open-label, Blinded End point
serious adverse event
suspected unexpected serious adverse reaction.
Vermeij FH, op Reimer WJ S, de MP, Van Oostenbrugge RJ, Franke CL, de Jong G, de Kort PL, Dippel DW, Netherlands Stroke Survey Investigators: Stroke-associated infection is an independent risk factor for poor outcome after acute ischemic stroke: data from the Netherlands Stroke Survey. Cerebrovasc Dis. 2009, 27: 465-471. 10.1159/000210093.
Westendorp WF, Nederkoorn PJ, Vermeij JD, Dijkgraaf MG, van de Beek D: Post-stroke infection: a systematic review and meta-analysis. BMC Neurol. 2011, 11: 110-10.1186/1471-2377-11-110.
van de Beek D, Wijdicks EF, Vermeij FH, de Haan RJ, Prins JM, Spanjaard L, Dippel DW, Nederkoorn PJ: Preventive antibiotics for infections in acute stroke: a systematic review and meta-analysis. Arch Neurol. 2009, 66: 1076-1081.
Westendorp WF, Vermeij JD, Vermeij F, den Hertog HM, Dippel DW, van de Beek D, Nederkoorn PJ: Antibiotic therapy for preventing infections in patients with acute stroke. Cochrane Database Syst Rev. 2012, 1: CD008530-
Nederkoorn PJ, Westendorp WF, Hooijenga IJ, de Haan RJ, Dippel DW, Vermeij FH, Dijkgraaf MG, Prins JM, Spanjaard L, van de Beek D: Preventive antibiotics in stroke study: rationale and protocol for a randomised trial. Int J Stroke. 2011, 6: 159-163. 10.1111/j.1747-4949.2010.00555.x.
Banks JL, Marotta CA: Outcomes validity and reliability of the modified Rankin scale: implications for stroke clinical trials: a literature review and synthesis. Stroke. 2007, 38: 1091-1096. 10.1161/01.STR.0000258355.23810.c6.
Bath PM, Gray LJ, Collier T, Pocock S, Carpenter J: Can we improve the statistical analysis of stroke trials? Statistical reanalysis of functional outcomes in stroke trials. Stroke. 2007, 38: 1911-1915.
Anderson CS, Heeley E, Huang Y, Wang J, Stapf C, Delcourt C, Lindley R, Robinson T, Lavados P, Neal B, Hata J, Arima H, Parsons M, Li Y, Wang J, Heritier S, Li Q, Woodward M, Simes RJ, Davis SM, Chalmers J, INTERACT2 Investigators: Rapid blood-pressure lowering in patients with acute intracerebral hemorrhage. N Engl J Med. 2013, 368: 2355-2365. 10.1056/NEJMoa1214609.
den Hertog HM, van der Worp HB, van Gemert HM, Algra A, Kappelle LJ, van Gijn J, Koudstaal PJ, Dippel DW, PAIS Investigators: Correction: PAIS: paracetamol (acetaminophen) in stroke; protocol for a randomized, double blind clinical trial. BMC Cardiovasc Disord. 2008, 8: 29-10.1186/1471-2261-8-29. ISCRTN74418480
Miller SW, Palesch YY: Comments regarding the recent OAST article. Stroke. 2008, 39: e14-10.1161/STROKEAHA.107.500355.
Hofmeijer J, Kappelle LJ, Algra A, Amelink GJ, van GJ, van der Worp HB: Surgical decompression for space-occupying cerebral infarction (the Hemicraniectomy After Middle Cerebral Artery infarction with Life-threatening Edema Trial [HAMLET]): a multicentre, open, randomised trial. Lancet Neurol. 2009, 8: 326-333. 10.1016/S1474-4422(09)70047-X.
Ananth CV, Kleinbaum DG: Regression models for ordinal responses: a review of methods and applications. Int J Epidemiol. 1997, 26: 1323-1333. 10.1093/ije/26.6.1323.
den Hertog HM, van der Worp HB, van Gemert HM, Algra A, Kappelle LJ, van Gijn J, Koudstaal PJ, Dippel DW, PAIS Investigators: The Paracetamol (Acetaminophen) In Stroke (PAIS) trial: a multicentre, randomised, placebo-controlled, phase III trial. Lancet Neurol. 2009, 8: 434-440. 10.1016/S1474-4422(09)70051-1.
Whitehead J: Sample size calculations for ordered categorical data. Stat Med. 1993, 12: 2257-2271. 10.1002/sim.4780122404.
Horan TC, Andrus M, Dudeck MA: CDC/NHSN surveillance definition of health care-associated infection and criteria for specific types of infections in the acute care setting. Am J Infect Control. 2008, 36: 309-332. 10.1016/j.ajic.2008.03.002.
Katzan IL, Cebul RD, Husak SH, Dawson NV, Baker DW: The effect of pneumonia on mortality among patients hospitalized for acute stroke. Neurology. 2003, 60: 620-625. 10.1212/01.WNL.0000046586.38284.60.
Kwan J, Hand P: Infection after acute stroke is associated with poor short-term outcome. Acta Neurol Scand. 2007, 115: 331-338.
McHugh GS1, Butcher I, Steyerberg EW, Marmarou A, Lu J, Lingsma HF, Weir J, Maas AI, Murray GD: A simulation study evaluating approaches to the analysis of ordinal outcome data in randomized controlled trials in traumatic brain injury: results from the IMPACT project. Clin Trials. 2010, 7: 44-57. 10.1177/1740774509356580.
Savitz SI, Lew R, Bluhmki E, Hacke W, Fisher M: Shift analysis versus dichotomization of the modified Rankin scale outcome scores in the NINDS and ECASS-II trials. Stroke. 2007, 38: 3205-3212. 10.1161/STROKEAHA.107.489351.
The PASS study was funded by the Academic Medical Centre (AMC), by the Netherlands Organisation for Health Research and Development (ZonMW; 171002302) and the Netherlands Heart Foundation (Hartstichting; 2009B095). Principal investigators of the PASS are Dr. PJ Nederkoorn and Professor D van de Beek. DvdB is supported by grants from the European Research Council (ERC Starting Grant (Proposal/Contract number 281156)), Netherlands Organization for Health Research and Development (ZonMw; NWO-Vidi grant 2010 (Proposal/Contract number 016.116.358)). The study group comprises Professor DWJ Dippel; Dr. MGW Dijkgraaf; Professor JM Prins; Dr. L Spanjaard; Professor T van der Poll; Dr. FH Vermeij. Two PhD students working on the PASS are Dr. WF Westendorp and Dr. J-D Vermeij. Trial manager and nurses are Drs. IJ Hooijenga, AG de Jong and I Stijnman– Moerman.
Thirty Dutch hospitals participate in the PASS; all centres with local investigators are shown in Table.
The data safety monitoring committee (DSMB) is formed by: GJ Hankey, MD, PhD, Consultant Neurologist, Head of Stroke Unit, Department of Neurology, Royal Perth Hospital, Australia (chair); A Algra, MD, PhD, Clinical Epidemiologist, Julius Centre and Department of Neurology, UMC Utrecht, the Netherlands; MJM Bonten, MD, PhD, Microbiologist, Department of Medical Microbiology and Julius Centre, University Medical Centre Utrecht, Utrecht, the Netherlands. Advisory Board of the PASS consists of Professor M Vermeulen, Department of Neurology, AMC Amsterdam, and Professor RJ de Haan, Clinical Research Unit, AMC Amsterdam. We like to thank Professor P Sandercock, Department of Clinical Neurosciences, Western General Hospital, Edinburgh, for advising us with the design of the current protocol update.
All authors declare not to have any competing interests.
WFW, JDV performed conception and design of the work and drafted the work. PJN and DvdB performed conception and design of the work and revised it critically for important intellectual content. NG performed the statistical analysis for this paper and revised it critically. DWJD, MGWD, TvdP, JMP, LS, FHV were involved in design of the work, and revised it critically for intellectual content. All authors approved the final version.
Willeke F Westendorp, Jan-Dirk Vermeij, Paul J Nederkoorn and Diederik van de Beek contributed equally to this work.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Westendorp, W.F., Vermeij, JD., van Geloven, N. et al. Update on the Preventive Antibiotics in Stroke Study (PASS): a randomised controlled phase 3 clinical trial. Trials 15, 133 (2014). https://doi.org/10.1186/1745-6215-15-133