Flexible trial design in practice - stopping arms for lack-of-benefit and adding research arms mid-trial in STAMPEDE: a multi-arm multi-stage randomized controlled trial
© Sydes et al.; licensee BioMed Central Ltd. 2012
Received: 9 March 2012
Accepted: 16 August 2012
Published: 15 September 2012
Systemic Therapy for Advanced or Metastatic Prostate cancer: Evaluation of Drug Efficacy (STAMPEDE) is a randomized controlled trial that follows a novel multi-arm, multi-stage (MAMS) design. We describe methodological and practical issues arising with (1) stopping recruitment to research arms following a pre-planned intermediate analysis and (2) adding a new research arm during the trial.
STAMPEDE recruits men who have locally advanced or metastatic prostate cancer who are starting standard long-term hormone therapy. Originally there were five research and one control arms, each undergoing a pilot stage (focus: safety, feasibility), three intermediate ‘activity’ stages (focus: failure-free survival), and a final ‘efficacy’ stage (focus: overall survival). Lack-of-sufficient-activity guidelines support the pairwise interim comparisons of each research arm against the control arm; these pre-defined activity cut-off becomes increasingly stringent over the stages. Accrual of further patients continues to the control arm and to those research arms showing activity and an acceptable safety profile. The design facilitates adding new research arms should sufficiently interesting agents emerge. These new arms are compared only to contemporaneously recruited control arm patients using the same intermediate guidelines in a time-delayed manner. The addition of new research arms is subject to adequate recruitment rates to support the overall trial aims.
(1) Stopping Existing Therapy: After the second intermediate activity analysis, recruitment was discontinued to two research arms for lack-of-sufficient activity. Detailed preparations meant that changes were implemented swiftly at 100 international centers and recruitment continued seamlessly into Activity Stage III with 3 remaining research arms and the control arm. Further regulatory and ethical approvals were not required because this was already included in the initial trial design.
(2) Adding New Therapy: An application to add a new research arm was approved by the funder, (who also organized peer review), industrial partner and regulatory and ethical bodies. This was all done in advance of any decision to stop current therapies.
The STAMPEDE experience shows that recruitment to a MAMS trial and mid-flow changes its design are achievable with good planning. This benefits patients and the scientific community as research treatments are evaluated in a more efficient and cost-effective manner.
First patient into trial: 17 October 2005
First patient into abiraterone comparison: 15 November 2011
KeywordsNovel design Multi-arm multi-stage design Implementation Prostate cancer Methodology Randomized controlled trial
Multi-arm multi-stage trials
Adaptive clinical trials are increasingly discussed and presented. The multi-arm, multi-stage (MAMS) design [1, 2] is one example of a flexible, seamless phase II/III randomized controlled trial. Detail on the general rationale for the MAMS design has been published elsewhere , but in brief, this approach allows for several research approaches to be assessed simultaneously against a common control group. Accrual resources are directed away from arms that show either insufficient activity on an intermediate primary outcome measure or unacceptable toxicity so that recruitment becomes increasingly focused towards the more promising research arms and the control arm. The MAMS design provides an efficient method for acquiring multi-agent prospective randomized data synchronously, requiring less time and needing fewer patients while simultaneously reducing the trial bureaucracy that is associated with a program of separate Phase II and Phase III trials. The MAMS approach thereby increases the likelihood of identifying one or more successful treatments in a single trial. It also decreases the likelihood of the whole trial stopping prematurely because the chance of multiple treatment approaches being insufficiently tolerated or ineffective is reduced.
The ability to add new research arms is an added advantage; initiating and conducting clinical trials remains resource-intensive and time-consuming both in terms of securing funding and gaining regulatory approval. The concept of adding new research arms within the context of an ongoing trial, thereby utilizing its existing machinery and recruitment base, is appealing. This can bring efficiencies in cost, personnel, and recruitment, leading to a reduction by many years in the time taken to initiate and recruit to the trial. This could further allow companies a longer period to generate profits within their patent.
The STAMPEDE trial
Rationale for publication
The methodological details of STAMPEDE’s design and the practical issues of initiating the trial have been published elsewhere , but here we report on ongoing trial logistics, discussing the early stopping of two trial arms after an intermediate lack-of-sufficient-activity analysis (often referred to as a ‘lack-of-benefit’ for short) and the activation of a new research arm.
Managing early stopping following lack-of-benefit analysis
Design parameters by trial stage for original research arms
Primary outcome measure
Target hazard ratio
One-sided Significance level
The intermediate analyses are triggered when a set number of events have been observed in the control arm. Focusing on the control arm in this way enables each analysis to be monitored and anticipated without revealing data on accumulating differences (or a lack of them) from the research arms. By considering the observed accrual rate and accumulating event rate in the control arm, it is possible to anticipate the time of the next intermediate analysis with reasonable precision. This can be calculated with the ARTPEP program (also available in Stata) . Therefore, the first step towards planning can easily be achieved, which facilitates the planning of when the Independent Data Monitoring Committee (IDMC) should meet to review the data.
A large proportion of agents are unsuccessful in phase III trials [11–13], so it can be reasonably anticipated that accrual to at least one research arm in a MAMS trial is likely to be stopped early. Therefore, actions can, and should be, planned in advance of any early stopping decision. The statistical design explicitly considers stopping for lack-of-benefit, but research arms can also be stopped for reasons of harm or toxicity. Plans for either contingency can therefore be developed in anticipation of either eventuality.
In the governance and oversight structure of STAMPEDE, the IDMC is advisory to a Trial Steering Committee (TSC), which has independent members (including the Chair) and representatives from the Trial Management Group (TMG), the latter being the committee responsible for the day-to-day running of the trial. The IDMC decides which accumulating data, if any, should be seen by the TSC executive when they next meet and also guides interpretation.
Before the first intermediate analysis, a joint meeting of the TSC and IDMC was held in which the design of the trial was reviewed and a number of hypothetical scenarios were considered, anticipating a number of different ‘results’ at the intermediate stages. The aim was to provoke discussion on what sort of decisions each committee might make when reviewing certain outcomes and what information the two committees could expect to see to make such recommendations and decisions.
A series of “what if…?” questions were considered months before the first intermediate activity analysis discussions were held within the trials unit and within the TMG about the actions and communications required before and after each intermediate analysis. These questions included the following: What if one arm was stopped for safety after a given review or was stopped for lack-of-benefit; what if more than one arm was halted and for the same or different reasons; and even, what if no changes were made?
Planned actions and timelines when accrual is stopped to trial arms
Notify sites in writing of IDMC meeting date to pre-warn
Circulate prior letter from regulatory agency confirming that stopping early for LOB is not a substantial amendment, but part of trial design
IDMC notes and recommendations finalised
TSC meeting: stop / continue decision for each research arm
Turn off randomisation to arms stopping early for safety
Notify centres by email; patients to ignore irrelevant parts of PIS
Notify relevant industry partners
Notify TMG members
Alert trials unit staff to potential queries
Phone all site PIs. Instructed to hand-amend PIS and CF. Updated documentation to follow
Protocol and documents updated and agreed by TMG
Summary information for patients
Notify ethics committee and regulatory agency (for information only)
Detailed discussions with industry partners
TMG review of processes
Many activities (Table 2) were planned to occur quickly after a TSC decision to stop recruitment to any arm. The planned timelines were the same for most activities, regardless whether stopping an arm for lack-of-benefit or toxicity; although the plans for notifying staff internally and turning off randomisation needed to be quicker in the instance of toxicity. The reason for this disparity in times is because it was anticipated that arms showing a lack-of-benefit could actually be showing a trend towards an advantage to the research arm, albeit an insufficiently large advantage to encourage recruitment of more patients to that comparison. For example, at the third intermediate analysis, the activity cut point is a hazard ratio of 0.89. Therefore, accrual may be stopped to an arm with a favorable hazard ratio of 0.90. In the absence of an overriding safety concern it was reasonable to allow a little more time to turn off allocation to such a treatment.
Notifications to the ethics committee(s) and the regulators were planned. Although no immediate protocol amendment would be required, it was decided that the protocol would be updated as soon as practicable after changes to study arms to simplify activities for sites. The Patient Information Sheets (PIS) would be updated immediately with removal of information that was no longer pertinent and sent to the ethics committee(s) for information.
The IDMC has met at least annually to review accumulating data. The data for the first formal intermediate activity analysis were frozen on 09 February 2010 with 1,424 patients randomized and 129 control-arm FFS events. The HR guideline cut point was 1.00. The review took place on 30 March 2010 by which time 1,518 patients had been randomized. The IDMC reviewed all data on the main outcome measures and recommended no changes.
The data for the second formal intermediate activity analysis were frozen on 01 February 2011 with 2,043 patients randomized and 209 control arm FFS events. The HR cut point was now 0.92. The IDMC meeting took place on 31 Mar 2011 by which time 2,163 patients had been randomized. The IDMC recommended that (i) the TSC see FFS data for both arms containing celecoxib and (ii) that no further patients be recruited to either celecoxib-containing arm. The detailed clinical findings are reported elsewhere [14, 15].
The TSC met on 06 April 2011 and approved the IDMC recommendations. They decided that (i) accrual should stop to both celecoxib-containing arms (D and F), following the lack-of-benefit guidelines; (ii) patients currently receiving celecoxib should be advised to stop celecoxib; (iii) comparative data celecoxib versus control arm (D versus A) should be shared with investigators; and (iv) data from the celecoxib plus zoledronic acid arm (F) should not be released as recruitment to the other zoledronic acid-containing arms (B and E) was to continue.
The observed HR for celecoxib versus control was 0.98, which did not meet the cut point. Although there was no clear evidence of either harm or unacceptable toxicity, no drugs are without potential for unwanted side-effects, and there was insufficient evidence of benefit to outweigh such risk.
As some patients were being advised to stop their treatment, it was decided to follow the safety rather than the lack-of-benefit timelines. By the afternoon of Day 0, (TSC meeting day) on 06 April 2011, the allocation to the celecoxib-containing arms in the randomization system had been disabled. All sites were notified by email that day and were told to re-advise patients who had consented to the trial but who had not yet been randomized. The Chief Investigator, patient representative and trials unit also agreed to a temporary revised version of the PIS. A quick response to this was facilitated by drafting many versions of the PIS before the IDMC meeting to reflect the needs following a number of hypothetical outcomes. Sites were offered a new electronic version of the revised PIS or they could manually cross out the few newly irrelevant sections of their current version. Sites were also told to advise patients to stop taking celecoxib at their next routine visit but that no urgent visits by patients to the clinic were required. A small number of patients who had been on celecoxib for many months chose to remain on treatment; only five patients are reported as still being on celecoxib at the start of July 2011.
On Day 1, phone calls were made to all site principal investigators (PIs) to ensure they were aware of and understood the actions taken. The trial team also worked with consumers to develop a summary of the results and actions to give to all patients. We thought it important for all trial patients to understand this information, not just those patients allocated to celecoxib-arms. This summary of results and actions was provided to sites for distribution to patients. Finally, industrial partners were apprised of the actions.
By Day 7, the PIS had been formally updated, submitted to the main ethics committee for information and distributed to sites. The regulatory authority was formally notified at this time. The protocol was formally amended (to version 7.0) after two months and submitted in June 2011 to the regulatory authority and ethics committee as a non-substantial amendment for information only.
These processes ran smoothly and no problems were reported from any of the governance bodies or from participating sites. The most common question from a small number of sites related to the use of new documents without apparent ‘prior’ approval. The earlier letter from the regulatory agency was sufficient to respond to these queries.
Recruitment continued to the control arm and to the remaining three research arms at good rates, with 47 patients in the 4 full weeks prior to change and 42 patients in the subsequent 4 full weeks. Importantly, follow-up continues for patients allocated to the celecoxib-containing arms.
Patients recently randomized to celecoxib-containing arms
A small number of patients randomized shortly prior to the halting of the celecoxib-containing arms had not necessarily had a chance to start their allocated treatment. It was agreed that patients allocated to arm D (HT plus celecoxib) and who still met all of the eligibility criteria for new patients joining the trial could be offered the opportunity to withdraw from STAMPEDE and to be re-randomized as a new patient. This was discussed with the relevant sites and five patients of seven meeting these criteria chose re-randomization. Since recruitment to and treatment within arm B (zoledronic acid) was continuing, patients on arm F (celecoxib plus zoledronic acid) were recommended to stop their celecoxib treatment and were not offered re-randomization. No patient will contribute more than once to any comparison. Sensitivity analyses will be considered.
Handling investigator assumptions
Investigators will no doubt make implicit assumptions about any research arms that continue accrual beyond each intermediate analysis. However, community uncertainty should not be affected by unreleased data from these intermediate comparisons. The knowledge that there are likely encouraging data on an early outcome measure at the intermediate analyses just reinforces the need to continue randomization to gain stronger evidence for the definitive primary outcome measure. If any of the arms showed early results for the definitive primary outcome measure that would be sufficiently convincing to influence clinical practice, the IDMC could recommend early release of the data. The strengths and weaknesses of that data would be discussed.
Designing new comparisons
Rationale for including new research arms
The practical reasons for choosing the five research arms at the outset of STAMPEDE has been discussed previously . The STAMPEDE TMG has now successful activated one further research arm (G, abiraterone) and further arms are being considered.
The motivations for including a new research arm are many. The philosophy at the outset was to evaluate multiple agents from different classes but as new agents emerge and potential synergies from agents within the same class become a possibility, it is important that consideration is given to testing these alone, and possibly in combination, within the framework of a MAMS trial design. Agents and approaches should only be considered for addition when there are robust and convincing scientific hypotheses.
There is huge interest in new ‘hormone therapies’ for prostate cancer with the first such agent, abiraterone, an androgen biosynthesis inhibitor, licensed in 2011. Drugs approved in patients with late stage disease will generally go on to be tested in earlier settings. The efficiencies available in MAMS trials  are as relevant to new agents as they are in the original arms. These efficiencies include the following: (i) using one protocol to allow for new comparisons to be introduced by amendment; (ii) quicker recruitment to the new comparison by activating participating sites for the new comparison more quickly than is possible in any new, separate study; (iii) the increased chance of allocation of a research arm, which may appeal to many patients, thereby boosting accrual; (iv) the contemporaneous accrual to comparisons which overlap in time means no gaps between, and no competition between, trials; (v) phase II assessments of activity are incorporated; and (vi) together, the duration and cost of such a setting up a new comparison in this way would be considerably shorter and lower than any separate, new trial.
Criteria for potential new research arms
Sound rationale, including a robust biological hypothesis and compelling evidence of activity that strongly identifies a need to assess a research approach in the setting studied.
Positive evidence of mechanisms or synergy of action (or both) in the disease area
Investigator enthusiasm for the new research arm.
Pharmaceutical research agents would need to be licensed or be close to being licensed at the time of activation. Without a licensed use for the drug (usually in later disease), data in the target setting are likely to be of limited value.
Relevant industry partners willing to collaborate and contribute to the trial, if the research arm is a pharmaceutical agent.
Successful independent peer review as for a new study.
Recruitment to new arm must not jeopardise completion of the ongoing research arms, e.g. by diluting recruitment excessively. This means that the accrual rate must be better than predicted in the original trial or that other research arms have already stopped accrual early. STAMPEDE is presently recruiting at around 700 patients/year when 500 patients/year were targeted. This permitted capacity to consider new research agents even while all original arms remained open.
The new comparison must still be relevant when it matures.
When to add new arms
Many new agents are being developed in prostate cancer, often with differing mechanisms of action and demonstrable survival advantages in the later, castrate-refractory stages of the disease. These include approaches based on cytotoxic chemotherapy (cabazitaxel) , immunotherapy (sipuleucel-T) , radionuclides (radium-223) , novel androgen blockade (MDV3100) [19–21], and cellular pathway targeting drugs (cabozantinib) . However, ahead of all of these in the development process has been abiraterone acetate (Zytiga: Janssen Pharmaceuticals). HT eventually fails for most men, even though they have castrate levels of circulating androgens. This is called castration-refractory prostate cancer (CRPC). Recent evidence suggests the failure is due to persistent activity of the androgen receptor, occurring because of intracellular conversion of steroids precursors to androgenic steroids by prostate cancer cells. A key enzyme in this process is CYP17, an enzyme which represents a logical target for therapy in later stages of prostate cancer . Abiraterone is a selective inhibitor of CYP17 and is highly active in patients developing resistance to standard androgen ablation therapies [24–26]. First results of a phase III study comparing abiraterone to placebo in CRPC patients following chemotherapy with docetaxel reported an absolute improvement in overall survival of more than 4 months, hazard ratio 0.65 (95% CI, 0.54 to −0.77) . The drug received marketing authorization in European Union from September 2011 and there is a robust biological hypothesis . The TMG hypothesized that abiraterone could have a greater absolute effect when given to men with high-risk disease starting long-term HT (that is, earlier in the time course of the disease and synchronously with standard androgen ablation).
The addition of HT plus abiraterone means that STAMPEDE has become a five-arm trial from mid-November 2011. The design parameters for STAMPEDE in Table 1 relate to each pairwise comparison of research arm against control arm. The same parameters and targets for the new comparison of abiraterone versus control have been chosen; these will only be made within contemporaneously recruited patients. That is, patients allocated to a new research arm are compared against control arm patients randomized after a new research arm was added.
Inevitably, analyses of new comparisons will be later than for the original comparisons. It is anticipated that completing accrual to the new research comparison (and possibly further additional arms) may occur before the primary survival results from the initial comparisons are known.
The key question was how many patients are required to attain these parameters? This depends on traditional and MAMS-specific factors, including recruitment rate, power and significance level for each stage. We realized that accrual would start strongly because the new comparison would quickly be activated in many sites. Furthermore, accrual to the new comparison would be boosted when recruitment to the original research arms stopped. A survey of participating sites (unpublished) suggested that overall accrual could even be boosted by including an ‘attractive’ new research arm. Accrual rates have increased throughout the trial (Figure 2) and could continue to increase regardless of the addition of a new arm.
For the sample size calculations, this comparison was first treated as if it were a two-arm multi-stage trial using nstage [8, 9] to obtain the control arm events required to trigger the end of each stage. The duration of the trial was then estimated using ARTPEP  to estimate when these events would be attained. ARTPEP offers much flexibility in accrual rates, follow-up duration and loss-to-follow-up.
Figure 3 (right) shows cumulative FFS events and deaths expected on the control arm. The dashed lines mark the number of control events required to trigger the intermediate and final analyses and the approximate calendar time of these analyses (rounded to the nearest quarter-year) in this scenario. On both sides of the graph, the vertical, dashed, black line represents the end of accrual.
The TMG has constructed and stored many such scenarios for the original trial, including increasing or decreasing the accrual rate, the accrual period, the follow-up period, the length of co-recruitment with the original arms and the median FFS and overall survival times, as well as introducing one or two further research arms later in the trial.
Accrual to this comparison is planned to stop at the sooner of (i) 1,500 new patients allocated to control or abiraterone or (ii) three years after activating the abiraterone comparison. The comparison should mature in around five years, depending on the mix of metastatic and non-metastatic patients joining the trial. Importantly, accrual to this comparison should complete before the original comparisons mature for the definitive primary outcome measure.
The abiraterone comparison was formally launched on Tuesday 15 November 2011. A total of 31 patients joined STAMPEDE by the end of the first full week, with 18 allocated to arms A or G (around the 4 of 7 expected). We describe the steps that we took to reach this point.
Janssen’s first formal results for abiraterone in late-stage prostate cancer were published in April 2011  and updated at the American Society of Clinical Oncology (ASCO) 2011 , with abiraterone being licensed in Europe in September 2011. Discussions between the TMG and Janssen were formally initiated much earlier in March 2010 with an application by the trial team for an investigator-initiated study. In July 2010, the main funding body, Cancer Research United Kingdom, organized a scientific peer review of the revised trial application to conditionally amend STAMPEDE pending successful negotiations and a successful results from the Janssen’s COU-AA-301 trial. This included findings reflecting broad enthusiasm among investigators and patients to assess abiraterone, plus the TMG’s enthusiasm for this new approach.
Subsequent months were spent discussing the dose and duration of abiraterone, steroid support, details of drug supply and distribution, safety reporting, research supports and contracts with Janssen’s United Kingdom, European and Global affiliates. The sample size estimates were then finalized and the protocol was conditionally updated.
The principle of adding a new arm was discussed at each IDMC and TSC meeting in 2010 and 2011. The TSC reviewed the protocol in August 2011. The new research arm G (hormone therapy plus abiraterone) was then submitted to the regulatory agency and ethics committee late in August 2011 as a substantial protocol amendment (version 8.0) along with an updated PIS. This updated protocol included some modified eligibility criteria pertinent to assessing abiraterone. All patients now needed histological confirmation of prostate cancer, something not previously required for the subset of patients with bone metastases and PSA >100 ng/ml. In the United Kingdom this affected only a small proportion of patients and fitted in with current National Institute for Health and Clinical Excellence (NICE) guidance recommending a biopsy where a patient may wish to enter a trial. This is also consistent with most trials of new agents in prostate cancer. Further clarifications on liver and renal function that are associated with fitness for abiraterone were also introduced but were unlikely to markedly affect the number of eligible patients.
The TMG also introduced an unrelated change for non-metastatic patients following recent results from SPCG-7  and MRC PR07/NCIC PR.3 , which demonstrated a survival advantage to HT plus radiotherapy over HT alone in men with locally advanced, non-metastatic prostate cancer. Previously, radiotherapy had been encouraged for such men in STAMPEDE, but the trial has been updated to reflect the new standard-of-care.
The likely addition of abiraterone had been extensively promoted at conferences and investigator meetings in addition to the survey. The trial team started training participating sites in parallel with the contractual and regulatory processes. Regional launch and training meetings in Glasgow, London, Cardiff and Manchester in September 2011 and October 2011 were supplemented with teleconferences. This included making clear that there would be a formal switchover date to protocol version 8.0 and that centers would need new local approval to maintain accrual beyond this date. That is, all sites needed to provide evidence to be given permission to start randomizing again.
The ethics committee responded quickly and positively in September 2011, the regulatory agency gave approval in October 2011 within their 35-day window, and neither body requested changes.
It is unlikely that any completely new trial could have 83 sites ready to recruit on activation day, something that would be a considerable achievement. Figure 2 shows (on the left axis) the number of sites recruiting their first patient to the trial, demonstrating how long de novo trials may take to activate sites. Site activation was deliberately limited during the original Pilot Phase, but new sites have continued to activate throughout, giving accelerated recruitment rates. Therefore, a new, separate trial of abiraterone would likely have taken much longer to get to the same rate of recruitment as STAMPEDE achieved immediately. The cost of a separate trial would also have been higher if the trial took longer to conduct. A separate trial would also potentially have become established as a competing trial, with the possibility of an adverse effect on recruitment to both trials. Combining the new comparison into STAMPEDE also brings efficiencies in costs regarding site training, site monitoring and database construction.
Randomization is achieved through minimization with a random element [32, 33] where 80% patients are allocated to a minimizing arm across a series of clinically-relevant stratification factors . Therefore, at any moment in time, the groups allocated to each arm are well-balanced. After consideration, the TMG wiped the stratification tables clean when the new comparison was activated, effectively starting over again.
The possibility of the original research arms maturing while the new comparison was ongoing was discussed. Such data can be considered as if they are data emerging from an external trial. Indeed, there are some other trials which overlap partially with STAMPEDE in terms of both population and treatment. The trial team would react if change is needed, as demonstrated by the introduction of radiotherapy in non-metastatic disease.
The STAMPEDE investigators appreciate that challenging and novel changes can only be made by working with enthusiastic researchers. The group has, therefore, encouraged discussions with sites from the outset and has repeatedly engaged sites to ensure clinician and patient input and ‘buy-in’. The potential changes have been presented in newsletters and at regional meetings over a long period. Furthermore, researchers have been encouraged to bring forward ideas for further arms that might be worthy of assessment in this trial population.
Indeed, the STAMPEDE TMG has started to consider further arms. In September 2011 the TMG prioritized potential questions. Any new comparison would take at least one year to develop and activate so it is important that such discussions start early if they are to be activated. Champions for potential new agents have been making contact with potential industry partners although the most favored question was radiotherapy for metastatic disease, which pertains only to a subgroup of patients. This provides a further challenge for our flexible design to address. Projections for various recruitment scenarios demonstrate that this could be achieved if participating centers are keen to formulate questions together. A questionnaire was distributed to sites in November 2011 and the concept was received positively. This has been approved by the trial committees and has been successfully peer-reviewed by Cancer Research United Kingdom. A formal amendment to activate this comparison will be developed during summer 2012. We estimated that undertaking this comparison within STAMPEDE would cost only about 60% as much as a separate stand-alone trial.
STAMPEDE is a high-profile adaptive randomized controlled trial (RCT). We believe the merits in this flexible approach are clearly apparent, and we encourage others to implement this or similar designs in other settings. In particular, the considerable costs associated with trial start up and close down can be substantially reduced by evaluating many new treatments simultaneously and also by using intermediate analyses to run a seamless phase II/III approach . The ability to rapidly add new arms is also an important innovation. We have essentially set up a new phase III comparison of abiraterone in 100 centers in 18 months from the first idea to first patient; From protocol sign-off to opening was less than 4 months. The price in trial administration costs (ignoring drug associated costs which accrue whatever route one chooses) ran into tens of thousands of pounds sterling rather than the much larger sums normally associated with trial set up on this scale de novo. Experience shows that funders, regulators, investigators and, most importantly, patients can deal with the complex issues involved. Indeed, as the trial has progressed, companies wishing to have their drug included within the trial have started to approach us.
We hope that this very positive experience of an adaptive trial will encourage others to undertake further trials like STAMPEDE and that our experience will smooth the passage of further such trials.
In summary, the STAMPEDE trial has confirmed the notion that MAMS trials speed the evaluation of new treatments by testing many treatments simultaneously and by using lack-of-benefit analyses to focus research efforts towards the more promising research arms. It has also demonstrated that accrual and treatment of insufficiently active arms can be stopped successfully without this radical change affecting the continued evaluation of agents still undergoing testing in this setting. Finally, and importantly, we have demonstrated that adding additional research arms to enable new and rapid comparisons of novel agents either alone or in combination is possible, and that the modification of a complex protocol to accommodate changes in practice during the running of a MAMS study is achievable. This is particularly important in an ongoing trial of this type. We have shown that a major change to the protocol can be swiftly and effectively achieved in large numbers of centers, and high volume recruitment can be continued in a seamless, safe and efficient manner.
This manuscript is based on an oral presentation given at the first United Kingdom Clinical Trials Methodology Conference, Bristol, UK in October 2011 and subsequently presented as a poster as the Genitourinary Cancer Symposium, San Francisco, USA in February 2012.
Androgen deprivation therapy
American Society of Clinical Oncology
castration-refractory prostate cancer
Clinical Trials Authorization
Clinical Trials Advisory and Award Committee
MRC Clinical Trials Unit
Independent Data Monitoring Committee
Medical Research Council
National Institute for Health and Clinical Excellence
Patient Information Sheet
Randomized Controlled Trial
Research and development
Swiss Group for Clinical Cancer Research (Schweizerische Arbeitsgemeinschaft für Klinische Krebsforschung)
Systemic Therapy for Advanced or Metastatic Prostate cancer: Evaluation of Drug Efficacy
Trial Management Group
Trial Steering Committee.
In memory of Jim Stansfeld, patient representative on the Trial Management Group at the design stage who was critical to the inclusion of celecoxib as a research arm in STAMPEDE.
MRC staff: Statisticians to MR Sydes, MKB Parmar (throughout); RC Jinks (née Morgan) (Oct-2006 to Sep-2008); G Jovic (Oct-2008 to present). Trial Managers: J Nuttall (Sep-2004 to Jun-2006); K Sanders (Jun-2006 to Feb-2011); T Fairfield (Feb-2011 to Aug-2011). Data Managers: J Millett (Jul-2004 to Mar-2005); S Hassan (Apr-2005 to Jul-2006); P Pollock (Jul-2006 -Mar-2007); R Gracie (May-2007 -Sep-2008); L van Dyck (Sep-2008 to Aug-2009); C Green (née Griffiths) (Aug-2009 to Aug-2011); E Clark (Nov-2009 to Jan-2011); S Peres (April-2011 to present)
Data Monitoring Committee: C Williams (Chair), DG Altman, B Tombal, R Hall
Trial Steering Committee: J Ledermann (Chair), D Kirk, J Paul
Pfizer: A Moledina, P Bramble
Janssen: R Murphy, D Atlan, E Lee, I Vercammen, L Davenport, I Milionis
Participating sites: UNITED KINGDOM:
Aberystwyth, Bronglais General Hospital (Sajid Durrani); Ashford, William Harvey Hospital (Natasha Mithal); Aylesbury, Stoke Mandeville Hospital (Andrew Protheroe); Ayr, Ayr Hospital (Jawaher Ansari); Barnstaple, North Devon District Hospital (Denise Sheehan); Basingstoke, Basingstoke and North Hampshire Hospital (Richard Shaffer); Bath, Royal United Hospital (Hugh Newman); Bebington, Clatterbridge Centre for Oncology (Helen Innes); Belfast, Belfast City Hospital (Joe O'Sullivan); Birmingham, Birmingham Heartlands Hospital (Anjali Zarkar); Birmingham, City Hospital (Daniel Ford); Birmingham, Queen Elizabeth Hospital (Nicholas James); Blackburn, Royal Blackburn Hospital (Omi Parikh); Bolton, Royal Bolton Hospital (Tony Elliott); Bournemouth, Royal Bournemouth Hospital (Sue Brock); Bradford, Bradford Royal Infirmary (Simon Brown); Brighton, Royal Sussex County Hospital (Angus Robinson); Bristol, Bristol Haematology & Oncology Centre (Amit Bahl); Burnley, Burnley General Hospital (Omi Parikh); Burton-on-Trent, Queen's Hospital Burton (Prabir Chakraborti); Bury St Edmunds, West Suffolk Hospital (Cathryn Woodward); Canterbury, Kent and Canterbury Hospital (Natasha Mithal); Cardiff, Velindre Hospital (Malcolm Mason); Carlisle, Cumberland Infirmary (Anil Kumar); Chelmsford, Broomfield Hospital (Priscilla Leone); Crewe, Leighton Hospital (James Wylie); Darlington, Darlington Memorial Hospital (John Hardman); Derby, London Road Community Hospital (Prabir Chakraborti); Derby, Royal Derby Hospital (Prabir Chakraborti); Doncaster, Doncaster Royal Infirmary (Catherine Ferguson); Dorchester, Dorset County Hospital (Perric Crellin); Dudley, Russells Hall Hospital (Prakash Ramachandra); Durham, University Hospital Durham (Rhona McMenemin); Eastbourne, Eastbourne District General Hospital (Fiona McKinna); Edinburgh, Western General Hospital (Duncan McLaren); Exeter, Royal Devon and Exeter Hospital (Denise Sheehan); Glasgow, Beatson West of Scotland Cancer Centre (Martin Russell); Guildford, Royal Surrey County Hospital (Robert Laing); Harlow, Princess Alexandra Hospital (Nishi Gupta); Hereford, Hereford County Hospital (Audrey Cook); High Wycombe, Wycombe Hospital (Andrew Protheroe); Huddersfield, Huddersfield Royal Infirmary (Uschi Hofmann); Hull, Castle Hill Hospital (John Hetherington); Inverness, Raigmore Hospital (Neil McPhail); Ipswich, Ipswich Hospital (Robert Brierly); Keighley, Airedale General Hospital (Michael Crawford); Kidderminster, Kidderminster General Hospital (Mark Churn); Leeds, St James University Hospital (William Cross); Liverpool, Royal Liverpool University Hospital (Zafar Malik); London, Charing Cross Hospital (Alison Falconer); London, Guy's Hospital (Simon Chowdhury); London, Hammersmith Hospital (Alison Falconer); London, North Middlesex Hospital (Jackie Newby); London, Queen Elizabeth Hospital (Simon Hughes); London, Royal Free Hospital (Maria Vilarino-Varela); London, Royal Marsden Hospital (Vincent Khoo); London, St George's Hospital (Lisa Pickering); London, St Mary's Hospital (London) (Alison Falconer); London, University College Hospital (Stephen Harland); Maidstone, Maidstone Hospital (Sharon Beesley); Manchester, Withington Hospital (Vijay Sangar); Margate, Queen Elizabeth The Queen Mother Hospital (Natasha Mithal); Middlesbrough, James Cook University Hospital (John Hardman); Newport, St Mary's Hospital (Newport) (Kudingila Madhava); Northwood, Mount Vernon Hospital (Peter Hoskin); Nottingham, Nottingham University Hospitals, City Campus (Santhanam Sundar); Oldham, Royal Oldham Hospital (Jacqueline Livsey); Oxford, Churchill Hospital (Andrew Protheroe); Poole, Poole Hospital (Sue Brock); Portsmouth, Queen Alexandra Hospital (Joanna Gale); Preston, Royal Preston Hospital (Alison Birtle); Reading, Royal Berkshire Hospital (Paul Rogers); Romford, Queen's Hospital (Romford) (Stephanie Gibbs); Salford, Hope Hospital (Noel Clarke); Scarborough, Scarborough General Hospital (Mohan Hingorani); Sheffield, Weston Park Hospital (Catherine Ferguson); Shrewsbury, Royal Shrewsbury Hospital (Narayanan Srihari); South Shields, South Tyneside District Hospital (Ashraf Azzabi); Southampton, Southampton General Hospital (Catherine Heath); Southport, Southport and Formby District General Hospital (Asha Sivapalasuntharam); St Leonards-on-Sea, Conquest Hospital (Sharon Beesley); Stevenage, Lister Hospital (Robert Hughes); Stockport, Stepping Hill Hospital (John Logue); Stoke-on-Trent, University Hospital of North Staffordshire (Fawzi Adab); Sunderland, Sunderland Royal Hospital (Ian Pedley); Sutton, Royal Marsden Hospital (David Dearnaley); Sutton Coldfield, Good Hope Hospital (Daniel Ford); Sutton-in-Ashfield, King's Mill Hospital (Daniel Saunders); Swansea, Singleton Hospital (Gianfilippo Bertelli, John Wagstaff); Swindon, Great Western Hospital (David J Cole); Taunton, Musgrove Park Hospital (John Graham); Torquay, Torbay District General Hospital (Anna Lydon); Warrington, Warrington Hospital (Isabel Syndikus); Westcliff on Sea, Southend University Hospital (David Tsang); Weston Super Mare, Weston General Hospital (Serena Hilman); Whitehaven, West Cumberland Hospital (Anil Kumar); Wigan, Royal Albert Edward Infirmary (Richard Cowan); Worcester, Worcestershire Royal Hospital (Jo Bowen); Worthing, Worthing Hospital (Ashok Nikapota). SWITZERLAND: Berne, Inselpital (G Thalmann); Chur, Kantonsspital Graubünden (Richard Cathomas); Zurich, Triemlispital (Donat Durr); Zurich, University Hospital (Michael Muntener).
- Royston P, Parmar MKB, Qian W: Novel designs for multi-arm clinical trials with survival outcomes with an application in ovarian cancer. Stat Med. 2003, 22: 2239-2256. 10.1002/sim.1430.View ArticlePubMed
- Royston P, Barthel FMS, Parmar MKB, Choodari-Oskooei B, Isham V: Designs for clinical trials with time-to-event outcomes based on stopping guidelines for lack of benefit. Trials. 2011, 12: 81-10.1186/1745-6215-12-81.PubMed CentralView ArticlePubMed
- Parmar MKB, Barthel F, Sydes M, Langley R, Kaplan R, Eisenhauer E, Brady M, James N, Bookman MA, Swart AM, Qian W, Royston P: Speeding up the evaluation of New agents in cancer. J Natl Canc Inst. 2008, 100: 1204-1214. 10.1093/jnci/djn267.View Article
- James N, Sydes M, Clarke N, Mason M, Dearnaley D, Anderson J, Popert R, Sanders K, Morgan R, Stansfeld J, Dwyer J, Masters J, Parmar MKB: STAMPEDE: systemic therapy for advancing or metastatic prostate cancer - a multi-Arm multi-stage randomised controlled trial. Clin Onc. 2008, 20: 577-581. 10.1016/j.clon.2008.07.002.View Article
- James ND, Sydes MR, Clarke NW, Mason MD, Dearnaley DP, Anderson J, Popert RJ, Sanders K, Morgan RC, Stansfeld J, Dwyer J, Masters J, Parmar MKB: Systemic therapy for advancing or metastatic prostate cancer (STAMPEDE): a multi-arm, multistage randomized controlled trial. BJU Int. 2009, 103: 464-469. 10.1111/j.1464-410X.2008.08034.x.View ArticlePubMed
- Sydes MR, Parmar MKB, James ND, Clarke NW, Dearnaley DP, Mason MD, Morgan RC, Sanders K, Royston P: Issues in applying multi-arm multi-stage methodology to a clinical trial in prostate cancer: the MRC STAMPEDE trial. Trials. 2009, 10: 39-10.1186/1745-6215-10-39.PubMed CentralView ArticlePubMed
- Barthel FM-S, Royston P, Babiker A: A menu-driven facility for complex sample size calculation in randomized controlled trials with a survival or a binary outcome: Update. Stata J. 2005, 5: 123-129.
- Barthel FM-S, Royston P, Parmar MKB: A menu-driven facility for sample-size calculation in novel multiarm, multistage randomized controlled trials with a time-to-event outcome. Stata J. 2009, 9: 505-
- Royston P, Barthel FM: Projection of power and events in clinical trials with a time-to-event outcome. Stata J. 2010, 10: 1-9.
- Kola I, Landis JR: Can the pharmaceutical industry reduce attrition rates?. Nat Rev Drug Discov. 2004, 3: 711-715. 10.1038/nrd1470.View ArticlePubMed
- Kumar A, Soares H, Wells R, Clarke M, Hozo I, Bleyer A, Reaman G, Chalmers I, Djulbegovic B: Are experimental treatments for cancer in children superior to established treatments?. Observational study of randomised controlled trials by the Children's Oncology Group. BMJ. 2005, 331: 1295-PubMed
- Roberts TG, Lynch TJ, Chabner BA: The phase III trial in the era of targeted therapy: unraveling the "go or no go" decision. J Clin Oncol. 2003, 21: 3683-3695. 10.1200/JCO.2003.01.204.View ArticlePubMed
- James ND, Sydes MR, Mason MD, Clarke NW, Anderson J, Dearnaley DP, Dwyer J, Jovic G, Ritchie AWS, Russell JM, Sanders K, Thalmann GN, Bertelli G, Birtle AJ, O'Sullivan JM, Protheroe A, Sheehan D, Srihari N, Parmar MKB: Celecoxib plus hormone therapy versus hormone therapy alone for hormone-sensitive prostate cancer: first results from the STAMPEDE multiarm, multistage, randomised controlled trial. Lancet Oncol. 2012, 13: 549-558. 10.1016/S1470-2045(12)70088-8.PubMed CentralView ArticlePubMed
- James ND, Sydes MR, Mason MD, Clarke NW, Dearnaley DP, Dwyer J, Jovic G, Russell JM, Thalmann G, Parmar MKB: Celecoxib plus hormone therapy Vs hormone therapy alone for hormone-sensitive prostate cancer: first results from the STAMPEDE randomised controlled trial (MRC PR08). Eur J Cancer. 2011, 11-Suppl 2
- de Bono JS, Oudard S, Ozguroglu M, Hansen S, Machiels JP, Kocak I, Gravis G, Bodrogi I, Mackenzie MJ, Shen L, Roessner M, Gupta S, Sartor AO: Prednisone plus cabazitaxel or mitoxantrone for metastatic castration-resistant prostate cancer progressing after docetaxel treatment: a randomised open-label trial. Lancet. 2010, 376: 1147-1154. 10.1016/S0140-6736(10)61389-X.View ArticlePubMed
- Kantoff PW, Higano CS, Shore ND, Berger ER, Small EJ, Penson DF, Redfern CH, Ferrari AC, Dreicer R, Sims RB, Xu Y, Frohlich MW, Schellhammer PF: Sipuleucel-T immunotherapy for castration-resistant prostate cancer. N Engl J Med. 2010, 363: 411-422. 10.1056/NEJMoa1001294.View ArticlePubMed
- Nilsson S, Franzen L, Parker C, Tyrrell C, Blom R, Tennvall J, Lennernas B, Petersson U, Johannessen DC, Sokal M, Pigott K, Yachnin J, Garkavij M, Strang P, Harmenberg J, Bolstad B, Bruland OS: Bone-targeted radium-223 in symptomatic, hormone-refractory prostate cancer: a randomised, multicentre, placebo-controlled phase II study. Lancet Oncol. 2007, 8: 587-594. 10.1016/S1470-2045(07)70147-X.View ArticlePubMed
- Scher HI, Beer TM, Higano CS, Anand A, Taplin ME, Efstathiou E, Rathkopf D, Shelkey J, Yu EY, Alumkal J, Hung D, Hirmand M, Seely L, Morris MJ, Danila DC, Humm J, Larson S, Fleisher M, Sawyers CL: Antitumour activity of MDV3100 in castration-resistant prostate cancer: a phase 1–2 study. Lancet. 2010, 375: 1437-1446. 10.1016/S0140-6736(10)60172-9.PubMed CentralView ArticlePubMed
- Tran C, Ouk S, Clegg NJ, Chen Y, Watson PA, Arora V, Wongvipat J, Smith-Jones PM, Yoo D, Kwon A, Wasielewska T, Welsbie D, Chen CD, Higano CS, Beer TM, Hung DT, Scher HI, Jung ME, Sawyers CL: Development of a second-generation antiandrogen for treatment of advanced prostate cancer. Science. 2009, 324: 787-790. 10.1126/science.1168175.PubMed CentralView ArticlePubMed
- Scher HI, Fizazi K, Saad F, Taplin M-E, Sternberg CN, Miller MDK: Increased Survival with Enzalutamide in Prostate Cancer after Chemotherapy. New Engl J Med. 2012, 10.1056/NEJMoa1207506. Published online 15-Aug-2012
- Hussain M, Smith MR, Sweeney C, Corn PG, Elfiky A, Gordon MS, Haas NB, Harzstark AL, Kurzrock R, Lara P, Lin C, Sella A, Small EJ, Spira AI, Vaishampayan UN, Vogelzang NJ, Scheffold C, Ballinger MD, Schimmoller F, Smith DC: Cabozantinib (XL184) in metastatic castration-resistant prostate cancer (mCRPC): results from a phase II randomized discontinuation trial. J Clin Oncol. 2011, 29: 4516-10.1200/JCO.2010.33.7741.View Article
- Attard G, Richards J, de Bono JS: New strategies in metastatic prostate cancer: targeting the androgen receptor signaling pathway. Clin Cancer Res. 2011, 17: 1649-1657. 10.1158/1078-0432.CCR-10-0567.PubMed CentralView ArticlePubMed
- Danila DC, Morris MJ, de Bono JS, Ryan CJ, Denmeade SR, Smith MR, Taplin ME, Bubley GJ, Kheoh T, Haqq C, Molina A, Anand A, Koscuiszka M, Larson SM, Schwartz LH, Fleisher M, Scher HI: Phase II multicenter study of abiraterone acetate plus prednisone therapy in patients with docetaxel-treated castration-resistant prostate cancer. J Clin Oncol. 2010, 28: 1496-1501. 10.1200/JCO.2009.25.9259.PubMed CentralView ArticlePubMed
- Reid AH, Attard G, Danila DC, Oommen NB, Olmos D, Fong PC, Molife LR, Hunt J, Messiou C, Parker C, Dearnaley D, Swennenhuis JF, Terstappen LW, Lee G, Kheoh T, Molina A, Ryan CJ, Small E, Scher HI, de Bono JS: Significant and sustained antitumor activity in post-docetaxel, castration-resistant prostate cancer with the CYP17 inhibitor abiraterone acetate. J Clin Oncol. 2010, 28: 1489-1495. 10.1200/JCO.2009.24.6819.PubMed CentralView ArticlePubMed
- Ryan CJ, Smith MR, Fong L, Rosenberg JE, Kantoff P, Raynaud F, Martins V, Lee G, Kheoh T, Kim J, Molina A, Small EJ: Phase I clinical trial of the CYP17 inhibitor abiraterone acetate demonstrating clinical activity in patients with castration-resistant prostate cancer who received prior ketoconazole therapy. J Clin Oncol. 2010, 28: 1481-1488. 10.1200/JCO.2009.24.1281.PubMed CentralView ArticlePubMed
- de Bono JS, Logothetis CJ, Molina A, Fizazi K, North S, Chu L, Chi KN, Jones RJ, Goodman OB, Saad F, Staffurth JN, Mainwaring P, Harland S, Flaig TW, Hutson TE, Cheng T, Patterson H, Hainsworth JD, Ryan CJ, Sternberg CN, Ellard SL, Flechon A, Saleh M, Scholz M, Efstathiou E, Zivi A, Bianchini D, Loriot Y, Chieffo N, Kheoh T, Hagg CM, Scher HI, COU-AA-301 Investigators, COU-AA-301 Investigators: Abiraterone and increased survival in metastatic prostate cancer. N Engl J Med. 2011, 364: 1995-2005. 10.1056/NEJMoa1014618.PubMed CentralView ArticlePubMed
- de Bono JS, Ashworth A: Translating cancer research into targeted therapeutics. Nature. 2010, 467: 543-549. 10.1038/nature09339.View ArticlePubMed
- Group obotC-A-S, Scher HI, Logothetis C, Molina A, Goodman OB, Sternberg CN, Chi KN, Kheoh TS, Haqq CM, Fizazi K, Bono JSD: Improved survival outcomes in clinically relevant patient subgroups from COU-AA-301, a phase III study of abiraterone acetate (AA) plus prednisone (P) in patients with metastatic castration-resistant prostate cancer (mCRPC) progressing after docetaxel-based chemotherapy. J Clin Oncol. 2011, 29: 4-10.1200/JCO.2010.32.1752.View Article
- Widmark A, Klepp O, Solberg A, Damber JE, Angelsen A, Fransson P, Lund JA, Tasdemir I, Hoyer M, Wiklund F, Fossa SD: Endocrine treatment, with or without radiotherapy, in locally advanced prostate cancer (SPCG-7/SFUO-3): an open randomised phase III trial. Lancet. 2009, 373: 301-308. 10.1016/S0140-6736(08)61815-2.View ArticlePubMed
- Warde P, Mason M, Ding K, Kirkbride P, Brundage M, Cowan R, Gospodarowicz M, Sanders K, Kostashuk E, Swanson G, Barber J, Hiltz A, Parmar MKB, Sathya J, Anderson J, Hayter C, Hetherington J, Sydes MR, Parulekar W, for the NCIC CTG PR.3/MRC UK PR07 investigators, for the NCIC CTG PR.3/MRC UK PR07 investigators: Combined androgen deprivation therapy and radiation therapy for locally advanced prostate cancer: a randomised, phase 3 trial. Lancet. 2011, 378: 2104-2111. 10.1016/S0140-6736(11)61095-7.PubMed CentralView ArticlePubMed
- Pocock S: Clinical Trials: A Practical Approach. 1983, New York: Wiley
- Taves DR: Minimization: a new method of assigning patients to treatment and control groups. Clin Pharmacol Ther. 1974, 15: 443-453.View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.