Quality of transurethral resection of bladder tumor procedure influenced a phase III trial comparing the effect of KLH and mitomycin C
© The Author(s). 2017
Received: 9 August 2016
Accepted: 16 February 2017
Published: 14 March 2017
Retrospective analysis of Center effect of the multi-center trial conducted to compare Immucothel (KLH Immunotherapy drug product) with Mytomycin-C (MM) concluded that efficacy evaluation of the drug product may be impacted by physician’s subjective performance of Transurethral resection of bladder tumor (TURBT).
A randomized trial was performed in 18 hospitals (clinical centers) and a total of 553 recruited, 283 patients under KLH arm and 270 patients under MM. An initial statistical analysis of efficacy comparisons between KLH and MM based on log-rank test performed for each center (hospital) showed 6 hospitals out of 18 hospitals a p-value of <0.05 and remaining 12 hospitals showed a p-values of >0.05. No association was observed between number of patients analysed and the associated p-values across hospitals. Final statistical analyses were carried out under each drug product using Kaplan-Meier survival analysis along with log-rank test after combining all eligible patients data for 6 hospital group and 12 hospital group.
Median recurrence free survival (RFS) times (in weeks) showed statistical significance (p-value = 0.03) between two groups of hospitals under KLH arm, while similar median values showed no statistical significance (p-value = 0.05).
Center effect with respect to median RFS values under KLH was more pronounced than under MM. Under the presence of such center effect, for reasons other than product related effects, concluding superiority of one drug product over another may create confounding bias conclusions in multi-center clinical trials. In the above cited clinical trial study, physician’s prior experience on TURBT might have contributed to center effect in examining efficacies of KLH and MM. Similar observation was also noted in the literature on studies dealing with TURBT and in other clinical studies.
Data set used in this study is based on previously documented clinical trial in the literature: See (Lammers et al., J Clin Oncol 30:2273–9, 2012) and Acknowledgments.
Intravesical bacillus Calmette-Guérin (BCG) instillation remains the standard treatment among intravesical anticancer therapies after transurethral resection (TURBT) for bladder cancer, to suppress disease recurrence and progression . Since the toxicity of BCG is a limitation in some patients, other alternative intravesical chemotherapeutic agents have been developed. One such cytostatic agent is mitomycin C (MM). IMMUCOTHEL® (Keyhole Limpet Hemocyanin (KLH) Immunotherapy drug product, biosyn, Fellbach, Germany) is an approved drug product for the prevention of bladder carcinoma recurrence after TURBT and after failure of other established therapies, like BCG and MM.
A randomized phase III trial based on 553 patients (283 patients under KLH and 270 patients under MM), with intermediate- and high-risk non-muscle-invasive bladder cancer (NMIBC) without carcinoma in situ has been performed and the study details are published . The multicenter trial spanned over 18 clinical centers (hospitals). In the phase III trial study patients were randomized into the KLH arm or the MM arm after TURBT. In the KLH arm, patients received 1 mg KLH preimmunization followed by instillations with 20 mg KLH once per week for 6 weeks and once per month for 10 months for a total targeted 16 instillations as part of the KLH treatment. In the MM arm, patients received 40 mg MM once per week for 4 weeks and followed by five monthly instillations, and then at 9 and 12 months for a total targeted 11 instillations. The efficacy comparison between KLH and MM was based on median recurrence-free survival (RFS) and recurrence rate .
The present work focus is on exploratory evaluation of a treatment-by-centre interaction effect through statistical significance tests for treatment effects within each centre based on ICH Guidance .
Material and Methods
The overall HR (18 centers) is 2.26 as reported by Lammers et al.  and confirmed in our analysis. The hospital grouping based on HR and p values shows a fairly good overall correlation. All the hospitals (5 out of 5, 100%) with p < 0.05 have a HR value greater than 2.26 and majority of hospital (9 out of 11, 81%) with p > 0.05 have a HR value less than 2.26. The HR values for two hospitals, 17 and 18, are not reported as there was no recurrence in MM treatment arm (Table 1). In view of these observations subsequent analysis was performed using hospital grouping based on p values.
Patient demographic and clinical characteristics of all patients within the two hospital groups
Number of patients
Mean age in years
Previous treatment in patients with recurrent tumors at baseline
Current single post-TURBT intravesical chemotherapy
Previous single post-TURBT intravesical chemotherapy
Local adjuvant intravesical therapy
No therapy other than TURBT
Number of tumors
Group 1 represents six hospitals, which show a statistically significant difference (p value < 0.05) between the two treatment groups. The data in group 1 consists of 95 patients in the KLH treatment arm and 90 patients for MM. Group 2 represents the remaining 12 hospitals, which displayed no statistically significant difference (p value > 0.05). Group 2 includes 172 patients for KLH and 166 for MM.
The median RFS and recurrence rates for KLH and MM were derived by Kaplan-Meier survival analysis. Comparison of median RFS using the log-rank test was performed for the same drug product (KLH or MM) between group 1 and group 2.
Results and Discussion
Significant differences between trial centers
Frequency of subjects and number of recurrences in the two hospital groups
N of events (# of recurrences)
Recurrences in [%]
Recurrence rate and median RFS were significantly different within treatment arms
Recurrence rate and median recurrence-free survival (RFS) for Keyhole Limpet Hemocyanin (KLH) and mitomycin C (MM) for group 1 and group 2
Recurrence rate (%)
95% confidence interval
The median RFS for KLH in group 1 is 84 weeks compared to 139 weeks for median RFS for KLH in group 2. The median RFS for group 1 is significantly lower than group 2 (p = 0.004, log-rank test). Similarly, the median RFS for group 1 is not attained for MM compared to a median RFS value of 297 for group 2 (approaching significance p = 0.05, log-rank test).
Similar results for recurrence rate and medium RFS were obtained when the hospital grouping was performed based on HR values (low <2.26 and high >2.26) (details not reported; see Additional files 1 and 2).
These results imply that the same drug product has better efficacy in one group compared to the other. Logically, this would be an unlikely scenario and suggests that other center-related effects may be involved in this study.
Significant influence of prior TURBT in multi-center trial
The study design called for TURBT prior to randomizing the patients into each treatment arm. Existing medical literature data suggests that outcome of TURBT with regard to recurrence is significantly influenced by the operative experience of the surgeon [4–10]. The results of this analysis provide additional evidence to the referenced existing medical literature data. The observed differences between group 1 and group 2 hospitals were possibly due to differences in the operative experience of the surgeons.
What are the possible approaches that can be taken in the design of clinical trials to overcome this TURBT-related variability in evaluating new drug product efficacies? One approach could be recruiting patients who have undergone at least one TURBT procedure. In this regard, we have performed a subgroup analysis of patients receiving 16 KLH instillations or 11 MM instillations and who had prior recurrent tumors (n = 156; KLH = 67 and MM = 89). The results showed that the percentage of recurrences for KLH-treated patients was 54% while the percentage of recurrence for MM treated patients was 38%. Statistical evaluation of product efficacy (chi-squared test) indicated that the two groups are not significantly different (p = 0.107).
Further supporting data has been reported by Lammers et al. . Subgroup analysis performed for patients with recurrent disease and a history of intravesical treatments, the number of patients with recurrences and time to recurrence was not statistically different for the KLH and MM treatment groups.
Different efficacy profile for KLH and mitomycin C exacerbate influence of TURBT on therapy outcome
Recurrence rate and median recurrence-free survival (RFS) for Keyhole Limpet Hemocyanin (KLH) and mitomycin C (MM) in patients with recurrence and complete treatment course who received additional treatment after transurethral resection of bladder tumor (TURBT) for prior tumor (KLH second-line treatment)
Recurrence rate (%)
95% confidence interval
In general, it appears that the recurrence rate between institutions or multiple clinical studies for bladder cancer patients treated with any of the currently used drug products (BCG and MM included) has a large variability [2, 4, 9].
The results of the prospective, randomized, multicenter, phase III clinical trial, “Intracutaneous and Intravesical Immunotherapy with Keyhole Limpet Hemocyanin Compared with Intravesical Mitomycin in Patients with Non-Muscle-Invasive Bladder Cancer,” have been published . The authors concluded that KLH has a different safety profile and is inferior to MM in preventing non-muscle-invasive bladder cancer.
This retrospective analysis of the same clinical data focused on evaluating center effects on product efficacy. From the statistical analysis of the individual centers, we identified two sets of hospital groups based on the p values (p < 0.05 and p > 0.05). The results indicate that the majority of the hospitals showed no statistical difference between KLH and MM with respect to median RFS. This suggests the presence of center effects in this clinical trial as evidenced by statistical comparison of the same drug product (KLH or MM) between the two hospital groups. The conclusion of this data would be that the same drug product is superior to itself between the two centers. As this is an illogical conclusion; among other possible determining factors, the TURBT procedure is suspected to be the main contributing factor. The patient data summary in Tables 1 and 2 suggests that there is no selection bias arising due to clinical and demographic patient characteristics. Such selection bias would normally be a prime determining factor but is not present in this well-designed clinical trial. Similar suspicions have been raised by other reports as it relates to variable observed recurrence rates between institutions. This report specifically expands on that concept to show that it has an effect on the efficacy determination of drug products.
This suggests that when performing new drug efficacy evaluation studies involving surgery as a prerequisite step, as is the case with bladder cancer, the operative experience of the surgeon [10, 11] is an additional important factor for consideration in designing future clinical studies.
In view of such differences in the efficacy of the same product used on patients in two groups of hospitals, proper care and procedures need to be taken in generalizing product efficacies. As suggested by Richsterstetter et al.  and Brausi et al. , suitable statistical procedures need to be utilized to account for interaction effect between product efficacy and multicenter effects before generalizing results of the clinical study. This additional confounding effect has to be taken into consideration when designing clinical trials with new drug products involving surgery as a prerequisite treatment step.
Once a product is approved, surgeons optimize surgical technique for a given drug product to provide improved clinical outcomes for their patients. Such modifications may be done unintentionally. As a result, when surgeons perform clinical studies using new product candidates, there may be an inherent bias in their surgical techniques toward their preferred choice of drug product.
Keyhole Limpet Hemocyanin
Transurethral resection of bladder tumor
Authors thank Wim P.J. Witjes, MD, PhD, Scientific and Clinical Research Director, CuraTrial SMO and Research, EAU Central Research Office, Radboud University, Nijmegen Medical Center, Nijmegen, The Netherlands and Christien T.M. Caris for providing the clinical trial data in SPSS format.
There is no direct funding for the project. However, a statistical consulting fee was given to NP.
Availability of data and materials
This is an independent secondary analysis of the dataset from Lammers RJM, Witjes WPJ, Janzing-Pastors MHD, Caris CTM, Witjes JA. Intracutaneous and Intravesical Immunotherapy with Keyhole Limpet Hemocyanin Compared with Intravesical Mitomycin in Patients with Non-Muscle-Invasive Bladder Cancer: Results From a Prospective Randomized Phase III Trial. J Clin Oncol. 2012 Jun 20;30(18):2273-9.
NP performed statistical analysis and manuscript preparation. SM was responsible for clinical interpretation, coordination and manuscript preparation. Both authors have read and approved the final manuscript related to this submission.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Babjuk M, Burger M, Zigeuner R, Shariat SF, van Rhijn BWG, Compérat E, et al. EAU guidelines on non-muscle-invasive urothelial carcinoma of the bladder: update 2013. Eur Urol. 2013;64(4):639–53.View ArticlePubMedGoogle Scholar
- Lammers RJM, Witjes WPJ, Janzing-Pastors MHD, Caris CTM, Witjes JA. Intracutaneous and intravesical immunotherapy with keyhole limpet hemocyanin compared with intravesical mitomycin in patients with non-muscle-invasive bladder cancer: results from a prospective randomized phase III trial. J Clin Oncol. 2012;30(18):2273–9.View ArticlePubMedGoogle Scholar
- Guidance for Industry – E9 Statistical Principles for Clinical Trials. U.S. Department of Health and Human Services Food and Drug Administration, Center for Drug Evaluation and Research, Center for Biologics Evaluation and Research. Rockville: ICH;1998.
- Jurincic CD, Engelmann U, Gasch J, Klippel KF. Immunotherapy in bladder cancer with keyhole-limpet hemocyanin: a randomized study. J Urol. 1988;139:723–6.PubMedGoogle Scholar
- Allard CB, Meyer CP, Gandaglia G, Chang SL, Chun FKH, Gelpi-Hammerschmidt F, et al. The effect of resident involvement on perioperative outcomes in transurethral urologic surgeries. J Surg Educ. 2015;72(5):1018–25.
- Jancke G, Rosell J, Jahnson S. Impact of surgical experience on recurrence and progression after transurethral resection of bladder tumour in non-muscle-invasive bladder cancer. Scand J Urol. 2014;48(3):276–83.View ArticlePubMedGoogle Scholar
- Mariappan P, Finney SM, Head E, Somani BK, Zachou A, Smith G, et al. Good quality white-light transurethral resection of bladder tumours (GQ-WLTURBT) with experienced surgeons performing complete resections and obtaining detrusor muscle reduces early recurrence in new non-muscle-invasive bladder cancer: validation across time and place and recommendation for benchmarking. BJU Int. 2012;109(11):1666–73.View ArticlePubMedGoogle Scholar
- Richterstetter M, Wullich B, Amann K, Haeberle L, Engehausen DG, Goebell PJ, et al. The value of extended transurethral resection of bladder tumour (TURBT) in the treatment of bladder cancer: the value of extended TURBT for treating bladder cancer. BJU Int. 2012;110(2b):E76–9.View ArticlePubMedGoogle Scholar
- Brausi M, Collette L, Kurth K, van der Meijden AP, Oosterlinck W, Witjes JA, et al. Variability in the recurrence rate at first follow-up cystoscopy after TUR in stage Ta T1 transitional cell carcinoma of the bladder: a combined analysis of seven EORTC studies. Eur Urol. 2002;41(5):523–31.View ArticlePubMedGoogle Scholar
- Rolevich AI, Minich AA, Nabebina TI, Polyakov SL, Krasny SA, Sukonko OG. Surgeon has a major impact on long-term recurrence risk in patients with non-muscle invasive bladder cancer. Cent European J Urol. 2016;69:170–7.PubMedPubMed CentralGoogle Scholar
- Hsu C-E, Lin T-K, Lee M-H, Lee S-T, Chang C-N, Lin C-L, et al. The impact of surgical experience on major intraoperative aneurysm rupture and their consequences on outcome: a multivariate analysis of 538 microsurgical clipping cases. PLoS One. 2016;11(3):e0151805. doi:10.1371/journal.pone.0151805.View ArticlePubMedPubMed CentralGoogle Scholar