- Open Access
- Open Peer Review
The challenge of recruiting patients into a placebo-controlled surgical trial
Trialsvolume 15, Article number: 167 (2014)
Randomized placebo-controlled trials represent the gold standard in evaluating healthcare interventions but are rarely performed within orthopedics. Ethical concerns or well-known challenges in recruiting patients for surgical trials in general have been expressed and adding a placebo component only adds to this complexity. The purpose of this study was to report the challenges of recruiting patients into an orthopedic placebo-controlled surgical trial, to determine the number of patients needed to be screened and allocated in order to include one participant into the trial, and to identify reasons associated with participation in a placebo-controlled randomized surgical trial.
Data were extracted from an ongoing placebo-controlled randomized controlled trial (RCT) on meniscectomy versus placebo surgery. We calculated the number of patients needed to be screened in order to include the required number of participants into the RCT. Participating patients were asked about their rationale for joining the study and which type of information was most useful for deciding upon participation.
A total of 476 patients entered the screening group, of which 190 patients fulfilled the inclusion and exclusion criteria. 102 patients declined to participate in the study due to various reasons and 46 were later excluded (no meniscus lesion on the magnetic resonance imaging scan or withdrawn consent). A total of 40 patients were finally included in the RCT. To include one patient into the RCT, 11.9 individuals needed to be screened. A total of 69% of participating patients considered the oral information to be the most important and the most common reason for participating was the contribution to research (90%).
Patients are willing to participate in an orthopedic placebo-controlled surgical trial. Oral information given by the surgeon to the patient and the contribution to research are important aspects to enhance patient recruitment.
ClinicalTrials.gov NCT01264991, registered 21 December 2010.
Randomized controlled trials (RCTs) represent the gold standard in evaluating healthcare interventions. The randomization of treatment and blinding of group allocation to the investigator and participants, possibly by use of a placebo, reduces bias . Though this design is considered gold standard in therapeutic trials this has not been the case within the field of surgery. Ethical concerns [2, 3] or well-known challenges in recruiting patients for surgical trial in general [4, 5] have been expressed and adding a placebo component only adds to this complexity.
We are not aware of any studies on the challenge of recruiting patients for a placebo-controlled orthopedic trial, specific screening procedures for identifying eligible patients, or motivation of patients to participate in a placebo-controlled orthopedic trial. One study on feasibility and acceptance showed that an orthopedic placebo-controlled trial could be conducted in principle, albeit with difficulty . The challenge of recruitment for an orthopedic RCT comparing rehabilitation plus early surgery with rehabilitation plus optional later surgery for an acute ACL (anterior cruciate ligament) tear have been reported,  but similar reports from placebo-controlled trials are lacking. Earlier placebo-controlled orthopedic studies have reported a recruitment rate between 35 and 71% [8–10] but no information exists on patient’s preferences and determinants of willingness to participate in an orthopedic placebo-controlled study.
Arthroscopic partial meniscectomy (APM) is the most commonly performed orthopedic procedure, carried out on 1 million patients annually in the United States . The mean age in most studies is around 50 years of age [8, 12–14], indicating the vast majority of procedures being performed in patients with a degenerative disease. Both meniscus injury and meniscectomy are associated with the development of knee osteoarthritis (OA) [15–17]. Previous studies in patients with or without concomitant OA have found APM to be no better than, or have no additional benefit in comparison to, placebo surgery, lavage, optimized non-surgical treatment, or exercise [8, 12–14].
This report describes the challenges of recruiting patients into an ongoing multicenter RCT  comparing APM to a placebo surgery of degenerative meniscus tears in a younger age group (between 35 and 55 years of age) at an earlier stage of disease. We provide the number of patients needed to be screened (NNS), and the number of patients needed to be allocated (NNA), in order to include the required number of participants into the RCT. We further identify the reasons associated with participation in a placebo-controlled randomized surgical trial by asking why patients were willing to participate and which type of information was most useful for deciding upon participation.
We recruited and screened patients aged between 35 and 55 years, having a magnetic resonance imaging (MRI) confirmed medial meniscus lesion and at least two months of knee pain without any previous significant trauma. Eligible patients were randomized to placebo surgery or APM after having agreed to participate in the RCT and after providing signed informed consent (Table 1).
Both APM and the placebo surgery were performed under general anesthesia but only skin incisions equivalent to two standard portals were performed in the placebo group.
The complete design and methodology of the study have been published . The study is approved by the Research Ethics Committee of Region Zealand, Denmark, and is consistent with the Declaration of Helsinki.
Patients referred from general practitioners were screened for eligibility by the principal investigator, an orthopedic surgeon in residency. If eligible, oral and written information were given about the study including a 12-minute DVD to view at home. A few days later the patients were contacted by telephone and provided temporary consent by phone, and if willing to participate they were referred for an MRI to confirm a meniscus lesion. If their MRI confirmed a medial meniscus lesion the patient provided written consent, was included in the study, and signed up for surgery if still willing to participate. The strategy of asking patients to participate before performing an MRI was chosen since an MRI is not routinely performed before an arthroscopy in Denmark.
Patients eligible for an MRI all received the same oral and written information. The oral information was given by the principal investigator in a standardized way. Patients were informed of the nature of a degenerative meniscus lesion, the treatment options, and hereunder surgery. They were informed about the lack of evidence for the effects of meniscus surgery in older age groups. They were then informed of the lack of trials in their age group, the need for a study, the general concept of the placebo effect, and the design of the current study, including information that placebo surgery would mean that no intervention on their meniscus tear would be performed.
The written information was identical to the oral information apart from formal information about study origin, study investigators, information on possible adverse events (most common infection and deep venous thrombosis) and other treatment modalities (such as exercise).
A 12-minute DVD was given to all eligible patients prior to the MRI to further ensure uniform dissemination of information to all patients. The video described the background for the study, the amount of involvement for participating and showed interviews of three different orthopedic surgeons with extensive experience within knee surgery giving their view on the condition and arthroscopic meniscus surgery.
The number needed to screen (NNS) and the number needed to allocate (NNA) are concepts used and described in previous studies [7, 19, 20]. The NNS was calculated by dividing the number of patients screened for eligibility with the number of patients included in the trial. Similarly the NNA was calculated by dividing the number of allocated patients with the number of included patients. All patients eligible for inclusion were regarded as allocated. The NNS and NNA provided an estimate of how many patients were needed to be screened and allocated to include one patient into the trial. Multiplied with the a priori determined sample size, the NNS gives an estimate of how many patients needed to be screened and the NNA an approximation of the total number of eligible patients necessary.
All participating patients were asked about their rationale for joining the study: wanting to contribute to research, wanting an operation no matter which type, or other, with room for elaboration. They were also asked which kind of information had been most beneficial in deciding whether or not to participate: the oral information given by the orthopedic surgeon, the written information, or the 12-minute DVD. The proportions of these answers were calculated and reported with 95% confidence intervals (95% CI).
Since the start of the study, 476 patients with a suspicion of medial meniscus injury referred from their general practitioner entered the screening group. A total of 190 patients fulfilled the inclusion and exclusion criteria and were thus eligible for an MRI. However, of these, 102 patients declined to participate in the study. More specifically, 77 did not wish to participate after reviewing the patient information, the reasons being: a) not wanting placebo surgery (38%), b) the risk of undergoing a secondary operation if allocated to the placebo group (21%), and c) not wanting surgery at all (19%). A small number (5%) did not want to participate in any scientific study and 17% had other reasons, mostly work-related. A total of 25 patients declined participation before reviewing the patient information and their reasons for declining participation were not collected. In addition, 46 were excluded after no visible meniscus tear was seen on MRI. Finally, 40 patients were included in the RCT (Figure 1). To include one patient into the RCT, 11.9 individuals with a suspected meniscus lesion needed to be screened. Similarly, the NNA was 4.8 individuals eligible for inclusion (prior to MRI) needed in order to include one patient in the RCT.
Of the 40 included patients, the most common reason for participating was the contribution to research (90% (80 to 100, 95% CI)) compared to other reasons (10% (0 to 20, 95% CI), P < 0.001). A total of 69% (54 to 84, 95% CI) of participating patients considered the oral information from the orthopedic surgeon as the most important compared to the written information and DVD (31% (16 to 46, 95% CI), P < 0.05).
There is a great need for randomized controlled, including placebo-controlled, orthopedic trials. The most common reasons for this lack of placebo-controlled surgical RCTs include ethical issues and difficulty in recruiting patients. The recruitment of patients into orthopedic RCTs is a well-recognized challenge [4, 5] and adding a placebo component to the trial potentially further complicates recruitment.
In our placebo-controlled study we showed that 46% of patients fulfilling clinical eligibility criteria were willing to participate in a placebo-controlled arthroscopy trial, fully aware they would have general anesthesia and possibly surgery without any real intervention being performed. These patients weighted the oral information given as more important than the written information and the 12-minute DVD when deciding whether to participate or not. They also reported that the contribution to science was the main reason for participating, which is similar to other studies [21–23].
A NNS of 11.9 is high, compared to other trials of orthopedic surgery. Buchbinder et al. reported a NNS of 6 for their placebo-controlled RCT of vertebroplasty and Frobell et al. reported an NNS of only 5.5 in their RCT study comparing rehabilitation plus early surgery with rehabilitation plus optional later surgery for an acute ACL injury. One other study by Katz et al. comparing APM in combination with physiotherapy or physiotherapy alone reported a NNS of 41.1, indicating only a minority of patients meeting the inclusion criteria. The NNS is markedly affected by the screening strategy, pathoanatomy and clinical inclusion criteria, and planned interventions, and hence will vary between different trials for different conditions. In this study the high NNS was influenced by the fact that the screening was made on a broad population of patients referred from general practitioners less experienced in knee examination and before any imaging was performed. Thus patients with symptoms and clinical signs not related to an MRI-verified meniscus injury constituted a large part of the screening population. Performing an MRI after clinical screening meant that more patients had to be screened. Future clinical trials of meniscus surgery may consider performing an MRI earlier during the screening process to lower the number of patients seen by the clinician. Degenerative meniscus tears are difficult to detect and assess by clinical examination alone  and in the present study an MRI failed to show a meniscus tear in 33% of eligible symptomatic patients willing to participate, confirming a poor correlation between clinical signs and MRI findings in this patient group [16, 25].
The NNA of 4.8 was also higher than other comparable studies: the NNA for the vertebroplasty trial  was 2.1, for the ACL treatment trial  1.6, and for another placebo-controlled study of medial degenerative tears by Sihvonen et al. the NNA was only 1.4. Despite this, it still took five years in five different centers to include 146 patients. That is approximately six patients included per year per center. This could suggest that definition of eligibility and/or timing of consent were different than from our study. The NNA in the study by Katz et al. was 3.8, mainly because approximately 60% of the patients declined to participate. In our study also more than half the patients declined to participate. This is no different from other placebo-controlled trials on already established surgical procedures and emphasizes the importance of evaluating the effect from surgical interventions in a similar fashion as for other therapeutic trials , alas prior to introducing a new surgical procedure. Another reason for the high NNA was that 17 patients withdrew their initial consent after their MRI. Half of these patients withdrew consent because, although having a positive MRI finding, their symptoms had regressed and they no longer experienced a need for surgery, and the other half because they would not risk receiving a placebo operation.
In conclusion we have shown that patients are willing to participate in an orthopedic placebo-controlled surgical trial. Challenges remain to improve screening procedures for an improved feasibility, and pilot studies are critical for a realistic assessment of NNS and NNA. We recommend that when recruiting patients for a placebo-controlled surgical trial, focus should be on the oral information given by an orthopedic surgeon and the patient’s contribution to science should be emphasized.
Anterior cruciate ligament
Arthroscopic partial meniscectomy
Digital video disc
Magnetic resonance imaging
Number needed to allocate
Number needed to screen
Randomized controlled trial.
Armitage P: The role of randomization in clinical trials. Stat Med. 1982, 1: 345-352. 10.1002/sim.4780010412.
London AJ, Kadane JB: Placebo that harms: sham surgery controls in clinical trials. Stat Methods Med Res. 2002, 11: 413-427. 10.1191/0962280202sm300ra.
Macklin R: The ethical problems of sham surgery in clinical trials. N Engl J Med. 1999, 341: 992-996. 10.1056/NEJM199909233411312.
Ergina PL, Cook JA, Blazeby JM, Boutron I, Clavien P-A, Reeves BC, Seiler CM: Challenges in evaluating surgical innovation. Lancet. 2009, 374: 1097-1104. 10.1016/S0140-6736(09)61086-2.
McLeod RS: Issues in surgical randomized controlled trials. World J Surg. 1999, 23: 1210-1214. 10.1007/s002689900649.
Campbell MK, Entwistle VA, Cuthbertson BH, Skea ZC, Sutherland AG, McDonald AM, Norrie JD, Carlson RV, Bridgman S: Developing a placebo-controlled trial in surgery: issues of design, acceptability and feasibility. Trials. 2011, 12: 50-10.1186/1745-6215-12-50.
Frobell R, Lohmander L, Roos E: The challenge of recruiting patients with anterior cruciate ligament injury of the knee into a randomized clinical trial comparing surgical and non-surgical treatment. Contemp Clin Trials. 2007, 28: 295-302. 10.1016/j.cct.2006.10.002.
Moseley JB, O’Malley K, Petersen NJ, Menke TJ, Brody BA, Kuykendall DH, Hollingsworth JC, Ashton CM, Wray NP: A controlled trial of arthroscopic surgery for osteoarthritis of the knee. N Engl J Med. 2002, 347: 81-88. 10.1056/NEJMoa013259.
Buchbinder R, Osborne RH, Ebeling PR, Wark JD, Mitchell P, Wriedt CJ, Graves SE, Staples MP, Murphy B: A randomized trial of vertebroplasty for painful osteoporotic vertebral fractures. N Engl J Med. 2009, 361: 557-568. 10.1056/NEJMoa0900429.
Sihvonen R, Paavola M, Malmivaara A, Itälä A, Joukainen A, Nurmi H, Kalske J, Järvinen TLN: Arthroscopic partial meniscectomy versus sham surgery for a degenerative meniscal tear. N Engl J Med. 2013, 369: 2515-2524. 10.1056/NEJMoa1305189.
Cullen K, Hall M, Golosinskiy A: Ambulatory surgery in the United States, 2006. Nat Health Stat Rep Nat Cent Health Stat. 2009, 11: 1-28.
Katz JN, Brophy RH, Chaisson CE, de Chaves L, Cole BJ, Dahm DL, Donnell-Fink LA, Guermazi A, Haas AK, Jones MH, Levy BA, Mandl LA, Martin SD, Marx RG, Miniaci A, Matava MJ, Palmisano J, Reinke EK, Richardson BE, Rome BN, Safran-Norton CE, Skoniecki DJ, Solomon DH, Smith MV, Spindler KP, Stuart MJ, Wright J, Wright RW, Losina E: Surgery versus physical therapy for a meniscal tear and osteoarthritis. N Engl J Med. 2013, 368: 1675-1684. 10.1056/NEJMoa1301408.
Herrlin S, Hållander M, Wange P, Weidenhielm L, Werner S: Arthroscopic or conservative treatment of degenerative medial meniscal tears: a prospective randomized trial. Knee Surg Sports Traumatol Arthrosc. 2007, 15: 393-401. 10.1007/s00167-006-0243-2.
Kirkley A, Birmingham TB, Litchfield RB, Giffin R, Willits KR, Wong CJ, Feagan BG, Donner A, Griffin SH, D’Ascanio LM, Pope JE, Fowler PJ: A randomized trial of arthroscopic surgery for osteoarthritis of the knee. N Engl J Med. 2008, 359: 1097-1107. 10.1056/NEJMoa0708333.
Englund M: The role of the meniscus in osteoarthritis genesis. Rheum Dis Clin N Am. 2008, 34: 573-579. 10.1016/j.rdc.2008.05.009.
Englund M, Guermazi A, Roemer FW, Aliabadi P, Yang M, Lewis CE, Torner J, Nevitt MC, Sack B, Felson DT: Meniscal tear in knees without surgery and the development of radiographic osteoarthritis among middle-aged and elderly persons: The multicenter osteoarthritis study. Arthritis Rheum. 2009, 60: 831-839. 10.1002/art.24383.
Englund M, Lohmander LS: Risk factors for symptomatic knee osteoarthritis fifteen to twenty-two years after meniscectomy. Arthritis Rheum. 2004, 50: 2811-2819. 10.1002/art.20489.
Hare KB, Lohmander LS, Christensen R, Roos EM: Arthroscopic partial meniscectomy in middle-aged patients with mild or no knee osteoarthritis: a protocol for a double-blind, randomized sham-controlled multi-centre trial. BMC Musculoskelet Disord. 2013, 14: 1-10.1186/1471-2474-14-1.
Rembold CM: Number needed to screen: development of a statistic for disease screening. BMJ. 1998, 317: 307-312. 10.1136/bmj.317.7154.307.
Nelson HD, Helfand M, Woolf SH, Allan JD: Screening for postmenopausal osteoporosis: a review of the evidence for the U.S. preventive service task force. Ann Intern Med. 2002, 137: 529-541. 10.7326/0003-4819-137-6-200209170-00015.
Sharp L, Cotton SC, Alexander L, Williams E, Gray NM, Reid JM: Reasons for participation and non-participation in a randomized controlled trial: postal questionnaire surveys of women eligible for TOMBOLA (Trial Of Management of Borderline and Other Low-grade Abnormal smears). Clin Trials. 2006, 3: 431-442. 10.1177/1740774506070812.
Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R: Barriers to participation in randomized controlled trials: a systematic review. J Clin Epidemiol. 1999, 52: 1143-1156. 10.1016/S0895-4356(99)00141-9.
Prescott RJ, Counsell CE, Gillespie WJ, Grant AM, Russell IT, Kiauka S, Colthart IR, Ross S, Shepherd SM, Russell D: Factors that limit the quality, number and progress of randomized controlled trials. Health Technol Assess. 1999, 3: 1-143.
Hegedus EJ: Physical examination tests for assessing a torn meniscus in the knee: a systematic review with meta-analysis. J Orthop Sports Phys Ther. 2007, 37: 541-550. 10.2519/jospt.2007.2560.
Englund M, Guermazi A, Gale D, Hunter DJ, Aliabadi P, Clancy M, Felson DT: Incidental meniscal findings on knee MRI in middle-aged and elderly persons. N Engl J Med. 2008, 359: 1108-1115. 10.1056/NEJMoa0800777.
Frobell R, Roos EM, Roos HP, Ranstam J, Lohmander LS: A randomized trial of treatment for acute anterior cruciate ligament tears. N Engl J Med. 2010, 363: 331-342. 10.1056/NEJMoa0907797.
Cook JA, McCulloch P, Blazeby JM, Beard DJ, Marinac-Dabic D, Sedrakyan A: IDEAL framework for surgical innovation 3: randomised controlled trials in the assessment stage and evaluations in the long term study stage. BMJ. 2013, 346: f2820-10.1136/bmj.f2820.
The authors would like to acknowledge the support from the University of Southern Denmark, Odense; the Orthopedic Departments of Slagelse and Næstved Hospital; the Research Unit of Hospital South, Region Zealand; Edith and Henrik Henriksens Memorial Fund for a grant (December 2010); Region Zealand Health Scientific Research Fund for a grant (November 2010); and Research Fund of Hospital South for funding of KBH.
The authors declare that they have no competing interests.
KBH participated in the design of the study, was responsible for data collection and drafted the manuscript. LSL participated in the design of the study and helped to draft the manuscript. EMR participated in the design of the study and helped to draft the manuscript. All authors read and approved the final manuscript.