Variability in research ethics review of cluster randomized trials: a scenario-based survey in three countries
© Taljaard et al.; licensee BioMed Central Ltd. 2014
Received: 17 September 2013
Accepted: 21 January 2014
Published: 5 February 2014
Cluster randomized trials (CRTs) present unique ethical challenges. In the absence of a uniform standard for their ethical design and conduct, problems such as variability in procedures and requirements by different research ethics committees will persist. We aimed to assess the need for ethics guidelines for CRTs among research ethics chairs internationally, investigate variability in procedures for research ethics review of CRTs within and among countries, and elicit research ethics chairs’ perspectives on specific ethical issues in CRTs, including the identification of research subjects. The proper identification of research subjects is a necessary requirement in the research ethics review process, to help ensure, on the one hand, that subjects are protected from harm and exploitation, and on the other, that reviews of CRTs are completed efficiently.
A web-based survey with closed- and open-ended questions was administered to research ethics chairs in Canada, the United States, and the United Kingdom. The survey presented three scenarios of CRTs involving cluster-level, professional-level, and individual-level interventions. For each scenario, a series of questions was posed with respect to the type of review required (full, expedited, or no review) and the identification of research subjects at cluster and individual levels.
A total of 189 (35%) of 542 chairs responded. Overall, 144 (84%, 95% CI 79 to 90%) agreed or strongly agreed that there is a need for ethics guidelines for CRTs and 158 (92%, 95% CI 88 to 96%) agreed or strongly agreed that research ethics committees could be better informed about distinct ethical issues surrounding CRTs. There was considerable variability among research ethics chairs with respect to the type of review required, as well as the identification of research subjects. The cluster-cluster and professional-cluster scenarios produced the most disagreement.
Research ethics committees identified a clear need for ethics guidelines for CRTs and education about distinct ethical issues in CRTs. There is disagreement among committees, even within the same countries, with respect to key questions in the ethics review of CRTs. This disagreement reflects variability of opinion and practices pointing toward possible gaps in knowledge, and supports the need for explicit guidelines for the ethical conduct and review of CRTs.
KeywordsCluster randomized trials Informed consent Research ethics guidelines Research ethics review Web-based survey
Cluster Randomized Trials (CRTs), that is, trials in which the units of randomization are intact social units or groups, rather than independent individuals, are an increasingly common design in health research [1, 2]. It is convenient to distinguish between three kinds of CRTs depending on the level of intervention: cluster-cluster trials (experimental interventions administered to the entire cluster as a unit), professional-cluster trials (experimental interventions administered to health or other professionals), and individual-cluster trials (experimental interventions administered to patients or individuals) [3, 4]. An example of a cluster-cluster trial is the COMMIT study, in which 22 communities in the United States and Canada were randomized to evaluate a community-wide advertising campaign to reduce smoking . In the Nexus trial, an example of a professional-cluster trial, 247 primary care practices were randomized to evaluate the effect of audit and feedback and reminder messages on radiology referrals , while in the bed net trial, an example of an individual-cluster trial, 36 villages were randomized to evaluate the impact of distribution of insecticide-treated bed nets to individual citizens on malaria morbidity and mortality in remote areas of Cambodia .
There are many aspects of CRTs that complicate their ethical design, conduct and review (beyond the statistical complications) [3, 8–10]. In the absence of guidance tailored to CRTs, researchers and research ethics committees have had to rely on variable interpretation of existing research ethics guidelines, which were developed primarily with individually randomized trials in mind. This has likely contributed to variation in how CRTs have been conducted in practice, as well as in the requirements and decisions by different research ethics committees [11, 12]. Between 2008 and 2012, we conducted a mixed-methods research project to develop internationally accepted, principled guidelines for the ethical design, conduct, and review of CRTs . As part of the effort to develop these guidelines, we conducted a web-based survey of chairs of research ethics committees (Research Ethics Boards (REBs) in Canada, Research Ethics Committees (RECs) in the United Kingdom, Institutional Review Boards (IRBs) in the United States). The main objectives of this survey were to a) evaluate the need among research ethics committees for guidelines specific to CRTs, b) gather information about the research ethics review process for CRTs at their institutions, and c) elicit their views on ethical issues in CRTs using a scenario-based approach.
The target population was chairs of research ethics committees (one per institution) in Canada, the United States, and the United Kingdom that a) are currently active, b) review health-related human subjects (that is, biomedical) research, and c) review randomized controlled trials.
The target sample size for the survey was 300, based on estimating the proportion of chairs who agree or strongly agree that there is a need to develop research ethics guidelines for CRTs. A total of 300 respondents would be sufficient to allow a 95% two-sided confidence interval to extend ± 5.7% around an expected proportion of 50%, which is the proportion that yields the maximum width. Assuming a response rate of 50%, we anticipated that we would need to survey all REBs in Canada, all RECs in the United Kingdom, and a random sample of IRBs from the United States. Our expected sample sizes were therefore 90 to 100 Canadian chairs, 50 to 60 United Kingdom chairs, and 150 to 160 United States chairs, for an overall total of 300 respondents.
In Canada we used a list of 252 'biomedical’ REBs supplied by the National Council on Ethics in Human Research (NCEHR). As this list was approximately 10 years out of date, it was cross-checked against the list of Canadian-based IORGs provided by the OHRP to obtain updated contact information and to identify any additional REBs. For those REBs not on the OHRP list, we attempted to obtain their updated contact information by conducting online searches, sending an email to the contact on file, and making telephone calls. The final sample size in Canada was 195 REBs.
In the United Kingdom, we used a list obtained from the National Research Ethics Service (NRES) to identify 119 active RECs. We cross-checked this list against the United Kingdom-based IORGs on the list provided by the OHRP and identified an additional 36 (mostly university-based) RECs. The final sample size in the United Kingdom was 152 RECs.
Description of three scenarios of cluster randomized trials presented in survey
Cluster-cluster trial (mass media advertising for colorectal cancer screening)
A researcher at your institution is proposing a cluster randomized trial to evaluate a radio, television, and billboard advertising campaign aimed at increasing the proportion of community residents who receive colorectal cancer screening according to well-accepted national guidelines. Cluster randomization is used because the intervention (the advertising campaign) is delivered to the community as a whole. Twenty cities will be randomly assigned to either the intervention group or a control group receiving no intervention. A random sample of 500 residents in each city will be surveyed before the intervention, and a separate random sample of 500 residents in each city will be surveyed after the intervention, to determine the proportions that have been screened. The surveys will be conducted by telephone using random digit dialing. No personally identifying information will be collected in the surveys.
Professional-cluster trial (professional education to reduce imaging)
A researcher at your institution is proposing a cluster randomized trial to evaluate an educational intervention designed to reduce unnecessary requests for X-rays in accordance with well-accepted national guidelines (which have been widely available for two years) for patients with nontraumatic back and knee pain. All 250 general practices in the study area will be randomly assigned to either the educational intervention or a control group. The guidelines will be mailed to all general practitioners (GPs) in intervention and control practices, but intervention GPs will additionally receive regular reminder messages about the guidelines by mail, as well as feedback about the number of X-rays ordered by their whole practice compared with requests made by all GPs in the study. Study outcome 1 is the number of X-rays ordered per thousand patients using data routinely collected by radiology departments. These data will be sent to the researchers with GP identifiers included, to allow the researchers to prepare feedback to the practices about their number of X-ray requests. Study outcome 2 is the percentage of X-ray requests that are concordant with the guidelines, determined by researchers reviewing and collecting anonymized data from a randomly chosen subset of 100 patient records per practice.
Individual-cluster trial (distribution of bed nets against malaria)
A researcher at your institution is proposing a cluster randomized trial to evaluate a malaria prevention intervention. Thirty villages in Cambodia with a total population of 10,000 will be randomly assigned to either an intervention group in which insecticide-treated bed nets will be distributed to all residents (by delivering them to each household), or a control group in which no bed nets will be distributed to any residents. Cluster randomization is used because the bed nets can only be effective in preventing the spread of malaria if they are used by the majority of residents in a village and because the investigators feel that it would not be acceptable to distribute bed nets to only a random half of the residents in a village. Although insecticide-treated bed nets have previously been shown to be effective against malaria in most tropical and subtropical regions, there are differences in vector biting cycles and malaria epidemiology in South East Asia that raise questions about the effectiveness of the insecticide-treated bed nets in Cambodia. Village volunteers in both intervention and control villages will be trained to recognize malaria symptoms and administer standard anti-malarial treatment. Villagers will be told that they can consult the village malaria worker when unwell. Malaria prevalence will be determined before and after the intervention using blood tests from cross-sectional random samples of 250 people per village.
The survey was conducted between April and July 2011. A series of five contacts, based on Dillman’s recommendations for the implementation of mail and internet surveys, was used . An invitation was sent to the chair or committee contact on file including the survey URL, a unique password, and details of confidentiality. A thank you and reminder email was sent to all contacts 1.5 weeks after the invitation, with reminder emails sent 3 and 5 weeks after the invitation. As a 'special’ contact has been shown to improve overall response to mail surveys, a final reminder was sent by postal mail approximately 8 weeks after the initial invitation. A $30 Amazon gift certificate was offered to each respondent as an incentive.
Categorical variables were described using frequencies and percentages. Exact or asymptotic methods were used to calculate 95% confidence intervals (CIs) of percentages for the main outcomes. We conducted tests of association using chi-squared or Fisher’s exact tests as appropriate. Verbatim comments from open text boxes were selected to illustrate the range of perspectives.
Participants were informed that participation is voluntary and assured of the confidentiality of their responses. Submission of the questionnaire was considered as consent. The study procedures were approved by the Ottawa Hospital Research Ethics Board.
Of 647 contacts surveyed, 105 were discovered to be ineligible; of the remaining 542 chairs, 189 responded, giving an overall response rate of 35%. Response rates were slightly higher in Canada (39%) than in the United Kingdom (35%) and the United States (32%) (P = 0.36). To help understand why response rates were lower than anticipated, we compared response rates by various aspects of the sampling design. First, we explored whether outdated contact information was a factor within Canada. We found that response rates were significantly higher among those with updated contact information from the OHRP list (49% versus 27%, P = 0.006). Next, we explored whether the inclusion of nonbiomedical committees was a factor within the United States. We found that response rates were higher among the top funded NIH institutions (more likely to be biomedical) (36% versus 26%, P = 0.08). In the United Kingdom, we compared response rates among university (29%) and National Research Ethics Service committees (36%) but found no significant difference (P = 0.50).
Characteristics of respondents
Characteristics of participating ethics committees and chairs
(N = 60)
(N = 86)
(N = 43)
(N = 189)
Ethics committee characteristics
1990 to 1999
> = 2000
# Protocols/month (Median, Q1-Q3)
5 (3 to 20)
30 (10 to 60)
8 (7 to 8)
10 (5 to 37.5)
Type of committee b
National Research Ethics Service
Number of CRTs /year
1 to 5
Have guidelines in place for CRTs
Aware of guidelines for CRTs
Ethics Chair characteristics
Years experience as chair
2 to 5
Years experience as member
6 to 10
Highest degrees c
Perceived need for guidelines
Need for ethics guidelines for cluster randomized trials (CRTs): number (%) agreeing or strongly agreeing with each statement
(N = 55)
(N = 79)
(N = 37)
(N = 175)
There is a need to develop ethics guidelines for CRTs
Ethics committees need more information about ethical issues in CRTs
Application forms ought to be designed separately for CRTs
Types of review required for each scenario
Illustrative verbatim explanations for the type of review required, by country: cluster-cluster scenario
Type of review
Full Board review would be recommended for the following reasons: a) community consent versus individual consent, b) there is an element of deception, c) the treatment/intervention received is determined by randomization, d) the telephone surveys deal with potentially sensitive topic (colorectal screening) and could result in situations where there is a need for follow-up medical and/or psychological care.
Review is necessary due to 'research’ component and to ensure privacy and patient rights are protected. Expedited as there is no experimental manoeuvre, screening is according to national guidelines.
The researcher is outside our jurisdiction - They are using subjects who are unlikely to be our patients. At the beginning, consent is not required except at the municipal level. There is no financial liability to the hospital. There is no treatment intervention. I see this as no different from the telephone surveys I receive now at home. It would be polite and professionally correct to bring this to the ethics committee as an FYI. If the researcher wanted to add gravitas to his/her survey they might ask for the 'blessing’ of the ethics committee. However , as before, it not being done on hospital property, involves no patients and no therapeutic intervention.
The exceptions are minimal risk studies with small numbers of participants, which have no contentious issues. In this case, 1,000 participants, approached by random 'cold-call’ telephone with verbal consent required and no prior information, would be rated by us as large and potentially contentious.
The proposed trial deals with a situation where the normal practice is 'no intervention’; there’s no specific bowel screening promotion as described in the UK. Expedited review would be to address whether the materials provided to the Mayors/Officials of the cities involved enough information to understand the proposed research. There is low/no risk to participating citizens and the interventions would be considered 'light touch’ and of low risk; unless of course review of the proposed telephone interview guidelines revealed significant intrusive or alarming questions.
Because it is the effectiveness of the advertising campaign that is to be evaluated and this in itself is not a medical intervention and I would regard the study as in support of delivering an established standard of normal care.
I think the questions raised by the methodology, in particular the randomization to a community intervention without individual consent, would merit consideration by the full board.
The study as described presents no more than minimal risk to the sample involved. The dependent measure is related to behavior. The study is not inviting participants to get a colorectal exam offered by the investigators. The study measures are related to the effectiveness of an information campaign.
This is a survey, should be exempt 45 CFR 46.101 #2.
Illustrative verbatim explanations for the type of review required, by country: professional-cluster scenario
Type of review
This study would require REB approval because there is an intervention, patient data is collected and consent is not planned. There is the onus to review fully given the lack of a consent process, regardless of the reason.
Meets all Tri-Council Policy Statement (TCPS) criteria for minimal risk.
This seems to be more akin to a Quality Improvement study of whether an educational intervention and reminders about an accepted Clinical Guideline leads to greater acceptance and adoption of these practices. Our REB does not review these, but there is a process of review and support for these studies through our Quality and Risk Management Dept. All interventions and practices are clinically indicated and data is only aggregate.
Because of the randomisation of practices. Otherwise could have been considered as a service evaluation and therefore not require review (potentially!)
Minimal risk, using routinely collected data, assuming that patient data for outcome 2 are properly anonymised and secure, and do not require information that is outside normal clinical care.
This is classic improvement methodology and would not need review.
There is an issue of physicians being known to the researchers and the potential for data about their behavior that could be used to potentially harm the physician’s reputation due to information about his/her medical practices (x-rays).
We would not consider an educational intervention as treatment. The educational intervention mailing established imaging guidelines is clearly minimal risk. Measuring radiology imaging by GP is not private information and routinely measured by many external entities. The outcome measures of number X-rays/thousand and anonymized medical records review would meet Expedited review categories.
This seem to be primarily a trial to determine quality of care and use or misuse of diagnostic studies. No patient is harmed or helped by the study. It may help cost containment. It doesn’t need to come to the IRB.
Identification of research subjects
Canada: They are all involved. The degree of protections required depends on the protocol itself, potential harms or burdens, potential benefits, what would happen anyway and what happens specifically because of the research. All this will vary.
United Kingdom: The intervention is targeted at the entire community, not only those who undergo screening.
United States: All residents in the intervention cities are potentially exposed to effects in the information campaign, and thus should be protected from effects of inappropriate content, no matter whether they actually were exposed to the advertisements. (For example, a spouse might hear the advertisement and prompt the other spouse to schedule screening.)
Identification of research subjects in the cluster-cluster, professional-cluster, and individual-cluster trial scenarios
All city residents in the intervention arm
All city residents in the control arm
Residents exposed to the advertisements
Residents in intervention arm receiving screening
Residents participating in the telephone survey
All patients in the practices
Patients presenting with back or knee pain
Patients providing data for study outcome 1
Patients providing data for study outcome 2
All GPs in intervention practices
All GPs in control practices
GPs whose patients present with back or knee pain
Residents receiving bed nets
Residents in control arm receiving no bed nets
Residents providing blood samples
Village malaria workers
Canada: No data is collected from all residents, only those sampled. Advertising for clinical procedures with or without generic advice is a normal experience of everyday life.
United Kingdom: The intervention is the advertising so those not exposed and not questioned are no different to those citizens in any uninvolved city. The screening itself is not research;- it is a standard health process which a proportion of citizens would choose to undergo regardless.
United States: The entire population cannot be considered as research subjects, both from a practical and study design perspective. Some may be affected by the advertising, but there are myriad ways for individuals to encounter similar messages and it would be virtually impossible to know what influenced their ultimate behavior. The residents who are directly contacted can more legitimately be considered as 'research’ subjects, given their direct participation in the survey instruments.
Canada: All GPs in the intervention and control practices even if their own habits aren’t being collected, because results will reflect on the quality of the practice in general and thus may impact on all of the GPs practicing in that practice.
United States: Would be concerned about whether study would have an impact on ordering of x-rays overall, so even patients who present with other than back or knee pain could be affected.
United Kingdom: Even if anonymised aggregated data is collected technically the patients are research subjects and the ethics committees are acting on their behalf to protect the appropriate use of their data.
United Kingdom: This trial is concerned with GPs - the aim is simple - if given feedback will GPs reduce the number of X ray requests - patients are not subjects - they are just a source of data.
United States: The patients are not having an intervention performed on them directly and are therefore not research subjects. The physicians are being active participants and are therefore research subjects.
In the individual-cluster scenario (bed nets to prevent malaria) there was much less variability. Almost all chairs indicated that residents who provided blood samples (98%), and the majority of those who received bed nets (88%), would be considered research subjects. A slightly lower percentage (80%) would also consider residents in control communities (not receiving bed nets) to be research subjects. Approximately 40% included village malaria workers as research subjects.
Any other comments
Canada: Occasionally I have been aware of cluster trials that deal with the evaluation of different forms of practice that are currently being done and for which there are no current standards of care proscribed. For example, use of different sets of antibiotics after cardiac interventions or changes in feeding in ICUs. What has been questioned are the following: What really constitutes an intervention (using (Tri-Council Policy Statement) as a guide) and therefore when should consent be obtained; where would one draw the line between quality assurance and research? Concern has also been raised about whether the trend for cluster trials is a mechanism to avoid the rigors of the consent process. Are letters of information sufficient to address this concern. These issues relate not so much to the large population studies, but rather to cluster trials being conducted in the current health care settings.
Canada: Most of the discussions we have had when discussing cluster RCT centered around the informed consent issues, when to waive consent, how much information to reveal, how much choice is there when the whole institute is already randomized to a certain intervention or not, and how to address situations where it is not beneficial for certain patients to be enrolled in the wrong intervention for their situation. For example, in a hospital cluster RCT where one hospital is randomized to a certain surgical process while the other is not, patients who are contraindicated to that surgery who end up in the intervention arm should be given the opportunity to refuse participation. In which case, they may have to be referred to another hospital not in the study.
United States: We have struggled with many issues related to this- when the Ministry of a country plans a roll out of a public health intervention and the research is to perform a cluster analysis of the intervention, what is research, what is a public health program evaluation and similar issues. This is still a topic of discussion and debate, especially between the IRB and international researchers.
This survey was conducted as part of a five-year project studying ethical issues in CRTs . Following a series of empirical studies (including this survey), an in-depth ethical analysis, and an extensive consensus process, the Ottawa Statement ─ the first comprehensive ethics guidelines specific to CRTs ─ was published in November 2012 . Although the survey was fielded before development of the Ottawa Statement, it is informative to interpret the results of the survey in light of the recommendations in the Ottawa Statement.
The first aim of the survey was to determine the need for research ethics guidelines for CRTs among research ethics chairs internationally. We found that 84% of research ethics chairs overall recognized the need for ethics guidelines for CRTs and 92% the need for education of ethics committees about ethical issues in CRTs. The perceived need for guidelines was not significantly associated with experience reviewing CRTs, which suggests that the need remains widespread and is not declining with experience. In our survey of 182 trialists (authors of CRTs) conducted as part of the five-year project, 74% (95% CI 67 to 80%) agreed or strongly agreed that there is a need to develop ethics guidelines for CRTs and 70% (95% CI 63 to 77%) that ethics committees could be better informed about distinct ethical issues surrounding CRTs . Surprisingly, the proportions of research ethics chairs indicating the need for ethics guidelines were higher than the corresponding proportions of trialists.
Our second aim was to investigate research ethics review procedures for three different kinds of CRTs. We found that there was little agreement among committees in the type of ethics reviews required in the cluster-cluster and professional-cluster scenarios, both among and within countries. Whereas regulatory differences may explain differences among countries, it does not explain within-country variability. Whereas there was more agreement in the individual-cluster scenario, cluster-cluster trials and professional-cluster trials often evaluate public health programs or quality improvement initiatives, and it is not always clear if such trials ought to be considered research and undergo research ethics review. According to Recommendation 1 in the Ottawa Statement, all CRTs involving human research participants must be submitted to a research ethics committee. This includes CRTs evaluating quality improvement and knowledge translation interventions, and those in education or public health research. The type of ethics review is subject to the discretion of the committee; research ethics committees ought to undertake a proportional approach to the review of study protocols such that CRTs that pose substantial risk or involve vulnerable participants ought to receive intensive scrutiny, whereas CRTs that pose low risk and do not involve vulnerable participants may be eligible for an expedited or delegated review. Although the majority of respondents in all three scenarios agreed that some type of review is required (as opposed to no review), variability in the type of review required is an important finding as it reflects fundamental differences among committees with respect to the perceived level of risk associated with each scenario and the perceived vulnerability of those who might be considered participants. The type of review may have implications with respect to the level of scrutiny a protocol will receive during the review process, the number of reviewers assessing a protocol, and the time required to complete the review process.
Our third aim was to characterize the views of research ethics chairs on the identification of research subjects. The proper identification of research subjects is of considerable importance, as only those cluster members who are research subjects properly fall under the protection of research ethics committees and the regulations under which they operate. We observed substantial variability among chairs in all three countries with respect to the identification of research subjects in the cluster-cluster and professional-cluster scenarios. The individual-cluster scenario, which most resembles a standard randomized controlled trial, presented less disagreement. According to the Ottawa Statement [17, 18] a research participant is defined as any individual whose interests may be affected as a result of study interventions or data collection procedures; that is, any individual who is the recipient or the direct target of a study intervention (whether an individual level or cluster level intervention), with whom researchers interact for study purposes, or about whom identifiable private information is collected. In the cluster-cluster scenario, fewer than one-third of chairs would consider residents in intervention and control communities to be research subjects, even though study interventions are targeted at them. It is a unique characteristic of CRTs that there can be participants at both individual and cluster levels. Surprisingly, in agreement with the Ottawa Statement, two-thirds of chairs indicated that they would consider health professionals to be research subjects. On the other hand, nearly 40% would consider patients whose health professionals participate in a knowledge translation intervention and who contribute only aggregate data (that is, practice-level imaging rates) to be research subjects. It is possible that those respondents who were broadly inclusive in identifying individuals who may be subjects in a CRT were doing so because they believed that the study required full ethics review and this would be one way to that end. Furthermore, although the need to seek informed consent is a separable issue , it is possible that chairs conflated the identification of research participants with the need to seek informed consent. The Ottawa Statement may help to avoid conceptual confusion by providing clarity on these important questions.
To the best of our knowledge, this is the first study to compare deliberations and decisions among research ethics committees in the review of CRTs. Although the scenarios were hypothetical, they represent three common settings where CRTs are used and are based on published CRTs. Participants in our survey provided perspectives from chairs in three countries: Canada, the United States, and the United Kingdom, and represented a variety of institutions: universities, hospitals, non-profit and for-profit, and varying degrees of experience. Our study provides empirical data of variability among committees both within and among countries in key decisions about the ethics review and conduct of CRTs. Although variability among ethics committees is not necessary morally problematic , these decisions have clear repercussions for the ability of research ethics committees to fulfill their purpose which includes protecting the rights and wellbeing of all research participants and to provide independent, competent, and timely review of the ethics of proposed studies .
Our study has two main limitations. First, our response rate was low and results may therefore not be representative. There can be many reasons for the low response. One is that our sampling frame was imperfect. Despite our best efforts at obtaining updated contact information and screening out ineligible committees prior to sampling, 105 of the 647 sampled committees (16%) either indicated that they were ineligible (that is, were nonbiomedical or did not review randomized controlled trials) or had invalid email addresses. Our stated response rate is conservatively calculated, meaning that all non-respondents are assumed to be eligible and included in the denominator of the response rate. The type of contact information varied: in some cases we had an email address for a named chair, while for others, only a central contact was available. Our analyses of response rates showed that response rates were higher among committees with more recent contact information; it was also higher among committees at NIH-funded institutions (more likely to be biomedical). Finally, our survey was relatively long and presented three complex scenarios; research ethics chairs are busy professionals and may simply not have had the time to complete the survey. Although we do not have any information that would allow us to investigate differences between respondents and non-respondents, we have no reason to expect answers of non-respondents to differ substantially from those observed in this survey.
A second limitation is that the descriptions of the scenarios were necessarily brief. In practice, ethics committees would have access to the full study protocol. It is possible that at least some of the variability observed is due to the lack of clarity or incompleteness of the information provided. However, we believe that the most relevant information was presented in each scenario, and the results are in line with findings from our survey of CRT investigators, which suggested that there are substantial challenges in practice. We were pleasantly surprised by the level of detail and thoughtfulness put into the open text responses. It was apparent that the majority of respondents paid careful consideration to the details provided in the scenarios and presented well-articulated and clear responses. This suggests that respondents understood that the scenarios were intended to trigger reflection on a certain class of study, rather than limit their consideration to those details provided in the survey alone.
CRTs are an important research design, but research ethics committees and investigators need guidance as to ethically appropriate practices. Our scenario-based survey provides empirical evidence of the likely variability of opinion and practices within and among countries, pointing towards possible gaps in knowledge, and further supporting the need for guidelines.
cluster randomized trial
Institutional Review Board Organization
Institutional Review Board
National Council on Ethics in Human Research
National Institutes of Health
National Research Ethics Service
Office of Human Research Protections
Research Ethics Board
Research Ethics Committee
Tri-Council Policy Statement.
We thank Stephanie Sturgeon (OHRI) and Shazia H. Chaudhry (University of Ottawa) for assistance with coordinating the survey and Annick Tanguay (University of Ottawa) for help with updating contact information on the sampling frame. We thank the research ethics chairs for taking the time to complete our survey questionnaire and for providing thoughtful answers to the many open-ended questions.
This work was supported by the Canadian Institutes of Health Research [grant number MOP85066, MOP89790]. Jeremy Grimshaw holds a Canada Research Chair in Health Knowledge Transfer and Uptake. Charles Weijer holds a Canada Research Chair in Bioethics.
- Donner A, Klar N: Design and analysis of cluster randomization trials in health research. 2000, London: Arnold
- Campbell MK, Mollison J, Steen N, Grimshaw JM, Eccles M: Analysis of cluster randomized trials in primary care: a practical approach. Fam Pract. 2000, 17: 192-196. 10.1093/fampra/17.2.192.View ArticlePubMed
- Edwards SJL, Braunholtz DA, Lilford RJ, Stevens AJ: Ethical issues in the design and conduct of cluster randomised controlled trials. Br Med J. 1999, 318: 1407-1409. 10.1136/bmj.318.7195.1407.View Article
- Eldridge SM, Ashby D, Feder GS: Informed patient consent to participation in cluster randomized trials: an empirical exploration of trials in primary care. Clin Trials. 2005, 2: 91-98. 10.1191/1740774505cn070oa.View ArticlePubMed
- The COMMIT Group: Community intervention trial for smoking cessation (COMMIT): II. Changes in adult cigarette smoking prevalence. Am J Public Health. 1995, 85: 193-200.View Article
- Eccles M, Steen N, Grimshaw J, Thomas L, McNamee P, Soutter J, Wilsdon J, Matowe L, Needham G, Gilbert F, Bond S: Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial. Lancet. 2001, 357: 1406-1409. 10.1016/S0140-6736(00)04564-5.View ArticlePubMed
- Sochantha T, Hewitt S, Nguon C, Okell L, Alexander N, Yeung S, Vannara H, Rowland M, Socheat D: Insecticide-treated bednets for the prevention of Plasmodium falciparum malaria in Cambodia: a cluster-randomized trial. Trop Med Int Health. 2006, 11: 1166-1177. 10.1111/j.1365-3156.2006.01673.x.View ArticlePubMed
- Hutton JL, Eccles MP, Grimshaw JM: Ethical issues in implementation research: a discussion of the problems in achieving informed consent. Implement Sci. 2008, 3: 52-10.1186/1748-5908-3-52.PubMed CentralView ArticlePubMed
- Hutton JL: Are distinctive ethical principles required for cluster randomized controlled trials?. Stat Med. 2001, 20: 473-488. 10.1002/1097-0258(20010215)20:3<473::AID-SIM805>3.0.CO;2-D.View ArticlePubMed
- Klar N, Donner A: Ethical challenges posed by cluster randomization. Wiley Encycl Clin Trials. 2007, 1-5. doi: 10.1002/9780471462422.eoct050
- Taljaard M, Chaudhry SH, Brehaut JC, Weijer C, Boruch R, Donner A, Eccles MP, McRae AD, Saginur R, Zwarenstein M, Grimshaw JM: Survey of consent practices in cluster randomized trials: improvements are needed in ethical conduct and reporting. Clin Trials. 2014, 11 (1): 60-69. 10.1177/1740774513513658.View ArticlePubMed
- Chaudhry SH, Brehaut JC, Grimshaw JM, Weijer C, Boruch R, Donner A, Eccles MP, McRae AD, Saginur R, Skea ZA, Zwarenstein M, Taljaard M: Challenges in the research ethics review of cluster randomized trials: International survey of investigators. Clin Trials. 2013, 10: 257-268. 10.1177/1740774513475530.View ArticlePubMed
- Taljaard M, Grimshaw JM WC, Belle Brown J, Binik A, Boruch R, Brehaut JC, Chaudhry SH, Eccles MP, McRae A, Saginur R, Zwarenstein M, Donner A: Ethical and policy issues in cluster randomized trials: rationale and design of a mixed methods research study. Trials. 2009, 10: 61-10.1186/1745-6215-10-61.PubMed CentralView ArticlePubMed
- Blue Ridge Institute for Medical Research. [http://www.brimr.org/NIH_Awards/2010/NIH_Awards_2010.htm]
- Collins D: Pretesting survey instruments: an overview of cognitive methods. Qual Life Res. 2003, 12: 229-238. 10.1023/A:1023254226592.View ArticlePubMed
- Dillman DA, Smyth JD, Christian LM: Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method. 2009, Hoboken NJ: Wiley
- Weijer C, Grimshaw JM, Eccles MP, McRae AD, White A, Brehaut JC, Taljaard M, the Ottawa Ethics of Cluster Trials Consensus Group: The Ottawa consensus statement on the ethical design and conduct of CRTs. PLoS Med. 2012, 9: e1001346-10.1371/journal.pmed.1001346.PubMed CentralView ArticlePubMed
- McRae AD, Weijer C, Binik A, White A, Grimshaw JM, Boruch R, Brehaut JC, Donner A, Eccles MP, Saginur R, Zwarenstein M, Taljaard M: Who is the research subject in cluster randomized trials in health research?. Trials. 2011, 12: 183-10.1186/1745-6215-12-183.PubMed CentralView ArticlePubMed
- McRae AD, Weijer C, Binik A, Grimshaw JM, Boruch R, Brehaut JC, Donner A, Eccles MP, Saginur R, White A, Taljaard M: When is informed consent required in cluster randomized trials in health research?. Trials. 2011, 12: 202-10.1186/1745-6215-12-202.PubMed CentralView ArticlePubMed
- Edwards SJL, Ashcroft RA, Kirchin S: Are discrepancies between research ethics committees always morally problematic?. Bioethics. 2004, 18: 408-427. 10.1111/j.1467-8519.2004.00407.x.View ArticlePubMed
- The Role of RECs, Governance Arrangements for NHS Research Ethics Committees. Section 2. Department of Health. Research Governance Framework for Health and Social Care.https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/213753/dh_133993.pdf,
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.