- Open Access
- Open Peer Review
This article has Open Peer Review reports available.
Willingness to participate in pragmatic dialysis trials: the importance of physician decisional autonomy and consent approach
© The Author(s). 2017
Received: 16 June 2017
Accepted: 26 September 2017
Published: 11 October 2017
Pragmatic clinical trials embedded in routine delivery of clinical care can lead to improvements in quality of care, but often have design features that raise ethical concerns.
We performed a discrete choice experiment and used conjoint analysis to assess how specific attributes of pragmatic dialysis trials influenced patients’ and physicians’ willingness to have their dialysis facility participate in a hypothetical trial of hypertension management. Electronic survey data were collected from 200 patients enrolled from 11 outpatient hemodialysis units and from 203 nephrologists. The three attributes studied were physicians’ treatment autonomy, participants’ research burden, and the approach to consent. The influence of each attribute was quantified using mixed-effects logistic regression.
Similar proportions of patients were willing to have their facilities participate in a trial with high vs. low physician autonomy (77% vs. 79%; p = 0.13) and research burden (76% vs. 80%; p = 0.06). Opt-in, opt-out, and notification-only consent approaches were acceptable to most patients (84%, 82%, and 81%, respectively), but compared to each of these consent approaches, fewer patients (66%) were willing to have their facility participate in a trial that used no notification (p < 0.001 for each 2-way comparison). Among the physicians, similar proportions were willing to participate in trials with high and low physician autonomy (61% and 61%, respectively, p = 0.96) or with low and high burden (60 and 61%, respectively, p = 0.79). However, as for the patients, the consent approach influenced trial acceptability with 77%, 69%, and 62% willing to participate using opt-in, opt-out, and notification-only, respectively, compared to no notification (36%) (p < 0.001 for each 2-way comparison).
Curtailing physician’s treatment autonomy and increasing the burden associated with participation did not influence patients’ or physicians’ willingness to participate in the hypothetical research, suggesting that pragmatic dialysis trials are generally acceptable to patients and physicians. Both patients and physicians preferred consent approaches that include at least some level of patient notification, but the majority of patients were still willing to participate in trials that did not notify patients of the research.
In contrast to traditional randomized clinical trials (RCTs) that are designed to evaluate the efficacy and safety of a drug or intervention under ideal conditions, pragmatic trials aim to compare the effectiveness, benefits, and harms of interventions under real-world conditions . Pragmatic trials embedded within usual clinical care delivery, or “learning health systems,” are designed to maximize the external validity of the knowledge they generate [2–4]. By facilitating rapid enrollment of large numbers of patients, pragmatic trials can markedly reduce recruitment challenges and high costs that characterize many traditional RCTs [5–15]. However, the benefits of trials embedded in clinical care must be considered in the context of the loss of patient and physician autonomy that they may impose especially if entire hospitals or clinics are randomized as a cluster to a specific treatment approach. Moreover, such trials may be conducted with waivers of informed consent. Several ethicists have noted that standard informed consent procedures may not be applicable in pragmatic trials comparing interventions that fall within the “standard of care” [16–19] because such trials do not increase risk to patients beyond the risk of usual care. However, such trials alter the process by which an individual’s care is selected, thereby limiting patients’ and physicians’ decisional autonomy .
As promising as pragmatic trials may be for improving the quality and costs of care , little empirical work has addressed these ethical concerns [17, 21–23]. In a recent qualitative study, we examined how patients and physicians value physician decisional autonomy and traditional informed consent in the context of pragmatic trials . In that study, patients receiving maintenance dialysis generally accepted restrictions on physician decisional autonomy and, when necessary to achieve the goals of the study, endorsed simple notification rather than formal consent. Physicians generally expressed similar views, though some expressed greater reservations about forgoing opt-in consent . Informed by these qualitative results, we designed the current study to quantify how strongly patients and physicians value physicians’ treatment autonomy relative to other desirable study features such as minimization of participant burden and opportunity for informed consent. We conducted a survey-based discrete choice study among patients with end-stage renal disease (ESRD) receiving maintenance hemodialysis and with physicians to determine the relative influence of these study attributes on willingness to participate in a pragmatic dialysis trial.
Setting and participants
Patients receiving maintenance hemodialysis for ESRD were recruited from 11 outpatient dialysis facilities in the greater Philadelphia region between June 2015 and March 2016. Exclusion criteria included age <18 years, initiation of dialysis within the previous 90 days, inability to speak English, and inadequate visual or cognitive function as determined by each facility’s charge nurse. Potential participants were approached during a dialysis session by a trained research coordinator. After providing informed consent, participants completed the survey using a tablet computer. Patient participants received compensation of US$10 after survey completion.
Physician members of the American Society of Nephrology (ASN) were invited to participate via email between July 2015 and February 2016. Eligible physicians were practicing nephrologists treating adult patients in outpatient dialysis units in the USA. Potentially eligible physicians were randomly selected from the ASN membership list and sent email invitations in two separate waves starting in July and December 2015, respectively, followed by two reminder emails over a 4-week period. Physician participants received a US$50 gift card for completing the study. The study was approved by DaVita Clinical Research (#18-2015) and the Institutional Review Board of the University of Pennsylvania (#819593).
Survey instrument and study design
The survey consisted of a presentation of scenarios, each describing a hypothetical cluster-randomized clinical trial comparing two approaches to blood pressure management for patients receiving maintenance hemodialysis. The basic trial design was held constant across the scenarios but trial attributes were varied. The survey content was informed by our previous qualitative study in which semi-structured interviews were used to understand views of patients and physicians about protocolized treatment approaches for clinical trials . We chose two of the three attributes evaluated in this study based on themes from these interviews: (1) the effect of protocolized care on physician treatment autonomy (treatment autonomy); and (2) information exchange between patients and physicians as it relates to the mechanism of consent (consent approach). Although the third attribute, participant burden, did not emerge as a major theme in the qualitative study, most patients and physicians interviewed did express concern about the burden of participation, making it appropriate for further evaluation. For the treatment autonomy attribute, we varied the physician’s role in selecting a blood pressure target for the patient and choosing which anti-hypertensive medications to use. For the participant burden attribute we varied the testing required for the trial from routine non-invasive blood pressure measurement to monthly blood draws and an additional research visit separate from dialysis treatment. For the consent approach attribute we varied the trial’s enrollment mechanism (opt-in consent, opt-out consent, notification-only, no-notification) (Additional file 1).
A full factorial design using these three attributes produced 16 scenarios (2 autonomy levels × 2 burden levels × 4 consent levels): however, we restricted the number of scenarios to 8 per participant by randomly assigning each to receive one of six groups of 8 scenarios to minimize participant fatigue . In each group, two of the four consent approaches were tested across the two levels of autonomy and two levels of burden. The 6 groups entailed all possible pairwise comparisons of the four consent attributes. We pilot-tested the computerized presentations with 5 patients and 14 physicians to assess acceptability of the format and language, and modified them accordingly. The final survey was written at an 8th-grade literacy level and supplemented with cartoon illustrations to promote readability.
The scenarios for physicians contained more medical terminology than those directed to patients (Additional file 1: Appendix A) but had comparable content. Physicians were informed that oversight of this large, adequately powered hypothetical trial would be provided by Institutional Review Boards and an independent Data and Safety Monitoring Board, and that patients would be provided with the following statement: Patients will not be included in the study if their doctor thinks they should not participate.
The sequence for the eight scenarios in each group was determined by electronic randomization to mitigate potential ordering effects. After reviewing each scenario, participants used a 4-point scale to indicate willingness to have their dialysis facility participate in the clinical trial (definitely participate, probably participate, probably not participate, definitely not participate). An a priori decision was made to dichotomize willingness to participate into either a “Yes” (definitely or probably participate) or “No” (probably not or definitely not participate) for the primary analysis.
Because of limited prior research exposure among this patient population , patients were asked to view a 3-minute animated video entitled “Approaches to Research in Medical Practice” from the Research on Medical Practices (ROMP) Ethics Study (rompethics.iths.org) prior to presentation of the clinical trial scenarios. Patients then completed a 5-item knowledge test about randomization and standard-of-care research, with the correct answers revealed afterwards (Additional file 1: Appendix B).
After completion of the scenarios, patients completed the Research Attitude Questionnaire , a 7-item measure that assesses patients’ support for and value of biomedical research (theoretical scores range from 7 to 35, with higher scores indicating more favorable views). Patients also completed the 9-item Revised Health Care System Distrust Scale  to capture their trust in the values and competence of the healthcare system (theoretical scores range 9 to 45, with higher scores indicating more distrust). Finally, we collected demographic information about patients (age, gender, race, ethnicity, employment status, income, comorbidities, hospitalizations in the past year, and years receiving dialysis therapy) and physicians (age, gender, race, ethnicity, years in practice, practice setting, and past experience with clinical trials).
The primary outcome, willingness to have the dialysis facility participate in the trial, was analyzed using hierarchical random-effects logistic regression with an exchangeable working correlation structure and robust error variance estimators to account for the clustering of the responses by each participant [28, 29]. Prior to model building, we examined all continuous variables using locally weighted scatterplot smoothing to determine the appropriateness of entering such variables as linear terms. No variable required transformation. The associations of participant characteristics with willingness to participate were assessed using t tests and Chi-square tests for continuous and categorical variables, respectively. We decided a priori to include all three trial attributes (exposures) in the baseline models for both patients and physicians. Other variables were added to the model if they had a p value <0.20 for the relationship between the variable and the primary outcome in a model that also included the three exposure variables. A priori we decided to also run an adjusted model without including either the healthcare system distrust or research attitude score. These data are not presented here as the results did not differ from the primary model. For physicians, none of the demographic variables met the inclusion criterion, thus the final model includes only the three trial attributes. We additionally explored potential interactions among all three trial attributes by adding two-way interaction terms one at a time to the final models for both patient and physician participants.
For all analyses, two-sided p values <0.05 were considered statistically significant. Statistical analyses were conducted in Stata (v14.1, StataCorp, College Station, TX, USA) and R Studio (v1.0.136, RStudio Inc., Boston, MA, USA) using the R language (v1.0.136, R Foundation for Statistical Computing, Vienna, Austria) and the R package ggplot2 (v2.2.1, Springer-Verlag, New York, NY, USA).
A total of 807 patients receiving hemodialysis therapy in 11 dialysis facilities were screened. Of these, 157 (19.4%) did not meet eligibility criteria, and 185 (22.9%) were not approached because they were absent or sleeping during attempts to enroll during two or more dialysis sessions. Among the 465 eligible patients approached, 210 (45.2%) consented to participate and 200 (43.0%) completed the entire survey.
Patients (N = 200)a
Less than high school
Annual household income
Less than US$20,000
Years on dialysis
Less than 1 year
More than 5 years
Hospitalizations in past year
More than 5
Chronic pulmonary diseases
Research Attitude Questionnaireb
Revised Healthcare System Distrust Scalec
Bivariate associations between trial attributes and patients’ willingness to have clinic participate
Willing to participatea, numberb (percentage)
OR (95% CI)
0.81 (0.61, 1.06)
0.70 (0.48, 1.01)
0.88 (0.49, 1.57)
0.68 (0.38, 1.23)
0.19 (0.10, 0.34)
Bivariate associations between patient characteristics and willingness to participate
Willing to participatea, number (percentage)
OR (95% CI)
1.61 (0.81, 3.22)
1.60 (0.47, 5.42)
2.45 (0.83, 7.23)
5.06 (1.72, 14.86)
6.48 (1.89, 22.24)
1.02 (0.50, 2.10)
≤ High school
1.31 (0.58, 2.96)
College or Graduate degree
0.89 (0.37, 2.12)
0.65 (0.27, 1.58)
0.60 (0.21, 1.72)
0.61 (0.24, 1.57)
Years on dialysis
Less than 1 year
0.94 (0.33, 2.68)
1.00 (0.36, 2.79)
More than 5 years
0.66 (0.23, 1.89)
Hospitalizations in past year
1.03 (0.35, 2.97)
0.69 (0.26, 1.83)
0.73 (0.31, 1.72)
0.17 (0.05, 0.68)
1.17 (0.58, 2.39)
0.86 (0.42, 1.75)
0.61 (0.19, 1.94)
0.66 (0.18, 2.46)
Research Attitude Questionnaireb (per 1-point change in score)
1.09 (1.02, 1.17)
Revised Healthcare System Distrust Scalec (per 1-point change in score)
0.87 (0.83, 0.92)
Influence of attributes on willingness to participatea in final adjusted model
OR (95% CI)
OR (95% CI)
0.79 (0.59, 1.07)
0.68 (0.46, 1.01)
0.91 (0.50, 1.63)
0.50 (0.26, 0.96)
0.69 (0.38, 1.27)
0.33 (0.18, 0.59)
0.20 (0.11, 0.36)
0.04 (0.02, 0.08)
1.51 (0.39, 5.79)
2.07 (0.65, 6.57)
4.65 (1.49, 14.50)
6.05 (1.64, 22.31)
Research Attitude Questionnaireb (per 1-point change in score)
1.05 (0.98, 1.12)
Revised Healthcare System Distrust Scalec (per 1-point change in score)
0.89 (0.83, 0.95)
Of the 1635 randomly selected physician members of the ASN who were emailed an invitation to participate, 747 (72%) opened the email and 272 (16.6%) initiated the online survey. Forty-two physicians (15.4%) were ineligible because they did not treat adults in a US outpatient dialysis unit and 27 (9.9%) did not complete the survey. Thus, 203 physicians completed the survey giving an overall response rate of 12.7%. The majority of participating physicians were male, white, 5 or more years beyond fellowship, and self-identified as having experience as a clinical trial investigator (Additional file 1: Appendix C). Demographics of responders were compared with those of a random sample of 300 non-responders. There were no significant differences in either the gender (p = 0.68) or mean age (p = 0.34) of responding and non-responding physicians.
Similar to the patient participants, most physician participants were willing to have their dialysis facility participate in at least one of the eight hypothetical clinical trials (61%). Physicians’ willingness to participate was not affected by either treatment autonomy (61% vs. 61% for low and high, respectively; p = 0.96) or research burden (60% vs. 61% for low and high, respectively; p = 0.79). Physicians were generally less willing than patients to have dialysis facilities participate in the described trials across all scenarios (Fig. 1), and the effect of consent approach on willingness to participate appeared to be stronger for physicians than for patients (Table 4). However, statistical comparisons between patients and physicians were not performed, as these were not specified in our analytic plan. As with patients, interactions among the three trial attributes were not evident among physicians (p > 0.1 for all interaction terms). Additionally, none of the physician characteristics was associated with willingness to participate (Additional file 1: Appendix D).
In this study of patients with dialysis-dependent end-stage renal disease and physicians, we did not detect an effect of curtailed treatment autonomy or research burden on willingness to participate in a hypothetical pragmatic trial, but did find an effect of the approach to consent. Both patients and physicians indicated levels of comfort that were similar for opt-out, participant notification, and traditional opt-in consent, but were less willing to participate when participants would receive no notification about the trial. However, even with no notification, two thirds of patients indicated willingness to have their facilities participate.
Patients and physicians are accustomed to interactions in which decisions about treatment approaches are either shared between the patient and the physician or directed by the physician. In traditional RCTs, therapeutic approaches are determined by chance rather than by choice , and such restrictions may dissuade patients or physicians from participating in the study. However, in cluster-randomized pragmatic trials patients may not have an option to avoid trials that restrict treatment autonomy because entire hospitals or clinics may be assigned to provide the same treatment approach for all eligible patients. Even when randomization is at the individual patient level, for some pragmatic trials the requirement for informed consent is waived and thus access to alternative treatments is eliminated. Interestingly, for patients and physicians in the current study, limitations on treatment autonomy did not reduce willingness to have their dialysis facility participate in the trial. Moreover, patients were as likely to participate in a trial that relied on opt-out consent or a notification of enrollment as in a trial that used opt-in informed consent, and two thirds of patients were willing to participate even in the absence of any notification. This finding is particularly notable in light of increased distrust in medical care and biomedical research among African Americans , who constituted the majority of participants in this ESRD cohort. Indeed, we found that race was not associated with willingness to participate in the hypothetical pragmatic trials.
Strikingly, the hypothetical pragmatic trials presented in our surveys were more acceptable to patients than physicians. This may be explained, at least in part, by the desire of some physicians to rely on their own experience to determine the best treatment for an individual patient . However, notably, one third of physicians expressed willingness to have their dialysis facility participate in a trial conducted without any patient notification. Another interesting finding is that, like patients, physicians’ willingness to participate was not influenced by degree of burden to patients resulting from the trial. The absence of an effect of this attribute might be due to the small incremental burdens for this group of patients of extra testing and blood collection relative to thrice-weekly hemodialysis treatments. It is also possible that effects smaller than we were powered to detect might be evident in a larger sample.
Overall, our findings suggest that a pragmatic clinical trial comparing standard-of-care interventions for blood pressure management is generally acceptable to patients receiving maintenance dialysis and to their treating physicians. Among those we evaluated, the only influential attribute for patients and physicians was the consent approach, a finding that is relevant to ongoing discussions about the use of alternatives to the “traditional” opt-in consent in pragmatic clinical trials . In particular, so long as studies were transparent and included notification to patients, they were generally acceptable to both patients and physicians. Understanding the views of multiple stakeholders is important for informing these discussions. A strength of this study is that we assessed the views of both patents and physicians, and found generally similar results for these two groups.
The findings of our study need to be considered in light of several limitations. The most important is that responses of the patients and physicians to hypothetical RCTs may not reflect the decisions they would make if they were considering participation in actual trials. However, structured vignettes have been shown to be a valid methodology in other clinical settings for producing results that accurately reflect those from more expensive and time-intensive non-hypothetical experimental procedures , and hypothetical preferences are the single best predictor of future enrollment decisions . A second limitation is that the valuations of these trial attributes and willingness to participate may not reflect those of patients receiving hemodialysis in other geographic areas or with other diseases, or physicians from other specialties. Likewise, results may vary among trials testing different types of interventions. We chose to focus on hemodialysis patients and physicians because of the potential for dialysis care delivery as a setting for pragmatic trials . The findings from this study should inform future studies in different clinical contexts. An additional limitation is the low survey response rate by physicians that occurred despite pilot testing the study instrument and offering a US$50 financial incentive conditional on completing the survey. Physicians are historically difficult to engage in survey research , and we acknowledge the possibility of non-response bias in the physician component of this study. Somewhat reassuringly, the age and sex of our respondents mirrored those of a random sample of physician members of the ASN. Finally, the hypothetical trials used in this study tested only three trial attributes, and it is possible that additional attributes (e.g., risk to patients) may influence participation decisions. However, we informed our attribute selection from interviews with patients and nephrologists , and chose to constrain the number of attributes to avoid overburdening participants.
This study provides evidence that limitations placed on treatment autonomy in clinical trials may not be an important contributor to patients’ or physicians’ willingness to participate, and that patients may place similar value on a variety of consent approaches as long as there is some form of notification. These findings contribute important stakeholder perspectives to the ongoing debate about the applicability of traditional research regulations to studies involving standard-of-care interventions [4, 16, 17, 21, 22, 36, 41–43]. Future work should aim to elucidate factors driving the expressed attribute valuations and expand this evidence base to other clinical contexts.
The authors are grateful to assistance from Kristiina Negron, MS, and Ashley Kraybill, MPH, and to the patients and staff members at the participating DaVita dialysis facilities.
This work was funded by the National Institutes of Health Common Fund as a supplement to award 3UH3DK102384 (LMD). The funding bodies had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Availability of data and materials
The datasets generated and/or analyzed during the current study are not publicly available due to containing protected patient clinical data, but may be available from the corresponding author on reasonable request and execution of appropriate data use and sharing agreements.
Study concept and design: SH, SJ, SE, JK, and LD. Collection, management, analysis, and interpretation of the data: KC, SH, SJ, SE, JK, VM, NG, SS, KY, and LD. Drafting or critical revision of the manuscript for important intellectual content: KC, SH, SJ, SE, JK, VM, NG, SS, KY, and LD. All authors read and approved the final manuscript.
Ethics approval and consent to participate
The study was approved by DaVita Clinical Research (#18-2015) and the Institutional Review Board of the University of Pennsylvania (#819593). Informed consent was obtained from all participants in the study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Ford I, Norrie J. Pragmatic Trials. N Engl J Med. 2016;375:454–63.View ArticlePubMedGoogle Scholar
- Institute of Medicine. The learning health care system workshop summary. Washington, DC: National Academies Press; 2007. Available at https://www.ncbi.nlm.nih.gov/books/NBK53494/.Google Scholar
- Institute of Medicine. Best care at lower cost: the path to continuously learning health care in America. Washington: National Academies Press; 2012. Available at https://www.ncbi.nlm.nih.gov/books/NBK207218/.Google Scholar
- Anderson ML, Califf RM, Sugarman J. Ethical and regulatory issues of pragmatic cluster randomized trials in contemporary health systems. Clin Trials. 2015;12:276–86.View ArticlePubMedPubMed CentralGoogle Scholar
- Emanuel EJ, Schnipper LE, Kamin DY, Levinson J, Lichter AS. The costs of conducting clinical research. J Clin Oncol. 2003;21:4145–50.View ArticlePubMedGoogle Scholar
- Nathan RA. How important is patient recruitment in performing clinical trials? J Asthma. 1999;36:213–16.View ArticlePubMedGoogle Scholar
- Hunningshake DB, Darby CA, Probstfield JL. Recruitment experience in clinical trials: Literature summary and annotated bibliography. Control Clin Trials. 1987;8:6S–30S.View ArticleGoogle Scholar
- Meinert CL. Clinical trials: Design, conduct, and analysis. New York: Oxford University Press; 1986.View ArticleGoogle Scholar
- Probstfield JL, Wittes JT, Hunningshake DB. Recruitment in the NHLBI population-based studies and randomized clinical trials: data analysis and survey results. Control Clin Trials. 1987;8:141S–9S.View ArticlePubMedGoogle Scholar
- Kramer MS, Shapiro SH. Scientific challenges in the application of randomized trials. JAMA. 1984;252:2739–45.View ArticlePubMedGoogle Scholar
- Vollmer VM, Osborn ML, Hertert S, et al. Recruiting hard-to-reach subjects: Is it worth the effort? Control Clin Trials. 1994;15:154–9.View ArticlePubMedGoogle Scholar
- Halpern SD. Prospective preference assessment: a method to enhance the ethics and efficiency of randomized controlled trials. Control Clin Trials. 2002;23:274–88.View ArticlePubMedGoogle Scholar
- Lovato LC, Hill K, Hertert S, Hunningshake DB, Probstfield JL. Recruitment for controlled clinical trials: literature summary and annotated bibliography. Control Clin Trials. 1997;18:328–52.View ArticlePubMedGoogle Scholar
- Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R. Barriers to participation in randomised controlled trials: a systematic review. J Clin Epidemiol. 1999;52:1143–56.View ArticlePubMedGoogle Scholar
- Taylor KM, Feldstein ML, Skeel RT, Pandya KJ, Ng P, Carbone PP. Fundamental dilemmas of the randomized clinical trial process: results of a survey of the 1,737 Eastern Cooperative Oncology Group investigators. J Clin Oncol. 1994;12:1796–805.View ArticlePubMedGoogle Scholar
- Faden RR, Kass NE, Goodman SN, Pronovost P, Tunis S, Beauchamp TL. An ethics framework for a learning health care system: a departure from traditional research ethics and clinical ethics. Hastings Cent Rep. 2013;Spec No:S16–27.View ArticlePubMedGoogle Scholar
- Solomon MZ, Bonham AC. Ethical oversight of research on patient care. Hastings Cent Rep. 2013;43:S1–44.Google Scholar
- Platt R, Kass NE, McGraw D. Ethics, regulation, and comparative effectiveness research: time for a change. JAMA. 2014;311:1497–8.View ArticlePubMedGoogle Scholar
- Faden RR, Beauchamp TL, Kass NE. Informed consent, comparative effectiveness, and learning health care. N Engl J Med. 2014;370:766–8.View ArticlePubMedGoogle Scholar
- Kim SY, Miller FG. Waivers and alterations to consent in pragmatic clinical trials: respecting the principle of respect for persons. IRB. 2016;38:1–5.PubMedGoogle Scholar
- Kass NE, Faden RR, Goodman SN, Pronovost P, Tunis S, Beauchamp TL. The Research-treatment distinction: a problematic approach for determining which activities should have ethical oversight. Hastings Cent Rep. 2013;43:S4–S15.View ArticleGoogle Scholar
- Largent EA, Joffe S, Miller FG. Can research and care be ethically integrated? Hastings Cent Rep. 2011;41:37–46.View ArticlePubMedGoogle Scholar
- Sugarman J. Ethics of research in usual care settings: data on point. AJOB Empir Bioeth. 2016;7:71–5.View ArticleGoogle Scholar
- Kraybill A, Dember LM, Joffe S, et al. Patient and physician views about protocolized dialysis treatment in randomized trials and clinical care. AJOB Empir Bioeth. 2016;7:106–15.View ArticlePubMedGoogle Scholar
- Bridges JF, Hauber AB, Marshall D, et al. Conjoint analysis applications in health–a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force. Value Health. 2011;14:403–13.View ArticlePubMedGoogle Scholar
- Rubright JD, Cary MS, Karlawish J, Kim SYH. Measuring how people view biomedical research: reliability and validity analysis of the Research Attitudes Questionnaire. J Empir Res Hum Res Ethics. 2011;6:63–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Shea JA, Micco E, Dean LT, McMurphy S, Schwartz JS, Armstrong K. Development of a revised Health Care System Distrust scale. J Gen Intern Med. 2008;23:727–32.View ArticlePubMedPubMed CentralGoogle Scholar
- Williams RL. A note on robust variance estimation for cluster-correlated data. Biometrics. 2000;56:645–6.View ArticlePubMedGoogle Scholar
- Rogers WH. Stata Tehcnical Bulletin: regression standard errors in clustered samples. 1993;3(13):19-23. Available at http://stata-press.com/journals/stbcontents/stb13.pdf.
- Localio AR, Berlin JA, Ten Have TR, Kimmel SE. Adjustments for center in multicenter studies: an overview. Ann Intern Med. 2001;135:112–23.View ArticlePubMedGoogle Scholar
- Kerry SM, Bland JM. The intracluster correlation coefficient in cluster randomisation. BMJ. 1998;316:1455–60.View ArticlePubMedPubMed CentralGoogle Scholar
- 2015 End Stage Renal Disease (ESRD) Network 4 Annual Report. November 30, 2016. (Accessed September 13, 2017, at https://www.qirn4.org/Files/Data-CrownWeb/Annual-Reports/2015_Network_Annual_Report-Network4.aspx.).
- Armstrong K, McMurphy S, Dean LT, et al. Differences in the patterns of health care system distrust between blacks and whites. J Gen Intern Med. 2008;23:827–33.View ArticlePubMedPubMed CentralGoogle Scholar
- Marquis D. Leaving therapy to chance. Hastings Cent Rep. 1983;13:40–7.View ArticlePubMedGoogle Scholar
- Corbie-Smith G, Thomas SB, St George DM. Distrust, race, and research. Arch Intern Med. 2002;162:2458–63.View ArticlePubMedGoogle Scholar
- McKinney Jr RE, Beskow LM, Ford DE, et al. Use of altered informed consent in pragmatic clinical research. Clin Trials. 2015;12:494–502.View ArticlePubMedPubMed CentralGoogle Scholar
- Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA. 2000;283:1715–22.View ArticlePubMedGoogle Scholar
- Halpern SD, Metzger DS, Berlin JA, Ubel PA. Who will enroll? Predicting participation in a phase II AIDS vaccine trial. J Acq Immun Def Synd. 2001;27:281–8.View ArticleGoogle Scholar
- Dember LM, Archdeacon P, Krishnan M, et al. Pragmatic Trials in Maintenance Dialysis: Perspectives from the Kidney Health Initiative. J Am Soc Nephrol. 2016;27:2955–63.View ArticlePubMedPubMed CentralGoogle Scholar
- Keating NL, Zaslavsky AM, Goldstein J, West DW, Ayanian JZ. Randomized trial of $20 versus $50 incentives to increase physician survey response rates. Med Care. 2008;46:878–81.View ArticlePubMedGoogle Scholar
- Sugarman J, Califf RM. Ethics and regulatory complexities for pragmatic clinical trials. JAMA. 2014;311:2381–2.View ArticlePubMedGoogle Scholar
- Kim SY, Miller FG. Informed consent for pragmatic trials–the integrated consent model. N Engl J Med. 2014;370:769–72.View ArticlePubMedGoogle Scholar
- Chen SC, Kim SY. A framework for analysis of research risks and benefits to participants in standard of care pragmatic clinical trials. Clin Trials. 2016;13:605–11.View ArticlePubMedGoogle Scholar