This article has Open Peer Review reports available.
Participants' preference for type of leaflet used to feed back the results of a randomised trial: a survey
- Stephen Brealey1Email author,
- Lazaros Andronis2,
- Laura Dennis3,
- Christine Atwell4,
- Stirling Bryan5,
- Simon Coulton6,
- Helen Cox1,
- Ben Cross1,
- Fiona Fylan7,
- Andrew Garratt8,
- Fiona Gilbert9,
- Maureen Gillan9,
- Maggie Hendry10,
- Kerenza Hood11,
- Helen Houston4,
- David King12,
- Veronica Morton1,
- Michael Robling4,
- Ian Russell13 and
- Clare Wilkinson10
© Brealey et al; licensee BioMed Central Ltd. 2010
Received: 29 April 2010
Accepted: 1 December 2010
Published: 1 December 2010
Hundreds of thousands of volunteers take part in medical research, but many will never hear from researchers about what the study revealed. There is a growing demand for the results of randomised trials to be fed back to research participants both for ethical research practice and for ensuring their co-operation in a trial. This study aims to determine participants' preferences for type of leaflet (short versus long) used to summarise the findings of a randomised trial; and to test whether certain characteristics explained participants' preferences.
553 participants in a randomised trial about General Practitioners' access to Magnetic Resonance Imaging for patients presenting with suspected internal derangement of the knee were asked in the final follow-up questionnaire whether they would like to be fed back the results of the trial. Participants who agreed to this were included in a postal questionnaire survey asking about their preference, if any, between a short and a long leaflet and what it was about the leaflet that they preferred. Multinomial logistic regression was used to test whether certain demographics of responding participants along with treatment group explained whether a participant had a preference for type of leaflet or no preference.
Of the participants who returned the final follow-up questionnaire, 416 (88%) agreed to receive the results of the trial. Subsequently 132 (32%) participants responded to the survey. Most participants preferred the longer leaflet (55%) and the main reasons for this were the use of technical information (94%) and diagrams (89%). There was weak evidence to suggest that gender might explain whether participants have a preference for type of leaflet or not (P = 0.084).
Trial participants want to receive feed back about the results and appear to prefer a longer leaflet. Males and females might require information to be communicated to them differently and should be the focus of further research.
The trial is registered with http://www.isrctn.org/ and ID is ISRCTN76616358.
Every year hundreds of thousands of volunteers take part in medical research, but many will never hear from researchers about what the study revealed. There is now a growing demand for the results of randomised trials to be fed back to research participants [1, 2]. Feeding back the results of trials has been described as an element of ethical research practice  and is a recommendation of the United Kingdom Department of Health's research governance framework . This has also been described as a participant's right and that achieving their full co-operation in designing, conducting, reporting and implementing the results of research may ensure that they are the first people to hear the results . Furthermore the majority of research participants want this right [5, 6].
The results of trials, however, can be complicated, alarming and distressing . The perceived negative psychological consequences of providing feedback may present a barrier to communicating study results [3, 8]. Studies have shown that negative psychological reactions amongst participants include anger, anxiety, guilt or upset; although these studies also report participants being relieved or satisfied to receive trial results even if there is a potentially negative impact [7, 9, 10]. Despite the recent calls for research to be disseminated to participants and the potential for negative psychological impact there is currently little evidence advocating the most effective approach of communicating results - the preparation of such materials can be costly and time consuming [3, 5].
In the DAMASK trial, we undertook a multi-centre pragmatic randomised trial to address the question of whether patients presenting to General Practitioners (GPs) with suspected internal derangement of the knee should be referred for early access to Magnetic Resonance Imaging (MRI) or directly to an orthopaedic specialist [11–13]. In view of the paucity of evidence to inform the method of communicating results to trial participants we thought it was timely to explore how participants might prefer to be fed back the results of a trial. The objectives of our survey were: to determine participants' preferences, if any, for type of leaflet (short versus long) which summarise the findings of the DAMASK trial; and to test whether certain demographics (e.g. gender, age) and treatment group explained whether the participants had a preference for type of leaflet or not.
In the final follow-up questionnaire we asked the 553 participants in the DAMASK trial whether they would like to receive the results of the study. Participants who requested feedback of study results were then included in our survey after the results of the trial had been published in scientific journals [11–13]. This included being sent a cover letter asking the participants to take part in the survey, two leaflets (short and long) summarising the trial findings, and a one-page questionnaire. The short leaflet was a one-page summary in the style of an abstract that was written in plain language using bullet points, with minimum use of numbers, and no pictures or diagrams. The structure of this leaflet was presented as: background; aims of the study; how we did it; what we found; and conclusion. The longer leaflet was four pages in length which included a picture of MRI of the knee and two diagrams (a pie chart and bar chart) presenting results of the trial. The content of the leaflet was more technical with far greater use of numbers and percentages and explained the main results in terms of confidence intervals. The structure of this leaflet was presented as: background; aims of the study; how we did it; data collected; what we found; and should GP access to MRI of the knee be introduced into the NHS? Contact details of the trial co-ordinator were included at the end of each leaflet, copies of which are available on request from the corresponding author. Participants were asked to complete a one-page questionnaire about whether they preferred the one-page leaflet, the four-page leaflet or had no preference. If a participant preferred a type of leaflet they were asked (yes/no) whether it was due to: its length; the amount of technical information; the use of numbers; the use of percentages; the use of diagrams. A free text box was provided for participants to record other reasons about their preference for a leaflet.
To test for differences in baseline characteristics of participants who did and did not respond to completing the survey we used χ2 tests and t-tests. Participants' preference for a type of leaflet or no preference and the reason for their preference are presented descriptively. Additional free text responses as to why participants preferred a type of leaflet were coded retrospectively. Multinomial logistic regression was used to test whether certain demographics of responding participants (i.e. gender [0 = female; 1 = male]; age [years], employment [0 = employed; 1 = other], age left education [years]) along with treatment group [0 = MRI (and Orthopaedic Referral); 1 = Orthopaedic Referral] explained their preference for a type of leaflet or not. This analysis was undertaken using Stata version 10.0 (Statacorp, Texas)  and included the commands mlogit and mlogtest .
The DAMASK trial was designed to comply with the Declaration of Helsinki as adopted by the World Medical Association. The Northern and Yorkshire Multi-Centre Research Ethics Committee approved the trial (reference number MREC/1/3/59). Ethics approval was not necessary for this survey as we were advised that this was an audit of feeding back trial results to participants.
Of the 553 participants in the DAMASK trial, 471 (85%) completed the final follow-up questionnaire. For those participants who returned the final follow-up questionnaire, 416 (88%) agreed that they would like to receive the results of the study. Subsequently 132 (32%) participants responded to the survey about their preference for type of leaflet feeding back the results of the trial. Of these 132 participants, 73 (55%) were in the MRI (and orthopaedic referral) group and 59 (45%) were in the orthopaedic referral (control group).
Participants' characteristics at baseline
Responders (n = 132)
Non-responders (n = 284)
Sex: male, n (%)
Ethnicity: white, n (%)
Employed: yes, n (%)
KQoL-26 (0-100, 100 = best health):
SF-36 (mean = 50, SD = 10, 100 = best health):a
EQ-5D (0-1, 1 = best health)
Participants' preference for type of leaflet or no preference
Reason for preference
No preference n (%)
One-page leaflet n (%)
Four-page leaflet n (%)
b) Technical information
c) Use of numbers
d) Use of percentages
e) Use of diagrams
Multinomial logistic regression model for variables that explain participants' preference
95% CI for Exp(B)
No preference Vs Four-page
0.698 to 5.317
0.962 to 1.068
0.756 to 1.060
0.277 to 4.320
0.440 to 2.666
0.016 to 62.231
One-page Vs Four-page
0.193 to 1.330
0.974 to 1.084
0.887 to 1.162
0.092 to 2.748
0.257 to 1.759
0.004 to 6.040
One-page vs No preference
0.079 to 0.880
0.950 to 1.083
0.516 to 1.373
0.068 to 3.126
0.200 to 1.933
0.001 to 20.230
Likelihood ratio tests for independent variables
Most participants (88%) wanted feed back of the DAMASK trial results which is comparable with findings from a literature review that a median of 90% (range 20%-100%) of participants wished to receive study results . This range of patients wanting feedback is, however, very wide. Interestingly the review showed that for several studies of patients being treated for cancer, 90% of participants or more wanted to be informed of the study results [16–19]. In contrast, for studies of pregnant women only 20%  and 40%  of woman wanted study results. In our trial we asked participants about being fed back the study results at the final postal questionnaire follow-up, but it might be more appropriate to do this when enrolling patients to take part and include it in the patient information leaflet and consent of patients.
The majority of participants (55%) preferred the longer leaflet and the main reasons for this were the technical information provided and use of diagrams to explain trial results. In contrast, every participant who preferred the one-page leaflet gave length of the leaflet as the reason for this. In the free text responses it was clarified that the leaflet being short and simple was the reason for preferring the one-page leaflet although some suggested the leaflet would have benefited from the use of diagrams. Graphical formats are increasingly being used to present risk information to patients [21, 22] and has been shown to improve their understanding of quantitative information over textual or written formats [23, 24]. Our findings support the use of a longer leaflet with visual aids to explain trial results which in particular might benefit participants with reading difficulties or low numeracy skills. We did, however, only compare participants' preference for a one-page leaflet compared with a four-page leaflet. It is possible that a shorter leaflet such as two-pages with the use of diagrams would have been preferred.
The findings from the regression analyses suggest that gender can significantly influence preference for type of leaflet (one-page) or no preference (P = 0.030); although this was the only significant finding from the several explanatory analyses that were performed and thus possibly a false-positive result that should be interpreted with caution. Whilst taking this into consideration: 71% of participants who had no preference for a leaflet were male (29% female); 50% and 58% of males respectively preferred a one-page or four-page leaflet. These findings indicate that females were more interested in how the information about trial results was presented to them which is consistent with women using health services more than men and seeking more health information . Therefore it might be appropriate in research that has a female population such as treatments for breast cancer or during pregnancy to consider feeding back results differently than for research including males such as the treatment for prostate cancer. Research about communicating results to participants of a cardiac rehabilitation trial has shown that gender can be important with women (97%) compared to men (76%) significantly more likely to prefer receiving study results by letter (P = 0.009); and no women (0%) compared to men (15%) preferring communication by email or the web (P = 0.024) . The use of qualitative methods could help to further explore the communication of trial results to males and females. None of the other characteristics of the participants appeared to be important for influencing their preference for a type of leaflet or not. Including ethnicity as a variable in the analyses would have been desirable, but in our survey sample there were only two participants who were non-white (who both preferred the four-page leaflet). Therefore, it was not appropriate to include ethnicity in the model.
A limitation of our survey was the low response rate, although participants' characteristics were mostly similar between those who did and did not respond. Younger patients, however, were significantly less likely to respond, though there was only a small difference in years and, from the analyses, age was not important for explaining participants' preferences. Participants who scored lower on the emotional functioning sub-scale of the KQoL-26 questionnaire were also significantly less likely to respond. This might possibly be a chance finding although the emotional functioning sub-scale is concerned with participants feeling downhearted and low, angry and annoyed, or worried about their knee worsening. The trial findings indicated to participants that there were only small benefits from GP access to MRI in terms of the physical functioning of their knee. It is conceivable that participants who were downhearted and low or worried about their knee were dissatisfied with the limited benefits of the intervention and therefore were less willing to complete the survey. Alternatively, they could have been dissatisfied with the methods offered for feeding back the trial results. Research into communicating clinical trial results to participants in a study about Huntington's disease found that participants reported high or complete satisfaction with an investigator of the trial contacting individual participants by telephone to explain the results (89%) or participants' attendance to a conference call with study investigators (82%) but relatively low satisfaction with the sponsor's press release (50%) . It is possible that the participants did not respond to our survey because they valued more personalised approaches to communicating the trial results. There was also a considerable delay from December 2006 which was when the last participant was followed-up in the trial to May 2009 when we informed the participants of the results of the trial. This was because we wanted to communicate the most accurate results possible to participants that had been peer-reviewed and accepted for publication in scientific journals. This delay might have contributed to participants' lack of interest in the survey.
Despite several studies commenting on the negative psychological impact of feeding back results of trials to participants [7, 9, 10], the trial co-ordinator has not had any contact with participants about the trial results. Nor did participants in the survey express any anxieties about the information conveyed. This may partly be due to the limited generalisability of this study, in that it is a single randomised trial including participants with a musculoskeletal condition which was not particularly acute or life-threatening and for which there was minimal difference in patient outcomes between the two groups. In a trial with a more vulnerable population (e.g. cancer patients) or with serious adverse events, participants could potentially have very different experiences which could affect their attitude towards the method of feeding back trial results. They might prefer a short leaflet that is plain and simple with clear messages such as "what these results mean to you" or "further steps you should take". It might also be important to present the findings separately for those who had a positive result compared with those who have had negative results, with the latter requiring a more personalised delivery of results through a telephone call or visit to the clinic . Indeed, it might be appropriate to guide the participant back to their main care provider who can offer the necessary clinical advice in the context of the trial results. Our study also used a randomised trial design and was evaluating the effectiveness of a diagnostic test. Participants that have a different experience of research which use alternative study designs (e.g. surveys, cohorts) or an evaluation of different treatments might like the results of the study to be communicated to them differently. This study might also have benefited from the involvement of trial participants in the design and piloting of the leaflets which has been recommended for future research . In addition to postal methods of feeding back results, other communication methods have been suggested including the telephone or a face-to-face consultation . Using the postal method is likely to be less time consuming and costly than the additional salary required for a suitably trained and knowledgeable person to spend time explaining trial results to individual participants. In our study, it only cost £105 and £252 to print the one-page and four-page leaflets respectively and the cost of posting these materials was estimated to be £150. The cost per trial participant for sending out both leaflets was therefore £1.22. Finally randomised trials are increasingly making use of the internet and email to recruit participants, to maintain contact during the trial, to deliver the intervention and to collect data [29, 30]. Participants could be asked when enrolled into a trial whether an electronic method could be used to feed back the results.
Serious consideration should be given about how and to whom the results of the trial should be fed back to participants as part of good research practice [2–4]. This is important for sharing the results of the research to the patients for which they contributed and might improve their future care . Participants in our trial did want to receive feed back about the trial results and appear to prefer the longer leaflet supported with graphs to present study findings and more technical information. It is possible that there could be a difference between males and females as to how information should be communicated to them and requires further research. Future research should also assess the effect of participants' preferences in different patient populations with more significant differences in outcomes and the effect of other modes of communicating trial findings on their understanding of results. Finally feeding back the results of trials to participants has the advantage of not only underpinning good research practice, but also appeals to participants' altruistic motives [31, 32] and sharing study results might enhance their understanding of randomised trials . This could have the advantage of improving recruitment and co-operation with data collection and ultimately the evidence-base to improve patient care.
We are indebted to the patients who agreed to take part in our study. The Medical Research Council funded the research costs. The NHS in England, Scotland and Wales funded the excess treatment and service support costs.
- Goodare H, Smith R: The rights of patients in research. BMJ. 1995, 3: 1277-1278.View ArticleGoogle Scholar
- Marshall S: How to get patients consent to enter clinical trials. Participants should be given feedback about the trial. BMJ. 1996, 312: 186-View ArticlePubMedPubMed CentralGoogle Scholar
- Fernandez CV, Kodish E, Weijer C: Informing study participants of research results: an ethical imperative. IRB Ethics Hum Res. 2003, 25: 12-19. 10.2307/3564300.View ArticleGoogle Scholar
- Department of Health: Research governance framework for health and social care. 2005, London, 2Google Scholar
- Shalowitz DI, Miller FG: Communicating the results of clinical research to participants: attitudes, practices, and future directions. PLoS Med. 2008, 5: 91-10.1371/journal.pmed.0050091.View ArticleGoogle Scholar
- Lancet: Trialists should tell participants results, but how?. The Lancet. 2006, 367: 1030-Google Scholar
- Snowdon C, Garcia J, Elbourne D: Reactions of participants to the results of a randomised controlled trial: Exploratory study. BMJ. 1998, 317: 21-26.View ArticlePubMedPubMed CentralGoogle Scholar
- Partridge AH, Winer EP: Informing clinical trial participants about study results. JAMA. 2002, 288: 363-365. 10.1001/jama.288.3.363.View ArticlePubMedGoogle Scholar
- Ormondroyd E, Moynihan C, Watson M, Foster C, Davolls S, Arden-Jones A, Eeles R: Disclosure of genetics research results after the death of the patient participant: A qualitative study of the impact on relatives. J Genet Couns. 2007, 16: 527-38. 10.1007/s10897-007-9088-1.View ArticlePubMedGoogle Scholar
- Dixon-Woods M, Jackson C, Windridge KC, Kenyon S: Receiving a summary of the results of a trial: Qualitative study of participants' views. BMJ. 2006, 332: 206-210. 10.1136/bmj.38675.677963.3A.View ArticlePubMedPubMed CentralGoogle Scholar
- DAMASK Trial Team: Influence of magnetic resonance of the knee on GPs' decisions: a randomised trial. Br J Gen Pract. 2007, 57: 622-629.Google Scholar
- Damask Trial Team: Effectiveness of GP access to magnetic resonance imaging of the knee: a randomised controlled trial. Br J Gen Pract. 2008, 58: 767-774.Google Scholar
- Damask Trial Team: Cost-effectiveness of magnetic resonance imaging of the knee for patients presenting in primary care. Br J Gen Pract. 2008, 58: 775-778.Google Scholar
- StataCorp: Stata Statistical Software: Release 10. 2008Google Scholar
- Long JS, Freese J: Models for nominal outcomes with case-specific data. Regression models for categorical dependent variables using Stata. Edited by: Long JS, Freese J. 2006, Texas: Stata Press, 223-291.Google Scholar
- Partridge AH, Burstein HJ, Gelman RS, Marcom PK, Winer EP: Do patients participating in clinical trials want to know study results?. J Natl Cancer Inst. 2003, 95: 491-492. 10.1093/jnci/95.6.491.View ArticlePubMedGoogle Scholar
- Fernandez CV, Taweel S, Kodish E, Weijer C: Disclosure of research results to research participants: A pilot study of the needs and attitudes of adolescents and parents. Paediatr Child Health. 2005, 10: 332-334.PubMedPubMed CentralGoogle Scholar
- Fernandez CV, Gao J, Strahlendorf C, Moghrabi A, Pentz RD, Barfield RC, Baker JN, Santor D, Weijer C, Kodish E: The return of research results to participants: Attitudes and needs of adolescents and parents of children with cancer. J Clin Oncol. 2009, 27 (6): 878-883. 10.1200/JCO.2008.18.5223.View ArticlePubMedPubMed CentralGoogle Scholar
- Richards MP, Ponder M, Pharoah P, Everest S, Mackay J: Issues of consent and feedback in a genetic epidemiological study of women with breast cancer. J Med Ethics. 2003, 29: 93-96. 10.1136/jme.29.2.93.View ArticlePubMedPubMed CentralGoogle Scholar
- Elbourne D: Subjects' views about participation in a randomized controlled trial. J Reprod Infant Psychol. 1998, 5: 3-8. 10.1080/02646838708403468.View ArticleGoogle Scholar
- Wang FC, Ubel PA: Reducing the influence of anecdotal reasoning on people's health care decisions: is a picture worth a thousand statistics?. Med Decis Making. 2005, 25: 398-405. 10.1177/0272989X05278931.View ArticlePubMedGoogle Scholar
- Epstein RM, Alper BS, Quill TE: Communicating evidence for participatory decision making. JAMA. 2004, 291: 2359-2366. 10.1001/jama.291.19.2359.View ArticlePubMedGoogle Scholar
- Schapira MM, Nattinger AB, McAuliffe TL: The influence of graphic format on breast cancer risk communication. J Health Commun. 2006, 11: 569-582. 10.1080/10810730600829916.View ArticlePubMedGoogle Scholar
- Feldman-Stewart D, Kocovski N, McConnell BA, Brundage MD, Mackillop WJ: Perception of quantitative information for treatment decisions. Med Decis Making. 2000, 20: 228-238. 10.1177/0272989X0002000208.View ArticlePubMedGoogle Scholar
- McCormick A, Fleming D, Charlton J: Morbidity Statistics from General Practice. Fourth national study 1991-1992. OPCS Series MB5 no.3. 1995, London: HMSOGoogle Scholar
- Dalal H, Wingham J, Pritchard C, Northey S, Evans P, Taylor RS, Campbell J: Communicating the results of research: how do participants of a cardiac rehabilitation RCT prefer to be informed?. Health Expect. 2009, 13: 323-330.PubMedGoogle Scholar
- Dorsey ER, Beck CA, Adams M, Chadwick G, de Blieck EA, McCallum C, Briner L, Deuel L, Clarke A, Stewart R, Shoulson I, the Huntington Study Group TREND-HD Investigators: Communicating clinical trial results to research participants. Arch Neurol. 2008, 65 (12): 1590-1595. 10.1001/archneurol.2008.503.View ArticlePubMedGoogle Scholar
- Thornton H, Edwards A, Elwyn G: Evolving the multiple roles of 'patients' in health-care research: reflections after involvement in a trial of shared decision making. Health Expectations. 2003, 6: 189-197. 10.1046/j.1369-6513.2003.00231.x.View ArticlePubMedGoogle Scholar
- Donker T, van Straten A, Riper H, Marks I, Andersson G, Cuijpers P: Implementation of Internet-based preventive interventions for depression and anxiety: role of support? The design of a randomized controlled trial. Trials. 2009, 10: 59-10.1186/1745-6215-10-59.View ArticlePubMedPubMed CentralGoogle Scholar
- Van Straten A, Cuijpers P, Smits N: Effectiveness of a Web-Based Self-Help Intervention for Symptoms of Depression, Anxiety, and Stress: Randomized Controlled Trial. J Med Internet Res. 2008, 10: e7-10.2196/jmir.954.View ArticlePubMedPubMed CentralGoogle Scholar
- Mattson ME, Curb JD, McArdle R: Participation in a clinical trial: the patients' point of view. Control Clin Trials. 1985, 6: 156-167. 10.1016/0197-2456(85)90121-7.View ArticlePubMedGoogle Scholar
- Rao JN: Giving medicine a fair trial: patients' altruism should be appreciated. BMJ. 2000, 321: 530-Google Scholar
- Ong LM, de Haes JC, Hoos AM, Lammes FB: Doctor-patient communication: a review of the literature. Soc Sci Med. 1995, 40: 903-918. 10.1016/0277-9536(94)00155-M.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.