- Open Access
- Open Peer Review
An integrated conceptual framework for evaluating and improving ‘understanding’ in informed consent
© The Author(s). 2017
- Received: 28 June 2017
- Accepted: 22 September 2017
- Published: 17 October 2017
The development of understandable informed consent (IC) documents has proven to be one of the most important challenges in research with humans as well as in healthcare settings. Therefore, evaluating and improving understanding has been of increasing interest for empirical research on IC. However, several conceptual and practical challenges for the development of understandable IC documents remain unresolved.
In this paper, we will outline and systematize some of these challenges. On the basis of our own experiences in empirical user testing of IC documents as well as the relevant literature on understanding in IC, we propose an integrated conceptual model for the development of understandable IC documents.
The proposed conceptual model integrates different methods for the participatory improvement of written information, including IC, as well as quantitative methods for measuring understanding in IC.
In most IC processes, understandable written information is an important prerequisite for valid IC. To improve the quality of IC documents, a conceptual model for participatory procedures of testing, revising, and retesting can be applied. However, the model presented in this paper needs further theoretical and empirical elaboration and clarification of several conceptual and practical challenges.
- Informed consent
- Participatory consent improvement
- Understanding in informed consent
Informed consent (IC) is an important ethical and legal requirement in research with humans as well as in clinical care [1–3]. The Council for International Organizations of Medical Sciences, for example, specifies that valid IC can only be given “after providing relevant information about the research and ascertaining that the potential participant has adequate understanding of the material facts” . Only if the ‘understanding’ requirement is met can IC be considered an effective means to protect participants’ and patients’ autonomy, and to maintain public trust [4–6].
Thus, evaluating and improving understanding has been of interest for empirical research on IC for several years [7–9]. However, there seems to be no agreed definition of the term ‘understanding’, which makes it difficult to compare the results of different studies [10, 11]. Further, various methods have been applied to test, improve, and sometimes retest understanding in IC. As we will argue below, different methods should be combined rather than applied independently to develop understandable IC documents.
In this paper, we will first argue that it is necessary to clarify the meaning of ‘understanding’ in IC, and propose a working definition of the concept by distinguishing (the measurement of) ‘subjective’ and ‘objective’ understanding. Secondly, based on the relevant literature as well as own experience with participatory improvement of IC documents, we aim to systematize a set of methodological issues for the development of understandable IC documents. Thereby, we will focus on the engagement of members of the target group in this process. Thirdly, we will propose an integrated conceptual model for testing, improving and retesting IC documents. Finally, we shall outline core issues for future research on IC development.
Analysis: conceptual and practical challenges for the development of understandable consent documents
In this section we outline five methodological and conceptual issues for testing and improving understanding in IC. These are (1) a clarification of the concept of ‘understanding’; (2) explaining the relationship between different approaches to empirical research on understanding in IC; (3) methodological challenges for the actual revision of IC documents; (4) conceptualizing benefits of involving members of the target population in the evaluation and revision of IC documents; and (5) the identification and recruitment of members of the target population for participatory consent improvement.
Clarification of concepts: ‘subjective’ vs. ‘objective’ understanding and general understandability
The first issue for the evaluation and enhancement of ‘understanding’ in IC is to clarify what exactly is to be evaluated. The lack of an agreed definition of understanding in empirical consent research has been criticized before [12, 13]. The comparison of different studies assessing understanding requires a common notion of what understanding actually entails, as well as the application of comparable methods [10, 11]. In a systematic review of studies measuring understanding, Sand et al.  show that several distinct concepts are covered by the term ‘understanding’. Despite their varying conceptualizations, all the studies reviewed by Sand et al.  aim to measure understanding objectively, i.e., by testing participants’ knowledge or memory of certain facts. These studies do not generally evaluate how well the participants (subjectively) felt themselves to have understood the IC document.
For valid IC, however, IC documents should address prospective research participants’ needs and demands. Therefore, to improve IC documents it can be helpful to first identify text passages that are intrinsically hard to understand. Thus, it is also important to assess readers’ own perception of the documents, e.g., whether they feel that they (subjectively) understood the given information, and whether this information is adequate to come to an autonomous decision on their participation.
Finally, in some cases, it can be advantageous to assess general understandability instead of or in addition to objective/subjective understanding. If, for example, there are no members of an IC document’s target population available for testing, third parties can be asked to anticipate how difficult it would be for the target population at large to understand the given pieces of information. Additionally, members of the target population themselves could be asked how difficult they think it would be for others to understand the given information (general understandability). This information could help to generalize or contrast data on objective and subjective understanding. For example, if test readers are better educated or more experienced than average members of the target population, results on objective as well as subjective understanding would be biased (higher scores for both concepts of understanding compared to the average reader). However, such test readers could possibly anticipate that it is more difficult for less educated and experienced persons to understand the information given in the tested IC documents. Then, assessing general understandability could substantially complement data on subjective and objective understanding.
Different concepts of ‘understanding’
Types of ‘understanding’
Exemplary methods of assessment
Correct knowledge of certain facts after having read IC documents
Knowledge or memory tests by means of (1) standardized questionnaires or interviews, or (2) by asking participants to rephrase facts in their own words
Subjective impression of having understood certain facts after reading IC documents
Open question, e.g., “Do you think you have understood the given information? If not, what were the text passages you find difficult to understand?”
Personal impression of whether the given information is in principle easy to understand for others, e.g., members of the target group
Open question, e.g., “How easy do you think will it be for others to understand the given information?”
Complementary types of empirical research on understanding in IC
The three types of understanding also help to distinguish two complementary types of empirical research on understanding. First, there is the relatively established field of mainly quantitative studies measuring objective understanding , e.g., whether study participants understand the purpose and the risks of the research explained in the IC documents, whether they actually grasp the meaning of randomization, or whether they understand that their participation is voluntary and that they have the right to withdraw. These studies mostly use standardized questionnaires or interview surveys; many even conduct randomized controlled trials to systematically compare participants’ understanding after different interventions supporting the consent process [7, 9, 12, 14]. One prominent model for systematically assessing objective understanding is the Brief Informed Consent Evaluation Protocol, developed by Sugarman et al. , which uses a short questionnaire for telephone interviews to evaluate the quality of IC for clinical research.
More recently, a second field of research on understanding written information has been explored. The studies in this field mostly apply an iteration of mixed methods – standardized questionnaires, semi-structured individual interviews, focus groups – to test, revise and retest written information (e.g., [16, 17]). These so-called ‘user testings’ address all three types of ‘understanding’ – most user testings assess participants’ objective understanding and how easy it is for them to find certain pieces of information by means of standardized questionnaires. Many complement the standardized assessment of objective understanding by focusing on test readers’ ‘subjective understanding’, e.g., to what extent they themselves feel that they understood the given information (e.g., ), and some ask for test readers’ assessment of the documents’ general ‘understandability’ (e.g., ). In addition, user testings often aim to identify reasons for problems of understanding by means of qualitative interviews or focus group discussions [16, 18, 19]. Usually, they also revise the tested information documents according to the test readers’ feedback and retest the revised version [16, 17]. Some user testing studies also evaluate the revised documents against the original version by means of a randomized controlled trial, using quantitative methods . The method was originally invented in Australia for testing product information leaflets . Since then, user testings (and similar methods under different labels) have been applied to a growing variety of written information on various topics [21–24], including patient information documents for clinical trials (e.g., [16, 25, 26]).
Most endeavors of participatory improvement of IC documents for clinical care or research in humans use individual standardized and semi-structured interviews. For some evaluations of written health information and decision aids focus group interviews are conducted to identify test readers’ perceptions of a given document and the information it provides, including emotional responses and misunderstandings of certain issues [18, 19]. Compared to individual interviews, focus groups have some advantages for testing and improving written information – they allow participants to comment on the statements of others, to clear up misunderstandings amongst themselves, and to discuss complex and divisive issues. This allows the assessment of the relative relevance of different feedback, e.g., when participants put into perspective their own feedback after comments by other participants – and to identify contrasting views as well as the underlying rationales, e.g., when participants discuss certain issues amongst themselves and give reasons for their differing opinions. These insights from focus groups can make it easier to understand test readers’ opinions of the tested documents and their potential problems of understanding.
Both standardized assessments of understanding and the different methods for participatory testing and improving written information have specific strengths and weaknesses. While quantitative methods allow for a valid assessment of objective understanding and produce generalizable results, user testings and other participatory methods can help to identify reasons for problems of understanding. In addition, test readers’ own perceptions of the IC documents can be assessed for subjective understanding or emotional responses to certain pieces of information . According to specific needs, IC evaluation might combine different methods to test, improve and retest high quality IC documents.
Challenges for the systematic and transparent revision of IC documents after user testing
Practical challenges for the systematic and transparent revision of informed consent documents
Questions to answer for the revision of IC documents
Dealing with feedback or suggestions from different numbers of participants
Are suggestions expressed repeatedly by multiple individuals in different interviews or focus groups more important than suggestions made by just one test reader?
Dealing with participants’ conflicting opinions on the same topic
How can test readers’ conflicting opinions be addressed, e.g., if some participants think sub-headlines should be formulated as questions, while others prefer declarative sentences? Which suggestion should be used when conflicting opinions about the same topic have been expressed?
Trade-off between different reasonable suggestions
How can different well-reasoned but irreconcilable suggestions be addressed, e.g., if participants on the one hand suggest to abbreviate the whole text to make it more readable to everybody, while on the other hand, they want some topics to be explained in more detail or they ask for additional pieces of information?
Dealing with feedback or suggestions that do not seem reasonable to the authors
How should suggestions be handled that do not seem reasonable, i.e., that would not seem to increase objective understanding, or do not assist prospective research participants with their autonomous decision, e.g., when a particular test reader is interested in more background information on some rather marginal topic? And how can one systematically decide which suggestions are reasonable and which are not?
Making changes transparent and replicable
How can revisions in general and decisions in the abovementioned cases in particular be made transparent and accountable to others?
Faced with these challenges, it can be difficult to ensure that the improved IC documents truly address test readers’ feedback and that revisions are not primarily based on the authors’ interpretations and personal tastes. As a first step to increase the transparency and accountability of revisions, in our own focus group study we first grouped the statements of all test readers into categories according to the subject they dealt with. To reduce the number of statements in each category, we then combined consensual and contesting comments on each issue into different sub-categories. For the actual revision of the tested documents, we assigned a distinct code to each sub-category and noted, for each change made to the original document, to which piece of feedback it referred. Additionally, we documented how we addressed each piece of feedback. When we did not address a particular suggestion we also gave reasons for our decision. All decisions regarding revisions were discussed by members of our research group to avoid bias in interpretation or revision. This method is one possible approach to increasing transparency and accountability, but needs further development and refinement.
Authors of previous user testings identify three general sources for their changes to the original documents, namely (1) feedback from the user testing, (2) best-practice guidelines in information wording and clear writing, and (3) authors’ experiences with writing patient information documents [16, 23, 25, 26]. However, at present, to our knowledge, no one has reported how exactly revisions were made based on test readers’ feedback and how they dealt with the challenges outlined in Table 2. If feedback from user testings is considered only one of three sources for the revision of the original document, what is the actual contribution of the target population to the development and improvement of IC documents?
Why members of the target population should be involved in the validation and improvement of IC documents
These different kinds of experts provide vital elements of IC documents. However, even multidisciplinary expert groups can hardly anticipate whether members of the target group will actually understand the given information and how they will assess the readability and comprehensibility of the IC documents [19, 30].
For this purpose, members of the target population should be involved in the process of testing and improving IC documents. Thus, in addition to the responsible researchers or medical experts and other professionals (ethicists, lawyers, and communication experts), prospective research participants and patients themselves can play an important role in the development of valid IC documents.
Identifying and recruiting members of the target population
For meaningful involvement of members of the target population in the development of IC documents, it is essential to first identify a suitable target population. For certain kinds of research, the target population could be the general public. This applies, for example, to clinical studies designed to test new drugs in healthy humans, as well as for biobanks, which aim to collect and store samples from a particular region or population. However, the target population can also consist of patients suffering from a certain disease. Each kind of target population requires different recruitment methods.
Nevertheless, members of most target populations for research IC documents are lay persons, whose involvement in the evaluation and improvement of IC documents implies certain limitations. Although lay persons can express their own difficulties with reading and understanding the given information and their own emotional reactions or misunderstandings, they can hardly anticipate the reactions of other members of the target population, which could be very different from their own. Further, they usually lack knowledge of the development and conduct of clinical research, and are thus unable to identify missing information or mistakes in the explanations of certain facts. One possible way around these limitations is to involve ‘expert patients’ instead of or in addition to lay persons. Based on concepts of involving specially trained patients in the development and conduct of clinical research, the working definition of ‘expert patients’ as patient representatives who (1) are or were affected by an illness (directly or indirectly as a relative/proxy for children or cognitively-impaired adults) relevant to the disease under study, (2) have learned to engage in discussions about the disease from a patient standpoint and not only from their personal standpoint, and thus to anticipate the perspective of other patients, and (3) have in-depth knowledge about how to design and conduct clinical research, can be used [31, 32]. While property (1) also applies to ‘lay patients’, properties (2) and (3) require further knowledge and competencies. The concept of expert patients is rather new, and needs further development, so the potential benefits of involving expert patients in the development of IC documents remain unclear.
Conceptual model for the development of understandable informed consent documents
Steps in the process of informed consent (IC) development
Action to take
Writing of IC documents
Involve multidisciplinary expert groups in design of IC documents
− Ensure completeness and correctness of given information
− Make sure legal and ethical requirements are met
Involve communications experts and/or apply guidelines for how to design understandable written information
− Increase readability and understandability for lay people
Testing original IC documents
Identify the IC documents’ target population and develop strategies for recruiting test readers
− Make sure to recruit testers who are able to unveil or anticipate prospective research participants’ potential problems of understanding (depending on the IC documents’ actual target population, this could be members of the general public, lay patients, or expert patients)
− Avoid systematic biases in groups of participants (e.g., according to education, age, sex)
Clarify relevant concepts for testing: ‘understanding’
− Make testing results reliable and comparable to other testings (using the same concepts)
− Adapt testing methods to applied concepts
Quantitative element (questionnaire/quiz): test objective understanding; assess how easy it is to find and understand particular pieces of information
− Ensure the most important pieces of information are easy to find and understand
− Take information from questionnaires for systematic preparation of focus groups or individual interviews
Qualitative element (focus groups/individual interviews): assess subjective understanding, emotional reactions, and/or general understandability; discuss original IC documents with test readers
− Validate and complement results of questionnaires
− Identify reasons for problems of understanding
− Assess participants’ impression of completeness and balance of given information
− Identify emotional reactions and misunderstandings
− Learn about participants’ suggestions for improving IC documents
Systematic summary of test readers’ feedback and suggestions
− Use as preparation for systematic revision
− Identify consensual and conflicting opinions
− Prioritize and organize potential changes in original document
Revising original documents
Develop rules to deal with different kinds of feedback
− Allow for systematic revision, not primarily based on authors’ experiences and personal taste
Track revisions and explicitly link changes to feedback
− Make revisions and arguments for changes transparent and reasonable
− Ensure changes actually address test readers’ needs and suggestions
− Increase legitimacy of changes
Involve original authors of IC documents and/or other experts
− Ensure the revised document still gives all relevant information
− Ensure all given information is correct and meets legal and ethical requirements
While making changes: apply guidelines for clear writing or involve communications experts
− Ensure standards for clear writing are met in revised version
Evaluating/re-testing revised documents
Quantitative element (questionnaire/quiz): test objective understanding for revised documents (as many iterations as necessary)
− Retest how easy to find and to understand most important pieces of information are in revised version
− Take information from questionnaires for systematic preparation of focus groups or individual interviews
− If necessary: revise and retest
Qualitative element (focus groups/individual interviews): assess subjective understanding, emotional reactions, and/or general understandability for revised documents (as many iterations as necessary)
− Evaluate changes to original document
− Ensure the most urgent needs and suggestions have been addressed
− Validate revised version
− Identify additional feedback and suggestions
− If necessary: revise and retest
Quantitative element: test final version against the original version by means of randomized survey
− Systematically evaluate the quality of the revised IC document in comparison to the original version
The proposed integrated model entails a rather sophisticated as well as costly process (with regard to both time and monetary resources). It may not be feasible for every single clinical research project to perform the whole model. However, at least parts of the model can be used in almost every research setting to validate and improve IC documents. Additionally, in certain research settings, template IC documents have been or are being developed, e.g., for clinical studies , by Research Ethics Boards for their addressees , or for biobanking in Germany . For these templates, which will be used in several individual clinical research projects, it is vital that written information is understandable to prospective research participants and that it covers all their information needs. Thus, the above presented model for participatory IC improvement may be especially suitable for developing IC templates. Finally, some consent procedures entail particular ethical requirements and, therefore, justify a greater effort to validate and improve the quality of written information [36–39], e.g., when obtaining new forms of consent for biobank research or when inviting participants for studies involving high levels of risks or uncertainties such as in gene therapy or genome editing. During the development of IC documents for such forms of research, the above presented model for participatory consent improvement may also be an adequate means.
There are a growing number of studies testing understanding and suggesting different measures to improve the consent process in this regard. However, several methodological and conceptual challenges remain unresolved in the assessment and improvement of understanding in IC. On the basis of our own experience as well as the relevant literature, we outlined an integrated conceptual model for the development, testing, and improvement of IC documents (Table 3). This rather sophisticated and time-consuming model is especially suitable for the development of IC templates that are going to be used in several individual studies, for the improvement of IC documents for clinical research involving particular risks and uncertainties (e.g., genome editing), or for IC documents obtaining broad consent (e.g., biobanks).
Further conceptual elaboration and empirical research is needed to continuously improve this model and to develop solutions to the unresolved challenges in the development, evaluation, and improvement of IC documents. What are the advantages and disadvantages of involving ‘expert patients’ compared to other potential test readers? How can IC documents be revised based on results from user testings or similar methods in a way that is sufficiently transparent and yet efficient?
To address the open research questions it might be fruitful, in future, for those involved in empirical evaluations of consent procedures to cooperate with those developing healthcare-related patient information.
The authors thank Reuben Thomas for proofreading and language editing of the manuscript.
This project was partly funded by intramural funds of Hannover Medical School and by the German Research Foundation (DFG) via the grant “Cluster of Excellence 62, REBIRTH – From Regenerative Biology to Reconstructive Therapy” http://www.dfg.de/foerderung/programme/listen/projektdetails/index.jsp?id=24102914. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Availability of data and materials
Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.
DS and SB designed the project and together developed the presented conceptual model. SB drafted the article. DS substantially contributed to several versions of the manuscript. Both authors approved the final version of the article.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- World Medical Association. Declaration of Helsinki - Ethical Principles for Medical Research Involving Human Subjects. Ferney-Voltaire: WMA; 2013.Google Scholar
- Council for International Organizations of Medical Services. International Ethical Guidelines for Health-Related Research Involving Human Subjects. Geneva: CIOMS; 2016.Google Scholar
- European Parliament, Council of the European Union. Regulation (EU) No 536/2014 on Clinical Trials on Medicinal Products for Human Use, and Repealing Directive 2001/20/EC. Official Journal of the European Union. Luxembourg: EC; 2014.Google Scholar
- Grady C. Enduring and emerging challenges of informed consent. New Engl J Med. 2015;372:855–62.View ArticlePubMedGoogle Scholar
- Capron AM. Legal and regulatory standards of informed consent in research. In: Emanuel EJ, Grady C, Crouch RA, Lie RK, Miller FG, Wendler D, editors. The Oxford Textbook of Clinical Research Ethics. Oxford: Oxford University Press; 2008. p. 613–32.Google Scholar
- Organisation for Economic Co-Operation and Development. Guidelines on Human Biobanks and Genetic Research Database. Paris: OECD; 2009.Google Scholar
- Flory JH, Emanuel EJ. Interventions to improve research participants’ understanding in informed consent for research. JAMA. 2004;292:1593–601.View ArticlePubMedGoogle Scholar
- Flory JH, Wendler D, Emanuel EJ. Empirical issues in informed consent for research. In: Emanuel EJ, Grady C, Crouch RA, Lie RK, Miller FG, Wendler D, editors. The Oxford Textbook of Clinical Research Ethics. Oxford: Oxford University Press; 2008. p. 645–60.Google Scholar
- Nishimura A, Carey J, Erwin PJ, Tilburt JC, Murad MH, McCormick JB. Improving understanding in the research informed consent process: a systematic review of 54 interventions tested in randomized control trials. BMC Med Ethics. 2013;14:28.View ArticlePubMedPubMed CentralGoogle Scholar
- Appelbaum PS. Understanding “understanding”: an important step toward improving informed consent to research. AJOB Prim Res. 2010;1:1–3.View ArticleGoogle Scholar
- Sand K, Kaasa S, Loge JH. The understanding of informed consent information—definitions and measurements in empirical studies. AJOB Prim Res. 2010;1:4–24.View ArticleGoogle Scholar
- Agre P, Campbell FA, Goldman BD, Boccia ML, Kass N, McCullough LB, Merz JF, Miller SM, Mintz J, Rapkin B, et al. Improving informed consent: the medium is not the message. IRB. 2003;Suppl 25:S11–9.View ArticlePubMedGoogle Scholar
- Dunn LB, Jeste DV. Enhancing informed consent for research and treatment. Neuropsychopharmacology. 2001;24:595–607.View ArticlePubMedGoogle Scholar
- Paris A, Nogueira da Gama Chaves D, Cornu C, Maison P, Salvat-Melis M, Ribuot C, Brandt C, Bosson JL, Hommel M, Cracowski JL. Improvement of the comprehension of written information given to healthy volunteers in biomedical research: a single-blind randomized controlled study. Fundam Clin Pharmacol. 2007;21:207–14.View ArticlePubMedGoogle Scholar
- Sugarman J, Lavory PW, Boeger M, Cain C, Edson R, Morrison V, Yeh SS. Evaluating the quality of informed consent. Clin Trials. 2005;2:34–41.View ArticlePubMedGoogle Scholar
- Knapp P, Raynor DK, Silcock J, Parkinson B. Can user testing of a clinical trial patient information sheet make it fit-for-purpose?--a randomized controlled trial. BMC Med. 2011;9:89.View ArticlePubMedPubMed CentralGoogle Scholar
- Raynor DK, Knapp P, Silcock J, Parkinson B, Feeney K. “User-testing” as a method for testing the fitness-for-purpose of written medicine information. Patient Educ Couns. 2011;83:404–10.View ArticlePubMedGoogle Scholar
- Zschorlich B, Knelangen M, Bastian H. The development of health information with the involvement of consumers at the German Institute for Quality and Efficiency in Health Care (IQWiG). Gesundheitswesen. 2011;73:423–9.View ArticlePubMedGoogle Scholar
- Hirschberg I, Seidel G, Strech D, Bastian H, Dierks M-L. Evidence-based health information from the users’ perspective - a qualitative analysis. BMC Health Serv Res. 2013;13:405.View ArticlePubMedPubMed CentralGoogle Scholar
- Sless D, Shrensky R. Writing About Medicine for People: Usability Guidelines for Consumer Product Information. 3rd ed. Sydney: Australian Self-Medication Industry; 2006.Google Scholar
- Knapp P, Wanklyn P, Raynor DK, Waxman R. Developing and testing a patient information booklet for thrombolysis used in acute stroke. Int J Pharm Pract. 2010;18:362–9.View ArticlePubMedGoogle Scholar
- Brooke RE, Herbert NC, Isherwood S, Knapp P, Raynor DK. Balance appointment information leaflets: employing performance-based user-testing to improve understanding. Int J Audiol. 2013;52:162–8.View ArticlePubMedGoogle Scholar
- Raynor DK. User testing in developing patient medication information in Europe. Res Social Adm Pharm. 2013;9:640–5.View ArticlePubMedGoogle Scholar
- Fearns N, Graham K, Johnston G, Service D. Improving the user experience of patient versions of clinical guidelines: user testing of a Scottish Intercollegiate Guideline Network (SIGN) patient version. BMC Health Serv Res. 2016;16:37.View ArticlePubMedPubMed CentralGoogle Scholar
- Knapp P, Raynor DK, Silcock J, Parkinson B. Performance-based readability testing of participant information for a Phase 3 IVF trial. Trials. 2009;10:79.View ArticlePubMedPubMed CentralGoogle Scholar
- Knapp P, Raynor DK, Silcock J, Parkinson B. Performance-based readability testing of patient materials for a phase I trial: TNG1412. J Med Ethics. 2009;35:573–8.View ArticlePubMedGoogle Scholar
- Jefford M, Moore R. Improvement of informed consent and the quality of consent documents. Lancet Oncol. 2008;9:485–93.View ArticlePubMedGoogle Scholar
- Hirschberg I, Kahrass H, Strech D. International requirements for consent in biobank research: qualitative review of research guidelines. J Med Genet. 2014;51:773–81.View ArticlePubMedGoogle Scholar
- Elwyn G, O’Connor A, Stacey D, Volk R, Edwards A, Coulter A, Thomson R, Barratt A, Barry M, Bernstein S, et al. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006;333:417.View ArticlePubMedPubMed CentralGoogle Scholar
- Lentz L, De Jong M. The evaluation of text quality: expert-focused and reader focused methods compared. IEEE Trans Prof Commun. 1997;40:224–33.View ArticleGoogle Scholar
- Hoos A, Anderson J, Boutin M, Dewulf L, Geissler J, Johnston G, Joos A, Metcalf M, Regnante J, Sargeant I, et al. Partnering with patients in the development and lifecycle of medicines: a call for action. Ther Innov Regul Sci. 2015;49:929–39.View ArticlePubMedPubMed CentralGoogle Scholar
- Chakradhar S. Training on trials: patients taught the language of drug development. Nat Med. 2015;21:209–10.View ArticlePubMedGoogle Scholar
- Coyne CA, Xu R, Raich P, Plomer K, Dignan M, Wenzel LB, Fairclough D, Habermann T, Schnell L, Quella S, Cella D. Randomized, controlled trial of an easy-to-read informed consent statement for clinical trial participation: a study of the Eastern Cooperative Oncology Group. J Clin Oncol. 2003;21:836–42.View ArticlePubMedGoogle Scholar
- Koonrungsesomboon N, Laothavorn J, Chokevivat V, Hirayama K, Karbwang J. SIDCER informed consent form: principles and a developmental guideline. Indian J Med Ethics. 2016;1:83–6.PubMedGoogle Scholar
- Villafranca A, Kereliuk S, Hamlin C, Johnson A, Jacobsohn E. The appropriateness of language found in research consent form templates: a computational linguistic analysis. PLoS One. 2017;12:e0169143.View ArticlePubMedPubMed CentralGoogle Scholar
- Strech D, Bein S, Brumhard M, Eisenmenger W, Glinicke C, Herbst T, Jahns R, von Kielmansegg S, Schmidt G, Taupitz J, Tröger HD. A template for broad consent in biobank research. Results and explanation of an evidence and consensus-based development process. Eur J Med Genet. 2016;59:295–309.View ArticlePubMedGoogle Scholar
- Cambon-Thomsen A, Rial-Sebbag E, Knoppers BM. Trends in ethical and legal frameworks for the use of human biobanks. Eur Respir J. 2007;30:373–82.View ArticlePubMedGoogle Scholar
- Shickle D. The consent problem within DNA biobanks. Stud Hist Philos Biol Biomed Sci. 2006;37:503–19.View ArticlePubMedGoogle Scholar
- Deschenes M, Cardinal G, Knoppers BM, Glass KC. Human genetic research, DNA banking and consent: a question of ‘form’? Clin Genet. 2001;59:221–39.View ArticlePubMedGoogle Scholar