- Open Access
- Open Peer Review
Improving trial recruitment processes: how qualitative methodologies can be used to address the top 10 research priorities identified within the PRioRiTy study
Trialsvolume 19, Article number: 584 (2018)
The Methodology to this article has been published in Trials 2018 19:147
How can we improve recruitment to trials? In their recently published paper, Healy et al. outline the top 10 prioritised questions for trial recruitment research identified by the PRioRiTy study. The challenge now is for researchers to answer these questions; but how best can these be answered? In this commentary, we illustrate how qualitative research can be utilised to generate in-depth insight into trial recruitment issues, either as a stand-alone methodology, or through a mixed-methods approach. Consideration is given to how different forms of qualitative research can be used to address these priorities and to help researchers set out an agenda to optimise its value.
In their recently published paper, Healy et al. outline the top 10 prioritised questions for trial recruitment research identified by the Prioritising Recruitment in Randomised Trials (PRioRiTy) study (Table 1) . The challenge now is for researchers to answer these questions. We believe that there are significant opportunities for qualitative methodologies to contribute to better understanding of trial recruitment issues and that the true value of such methodologies has not been fully recognised, or realised, to date. By working together, all key stakeholders—including trialists, researchers, clinicians, practitioners, commissioners, managers, policy makers, and members of the public—can find answers to the various recruitment issues by embedding qualitative designs in trials, or vice versa (i.e. embedding trials within qualitative designs) . To this end, this paper will present a number of examples where qualitative research has been used to improve the conduct of trials, and specifically recruitment.
What is the value of qualitative methods in trial recruitment research?
Qualitative research can address questions in trial recruitment that are not easily addressed by quantitative methods, by providing in-depth information on the experiences of participants and recruiters. It can also help contribute to trial design, including the development of effective recruitment strategies. Qualitative research methods have been used to address various aspects of randomised trials; these include developing and understanding the acceptability of the intervention being trialled, the trial design, process and conduct (including recruitment and retention), explaining trial outcomes, and providing contextual understanding of the target condition for the trial . Increasingly, more focus is being placed on the pre-trial stage . Qualitative research can potentially improve the efficiency of trials by identifying problems with recruitment. This enables the trialists to address those problems and increase or optimise recruitment . Common qualitative research methods include interviews, focus groups, and observations. Other methods include analysis of trial documents, and audio recordings of trial recruitment interactions. While the integration of qualitative methods within randomised trials is recognised as important, in practice, fully embedded/integrated designs are rarely realised and methodological concerns persist [3,4,5]. It is imperative that researchers in primary qualitative research fully report and justify their methodological approach to ensure the rigor of their methods and maintain the credibility of qualitative research in trials. A range of potential weaknesses have been identified, including lack of clarity regarding methods, sample and data collection, limited explanation of context, poor description of data analysis, and failure to account for the impact, if any, of the qualitative researcher [6, 7] There is also a need for those undertaking qualitative evidence synthesis to address the confidence in their findings using GRADE CERQual . In addition, there are reporting guidelines on the EQUATOR network (https://www.equator-network.org/) specifically aimed at qualitative research and evidence synthesis.
How can questions be answered by qualitative methods?
We will now outline how different qualitative methodologies can be used to address the top 10 priorities. We have grouped the approaches into three categories: 1) interviews and focus groups; 2) observation, audio recording and documentary analysis; and (3) qualitative evidence synthesis. Each of the methods can also be used within mixed-methods approaches; however, we will not specifically address such approaches within this commentary. In mixed-methods research, the researcher collects and analyses both qualitative and quantitative data rigorously, integrates the two forms of data and their results, organizes these procedures into specific research designs, and frames these procedures within theory and philosophy (: page 5).
Interviews and focus groups
The use of individual interviews or focus groups within randomised trials facilitates understanding from the viewpoint of those experiencing phenomena (in this instance, recruitment to trials), and can be conducted with patient participants, recruiters, health professionals, or others. Individual interviews provide the opportunity for in-depth discussion of individuals’ personal insights and lived experiences, particularly when the topic is potentially sensitive [10, 11]. Alternatively, the strengths of focus groups lie in group dynamics and the interactive nature of the unfolding discussions. Focus groups allow discussion in a more relaxed atmosphere to explore shared experiences and develop understanding from their interaction .
Donovan et al. provide a detailed example of how interviews can provide a rich understanding of the complexities and hidden challenges underlying recruitment to randomised trials from the perspectives of recruiters . Similarly, Oakley et al. provide an example of the use of focus groups to support process evaluation within a trial . They argue that the science of a randomised trial is enhanced by ongoing high-quality evaluation which considers the context in which the intervention is delivered, helping to explain outcomes. Analysis of focus group data provides insight into acceptability and delivery of interventions from the perspective of participants ; interviews can also facilitate such insights. O’Cathain et al. identify the increasing use of focus groups and individual interviews within trials, suggesting that incorporating these methods at feasibility and pilot stages of trials can enhance the leaning about trials for trialists and researchers, and contribute to the overall trial endeavour .
Dormandy et al. conducted interviews with general practitioners to seek their views on effective ways of recruiting and retaining practices to clinical trials . This study found that interviews with general practitioners allowed identification of key strategies for communication, data collection, and payment to support retention and recruitment.
Donovan et al. synthesised findings from interviews with recruiters in a number of trials, providing improved understanding of the complexity and fragile nature of recruitment practices . Interviews elicited detailed information from recruiters regarding their tendency to undermine recruitment practices, specifically randomisation for clinical and equipoise reasons . Importantly, these findings were elicited in individual interviews, with responses being fed into efforts to improve recruitment practices. In an earlier study, Donovan et al. conducted in-depth interviews with men in the Prostate testing for cancer and Treatment (ProtecT) study to establish interpretation of study information by participants . Subsequent changes to the content and delivery of study information within this trial, incorporating findings from these interviews amongst other data, increased recruitment rates from 40% to 70% . The examples presented show that interviews and focus groups would be appropriate qualitative methods for most of the PRioRiTy questions, conscious of the group versus individual dynamic for some sensitive questions. Individual interviews would be more suitable for question nine (‘What are the best approaches to optimise the informed consent process when recruiting participants to randomised trials?’), however, where the process of informed consent would perhaps be better discussed individually.
Observation, audio recording, and documentary analysis
While the strengths of interviews and focus groups are to capture perspectives and experiences, there can sometimes be conflict between what people say happens and what actually happens. There are times when qualitative methods that capture interactions and events would be more suitable for answering questions about trial processes. These methods can include observations, audio recordings, and documentary analysis of trial processes. For example, Healy et al. conducted a mixed-methods process evaluation of the OptiBIRTH trial (a pan-European cluster randomised controlled trial (RCT)) . An ethnographic study conducted by Maguire was embedded within this study to explore the implementation of the intervention in practice . Qualitative observations and interviews uncovered the impact of the intervention on culture and rituals within the practice setting.
An example of the use of audio recording was presented by Donovan and colleagues . Analysis of audiotape recordings of recruitment appointments in the ProtecT study revealed how the language used when presenting trial information could impact on recruitment . This innovative qualitative approach became the cornerstone of QuinteT Recruitment Intervention (QRI) developed by Donovan and colleagues . The QRI involves understanding the process of recruitment in real time and then developing an action plan to address the identified difficulties in collaboration with the RCT Chief Investigator, Trial Management Group, and Clinical Trials Unit .
Documentary analysis examines anything written or produced about a context and how it has evolved . This can include formal and informal sources which may contain clues as to how a phenomenon has evolved . This is an important method to understand what is happening and the context from which the phenomenon has grown. Documentary sources, unlike interviews, are not the result of a somewhat artificial process of interaction and, therefore, the process by which they are produced cannot be ignored . Content analysis of trial documents was conducted in the Selective bladder Preservation Against Radical Excision (SPARE) feasibility study (along with analysis of interview data and audio recordings of recruitment appointments) to explore reasons for low recruitment and to attempt to improve recruitment rates . Trial documents examined included the SPARE trial Patient Information Sheet and trial protocol. Findings contributed to revisions to trial processes that were acceptable to trialists and recruiters.
In recruitment research, these qualitative methods, alone or in combination (as utilized for example in the QRI), could be used to answer the “what is happening?” component of the PRioRiTy questions. For instance, using observation or audio recording, the best approaches for including under-represented or vulnerable populations (question seven) could be explored. Similarly, informed consent processes (question nine: ‘What are the best approaches to optimise the informed consent process when recruiting participants to randomised trials?’) could be examined using observations, audio recording, or documentary analysis. Researchers could also use observational techniques to explore the role of technology in recruitment processes outlined in question ten. In the context of the PRioRiTy questions, documents would be important for augmenting evidence from interviews and observations , to develop a better understanding about recruitment processes and outcomes.
Qualitative evidence synthesis
In addition to emphasising the importance of primary qualitative studies in trial research, there is now recognition of the contribution to be made by qualitative evidence synthesis (QES). QES is a valuable way of synthesising primary qualitative research to capture experiences, perceptions, and factors that impact on certain components of the trial process. QES is rigorous and provides meaningful conclusions that can inform policy and practice [23, 24].
As outlined in the PRioRiTy paper, a number of qualitative syntheses have already been conducted that address questions six and nine [25,26,27,28]. It should be noted that all of the questions identified in the PRioRiTy paper were deemed “unanswered” if there was no up-to-date systematic review (< 3 years old). Houghton et al. have also published a Cochrane Protocol exploring the factors that impact on recruitment to trials . This ongoing qualitative review will be integrated with the findings of a Cochrane review  that aimed to identify interventions designed to improve recruitment to RCTs, which in turn will inform PRioRiTy questions two and six. QES has great potential for guiding further recommendations for most of the PRioRiTy questions.
Conclusions: where do we go from here?
The PRioRiTy study identified and prioritised important unanswered questions on how to improve the process of recruiting people to randomised trials. Further research is now required to address those prioritised questions. We propose that qualitative research approaches have a crucial role in providing answers to the questions posed. Similar to the examples provided, qualitative research could be conducted as a stand-alone study embedded as a study within a trial (SWAT), or as part of mixed-methods research. Failure to integrate findings and variations in quality are ongoing issues . Trialists and qualitative researchers need to collaborate and work together to ensure qualitative work is done appropriately, ethically, and rigorously.
As described above, there is ample opportunity for qualitative methodologies to address the top ten priorities identified for trial recruitment research. Organisations such as QUESTS, the HRB-TMRN, Trial Forge, and QuinteT can bridge links between trialists and researchers to better inform trial recruitment.
Some key considerations for moving this agenda forward are:
Qualitative research needs to be integral, and not considered an optional add-on.
There needs to be a common language supporting communication between trialists and researchers.
The potential positive impact of qualitative research in trial recruitment and other trial methodology research needs to be rigorously researched, articulated, and disseminated.
Qualitative research can help provide the necessary evidence to guide researchers on how to improve the process of how people are recruited to randomised trials; an issue which persists as a challenge to trialists.
Prioritising Recruitment in Randomised Trials
Prostate testing for cancer and Treatment
Qualitative Evidence Synthesis
QuinteT Recruitment Intervention
Qualitative Research in Trials Centre
Qualitative Research Integrated within Trials
Randomised Controlled Trial
Selective bladder Preservation Against Radical Excision
Study Within A Trial
Healy P, Galvin S, Williamson PR, Treweek S, Whiting C, Maeso B, et al. Identifying trial recruitment uncertainties using a James Lind Alliance Priority Setting Partnership—the PRioRiTy (Prioritising Recruitment in Randomised Trials) study. Trials. 2018;19(1):147.
Donovan J, Little P, Mills N, Smith M, Brindle L, Jacoby A, et al. Improving design and conduct of randomised trials by embedding them in qualitative research: ProtecT (prostate testing for cancer and treatment) study. BMJ. 2002;325(7367):766–70.
O'Cathain A, Thomas KJ, Drabble SJ, Rudolph A, Hewison J. What can qualitative research do for randomised controlled trials? A systematic mapping review. BMJ Open. 2013;3(6):e002889.
Plano Clark VL, Schumacher K, West C, Edrington J, Dunn LB, Harzstark A, et al. Practices for embedding an interpretive qualitative approach within a randomized clinical trial. J Mix Methods Res. 2013;7(3):219–42.
O’Cathain A, Goode J, Drabble SJ, Thomas KJ, Rudolph A, Hewison J. Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study. Trials. 2014;15(1):215.
Houghton C, Casey D, Shaw D, Murphy K. Approaches to rigour in qualitative case study research. Nurse Researcher. 2012;20(4):12–7.
Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. Br Med J. 2009;339:b3496.
Lewin S, Booth A, Glenton C, Munthe-Kaas H, Rashidian A, Wainwright M, Noyes J. Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. Implement Sci 2018;13(1), 2.
Creswell JW, Plano Clark VL. Designing and conducting mixed methods research. 3rd ed. London: Sage Publications Ltd; 2018.
Bazeley P. Qualitative data analysis: practical strategies. Los Angeles: Sage Publications; 2013.
Elam G, Fenton KA. Researching sensitive issues and ethnicity: lessons from sexual health. Ethn Health. 2003;8(1):15–27.
Greenbaum T. Moderating focus groups. Thousand Oaks: Sage Publications; 2000.
Donovan JL, Paramasivan S, de Salis I, Toerien M. Clear obstacles and hidden challenges: understanding recruiter perspectives in six pragmatic randomised controlled trials. Trials. 2014;15(1):5.
Oakley A, Strange V, Bonell C, Allen E, Stephenson J. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6.
Dormandy E, Kavalier F, Logan J, Harris H, Ishmael N, Marteau TM. Maximising recruitment and retention of general practices in clinical trials: a case study. Br J Gen Pract. 2008;58(556):759–66.
Healy P, Smith V, Savage G, Clarke M, Devane D, Gross MM, et al. Process evaluation for OptiBIRTH, a randomised controlled trial of a complex intervention designed to increase rates of vaginal birth after caesarean section. Trials. 2018;19(1):9.
Maguire R. “Trying for a VBAC”: an ethnography of cultural change within a randomised trial aimed at increasing vaginal birth after caesarean section: the OptiBIRTH study. Dublin: University of Dublin, Trinity College; 2016.
Donovan JL, Rooshenas L, Jepson M, Elliott D, Wade J, Avery K, et al. Optimising recruitment and informed consent in randomised controlled trials: the development and implementation of the QuinteT Recruitment Intervention (QRI). Trials. 2016;17(1):283.
Simons H. Case study research in practice. London: Sage Publications; 2009.
Bechhofer F, Paterson L. Principles of research design in the social sciences. London: Routledge; 2000.
Paramasivan S, Huddart R, Hall E, Lewis R, Birtle A, Donovan JL. Key issues in recruitment to randomised controlled trials with very different interventions: a qualitative investigation of recruitment to the SPARE trial (CRUK/07/011). Trials. 2011;12:78.
Shah SK, Corley KG. Building better theory by bridging the quantitative–qualitative divide. J Manage Stud. 2006;43(8):1821–35.
Mays N, Pope C, Popay J. Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J Health Serv Res Policy. 2005;10(1_suppl):6–20.
Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009;9(1):59.
Limkakeng A, Phadtare A, Shah J, Vaghasia M, Wei DY, Shah A, et al. Willingness to participate in clinical trials among patients of Chinese heritage: a meta-synthesis. PLoS One. 2013;8(1):e51328.
Nalubega S, Evans C. Participant views and experiences of participating in HIV research in sub-Saharan Africa: a qualitative systematic review. JBI Database of System Rev Implement Rep. 2015;13(5):330–420.
Wilman E, Megone C, Oliver S, Duley L, Gyte G, Wright JM. The ethical issues regarding consent to clinical trials with pre-term or sick neonates: a systematic review (framework synthesis) of the empirical research. Trials. 2015;16(1):502.
Eltorki M, Uleryk E, Freedman SB, Adams J. Waiver of informed consent in pediatric resuscitation research: a systematic review. Acad Emerg Med. 2013;20(8):822–34.
Houghton C, Dowling M, Meskell P, Hunter A, Gardner H, Conway A, Treweek S, Sutcliffe K, Noyes J, Devane D, Nicholas JR, Biesty LM. Factors that impact on recruitment to randomised trials in health care: a qualitative evidence synthesis. Cochrane Database of Syst Rev. 2017, Issue 5. Art. No.: MR000045.
Treweek S, Lockhart P, Pitkethly M, Cook JA, Kjeldstrøm M, Johansen M, et al. Methods to improve recruitment to randomised controlled trials: Cochrane systematic review and meta-analysis. BMJ Open. 2013;3(2):e002360.
Cooper C, O'Cathain A, Hind D, Adamson J, Lawton J, Baird W. Conducting qualitative research within clinical trials units: avoiding potential pitfalls. Contemp Clin Trials. 2014;38(2):338–43.
Marita Hennessy is a PhD Scholar funded by the Health Research Board under SPHeRE/2013/1.
Availability of data and materials
PH and SG are on behalf of the PRioRiTy study team, listed at https://priorityresearch.ie/.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
- Documentary analysis
- Focus groups
- Qualitative evidence synthesis
- Randomised trials
- Trial methodology
- Trial recruitment