Skip to main content

Qualitative and mixed methods research in trials

Peer Review reports

This BMC Special Issue on qualitative and mixed methods research in clinical trials marks an important stage in both methodological development and collaborative relationships between researchers from different academic and clinical fields. It is indicative of the level of interest in the work of a now-substantial community of researchers, and a measure of the extent of integration of that work into the methodological component of trials. It highlights the ability to explore, explain and work through important questions for trials, as well as to provide trialists with evidence-based tools which they can use to improve and refine their own research practice. It is a sign of the growth in comfort and familiarity within the trials community with the aims, perspectives and techniques of qualitative and mixed methods research.

Key aims of this series are to showcasethe range of qualitative and mixed methods research in this field and the ways in which they can be utilised to support the methodological growth of clinical trials. The range of qualitative and mixed methods studies published in Trials in recent years is indicative of the growing importance of these approaches. Now endorsed by funders [3] and embraced by trialists [16], qualitative studies are moving beyond being an adjunct to a trial or an opportunist form of study. They are becoming an integral activity for trial teams and clinical trials units [19, 2]. This is a long way to have come in the relatively short history of this particular field. In the late 1980s and 1990s, early work on views of trials and their processes was often hypothetical and adopted simple thematic approaches, commonly collecting data with simple questionnaires. It often focused on a small number of key logistical and ethical issues: recruitment, standards of consent and challenges of integrating research and clinical obligations. From this has grown a complex field with expanding interests and objectives using a range of methodological approaches.

If we look at the field now, those core concerns are still important with research around recruitment still forming a large part of the qualitative and mixed methods portfolio. This strand of work continues because, as with the trials we study, it is rarely the case that there can be one definitive piece of research which fully answers our questions. Many studies seek to better understand the challenges involved in different settings (see for example work by Donovan and colleagues [6]) and are doing so with increasing sophistication. Some studies, for instance, involve direct intervention in an ongoing trial as the knowledge gained in pilot or integrated qualitative research is fed into the recruitment process to improve practice [7, 13]. Such studies provide a depth analysis of one trial, seeking to understand the particular circumstances in which it is set and the conditions under which it operates, in order to implement change, but these studies almost always have lessons for upcoming trials. New trials bring with them new challenges, and we push on with recruitment-related research as the questions as well as the settings keep on changing. We now have, for instance, the opportunity to recruit hard-to-reach research populations via social media [24]. We have legislation in Europe which permits trial enrolment in emergency settings without prior consent. Qualitative research helps us to understand how such approaches to recruitment in these novel settings are viewed [21, 2527]. Studies of decision-making, consent and recruitment are part of an ongoing endeavour to chip away at important questions and improve understanding of the multifaceted and dynamic nature of this key area of trials practice. The body of qualitative research on recruitment is now sufficiently large for reviews [10] and meta-analyses to be a reality [9, 11], and given the importance of these approaches, we are working with our sister journal Systematic Reviews for this Special Issue (see Systematic Reviews Special Issue editorial by David Gough).

Ethical aspects of trial conduct also continue to be an important area for qualitative and mixed methods research. Exploration of the impact of policies such as feedback of results, a policy driven by development of fair and transparent trial processes, demonstrates diverse reactions among participants and, for some, profound and enduring effects made visible only through qualitative inquiry [5, 20]. The groundwork of such studies in identifying ethical issues, benefits and concerns allows us to move on to develop the tools and evidence base and for change. The Ottawa Statement on the Ethical Design and Conduct of Cluster Randomized Trials [28], based on a complex mixed methods study, is a recent example of how we can progress directly from qualitative research to the generation of evidence-based guidelines for the good conduct of clinical trials.

The Ottowa Statement is a positive example of the value of holistic consideration of the design and analytical choices trial teams make, issues which are not so often considered by qualitative researchers. This is an important new direction for study with scope for qualitative exploration of the value of different trial methods and methodological questions (see, for instance, the work of Dimairo and colleages [4] on trialists’ views of adaptive trial designs and Snowdon and colleagues [20] on expert methodologists’ views of inclusion and exclusion criteria in high mortality trials). Views and experiences of the effects of design on trial participants are also important but have received insufficient scrutiny. Work in this area is, however, emerging with, for instance, studies of views of the use of sham interventions [18], placebos [23] and control groups [12]. Qualitative and mixed methods researchers are now demonstrating the contribution they can make to the development of trial outcome measures which are conceptually grounded in the knowledge, values, preferences and needs of patients, trial participants and healthcare providers [8, 14].

We need to continue to grow in our understanding of the value and application of qualitative research in this context, especially in mixed methods studies where integration of data from different approaches is a crucial and complex endeavour [15]. We need to engage with the epistemological challenges involved [1]. The qualitative stream of work at ConDuCT (Collaboration and Innovation for Difficult or Complex Randomised Controlled Trials - http://www.bris.ac.uk/social-community-medicine/centres/conduct2/research/theme-2.html), one of the MRC Hubs for Trial Methodology Research, and the QUART study to consider the contribution of qualitative research to trials [17] are evidence of this reflexive and empirically driven direction in methodological research. As trials develop and change and focus on new areas of medicine, they will explore ever more complex interventions, using new methodological tools. As they do so, new and complex questions of conduct, policy and ethics will emerge.

New questions and methodological innovation allow important strides forward, as do shifts in our thinking about data and evidence. A move away from a deficit model, in which we see participants as “failing” to understand, allows us to use testimonies of participants and professionals on an equal footing, recognising and valuing the different expertise they have to offer. A widening of focus from initial recruitment to the full course of the trial allows us to consider the ongoing lived experience of participants into which trial-related events and views are incorporated. Interest in the “hidden challenges” [6] and the unseen areas of research practice allows close scrutiny of what Stobart [22] refers to as the “liminal spaces” in which the everyday work of trials is carried out. We need to explore these different components in order to improve our understanding of the whole.

This is a dynamic and evolving field, and we anticipate that the collective body of work for this Special Issue will clearly demonstrate the variety and complexity of the work we do. We hope that it will be a forum for methodological reflection and debate and will stimulate, in the spirit of qualitative enquiry, engagement with context, experience and expertise, and will bring to the fore new and emergent questions for clinical trials.

References

  1. Blackwood B, O’Halloran P, Porter S. On the problems of mixing RCTs with qualitative research: the case of the MRC framework for the evaluation of complex healthcare interventions. J Res Nurs. 2010;15(6):511–21.

    Article  Google Scholar 

  2. Cooper C, O'Cathain A, Hind D, Adamson J, Lawton J & Baird W 2014) Conducting qualitative research within Clinical Trials Units: avoiding potential pitfalls. Contemp Clin Trials, 38(2), 338–343.

    Article  PubMed  Google Scholar 

  3. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: new guidance: MRC. 2008.

    Google Scholar 

  4. Dimairo M, Boote J, Nicholl J, Todd S. Missing steps in a staircase: a qualitative study of the perspectives of key stakeholders on the use of adaptive designs in confirmatory trials. Trials. 2015;16:430.

    Article  PubMed Central  PubMed  Google Scholar 

  5. Dixon-Woods M, Tarrant C, Jackson CJ, Jones DR, Kenyon S. Providing the results of research to participants: a mixed-method study of the benefits and challenges of a consultative approach. Clin Trials. 2011;8(3):330–41.

    Article  PubMed  Google Scholar 

  6. Donovan JL, Paramasivan S, de Salis I, Toerien M. Clear obstacles and hidden challenges: understanding recruiter perspectives in six pragmatic randomised controlled trials. Trials. 2014;15:5. doi:10.1186/1745-6215-15-5.

    Article  PubMed Central  PubMed  Google Scholar 

  7. Donovan JL, Rooshenas L, Jepson M, Townsend D, Wade J, Avery K, et al. An intervention to improve informed consent and recruitment to randomised clinical trials: the development of the Quintet Recruitment Intervention (QRI). In press.

  8. Heffernan E, Coulson, Henshaw H, Barry J, Ferguson M. The development of a measure of participation in adults with hearing loss: a qualitative study of expert views. Trials. 2015;16Suppl 1:30. doi:10.1186/1745-6215-16-S1-P30.

  9. Hughes-Morley A, Young B, Waheed W, Small N, Bower P. Factors affecting recruitment into depression trials: systematic review, meta-synthesis and conceptual framework. J Affect Disord. 2014;172C:274–90.

    PubMed  Google Scholar 

  10. Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009;339:b3496.

    Article  PubMed Central  PubMed  Google Scholar 

  11. Mccann S, Campbell M, Entwistle V. Recruitment to clinical trials: a meta-ethnographic synthesis of studies of reasons for participation. J Health Serv Res Policy. 2013;18:233–41.

    Article  PubMed  Google Scholar 

  12. Meinich Petersen S, Zoffmann V, Kjærgaard J, Graff Stensballe L, Greisen G. Disappointment and adherence among parents of newborns allocated to the control group: a qualitative study of a randomized clinical trial. Trials. 2014;15:126.

    Article  PubMed Central  PubMed  Google Scholar 

  13. Mills N, Blazeby JM, Hamdy FC, Neal DE, Campbell B, Wilson C, et al. Training recruiters to randomized trials to facilitate recruitment and informed consent by exploring patients' treatment preferences. Trials. 2014;15:323.

    Article  PubMed Central  PubMed  Google Scholar 

  14. Nguyen AM, Humphrey L, Kitchen H, Rehman T, Norquist JM. A qualitative study to develop a patient-reported outcome for dysmenorrhea. Qual Life Res. 2015;24(1):181–91.

    Article  PubMed  Google Scholar 

  15. O’Cathain A, Murphy E, Nicholl J. Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study. BMC Health Serv Res. 2007;7:85.

    Article  PubMed Central  PubMed  Google Scholar 

  16. O'Cathain A, Goode J, Drabble SJ, Thomas KJ, Rudolph A, Hewison J. Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study. Trials. 2014;15:215.

    Article  PubMed Central  PubMed  Google Scholar 

  17. O’Cathain A, Thomas KJ, Drabble SJ, Rudolph A, Goode J, Hewison J. Maximising the value of combining qualitative research and randomised controlled trials in health research: the QUAlitative Research in Trials (QUART) study – a mixed methods study. Health Technol Assess. 2014;18(38):1–197.

    PubMed  Google Scholar 

  18. Paterson C, Zheng Z, Xue C, Wang Y. "Playing their parts": the experiences of participants in a randomized sham-controlled acupuncture trial. J Altern Complement Med. 2008;14(2):199–208.

    Article  PubMed  Google Scholar 

  19. Rapport F, Storey M, Porter A, Snooks H, Sanchez A, Thorne K, et al. Developing a Standard Operating Procedure for a clinical trials unit: qualitative research and the quasi experimental study or pragmatic randomisedtrial, Trials 2013, 14:54 doi:10.1186/1745-6215-14-54.

  20. Snowdon C, Brocklehurst P, Tasker R, Ward-Platt MPW, Elbourne D. Death, Bereavement and randomised controlled trials (BRACELET): a methodological study of policy and practice in neonatal and paediatric intensive care trials. Health Technol Assess. 2014;18:1–410.

    Article  Google Scholar 

  21. Snowdon C, Elbourne D, Forsey M, Alfirevic Z. Views of emergency research (VERA): A qualitative study of women and their partners' views of recruitment to trials in severe postpartum haemorrhage. Midwifery. 2012;28(6):800–8.

    Article  PubMed  Google Scholar 

  22. Stobart L (in press- Trials)

  23. Stone DA, Kerr CE, Jacobson E, Conboy LA, Kaptchuk TJ. Patient expectations in placebo-controlled randomized clinical trials. J Eval Clin Pract. 2005;11(1):77–84.

    Article  PubMed  Google Scholar 

  24. Storrar W, Dewey A, Chauhan A, Fogg C, Lanning E, Brown T, et al. Early qualitative analysis to enhance trial processes, Trials. 2015. 16(Suppl 2):P73.

  25. Storrar W, Brown T, Balls L, Chauhan A, Fogg C. Recruitment to clinical trials - the use of social media, Trials. 2015. 16(Suppl 2):O77.

  26. Woolfall K, Frith L, Gamble C, Gilbert R, Mok Q, Young B. How parents and practitioners experience research without prior consent (deferred consent) for emergency research involving children with life threatening conditions: a mixed method study. BMJ Open. 2015; 5.e008522. doi:10.1136/bmjopen-2015-008522. http://bmjopen.bmj.com/content/5/9/e008522.full.

  27. Woolfall K, Young B, Frith L, Appleton R, Iyer A, Messahel S, et al. Doing challenging research studies in a patient centred way: qualitative study to inform a randomised controlled trial in the paediatric emergency care setting. BMJ Open. 2014;4(5):e005045. doi:10.1136/bmjopen-2014-005045.

    Article  PubMed Central  PubMed  Google Scholar 

  28. Weijer C, Grimshaw JM, Eccles MP, McRae AD, White A, Brehaut JC, et al. The Ottawa Statement on the Ethical Design and Conduct of Cluster Randomized Trials. PLoS Med. 2012;9(11):e1001346.

    Article  PubMed Central  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Claire Snowdon.

Additional information

Competing interests

The author declares that she has no competing interests.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Snowdon, C. Qualitative and mixed methods research in trials. Trials 16, 558 (2015). https://doi.org/10.1186/s13063-015-1084-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-015-1084-4