Skip to main content

How to embed qualitative research in trials: insights from the feasibility study of the SAFER trial programme

Abstract

Qualitative research can enhance the design, conduct and interpretation of trials. Despite this, few trials incorporate qualitative methods, and those that do may not realise their full potential. In this commentary, we highlight how qualitative research can contribute to the design, conduct and day-to-day running of a trial, outlining the working arrangements and relationships that facilitate these contributions. In doing so, we draw on (i) existing frameworks on the role of qualitative research alongside trials and (ii) our experience of integrated qualitative research conducted as part of the feasibility study of the SAFER trial (Screening for Atrial Fibrillation with ECG to Reduce stroke), a cluster randomised controlled trial of screening people aged 70 and above for atrial fibrillation in primary care in England. The activities and presence of the qualitative team contributed to important changes in the design, conduct and day-to-day running of the SAFER feasibility study, and the subsequent main trial, informing diverse decisions concerning trial documentation, trial delivery, timing and content of measures and the information given to participating patients and practices. These included asking practices to give screening results to all participants and not just to ‘screen positive’ participants, and greater recognition of the contribution of practice reception staff to trial delivery. These changes were facilitated by a ‘one research team’ approach that underpinned all formal and informal working processes from the outset and maximised the value of both qualitative and trial coordination expertise. The challenging problems facing health services require a combination of research methods and data types. Our experience and the literature show that the benefits of embedding qualitative research in trials are more likely to be realised if attention is given to both structural factors and relationships from the outset. These include sustained and sufficient funding for qualitative research, embedding qualitative research fully within the trial programme, providing shared infrastructure and resources and committing to relationships based on mutual recognition of and respect for the value of different methods and perspectives. We outline key learning for the planning of future trials.

Trial registration: Screening for atrial fibrillation with ECG to reduce stroke ISRCTN16939438 (feasibility study); Screening for atrial fibrillation with ECG to reduce stroke – a randomised controlled trial ISRCTN72104369.

Peer Review reports

Background

Much has been written about the multiple benefits qualitative research can bring to the design, conduct and interpretation of trials. At the pre-trial stage, qualitative approaches can contribute to the optimisation of the content, quality, delivery and acceptability of the trial intervention [1,2,3,4,5,6]. Methods such as interviews and focus groups can explore patients’ experiences and beliefs [7,8,9,10] to inform the choice of important outcomes for trials and minimum standards for interventions. Such preparation may “reduce unwelcome surprises and costly errors during the main trial” ([4]: 257). Qualitative appraisal of the nature of obtaining and sustaining informed consent [2, 11, 12] can strengthen the ethical foundation of trials. Examination of issues that impair the efficiency and acceptability of recruitment processes can enhance trial uptake [2, 13,14,15] and participant retention. Crucially, qualitative methods (notably qualitative process evaluations which include ethnographic observations) can support the implementation of complex interventions by exposing the contexts and the social and behavioural processes that may derail or amplify their success [9, 16,17,18,19,20,21]. Qualitative research, then, may enhance and strengthen trials in manifold ways [2, 22, 23]. As Greenhalgh et al. comment [24]: “Few research topics in clinical decision making and patient care can be sufficiently understood through quantitative research alone.”

Despite these enticing sounding claims, in practice, very few trials incorporate qualitative methods. A review of three trial registers from 1999 to 2016 found only 0.03 to 3.4% of trials reported using qualitative methods; trials of complex interventions were the most likely to do so [7]. Only 2% of funded trial proposals in the UK from 2001 to 2010 described embedded qualitative research [25]. Even when qualitative research is included in trials, concerns have been raised about its quality, visibility and reporting [7, 20, 25, 26]. Such studies typically rely on standard methods like interviews and focus groups, rather than generating insights using the whole range of available qualitative methods [22], and are usually concerned with highly visible trial mechanisms (such as the content and delivery of interventions), rather than with wider trial processes [23]. As one paper summarised, qualitative approaches in trials “continue to be underused, underreported, inadequately described and contain systematic and methodological shortcomings” ([4]: 257).

Even when there is a commitment to the inclusion of qualitative approaches within a trial, there is little practical guidance on how to achieve this effectively. Debate about the philosophical appropriateness of integrating qualitative and quantitative data continues [27, 28], whilst concrete examples of integration are scarce [29]. A number of frameworks outline the potential contribution of qualitative research to trials [30]. Although these frameworks vary in their details, they typically use one of three lenses [31]: (i) a temporal focus on qualitative methods to use before, during and after a trial [32, 33]; (ii) a process-outcome evaluation framework with qualitative research used to explore components like the context, reach and implementation of an intervention [26, 31]; and (iii) a broader focus on how qualitative methods can contribute across varying aspects of a trial, including the intervention, trial design and context, outcomes, process and outcome measures, understanding of the target health condition and experience of the participants [8, 30, 34]. A further dimension included in some frameworks is the degree of integration between the qualitative research and the trial [6, 35].

This continued focus on abstract design issues hides a surprisingly under-developed literature on how to deliver high-quality qualitative research alongside trials, and good examples remain rare [36, 37]. A crucial absence is recognition of the role of interpersonal dynamics within the research team [38]. Too often, research aspirations are derailed by mundane practicalities or poor relationships [39]. A key question for all trial programmes therefore, alongside how to integrate qualitative and quantitative research, is how to integrate qualitative and quantitative researchers. Effective team working is too often taken for granted, only brought to the fore when studies encounter serious problems [23]. One existing framework highlights three types of joint working between trial and qualitative researchers: at best interdisciplinary (representing close working), at worst dysfunctional and, somewhere in the middle, multidisciplinary (working in parallel or in sequence) [38]. What this looks like on the ground is far from clear.

This commentary starts to address these gaps. Its aim is to describe the changes to the design, conduct and day-to-day running of a trial arising from embedded qualitative research and to explore the working arrangements and relationships between qualitative and trial team researchers that facilitated these changes. We use as a case study our experience of working closely together, as qualitative and trial teams, in the feasibility study of the SAFER trial [40], a cluster randomised controlled trial (RCT) of screening for atrial fibrillation (AF) in primary care.

Embedded qualitative research: a case study

The SAFER trial is a large cluster randomised controlled trial of screening for the heart condition AF in older adults (age 70 and above) in primary care in England (Fig. 1). The main phase of the SAFER trial aims to recruit 126,000 consented patients from 360 general practices (84,000 patients in the control arm, 42,000 patients in the intervention or screening arm), with an average follow-up of 5 years; recruitment to the internal pilot began in spring 2021. The feasibility study on which this commentary is based was carried out in 2019 in ten general practices. These practices — all delivering the screening intervention in order to test feasibility — recruited a total of around 3440 participants from 8000 invitations.

Fig. 1
figure 1

Outline of the SAFER programme. Note: a second small feasibility study (introduced in response to the COVID-19 pandemic) was carried out in 2020-2021 to assess the feasibility of remote delivery of the screening intervention

The SAFER trial programme includes extensive, embedded qualitative research, running throughout all phases. In the feasibility study, this focused on exploring GP practice and participant experiences of AF screening. Data collection included longitudinal, repeat interviews with 24 screening participants (55 interviews in total); interviews with study invitees who declined to participate in the SAFER study (n=12); interviews with SAFER study participants who declined the offer of screening (n=12); interviews with staff and other stakeholders (n=19); and observations of screening appointments (n=47), along with observations of general care delivery, in three case study practices.

Impact of qualitative research on the SAFER trial

In reflecting on the impact of qualitative research on the SAFER trial, we drew extensively on existing literature and used existing frameworks of qualitative research alongside trials, notably O’Cathain’s model of the stages at which such research may be utilised [34], to identify key areas of change.

We identified multiple modifications to the design, conduct and day-to-day running of the trial arising from the activities and presence of the qualitative team within the SAFER programme. The qualitative data and observations made by the SAFER qualitative team led to modifications within the intervention, the conduct of the trial and the timing and content of the assessment of outcomes (Table 1). Two significant changes were an alteration asking practices to notify all screening participants (not just ‘screen positive’ participants) of their screening results (discussed further below), and the inclusion of resources and information in recognition of the pivotal role played by practice reception staff in the trial delivery. As we outline below, a ‘one research team’ way of working is the norm on the SAFER programme. Trial team members emphasised that this way of working facilitated many and varied informal contributions to trial improvements as a result of the qualitative data and qualitative researchers. A key observation made at one of our joint discussions about our ways of working in preparation for writing this commentary was that there were “too many contributions to remember” and that it was hard to pull out specific examples because “this is so much part of the way we work”.

Table 1 Qualitative research contribution in the feasibility study of the SAFER trial programme

Routes to impact: the importance of integrated working arrangements and respectful relationships

One question we have reflected on extensively is what it was about the SAFER programme that made these contributions possible: what factors had enabled and enhanced the changes we identified? We considered the argument made by several authors (e.g. 25,26) that the degree of integration between qualitative research and a trial — the degree of ‘embeddedness’ of the qualitative research — was an important determinant of the extent to which qualitative research could broaden and sustain its contribution. This led us to reflect on something that we had largely taken for granted: the degree to which the qualitative research and qualitative researchers were an integral part of the SAFER programme. We examined the set-up, organisation and delivery of the SAFER programme and identified key aspects that underpinned this integration and that we believe enabled and enhanced the changes we identified.

Qualitative research workstreams were central and well-resourced

The trialists involved in the study were sensitised to the value of qualitative research through previous positive experience, both in general and particularly in relation to the topic of screening for AF. They were therefore keen to ensure that qualitative research was central to the SAFER endeavour from the outset. The senior qualitative lead contributed to the design of the programme from an early stage and was a co-investigator on all grant applications; additional senior qualitative collaborators were named on the main programme grant application. The senior qualitative lead was funded at 20% full-time equivalent (FTE) throughout the feasibility study and main trial, and a total of 7.5 years FTE was allocated to postdoctoral qualitative researchers. Senior members of the trial team sat on the appointment panels for these researchers.

The protocol made clear that the qualitative components of the trial were essential to fulfilling the trial objectives and meeting policy requirements. The SAFER research team set out to answer the overall research questions of the trial (in brief, the feasibility, harms, effectiveness and cost-effectiveness of a national screening programme for AF in primary care) by drawing on a range of types of data: clinical data, other quantitative data (e.g. engineering and organisational data), qualitative data and health economic data. Furthermore, the protocol explicitly referred to the need to integrate the qualitative findings with the quantitative trial outcomes in order to address the core aim of the trial and the potential implementation of a national screening programme after the trial.

A “one research team” approach was innate

Working arrangements promoted a ‘one research team’ approach from the outset, facilitated by the co-location of the SAFER qualitative research team in the same University department as the SAFER trial team. The structure of meetings within the programme reflected the integrated ‘one team’ approach: separate qualitative research team and trial team meetings that discussed detailed work processes, data collection and data analysis, fed into joint meetings attended by both. A key joint meeting was the monthly Trial Management Group meeting: trial team members and qualitative team members who were not part of the management group itself acknowledged the importance of attending this meeting in understanding the whole trial and how the different workstreams were inter-connected. Some of the meeting arrangements were set up at the outset and others emerged as the feasibility study progressed. Notably, regular smaller meetings between members of the trial team and the two postdoctoral qualitative researchers were established to ensure that the qualitative and quantitative data collection streams were co-ordinated effectively and informed by each other. This meeting was supported by a shared ‘living’ document, used as a focus for recording, discussing and addressing emerging issues.

The qualitative data collection processes were integrated into the trial ‘study coordination’ database. This was facilitated by holding meetings between the database manager, members of the qualitative research team and the trial team to design and modify the database. This integration within the database enabled qualitative and trial team members to work together to coordinate the involvement of selected trial participants in the qualitative strands of the study (e.g. in successive qualitative interviews at different points on the screening pathway) and to maintain shared records of communication with participants. A designated member of the trial team was responsible for supporting the administrative aspects of the qualitative fieldwork (e.g. contacting participants to arrange interview times).

Between meetings, research team members were in regular contact by phone, email and (later) a dedicated Microsoft Teams chat [41], covering work such as consulting on draft documents or debating potential changes to the trial protocol. All trial documents were available on shared servers so that they could be worked on or amended by a range of team members as appropriate. In addition to daily informal communication and reports made at joint meetings, the qualitative team wrote a rapid, formal report at the end of the feasibility study. It summarised emergent findings from the qualitative research, reported early analysis on patient and staff experiences in the trial and on how practices implemented it, and made observations for the team to consider in relation to the internal pilot and the main trial phases. The report was shared with the Programme Steering Committee members. The trial team took all these observations forward.

Diverse and complementary skills and experience were respected and used

Close working between members of the SAFER team meant that decisions were informed by diverse research insights and professional experience. Qualitative researchers on the team brought experience of designing qualitative studies and collecting, analysing and writing up qualitative data from patients, health professionals, managers and wider stakeholders. As individuals and as a team, they had an orientation to the research process that was different from, but complementary to, the orientations of the members of the trial team who came from other research and professional backgrounds. This could be seen in meetings when individuals drew on experience or data gained outside of or prior to the SAFER trial in explaining a point of view or raising a concern. Equally, the trial team were able to inform qualitative research plans when adjustments were needed to work around the needs of the trial processes.

A shared understanding of the purpose of the feasibility study was developed

Key to effective working as a team in all this was a shared understanding (and a willingness to act on this understanding) that the express purpose of the feasibility study was to learn from experience and to refine and improve the processes and documents in preparation for the main trial. This shared understanding helped to foster an openness to constructive suggestions from any team member and a readiness to do the additional work of amending trial documents and submitting often lengthy and detailed protocol amendments to serve that aim.

We describe here three examples of changes (included in Table 1) that resulted from this way of working.

Reporting screening results to all participants

Many changes to trial procedures emerged through repeated discussions amongst the SAFER team. One example emerged from an observation by the qualitative team of how screening results were being reported to participants by practices. Although the protocol stated that practices would only notify ‘screen positive’ participants of their screening results, one practice was contacting all participants with their screening results (positive or negative). Qualitative data showed that participants and practice staff had concerns that only returning ‘positive’ screening results risked provoking participant anxiety (e.g. that a positive screening result may have been ‘lost in the system’) and could be discourteous to trial participants. The issue was discussed further by the Trial Management Group, at an ‘All investigators’ meeting and in detail by the chief investigator and the qualitative lead to explore how the concerns might best be addressed within the constraints of funding. The trial team subsequently submitted a protocol amendment that screening practices would be encouraged to inform all participants of the result of their screening (positive or negative).

Providing a trial update to participants

Another example of qualitative data leading to a change in trial processes concerned feedback to participants and practices. A recurrent finding was that trial participants were keen to know more about the trial and to receive feedback after their participation in addition to the option to receive a summary of the results at the end of the trial. The qualitative team suggested that this earlier feedback might also have the wider benefit of encouraging participants to engage with future research studies. The trial team agreed to produce a brief ‘feedback and thank you’ message from the feasibility study that practices could share with patients.

Removing the heart rate check from the screening device set up

The trial team also made specific requests for qualitative data to inform decisions on future trial processes. For example, a query was raised about whether it was desirable to include a heart rate check when a participant was set up with the screening device (i.e. to assess whether the participant’s heart rate was within a pre-specified range). This requirement was a barrier to designing a ‘remote’ screening programme to enable the trial to continue during the COVID-19 (coronavirus 2019) pandemic. The Trial Management Group reviewed both quantitative and qualitative data from the feasibility study to inform the decision. The qualitative team collated data from patient and practice staff interviews and from observations of screening appointments, which demonstrated that the heart rate check was a source of anxiety for some patients and provided false reassurance to others. It also created challenges for the staff running the screening clinic as it could generate further action (e.g. referral to the duty doctor). The trial team used the qualitative data together with the quantitative data (which showed that no important health conditions were picked up as a result of the heart rate check) to support removing the heart rate check.

As Table 1 illustrates, qualitative insights and researchers drove a number of changes to the SAFER trial following the feasibility study. Issues brought to the fore and ‘championed’ by the qualitative team ranged from high profile trial design considerations to mundane practicalities; cumulatively, these had the potential to improve the efficiency of conduct, experience of participating patients and practice staff, and the overall reputation of the trial and the institutions involved. The qualitative team acted as advocates both for the specific findings identified through qualitative data analysis and for the broader perspectives that a qualitative research orientation represents. It was intended from the outset that qualitative research would contribute to changes to the trial: the feasibility study was set up to explore aspects of trial design (e.g. acceptability to participants, viability in busy practices). The SAFER trial team also had in place mechanisms to receive feedback from practice and patient participants (e.g. device feedback forms from patients, case report forms from practice participants and teleconferences with practice participants to share experiences and tips for use by future practices in the trial). However, the trial benefitted not just from the qualitative data, but also from the additional and complementary resource of the qualitative researchers, who brought insights from their previous research and from the qualitative research within the SAFER programme to bear on a daily basis.

Senior investigators with expertise in qualitative and quantitative methods

The senior investigators were conversant with and supportive of both qualitative and quantitative methods. Thus, they were able to understand and appreciate the contribution of different forms of data and their interaction and to ‘translate’ or interpret those meanings to others. We are not suggesting that trial researchers need to be confident in using both qualitative and quantitative methods themselves. In our experience, this dual qualification is rare among health researchers and is unlikely to be necessary. What is needed is a team culture within which all members (regardless of discipline) respect and value the contribution of other methods and the knowledge and experience of other researchers on the team and that this culture is endorsed and embodied by the senior investigators on the trial.

In referring to a qualitative/quantitative dualism, we may risk evoking and even contributing to the long-running and ongoing debates about the existence of such a dualism and its ramifications. Nevertheless, there remains considerable evidence (e.g. 2,24,37) that whilst these debates may be old, the standpoints and methodological challenges that give rise to them do persist in some of the structures and influential discourses in health research.

Challenges

The many benefits achieved did not occur without challenges. Proponents of qualitative research alongside trials acknowledge a range of potential difficulties. Notably, an embedded RCT places particular demands on the design of the trial, requiring careful consideration of the timing of data collection, analysis and reporting. Parallel workstreams must not impede each other or disadvantage participants. The timing and mechanisms of reporting (both internal and external) and of formal and informal communication between the researchers must be efficient and accommodating of trial processes [2, 37, 42]. An assessment needs to be made at the design stage as to whether any data collection streams risk ‘contaminating’ the outcomes from other parts of the trial [42, 43], and how to mitigate such risks. Recruitment of healthcare organisations and of individuals to the trial requires disclosure at the outset of the details of all elements of the trial (both quantitative and qualitative) and an indication of which elements are compulsory and which are optional. The scope for refining aspects of the qualitative data collection in response to emerging findings may therefore be more limited than in a discrete qualitative study.

One of the concerns expressed about the inclusion of qualitative approaches in an embedded RCT is that embedded designs may undervalue and underutilise interpretive qualitative approaches. Interpretive qualitative approaches are broadly concerned with interpreting the ways that actors in the study setting (e.g. healthcare professionals and patients participating in the trial) understand its activities, structures and language and the meanings they give to their experiences in the setting [8, 37]. Such approaches typically use qualitative research methods that are more time- and labour-intensive for researchers or participants (e.g. ethnographic observations, diary methods [26]). As we noted in the ‘Background’ section, qualitative research in trials has tended to use standard methods, such as interviews and focus groups, rather than the full range of qualitative approaches. This may well be because of the scheduling constraints imposed within an RCT design or because of limited funding allocated to the qualitative research elements. Our contention is that when the qualitative research is built into the design of the trial from the outset, with sufficient resourcing and qualitative expertise throughout, it is possible to enlarge the range of qualitative methods being used [43] and to give due weight to interpretive approaches.

The risk of selection bias poses a further challenge. Although this is a risk faced by all research studies to some degree, qualitative research carried out in an embedded RCT grapples with a particular challenge: by definition, the qualitative research participants are individuals who are willing and able both to engage with the overall trial and to additionally participate in qualitative research (e.g. taking part in interviews or being observed during healthcare appointments). Selection bias may also occur in the recruitment of healthcare organisations in embedded RCTs, such as towards those which are able to accommodate qualitative research data collection, e.g. by providing researchers with access to rooms or staff. These particular risks can be offset by designing the trial to include diverse participants and healthcare organisations, offering a range of data collection methods and recruiting to the qualitative research ‘non-standard’ participants (e.g. participants who decline the trial invitation or the trial intervention).

Threats to recruitment and retention in embedded RCTs can be reduced by patient and public involvement (PPI) in the design of the trial and the participant documentation, offering a range of data collection methods appropriate to the study population and ensuring that qualitative research participants are not disadvantaged or overburdened relative to other trial participants.

A further challenge concerns assessing whether any of the trial outcome measures may be compromised by embedded qualitative research [42], for example if research participants change their minds about trial participation or about the intervention as a result of taking part in interviews or focus groups or withdraw from the trial because of research fatigue.

Other considerations faced by embedded RCTs include the resource implications of labour-intensive qualitative research methods, issues of consent and confidentiality for trial participants, the possibility of unplanned modifications to the trial intervention during the full RCT and the risk that qualitative researchers may identify issues that disrupt existing processes and are challenging to address [8, 23, 31, 42, 43]. As Russell et al. noted in response to qualitative insights brought to a trial: “One conclusion that could be drawn from these results is that they unhelpfully complicate matters for those undertaking a trial” ([37]:4). To these challenges, we would add, from the perspective of the qualitative researchers: the constraints of working within the more bounded and often externally driven timelines of a trial (in contrast to the more fluid timescales and greater flexibility that may be possible within a discrete qualitative research study), the challenge of maintaining focus within a large and complex trial in which there are many processes and themes of potential interest, the need to communicate to trial team colleagues the breadth of the qualitative team interest, the ‘hidden’ work of contributing to routine trial processes and the subsequent impact on the social science research that is a major focus for the qualitative researchers, the need to cultivate an identity that is part of the team but able to act as ‘critical friends’ when appropriate and the risk that taking the lead on patient and public involvement (PPI) may locate it in ‘the qualitative domain’. From the perspective of the trial delivery team, the challenges included managing the complex processes of a large trial whilst simultaneously keeping a watching brief for possible issues of interest to bring to the attention of the qualitative researchers. A further challenge was to handle the practicalities of sequencing invitations to participants who were involved in both qualitative and quantitative aspects of the trial and ensuring that these arrangements did not disadvantage or overburden individuals or affect the trial processes. We do not want to over-emphasise these challenges. There is a tendency in the literature to place considerable weight on the challenges of including qualitative research in trials and very little on the converse: the substantial risks to trials that go ahead in the absence of a qualitative perspective. We turn now to offer some observations from our experience and from the literature for the conduct of future trials.

Practical lessons for future trials

We believe that current methodological frameworks do not go far enough in recognising and describing the value of qualitative research and qualitative researchers to trials [8, 26, 30,31,32,33]. Such frameworks may even have the inadvertent effect of limiting the contribution of qualitative research to trials by ‘boxing off’ the scope of qualitative activities or by framing them in ways that are overly trial-centric. There is a risk that the qualitative research is simply bolted on to a trial’s original conception and aim, with limited power to infuse the trial as a whole. The many benefits of combining qualitative research with trials have led some authors (e.g. 22,31) to argue that a combination of quantitative and qualitative data should be the standard for all interventional studies. Guidance from research bodies like the Medical Research Council (MRC) in the UK [44] and the National Institutes of Health (NIH) Office of Behavioral and Social Sciences [45] in the USA suggests that using a combination of research methods is likely to enhance understanding of complex health situations and to reduce the disadvantages of relying on one type of data alone. We would agree that the challenging issues facing health services require multiple forms of data and therefore a combination of research methods to address them. However, studies need to be set up and carried out in a way that enables integrated ways of working. It is possible to design a trial that on paper looks as if it will enable the integration of qualitative and quantitative data but that in practice fails to realise the full benefit of the integration of qualitative and quantitative researchers: integration that allows for other benefits to emerge from working together. To realise the full potential of qualitative research in trials, future trial programmes should carefully consider how trial funding, structure and day-to-day working arrangements will enable and promote effective collaborative working. In Table 2, we distil practical points which our experience and the literature suggest can contribute to achieving this.

Table 2 How to embed qualitative research in a trial

Conclusions

Qualitative research can contribute in multiple ways to trials but this work cannot be done ‘off the side of the desk’. If the full benefit of qualitative research within trials is to be realised, qualitative research must be valued. This means that it needs to have equal status with the rest of the trial, to be well resourced and to be embedded in the trial’s structures and relationships.

Availability of data and materials

Not applicable.

Abbreviations

AF:

Atrial fibrillation

CRF:

Case report form

COVID-19:

Coronavirus 2019

ECG:

Electrocardiogram

FTE:

Full-time equivalent

MRC:

Medical Research Council

NIH:

National Institutes of Health

PPI:

Patient and public involvement

RCT:

Randomised controlled trial

SAFER:

Screening for Atrial Fibrillation with ECG to Reduce stroke

References

  1. Woolfall K, Young B, Frith L, Appleton R, Iyer A, Messahel S, et al. Doing challenging research studies in a patient-centred way: a qualitative study to inform a randomised controlled trial in the paediatric emergency care setting. BMJ Open. 2014;4(5):e005045.

    Article  Google Scholar 

  2. Bartlam B, Waterfield J, Bishop A, Holden MA, Barlas P, Ismail KM, et al. The role of qualitative research in clinical trial development: the EASE back study. J Mixed Methods Res. 2018;12(3):325–43.

    Article  Google Scholar 

  3. Evans M, Malpass A, Agnew-Davies R, Feder G. Women’s experiences of a randomised controlled trial of a specialist psychological advocacy intervention following domestic violence: a nested qualitative study. PLoS One. 2018;13(11):e0193077.

    Article  Google Scholar 

  4. Bouchard K, Tulloch H. Strengthening behavioral clinical trials with online qualitative research methods. J Health Psychol. 2020;25(2):256–65.

    Article  Google Scholar 

  5. Bugge C, Williams B, Hagen S, Logan J, Glazener C, Pringle S, et al. A process for Decision-making after Pilot and feasibility Trials (ADePT): development following a feasibility study of a complex intervention for pelvic organ prolapse. Trials. 2013;14(1):353.

    Article  Google Scholar 

  6. O’Cathain A, Goode J, Drabble SJ, Thomas KJ, Rudolph A, Hewison J. Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study. Trials. 2014;15:215.

    Article  Google Scholar 

  7. Clement C, Edwards SL, Rapport F, Russell IT, Hutchings HA. Exploring qualitative methods reported in registered trials and their yields (EQUITY): systematic review. Trials. 2018;19(1):589.

    Article  Google Scholar 

  8. Wigginton B, Thomson ZO, Sandler CX, Reeves MM. Reflexive intervention development: using qualitative research to inform the development of an intervention for women with metastatic breast cancer. Qual Health Res. 2020;30(5):666–78.

    Article  Google Scholar 

  9. Cheng KKF, Metcalfe A. Qualitative methods and process evaluation in clinical trials context: where to head to? Int J Qual Methods. 2018;17(1):1609406918774212.

    Article  Google Scholar 

  10. Lawton J, Blackburn M, Breckenridge JP, Hallowell N, Farrington C, Rankin D. Ambassadors of hope, research pioneers and agents of change—individuals’ expectations and experiences of taking part in a randomised trial of an innovative health technology: longitudinal qualitative study. Trials. 2019;20(1):289.

    Article  Google Scholar 

  11. Tomlin Z, deSalis I, Toerien M, Donovan JL. Patient advocacy and patient centredness in participant recruitment to randomized-controlled trials: implications for informed consent. Health Expect. 2014;17(5):670–82.

    Article  Google Scholar 

  12. Donovan JL, Rooshenas L, Jepson M, Elliott D, Wade J, Avery K, et al. Optimising recruitment and informed consent in randomised controlled trials: the development and implementation of the Quintet Recruitment Intervention (QRI). Trials. 2016;17(1):283.

    Article  Google Scholar 

  13. Whybrow P, Pickard R, Hrisos S, Rapley T. Equipoise across the patient population: optimising recruitment to a randomised controlled trial. Trials. 2017;18(1):140.

    Article  Google Scholar 

  14. Hennessy M, Hunter A, Healy P, Galvin S, Houghton C. Improving trial recruitment processes: how qualitative methodologies can be used to address the top 10 research priorities identified within the PRioRiTy study. Trials. 2018;19(1):584.

    Article  Google Scholar 

  15. Rooshenas L, Paramasivan S, Jepson M, Donovan JL. Intensive triangulation of qualitative research and quantitative data to improve recruitment to randomized trials: the QuinteT approach. Qual Health Res. 2019;29(5):672–9.

    Article  Google Scholar 

  16. Hoddinott P, Britten J, Pill R. Why do interventions work in some places and not others: a breastfeeding support group trial. Soc Sci Med. 2010;70(5):769–78.

    Article  Google Scholar 

  17. Hesse-Biber S. Weaving a multimethodology and mixed methods praxis into randomized control trials to enhance credibility. Qual Inq. 2012;18(10):876–89.

    Article  Google Scholar 

  18. Greenhalgh T, Papoutsi C. Spreading and scaling up innovation and improvement. BMJ. 2019;365:l2068. https://doi.org/10.1136/bmj.l2068.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Frost J, Wingham J, Britten N, Greaves C, Abraham C, Warren FC, et al. The value of social practice theory for implementation science: learning from a theory-based mixed methods process evaluation of a randomised controlled trial. BMC Med Res Methodol. 2020;20(1):181.

    Article  Google Scholar 

  20. Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009;339:b3496. https://doi.org/10.1136/bmj.b3496.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Wells M, Williams B, Treweek S, Coyle J, Taylor J. Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials. 2012;13(1):95.

    Article  Google Scholar 

  22. Mannell J, Davis K. Evaluating complex health interventions with randomized controlled trials: how do we improve the use of qualitative methods? Qual Health Res. 2019;29(5):623–31.

    Article  Google Scholar 

  23. O’Cathain A, Thomas K, Drabble S, Rudolph A, Goode J, Hewison J. Maximising the value of combining qualitative research and randomised controlled trials in health research: the QUAlitative Research in Trials (QUART) study a mixed methods study. Health Technol Assess. 2014;18(38). https://www.journalslibrary.nihr.ac.uk/hta/hta18380/#/abstract.

  24. Greenhalgh T, Annandale E, Ashcroft R, Barlow J, Black N, Bleakley A, et al. An open letter to The BMJ editors on qualitative research. BMJ. 2016;352:i563.

    Article  Google Scholar 

  25. Drabble SJ, O’Cathain A, Thomas KJ, Rudolph A, Hewison J. Describing qualitative research undertaken with randomised controlled trials in grant proposals: a documentary analysis. BMC Med Res Methodol. 2014;14(1):24.

    Article  Google Scholar 

  26. Davis K, Minckas N, Bond V, Clark CJ, Colbourn T, Drabble SJ, et al. Beyond interviews and focus groups: a framework for integrating innovative qualitative methods into randomised controlled trials of complex public health interventions. Trials. 2019;20(1):329.

    Article  Google Scholar 

  27. Uprichard E, Dawney L. Data diffraction: challenging data integration in mixed methods research. J Mixed Methods Res. 2019;13(1):19–32.

    Article  Google Scholar 

  28. Åkerblad L, Seppänen-Järvelä R, Haapakoski K. Integrative strategies in mixed methods research. J Mixed Methods Res. 2021;15(2):152–70.

    Article  Google Scholar 

  29. Richards DA, Bazeley P, Borglin G, Craig P, Emsley R, Frost J, et al. Integrating quantitative and qualitative data and findings when undertaking randomised controlled trials. BMJ Open. 2019;9(11):e032081.

    Article  Google Scholar 

  30. O’Cathain A, Thomas KJ, Drabble SJ, Rudolph A, Hewison J. What can qualitative research do for randomised controlled trials? A systematic mapping review. BMJ Open. 2013;3(6):e002889.

    Article  Google Scholar 

  31. Fetters MD, Molina-Azorin JF. Utilizing a mixed methods approach for conducting interventional evaluations. J Mixed Methods Res. 2020;14(2):131–44.

    Article  Google Scholar 

  32. Burke Johnson R, Schoonenboom J. Adding qualitative and mixed methods research to health intervention studies: interacting with differences. Qual Health Res. 2016;26(5):587–602.

    Article  Google Scholar 

  33. Maher L, Neale J. Adding quality to quantity in randomized controlled trials of addiction prevention and treatment: a new framework to facilitate the integration of qualitative research. Addiction. 2019;114(12):2257–66.

    Article  Google Scholar 

  34. O’Cathain A. A practical guide to using qualitative research with randomized controlled trials. Oxford: Oxford University Press; 2018.

    Book  Google Scholar 

  35. Corneli A, Meagher K, Henderson G, Peay H, Rennie S. How biomedical HIV prevention trials incorporate behavioral and social sciences research: a typology of approaches. AIDS Behav. 2019;23(8):2146–54.

    Article  Google Scholar 

  36. Grant A, Bugge C, Wells M. Designing process evaluations using case study to explore the context of complex interventions evaluated in trials. Trials. 2020;21(1):982.

    Article  Google Scholar 

  37. Russell J, Berney L, Stansfeld S, Lanz D, Kerry S, Chandola T, et al. The role of qualitative research in adding value to a randomised controlled trial: lessons from a pilot study of a guided e-learning intervention for managers to improve employee wellbeing and reduce sickness absence. Trials. 2016;17(1):396.

    Article  Google Scholar 

  38. O’Cathain A, Murphy E, Nicholl J. Multidisciplinary, interdisciplinary, or dysfunctional? Team working in mixed-methods research. Qual Health Res. 2008;18(11):1574–85.

    Article  Google Scholar 

  39. Curry LA, O’Cathain A, Clark VLP, Aroni R, Fetters M, Berg D. The role of group dynamics in mixed methods health sciences research teams. J Mixed Methods Res. 2012;6(1):5–20.

    Article  Google Scholar 

  40. The SAFER Trial – Screening for atrial fibrillation with ECG to reduce stroke. Available from: https://www.safer.phpc.cam.ac.uk/. Accessed 28 Aug 2021.

  41. Microsoft Teams. https://www.microsoft.com/en-gb/microsoft-teams/group-chat-software. Accessed 28 Aug 2021.

  42. Cooper C, O’Cathain A, Hind D, Adamson J, Lawton J, Baird W. Conducting qualitative research within Clinical Trials Units: avoiding potential pitfalls. Contemp Clin Trials. 2014;38(2):338–43.

    Article  Google Scholar 

  43. O’Cathain A, Hoddinott P, Lewin S, Thomas KJ, Young B, Adamson J, et al. Maximising the impact of qualitative research in feasibility studies for randomised controlled trials: guidance for researchers. Pilot Feasibility Stud. 2015;1(1):32.

    Article  Google Scholar 

  44. Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021;374:n2061. https://doi.org/10.1136/bmj.n2061.

    Article  PubMed  PubMed Central  Google Scholar 

  45. NIH Office of Behavioral and Social Sciences. Best practices for mixed methods research in the health sciences. 2nd ed. Bethesda: National Institutes of Health; 2018.

    Google Scholar 

  46. Rapport F, Storey M, Porter A, Snooks H, Jones K, Peconi J, et al. Qualitative research within trials: developing a standard operating procedure for a clinical trials unit. Trials. 2013;14(1):54.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

The SAFER programme is funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research (grant reference number RP-PG-0217-20007) and School for Primary Care Research (SPCR-2014-10043, project 410). The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care.

AFFECT-EU is receiving funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement NO. 847770.

AP, SH and JB are based in The Healthcare Improvement Studies Institute (THIS Institute), University of Cambridge. THIS Institute is supported by the Health Foundation, an independent charity committed to bringing about better health and healthcare for people in the UK. JB is supported by the Health Foundation’s grant to the University of Cambridge for The Healthcare Improvement Studies (THIS) Institute (RG88620).

The University of Cambridge has received salary support in respect of SG from the NHS in the East of England through the Clinical Academic Reserve.

JM is funded by the University of Cambridge. JM is a National Institute for Health Research Senior Investigator.

RM is supported by the Wellcome Trust as part of the Wellcome Trust PhD Programme for Primary Care Clinicians (grant reference number 203921/Z/16/Z).

The funders had no involvement in the study design; the data collection, analysis and interpretation; and the preparation of this commentary.

Author information

Authors and Affiliations

Authors

Contributions

AP and JB drafted the original manuscript with input from JM. All authors critically reviewed, revised and approved the final version.

Authors’ information

Not applicable.

Corresponding author

Correspondence to Alison Powell.

Ethics declarations

Ethics approval and consent to participate

Ethics approval for the SAFER programme was granted by London-Central Research Ethics Committee: 18/LO/2066 and 19/LO/1597.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visithttp://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Powell, A., Hoare, S., Modi, R. et al. How to embed qualitative research in trials: insights from the feasibility study of the SAFER trial programme. Trials 23, 394 (2022). https://doi.org/10.1186/s13063-022-06308-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-022-06308-7

Keywords