Skip to main content

Advancing cluster randomised trials in children’s therapy: a survey of the acceptability of trial behaviours to therapists and parents

Abstract

Background

Randomised controlled trials of non-pharmacological interventions in children’s therapy are rare. This is, in part, due to the challenges of the acceptability of common trial designs to therapists and service users. This study investigated the acceptability of participation in cluster randomised controlled trials to therapists and service users.

Methods

A national electronic survey of UK occupational therapists, physiotherapists, speech and language therapists, service managers, and parents of children who use their services. Participants were recruited by NHS Trusts sharing a link to an online questionnaire with children’s therapists in their Trust and with parents via Trust social media channels. National professional and parent networks also recruited to the survey. We aimed for a sample size of 325 therapists, 30 service managers, and 60 parents. Trial participation was operationalised as three behaviours undertaken by both therapists and parents: agreeing to take part in a trial, discussing a trial, and sharing information with a research team. Acceptability of the behaviours was measured using an online questionnaire based on the Theoretical Framework of Acceptability constructs: affective attitude, self-efficacy, and burden. The general acceptability of trials was measured using the acceptability constructs of intervention coherence and perceived effectiveness. Data were collected from June to September 2020. Numerical data were analysed using descriptive statistics and textual data by descriptive summary.

Results

A total of 345 survey responses were recorded. Following exclusions, 249 therapists and 40 parents provided data which was 69.6% (289/415) of the target sample size. It was not possible to track the number of people invited to take the survey nor those who viewed, but did not complete, the online questionnaire for calculation of response rates. A completion rate (participants who completed the last page of the survey divided by the participants who completed the first, mandatory, page of the survey) of 42.9% was achieved. Of the three specified trial behaviours, 140/249 (56.2%) therapists were least confident about agreeing to take part in a trial. Therapists (135/249, 52.6%) reported some confidence they could discuss a trial with a parent and child at an appointment. One hundred twenty of 249 (48.2%) therapists reported confidence in sharing information with a research team through questionnaires and interviews or sharing routine health data. Therapists (140/249, 56.2%) felt that taking part in the trial would take a lot of effort and resources. Support and resources, confidence with intervention allocation, and sense of control and professional autonomy over clinical practice were factors that positively affected the acceptability of trials. Of the 40 parents, twelve provided complete data. Most parents (18/40, 45%) agreed that it was clear how trials improve children’s therapies and outcomes and that a cluster randomised trial made sense to them in their therapy situation (12/29, 30%).

Conclusions

Using trials to evaluate therapy interventions is, in principle, acceptable to therapists, but their willingness to participate in trials is variable. The willingness to participate may be particularly influenced by their views related to the burden associated with trials, intervention allocation, and professional autonomy.

Peer Review reports

Background

Formal, randomised controlled trial designs are important for robust evaluation of the effectiveness of health interventions [1, 2]. By assessing causal relationships between an intervention and outcomes, trials provide valuable information about potential intervention benefits to inform decision-making about finite healthcare resources. However, randomised controlled trials (RCTs) have not been equally adopted and used in all health fields and populations. Whilst they are well-established in many acute adult health conditions and increasingly used in paediatric medicine, trials remain relatively rare in children’s therapy interventions including occupational therapy, physiotherapy, and speech and language therapy. A scoping of the International Standard Randomised Controlled Trials Number (ISRCTN) registry in October 2020 (unpublished observations) found 1892 studies registered with child participants globally, of which only twelve were open, ongoing trials investigating childhood non-pharmacological interventions in therapy contexts [3,4,5,6,7,8,9,10,11,12,13,14].

We, and others [15, 16] in the field of children’s therapy interventions, argue that establishing the effectiveness of interventions is central to high-quality care, to optimal achievement of health outcomes, and to decision-making and that advancing robust evaluations of non-pharmacological interventions is an important research priority. However, others have argued that successful adoption of feasible and acceptable trial designs to evaluate children’s therapy is very difficult, if not impossible [17,18,19,20]. Key arguments against trials have included that some of the fundamental features of RCTs, such as the delineation and control of variation, and the focus on a restricted number of specified outcomes [18, 19] are not compatible with the fundamental ideas of children’s therapy where variation equates to important context to be incorporated into interventions, and outcomes are commonly longitudinal, multi-level, and interwoven with the experience of therapy [17, 19, 21, 22]. Yet, there are published examples of successful trials of therapy interventions in general [23,24,25,26] and with children specifically [27,28,29], particularly using cluster randomised controlled trial designs [25, 27, 29] which suggests that trials are feasible and acceptable, at least with some interventions, some of the time.

The present paper proposes that at least some types of RCTs, particularly cluster RCTs, may be feasible in children’s therapy and that trials offer a potentially under-used approach to advancing children’s non-pharmacological interventions and child health. It further investigates some key questions that remain to be answered before progress at scale is possible, specifically: What are the potential barriers to using large-scale formal randomised controlled trials to evaluate children’s therapies in clinical practice? What are the views among therapy professionals and service users about behaviours required for their involvement in the trials? Where are the congruences and divergencies in the professionals’ and service users’ attitudes?

The specific aim of our study was to investigate the views of allied health therapists, as the most common paediatric non-pharmacological intervention providers, and parents of children receiving these services, about the acceptability and compatibility of RCTs in the context of paediatric therapy. This was to generate evidence to inform the design of future trials of paediatric non-pharmacological interventions.

Method

This was a national survey of United Kingdom (UK) paediatric allied health therapists (occupational therapists, physiotherapists, speech, and language therapists), and parents of children who use their services, about cluster randomised controlled trials (CRCTs) in children’s therapy. In CRCTs, clusters of some kind (e.g. therapy teams, children’s centres, people living in certain areas) are randomised to the study arms, and data within a cluster is considered connected rather than independent. CRCTs are used in situations where it is preferable to assign groups of people to an intervention, rather than individuals [30], and may go some way to address some of the difficulties with trials in children’s therapy. CRCTs have been successfully employed in adult non-pharmacological intervention contexts [25, 31, 32] and are generally considered a potential way forward in children’s therapy trials.

The present study was approved by the National Health Service (NHS) Health Research Authority (HRA) and North West - Greater Manchester West Research Ethics Committee (REC, ref: (19/NW/0521). The survey is reported here in accordance with the Checklist for Reporting Results of Internet E-Surveys (CHERRIES) [33].

Therapists and therapy service managers were sampled from a database of children’s therapy services in the UK [34]. The research departments of 122/149 NHS Trusts/Health Boards named on the database and specifically based in England and Wales were approached either directly by the research team or via the National Institute of Health Research (NIHR) Clinical Research Network (CRN). Therapists and managers in children’s therapy services were then approached and invited to the study by their local research teams. The total number of individual therapists and service managers in every therapy service approached is unknown. Professional networks with UK-wide membership also invited their members to participate, specifically the Royal College of Occupational Therapists Specialist Section for Children, Young People and Families, the Royal College of Occupational Therapists Specialist Section for Housing (social care), the Association of Paediatric Chartered Physiotherapists, and the Royal College of Speech and Language Therapists Clinical Excellence Networks. Due to data protection regulations, no member details were shared with the research team and the professional network organisations distributed the survey to their own members. The total number of individuals receiving the survey is therefore unknown along with the degree of duplication between sampling sources, i.e. the number of individuals that received the survey from their NHS Trust and professional networks. Parents of children were invited to the study via participating NHS Trusts’ Facebook and Twitter social media pages, the South and West Yorkshire Children’s Additional Need Networks, the Northern Ireland Cerebral Palsy Register, and regional Parent Carer Forum networks. Communication Matters magazine, Augmentative and Alternative Communication (AAC) Info newsletter, and Sensory Integration Network UK and Ireland with a shared therapist and parent membership also supplemented recruitment. HRA- and REC-approved invitations to participate in the study, including an open link to the online participant information sheet and questionnaire, were emailed to potential participants by participating organisations or advertised on organisations’ social media and/or online newsletters. Participant information sheets provided information for informed consent. No personal, identifiable information was collected, and participants were informed of data management processes as part of the informed consent process. Consent was inferred from questionnaire completion.

We aimed to achieve a sample size of 30 managers of therapy services from across the UK, 325 therapists providing care to children with disabilities, and 60 parents of children receiving therapy. Sample sizes were based on the information available in the sampling frame of children’s therapy services [34] and on anticipated response rates of 20% for managers and therapists and 5% for parents. These expected response rates were informed by response rates achieved in previous national surveys of children’s therapy services [35].

An online questionnaire was developed to collect data on the acceptability of cluster randomised controlled trials in the context of children’s therapy. The questionnaire was structured with three questions about the general acceptability of trials at the beginning, followed by vignettes to specify each of the trial behaviours and acceptability questions based on the vignettes, and finally a section on participant demographics at the end of the questionnaire. Documents related to the development of the questionnaire and the final questionnaires for therapists and parents can be accessed at https://doi.org/10.25405/data.ncl.17087333.v1.

Trials were specified by therapist and parent participant behaviours, and the behaviours were specified in terms of target, actions, context, time (TACT [36]; see Tables 1 and 2). Three behaviours for therapists and three behaviours for parents were incorporated into vignettes for an online questionnaire. Question items and response options related to the vignettes were developed to investigate the acceptability of the behaviours.

Table 1 Target behaviours related to therapists specified by TACT
Table 2 Target behaviours related to parents specified by TACT

The theoretical framework of acceptability [37] (TFA) provides an explicit definition of acceptability: ‘A multi-faceted construct that reflects the extent to which people delivering or receiving a healthcare intervention consider it to be appropriate, based on anticipated or experiential cognitive and emotional responses to the intervention’ [37] and proposes 7 constructs relating to acceptability:

  1. 1.

    Affective attitude (how an individual feels about the intervention)

  2. 2.

    Burden (perceived amount of effort to participate in the intervention)

  3. 3.

    Ethicality (the extent to which the intervention has a good fit with an individual’s value system)

  4. 4.

    Intervention coherence (the extent to which the individual understands the intervention and how it works)

  5. 5.

    Opportunity costs (the extent to which benefits, profits or values must be given up to engage in the intervention)

  6. 6.

    Perceived effectiveness (the extent to which the intervention is perceived as likely to achieve its purpose)

  7. 7.

    Self-efficacy (the individual’s confidence that they can perform the behaviour(s) required to participate in the intervention)

Constructs from the TFA [37, 38] underpinned the survey questions and response options, with modifications. The TFA focuses on acceptability of an object (i.e. an intervention), whereas our study focused on the acceptability of behaviours related to an object (i.e. actions related to participating in a trial). We used the TFA to consider prospective (rather than present) acceptability as a predictor of future behaviour. Further theoretical constructs were incorporated into the acceptability framework to reflect the specific study context; for example, literature on behavioural regulation [39] and the Theoretical Domains Framework [40] were used to map the construct of ethicality to ‘goals’ and the value systems inherent in goals, in addition to the TFA construct ‘fairness’ [38].

Question items related to trial behaviours (Tables 1 and 2) were developed for the acceptability constructs: confidence (self-efficacy), burden and affective attitude, with a mix of open and closed response options. Likert scales, drawn from the theory of planned behaviour [41], were used in closed response options. Question items were then developed to measure the general acceptability of trials for the acceptability constructs of intervention coherence and perceived effectiveness. Draft questionnaires were reviewed within the research team and piloted with health professionals (2 health visitors and 1 occupational therapist) and parents (1 mother and 1 father). Piloting involved cognitive testing [42] to check the construct validity and think-aloud techniques [42] to collect feedback on the formatting of the questionnaire. In response to piloting, changes were made to the questionnaire (see https://doi.org/10.25405/data.ncl.17087333.v1). The final questionnaire was hosted and administered online by Qualtrics [43]. Accessibility checks on the questionnaire were reviewed in Qualtrics and deemed to be fair. To improve accessibility, question items were presented to participants sequentially; display and skip logic were applied to navigate therapists and parents through the appropriate questionnaire; and page navigation buttons (back and next) were made available for participants to review their answers and move forwards and backwards through the questionnaire. The first survey question, related to the general acceptability of trials, was set as mandatory with all subsequent questions set for voluntary responses. No incentives were offered for questionnaire completion.

Data were transferred from Qualtrics to the Statistical Package for Social Sciences (SPSS) v25 [44] for analysis. Descriptive statistical analysis was used to summarise the numerical data from closed-question responses. Missing data were excluded from the analysis of each questionnaire item. Questionnaire data were primarily ordinal (Likert scales), resulting in modal and median values being used for measures of central tendency, and interquartile range and range being used to describe dispersion. For the two continuous variables related to participants’ demographic data (number of years the participating therapist has been qualified and the age of the participating parents’ child), the null hypothesis that the data followed the normal distribution was rejected based on the Shapiro-Wilk test and visual inspection of the distribution of values. The median, interquartile range (IQR), and range were therefore used to summarise the continuous variable data. Comments written in open-text response boxes were extracted from the questionnaires and pooled into two categories (likes and dislikes) and read and summarised descriptively into factors related to participants’ positive and negative attitudes towards trials.

Results

The survey was open to collect data between June and September 2020. The total number of people—professionals and parents alike—who received the invitation email and visited the survey site is unknown, precluding the calculation of survey response rates. A total of 345 survey responses were received, of which 289 were eligible for inclusion in the final analysis. Figure 1 presents a flow chart of survey questionnaire responses by respondent group (therapist/parent) and inclusion eligibility. We achieved an overall completion rate, based on users who completed the last page of the survey divided by the number who completed the first (mandatory) page of the survey [33], of 42.9%. The potential for duplicate responses could not be determined.

Fig. 1
figure 1

Flow chart of survey participant eligibility

In total, 249 therapists and 40 parents recorded survey responses on trial behaviours. Characteristics of therapist participants are described in Table 3; not all respondents completed these demographic and work-related variables due to the number of incomplete questionnaires and collection of demographic data at the end of the questionnaire. The median number of years qualified for 116/249 (46.6%) therapists reporting was 17 (IQR: 6–25 range 0–38).

Table 3 Characteristics of therapist participants

Fourteen (n = 14/40, 35%) of the responding parents provided sociodemographic data which is presented in Table 4. The median age of the parents’ children was 6 years (IQR: 5–10.5, range 3–14). Twelve of the fourteen (85.7%) parents reported their child had diagnosed health conditions (n = 6/12, 50% autism spectrum disorder/Asperger’s syndrome/specific language impairment; n = 5/12, 41.7% ‘other’ described as anxiety and demand avoidance, a rare genetic condition, Down syndrome, sensorial processing disorder and hypersensitivity; n = 4/12, 33.3% developmental coordination disorder/dyspraxia/verbal dyspraxia; n = 4/12, 33.3% developmental delay/speech delay; n = 4/12, 33.3% cognitive delay/learning disability; n = 2/12, 16.7% cerebral palsy). The median number of health conditions children were reported to have was 2 (IQR: 1–3, range 1–5).

Table 4 Characteristics of parent participants

Of the 40 parents who participated in the survey, 26/40 (65%) ceased answering after the first three survey questions related to the general acceptability of trials. Fourteen of the 40 (35%) parents continued the questionnaire but only 12/40 (30%) answered all questions. Due to the large amount of missing data, we report parental data on the first three questions related to the general acceptability of trials only. Figure 2 presents the general acceptability of trials to children’s therapists and parents of children receiving therapy respectively.

Fig. 2
figure 2

General acceptability of cluster trials to therapists and parents of children receiving therapy

Most commonly, therapists and parents agreed that it was clear to them how trials improve children’s therapies and outcomes (TFA construct ‘intervention coherence’). Parents (n = 18/40, 45%) tended to strongly agree with this statement more than therapists (n = 81/249, 32.5%) but had more varied views (see Fig. 2). Therapists were somewhat divided that it made sense to them how a cluster trial would work in their therapy situation (TFA construct ‘intervention coherence’) and that a trial of treatments for children would likely inform front line care (TFA construct ‘perceived effectiveness’) whereas parents tended to show more agreement with these statements than therapists (see Fig. 2). The acceptability of specified trial behaviours to children’s therapists are presented in Figs. 3 and 4, grouped by TFA acceptability constructs confidence (self-efficacy) and burden [37].

Fig. 3
figure 3

Therapists’ confidence (self-efficacy) in each of the specified trial behaviours

Fig. 4
figure 4

Therapists’ perceived effort and resource (burden) for each of the specified trial behaviours

Therapists’ confidence that they could take part in a trial was varied (see Fig. 3). Only 8/140 (5.7%) of the reporting therapists felt confident that taking part in the trial was something they could definitely do. Mostly, therapists felt somewhat confident they could take part in the trial. Therapists were more confident that, if taking part in the trial, they could discuss the trial with the parent and child at an appointment and share information with the research team, either directly through questionnaires and interviews or indirectly through sharing routine health data (see Fig. 3).

Across all three trial behaviours, therapists perceived that ‘moderate’ to ‘a lot’ of effort and resource would be required from them and tended to perceive the trial behaviours as burdensome (see Fig. 4). Taking part in the trial tended to be perceived as the most burdensome behaviour. Therapists’ perceptions of effort and resource were most widely dispersed in relation to the behaviour ‘discussing the trial with the child and parent at the appointment’ where some therapists perceived this could be done with little effort and resource (see Fig. 4).

Figure 5 represents therapists’ (n = 140/249, 56.2%) intentions to take part in a trial. Therapists were uncertain that they would agree to take part in a trial, most commonly (n = 52/140, 37.1%) rating their intention to take part in a trial as ‘maybe’.

Fig. 5
figure 5

Likelihood of therapists taking part in a trial

Commonly, across all three trial behaviours (Table 1), therapists reported positive feelings (TFA construct ‘affective attitude’) in relation to (i) receiving support for the trial to be put in place, (ii) the learning and development that they would gain from participating in a trial, (iii) children being represented in the trial, and (iv) therapist and parent choice and control over if and how much they are involved in the trial (see Table  5).

Table 5 Participant identified factors related to positive affective attitude about trials

Negative feelings (TFA ‘affective attitude’) were similarly reported across all three behaviours and related to (i) time, therapist capacity, and resources needed to participate in a trial; (ii) confidence in the new intervention; (iii) (dis)agreement with the benefit of intervention allocation; and (iv) loss of autonomy (see Table 6).

Table 6 Participant-identified factors related to negative affective attitude about trials

Discussion

Randomised controlled trials to evaluate children’s therapy have long been a topic of debate, focussed primarily on the incompatibility of trial design with children’s therapy interventions and practice [18,19,20]. Our study investigated the acceptability of selected trial behaviours, in the context of various trial design features, to children’s therapists and parents of children using therapy services with the aim of advancing trial design. Trials and their coherence with children’s therapy, outcomes, and front-line care were generally acceptable to both therapists and parents. Therapists reported varied levels of confidence in participating in a trial and high perceptions of burden associated with taking part in a trial and uncertainty about their intention to do so. Trial factors that positively and negatively affect therapists’ attitudes to trials have been identified.

Acceptability factors identified by therapists in our study, e.g. positive support for the trial; time, capacity, and resources; and confidence with intervention allocation reflect factors commonly reported by healthcare professionals in other clinical trial settings as barriers to trial participation and recruitment [45,46,47,48,49]. Whilst these barriers initially appear behavioural, there may also be structural barriers that explain these. For example, whilst therapy time is frequently costed into research trials and finance provided to the therapy service to recompense for that time, this may be of limited benefit where the challenges relate to the unavailability of a workforce to absorb the additional workload. Understanding the structural barriers to therapists’ participation in trials and identifying practical solutions to address the barriers is important to reduce the perceived burden of trial participation. Some of the factors identified in our present study, such as supporting further therapy capacity building and learning as part of the trial, offer new insights into avenues to enable a step change in children’s therapy services’ capacity to be involved in and deliver trials. Similarly, therapists’ positive feelings and confidence in taking part, and providing support and resources for implanting and embedding the trial in the practice setting, are likely very important.

The findings of our study influence the future direction of trials methods research and the use of trials in children’s non-pharmacological interventions. Key questions for future research have been identified and relate to (i) how different solutions and supports to address capacity and caseload pressures affect therapists’ involvement in trials; (ii) what strategies work best, what works for whom and in which contexts in terms of incentivising therapists’ trial participation by embedding meaningful support, learning, and development opportunities within trials; (iii) what strategies can be used to effectively address concerns about perceived choice, control, and professional autonomy within trials; and finally (iv) what strategies can be adopted to facilitate parent and child engagement in trials and what trial methods and processes work best for parents and children.

For our survey, we used a broad and comprehensive sampling strategy alongside proactive recruitment and an online survey, yet the final sample size was smaller than originally hoped for, and most parents did not complete the entire questionnaire, with insufficient responses to the vignette items for meaningful analysis. The COVID-19 pandemic and subsequent impact on therapists, research departments, and parents undoubtedly limited recruitment, yet the response rate for therapists was reasonable and covered all professional groups targeted. Non-response bias from high rates of partial questionnaire completion and selection bias towards more research-oriented therapists are concerns. Furthermore, despite our recruitment strategy targeting therapists in Wales, Scotland, and Northern Ireland by disseminating the survey through national professional bodies and networks, response rates from these devolved nations were very low. We used an evidence-based framework and related questionnaire for assessing acceptability, and the overall survey was systematically developed through a rigorous methodological process. However, most parents disengaged from responding after the first three questions, suggesting further involvement of parents in the questionnaire design may have improved the survey. Greater parental involvement in the overall study design may have also led to more diversity in our parent participants, e.g. inclusion of more fathers and participants with English as an additional language.

The low parental response rate in our survey could be due to factors related to the COVID-19 pandemic, the chosen research methods, and/or the questionnaire design, as the questionnaire was not tied to specific service user groups and was presenting a hypothetical, rather than specific, trial; however, the literature also suggests parents of children receiving therapy may feel uncertain about the concept of trials and participating in trials which needs to be considered as a potential factor related to parental (dis)engagement with our survey. A recent study exploring trial designs for children’s eating, drinking, and swallowing interventions [50] found that, whilst randomisation and indeed cluster randomisation was an acceptable feature of trials to parents, uncertainty about trial designs being appropriate and necessary for evaluating eating, drinking, and swallowing therapy interventions was expressed. Whilst the cluster randomised trial design was supported by parents in the context of eating, drinking, and swallowing interventions, case series studies were also put forward as a potential alternative. Goodwin et al. [45] in their study exploring the acceptability and feasibility of a specific trial of standing frames in children’s therapy found that less than half (43.2%, n = 32) of the parents from their survey would be willing to take part in a standing frames trial. Reasons cited included concerns about child factors (tolerance and pain) as well as perceptions of the risks and benefits of participation being a barrier to participation. With so few evaluation trials in children’s therapy and the field of childhood disability more broadly, there remains uncertainty about parent and child engagement in trials. There is a need to further explore how parent views and attitudes towards trials might affect recruitment and retention to future non-pharmacological intervention therapy trials and what strategies and supports might be beneficial to facilitate parent and child participation.

Whilst recognising the challenge to children’s therapy trials, it is also important to note that large-scale children’s therapy trials have been successfully conducted across several contexts, such as school-based practice [29, 51, 52] and sensory integration [3]. Their success suggests trials are possible in children’s therapy at least some of the time. More evidence is needed to explore the situations in which trials can be successfully conducted, how trial designs can be adapted to support their use, and what strategies facilitate trial delivery in the community context.

Conclusions

This study found that, in principle, trials have coherence with children’s therapy, outcomes, and front-line care, both from the perspective of therapists and parents. However, therapists also reported varied levels of confidence in participating in a trial, high perceptions of burden associated with a trial, uncertainty of intention to do so, and potentially important negative and positive feelings related to participation. A range of factors that positively and negatively affect therapists’ perceptions about a trial were identified—including the potentially positive impact of appropriate support and resources, confidence with intervention allocation, and therapists’ sense of control and professional autonomy over their practice.

Availability of data and materials

The datasets generated and/or analysed during the current study are available in the Newcastle University repository (https://doi.org/10.25405/data.ncl.17087333.v1).

Abbreviations

A-Level:

Advanced level

AAC:

Augmentative and alternative communication

CHERRIES:

Checklist for Reporting Results of Internet E-Surveys

CRCTs:

Cluster randomised controlled trials

CRN:

Clinical Research Network

GCE:

General Certificate of Education

GCSE:

General Certificate of Secondary Education

HRA:

Health Research Authority

HSC:

Health and Social Care

IQR:

Interquartile range

ISRCTN:

International Standard Randomised Controlled Trials Number

NHS:

National Health Service

NIHR:

National Institute for Health Research

O-level:

Ordinary level

REC:

Research Ethics Committee

RCTs:

Randomised controlled trials

SPSS:

Statistical Package for Social Sciences

TACT:

Target, actions, context, time

TFA:

Theoretical framework of acceptability

UK:

United Kingdom

References

  1. Bluhm R. From hierarchy to network: a richer view of evidence for evidence-based medicine. Perspect Biol Med. 2005;48(4):535–47.

    Article  PubMed  Google Scholar 

  2. Ingham-Broomfield R. A nurses’ guide to the hierarchy of research designs and evidence. Aust J Adv Nurs. 2016;33(3):38.

    Google Scholar 

  3. Randell E, McNamara R, Delport S, Busse M, Hastings RP, Gillespie D, et al. Sensory integration therapy versus usual care for sensory processing difficulties in autism spectrum disorder in children: study protocol for a pragmatic randomised controlled trial. Trials. 2019;20(1):113.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Anderson E, Gaunt D, Metcalfe C, Rai M, Hollingworth W, Mills N, et al. Investigating the effectiveness and cost-effectiveness of FITNET-NHS (Fatigue In Teenagers on the interNET in the NHS) compared to activity management to treat paediatric chronic fatigue syndrome (CFS)/myalgic encephalomyelitis (ME): amendment to the published protocol. Trials. 2019;20(1):750.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Wolters LH, Weidle B, Babiano-Espinosa L, Skokauskas N. Feasibility, acceptability, and effectiveness of enhanced cognitive behavioral therapy (eCBT) for children and adolescents with obsessive-compulsive disorder: protocol for an open trial and herapeutic intervention. JMIR Res Protoc. 2020;9(12):e24057.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Plymouth Uo. Elastic Therapeutic Taping for children with Cerebral Palsy (ETT4CP); a study of ETT of the thigh in children with cerebral palsy and spastic hemiplegia or diplegia. 2021. Available from: https://www.plymouth.ac.uk/schools/school-of-health-professions/ett4cp.

  7. Raywood E, Douglas H, Kapoor K, Filipow N, Murray N, O’Connor R, et al. Protocol for Project Fizzyo, an analytic longitudinal observational cohort study of physiotherapy for children and young people with cystic fibrosis, with interrupted time-series design. BMJ Open. 2020;10(10):e039587.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Williams TI, Loucas T, Sin J, Jeremic M, Aslett G, Knight M, et al. A randomised controlled feasibility trial of music-assisted language telehealth intervention for minimally verbal autistic children-the MAP Study. 2021.

    Google Scholar 

  9. Kim J, Kim B-N. Improvisational music therapy for children with autism spectrum disorder assessed using brain imaging: Springer Science and Business Media LLC; 2019. http://isrctn.com/

    Google Scholar 

  10. Bennett SD, Cross JH, Coughtrey AE, Heyman I, Ford T, Chorpita B, et al. M.I.C.E—Mental Health Intervention for Children with Epilepsy: a randomised controlled, multi-centre clinical trial evaluating the clinical and cost-effectiveness of MATCH-ADTC in addition to usual care compared to usual care alone for children and young people with common mental health disorders and epilepsy—study protocol. Trials. 2021;22(1):132.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Hollis C, Hall CL, Jones R, Marston L, Novere ML, Hunter R, et al. Therapist-supported online remote behavioural intervention for  tics in children and adolescents in England (ORBIT): a multicentre, parallel group, single-blind, randomised controlled trial. Lancet Psychiatry. 2021;8(10):871–82. https://doi.org/10.1016/S2215-0366(21)00235-2.

  12. Hagen KA, Olseth AR, Laland H, Rognstad K, Apeland A, Askeland E, et al. Evaluating Modular Approach to Therapy for Children with Anxiety, Depression, Trauma and Conduct Problems (MATCH-ADCT) in Norwegian child and adolescent outpatient clinics: study protocol for a randomized controlled trial. Trials. 2019;20(1):16.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Idsoe T, Keles S, Olseth AR, Ogden T. Cognitive behavioral treatment for depressed adolescents: results from a cluster randomized controlled trial of a group course. BMC Psychiatry. 2019;19(1):155.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Waite P. Protocol for a randomised controlled feasibility study examining the efficacy of brief cognitive therapy for the treatment of panic disorder in adolescents (PANDA). Pilot Feasibility Stud. 2022;8(1):49.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Morris C, Simkiss D, Busk M, Morris M, Allard A, Denness J, et al. Setting research priorities to improve the health of children and young people with neurodisability: a British Academy of Childhood Disability-James Lind Alliance Research Priority Setting Partnership. BMJ Open. 2015;5(1):e006233.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Watson J. Research priorities for occupational therapy in the UK. London: SAGE Publications Sage UK; 2021.

    Book  Google Scholar 

  17. Tse S, Blackwood K, Penman M. From rhetoric to reality: use of randomised controlled trials in evidence-based occupational therapy. Aust Occup Ther J. 2000;47(4):181–5.

    Article  Google Scholar 

  18. Rosenbaum P. The randomized controlled trial: an excellent design, but can it address the big questions in neurodisability? Dev Med Child Neurol. 2010;52(2):111.

    Article  PubMed  Google Scholar 

  19. Rosenbaum P. How do we know if interventions in developmental disability are effective? Dev Med Child Neurol. 2020;62(12):1344.

    Article  PubMed  Google Scholar 

  20. Beresford BA, Clarke S, Maddison JR. Therapy interventions for children with neurodisability: a qualitative scoping study of current practice and perceived research needs. Health Technol Assess. 2018;22:1–150.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Pentland D, Kantartzis S, Clausen MG, Witemyre K. Occupational therapy and complexity: defining and describing practice. London: Royal College of Occupational Therapists; 2018.

    Google Scholar 

  22. Morris C, Janssens A, Shilling V, Allard A, Fellowes A, Tomlinson R, et al. Meaningful health outcomes for paediatric neurodisability: stakeholder prioritisation and appropriateness of patient reported outcome measures. Health Qual Life Outcomes. 2015;13(1):87.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Walker MF, Gladman JRF, Lincoln NB, Siemonsma P, Whiteley T. Occupational therapy for stroke patients not admitted to hospital: a randomised controlled trial. Lancet. 1999;354(9175):278–80.

    Article  CAS  PubMed  Google Scholar 

  24. Gilbertson L, Langhorne P, Walker A, Allen A, Murray GD. Domiciliary occupational therapy for patients with stroke discharged from hospital: randomised controlled trial. BMJ. 2000;320(7235):603–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Sackley CM, Walker MF, Burton CR, Watkins CL, Mant J, Roalfe AK, et al. An occupational therapy intervention for residents with stroke related disabilities in UK care homes (OTCH): cluster randomised controlled trial. BMJ. 2015;350:h468. https://doi.org/10.1136/bmj.h468.

  26. Frost H, Lamb SE, Doll HA, Carver PT, Stewart-Brown S. Randomised controlled trial of physiotherapy compared with advice for low back pain. BMJ. 2004;329(7468):708.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Law MC, Darrah J, Pollock N, Wilson B, Russell DJ, Walter SD, et al. Focus on function: a cluster, randomized controlled trial comparing child-versus context-focused intervention for young children with cerebral palsy. Dev Med Child Neurol. 2011;53(7):621–9.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Araujo CRS, Cardoso AA, Polatajko HJ, de Castro Magalhães L. Efficacy of the Cognitive Orientation to daily Occupational Performance (CO-OP) approach with and without parental coaching on activity and participation for children with developmental coordination disorder: a randomized clinical trial. Res Dev Disabil. 2021;110:103862.

    Article  PubMed  Google Scholar 

  29. McLeod S, Baker E, McCormack J, Wren Y, Roulstone S, Crowe K, et al. Cluster-randomized controlled trial evaluating the effectiveness of computer-assisted intervention delivered by educators for children with speech sound disorders. J Speech Lang Hear Res. 2017;60(7):1891–910.

    Article  PubMed  Google Scholar 

  30. Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661.

    Article  PubMed  Google Scholar 

  31. Sackley CM, van den Berg ME, Lett K, Patel S, Hollands K, Wright CC, et al. Effects of a physiotherapy and occupational therapy intervention on mobility and activity in care home residents: a cluster randomised controlled trial. BMJ. 2009;339:b3123.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Underwood M, Lamb SE, Eldridge S, Sheehan B, Slowther A-M, Spencer A, et al. Exercise for depression in elderly residents of care homes: a cluster-randomised controlled trial. Lancet. 2013;382(9886):41–9.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res. 2004;6(3):e132.

    Article  Google Scholar 

  34. Database of children’s therapy services in the UK v1. Newcastle University; 2020. Available from: https://doi.org/10.25405/data.ncl.10265012.v1.

  35. Armitage S, McColl E, Kolehmainen N, Rapley T. Describing pre-appointment written materials as an intervention in the context of children’s NHS therapy services: a national survey. Health Expect. 2020;n/a(n/a).

  36. Ajzen I. Constructing a TPB questionnaire: conceptual and methodological considerations. 2002. Available from: https://pdfs.semanticscholar.org/0574/b20bd58130dd5a961f1a2db10fd1fcbae95d.pdf.

    Google Scholar 

  37. Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):88.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Sekhon M, Cartwright M, Francis J. Development of a theory-informed questionnaire to assess the acceptability of healthcare interventions: application of prevalidation methods. Birmingham: UK Society for Behavioural Medicine; 2018.

    Google Scholar 

  39. Carver CS, Scheier MF. Chapter 3 - On the structure of behavioral self-regulation. In: Boekaerts M, Pintrich PR, Zeidner M, editors. Handbook of self-regulation. San Diego: Academic; 2000. p. 41–84.

    Chapter  Google Scholar 

  40. Michie S, Atkins L, West R. The behaviour change wheel: a guide to designing interventions. Needed: physician leaders; 2014. p. 26.

    Google Scholar 

  41. Francis J, Eccles MP, Johnston M, Walker A, Grimshaw JM, Foy R, et al. Constructing questionnaires based on the theory of planned behaviour: a manual for health services researchers: Centre for Health Services Research, University of Newcastle upon Tyne; 2004. http://openaccess.city.ac.uk/id/eprint/1735.

  42. Campanelli P. Testing survey questions. In: de Leeux E, Hox J, Dillman D, editors. International handbook of survey methodology. Hove: Psychology Press; 2008.

    Google Scholar 

  43. Qualtrics. Qualtrics. 10 2019 ed. Provo: Qualtrics; 2005. Available at: https://www.qualtrics.com.

  44. IBM Corp. IBM SPSS Statistics for Windows. Version 25.0 ed. Armonk: IBM Corp.; 2017.

    Google Scholar 

  45. Goodwin J, Lecouturier J, Basu A, Colver A, Crombie S, Smith J, et al. Standing frames for children with cerebral palsy: a mixed-methods feasibility study. Health Technol Assess. 2018;22(50):1–232.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Foster JM, Sawyer SM, Smith L, Reddel HK, Usherwood T. Barriers and facilitators to patient recruitment to a cluster randomized controlled trial in primary care: lessons for future trials. BMC Med Res Methodol. 2015;15(1):18.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R. Barriers to participation in randomised controlled trials: a systematic review. J Clin Epidemiol. 1999;52(12):1143–56.

    Article  CAS  PubMed  Google Scholar 

  48. Elliott D, Husbands S, Hamdy FC, Holmberg L, Donovan JL. Understanding and improving recruitment to randomised controlled trials: qualitative research approaches. Eur Urol. 2017;72(5):789–98.

    Article  PubMed  Google Scholar 

  49. Donovan JL, Paramasivan S, de Salis I, Toerien M. Clear obstacles and hidden challenges: understanding recruiter perspectives in six pragmatic randomised controlled trials. Trials. 2014;15:5.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Parr J, Pennington L, Taylor H, Craig D, Morris C, McConachie H, et al. Parent-delivered interventions used at home to improve eating, drinking and swallowing in children with neurodisability: the FEEDS mixed-methods study. Health Technol Assess. 2021;25(22):1–208.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Tokolahi E, Vandal AC, Kersten P, Pearson J, Hocking C. Cluster-randomised controlled trial of an occupational therapy intervention for children aged 11–13 years, designed to increase participation to prevent symptoms of mental illness. Child Adolesc Mental Health. 2018;23(4):313–27.

    Article  Google Scholar 

  52. McAnuff J, Gibson JL, Webster R, Kaur-Bola K, Crombie S, Grayston A, et al. School-based allied health interventions for children and young people affected by neurodisability: a systematic evidence map. Disabil Rehabil. 2022:1–19. https://doi.org/10.1080/09638288.2022.2059113.

Download references

Acknowledgements

This study was supported by the National Institute for Health Research Clinical Research Network. Thanks to Dr. Mandeep Sekhon and Dr. Martin Cartwright for generously sharing their time, expertise, and work related to the Theoretical Framework of Acceptability for use in the development of the questionnaire.

Tim Rapley is a member of the NIHR Applied Research Collaboration North East and North Cumbria (NIHR200173). The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care.

Funding

The study was funded and supported by the UK Occupational Therapy Research Foundation, a division of the Royal College of Occupational Therapists, as part of the 2018–2021 Research Priority Grant.

Author information

Authors and Affiliations

Authors

Contributions

NK, LP, TR, JM, RB, and CD conceived and designed the study as part of a larger programme of work and contributed to the interpretation of the findings. NK, TR, and EM contributed theoretical development to the questionnaire and supported the data analysis, reporting, and interpretation of results. SA developed the questionnaire and collected and analysed the data. All authors drafted the work or substantively revised it. All authors have approved the final submitted version, agreed to be personally accountable for their contributions, and agreed to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature.

Corresponding author

Correspondence to Samantha Armitage.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the National Health Service (NHS) Health Research Authority (HRA) and North West - Greater Manchester West Research Ethics Committee (REC, ref: (19/NW/0521).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Armitage, S., Rapley, T., Pennington, L. et al. Advancing cluster randomised trials in children’s therapy: a survey of the acceptability of trial behaviours to therapists and parents. Trials 23, 958 (2022). https://doi.org/10.1186/s13063-022-06872-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-022-06872-y

Keywords