- Study protocol
- Open Access
Efficacy of digital cognitive behavioural therapy for symptoms of generalised anxiety disorder: a study protocol for a randomised controlled trial
Trials volume 21, Article number: 357 (2020)
Generalised anxiety disorder (GAD) is a chronic and disabling condition with considerable personal and economic impact. Cognitive behavioural therapy (CBT) is a recommended psychological therapy for GAD; however, there are substantial barriers to accessing treatment. Digital CBT, in particular smartphone-delivered CBT, has the potential to improve accessibility and increase dissemination of CBT. Despite the emerging evidence of smartphone-based psychological interventions for reducing anxiety, effect size scores are typically smaller than in-person interventions, and there is a lack of research assessing the efficacy of smartphone-delivered digital interventions specifically for GAD.
In the DeLTA trial (DigitaL Therapy for Anxiety), we plan to conduct a parallel-group superiority randomised controlled trial examining the efficacy of a novel smartphone-based digital CBT intervention for GAD compared to a waitlist control. We aim to recruit 242 adults (aged 18 years or above) with moderate-to-severe symptoms of GAD. This trial will be conducted entirely online and will involve assessments at baseline (week 0; immediately preceding randomisation), mid-intervention (week 3), post-intervention (week 6; primary end point) and follow-up (week 10). The primary objective is to evaluate the efficacy of the intervention on GAD symptom severity compared to a waitlist control at post-intervention. Secondary objectives are to examine between-group effects on GAD at follow-up, and to examine the following secondary outcomes at both post-intervention and follow-up: 1) worry; 2) depressive symptoms; 3) wellbeing; 4) quality of life; and 5) sleep difficulty.
This trial will report findings on the initial efficacy of a novel digital CBT intervention for GAD. Results have the potential to contribute towards the evidence base for digital CBT for GAD and increase the dissemination of CBT.
ISRCTN, ISRCTN12765810. Registered on 11 January 2019.
Generalised anxiety disorder (GAD) is a chronic and disabling condition with a lifetime prevalence of 5–8% [1,2,3] and most patients continue to experience symptoms after 6 to 12 years . GAD is characterised by excessive and persistent anxiety and worry that is difficult to control . In addition to the considerable impact it has on the lives of individuals, GAD has serious economic consequences. It is associated with increased use of health care services, medical costs, absenteeism from work and decreased work productivity [6,7,8].
Cognitive behavioural therapy (CBT) is a recommended first-line treatment for GAD [9,10,11,12]. CBT for GAD encompasses a range of cognitive and behavioural components, including cognitive restructuring, imaginal exposure, situational (in vivo) exposure, stimulus control, applied relaxation, self-monitoring and psychoeducation [13,14,15]. Meta-analyses of randomised controlled trials (RCTs) show that, when compared to control conditions, CBT for GAD significantly improves anxiety, with large effect size scores [16, 17]. Despite this evidence base for CBT, availability is limited due to substantial barriers to accessing this treatment. These include insufficient numbers of trained therapists, costs, waiting lists, incompatible scheduling, distance from services and stigma [18, 19]. Digital CBT, or CBT delivered primarily via software applications on digital devices (e.g. computers, tablets, and smartphones) , provides a solution to help overcome treatment accessibility barriers and has the potential to increase dissemination of CBT. The importance of using digital technologies for improving mental health care is now well recognised  and there are a number of advantages offered by digital CBT. Digital CBT is cost effective [22, 23] scalable across people and geographies, and may reduce additional difficulties with attending appointments in person such as time constraints and stigma [18, 19]. Additionally, using algorithms, digital CBT has the potential to not only provide standardised and reliable, high-quality interventions for anyone, but can also be tailored to individual needs  thereby offering personalised psychological therapy.
The widespread uptake and use of smartphone technologies in our daily lives has increased interest in the use of these devices to deliver psychological therapies [24, 25]. In a survey of smartphone ownership conducted in 2019, 81% of US adults were found to own a smartphone  and smartphones are increasingly used by people to help address mental health problems . They are therefore regarded as ‘next-generation’ platforms for delivering psychological therapies [21, 25], and the evidence base for the efficacy of smartphone-based interventions is growing. A recent systematic review and meta-analysis identified nine RCTs examining the effects of psychological therapies delivered primarily via smartphone on anxiety outcomes . Findings showed that, compared to waitlist control conditions, smartphone interventions significantly reduced symptoms of anxiety, with a medium effect size. A more recent meta-analysis identified 29 RCTs examining the effects of smartphone interventions on generalised anxiety symptoms and found these to be superior to any control condition, with a small effect size .
Given that the effect size scores for in-person CBT for GAD are typically in the large range , there is clearly room for improvement in the efficacy of smartphone-based digital interventions. Furthermore, only four trials from the systematic review of Firth et al.  evaluated smartphone-based interventions designed to target anxiety. None of these four trials assessed efficacy for improving GAD symptoms, and only two of the four interventions were based on CBT, a recommended psychological therapy for GAD [9,10,11,12]. This is an important omission to address given the considerable personal and economic impact of GAD and the aforementioned difficulties associated with accessing CBT for GAD.
The current protocol is for a parallel-group superiority RCT examining the initial efficacy of a novel digital CBT intervention for GAD compared to a waitlist control for adults with at least moderate GAD symptom severity. The digital CBT intervention, Daylight, is fully automated (i.e. standalone functioning without human input) and is delivered entirely via a smartphone application (app). This form of digital CBT takes advantage of the wide uptake of smartphone devices and offers the fewest barriers to accessibility and greatest potential for scalability . A waitlist control group comparison is appropriate to test the efficacy and safety of this new intervention in this population .
The primary objective is to evaluate the initial efficacy of a smartphone digital CBT intervention compared to waitlist control on self-reported GAD symptom severity at post-intervention (6 weeks from randomisation). Secondary objectives are to examine the effects compared to a waitlist control on GAD symptoms at follow-up (10 weeks from randomisation), and to examine effects on the following secondary outcomes at both post-intervention and follow-up: 1) worry; 2) depressive symptoms; 3) wellbeing; 4) participant-specific quality of life; and 5) sleep difficulty.
The primary hypothesis is that smartphone digital CBT intervention will be significantly more effective than waitlist control at treating GAD symptoms at post-intervention (6 weeks from randomisation). The secondary hypotheses are: 1) digital CBT will be significantly more effective than waitlist at improving GAD symptoms at follow-up (10 weeks from randomisation); 2) digital CBT will be significantly more effective than waitlist at improving the following outcomes at post-intervention (6 weeks from randomisation): worry, depressive symptoms, wellbeing, quality of life, and sleep difficulty; and 3) digital CBT will be significantly more effective than waitlist at improving the following outcomes at follow-up (10 weeks from randomisation): worry, depressive symptoms, wellbeing, quality of life, and sleep difficulty.
This study is a parallel-group superiority RCT which will examine the efficacy of a novel smartphone-delivered digital CBT intervention for GAD compared to waitlist control for treating symptoms of GAD in adults with moderate-severe symptom severity. The DeLTA (DigitaL Therapy for Anxiety) trial will be conducted entirely online.
The sample size calculation was conducted using G*Power 3 . The study aims to recruit 242 participants with GAD, with 121 participants randomised to each arm. This recruitment target accounts for approximately 30% attrition, based on the range of dropout rates from previous RCTs comparing smartphone-based digital interventions for anxiety to waitlist (19% to 45%; [32,33,34]). The sample size was determined based on an estimated medium effect on post-intervention scores on the seven-item Generalised Anxiety Disorder questionnaire (GAD-7) (Cohen’s d = 0.50) between the digital CBT and waitlist arms, with 90% power, a 1:1 allocation ratio, and with α set at 0.05. The effect size is based on a recent meta-analysis of RCTs of smartphone-delivered psychological treatment for anxiety versus waitlist which demonstrated a small-to-moderate (Hedges’ g = 0.33) between-group post-intervention effect on anxiety symptoms when compared to any active or waitlist/inactive control condition . When comparing smartphone interventions with only waitlist/inactive control conditions, Hedges’ g increased to 0.45. The effect size of 0.50 corresponds to a minimally clinically significant 2-point change on the GAD-7 and a standard deviation of 4 in this population .
For inclusion in this trial, participants must: 1) be aged 18 years or older; 2) score 10 or higher on the GAD-7  indicating at least moderate GAD symptom severity; 3) screen positive for a GAD diagnosis on a digital version of the Mini-International Neuropsychiatric Interview (MINI) version 7 for DSM-5 , followed by telephone verification (see Procedure below for details); 4) be either not on prescription medication for anxiety, depressive symptoms, or poor sleep, or on a stable dose for at least 4 weeks; and 5) must not be currently receiving or have previously received CBT for anxiety in the last 12 months (this inclusion criterion was included after a modification was made by the ethical review committee after recruitment start). We will exclude participants who self-report: 1) being diagnosed with any of the following conditions: schizophrenia, psychosis, bipolar disorder, seizure disorder, substance use disorder; 2) having recent trauma to the head or brain damage; 3) having severe cognitive impairment; 4) having serious physical health concerns necessitating surgery or with a prognosis of less than 6 months; or 5) being pregnant. Individuals with other anxiety or related disorders (e.g. panic disorder, social anxiety disorder, and so forth) were included in the study as long as they endorsed worry (consistent with a GAD diagnosis) as their primary concern assessed at telephone screening.
Participants will be recruited online from the UK and the USA. A number of recruitment strategies will be used, including online, print, and broadcast media advertisements. Participants will receive 10 GBP in Amazon.com gift vouchers (or USD equivalent at the time of payment) in exchange for completing each of the core assessments following baseline (mid-intervention, post-intervention, and follow-up), and a bonus of 10 GBP (or USD equivalent) in vouchers for completing all assessments. Therefore, each participant can receive up to a total maximum of 40 GBP (or USD equivalent) in vouchers. Payment will be made at the end of the core study period for each participant (after 10 weeks from randomisation). If participants withdraw from the study, payment will be made for completion of any assessments at the point of withdrawal. Participants may withdraw themselves from the study for any reason at any time. The study investigator may also withdraw participants from the study to protect their safety and/or if they are unwilling or unable to comply with required study procedures after consultation with the study investigator team.
Randomisation and allocation concealment
Participants will be assigned to the digital CBT or waitlist arm by blocked randomisation with a 1:1 allocation ratio. Randomisation will be carried out and the allocation sequence generated automatically upon completion of baseline measures using the randomisation function within Qualtrics Survey Software (Qualtrics, Provo, UT, USA, ). Members of the research team will be unable to influence randomisation and will be concealed from future assignments.
All assessments will be completed by participants online, independent from members of the research team, which will reduce the risk of bias associated with researcher-administered assessments. Participants will be informed of their randomly allocated condition (digital CBT or waitlist control) and will not be blind to group allocation. The trial coordinator will not be blind to group allocation as they will monitor uptake (download) of the intervention by participants. Participants who do not download the intervention will be reminded first by a daily email reminder for up to 3 days and then contacted by telephone. All other members of the research team will be blind to allocation. Participant contact with the trial coordinator will be limited to standardised emails containing instructions for completing online assessments and accessing digital CBT and will not cover treatment content or clinical support. Data analyses will be conducted by an independent external statistician who is not involved in the management of this trial. The statistician will be blind during the study and subgroup-unblind (groups labelled as ‘A’ and ‘B’) during the statistical analysis.
Online assessments for the core study period will occur at 0 (baseline), 3 (mid-intervention), 6 (post-intervention) and 10 weeks (follow-up) from randomisation. Waitlist control participants will receive access to the digital CBT app after the follow-up assessment point (after 10 weeks from randomisation). In order to understand if effects persist over time, participants randomised to the intervention arm will also be invited to complete an optional longer-term uncontrolled assessment online at 6 months from randomisation without compensation. Table 1 presents details of the self-reported measures administered at each assessment point. After randomisation, participants will have up to 2 weeks to complete each questionnaire assessment battery. The trial coordinator will make every reasonable effort to follow the participant for the entire study period (from consent to the final follow-up assessment) using both email and telephone calls. To promote outcome data completeness, where necessary participants will be reminded to complete assessments first by a daily email reminder for up to 3 days and then by telephone for each overdue assessment. Participants who do not complete a study assessment will not be withdrawn from the study and will continue to be asked to complete any subsequent assessments. All online surveys will be hosted and stored on Qualtrics. Potential errors with data entry will be minimised as data will be entered by participants online.
The Consolidated Standards of Reporting Trials (CONSORT; ) diagram displaying participant flow through the trial is shown in Fig. 1. Participants who respond to advertisements will be directed to the online participant information sheet and asked to consent to and complete an online screening survey as a first step in assessing eligibility against inclusion and exclusion criteria. Screening questions will assess age, GAD symptom severity (GAD-7), GAD diagnosis (MINI for GAD), medical and psychiatric history, prescription medication use and pregnancy. Eligible participants who meet inclusion criteria assessed above by the online screening survey will then be contacted by a member of the research team to take part in a brief 10-min telephone call. During this call, study procedures will be explained, any questions about the study will be answered, and we will verify participant reports of GAD against criteria from the Structured Clinical Interview for DSM-5 , ensuring that the participant feels their GAD symptoms are their current primary area of concern. All potential participants were informed (through study advertising, the participant information sheet and during the telephone conversation) that they should aim to use the app daily throughout the study period. Eligible participants who are willing to participate are then emailed a link to the online consent form.
Participants who consent will be allocated a unique identification code to use when completing all subsequent online surveys to ensure that identifiable information provided as part of consent is not directly linked to survey responses. This unique identification code will be used for data files to ensure confidentiality. Participants will receive an email asking them to complete an online baseline survey containing a battery of self-report measures (see Table 1). Upon completion of the baseline survey, participants will be automatically randomised to either the digital CBT or waitlist control condition and informed of their allocation by automated email. All participants allocated to digital CBT will receive immediate access to the intervention and access will not be withdrawn (i.e. participants are welcome to continue using the app after conclusion of their participation in the study). All waitlist control participants will be given access to digital CBT after the final controlled follow-up assessment point (after 10 weeks from randomisation).
Digital CBT intervention
The intervention involves interactive and tailored delivery of digital CBT for worry and anxiety via a smartphone-based app, Daylight (https://www.bighealth.com/daylight). The app provides an interactive and media-rich experience and includes supportive visuals and brief animations. Daylight is a voice-led experience, in which a virtual therapist guides the user through intervention content. Throughout the intervention, participants are asked to complete questions within the app about their anxiety and other aspects of their experience (e.g. mood, sleep). Personalisation is built in using algorithms to tailor the intervention based on responses to questions and user’s progress.
Daylight was developed in collaboration with leading experts in the area of CBT for GAD and anxiety disorders. The content is based on evidence-based CBT techniques for the treatment of GAD, including psychoeducation, stimulus control, applied relaxation, cognitive restructuring, imaginal exposures and self-monitoring of progress. The programme is designed to be self-paced and includes four modules, each lasting up to 20 min, and shorter practice versions of the same techniques (lasting approximately 5 min). Modules are accessed sequentially, with access to a subsequent module available on completion of the previous module. The app provides feedback and troubleshooting based on the user’s feedback during the exercises as well as personalised recommendations for how the techniques may be applied in the user’s life. At the start of the programme, Daylight recommends that users aim to use the app daily to practice techniques; accordingly, the modules and practice exercises can be repeatedly accessed (as per the user’s preference) for reinforcement of specific techniques. Optional notifications in the form of emails (once weekly for the first few weeks of use), text messages (twice weekly) and in-app push notifications (of varied frequency) are used to prompt use of the app. The digital CBT intervention allows for monitoring of engagement through the automatic capture of objective usage statistics including the number of modules completed, frequency of access, and length of time taken to complete all modules.
Outcomes are self-reported and measured online at screening or baseline (week 0; immediately preceding randomisation), mid-intervention (3 weeks), post-intervention (6 weeks) and follow-up (10 weeks). Measures included are indicated below and in Table 1.
The primary outcome will be GAD symptom severity measured using the GAD-7 . The GAD-7 will be administered at all time points. Items ask participants to indicate how often they have been bothered by symptoms over the last 2 weeks. Responses are given on a four-point Likert scale ranging from 0 (“not at all”) to 3 (“nearly every day”). Items are summed and total scores range from 0 to 21. The GAD-7 has been shown to have good validity and reliability, including internal consistency, test–retest reliability and construct validity .
In addition to scores on GAD-7, we will examine whether or not each participant demonstrated remission and reliable remission on the GAD-7 from baseline to 6 weeks post-intervention and baseline to 10 weeks follow-up. We will report and compare between groups the percentage of participants demonstrating remission (scores of <10 on the GAD-7; ) and reliable remission where participants experience remission and a change score reduction of ≥5 , which is greater than the known unreliability of the measure , at both time points.
Worry will be measured using the 16-item Penn State Worry Questionnaire (PSWQ; ). The PSWQ will be administered at all time points. Each item is rated using a five-point Likert scale ranging from 1 (“not at all typical of me”) to 5 (“very typical of me”). Total scores range from 16 to 80, with higher scores indicating greater degree of worry. The PSWQ has been shown to have good validity and reliability, including internal consistency, factorial validity and convergent and discriminant validity .
Depressive symptoms will be assessed using the nine-item Patient Health Questionnaire (PHQ-9; ), administered at all time points. Items ask participants to indicate how often they have been bothered by symptoms over the last 2 weeks. Responses are given on a four-point Likert scale ranging from 0 (“not at all”) to 3 (“nearly every day”). Total scores range from 0 to 27, with higher scores indicating greater severity of symptoms. The PHQ-9 has been shown to have good validity and reliability, including internal consistency, test–retest reliability, sensitivity to change and criterion validity . Participants experience remission if they score <10 and reliable remission if they both remit and reduce by ≥6 .
Sleep difficulty will be measured using the eight-item Sleep Condition Indicator (SCI-8; ), administered at all time points. Total scores range from 0 to 32, with higher scores indicating better sleep. The SCI-8 has been shown to have good validity and reliability, including internal consistency, convergent validity and sensitivity to change . Participants experience remission if they score >16 and reliable remission if they both remit and reduce by ≥7 .
Positive mental wellbeing will be assessed using the 14-item Warwick–Edinburgh Mental Wellbeing Scale (WEMWBS; ). Items ask participants to indicate how often they have particular experiences over the last 2 weeks. Responses to items are given on a five-point Likert scale ranging from 1 (“none of the time”) to 5 (“all of the time”). Total scores range from 14 to 70, with higher total scores indicating greater wellbeing. The WEMWBS has good validity and reliability, including factorial validity, internal consistency, test–retest reliability, and convergent and discriminant validity .
Quality of life
Quality of life will be assessed using the individualised Patient-Generated Index measure . The Patient-Generated Index will consist of two parts in which participants are asked to: 1) identify the three most important areas of their lives affected by their anxiety; and 2) for each area identified, indicate the degree to which this area has been affected by their anxiety in the past month, from 0 (“the worst you could imagine”) to 100 (“exactly as you would like to be”). The Patient-Generated Index has been shown to have good validity and reliability .
Treatment credibility and expectancy
Credibility of and expectancy of benefit from the digital CBT intervention will be assessed using the six-item Credibility/Expectancy Questionnaire  administered at baseline only. This questionnaire has been found to have good internal consistency and test–retest reliability .
Treatment satisfaction will be assessed in participants randomised to the intervention arm by the following questions administered at post-intervention: 1) “How would you rate your overall satisfaction with the programme?” (ranging from 0 (totally dissatisfied) to 10 (totally satisfied)); 2) “What could be better about this treatment programme?”; 3) “What did you like and enjoy about the treatment programme?”; 4) “In what ways did the treatment programme help you to reduce your anxiety?”; 5) “At any point during the treatment programme did you consider stopping using it? When and Why?”; and 6) “Was the content of the treatment programme specific enough to your needs?”
Assessment of safety
We will record the occurrence of any serious adverse events or adverse events reported to the trial coordinator at any point from study entry until the participant has left the study. A serious adverse event is defined as any untoward medical occurrence that is believed by the investigators to be causally related to digital CBT and results in any of the following: life-threatening condition (that is, immediate risk of death); or severe or permanent disability, prolonged hospitalisation, or a significant hazard as determined by the trial management committee. The study will monitor for potential adverse effects through frequent Anxiety and Depression symptom questionnaires (GAD-7 and PHQ-9). A modified symptom checklist  will also be used to document potential somatic and psychological side effects. The questionnaire is administered at post-intervention only and asks participants to indicate whether or not they experienced any of 14 pre-specified unwanted symptoms (e.g. low mood, feeling agitated) or other non-listed unwanted symptoms at any point during the treatment period. The original version of the symptom checklist asks participants to report on the development of any unwanted symptoms while taking part in a programme. In order to ensure that the questionnaire is also applicable to the waitlist condition (who will not have access to the programme until 10 weeks after randomisation), the questionnaire was modified after recruitment start to ask whether or not participants developed any unwanted symptoms more generally over the last 6 weeks. The questionnaire also asks to what extent any unwanted symptoms interfered with everyday functioning using a five-point Likert scale from 0 (“not at all”) to 4 (“very much”).
The administration of other interventions and medications to address GAD is not prohibited after randomisation. Concomitant treatment will be assessed using the following questions administered at all time points from baseline onwards. First, “How many days over the last 3 weeks did you see a treatment provider about your anxiety” and, if yes, “what type of treatment did you pursue?”; this is captured from predefined responses (e.g. “general advice from my family physician or general practitioner or cognitive behavioural therapy, etc.”). If participants select CBT, they will then be asked to select which techniques they have used from a further predefined list. This question was included after a modification was made by the ethical review committee after recruitment start. Second, participants will also be asked “How many days in the last 3 weeks have you taken medications for anxiety that were prescribed by your doctor or not prescribed by your doctor?” (with the follow-up question “Please list these medications and the dosage”).
The trial investigators and the trial statistician will have access to the final cleaned dataset. The project dataset will be collected and stored online in the study web portal created for the study by Qualtrics Survey Software (Qualtrics, Provo, UT, USA), and all data will be password protected. Data integrity will be enforced through a variety of mechanisms including data rules, range checks and consistency checks against data already stored in the database. All data will be treated as confidential. To ensure confidentiality, data dispersed to project team members will be blinded of any identifying participant information. Questionnaire data will be de-identified by a unique coded participant identification number only (assigned at consent into the study) to maintain confidentiality. Participant data linkage information will be stored in a single digital file separate from questionnaire research data. This file will be encrypted and stored on a secure server with limited user access and password protection for members of the study team only. Minimal personal identifiable information (e.g. name, email) will be captured and will only be made accessible (password protected) to the research study team. These data will be deleted at the completion of the study on publication or public release of the results. We will only hold contact information of participants who give optional consent to being contacted again in the future and will retain these records for 7 years after the release of this work. The final anonymised research data will be archived with the Oxford Research Archive (ORA-Data) at the University of Oxford for longer term storage (at least 7 years) after publication or public release of the results.
Analyses will be carried out using Stata . In accordance with the CONSORT statement , we will report all participant flow in each arm (see Fig. 1). Descriptive statistics of participant recruitment, study dropout and intervention engagement will be reported. Baseline characteristics will be presented by randomised group and summarised by means and standard deviations for continuous measures, or number and percentage for categorical measures.
To test the primary hypothesis, treatment effects on GAD symptom severity (GAD-7) will be estimated using linear mixed models fitted to data at all core time points (baseline, 3 weeks mid-intervention, 6 weeks post-intervention, 10 weeks follow-up). Fixed effects will be baseline assessment for GAD-7, randomised group, time (categorical), and time by group interactions. Participant ID will be included as random intercepts to allow for repeated measures. Marginal treatment effects will be estimated for GAD-7 at each time point and reported separately as mean-adjusted differences in scores between the randomised treatment groups with 95% confidence intervals and two-sided P values. The analysis will use statistical techniques for handling missing data under a missing-at-random assumption. Secondary hypotheses will be tested using analogous analyses. For the binary secondary outcome (whether participants achieved remission and reliable remission on GAD-7, PHQ-9 and SCI-8 outcomes), the same approach will be followed using logistic mixed models. All primary and secondary analyses will be conducted on an intention-to-treat basis, including all participants who were randomised, with no planned interim analysis.
Additional sensitivity analyses will be conducted to test primary and secondary hypotheses using data from participants who receive and engage with the intervention, defined as those who: 1) download the app; 2) complete at least two modules of digital CBT; and 3) complete all modules. Separate sets of analyses will be conducted for each of these three categories of intervention completion.
Exploratory analyses will examine mechanisms underlying the effect of digital CBT compared to waitlist control on GAD symptom severity using causal mediation methods based on parametric regression models. This will examine whether changes in worry (PSWQ), depressive symptoms (PHQ-9) and sleep difficulty (SCI-8) during the intervention period (from baseline to 3 weeks mid-intervention) significantly mediate the effect of digital CBT compared to waitlist on changes in GAD symptom severity (GAD-7) from baseline to 6 weeks post-intervention. Exploratory moderation analyses will also be conducted to examine whether the between-group effect on GAD symptom severity is moderated by baseline variables (e.g. demographic variables, baseline levels of anxiety).
All analyses will be pre-specified in a detailed statistical analysis plan.
We will publish the results of this study in peer-reviewed journals, irrespective of magnitude or direction of effect. Findings will also be presented at national or international scientific meetings. A lay report of the findings will be produced and disseminated to participants upon request. Items in this protocol comply with the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist  (see Additional file 1; and Fig. 2 for the SPIRIT figure).
Ancillary and post-trial care
Any participant who is discovered to have another medical condition will be referred to their medical practitioner by a study clinical psychologist. Participants who complete or withdraw at any time for any reason during the study period will be referred by a study clinical psychologist at discretion, and/or if required or requested by the participant, to their medical practitioner for further management.
Despite the evidence base for CBT for GAD [16, 17] there are substantial barriers to accessing this treatment (e.g. insufficient numbers of trained therapists, costs, waiting lists, distance from services, stigma) [18, 19]. Digital CBT not only provides a solution to overcoming treatment accessibility barriers, but also has the potential to provide standardised treatment that can be personalised to the individual. This protocol is for a two-arm parallel-group superiority RCT examining the efficacy of a novel and fully automated smartphone-delivered CBT intervention compared to waitlist control for moderate-to-severe symptoms of GAD. This trial also explores worry as a potential mechanism underlying the effect of digital CBT for GAD on anxiety symptom severity.
Findings have the potential to contribute towards the evidence base for digital CBT for GAD and increasing the dissemination of CBT. Given the novelty of the smartphone digital CBT intervention for GAD currently assessed, this trial compares the intervention to a waitlist control group. Building on findings from efficacy trials of this digital CBT for GAD intervention, it would be helpful for future research to further illuminate how and for whom digital CBT for GAD yields therapeutic benefits and whether digital CBT for GAD confers specific benefits by comparing this to active control conditions. If findings support the efficacy of the intervention, it would also be valuable to examine effectiveness in larger participant samples across different settings.
This is protocol version 1.1, September 2019. Recruitment started on 2 August 2019.
At the time of manuscript submission, recruitment for this study is not yet complete. It is anticipated that recruitment will end in November 2019.
Please see Fig. 2 for a copy of the SPIRIT figure. The SPIRIT checklist can be found in Additional file 1.
Availability of data and materials
The full study protocol, statistical code and participant-level dataset for the current study may be available from the corresponding author on reasonable request.
Cognitive behavioural therapy
Consolidated Standards of Reporting Trials
Generalised anxiety disorder
Seven-item Generalised Anxiety Disorder questionnaire
Mini-International Neuropsychiatric Interview
Nine-item Patient Health Questionnaire
Penn State Worry Questionnaire
Randomised controlled trial
Eight-item Sleep Condition Indicator
Standard Protocol Items: Recommendations for Interventional Trials
Warwick–Edinburgh Mental Wellbeing Scale
Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey replication. Arch Gen Psychiatry. 2005;62(6):593 Available from: http://www.ncbi.nlm.nih.gov/pubmed/15939837.
Kroenke K, Spitzer RL, Williams JBW, Monahan PO, Löwe B. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007;146(5):317–25.
Roy-Byrne PP, Wagner A. Primary care perspectives on generalized anxiety disorder. J Clin Psychiatry. 2004;65(Suppl 1):20–6.
Yonkers KA, Dyck IR, Warshaw M, Keller MB. Factors predicting the clinical course of generalised anxiety disorder. Br J Psychiatry. 2000;176:544–9 Available from: http://www.ncbi.nlm.nih.gov/pubmed/10974960.
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5). 5th ed. Washington, DC: American Psychiatric Asscociation; 2013.
Lépine J-P. The epidemiology of anxiety disorders: prevalence and societal costs. J Clin Psychiatry. 2002;63(Suppl 1):4–8.
Revicki DA, Travers K, Wyrwich KW, Svedsäter H, Locklear J, Mattera MS, et al. Humanistic and economic burden of generalized anxiety disorder in North America and Europe. J Affect Disord. 2012;140(2):103–12 Available from: http://www.ncbi.nlm.nih.gov/pubmed/22154706.
Wittchen H-U. Generalized anxiety disorder: prevalence, burden, and cost to society. Depress Anxiety. 2002;16(4):162–71.
Anxiety and Depression Association of America. Clinical practice review for GAD. 2015. Available from: https://adaa.org/resources-professionals/practice-guidelines-gad.
Locke AB, Kirst N, Shultz CG. Diagnosis and management of generalized anxiety disorder and panic disorder in adults, vol. 91; 2015.
National Institute for Health and Clinical Excellence. Clinical Guideline [CG113] Generalised anxiety disorder and panic disorder in adults: management. 2011.
Canadian Psychiatric Association. Clinical practice guidelines. Management of anxiety disorders. Can J Psychiatry. 2006;51(8 Suppl 2):9S–91S.
Otto M, Smits J. Exercise for mood and anxiety disorders. New York: Oxford University Press; 2009.
Shafran R, Brosan L, Cooper P. The complete CBT guide for anxiety. London: Constable & Robinson; 2013.
Zinbarg R, Craske M, Barlow D. Mastery of your anxiety and worry. 2nd ed. Oxford: Oxford University Press; 2006.
Carpenter JK, Andrews LA, Witcraft SM, Powers MB, Smits JAJ, Hofmann SG. Cognitive behavioral therapy for anxiety and related disorders: a meta-analysis of randomized placebo-controlled trials. Depress Anxiety. 2018;35(6):502–14.
Cuijpers P, Sijbrandij M, Koole S, Huibers M, Berking M, Andersson G. Psychological treatment of generalized anxiety disorder: a meta-analysis. Clin Psychol Rev. 2014;34(2):130–40 Available from: http://www.ncbi.nlm.nih.gov/pubmed/24487344.
Comer JS, Barlow DH. The occasional case against broad dissemination and implementation: retaining a role for specialty care in the delivery of psychological treatments. Am Psychol. 2014;69(1):1–18 Available from: http://www.ncbi.nlm.nih.gov/pubmed/23915401.
Gunter RW, Whittal ML. Dissemination of cognitive-behavioral treatments for anxiety disorders: overcoming barriers and improving patient access. Clin Psychol Rev. 2010;30(2):194–202 Available from: https://linkinghub.elsevier.com/retrieve/pii/S0272735809001561.
Luik AI, Kyle SD, Espie CA. Digital cognitive behavioral therapy (dCBT) for insomnia: a state-of-the-science review. Curr Sleep Med Rep. 2017;3(2):48–56 Available from: http://link.springer.com/10.1007/s40675-017-0065-4.
Bhugra D, Tasman A, Pathare S, Priebe S, Smith S, Torous J, et al. The WPA- Lancet Psychiatry Commission on the future of psychiatry. Lancet Psychiatry. 2017;4(10):775–818.
Hedman E, Andersson E, Ljótsson B, Andersson G, Rück C, Lindefors N. Cost-effectiveness of internet-based cognitive behavior therapy vs. cognitive behavioral group therapy for social anxiety disorder: results from a randomized controlled trial. Available from: http://www.random.org. Cited 16 Aug 2018.
Kumar S, Jones Bell M, Juusola JL. Mobile and traditional cognitive behavioral therapy programs for generalized anxiety disorder: a cost-effectiveness analysis. PLoS One. 2018;13(1):e0190554 Seedat S, editor. Available from: https://dx.plos.org/10.1371/journal.pone.0190554.
Byambasuren O, Sanders S, Beller E, Glasziou P. Prescribable mHealth apps identified from an overview of systematic reviews. NPJ Digit Med. 2018;1(1):12 Available from: http://www.nature.com/articles/s41746-018-0021-9.
Firth J, Torous J, Carney R, Newby J, Cosco TD, Christensen H, et al. Digital technologies in the treatment of anxiety: recent innovations and future directions. Curr Psychiatry Rep. 2018;20(6):44 Available from: http://link.springer.com/10.1007/s11920-018-0910-2.
Pew Research Center. Demographics of mobile device ownership and adoption in the United States: Pew Research Center; 2019. Available from: https://www.pewinternet.org/fact-sheet/mobile/.
Firth J, Cotter J, Torous J, Bucci S, Firth JA, Yung AR. Mobile phone ownership and endorsement of health among people with psychosis: a meta-analysis of cross-sectional studies. Schizophr Bull. 2016;42(2):448–55 Available from: http://www.ncbi.nlm.nih.gov/pubmed/26400871.
Firth J, Torous J, Nicholas J, Carney R, Rosenbaum S, Sarris J. Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. J Affect Disord. 2017;218:15–22 Available from: https://www.sciencedirect.com/science/article/pii/S0165032717300150.
Linardon J, Cuijpers P, Carlbring P, Messer M, Fuller-Tyszkiewicz M. The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials. World Psychiatry. 2019;18(3):325–36 Available from: https://onlinelibrary.wiley.com/doi/abs/10.1002/wps.20673.
Gold SM, Enck P, Hasselmann H, Friede T, Hegerl U, Mohr DC, et al. Control conditions for randomised trials of behavioural interventions in psychiatry: a decision framework. Lancet Psychiatry. 2017;4:725–32 Elsevier Ltd.
Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39(2):175–91 Available from: http://www.ncbi.nlm.nih.gov/pubmed/17695343.
Enock PM, Hofmann SG, McNally RJ. Attention bias modification training via smartphone to reduce social anxiety: a randomized, controlled multi-session experiment. Cognit Ther Res. 2014;38(2):200–16 Available from: http://link.springer.com/10.1007/s10608-014-9606-z.
Ivanova E, Lindner P, Ly KH, Dahlin M, Vernmark K, Andersson G, et al. Guided and unguided acceptance and commitment therapy for social anxiety disorder and/or panic disorder provided via the Internet and a smartphone application: a randomized controlled trial. J Anxiety Disord. 2016;44:27–35 Available from: http://www.ncbi.nlm.nih.gov/pubmed/27721123.
Pham Q, Khatib Y, Stansfeld S, Fox S, Green T. Feasibility and efficacy of an mHealth game for managing anxiety: “flowy” randomized controlled pilot trial and design evaluation. Games Health J. 2016;5(1):50–67 Available from: http://www.ncbi.nlm.nih.gov/pubmed/26536488.
Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder. Arch Intern Med. 2006;166(10):1092.
Sheehan D. Mini international neuropsychiatric interview 7.0. Jacksonville: Medical Outcomes Systems; 2014.
Qualtrics. Qualtrics. Provo; 2019. Available from: http://www.qualtrics.com.
Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMC Med. 2010;8(1):18 Available from: http://bmcmedicine.biomedcentral.com/articles/10.1186/1741-7015-8-18.
First MB, Williams JBW, Karg RS, Spitzer RL. SCID-5-RV: structured clinical interview for DSM-5 disorders, research version: American Psychiatric Association; 2015. p. 95. Available from: https://www.appi.org/Structured_Clinical_Interview_for_DSM-5_Disorders-Clinician_Version_SCID-5-CV.
Richards D, Borglin G. Implementation of psychological therapies for anxiety and depression in routine practice: two year prospective cohort study. J Affect Disord. 2011;133(1–2):51–60.
Meyer TJ, Miller ML, Metzger RL, Borkovec TD. Development and validation of the penn state worry questionnaire. Behav Res Ther. 1990;28(6):487–95 Available from: https://linkinghub.elsevier.com/retrieve/pii/0005796790901356.
Brown TA, Antony MM, Barlow DH. Psychometric properties of the Penn State Worry Questionnaire in a clinical anxiety disorders sample. Behav Res Ther. 1992;30(1):33–7 Available from: http://www.ncbi.nlm.nih.gov/pubmed/1540110.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13 Available from: http://www.ncbi.nlm.nih.gov/pubmed/11556941.
Kroenke K, Spitzer RL, Williams JBW, Löwe B. The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: a systematic review. Gen Hosp Psychiatry. 2010;32(4):345–59.
National Collaborating Centre for Mental Health. The improving access to psychological therapies manual appendices and helpful resources. 2018.
Espie CA, Kyle SD, Hames P, Gardani M, Fleming L, Cape J. The Sleep Condition Indicator: a clinical screening tool to evaluate insomnia disorder. BMJ Open. 2014;4(3):e004183 Available from: http://www.ncbi.nlm.nih.gov/pubmed/24643168.
Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, et al. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5(1):63 Available from: http://hqlo.biomedcentral.com/articles/10.1186/1477-7525-5-63.
Ruta DA, Garratt AM, Leng M, Russell IT, MacDonald LM. A new approach to the measurement of quality of life. The Patient-Generated Index. Med Care. 1994;32(11):1109–26 Available from: http://www.ncbi.nlm.nih.gov/pubmed/7967852.
Martin F, Camfield L, Rodham K, Kliempt P, Ruta D. Twelve years–experience with the Patient Generated Index (PGI) of quality of life: a graded structured review. Qual Life Res. 2007;16(4):705–15 Available from: http://link.springer.com/10.1007/s11136-006-9152-6.
Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry. 2000;31(2):73–86.
Kyle SD, Morgan K, Spiegelhalder K, Espie CA. No pain, no gain: an exploratory within-subjects mixed-methods evaluation of the patient experience of sleep restriction therapy (SRT) for insomnia. Sleep Med. 2011;12(8):735–47 Available from: http://www.ncbi.nlm.nih.gov/pubmed/21907616.
StataCorp. Stata statistical software: release 15. College Station: StataCorp LLC; 2017.
Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158:200–7 American College of Physicians.
The research was supported in part by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC). KEAS is supported by the NIHR Oxford Health BRC (grant BRC-1215-20005). The views expressed are those of the authors and not necessarily those of the National Health Service, the NIHR or the Department of Health and Social Care.
This study is supported by Big Health Inc. Big Health Inc. has contributed to the study design, and will contribute to the collection, management, and interpretation of the data, and preparation, review, or approval of the manuscript. Data analysis will be conducted by an independent statistician (RE) not employed by the funder. The decision to publish findings will not be influenced by the funder or sponsor. Other funders had no role in the design and conduct of the study, collection of data, data analysis, management, interpretation, or review or approval of the manuscript.
Ethics approval and consent to participate
This study has been granted ethical approval by the University of Oxford Central University Research Ethics Committee (CUREC; reference number R61262/RE002). Informed consent will be obtained from all participants through completion of an online consent form. Important modifications to the trial protocol will be submitted for approval from the trial sponsor (University of Oxford; firstname.lastname@example.org) and CUREC.
Consent for publication
CAE is co-founder and Chief Medical Officer of Big Health Inc., and is a shareholder in the company. CBM, ALH, RS, MLD and JC are employed by Big Health Inc., and are salaried by the company. JG previously received a salary from Big Health Inc. JAJS is a paid Clinical Advisor for Big Health Inc., and receives royalty payments from Oxford University Press and Academic Press. The remaining authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1.
SPIRIT 2013 checklist: recommended items to address in a clinical trial protocol and related documents.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Gu, J., Miller, C.B., Henry, A.L. et al. Efficacy of digital cognitive behavioural therapy for symptoms of generalised anxiety disorder: a study protocol for a randomised controlled trial. Trials 21, 357 (2020). https://doi.org/10.1186/s13063-020-4230-6
- Randomised controlled trial
- Cognitive behavioural therapy
- Generalised anxiety disorder