An Internet-based Acceptance and Commitment Therapy intervention for older adults with anxiety complaints: study protocol for a cluster randomized controlled trial
Trials volume 19, Article number: 502 (2018)
Anxiety is among the most prevalent and disabling mental health problems in older adults. Few older adults with mild to moderately severe anxiety symptoms receive adequate interventions, putting them at risk for developing anxiety disorders, depression, and various somatic problems. Effective, low-threshold interventions should be developed. Blended care, in which a web-based intervention is combined with a limited amount of face-to-face contacts with a mental healthcare counselor at the general practice, is a promising option. The online self-help intervention “Living to the Full”—an Acceptance and Commitment Therapy (ACT) intervention—has been proven to reduce depression and anxiety in several patient groups, but has not yet been investigated in older adults. The aim of this study is to evaluate the (cost-)effectiveness of a blended form of “Living to the Full” in reducing anxiety symptoms in adults aged 55 to 75 years. Furthermore, moderators and mediators of the treatment effect are investigated.
The (cost-)effectiveness of the ACT intervention will be investigated in a cluster single-blind randomized controlled trial (RCT). The blended intervention will be compared to treatment-as-usual. Thirty-six mental health counselors working at general practices in the Netherlands will be randomized to deliver blended care or treatment as usual. A total of 240 participants (aged 55–75 years) with mild to moderately severe anxiety complaints (defined as a total score of 5–15 on the GAD-7) will be recruited. There are four measurements consisting of online questionnaires (primary outcome: GAD-7) and a telephone interview: before the start of the intervention; directly following the intervention (14 weeks after baseline); and six and twelve months after baseline. Possible mediator variables will be assessed multiple times basis during the intervention.
This RCT will evaluate the effectiveness of a blended ACT intervention for older adults with anxiety symptoms. If the intervention is shown to be effective, it will be implemented, thereby improving the accessibility and quality of preventive interventions for older adults with anxiety problems.
Netherlands Trial Register, NTR6270. Registered on 21 March 2017.
Anxiety problems form one of the most ubiquitous and disabling mental health conditions in older adults. Prevalence estimates of anxiety disorders in this age group are in the range of 1.2–14% [1, 2] . Furthermore, prevalence studies on anxiety in older adults consistently show that subclinical anxiety is even more widespread, with estimates in the range of 15–52.3% in community samples. These findings suggest that anxiety mostly presents as a sub-threshold disorder in elderly adults [1, 2]. Unfortunately, anxiety symptoms (and anxiety disorders as well) frequently go unrecognized and untreated in older adults [1,2,3]. This is due to several characteristics of this age group such as a stronger belief in self-reliance, higher perceived stigma of mental health problems, a limited willingness to accept treatment for such problems, a tendency to minimize symptoms, mobility problems, use of different terms to describe psychological problems, and problems with remembering and recognizing symptoms [4, 5]. Also, it seems challenging for both clinicians and patients to differentiate between functional and pathological anxiety in older adults; anxiety in elderly adults is regularly considered to be an epiphenomenon of a physical condition or part of the normal aging process [4, 6].
The fact that only a small proportion of anxious older adults receive adequate treatment is alarming, since even on a subclinical level, anxiety in older adults is associated with diminished quality of life and wellbeing [7, 8], depressive symptoms, hypertension, urinary incontinence , cognitive decline [10, 11], functional disability , and an increased risk for stroke  and coronary heart disease . Furthermore, anxiety symptoms tend to run a chronic course  and put people at risk for developing anxiety disorders . To diminish the personal and societal impact of anxiety complaints in older adults, low-threshold, evidence-based interventions are needed [15, 16]. However, considering the high prevalence of anxiety symptoms in older adults and the rise in life expectancy, even existing healthcare systems in affluent societies cannot adequately address this need. Internet-based therapy (possibly combined with a limited amount of face-to-face contacts with a therapist, counselor, or coach) is a promising option to reduce the treatment gap in a cost-effective way. For older adults with anxiety symptoms, Internet-based therapy could lower some of the barriers that prevent them from seeking help (e.g. perceived stigma on seeing a therapist, mobility problems, strong belief in self-reliance with regard to mental health).
In younger adult populations, Internet-based therapy—predominantly cognitive behavioral interventions—have repeatedly been shown to form a (cost-)effective treatment option for both anxiety disorders and subclinical anxiety [17,18,19,20,21,22,23,24,25]. Evidence so far suggests that a combination of an online self-help module and therapist support (either online, by telephone, or face-to-face) is the most effective form of Internet-based therapy .
To date, only one study has examined an online intervention for older adults with anxiety symptoms. This randomized controlled trial (RCT) found that Internet-delivered cognitive behavioral therapy (CBT) was an efficacious and cost-effective treatment for older adults with subclinical anxiety . The vast majority of other trials in anxious older adults also focus on CBT but delivered as face-to-face therapy to patients with anxiety disorders. Several meta-analyses support the effectiveness of CBT for elderly adults with an anxiety disorder [27,28,29,30,31]. However, researchers suggest investigating other treatment approaches as well, since the effect sizes for CBT in anxious older adults are relatively small and several analyses suggest that older adults benefit less from CBT for anxiety than the younger adult population [2, 6, 28, 31, 32].
One treatment approach that might form a valuable alternative for CBT in older adults is Acceptance and Commitment Therapy (ACT), a so-called third-wave CBT [6, 33,34,35]. In contrast to CBT, ACT makes little to no use of content-oriented cognitive techniques. The goal of ACT is not to reduce the frequency or discomfort of negative internal experiences. Rather, ACT strives to reduce the struggle that arises when people try to suppress internal experiences and to stimulate people to engage in activities that are meaningful to them. Ultimately, ACT aims to promote psychological flexibility: the ability to fully and openly experience the present moment (including the negative or painful aspects); and to persist in or change behavior dependent on its accordance with personal goals and values [33, 35, 36]. Meta-analyses support the effectiveness of ACT in reducing various psychological problems, including anxiety disorders [36,37,38,39]. Internet interventions based on ACT have also been shown to be effective for adults with depressive and anxiety symptoms [40, 41]. No large-scale, controlled trials have yet been conducted to evaluate ACT interventions for older adults. However, it could be argued that the ACT approach might particularly resonate with older adults, as it concurs with the reorientation on important life values and associated value-directed behavior change in this life phase [34, 35]. Furthermore, an acceptance-based coping style could be especially valuable for older adults, because age-related adversities such as loss of dear ones and declining health might be most effectively coped with through an acceptance-oriented style. Some evidence suggests that in older adults, acceptance is associated with better emotional wellbeing and quality of life [35, 42,43,44]. Another possible benefit of ACT is its transdiagnostic approach, since anxiety and depression are highly co-morbid in older adults [1, 2, 45]. Some evidence suggests that co-morbid depressive symptoms have a negative impact on treatment outcome in anxious older adults (when treated with CBT) . Therefore, a transdiagnostic treatment that focuses on psychological factors that might underlie both anxiety and depression is highly valuable.
Considering the need for evidence-based interventions for older adults with subclinical anxiety and the plausible suitability of ACT for this group, the proposed study aims to evaluate the (cost-)effectiveness of an Internet-based ACT intervention for older adults with anxiety complaints in general practice. To promote compliance and reduce dropout, this intervention is combined with a limited amount of face-to-face contacts with the mental health counselor at the general practice. This intervention will be compared to optimized treatment-as-usual. In addition to the analysis of the (cost-) effectiveness, moderators and mediators of treatment effects will also be investigated in the study. The current paper describes the research protocol for this study.
The proposed study is a pragmatic cluster single-blind RCT. In a clustered trial, the unit of randomization is not the individual participant, but a group of participants (e.g. patients from one general practice, students from the same school, family members). In this study, randomization takes place on the level of the mental health counselors at general practices, which creates clusters of participants that receive treatment from the same counselor. Cluster randomization is used in this study to reduce experimental contamination  and to minimize administrative burden and time spent on training the participating mental health counselors in the used treatment methods. Participating mental health counselors will be randomly assigned to one of the following two conditions: they will either treat all included patients in their practice(s) with the Internet-based ACT intervention or provide all their patients with treatment-as-usual. In most cases, randomization of the mental health counselor will coincide with randomization of the practice(s) at which he/she is employed, but some practices employ multiple counselors. In these practices, a double randomization procedure will be used. First, the counselors are randomized. Second, when patients of this practice are included in the study, they are randomly allocated to one of the counselors in the practice.
The randomization table (containing 36 cells, block randomized into blocks of four cells) will be created by an independent researcher using R software. Participants, mental health counselors, and the main researcher (who serves as the contact person for the mental health counselors) cannot be blind for allocation to conditions. However, participants are not informed on whether the treatment they receive is the experimental or active control intervention. They are told that the study aims to compare two treatment options for people with mild to moderate anxiety complaints. This is considered an ethically sound approach, since treatment-as-usual is delivered as optimized care as usual.
Each participant will complete four main measurements during the study: before the start of the intervention (and before participants are informed about which intervention they will receive) (T0); directly following the intervention (three months after baseline; T1); and six (T2) and twelve months (T3) after baseline. All measurements consist mainly of online self-report questionnaires. T0, T1, and T3 also include a telephone interview conducted by a research assistant. The research assistant that conducts the telephone interviews will be unaware of treatment allocation of the participants. If for any reason this blinding is broken, another research assistant (that is blind to treatment condition of the participant) will take over the telephonic assessment.
Figure 1 shows the flow chart of the study design. The SPIRIT Checklist and Figure are presented as Additional file 1 and 2 respectively. The study is approved by the medical ethical committee of the Leiden University Medical Center (LUMC; no. P16.248).
A total of 240 participants will be included. In order for a person to be eligible to participate in the study, the following inclusion criteria have to be met: aged 55–75 years; presence of mild to moderate anxiety symptoms; access to Internet; mastery of the Dutch language; and the possibility and motivation to spend up to 30 min per day on the intervention. Potential individuals that meet any of the following exclusion criteria will be excluded from participation: Alzheimer’s disease or other severe cognitive impairments; unstable severe medical condition(s); severe anxiety or few anxiety symptoms; severe depressive symptomatology; having received psychological or psychopharmacological treatment (with the exception of stable use of benzodiazepines or SSRIs) within the last three months; severe role impairment in at least two areas of role functioning; high suicide risk; substance use disorder or a lifetime diagnosis of bipolar disorder or schizophrenia. The main inclusion criterion—severity of anxiety symptoms—is measured with the GAD-7. This questionnaire uses well-established cut-off points for mild, moderate, and severe anxiety symptoms . These cut-offs point are used to identify our study population: people that score between 5 (cut-off point for mild anxiety) and 15 (cut-off point for severe anxiety) are considered to experience mild to moderately severe anxiety complaints. The information in the participants’ medical record at the general practice is used to determine the presence of a severe unstable medical condition, severe cognitive impairment, and a lifetime diagnosis of bipolar disorder or schizophrenia.. The PHQ-9  is used to assess depressive symptomology (a score of ≥ 20 indicates severe symptoms and excludes people from participation). Role impairment is assessed with the Sheeran Disability Scale (SDS) . A score of ≥ 8 on two of the three subscales is indicative of severe role impairment. Participants are screened for high suicide risk, substance use disorders, and a lifetime diagnosis of bipolar disorder or schizophrenia with the M.I.N.I.-Plus .
Cluster randomization will be applied at the level of the participating mental health counselors. Assuming a mean cluster size of five patients per counselor, an intraclass correlation coefficient of 0.01  and a coefficient of variation of 0.30 , 18 mental health counselors in each intervention arm and 90 participants per study arm are needed to detect a between group difference on the GAD-7 with a medium effect size (d = 0.45) with an alpha of 0.05 (two-tailed) and a power of 0.80. Compensating for an anticipated dropout of 25% (based on trials similar to the proposed study with regard to either the treatment approach [40, 54] or the study population ), 240 participants will have to be included at baseline. The endpoint for this sample size is 14 weeks. In the most recent and comprehensive Cochrane meta-analysis of 101 studies of media-delivered CBT for anxiety disorders in adults, moderate-quality evidence showed medium effect sizes for CBT compared to control conditions (d = 0.67; 95% confidence interval = 0.55–0.80) . These effects were somewhat smaller than those reported in other recent reviews [17, 19,20,21,22] and also smaller than the large effect sizes for Internet-based ACT (0.80 and 0.87) in the study of Fledderus et al.  and for Internet-based CBT for anxiety complaints in older adults (1.43) in the study of Dear et al. . These last two studies both compared active treatment to a waiting list control condition. Furthermore, Pots et al. reported an effect size of 0.41 for web-based ACT (with e-mail support) compared to an active control group (expressive writing) . Based on these studies, a moderate effect size of d = 0.45 is estimated for the difference between the ACT online intervention and treatment-as-usual.
Recruitment of general practices
General practices will be recruited throughout the Netherlands, with a focus on the Leiden and the Hague area. Both general practitioners and the mental health counselors working at the general practices will receive a printed invitation to participate in the study, after which they will be contacted by email and phone to recommend participation. When a practice (both GP and mental health counselor) agrees to participate, the mental health counselor will be randomized. A total of 36 mental health counselors will be included. Randomization is performed by an independent researcher, who is informed by the main researcher when a group of four mental health counselors have been enrolled. The mental health counselors are informed about their group allocation by the main researcher and are invited to attend a training in the treatment method they will apply during the study.
Recruitment of participants
A data manager will visit the participating general practices to assist the general practitioner in the selection of patients aged 55–75 years that are eligible to receive an invitation letter for the study. Patients whose medical records mention a lifetime diagnosis of bipolar disorder or schizophrenia, a severe unstable medical condition, Alzheimer’s disease, or other severe cognitive impairments will not receive an invitation. All other patients aged 55–75 years do receive an invitation letter. The invitation letter from the GP to the patients contains information about anxiety complaints and explains the aim, design, and procedure of the study. Furthermore, the letter refers to the study website. On this website, potential participants can read more extensive information about the study and indicate their interest to participate. After doing so, they will be asked to fill in the GAD-7 and PHQ-9 and to indicate whether they have received psychological treatment for emotional problems during the last three months, have Internet access, have sufficient time for treatment, are able to communicate in Dutch, and are aged 55–75 years. If based on these answers patients are still eligible to participate, they are asked if they are willing to be interviewed by phone to determine whether they fulfill all inclusion criteria. They are asked to fill in their telephone number and to indicate on which day they prefer to be called. Within ten days they will be phoned by a research assistant, who will administer the SDS and M.I.N.I.-Plus. Furthermore, they will be asked about their medication use. Patients will also be given the opportunity to ask any remaining questions about the aim of the study and the study procedures. The interviewer will discuss his/her diagnostic findings from the M.I.N.I-Plus with a senior clinical psychologist; subsequently the interviewee is informed by mail about inclusion or exclusion. When patients are eligible, they will receive a link to an online informed consent form and the baseline questionnaires (T0). Ineligible patients will be referred to their general practitioner in case they want help for their complaints. Once eligible patients have filled in the informed consent form and the baseline questionnaires, the mental health counselor at their general practice will be informed about study participation and they will be invited for a first appointment. In addition to the mass mailing, general practitioners and mental health counselors will recommend participation to patients aged 55–75 years that attend the practice with anxiety complaints during the inclusion period. They will inform these patients about the study and refer them to the study website if they want to participate. These patients then follow the screening and inclusion procedure as described above.
Procedure during study participation
During the intervention, participants will fill in a short questionnaire assessing potential mediator variables several times. At these moments they will also complete the GAD-2  and PHQ-2  to measure respectively anxiety and depression symptoms (the combination of PHQ-2 and GAD-2 is also known as the PHQ-4 ). They will also be asked whether they have had recurrent thoughts about death or hurting themselves in the past week, using an item of the PHQ-9 . When participants have had suicidal thoughts in the past week, they will be recommended to discuss this with their mental health counselor at the general practice. Furthermore, their mental health counselor will be notified about the presence of suicidal thoughts by the researchers and are asked to contact the participant. Participants in the experimental condition complete this questionnaire at the end of every online lesson (nine times in total). Participants in the control condition, receive an email with a link to this questionnaire after every session with the mental health counselor (a total of four times).
Both interventions are delivered in a timespan of maximum 12 weeks, after which participants receive an e-mail with a link to the online self-report questionnaires of the post-treatment assessment (T1). T1 also includes a clinical interview by telephone conducted by a research assistant. The follow-up assessments take place six (T2) and twelve months (T3) after baseline. Both these assessments consist of self-report questionnaires and T3 also includes a clinical telephone interview. Figure 1 shows an overview of the patient flow through the phases of the study.
Prevention of attrition
Although available research shows that the effect of eHealth interventions does not depend on age and that older adults are even more adherent than younger adults , several precautions will be taken to reduce dropout and heighten compliance throughout this study. If participants fail to complete study assessments or intervention assessments, motivational reminders will be send repeatedly by email. Furthermore, individuals who complete all study assessments will take part in a lottery for gift vouchers worth €50, in order to stimulate them to complete all study assessments (lotteries will take place every year during the data collection period). If participants drop out or stop using the intervention, they will be asked for the reason(s) why they decided to quit the intervention and/or study.
The online intervention “Living to the Full” is an adaptation of the similarly titled ACT-based self-help book  (English version: ). The effectiveness of this web-based intervention (both with and without support from a counselor) in reducing depression and associated anxiety in adults has been established in RCTs [21, 40, 41, 61]. A pilot study in which ten older adults worked through the online module, resulted in some age-matched adaptations of the layout and text of the intervention. The online module consists of nine lessons that are ideally completed in a maximum of 12 weeks. The lessons are based on the six core processes of ACT that aim to promote psychological flexibility: acceptance; cognitive defusion; contact with the present moment; self as context; values; and committed action. Each lesson contains information in both text and video form about the relationship between the ACT processes and emotional wellbeing, experiential exercises, metaphors, and motivational exercises. Furthermore, participants are instructed to practice mindfulness for 10–15 min on a daily basis. The intervention provides them with audio files that guide them through the mindfulness exercises. Each week, participants receive two or three standardized motivational text messages, to increase motivation and adherence. In addition to the online self-help module, participants will have four face-to-face sessions with the mental health counselor at their general practice to increase motivation, evaluate their progress, and discuss problems. For these sessions, a protocol has been developed. To measure adherence to the protocol, mental health counselors will complete a short online questionnaire after every face-to-face session which asks them to give a brief summary of the session. The mental health counselors in this condition will receive training from an experienced clinical psychologist to get acquainted with ACT, the protocol, and the online environment in which their patients will be working. During the study, the mental health counselors will have two supervision sessions from a clinical psychologist.
Treatment as usual will be provided as optimized care as usual. Participants will be offered four face-to-face sessions with the mental health counselor at the general practice. The treatment follows the guideline for anxiety complaints as developed by the Dutch College of General Practitioners. This guideline prescribes psycho-education and, if necessary, short-term CBT or problem-solving therapy. A manual for the treatment older adults with anxiety complaints has been developed by the researchers. The manual comprises 12 small interventions. Each intervention focuses on either a common form of anxiety (worrying, panic symptoms, social anxiety), cognitive or behavioral aspects typical of most anxiety complaints (catastrophic thinking, avoidance), or consequences of anxiety (sleeping problems, physical tension). All interventions consist of psycho-educative texts and exercises based on CBT. During the first session, the mental health counselor and participant make an overview of the psychological complaints of the participant. Based on this inventory, one or more of the small interventions are selected to form the basis of the next three sessions. In order to prevent treatment diffusion, the delivery of interventions resembling the web-based interventions (i.e. eHealth interventions in general and ACT and mindfulness-based interventions in particular) are not allowed. Mental health counselors will complete a short online questionnaire that measures treatment protocol adherence after every session. Mental health counselors in this condition will follow a training from an experienced clinical psychologist, to practice with the protocol. They will also be supervised during the study.
Table 1 depicts an overview of the assessment instruments that will be used throughout the study. All questionnaires—except for the M.I.N.I.-Plus and SDS—will be conducted online. The M.I.N.I.-Plus and SDS are conducted by telephone.
Anxiety symptom severity
The primary outcome—severity of anxiety symptoms—will be assessed with the GAD-7 . This questionnaire will be used to screen participants on anxiety symptoms and to measure change in these symptoms from baseline to post- and follow-up tests. The primary endpoint for this measure is the measurement 14 weeks after baseline (T1). The GAD-7 consists of seven items that are rated on a 4-point scale ranging from 0 (not at all) to 3 (nearly every day), e.g. “Over the last 2 weeks, how often have you been bothered by: feeling nervous, anxious or on edge.” Higher scores indicate more anxiety symptoms. Total scores are in the range of 0–21 and scores of 5, 10, and 15 are taken as the cut-off points for mild, moderate, and severe anxiety. Psychometric properties of the GAD-7 are adequate and the scale may also be used as a screener for panic disorder, social anxiety, and post-traumatic stress disorder [48, 55, 62]. The reliability and validity of a web-based Dutch translation of the GAD-7 have also been established .
Furthermore, during treatment, participants will fill in the GAD-2  several times to measure anxiety symptom severity. The GAD-2 consists of the first two items of the GAD-7, which reflect core anxiety symptoms (“Feeling nervous, anxious, or on edge” and “Not being able to stop or control worrying”). Scores on the GAD-2 will be used in the mediation analyses. The GAD-2 is a reliable, valid, and sufficiently sensitive and specific instrument [55, 63, 64].
Depression symptom severity
Depression symptoms will be measured with the PHQ-9 . This questionnaire will be used as a screener for depressive symptoms and to measure change in depressive symptomology from baseline to post- and follow-up tests. The questionnaire consists of nine items and includes the DSM-IV criteria for a major depressive disorder. The items are rated on a 4-point scale ranging from 0 (not at all) to 3 (nearly every day). Scores are in the range of 0–27 and cut-off points of 5, 10, 15, and 20 represent mild, moderate, moderately severe, and severe levels of depressive symptoms. The PHQ-9 is sensitive to change, has good sensitivity and specificity for detecting depressive disorders, and its psychometric properties are adequate [62, 64, 65]. In addition, depression symptoms will be measured with the PHQ-2  at several times during treatment. The two items of the PHQ-2 (which correspond to the first two items of the PHQ-9) measure core depressive symptomology. The scores on these items will be used in the mediation analyses. The reliability, validity, and sensitivity to change of the PHQ-2 have been established [56, 57, 64].
Presence of psychiatric disorder
Presence of current and/or lifetime diagnosis of anxiety disorder (generalized anxiety disorder, panic disorder, agoraphobia, specific phobia, social phobia), obsessive-compulsive disorder, depressive disorder, post-traumatic stress disorder, and illness anxiety disorder will be determined by the M.I.N.I.-Plus . Current substance abuse disorder and suicide risk as well as a lifetime diagnosis of psychotic disorder and bipolar disorder will also be assessed. The M.I.N.I.-Plus is the most widely used psychiatric structured diagnostic interview instrument in the world and has been validated against the Structured Clinical Interview for DSM diagnoses (SCID-P) and the Composite International Diagnostic Interview for ICD-10 (CIDI) . Trained research assistants who are blind to the randomization scheme will conduct the M.I.N.I-Plus by phone. The M.I.N.I.-Plus will be administered during the screening (T0). At T1 and T3, only the modules for current anxiety disorders, depressive disorder, post-traumatic stress disorder, obsessive-compulsive disorder, and illness anxiety will be conducted. Minor adjustments will be made to the M.I.N.I.-Plus, so it corresponds with the criteria of the DSM-V. When uncertain of a diagnosis, the interviewers will have the opportunity to consult a psychiatrist or senior clinical psychologist, who is also blind to randomization status of the participants.
The SDS  was developed to assess functional impairment in three inter-related domains: work/school; social life; and family life. The SDS measures the extent to which work/school, social life, and home life or family responsibilities are impaired by psychiatric symptoms on a 10-point visual analogue scale. The three items can be summed into a single dimensional measure of global functional impairment that ranges from 0 (unimpaired) to 30 (highly impaired). A psychometric analysis in a large sample of primary care patients demonstrated that the SDS has good psychometric qualities . Research assistants that are blind to group allocation, will administer the SDS by telephone during the screening (T0) and at T1 and T3.
Cognitive emotion regulation
The subscales Rumination, Catastrophizing, Positive reappraisal, and Blaming yourself of the CERQ [66, 67] will be used to measure the extent to which participants use these cognitive coping strategies when confronted with adversities. The choice for these subscales is based on several studies that have demonstrated the association between these strategies and anxiety and depression symptoms [67,68,69]. The subscales consist of four items each. Higher scores on a subscale indicate that this cognitive coping strategy is more often used to regulate emotions. Psychometric properties of the Dutch CERQ are adequate [68, 70].
The Acceptance and Action Questionnaire (AAQ-II) [71, 72] is a uni-dimensional measure [72, 73] that assesses experiential avoidance: the unwillingness to remain in contact with aversive private experience and behaviors aimed at altering these experiences or the events that elicit them. The AAQ-II originally contained ten items, but a study showed that a seven-item version has better psychometric qualities . Items are scored on a 7-point scale ranging from 1 (never true) to 7 (always true). Higher scores reflect higher levels of experiential avoidance. The reliability and validity of a Dutch translation of the AAQ-II has been established in a sample of moderately depressed and anxious individuals .
Positive mental health
The Mental Health Continuum-Short Form (MHC-SF)  is a 14-item self-report questionnaire for positive mental health assessment. The questionnaire consists of three subscales, corresponding with the three dimensions of positive mental health: three items for emotional wellbeing; six items for psychological wellbeing; and five items for social wellbeing. Items are rated on a 6-point scale ranging from 0 (never) to 5 (every day). Confirmatory factor analysis (CFA) confirmed the three-factor structure of a Dutch translation of the MHC-SF. Results from the same psychometric study also revealed high internal and moderate test–retest reliability for the Dutch MHC-SF .
The Five Facet Mindfulness Questionnaire- Short Form (FFMQ-SF)  will be used to measure mindfulness, defined as the ability to bring one’s attention to experiences in the present moment in a non-judgmental way . The questionnaire contains 24 items that measure five facets of mindfulness: observing; describing; acting with awareness; non-judging; and non-reactivity. Items are scored on a 5-point scale ranging from 1 (never or very rarely true) to 5 (very often or always true). A psychometric study showed that the FFMQ-SF is a sensitive, reliable, and valid instrument. Furthermore, the five-factor structure of the questionnaire was confirmed in this study .
Generic health status and quality of life
The EuroQol-5 Dimensions-5 Levels questionnaire (EQ-5D-5 L) measures general quality of life using five dimensions (i.e. mobility, self-care, usual activities, pain/discomfort, and anxiety/depression) . Each dimension has five response categories, describing the severity of problems. A total of 3125 unique health states can be defined, by combining the responses for the five dimensions into a five-digit number (ranging from “11111” meaning no problems at all to “55555” meaning extreme problems in all five dimensions) . The EQ-5D-5 L is an adaption of the EQ-5D . The EQ-5D consists of the same five dimensions but has only three response categories per dimension. Evidence suggests that the EQ-5D has limited responsiveness to changes in health, partly caused by ceiling and floor effects. Studies show that compared to the EQ-5D, the EQ-5D-5 L has smaller ceiling and floor effects, and improved reliability and discriminating ability [80, 81].
Costs associated with psychiatric illness
For calculating the total direct medical costs, the Trimbos/iMTA questionnaire for Costs associated with Psychiatric Illness (TiC-P)  will be used. The TiC-P measures utilization of medical treatment, such as the number of contacts with the general practitioner and multiple other care providers (e.g. medical specialists and paramedics) during the last four weeks, as well as medication use and loss of productivity at (voluntary) work. The costs will be calculated using the Dutch guidelines for cost calculations in healthcare. Reference unit prices of the corresponding healthcare services will be applied. A psychometric study demonstrated that the Dutch version of the TIC-P is a feasible, reliable, and valid tool for assessing care consumption and productivity loss in patients with mild to moderate psychiatric problems .
The Client Satisfaction Questionnaire-8 (CSQ-8)  is an eight-item instrument that is designed to measure client satisfaction with services. The items for the CSQ-8 were selected based on mental health professionals’ ratings of a number of items that could be related to client satisfaction and a subsequent factor analysis. The CSQ-8 is uni-dimensional, yielding a homogeneous estimate of general satisfaction with services. The questions are answered on a 4-point scale in the range of 1–4, but each question has different labels attached to these values. Higher scores indicate higher client satisfaction. The psychometric qualities of the Dutch translation of the CSQ are adequate [84, 85].
Self-esteem, mastery, and support
Starting from existing instruments, Bovier, Chamot, and Perneger used factor analyses to develop four brief scales for the assessment of self-esteem, affective social and confident/problem-solving social support . All 12 items are answered on a 5-point Likert scale, with higher scores representing higher levels of the four measured constructs. All four scales have been found to demonstrate good internal and construct validity .
A self-developed questionnaire will be used to measure negative life events and associated distress. Participants are asked if they have experienced negative life events in the past six months and/or earlier in their life. If they indicate that they have experienced such (an) event(s), they are asked to rate them on an 11-point scale (ranging from 0 [not at all] to 10 [extremely]) to what extent these experiences currently still evoke strong negative feelings.
Co-morbid somatic problems
Co-morbid physical problems will be measured with a self-developed questionnaire listing 25 (chronic) conditions. This list is based on information from Statistics Netherlands. Participants will also be asked to rate to what extent their somatic problem(s) interferes with their current daily functioning on an 11-point scale ranging from 0 (not at all) to 10 (extremely).
Socio-demographics and other information
Using a self-developed questionnaire, the following socio-demographic information and additional information will be collected: age; gender; nationality; marital status; living conditions; education; work status; computer usage; and Internet usage.
Treatment credibility and expectancies
Participants’ expectations of the treatment will be measured with a questionnaire derived from the Treatment Credibility Questionnaire (TCQ) from Borkovec and Nau . In this study, the version as developed by De Jong et al. (Risk models for negative treatment outcomes in psychiatric outpatients: predicting end state functioning and rate of change using classification and regression trees (CART) and multilevel modeling, unpublished) will be used. This version combines an adaptation of the TCQ  with one item (“How much improvement in your symptoms do you think will occur”) from the Credibility Expectancy Questionnaire . The questionnaire consists of seven items that are scored on a 7-point rating scale, ranging from 1 (not at all) to 7 (extremely). The questionnaire consists of two factors: Expectancies and Credibility. The version that will be used in this study has an internal consistency of 0.89 for the Expectancies subscale and 0.84 for the Credibility subscale . This questionnaire will be completed after participants have had the first session with the mental health counselor at the general practice.
A self-developed questionnaire measures the use of the following emotion regulation strategies: distraction; reappraisal; acceptance; rumination/worry; and suppression. Adaptive strategies (distraction, reappraisal, acceptance) are consistently more strongly related with reduced negative affect and maladaptive strategies (rumination/worry and suppression) with enhanced negative affect in laboratory studies  and psychopathology in clinical studies . In addition, participants will be asked whether they used problem-solving and attempted to change the stressful situation or contain its consequences. Although problem-solving responses are not directly aimed at regulating emotions, they can have beneficial effects on emotions by modifying or eliminating stressors . Participants will report on the extent to which they have engaged in each of these emotion-regulation strategies on a 6-point scale ranging from 0 (never) to 6 (always). The questionnaire consists of a total of seven items.
Since both interventions stimulate participants to limit their avoidance behavior, this factor will be included in the mediation analyses. Behavioral avoidance is measured with one item (i.e. “In the past week my anxiety caused me to avoid situations and/or activities”), that participants rate on a 6-point-scale ranging from 0 (never) to 6 (always).
Treatment expectancy is measured with one item: “How confident are you that the course will be helpful in reducing your anxiety complaints?” Participants rate this question on a 7-point scale ranging from 1 (not at all) to 7 (very confident). Several studies have shown the impact of client expectancies on treatment effect. Evidence suggests that eliciting hope and positive expectations about the effect of the treatment is a crucial factor in many psychotherapies [93,94,95,96].
Preliminary results suggest that the outcome of psychological interventions may be mediated by patient’s self-efficacy with regard to the treatment (i.e. one’s judgment of the capability to successfully participate in and complete the treatment) [97, 98]. Self-efficacy with regard to therapy is measured with one item: “How confident are you that you will do what is required to successfully follow and complete this course?” Participants rate this question on a 7-point scale ranging from 1 (not at all) to 7 (very confident).
Session Rating Scale
The Session Rating Scale (SRS)  will be used to measure the working alliance between the participants and their mental health counselor. The items assess four aspects of the working alliance: the relational bond (the degree to which one feels heard, understood, and respected); the degree to which desired goals and topics of the individual were discussed; an evaluation of the therapist’s approach or method that was used; and an evaluation of how the individual perceives the session overall. Instead of using a visual analogue scale, an 11-point scale will be used to answer each of the four items, with “0” depicting the most negative response and “10” depicting the most positive response. The SRS was shown to have high test–retest and internal consistency reliability, as well as acceptable validity [100, 101]. The SRS will be completed after every face-to-face session.
All analyses will use intention-to-treat principles and a two-tailed alpha of 0.05 for significance testing. Cluster randomization at the level of mental health counselors (instead of individual patients) results in a lack of independence for the outcomes of patients receiving treatment from the same counselor. If clustering and dependence of outcome are ignored, this could lead to underestimation of standard errors and regression coefficients . Therefore, multilevel regression analysis will be used to examine the treatment effect on the primary and secondary outcome measures. Multilevel analysis allows modeling of the variability of the outcome measures within clusters and analysis of a repeated-measure design with missing data. In this cluster randomized RCT, three levels can be distinguished: (1) repeated measures within patients; (2) treatment allocation; and (3) mental health counselors. To evaluate the intervention effect, a twofold analysis will be conducted. First, using a mixed-model analysis with treatment as a dummy variable and the dependent variable on baseline as covariate it will be examined whether conditions differ across time. In addition, a subsequent mixed-model analysis without the dependent variable at baseline as covariate will analyze at which particular time point conditions differ as indicated by the interaction effect of treatment × time. Missing data will be imputed using a model-based approach. Covariance will be estimated using an unstructured covariance matrix.
To examine moderators of the treatment outcome, longitudinal multi-level regression analysis will be performed. Potential moderators will be entered individually in the model. Interaction effects will be investigated (e.g. time × condition × potential moderator). Bivariate latent difference score models will be used for the mediation analysis. This type of analysis is recommended for repeated measurements and multiple mediators, because they allow for a more dynamic approach to mediation, by assessing changes in multiple variables and their interrelations over time [103,104,105]. Cost-effectiveness analyses will be conducted in agreement with the CHEERS statement  and will be determined by relating the difference in healthcare costs (measured with the TiC-P) to the between-group difference in reliable change on GAD-7 scores (cost-effectiveness analysis) and quality-adjusted life-years (QALYs) gained based on the EQ-5D-5 L using the Dutch tariffs (cost–utility analysis). Productivity losses in paid work will be included in the economic evaluation and measured by assessing work-loss days due to absenteeism and work cutback days (presenteeism) while at work but not feeling well. All cost prices will be indexed for the appropriate reference year (likely to be 2017) but not discounted because the study’s time horizon does not exceed the period of a single year. Stochastic uncertainty in the incremental cost-effectiveness ratios (ICERs) will be handled using non-parametric bootstraps (2500 replications), plotted on the ICER plane and depicted in an ICER acceptability curve. Sensitivity analyses will focus on the friction cost versus human capital method and on main cost-drivers.
The proposed study will evaluate the (cost-)effectiveness of the Internet-based ACT intervention ‘Living to the Full’ for older adults with anxiety complaints in a RCT. This study has several strengths. First, the trial is unique in this field of research. It differs from the majority of studies in older anxious adults with regard to therapy approach (ACT instead of CBT), the delivery of the investigated intervention (Internet-based instead of face-to-face) and the study population (people with anxiety complaints instead of anxiety disorders). The moderation and mediation analyses form a second strength. These analyses will provide insight into respectively the effect of personal characteristics on treatment outcome and the processes through which the intervention achieves its effects. Including such analyses broadens the scope of the study. The trial is not merely focused on answering the question if “Living to the Full” is more or less effective than treatment-as-usual. Because of the optimized active control condition, it is plausible that both treatments will result in a significant reduction in symptomology and related measures. In this scenario, the moderation and mediation analyses will still be of value in exploring if certain subgroups of patients benefit from one of the interventions in particular and if the processes through which the treatments achieved their effects differ. This sort of knowledge can contribute to a more personalized treatment approach by taking into account moderating factors and an increased effectiveness of interventions by refining and intensifying those components that focus directly on the mediators . Another strength of this study is related to the fact that treatment-as-usual is delivered as optimized care as usual. Because participants in the control condition will receive appropriate treatment, a 12-month follow-up is defendable, allowing to investigate the long-term (cost-)effectiveness of the “Living to the Full” intervention compared to treatment as usual. A final strength of this study is its recruitment method. All patients aged 55–75 years from participating general practices are actively invited to participate in the study and are able to register online. Compared to studies in which only patients that visit their general practitioner with certain complaints are informed about a study, this method reaches a wider population and lowers the threshold for registering for participation.
The study also has some limitations. First, the online nature of the screening procedure and intervention might limit the study sample. It excludes people that are not proficient with computers. These people might share certain characteristics (e.g. older age, lower education levels), which reduces the representativeness of the sample. Second, the study might encounter difficulties in recruiting enough participants. Recruiting older adults for study participation is challenging . Furthermore, due to the cluster-randomized design, more participants are needed to obtain equivalent statistical power as compared to an individually randomized trial . However, this study uses a mass mailing as the main recruitment method, which has proven to be one of the most successful strategies to recruit older adults .
To conclude, the proposed study will evaluate an ACT online self-help program combined with face-to-face contacts with the mental health counselor at the general practice for older adults with anxiety symptoms. Since subclinical anxiety is highly prevalent in this age group, (cost-)effective, low-threshold interventions are needed. The proposed study complies with this request. When “Living to the Full” proves to be effective for this patient group, implementation of the intervention in general practices in the Netherlands will follow.
Patient recruitment started November 2017. Recruitment is expected to be completed December 2018.
Acceptance and Action Questionnaire II
Acceptance and Commitment Therapy
Cognitive behavioral therapy
Cognitive Emotion Regulation Questionnaire
Client Satisfaction Questionnaire 8
- EQ-5D-5 L:
EuroQol 5 dimensions 5 levels questionnaire
Five Facet Mindfulness Questionnaire Short Form
General Anxiety Disorder 2
General Anxiety Disorder 7
Mini-International Neuropsychiatric Interview-PLUS
Mental Health Continuum Short Form
Patient Health Questionnaire 2
Patient Health Questionnaire 4
Patient Health Questionnaire 9
Sheehan Disability Scale
Session Rating Scale
Trimbos/iMTA questionnaire for Costs associated with Psychiatric Illness
Bryant C, Jackson H, Ames D. The prevalence of anxiety in older adults: methodological issues and a review of the literature. J Affect Disord. 2008;109(3):233–50.
Wolitzky-Taylor KB, Castriotta N, Lenze EJ, Ma S, Craske MG. Anxiety disorders in older adults: a comprehensive review. Depress Anxiety. 2010;27(2):190–211.
Diefenbach GJ, Hopko DR, Feigon S, Stanley MA, Novy DM, Beck JG, et al. ‘Minor GAD’: characteristics of subsyndromal GAD in older adults. Behav Res Ther. 2003;41:481–7.
Lenze EJ, Wetherell JL. Bringing the bedside to the bench, and then to the community: a prospectus for intervention research in late-life anxiety disorders. Int J Geriatr Psychiatry. 2009;24(1):1–14.
Wetherell JL, Kaplan RM, Kallenberg G, Dresselhaus TR, Sieber WJ, Lang AJ. Mental health treatment preferences of older and younger primary care patients. Int J Psychiatry Med. 2004;34(3):219–33.
Voshaar RC. Lack of interventions for anxiety in older people. Br J Psychiatry. 2013;203(1):8–9.
De Beurs E, Beekman AT, van Balkom AJ, Deeg DJ, van Dyck R, van Tilburg W. Consequences of anxiety in older persons: its effect on disability, well-being and use of health services. Psychol Med. 1999;29(3):583–93.
Diefenbach GJ, Tolin DF, Gilliam CM. Impairments in life quality among clients in geriatric home care: associations with depressive and anxiety symptoms. Int J Geriatr Psychiatry. 2012;27(8):828–35.
Mehta KM, Simonsick EM, Penninx BW, Schulz R, Rubin SM, Satterfield S, et al. Prevalence and correlates of anxiety symptoms in well-functioning older adults: findings from the health aging and body composition study. J Am Geriatr Soc. 2003;51(4):499–504.
Gallacher J, Bayer A, Fish M, Pickering J, Pedro S, Dunstan, et al. Does anxiety affect risk of dementia? Findings from the Caerphilly prospective study. Psychosom Med. 2009;71:659–66.
Yochim BP, Mueller AE, Segal DL. Late life anxiety is associated with decreased memory and executive functioning in community dwelling older adults. J Anxiety Disord. 2013;27:567–75.
Brenes GA, Guralnik JM, Williamson JD, Fried LP, Simpson CS, Simonsick EM, et al. The influence of anxiety on the progression of disability. J Am Geriatr Soc. 2005;53(1):34–9.
Lambiase MJM, Kubzansky LD, Thurston RC. Prospective study of anxiety and incident stroke. Stroke. 2014;45(2):438–43.
Kawachi I, Sparrow D, Vokonas PS, Weiss ST. Symptoms of anxiety and risk of coronary heart disease: the normative aging study. Circulation. 1994;90:2225–9.
Smit F, Comijs H, Schoevers R, Cuijpers P, Deeg D, Beekman A. Target groups for ` the prevention of late-life anxiety. Br J Psychiatry. 2007;190:428–34.
Veer-Tazelaar PJ, Marwijk HWJ, Van Oppen P, Van Hout HPJ, Van der Horst HE, Cuijpers P, et al. Stepped-care prevention of anxiety and depression in late life. Arch Gen Psychiatry. 2009;66(3):297–304.
Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5(10):e13196.
Christensen H, Batterham P, Calear A. Online interventions for anxiety disorders. Curr Opin Psychiatry. 2014;27(1):7–13.
Cuijpers P, Donker T, van Straten A, Li J, Andersson G. Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med. 2010;40(12):1943–57.
Griffiths KM, Farrer L, Christensen HR. The efficacy of internet interventions for depression and anxiety disorders: a review of randomised controlled trials. Med J Australia. 2010;192(11):S4–S11.
Haug T, Nordgreen T, Ost LG, Havik OE. Self-help treatment of anxiety disorders: a meta-analysis and meta-regression of effects and potential moderators. Clin Psychol Rev. 2012;32(5):425–45.
Lewis C, Pearce J, Bisson JI. Efficacy, cost-effectiveness and acceptability of self-help interventions for anxiety disorders: systematic review. Br J Psychiatry. 2012;200(1):15–21.
Mayo-Wilson E, Montgomery P. Media-delivered cognitive behavioural therapy and behavioural therapy (self-help) for anxiety disorders in adults. Cochrane Database Syst Rev. 2013;9:CD005330.
Reger MA, Gahm GA. A meta-analysis of the effects of internet- and computer-based cognitive-behavioral treatments for anxiety. J Clin Psychol. 2009;65(1):53–75.
Spek V, Cuijpers P, Nyklicek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. 2007;37:319–28.
Dear BF, Zou JB, Ali S, Lorian CN, Johnston L, Sheehan J, et al. Clinical and cost-effectiveness of therapist-guided internet-delivered cognitive behavior therapy for older adults with symptoms of anxiety: a randomized controlled trial. Behav Ther. 2015;46(2):206–17.
Ayers CR, Sorrell JT, Thorp SR, Wetherell JL. Evidence-based psychological treatments for late-life anxiety. Psychol Aging. 2007;22(1):8–17.
Gould RL, Coulson MC, Howard RJ. Efficacy of cognitive behavioral therapy for anxiety disorders in older people: a meta-analysis and meta-regression of randomized controlled trials. J Am Geriatr Soc. 2012;60(2):218–29.
Hendriks GJ, Oude Voshaar RC, Keijsers GPJ, Hoogduin CAL, van Balkom AJLM. Cognitive-behavioural therapy for late-life anxiety disorders: a systematic review and meta-analysis. Acta Psychiat Scand. 2008;117(6):403–11.
Pinquart M, Duberstein PR. Treatment of anxiety disorders in older adults: a meta- analytic comparison of behavioral and pharmacological interventions. Am J Geriatric Psychiatry. 2007;15(8):639–51.
Thorp SR, Ayers CR, Nuevo R, Stoddard JA, Sorrell JT, Wetherell JL. Meta-analysis comparing different behavioral treatments for late-life anxiety. Am J Geriatric Psychiatry. 2009;17(2):105–15.
Wetherell JL, Petkus AJ, Thorp SR, Stein MB, Chavira DA, Campbell-Sills L, et al. Age differences in treatment response to a collaborative care intervention for anxiety disorders. Br J Psychiatry. 2013;203(1):65–72.
Hayes SC. Acceptance and commitment therapy, relational frame theory, and the third wave of behavioral and cognitive therapies. Behav Ther. 2004;35:639–65.
Petkus AJ, Wetherell JL. Acceptance and commitment therapy with older adults: rationale and considerations. Cogn Behav Pract. 2013;20(1):47–56.
Wetherell JL, Ayers CR, Stoddard JA, Ruberg J, Sorrell JT, Liu L, et al. Acceptance and commitment therapy for generalized anxiety disorder in older adults: a preliminary report. Behav Ther. 2011;42(1):127–34.
Swain J, Hancock K, Hainsworth C, Bowman J. Acceptance and commitment therapy in the treatment of anxiety: a systematic review. Clin Psychol Rev. 2013;33(8):965–78.
A-Tjak JG, Davis ML, Morina N, Powers MB, Smits JA, Emmelkamp PM. A meta-analysis of the efficacy of acceptance and commitment therapy for clinically relevant mental and physical health problems. Psychother Psychosom. 2015;84(1):30–6.
Öst L. The efficacy of acceptance and commitment therapy: an updated systematic review and meta-analysis. Behav Res Ther. 2014;61:105–21.
Powers MB, Zum Vörde Sive Vörding MB, Emmelkamp PMG. Acceptance and commitment therapy: a Meta-analytic review. Psychother Psychosom. 2009;78:73–80.
Fledderus M, Bohlmeijer ET, Pieterse ME, Schreurs KM. Acceptance and commitment therapy as guided self-help for psychological distress and positive mental health: a randomized controlled trial. Psychol Med. 2012;42(3):485–95.
Pots WTM, Fledderus M, Meulenbeek PAM, ten Klooster PM, Schreurs KMG, Bohlmeijer ET. Acceptance and commitment therapy as a web-based intervention for depressive symptomatology: randomised controlled trial. Brit J Psychiat. 2016;208(1):69–77.
Butler J, Ciarrochi J. Psychological acceptance and quality of life in the elderly. Qual Life Res. 2007;16:607–15.
Shallcross AJ, Ford BQ, Floerke VA, Mauss IB. Getting better with age: the relationship between age, acceptance, and negative affect. J Pers Soc Psychol. 2013;104(4):734–49.
Smith A. Clinical uses of mindfulness training for older people. Behav Cogn Psychother. 2004;32:423–30.
Beekman AT, de Beurs E, van Balkom AJ, Deeg DJ, van Dyck R, van Tilburg W. Anxiety and depression in later life: co-occurrence and communality of risk factors. Am J Psychiatry. 2000;157(1):89–95.
Schuurmans J, Comijs H, Emmelkamp PM, Weijnen IJ, van den Hout M, van Dyck R. Long-term effectiveness and prediction of treatment outcome in cognitive behavioral therapy and sertraline for late-life anxiety disorders. Int Psychogeriatrics. 2009;21(6):1148–59.
Campbell MK, Piaggo G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661.
Spitzer RL, Kroenke K, Williams JB, Lowe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.
Leon AC, Olfson M, Portera L, Farber L, Sheehan DV. Assessing psychiatric impairment in primary care with the Sheehan disability scale. Int J Psychiatry Med. 1997;27(2):93–105.
Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The mini-international neuropsychiatric interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 20):22–33. quiz 4–57
Van der Weele GM, de Waal MWM, van den Hout WB, de Craen HJM, Spinhoven P, Stijnen T, et al. Effects of a stepped-care intervention programme among older subjects who screened positive for depressive symptoms in general practice: the PROMODE randomised controlled trial. Age Aging. 2012;41(4):482–8.
Eldridge SM, Ashby D, Kerry S. Sample size for cluster randomized trials:effect of coefficient of variation of cluster size and analysis method. Int J Epidemiol. 2006;35:1292–300.
Bohlmeijer ET, Fledderus M, Rokx TAJJ, Pieterse ME. Efficacy of an early intervention based on acceptance and commitment therapy for adults with depressive symptomatology: evaluation in a randomized controlled trial. Behav Res Ther. 2011;49(1):62–7.
Kroenke K, Spitzer RL, Williams JBW, Monahan PO, Löwe B. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007;146(5):317–25.
Löwe B, Kroenke K, Grafe K. Detecting and monitoring depression with a two-item questionnaire (PHQ–2). J Psychosom Res. 2005;58:163–71.
Kroenke K, Spitzer RL, Williams JB, Lowe B. An ultra-brief screening scale for anxiety and depression: the PHQ-4. Psychosomatics. 2009;50(6):613–21.
Karyotaki E, Kleiboer A, Smit F, Turner DT, Pastor AM, Andersson G, et al. Predictors of treatment dropout in self-guided web-based interventions for depression: an 'individual patient data' meta-analysis. Psychol Med. 2015;45(13):2717–26.
Bohlmeijer ET, Hulsbergen M. Voluit leven. Mindfulness of de kunst van het aanvaarden. Amsterdam: Boom; 2008.
Bohlmeijer ET, Hulsbergen M. A beginners’ guide to mindfulness, live in the moment. Oxford: McGraw-Hill; 2015.
Kelders S, Bohlmeijer ET, Pots WT, van Gemert-Pijnen JE. Comparing human and automated support for depression: fractional factorial randomized controlled trial. Behav Res Ther. 2015;72:72–80.
Kroenke K, Spitzer RL, Williams JB, Lowe B. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32(4):345–59.
Donker T, Van Straten A, Marks I, Cuijpers P. Quick and easy self-rating of generalized anxiety disorder: validity of the Dutch web-based GAD-7, GAD-2 and GAD-SI. Psychiatry Res. 2011;188:58–64.
Löwe B, Wahl I, Rose M, Spitzer C, Glasmer H, Wingenfeld K, et al. A 4-item measure of depression and anxiety: validation and standardization of the patient health Questionnaire-4 (PHQ-4) in the general population. J Affect Disord. 2010;122:86–95.
Löwe B, Unutzer J, Callahan CM, Perkins AJ, Kroenke K. Monitoring depression treatment outcomes with the patient health Questionnaire-9. Med Care. 2004;42:1194–201.
Garnefski N, Kraaij V, Spinhoven P. CERQ: Manual for the use of the Cognitive Emotion Regulation Questionnaire. Leiderdorp: Datec; 2002.
Garnefski N, Kraaij V, Spinhoven P. Negative life events, cognitive emotion regulation and emotional problems. Pers Indiv Differ. 2001;30:1311–27.
Garnefski N, Kraaij V. The cognitive emotion regulation questionnaire. Eur J Psychol Assessment. 2007;23:141–9.
Omran MP. Relationships between cognitive emotion regulation strategies with depression and anxiety. O J Psych. 2011;1:106–9.
Kraaij V, Pruymboom E, Garnefski N. Cognitive coping and depressive symptoms in the elderly: a longitudinal study. Aging Ment Health. 2002;6(3):275–81.
Jacobs N, Kleen M, de Groot F, A-Tjak J. De Nederlandse versie van de acceptance and action questionnaire-II (AAQ-II). Gedragstherapie. 2008;41:349–61.
Bond FW, Hayes SC, Baer RA, Carpenter KM, Guenole N, Orcutt HK, et al. Preliminary psychometric properties of the acceptance and action questionnaire-II: a revised measure of psychological inflexibility and experiential avoidance. Behav Ther. 2011;42(4):676–88.
Fledderus M, Voshaar MAHO, Ten Klooster PM, Bohlmeijer ET. Further evaluation of the psychometric properties of the acceptance and action questionnaire–II. Psychol Assess. 2012;24:925–36.
Lamers SM, Westerhof GJ, Bohlmeijer ET, ten Klooster PM, Keyes CL. Evaluating the psychometric properties of the mental health continuum-short form (MHC-SF). J Clin Psychol. 2011;67(1):99–110.
Bohlmeijer ET, Ten Klooster PM, Fledderus M, Veehof MM, Baer R. Psychometric properties of the five facet mindfulness questionnaire in depressed adults and development of a short form. Asmnt. 2011;18(3):308–20.
Kabat-Zinn J. Full catastrophe living: Using the wisdom of your body and mind to face stress, pain and illness. New York: Hyperion; 2008.
Herdman M, Gudex C, Lloyd A, Janssen MF, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20:1727–36.
Versteegh M, Vermeulen KM, Evers SMAA, De Wit GA, Prenger R, Stolk EA. Dutch tariff for the five-level version of EQ-5D. Value Health. 2016;19:343–52.
EuroQOL Group. A new facility for measurement of health-related quality of life. Health Policy. 1990;16:199–208.
Janssen MF, Birni E, Haagsma JA, Bonsel GJ. Comparing the standard EQ–5D three level system with a five level version. Value Health. 2008;11:275–84.
Pickard AS, De Leon MCBBA, Kohlmann T, Cella D, Rosenbloom S. Psychometric comparison of the standard EQ-5D to a 5 level version in Cancer patients. Med Care. 2007;45(3):259–63.
Hakkaart-van Roijen L, Van Straten A, Donker M, Tiemens B. Manual Trimbos/Imta Questionnaire for Costs Associated with Psychiatric Illness (TIC-P, in Dutch). Rotterdam: Erasmus University; 2002.
Bouwmans C, De Jong K, Timman, Zijlstra-Vlasveld M, Van der Feltz-Cornelis C, Swan Tan S, et al. Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P). BMC Health Serv Res. 2013;13:1–9.
De Brey H. A cross-national validation of the client satisfaction questionnaire: the Dutch experience. Eval Program Plann. 1983;6:395–400.
De Wilde EF, Hendriks VM. The client satisfaction questionnaire: psychometric properties in a Dutch addict population. Eur Addict Res. 2005;11(4):157–62.
Bovier PA, Chamot E, Perneger TV. Brief scales for measurement of functional social support and psychological resources in French-speaking adults. Sozial- und Praventivmedizin. 2002;47(5):298–306.
Borkovec TD, Nau SD. Credibility of analogue therapy rationales. J Behav Ther Exp Psy. 1972;3:257–60.
Addis ME, Hagtis C, Krasnow AD, Jacob K, Boume L, Mansfield A. Effectiveness of cognitive-Behavioural treatment for panic disorder versus treatment as usual in a managed care setting. J Consult Clin Psychol. 2004;72(4):625–35.
Devilly GJ, Borkovec TD. Psychometric properties of the credibility expectancy questionnaire. J Behav Ther Exp Psy. 2000;31:73–86.
Hüpscher LJ. Herstelverwachtingen van cliënten met een ambulante behandeling. Amsterdam: Department of Psychology and Pedagogy, VU University Amsterdam; 2007.
Webb TL, Miles E, Sheeran P. Dealing with feeling: a meta-analysis of the effectiveness of strategies derived from the process model of emotion regulation. Psychol Bull. 2012;138(4):775–808.
Aldao A, Nolen-Hoeksema S, Schweizer S. Emotion-regulation strategies across psychopathology: a meta-analytic review. Clin Psychol Rev. 2010;30(2):217–37.
Borkovec TD, Newman MG, Pincus AL, Lytle R. A component analysis of cognitive behavioral therapy for generalized anxiety disorder and the ro1e of interpersona1 problems. J Consult Clin Psychol. 2002;70:288–98.
Ilardi S, Craighead WE. The role of nonspecific factors in cognitive-behavioral therapy for depression. Clin Psycho: Sci Pr. 1994;1:138–56.
Lambert MJ. Implications for outcome research for psychotherapy integration. In Norcross JC, Goldstein MR. Handbook of psychotherapy integration. New York: Basic Books;1992. p. 94–129.
Lambert MJ, Bergin AE. Garfie1d SL. Bergin and Garfield's handbook of psychotherapy and behaviour change. New York: John Wiley & Sons; 2004.
Moradveisi L, Huibers MJ, Arntz A. The influence of patients’ attributions of the immediate effects of treatment of depression on long-term effectiveness of behavioural activation and antidepressant medication. Behav Res Ther. 2015;69:83–92.
Strunk DR, DeRubeis RJ, Chiu AW, Alvarez J. Patients’ competence in and performance of cognitive therapy skills: relation to the reduction of relapse risk following treatment for depression. J Consult Clin Psychol. 2007;75(4):523–30.
Johnson LD, Miller SD, Duncan BL. The session rating scale 3.0. Chicago: Author; 2000.
Campbell A, Hemsley S. Outcome rating scale and session rating scale in psychological practice: clinical utility of ultra-brief measures. Clin Psychol. 2009;13(1):1–9.
Duncan BL, Miller SD, Sparks JA, Claud DA, Reynolds LR, Brown J, et al. The session rating scale: preliminary psychometric properties of a “working” alliance measure. J Brief Therapy. 2003;3:3–12.
Campbell MK, Grimshaw JM. Cluster randomised trials: time for improvement. BMJ. 1998;317:1171–2.
Gunzler D, Chen T, Wu P, Zhang H. Introduction to mediation analysis with structural equation modeling. Shanghai Arch Psychiatry. 2013;25(6):390–4.
Montfort A, Oud JHL, Satorra A. Longitudinal research with latent variables. London: Springer; 2010.
Selig JP, Preacher KJ. Mediation models for longitudinal data in developmental research. Res Hum Dev. 2009;6:144–64.
Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated health economic evaluation reporting standards (CHEERS)- explanation and elaboration: a report of the ISPOR health economic evaluation publication guidelines good reporting practices task force. Value Health. 2013;16:231–50.
Kazdin AE. Mediators and mechanisms of change in psychotherapy research. Annu Rev Clin Psychol. 2007;3:1–27.
Marx MS, Cohen-Mansfield JC, Guralnik JM. Recruiting community-dwelling elderly at risk for physical disability into exercise research. J Aging Phys Act. 2003;11:229–41.
The proposed study is supported by ZonMw (file number 531001205).
Ethics approval and consent to participate
The study is approved by the medical ethical committee of the Leiden University Medical Center (LUMC; no. P16.248). According to the medical ethical committee, the study’s consent procedure is concordance with the Dutch legislation.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Witlox, M., Kraaij, V., Garnefski, N. et al. An Internet-based Acceptance and Commitment Therapy intervention for older adults with anxiety complaints: study protocol for a cluster randomized controlled trial. Trials 19, 502 (2018). https://doi.org/10.1186/s13063-018-2731-3
- Anxiety complaints
- Subclinical anxiety
- Older adults
- Blended care
- Acceptance and commitment therapy
- Randomized controlled trial