Skip to main content
Download PDF

Effectiveness and acceptance of a web-based depression intervention during waiting time for outpatient psychotherapy: study protocol for a randomized controlled trial

Trials volume 19, Article number: 285 (2018) Cite this article

A Correction to this article was published on 19 July 2018

This article has been updated

Abstract

Background

Due to limited resources, waiting periods for psychotherapy are often long and burdening for those in need of treatment and the health care system. In order to bridge the gap between initial contact and the beginning of psychotherapy, web-based interventions can be applied. The implementation of a web-based depression intervention during waiting periods has the potential to reduce depressive symptoms and enhance well-being in depressive individuals waiting for psychotherapy.

Methods

In a two-arm randomized controlled trial, effectiveness and acceptance of a guided web-based intervention for depressive individuals on a waitlist for psychotherapy are evaluated. Participants are recruited in several German outpatient clinics. All those contacting the outpatient clinics with the wish to enter psychotherapy receive study information and a depression screening. Those adults (age ≥ 18) with depressive symptoms above cut-off (CES-D scale > 22) and internet access are randomized to either intervention condition (treatment as usual and immediate access to the web-based intervention) or waiting control condition (treatment as usual and delayed access to the web-based intervention). At three points of assessment (baseline, post-treatment, 3-months-follow-up) depressive symptoms and secondary outcomes, such as quality of life, attitudes towards psychotherapy and web-based interventions and adverse events are assessed. Additionally, participants’ acceptance of the web-based intervention is evaluated, using measures of intervention adherence and satisfaction.

Discussion

This study investigates a relevant setting for the implementation of web-based interventions, potentially improving the provision of psychological health care. The results of this study contribute to the evaluation of innovative and resource-preserving health care models for outpatient psychological treatment.

Trial registration

This trial has been registered on 13 February 2017 in the German clinical trials register (DRKS); registration number DRKS00010282.

Peer Review reports

Background

Psychotherapy usually is a restricted resource, often associated with prolonged waiting periods for people seeking psychotherapeutic treatment. In Germany, on average, the waiting time to start psychotherapy is 4.5 months [1], with rural areas being particularly undersupplied [2]. These waiting periods are disadvantageous for people seeking help as well as the health care system. Individuals in need of mental health care experience an increased risk of chronification [3] and they are more dissatisfied with the help they receive [4]. They utilize more unspecific health care offers [5], causing high direct and indirect costs for the health care system [6]. Moreover, waiting periods contribute to people not starting psychotherapeutic treatment [7, 8] or not considering psychotherapy in the first place [9]. In order to address this issue, appropriate interventions should be offered to those unable to receive immediate psychotherapy.

One possibility to produce relief for people waiting for psychotherapy is the implementation of web-based self-help interventions. Web-based interventions have the potential to bridge treatment gaps [10, 11], as they can be applied flexibly, with comparably little time, space, and personnel resources [12, 13]. Since the late 1990s, a large body of research has emerged, confirming that web-based interventions are effective in reducing a range of psychological symptoms [14,15,16,17,18]. Particularly guided interventions offering feedback to participants have put forth promising effects [19]. Most recent research suggests that web-based interventions can be comparably effective to face-to-face psychotherapy [20]. While the efficacy of web-based interventions has been shown in various trials [21,22,23,24], the implementation of web-based interventions into health care systems worldwide is still in its infancy. One possibility to integrate web-based interventions into the health care system is their implementation during waiting periods. Offering web-based interventions to those waiting for psychotherapy may prove to be superior to mere waiting for several reasons: Individuals unable to enter psychotherapy could receive immediate access to an evidence-based intervention, therefore be provided with instant help; they could access the intervention 24 h a day, and use it in a familiar environment without time or travel costs [25]. For those in need of further treatment, interventions during waiting periods may facilitate progress in the subsequent face-to-face psychotherapy [26]. Hence, the implementation of a web-based intervention during waiting periods may prove to be particularly beneficial for both, help-seeking people and the adequate allocation of resources in our health care systems.

In order to assess the potential benefits of web-based interventions, they must be implemented in populations in need of help. One common complaint during waiting periods is depressive symptomatology [5]. With a point prevalence of about 8%, depressive symptoms are widespread in Germany [27], substantially reducing the quality of life of those affected [28, 29]. As almost half the patients in German outpatient clinics present with a depressive disorder [30, 31] and depressive symptoms often occur comorbid with other mental disorders [32], an intervention targeting the reduction of depressive symptoms is likely to be beneficial for many individuals waiting for psychotherapy.

The efficacy of web-based interventions for the reduction of depressive symptoms has been shown in several trials [22, 33]. However, there is limited evidence for their effectiveness and acceptance when implemented during waiting periods. To the best of our knowledge, three studies have examined web-based depression interventions during waiting periods [34,35,36]. Two studies reported intervention take-up rates between 26 and 53% [34, 37], high satisfaction among users [34] and large pre-post effect sizes of d = .75 [36]. The only randomized controlled trial testing a web-based depression intervention against mere waiting (treatment as usual) implemented an unguided intervention and had a number of methodological limitations, such as baseline assessment after randomization, substantial study dropout combined with missing intention-to-treat analyses and including participants without depressive symptoms [35]. At this point, no conclusions concerning the effectiveness of guided web-based depression interventions compared to treatment as usual during waiting periods can be drawn. Also, considering the results on intervention take-up and user satisfaction, findings concerning the acceptance of web-based interventions during waiting periods are quite heterogeneous and vary depending on the measure of acceptance (e.g., uptake vs. satisfaction rates) [34,35,36].

Taken together, the former studies highlight some of the challenges, such as low take-up rates [37], as well as the potentials of web-based interventions in this setting, such as high satisfaction among users [34] and possible reductions of depressive symptoms [36]. More research is needed to determine to what extent web-based interventions during waiting periods are superior to treatment as usual and which participant and intervention characteristics might impact on effectiveness and acceptance.

Aims and research questions

The study aims at evaluating the effectiveness and acceptance of a guided web-based intervention for depressive individuals on a waitlist for outpatient psychotherapy. The following research questions are addressed:

  • (Ia) Does the implementation of the web-based intervention have an effect on depressive symptoms when compared to waiting for psychotherapy without a web-based intervention? (effectiveness)

  • (Ib) Does the implementation of the web-based intervention have an effect on other psychological symptoms, quality of life, and attitudes towards face-to-face psychotherapy and towards web-based interventions? (effectiveness)

  • (II) How are intervention adherence (take-up rates, number of modules completed) and intervention satisfaction among depressive individuals waiting for face-to-face psychotherapy? (acceptance)

  • (III) Which variables influence the effectiveness and acceptance of the web-based intervention (e.g., internet affinity, former psychotherapy)?

Methods

Design

A two-arm randomized controlled trial (RCT) of parallel design is conducted in order to investigate the research questions. Participants are randomized either to the intervention group receiving immediate access to the web-based intervention, or the waiting control group receiving treatment as usual (TAU) until follow-up assessment, and subsequently access to the web-based intervention. TAU in the control condition means waiting for face-to-face psychotherapy while having access to all other services of health care (e.g., general practitioner). Assessments take place before randomization (T1), seven weeks after randomization (T2), and at 3-months follow-up (T3). Figure 1 displays the flow of participants following the SPIRIT guidelines [38]. Additional file 1 are available online. All procedures have been approved by the ethics committee of the Albert-Ludwigs-University Freiburg (approval number 404/16). The trial is registered in the German clinical trials register under DRKS00010282. We conduct and report the trial in accordance with the CONSORT 2010 Statement [39], the supplement of the CONSORT statement for pragmatic effectiveness trials [40] and the guidelines for executing and reporting internet intervention research [41].

Fig. 1
figure 1

Study flow. CES-D Center for Epidemiologic Studies Depression Scale, TAU Treatment as usual

Full size image

Recruitment

Participants are recruited at several psychotherapeutic outpatient clinics in Germany. All cooperating outpatient clinics have a current wait of at least two months before individuals enter psychotherapy. Consecutively, all those accepted onto the waitlist of an outpatient clinic are informed about the ongoing study and receive study information and screening material. All individuals on the existing waitlists with a remaining waiting time of at least two months are also invited to fill in screening material. Screeners are sent back directly to the research team. Respondents are tested for eligibility to participate in the study (cf. inclusion criteria). Eligible respondents receive an e-mail providing further study information and a link to the digital informed consent sheet. All respondents giving their informed consent are enrolled in the online baseline assessment (T1) and then randomized either to the intervention group (IG) or the control group (CG). Participants of the IG are provided with a link to access the web-based intervention. Participants of the CG are given the opportunity to access the web-based intervention without guidance after follow-up assessment. Recruitment has started in February 2017 and is ongoing until both treatment arms have reached a size of n = 68. All procedures were specified prior to recruitment start and are conducted as explicated in the clinical registration form (DRKS00010282).

Inclusion and exclusion criteria

Individuals waiting for psychotherapy in one of the cooperating outpatient clinics and interested in study participation are eligible when they indicate (1) an age of 18 years and over, (2) working internet access, and (3) depressive symptoms (CES-D score > 22; Center for Epidemiologic Studies Depression Scale [42]). Exclusion criteria are reduced to a minimum. This procedure allows for high external validity as it leads to a heterogeneous sample of people seeking outpatient psychotherapy independent of a particular diagnosis. It allows individuals with other primary diagnoses (e.g. anxiety disorder) to participate in the study, as long as they show substantial depressive symptoms. Comorbid psychological symptoms are detected with the Brief Symptom Inventory (BSI; [43]). As additional criterion, participants must (4) submit their informed consent, (5) complete baseline assessments and (6) state no suicidal ideation on the BSI item no. 9 (score < 2). In case of a BSI item score of 1, participants must agree to a non-suicide-contract before entering the study. In case of suicidal ideation throughout the study, we follow a firm suicide protocol, which has been approved by the ethics committee. Potential steps in case of suicidal ideation include information on further help, non-suicide contracts, and telephone calls by a licensed psychotherapist.

Randomization and blinding

An independent researcher of the Methodological Support Centre of the Rehabilitation Research Network Freiburg, who is not elsewhere involved in the study, prepared randomization and allocation of participants in advance. As a means of randomization, an automated computer-based system is implemented (https://www.sealedenvelope.com/) using permuted block randomization with variable block sizes of 4, 6, and 8 (randomly arranged), in a ratio of 1:1. Randomization is stratified by outpatient clinic. The means for blinding in this study are limited. Still, data analysts will be blinded by creating syntaxes before adding the treatment condition variable to the data set.

Proposed sample size

The sample size calculation is based on the difference in change in the primary outcome (depressive symptoms) from pre- to post-treatment in both treatment arms (intention-to-treat analysis). Considering recent meta-analytic effect sizes for web-based depression interventions, an effect size of d = 0.56 [33] can be expected and is considered feasible for the type of intervention (guided intervention, naturalistic study design, cf. [44]). On the basis of a two-sample t-test at a two-sided significance level of .05, the study is planned to detect this effect with 90% power. This requires a sample of 68 individuals in each arm.

With a target sample size of N = 136 for randomization, at least 597 screeners have to be sent out. Based on previous research, it is expected that about 50% of the contacted people are interested in study participation [37]. Further, about 65% of those interested are expected to score above the cut-off for depressive symptoms [45], resulting in 194 potential participants. A 30% loss is expected due to incomplete baseline, suicidal ideation or missing informed consent, leaving 136 participants for randomization.

Intervention condition

The intervention in use (GET.ON Mood Enhancer) 46 consists of six consecutive modules, each about 30 min in length, and homework assignments. Participants are recommended to work on one or two modules per week. Adaptations of the intervention have proven effective in reducing depressive symptoms in varying samples [46,47,48,49,50,51]. The intervention has been slightly modified to suit the purpose of this setting (wording of the introduction, example participants, explanation of further treatment options, and text message support).

The intervention is based on behavioral activation [52] and problem-solving therapy [53]. The core elements of the intervention are (1) psycho-education, (2) behavioral activation, (3) systematic problem solving, and (4) optional lections on sleep, rumination, and relaxation. Additionally, participants receive access to an electronic mood diary. Participants receive a semi-standardized feedback after each completed module by an e-coach (trained psychologist) in order to enhance adherence. Feedback includes positive reinforcement of the participants’ assignments and encouragement to continue working with the intervention. E-coaches are not otherwise involved in the study. Additionally, participants can chose to activate text message support (42 text messages, one per day). The text messages are standardized and remind the participants of their weekly assignments and repeat specific lessons. Text message prompts and guidance have been shown to be very beneficial for the efficacy and adherence to web-based interventions [33, 54, 55]. Participants also receive standardized e-mails reminding them of unfinished tasks. Participants can access the intervention at any time and from all web-enabled devices. Each module closes with a short questionnaire, assessing subjective usefulness of the module, the location and time spent working on the module, and the level of concentration.

Participants’ access to TAU (e.g., visits to other medical practitioners) is not restricted. A detailed description of TAU is obtained at post-treatment. Any contact between the research team and study participants (e.g., online assessments, e-mail reminders) is standardized for all study participants (IG and CG) and reduced to a minimum.

Control condition

Participants of the waiting control group are informed that they can access the web-based intervention after follow-up assessments. Again, access to TAU until follow-up assessment is not restricted. As for the intervention group, a detailed description of TAU is obtained at post-treatment.

Outcome measures

Table 1 gives an overview of assessments at screening, baseline, post-treatment and follow-up.

Table 1 Overview of measurements
Full size table

Effectiveness measures

Primary outcome

Depressive symptoms

Depressive symptoms are assessed using the Center for Epidemiologic Studies Depression Scale (CES-D; German version [42]). The CES-D consists of 20 items measuring the global level of depressive severity within the last week on a 4-point Likert scale. The total score ranges from 0 to 60, with higher scores indicating more severe depressive symptoms. Its internal consistency of α = .92 in clinical samples is very good [42].

Secondary outcomes

Depressive symptoms

The Patient Health Questionnaire (PHQ-9; [56]) allows a categorical classification of depression severity, distinguishing between moderate, moderately severe and severe major depression. It consists of nine items and assesses depressive symptoms of the past two weeks. Its internal consistency reaches values of α = .88 [57].

Health related quality of life

To assess health related quality of life, the SF-12 Health Survey [58] is used. The instrument provides two subscales, measuring physical and mental quality of life components. It consists of 12 items, rated on scales between two and five points. Reliability and validity of the SF-12 have been well documented (α = .77; [58]).

Psychological symptoms

The Brief Symptom Inventory (BSI; [43]) is applied to measure psychological symptoms of the past week. Its 53 items are rated on a 5-point Likert scale and cover symptoms of somatization, obsessive compulsion, interpersonal sensitivity, depression, anxiety, hostility, phobic anxiety, paranoid ideation and psychoticism. The Global Severity Index (GSI) reflects the respondents’ overall level of psychological distress. Validity and reliability of the BSI are well-established (α = .91; [43]). Additionally, item number 9 of the BSI serves as an indicator for suicidal ideation.

Attitudes towards psychotherapy

Participants’ attitudes towards face-to-face psychotherapy are measured by the Attitude Towards Seeking Professional Psychological Help Scale - Short Form (ATSPPH-SF; [59]). This instrument consists of 10 items that are rated on a 4-point Likert scale. The psychometric properties of the questionnaire are good (α = .78; [60]).

Attitudes towards web-based interventions

An adapted version of the Attitude Towards Seeking Professional Psychological Help Scale - Short Form (ATSPPH-SF; [59]) is applied to assess the attitude towards web-based interventions. Compared to the original version of the ATSPPH-SF, solely the term “psychotherapy” is replaced by the term “online training” in each item. The number of items remains unchanged.

Adverse events

The Inventory for the Assessment of Negative Effects of Psychotherapy (INEP; [61]) consists of 21 items dealing with potential side effects of psychotherapy. In accordance with previous studies [62,63,64,65], the instrument is adapted for the particular setting of web-based interventions, resulting in the deletion of 6 face-to-face specific items. The remaining 15 items are scored on a 4-point Likert scale. The reliability of this instrument is good (α = .86; [61]).

Acceptance measures

Intervention adherence

The adherence to the intervention in use is depicted by the take-up rate at the level of recruitment and the number of modules completed. Additionally, the intervention dropout relates to the number of intervention completers (≥ 5 modules; [46]) and non-completers in the IG. For a better understanding of intervention dropouts, all non-completers are asked to indicate reasons for their non-completion.

Intervention satisfaction

The Client Satisfaction Questionnaire (CSQ-8; [66]) measures client satisfaction with health care services. Following Boss and colleagues [67], we use an adapted version for the evaluation of satisfaction with web-based interventions for IG-participants at post-treatment. The scale consists of eight items, rated on a 4-point Likert scale. The adapted scale has been validated, indicating high reliability and construct validity [67]. In addition to intervention satisfaction, one item assesses technical difficulties dealing with the intervention. This item will be evaluated separately.

Motivation to use a web-based intervention

In order to gain an understanding of how interested respondents differ from non-interested respondents at the level of recruitment, the screening questionnaire includes five items dealing with respondents’ motivation to try a web-based interventions. Three items assess respondents’ anticipated usefulness of a web-based intervention, one item assesses their willingness to try a web-based intervention, and one item assesses respondents’ computer skills with regards to the application of a web-based intervention. All items are rated on a 4-point Likert scale.

Sample characteristics

Demographic variables

Socio-demographic variables are assessed at baseline, based on the recommendations of Deck and Röckelein [68]. These variables include age, gender, family status, education, employment, diseases, and former psychotherapy.

Internet affinity

Internet affinity is measured using the Internet Affinity Scale (IAS; [69]). The IAS measures internet affinity and frequency of internet usage with six items to be rated on a 5-point Likert scale. The scale’s reliability is good (α = .84; [69]). One additional item assesses computer-related competencies and will be evaluated separately.

Health care utilization

For the assessment of utilized health care services, the Questionnaire for Health-Related Resource Use in an Elderly Population (FIMA; [70]) is applied in an adapted version; items dealing with seniority-specific aspects, such as the usage of nursing services or domestic help, are left out. The remaining ten items assess the number of utilized health care services of the past eight weeks, as well as the current intake of medication. One additional item assesses the use of additional psychological health care options, such as bibliotherapy and self-help groups.

Current Psychotherapy

At all points of assessment participants indicate their current motivation and their perceived need for psychotherapy, and whether they are currently receiving face-to-face psychotherapy. Participants indicating their current receipt of psychotherapy are asked how many sessions they have had and when their first appointment has been. Participants not receiving face-to-face psychotherapy are asked to indicate reasons.

Statistical analyses

Effectiveness analyses

Analyses will be based on an intention-to-treat principle by including all randomized participants into the analyses. Primary and secondary outcomes will be analysed using a linear mixed model, assuming data are missing at random. The mixed model for the primary outcome (depression) will include group, time (all three points of assessment) and the interaction of group and time as fixed effects and recruiting outpatient clinic as random effect. Secondary outcomes will be analysed accordingly. We will calculate between-group effect sizes for the primary outcome using the post-treatment depression means and their pooled observed standard deviation. Additional per protocol analyses will include only those participants who have not started psychotherapy until the end of all study procedures, completing all three assessments, and, regarding the intervention group, at least five intervention modules.

We will evaluate the clinical relevance of any given development in a generalized linear model by estimating numbers of treatment response and deterioration (based on the reliable change index; [71]) and symptom remission (ADS-L score < 22; [41]), and by calculating the number needed to treat (NNT) for one more remitted participant.

Potential moderators influencing treatment effects will be analysed in the mixed model analysis. As there is at this point little research concerning moderating variables in the field [72], these analyses follow an exploratory approach. Potential influencing variables include socio-demographics, internet affinity or attitudes towards psychotherapy.

Analyses will be performed using an alpha level of .05 and two-sided tests. All analyses will be conducted using IBM SPSS.

Acceptance analyses

Intervention adherence will be calculated by assessing the response rate of returned screeners with interest in study participation and the number of modules completed by intervention group participants. Recruitment and dropout rates will be examined using absolute and percentage frequencies. Participants’ satisfaction with the intervention (T2) will be reported descriptively. Potential predictors influencing intervention adherence and intervention satisfaction (e.g., age, depressive symptoms, internet affinity, former psychotherapy) will be assessed in an exploratory multiple regression analysis.

Discussion

This study investigates the effectiveness and acceptance of a guided web-based intervention for individuals with depressive symptoms seeking psychotherapy. Participants are individuals with elevated depressive symptoms on a waitlist for psychotherapy at several psychotherapeutic outpatient clinics, who consent to applying an intervention for mood improvement. A randomized controlled trial is conducted, comparing an intervention group receiving immediate access to a web-based intervention to a waiting control group. We expect the intervention group to benefit from the web-based intervention with regard to depressive symptoms, psychological symptoms and quality of life at post intervention and 3-months follow up. In an exploratory approach, the acceptance of the web-based intervention during waiting periods will be assessed, taking various sources of information into account (e.g., take-up and dropout rates).

This study features a number of strengths. While a series of trials have highlighted the efficacy of web-based depression interventions [22], more research on their effectiveness in practical settings is needed [73]. This study focuses on the applicability of a web-based intervention in a setting where low-intensity interventions are scarce and urgently needed. At the same time the waiting period differs from other investigated settings, as participants are distinctly seeking face-to-face psychotherapy. Thus, participants might perceive the web-based intervention as less credible, thinking that the “real treatment” is yet to come, potentially reducing the effectiveness of the intervention in this setting [74, 75]. The study is based on a solid methodology, applying a randomized controlled trial with three times of assessment. The pragmatic study design allows high external validity. As inclusion and exclusion criteria are reduced to a minimum, the investigated sample consists of individuals with depressive symptoms seeking outpatient psychotherapy. In line with current standards, analyses will be based on an intention-to-treat principle and performed using linear mixed-model analyses.

This study also has a few limitations which deserve note. As the study will be conducted in the context of routine mental health care, the waiting periods of participants will vary depending on the capacities of the cooperating outpatient clinics. Some participants will presumably start psychotherapy between post- and follow-up assessments. However, due to the limited time span between post and follow-up assessments, the take-up of a subsequent psychotherapy cannot be reliably assessed. Per protocol analyses will be conducted including only those participants who have not started psychotherapy until the completion of follow-up assessments. Due to the routine care setting and in favor of external validity, we include participants who may suffer from other primary psychological symptoms (e.g. anxiety). These participants might benefit more from other disorder-specific interventions. Nonetheless, trials have implemented web-based depression interventions in routine care settings with high external validity and put forth large effect sizes (e.g. [36, 37]). Similar effects are expected in this study as all participants suffer from depressive symptoms and take an informed choice to partake in an intervention for mood improvement.

When it comes to web-based interventions, considerable dropout rates have been reported [76]. The participants dropping out of the intervention will be asked for their reasons to do so, thus dropouts will be used for a deeper understanding of intervention acceptance and applicability. In an attempt to minimize intervention dropouts, we implement a web-based intervention with guidance [19]. Additionally, per protocol analysis will be performed for a high quality data analysis. Another limitation is that the main outcome data is based on self-reports. This is a frequently conducted approach with a favorable study cost–validity balance, still clinician-rated outcome measures would be beneficial. We have selected measures with high internal consistency and validity. In line with other research in the field (e.g., [63, 77]), retest-reliabilities are not reported as studies vary greatly in terms of evaluation times and sample characteristics, which makes retest-reliabilities difficult to interpret in the context of this study design. Also, due to related effort, no analyses of cost-effectiveness are performed in this study. Last, the recruitment of participants has started in February 2017; however, the study has been registered before the beginning of recruitment and no changes have been made to the registry.

The results of this study will be of great relevance for daily clinical practice, as they reflect the applicability of an evidence-based self-help treatment option for individuals seeking psychotherapeutic treatment. Addressing the problem of prolonged waiting periods, it is essential to investigate which treatment options are effective and accepted by those in need. Evidence-based interventions with minimal effort for outpatient clinics are scarce and urgently needed. Thus, implementing a web-based intervention in this setting may be beneficial for those on a waitlist and health care providers. Also, this study investigates a model to viably integrate web-based interventions into the health care system. Considering the growing interest and realization of new treatment approaches, such as stepped-care models [78, 79], web-based interventions have the potential to play an important role as low-intensity interventions in the treatment of depression [80]. As Kazdin and Blase [81] emphasize, innovative treatment approaches are needed to decrease the burden of mental diseases on a large scale.

Trial Status

This is the first protocol version. Recruitment has started in February 2017 and will presumably be completed in summer 2018.

Change history

  • 19 July 2018

    Following publication of the original article [1], the author reported the errors in the figure and in text reference in the published article. These errors are detailed below. The original article has been corrected.

Abbreviations

ATSPPH-SF :

Attitude Towards Seeking Professional Psychological Help Scale-Short

BSI :

Brief Symptom Inventory

CES-D :

Center for Epidemiologic Studies Depression Scale

CG :

Control group

CSQ :

Client Satisfaction Questionnaire

FIMA :

Questionnaire for Health-Related Resource Use in an Elderly Population

GSI :

Global Severity Index

IAS :

Internet Affinity Scale

IG :

Intervention group

INEP :

Inventory for the Assessment of Negative Effects of Psychotherapy

PHQ :

Patient Health Questionnaire

RCT :

Randomized controlled trial

TAU :

Treatment as usual

References

  1. Bundespsychotherapeutenkammer (BPtK). BPtK-Studie zu Wartezeiten in der ambulanten psychotherapeutischen Versorgung [Waiting times in outpatient psychotherapeutic care]. BPtK. 2011. http://www.bptk.de/publikationen/bptk-studie.html. Accessed 2 Oct 2017.

  2. Apolinário-Hagen J, Tasseit S. Chancen und Risiken der Internettherapie für die Regelversorgung in Deutschland. Ein Beitrag zur Psychotherapie im Zeitalter von Web 2.0 [Risks and potential of online therapy for German routine health care. Psychotherapy in the age of web 2.0]. Fachzeitschrift für Onlineberatung und computervermittelte Kommunikation. 2015;11:69–86.

    Google Scholar 

  3. Huckert TF, Hank P, Krampen G. Veränderungen in der Symptombelastung während der Wartezeit auf einen ambulanten Psychotherapieplatz [Changes in psychopathological symptoms during the waiting period for outpatient psychotherapy]. Psychother Psych Med. 2012;62:301–9.

    Article  Google Scholar 

  4. Siponen U, Välimäki M. Patients’ satisfaction with outpatient psychiatric care. J Psychiatr Ment Health. 2003;10:129–35.

    Article  CAS  Google Scholar 

  5. Helbig S, Hoyer J. Hilft wenig viel? Eine Minimalintervention für Patienten während der Wartezeit auf ambulante Verhaltenstherapie [A minimal intervention for patients waiting for outpatient behavioral therapy]. Verhaltenstherapie. 2007;17:109–15.

    Article  Google Scholar 

  6. Jacobi F, Wittchen H-U. «Diagnoseträger» und Patienten: Zur Epidemiologie behandelter und unbehandelter psychischer Störungen in Deutschland [The epidemiology of treated and untreated psychiatric diseases in Germany]. Psychotherapeut. 2004;3:17–22.

    Google Scholar 

  7. Hicks C, Hickman G. The impact of waiting-list times on client attendance for relationship counselling. Brit J Guid Couns. 1994;22:175–82.

    Article  Google Scholar 

  8. Loumidis KS, Shropshire JM. Effects of waiting time on appointment attendance with clinical psychologists and length of treatment. Ir J Psychol Med. 1997;14:49–54.

    Article  Google Scholar 

  9. Hoyer J, Helbig S, Wittchen H-U. Experiences with psychotherapy for depression in routine care: a naturalistic patient survey in Germany. Clin Psychol Psychother. 2006;13:414–21.

    Article  Google Scholar 

  10. Musiat P, Goldstone P, Tarrier N. Understanding the acceptability of e-mental health - attitudes and expectations towards computerised self-help treatments for mental health problems. BMC Psychiatry. 2014;14:CD005330.

    Article  Google Scholar 

  11. Muñoz RF. Using evidence-based Internet interventions to reduce health disparities worldwide. J Med Internet Res. 2010;12:e60.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Eells TD, Barrett MS, Wright JH, Thase M. Computer-assisted cognitive-behavior therapy for depression. Psychotherapy. 2014;51:191–7.

    Article  PubMed  Google Scholar 

  13. Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res. 2006;8:e10.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Andersson G, Ljotsson B, Weise C. Internet-delivered treatment to promote health. Curr Opin Psychiatr. 2011;24:168–72.

    Google Scholar 

  15. Baumeister H, Lin J, Ebert D. Internetbasierte Gesundheitsinterventionen [Web-based health care interventions]. In: Koch U, Bengel J, editors. Enzyklopädie der Psychologie: Medizinische Psychologie (Band 2) - Anwendungen der Medizinischen Psychologie. Göttingen: Hogrefe; 2017. p. 231–58.

    Google Scholar 

  16. Lin J, Ebert D, Lehr D, Berking M, Baumeister H. Internetbasierte kognitiv-behaviorale Behandlungsansätze: State of the Art und Einsatzmöglichkeiten in der Rehabilitation [Internet based cognitive behavioral interventions: State of the art and implementation possibilities in rehabilitation]. Rehabilitation. 2013;52:155–63.

    Article  PubMed  CAS  Google Scholar 

  17. Ebert DD, Zarski A-C, Christensen H, et al. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: A meta-analysis of randomized controlled outcome trials. PLoS One. 2015;10:e0119895.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  18. Sander L, Rausch L, Baumeister H. Effectiveness of Internet-based interventions for the prevention of mental disorders: A systematic review and meta-analysis. JMIR Ment Health. 2016;3:e38.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on Internet-based mental health interventions — A systematic review. Internet Interv. 2014;1:205–15.

    Article  Google Scholar 

  20. Andersson G, Topooco N, Havik O, Nordgreen T. Internet-supported versus face-to-face cognitive behavior therapy for depression. Expert Rev Neurother. 2016;16:55–60.

    Article  PubMed  CAS  Google Scholar 

  21. Buhrman M, Syk M, Burvall O, Hartig T, Gordh T, Andersson G. Individualized guided Internet-delivered Cognitive-Behavior Therapy for chronic pain patients with comorbid depression and anxiety: A randomized controlled trial. Clin J Pain. 2015;31:504–16.

    Article  PubMed  Google Scholar 

  22. Königbauer J, Letsch J, Doebler P, Ebert D, Baumeister H. Internet- and mobile-based depression interventions for people with diagnosed depression: A systematic review and meta-analysis. J Affect Disorders. 2017;223:28–40.

    Article  Google Scholar 

  23. Kok RN, van Straten A, Beekman ATF, Cuijpers P. Short-term effectiveness of web-based guided self-help for phobic outpatients: randomized controlled trial. J Med Internet Res. 2014;16:e226.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Karyotaki E, Riper H, Twisk J, et al. Efficacy of self-guided Internet-based Cognitive Behavioral Therapy in the treatment of depressive symptoms: A meta-analysis of individual participant data. JAMA Psychiat. 2017;74:351–9.

    Article  Google Scholar 

  25. Reins JA, Ebert DD, Lehr D, Riper H, Cuijpers P, Berking M. Internet-based treatment of major depression for patients on a waiting list for inpatient psychotherapy: protocol for a multi-centre randomised controlled trial. BMC Psychiatry. 2013;13:318–26.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Helbig S, Hähnel A, Weigel B, Hoyer J. Wartezeit für Psychotherapiepatienten – und wie sie zu nutzen ist [Waiting times for psychotherapy and how to make the most of it]. Verhaltenstherapie. 2004;14:294–302.

    Article  Google Scholar 

  27. Maske UE, Buttery AK, Beesdo-Baum K, Riedel-Heller S, Hapke U, Busch MA. Prevalence and correlates of DSM-IV-TR major depressive disorder, self-reported diagnosed depression and current depressive symptoms among adults in Germany. J Affect Disorders. 2016;190:167–77.

    Article  PubMed  Google Scholar 

  28. Faller H, Brähler E, Härter M, et al. Performance status and depressive symptoms as predictors of quality of life in cancer patients. A structural equation modeling analysis. Psycho-Oncol. 2015;24:1456–62.

    Article  Google Scholar 

  29. Rubio JM, Olfson M, Perez-Fuentes G, Garcia-Toro M, Wang S, Blanco C. Effect of first episode axis I disorders on quality of life. J Nerv Ment Dis. 2014;202:271–4.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Gallas C, Kächele H, Kraft S, Kordy H, Puschner B. Inanspruchnahme, Verlauf und Ergebnis ambulanter Psychotherapie [Uptake, process and outcomes of outpatient psychotherapy]. Psychotherapeut. 2008;53:414–23.

    Article  Google Scholar 

  31. Huprich S, Rosen A, Kiss A. Manifestations of interpersonal dependency and depressive subtypes in outpatient psychotherapy patients. Personal Ment Health. 2013;7:223–32.

    Article  PubMed  Google Scholar 

  32. Pini S, Perkonnig A, Tansella M, Wittchen H-U. Prevalence and 12-month outcome of threshold and subthreshold mental disorders in primary care. J Affect Disorders. 1999;56:37–48.

    Article  PubMed  CAS  Google Scholar 

  33. Richards D, Richardson T. Computer-based psychological treatments for depression: A systematic review and meta-analysis. Clin Psychol Rev. 2012;32:329–42.

    Article  PubMed  Google Scholar 

  34. Whitfield G, Hinshelwood R, Pashely A, Campsie L, Williams C. The impact of a novel computerized CBT CD Rom (Overcoming Depression) offered to patients referred to clinical psychology. Behav Cognit Psychother. 2006;34:1–11.

    Article  Google Scholar 

  35. Twomey C, O'Reilly G, Byrne M, et al. A randomized controlled trial of the computerized CBT programme, MoodGYM, for public mental health service users waiting for interventions. Br J Clin Psychol. 2014;53:433–50.

    Article  PubMed  Google Scholar 

  36. Kenter RMF, Cuijpers P, Beekman A, van Straten A. Effectiveness of a web-based guided self-help intervention for outpatients with a depressive disorder: Short-term results from a randomized controlled trial. J Med Internet Res. 2016;18:e80.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Kenter R, Warmerdam L, Brouwer-Dudokdewit C, Cuijpers P, van Straten A. Guided online treatment in routine mental health care: An observational study on uptake, drop-out and effects. BMC Psychiatry. 2013;13:43.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Chan A-W, Tetzlaff JM, Altman DG, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158:200–7.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: Updated guidelines for reporting parallel group randomised trials. BMJ Brit Med J. 2010;340:698–702.

    Article  Google Scholar 

  40. Zwarenstein M, Treweek S, Gagnier JJ, et al. Improving the reporting of pragmatic trials: An extension of the CONSORT statement. BMJ Brit Med J. 2008;337:a2390.

    Article  PubMed  Google Scholar 

  41. Proudfoot J, Klein B, Barak A, Carlbring P. Establishing guidelines for executing and reporting internet intervention research. Cogn Behav Ther. 2011;40:82–97.

    Article  PubMed  Google Scholar 

  42. Hautzinger M, Bailer M, Hofmeister D, Keller F. Allgemeine Depressionsskala (ADS) [The Center for Epidemiologic Studies Depression Scale (CES-D)]. 2nd ed. Göttingen: Hogrefe; 2012.

    Google Scholar 

  43. Franke GH. Brief Symptom Inventory von L.R. Derogatis (Kurzform der SCL-90-R) - Deutsche Version. Beltz: Göttingen; 2000.

    Google Scholar 

  44. Gellatly J, Bower P, Hennessy S, Richards D, Gilbody S, Lovell K. What makes self-help interventions effective in the management of depressive symptoms? Meta-analysis and meta-regression. Psychol Med. 2007;37:1217–28.

    Article  PubMed  Google Scholar 

  45. Krämer LV, Helmes AW, Seelig H, Fuchs R, Bengel J. Correlates of reduced exercise behaviour in depression: The role of motivational and volitional deficits. Psychol Health. 2014;29:1206–25.

    Article  PubMed  Google Scholar 

  46. Buntrock C, Ebert D, Lehr D, et al. Effectiveness of a web-based cognitive behavioural intervention for subthreshold depression: Pragmatic randomised controlled trial. Psychother Psychosom. 2015;84:348–58.

    Article  PubMed  Google Scholar 

  47. Ebert D, Lehr D, Boß L, et al. Efficacy of an internet-based problem-solving training for teachers: Results of a randomized controlled trial. Scand J Work Environ Health. 2014;40:582–96.

    Article  PubMed  Google Scholar 

  48. Nobis S, Lehr D, Ebert D, et al. Efficacy of a web-based intervention with mobile phone support in treating depressive symptoms in adults with type 1 and type 2 diabetes: A randomized controlled trial. Diabetes Care. 2015;38:776–83.

    Article  PubMed  Google Scholar 

  49. Ebert DD, Nobis S, Lehr D, et al. The 6-month effectiveness of Internet-based guided self-help for depression in adults with Type 1 and 2 diabetes mellitus. Diabet Med. 2017;34:99–107.

    Article  PubMed  CAS  Google Scholar 

  50. Ebert DD, Buntrock C, Lehr D, et al. Effectiveness of web- and mobile-based treatment of subthreshold depression with adherence-focused guidance: A single-blind randomized controlled trial. Behav Ther. 2018;49(1):71–83.

    Article  PubMed  Google Scholar 

  51. Buntrock C, Ebert DD, Lehr D, et al. Effect of a web-based guided self-help intervention for prevention of major depression in adults with subthreshold depression: A randomized clinical trial. JAMA. 2016;315:1854–63.

    Article  PubMed  CAS  Google Scholar 

  52. Lewinsohn PM. A behavioral approach to depression. In: Friedman J, Katz MM, editors. The psychology of depression: Contemporary theory and research. New York: Wiley; 1974. p. 157–85.

    Google Scholar 

  53. D'Zurilla TJ, Nezu AM. Social problem solving in adults. In: Kendall PC, editor. Advances in cognitive-behavioral research and therapy. London: Academic Press; 1986. p. 201–74.

    Google Scholar 

  54. Wyer RS, editor. Perspectives on behavioral self-regulation. Mahwah: Lawrence Erlbaum Associates; 1999.

    Google Scholar 

  55. Titov N. Internet-delivered psychotherapy for depression in adults. Curr Opin Psychiatr. 2011;24:18–23.

    Article  Google Scholar 

  56. Kroenke K, Spitzer RL. The PHQ-9: A New Depression Diagnostic and Severity Measure. Psychiat Ann. 2002;32:509–15.

    Article  Google Scholar 

  57. Löwe B, Spitzer RL, Gräfe K, et al. Comparative validity of three screening questionnaires for DSM-IV depressive disorders and physicians? J Affect Disorders. 2004;78:131–40.

    Article  PubMed  Google Scholar 

  58. Ware JE, Kosinki M, Keller SD. A 12-Item Short-Form Health Survey. Med Care. 1996;34:220–33.

    Article  PubMed  Google Scholar 

  59. Fischer EH, Farina A. Attitudes toward seeking professional psychological help: A shortened form and considerations for research. J Coll Student Dev. 1995;36:368–73.

    Google Scholar 

  60. Elhai JD, Schweinle W, Anderson SM. Reliability and validity of the Attitudes Toward Seeking Professional Psychological Help Scale-Short Form. Psychiat Res-Neuroim. 2008;159:320–9.

    Article  Google Scholar 

  61. Ladwig I, Rief W, Nestoriuc Y. Welche Risiken und Nebenwirkungen hat Psychotherapie? Entwicklung des Inventars zur Erfassung Negativer Effekte von Psychotherapie (INEP) [What are the risks and side effects to psychotherapy? –Development of an inventory for the assessment of negative effects of psychotherapy (INEP)]. Verhaltenstherapie. 2014;24:252–63.

    Article  Google Scholar 

  62. Nobis S, Lehr D, Ebert D, et al. Efficacy and cost-effectiveness of a web-based intervention with mobile phone support to treat depressive symptoms in adults with diabetes mellitus type 1 and type 2: Design of a randomised controlled trial. BMC Psychiatry. 2013;13:306.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Thiart H, Lehr D, Ebert DD, Sieland B, Berking M, Riper H. Log in and breathe out: efficacy and cost-effectiveness of an online sleep training for teachers affected by work-related strain - study protocol for a randomized controlled trial. Trials. 2013;14:169.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Heber E, Ebert DD, Lehr D, Nobis S, Berking M, Riper H. Efficacy and cost-effectiveness of a web-based and mobile stress-management intervention for employees: design of a randomized controlled trial. BMC Public Health. 2013;13:655.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Ebert DD, Lehr D, Smit F, et al. Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial. BMC Public Health. 2014;14:807.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Nguyen TD, Attkisson CC, Stegner BL. Assessment of patient satisfaction: Development and refinement of a service evaluation questionnaire. Eval Program Plann. 1983;6:299–313.

    Article  PubMed  CAS  Google Scholar 

  67. Boss L, Lehr D, Reis D, et al. Reliability and validity of assessing user satisfaction with web-based health interventions. J Med Internet Res. 2016;18:1–13.

    Article  Google Scholar 

  68. Deck R, Röckelein E. Zur Erhebung soziodemographischer und sozialmedizinischer Indikatoren in den rehabilitationswissenschaftlichen Forschungsverbünden [Assessing socio-demographic and medical indicators in rehabilitation research]. In: Rentenversicherungsträger VD, editor. Förderschwerpunkt “Rehabilitationswissenschaften” - Empfehlungen der Arbeitsgruppen “Generische Methoden”, “Routinedaten” und “Reha-Ökonomie”. Frankfurt am Main: WDV Wirtschaftsdienst; 1999. p. 84–102.

    Google Scholar 

  69. Papacharissi Z, Rubin AM. Predictors of internet use. J Broadcast Electron. 2000;44:175–96.

    Article  Google Scholar 

  70. Seidl H, Bowles D, Bock J-O, et al. FIMA – Fragebogen zur Erhebung von Gesundheitsleistungen im Alter: Entwicklung und Pilotstudie [FIMA – Questionnaire for Health-Related Resource Use in an Elderly Population: Development and pilot study]. Das Gesundheitswesen. 2015;77:46–52.

    PubMed  CAS  Google Scholar 

  71. Jacobson NS, Truax P. A statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psych. 1991;1:12–9.

    Article  Google Scholar 

  72. Junge MN, Lehr D, Bockting C, et al. For whom are internet-based occupational mental health interventions effective? Moderators of internet-based problem-solving training outcome. Internet Interv. 2015;2:39–47.

    Article  Google Scholar 

  73. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: A meta-analysis. PLoS One. 2010;5:1–6.

    Google Scholar 

  74. Swift JK, Callahan JL. The impact of client treatment preferences on outcome: a meta-analysis. J Clin Psychol. 2009;65:368–81.

    Article  PubMed  Google Scholar 

  75. Bennett-Levy J, Richards DA, Farrand P. Low intensity CBT interventions: a revolution in mental health care. In: Bennett-Levy J, Richards DA, Farrand P, Christensen H, editors. Low intensity CBT interventions. Oxford: Oxford University Press; 2010. p. 3–18.

    Google Scholar 

  76. Spek V, Cuijpers P, Nyklícek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. 2007;37:319–28.

    Article  PubMed  Google Scholar 

  77. Buntrock C, Ebert D, Lehr D, et al. Evaluating the efficacy and cost-effectiveness of web-based indicated prevention of major depression: Design of a randomised controlled trial. BMC Psychiatry. 2014;14:25.

    Article  PubMed  PubMed Central  Google Scholar 

  78. Firth N, Barkham M, Kellett S. The clinical effectiveness of stepped care systems for depression in working age adults: a systematic review. J Affect Disorders. 2015;170:119–30.

    Article  PubMed  Google Scholar 

  79. Bower P, Gilbody S. Stepped care in psychological therapies: Access, effectiveness and efficiency: Narrative literature review. Br J Psychiatry. 2005;186:11–7.

    Article  PubMed  Google Scholar 

  80. Baumeister H. Inappropriate prescriptions of antidepressant drugs in patients with subthreshold to mild depression: time for the evidence to become practice. J Affect Disorders. 2012;139:240–3.

    Article  PubMed  Google Scholar 

  81. Kazdin AE, Blase SL. Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspect Psychol Sci. 2011;1:21–37.

    Article  Google Scholar 

Download references

Acknowledgements

The authors express special thanks to the „Open Access Publishing“-program at the University of Freiburg, which funded the article processing charge. Furthermore, we thank the cooperating outpatient clinics in advance for the recruitment of participants and the Methodological Support Centre of the Rehabilitation Research Network Freiburg for their methodological services.

Funding

This study is funded by the Young Researchers Academy “Health Services Research” Baden-Württemberg (Nachwuchsakademie Versorgungsforschung Baden-Württemberg) and the Cooperative Doctoral Study Course “Health Services Research: Collaborative Care” (Kooperatives Promotionskolleg Versorgungsforschung Collaborative Care), which in turn are brought forward by the Ministry of Science, Research and the Arts Baden-Württemberg.

Author information

Authors and Affiliations

  1. Department of Rehabilitation Psychology and Psychotherapy, Institute of Psychology, Albert-Ludwigs-University Freiburg, Engelbergerstr. 41, 79085, Freiburg, Germany

    Sasha-Denise Grünzig, Jürgen Bengel & Lena Krämer

  2. Department of Clinical Psychology and Psychotherapy, University of Ulm, Albert-Einstein-Allee 47, 89081, Ulm, Germany

    Harald Baumeister

  3. Department of Clinical Psychology and Psychotherapy, Institute of Psychology, Friedrich-Alexander University Erlangen-Nürnberg, Nägelsbachstr. 25a, 91052, Erlangen, Germany

    David Ebert

Authors
  1. Sasha-Denise Grünzig
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Harald Baumeister
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jürgen Bengel
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. David Ebert
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lena Krämer
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the design of this study. LK is initiator and supervisor of the study. SG is responsible for recruitment and data acquisition, she wrote the draft of this manuscript. HB, JB, DE and LK revised the draft of this manuscript, read and approved the final manuscript.

Corresponding author

Correspondence to Sasha-Denise Grünzig.

Ethics declarations

Ethics approval and consent to participate

All procedures involved in the study are consistent with the generally accepted standards of ethical practice approved by the ethics committee of the Albert-Ludwigs-University Freiburg (approval number 404/16). All participants submit their informed consent prior to study inclusion.

Competing interest

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional information

The original version of this article was revised:Figure 2 SPIRIT figure is only meant as supplementary material.

Additional file

Additional file 1:

SPIRIT-checklist. (DOC 162 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Grünzig, SD., Baumeister, H., Bengel, J. et al. Effectiveness and acceptance of a web-based depression intervention during waiting time for outpatient psychotherapy: study protocol for a randomized controlled trial. Trials 19, 285 (2018). https://doi.org/10.1186/s13063-018-2657-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-018-2657-9

Keywords

  • Web-based intervention
  • Internet
  • E-health
  • Waiting time
  • Waitlist
  • Depression
  • Outpatient treatment
  • Psychotherapy
  • Psychological health care

Trials

ISSN: 1745-6215