Evolutionary cognitive therapy versus standard cognitive therapy for depression: a protocol for a blinded, randomized, superiority clinical trial
© Giosan et al.; licensee BioMed Central Ltd. 2014
Received: 25 June 2013
Accepted: 27 February 2014
Published: 19 March 2014
Depression is estimated to become the leading cause of disease burden globally by 2030. Despite existing efficacious treatments (both medical and psychotherapeutic), a large proportion of patients do not respond to therapy. Recent insights from evolutionary psychology suggest that, in addition to targeting the proximal causes of depression (for example, targeting dysfunctional beliefs by cognitive behavioral therapy), the distal or evolutionary causes (for example, inclusive fitness) should also be addressed. A randomized superiority trial is conducted to develop and test an evolutionary-driven cognitive therapy protocol for depression, and to compare its efficacy against standard cognitive therapy for depression.
Romanian-speaking adults (18 years or older) with elevated Beck Depression Inventory (BDI) scores (>13), current diagnosis of major depressive disorder or major depressive episode (MDD or MDE), and MDD with comorbid dysthymia, as evaluated by the Structured Clinical Interview for DSM-IV (SCID), are included in the study. Participants are randomized to one of two conditions: 1) evolutionary-driven cognitive therapy (ED-CT) or 2) cognitive therapy (CT). Both groups undergo 12 psychotherapy sessions, and data are collected at baseline, mid-treatment, post-treatment, and the 3-month follow-up. Primary outcomes are depressive symptomatology and a categorical diagnosis of depression post-treatment.
This randomized trial compares the newly proposed ED-CT with a classic CT protocol for depression. To our knowledge, this is the first attempt to integrate insights from evolutionary theories of depression into the treatment of this condition in a controlled manner. This study can thus add substantially to the body of knowledge on validated treatments for depression.
Current Controlled Trials ISRCTN64664414
The trial was registered in June 2013. The first participant was enrolled on October 3, 2012.
KeywordsDepression Protocol Randomized trial Evolutionary psychotherapy Darwinian psychotherapy Evolutionary psychology Cognitive therapy CBT Cognitive evolutionary therapy
Depression affects around 350 million people worldwide, and is estimated to become the leading cause of disease burden globally by 2030 . More than 30 million people are affected by depression in Europe alone, and the associated annual costs are estimated at €92 billion .
CBT is the psychological standard of care for depression recommended as the first-line psychotherapeutic intervention . In CBT, the root of the depressive symptoms is seen as a set of dysfunctional core beliefs/schemas, which distort information processing, thus leading to systematic negative cognitive biases [3–5]. In CBT, the therapist tries to modify these dysfunctional beliefs, as well as engage the patient in rewarding activities.
IPT for depression focuses on ameliorating interpersonal difficulties and emphasizes the role of social support in the onset and maintenance of depression. The treatment rationale in IPT is that improvement in interpersonal relationships leads to improvement in depressive symptoms, which positively feeds back onto interpersonal functioning . Like CBT, IPT is one of the recommended treatments of choice by the National Institute for Clinical Excellence  and the National Institute of Mental Health .
Research on the efficacy of the therapies for depression shows that 30% to 50% of the patients do not respond to anti-depressive medication , and around 40% of patients with moderate to severe depression do not respond well to CBT . Moreover, 40% of those patients whose depression does remit will relapse within 2 years  and 20% are at risk of developing chronic, unremitting depression [16, 17]. Generally, meta-analyses indicate that all bona fide (non-placebo) psychological treatments for depression are equally efficacious , and the effect sizes of psychotherapy for adult depression vary from small to moderate .
Therefore, despite existing efficacious treatments, efforts should be made to develop and provide improved evidence-based treatment protocols for patients with depression. These efforts should build on the already validated treatment approaches and strive to add incremental benefits by targeting additional factors potentially involved in the onset or maintenance of depression. The current clinical trial is designed to contribute to this desired outcome.
Framework and rationale of the present study
Human behavior generally revolves around a finite set of biosocially relevant themes, and focuses on fitness maximization (that is, reproductive success). Biosocial goals are behaviors that increase fitness or that historically have increased fitness. Examples of these are satisfactory outcomes in areas such as shelter and security, nutrition and food acquisition, health, sexuality, mate selection, attraction, protection and retention, parenting, and in-group and between-group interactions . Evolutionary psychologists have noted that when humans are successful at meeting these fitness-enhancing goals, they generally experience well-being and happiness . On the other hand, failure (perceived or real) to meet these challenges results in dissatisfaction, depression, tension, or frustration .
A growing number of researchers are proposing that, in addition to targeting proximal or immediate causes of depression (for example, dysfunctional beliefs, as targeted by CBT), barriers to fitness should also be addressed. These factors are thought to be distal or evolutionary causes of depression.
In one of the early attempts at evolutionary explanations for depression, Dobson and Show  argued that Beck’s cognitive distortions are a consequence of depression, rather than a cause of it. Recent research has provided more empirical support for these insights, which link threats to fitness to depression. For example, a large study conducted on a sample of 1,400 disaster workers found that a successful slow fitness strategy (High-K) was a negative predictor of a variety of psychopathologies, including post-traumatic stress disorder, functional disability, anger, and sleep disturbances . Another study showed that the same fitness strategy was an important negative predictor of depressive symptomatology, accounting for 15% of the variance in scores on the Beck Depression Inventory, Second Edition (BDI-II),  after controlling for risk factors for depression . Elsewhere, greater depressive symptomatology scores have been shown to correlate negatively with ratings of mate value for self, and indirectly predicted lower ratings of mate value for short-term and long-term partners, as well as best friends .
These findings support a relationship between fitness level and depressive symptomatology, and suggest that interventions that specifically target increasing fitness could potentially alleviate depression.
It is the goal of the present study to explore the efficacy of formally incorporating interventions on the distal causes of depression in the treatment of this condition. An evolutionary-driven cognitive therapy (ED-CT) protocol for depression is being developed and tested in this clinical trial. Thus, patients with depression initially complete a questionnaire aiming at identifying deficient areas of fitness, and are guided by the therapist on ways of improving on those areas. The therapeutic outcome will be compared with the outcome of a group of patients with depression undergoing a well-established CBT treatment, namely, Beck’s cognitive therapy (CT) for depression .
This study is designed to be a blinded, randomized, superiority clinical trial. The experimental group receives ED-CT, while the control group receives CT. We hypothesize that, because the intervention array is larger in the case of ED-CT, the therapeutic gains will be larger in this condition than in the CT group at the completion of the therapy, and that this will be maintained at the 3-month follow-up.
The study population consists of Romanian adults with a diagnosis of major depression as defined in the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Revised Text (DSM-IV-TR) , or with depressive symptomatology. The study is being implemented through the Babes-Bolyai University Psychological Clinic, Cluj-Napoca, Romania.
Romanian-speaking adults (18 years or older) with raised BDI [24, 29]) scores (>13), current diagnosis of major depressive disorder or major depressive episode (MDD or MDE), and MDD with comorbid dysthymia, are included in the study. Participants presenting with panic disorder, substance abuse, psychotic symptoms, organic brain disorders (for example, dementia), imminent risk of suicide, self-injury or harming others, or serious legal or health issues that would prevent from regularly attending, are excluded.
The CT group
The CT group undergoes a 1-hour session of CT  each week for 12 weeks. CT is a structured, goals-oriented, short-term intervention organized around the concepts of automatic thoughts and schema/core beliefs. A distinctive feature of CT is the cognitive conceptualization of the client’s problems. Problematic behaviors are seen as consequences of the dysfunctional thinking patterns. Therefore, clients are trained to identify and modify dysfunctional automatic thoughts and beliefs. When behavioral techniques are used, they are employed in the service of cognitive change (for example, behavioral experiments to challenge dysfunctional thoughts), as well as to increase the number of positive reinforcements. The treatment begins with the identification of negative automatic thoughts (conceptualized as the most easily accessible cognitive contents, as they are linked to specific activating events), followed by the examination of their validity and utility, to construct a more adaptive viewpoint and thus decrease depressive symptoms. As the therapy progresses, deeper cognitive structures are targeted (including underlying assumptions/intermediate beliefs and dysfunctional schemas), with the ultimate goal of helping the client to achieve a remission of their depression and prevent relapse.
The ED-CT group
The ED-CT group also undergoes a 1-hour session of therapy each week for 12 weeks. Therapy sessions follow the guidelines of the ED-CT manual that we have developed. Following implementation of the study, the manual will be available upon request from the first author, and will also be submitted for publication.
The ED-CT starts with the administration of a Fitness Evaluation Scale (FES), described below, which yields a comprehensive assessment of the client’s perceived darwinian or evolutionary fitness. The therapist thus begins the treatment with a clear understanding of the barriers to fitness that the patient is facing, in addition to the problems formulated by them at the beginning of therapy. In other words, the patient’s answers to the FES guide the evolutionary-driven intervention elements by providing additional focuses for treatment, alongside classic CT targets of intervention. Thus, the key difference between ED-CT and a classic CT approach is that in the ED therapy, the therapist comes pre-equipped with a list of fitness deficiencies identified by the patient through the completion of the FES at intake, which the therapist addresses alongside other problems.
The ED-CT intervention is based on standard CT while adding specific goals and techniques designed to increase an individual’s evolutionary fitness. We will succinctly describe the treatment course, focusing on the evolutionary aspects of the treatment.
The first treatment session focuses on educating the patient about typical topics such as depression and psychotherapy, emphasizing the importance of ‘homework’ (personal practice of the therapy at home), taking responsibility for change, and adjusting the patient’s expectations. This session also focuses on presenting details about specific ED-CT insights such as the mismatch theory (the theory that cognitive structures which were adaptive in a Pleistocene environment, but are now ‘mismatched’ to the current environment, lead to dysfunctional emotions and behaviors), and about the hypothesized evolutionary functions of depression . The patient is informed in this session about the research linking depression and fitness-related behaviors, and why an evolutionary approach can be suited as a guiding add-on to a CT intervention. This is also the point at which the therapist discusses the problems identified by the FES at intake, and, with the help of the patient, sets realistic goals to address them in future sessions. The homework in this session usually consists of building specific goals, using the FES as a guideline and as an example of specific target behaviors.
Session 2 focuses on continuing to build the therapeutic alliance and elaborating on the fitness problems list yielded by the FES. This session also provides the opportunity to discuss with the patient their understanding of the distal evolutionary causes of depression.
Sessions 3 to 6 focus on working on each of the fitness deficiencies identified at intake. These problems are conceptualized using evolutionary insights. For instance, some dysfunctional beliefs and their consequences can be seen as adaptive mental structures left over from the Environment of Evolutionary Adaptedness (EEA) . This helps the patient to experience control and self-acceptance of their depressive symptoms. For example, a patient can present guilt – a depression symptom – about feelings or expressions of anger, fueled by beliefs such as: ‘I’m a horrible person because I got angry and yelled at my neighbor.’ In this case, guilt is typically seen as a secondary emotional problem (dysfunctional emotion about other emotions) . Evolutionary explanations of anger (for example, anger as an adaptive reaction during the EEA) can lower self-criticism and promote self-acceptance by reducing the intensity of the secondary emotion (guilt in this example), thus enabling the psychotherapist to work on the primary, present problem (anger in this example).
Homework is negotiated during these sessions, and generally consists of self-monitoring of emotions and behaviors, cognitive restructuring, and behavioral activation tasks generated from the FES. Specific behaviors that the patient does not engage in as captured by the FES (for example, spending time in nature, healthy eating habits) are targeted for activation. In addition, problem-solving, conflict resolution, and assertiveness training are used to enhance relationships with the patient’s relatives where appropriate, thus tapping into indirect fitness, while direct fitness (for example, mate value, health, income) is enhanced with standard CT techniques.
Sessions 7 to 10 are targeted at making headway towards the resolution of some or all of the problems previously identified by the FES, working toward strengthening the patient’s adaptive beliefs and weakening the maladaptive beliefs, and encouraging them to see the links between problems, particularly those that are characterized by common dysfunctional beliefs. Core beliefs are identified and approached in this part of the therapy. Standard CT techniques are used to change beliefs and behaviors, but the therapist often refers back to the evolutionary-informed CT conceptualization. Homework continues to focus on FES-generated behavioral activation, rehearsing adaptive statements in real-life situations, and applying the techniques and conceptualization to novel, diverse problems.
Sessions 11 and 12 prepare the patient for the task of becoming their own future therapists, and for discussing relapse prevention. The homework focuses on strengthening confidence in healthy core beliefs and promoting self-acceptance and other-acceptance. Self-control techniques in difficult situations are practiced, and solutions for possible relapses are tested before the end of the therapy.
Outcomes and measures
The level of depressive symptomatology and a categorical diagnosis of depression after treatment constitute the primary outcomes.
Perceptions about quality of life and social functioning constitute the secondary outcomes.
Because the interventions in the experimental group target both proximal and distal causes of depression, it is expected that they will lead to a greater decrease in depressive symptomatology and a greater increase in quality of life and in social and occupational functioning than those in the control group.
We considered three sets of additional outcomes, as follows.
The first set comprises measures related to fitness and mate value; self-reported physical health; behavioral activation; self-reported religiosity; self-reported coping strategies; and measures of positive and negative emotions. We decided to include these measures to investigate, in an exploratory manner, if the eventual superiority of the ED-CT intervention is related to improvements in fitness dimensions (for example, kinship relations, upward mobility, physical health, social capital) We also included behavioral activation as a potential predictor of outcomes for both interventions [27, 33]. In addition, we were interested to see if the ED-CT intervention efficacy is associated with a person’s religiosity, as a high level of religious faith might undermine the acceptance of the ED-CT intervention rationale. Lastly, we included measures of emotionality and coping strategies to explore the extent to which the newly devised intervention might have broader clinical implications.
The second set of additional outcomes includes measures of presumed mechanisms of change within classic CBT (including CT): negative automatic thoughts , dysfunctional attitudes [3, 34], and irrational beliefs [35, 36]. We included these measures to examine, in an exploratory manner, if the two interventions have differential effects on the same cognitive mechanisms.
The third set of additional outcomes includes measures of working alliance, treatment outcome expectancies, and client satisfaction with the therapy. We added these measures to allow exploratory investigation of the eventual differences between the two interventions in terms of non-specific factors associated with the treatment outcome.
The instruments that we use for measuring each of these outcomes are briefly described below.
Measures of primary outcomes
The Structured Clinical Interview for DSM-IV (SCID) , specifically, the Overview, Mood Episodes, and Anxiety Disorders modules, is used for the clinical assessment of depression. The Overview module collects information about sociodemographic variables (date of birth, marital status, number of children, level of education, employment status), drug use, physical and psychological treatment history (including any past or current treatments for depression), and current social functioning. The Mood Episodes and Anxiety Disorders modules follow the diagnostic criteria of the DSM-IV-TR  for mood episodes and anxiety disorders. The SCID has been adapted for use on the Romanian population .
The BDI-II [24, 29], a 21-item version of the original BDI , is one of the most widely used self-report measures of depression. Participants rate the intensity of depressive symptoms on a Likert scale from 0 to 3, where 0 corresponds to lack of the symptom, while 3 corresponds to the highest intensity. The psychometric properties of the original BDI are well established, and the BDI-II also appears to be psychometrically strong . The BDI-II has been adapted for use with the Romanian population , and has adequate psychometric properties .
Measures of secondary outcomes
The Social Adjustment Scale (SAS) [42–44] is a self-report measure of social functioning used in both research and clinical practice. The questions are designed to assess six key role areas: 1) work, 2) social and leisure activities, 3) relationships with extended family, 4) role as a marital partner, 5) parental role, and 6) role within the family unit. The items are coded on a five-point Likert scale. An overall score is obtained, as well as scores for each of the six role areas . Larger scores denote greater impairment. The SAS has been translated into Romanian and adapted for the purposes of this study, as described further below.
The World Health Organization Quality of Life BREF (WHOQOL-BREF; ) is a 26-item self-report tapping into the following broad domains: physical health, psychological health, social relationships, and environment. The Cronbach’s α values for these domains are acceptable, varying from .68 to .81 [47–49]. Items are rated on a five-point Likert scale and scored in a positive direction (that is, higher scores indicate higher quality of life). The scale has been translated and adapted into Romanian for the purposes of the current study.
Measures of other outcomes
For the first set of additional outcomes used in this study, the following measures are used.
The FES is a scale adapted and expanded by the authors from the High-K Strategy Scale (HKSS) . The HKSS has been shown to be negatively associated with depressive symptomatology  and psychopathology in general . The FES consists of 45 items (58 if the patient has children), tapping into various dimensions theorized to make up the indicators of fitness. Participants rate every item on a five-point Likert scale. A total FES score is computed by adding up ratings for each item, with higher scores indicating greater fitness. The FES was preliminarily validated on a sample of 146 subjects, and showed good internal consistency (Cronbach’s α = 0.93). The FES is the therapist’s starting point in prescribing the evolutionary-driven interventions, as further detailed below.
The Mate Value Inventory (MVI)  is a multivariate assessment of attributes desired in the self, and in social or sexual partners.The MVI is a list of 17 traits, for which participants are asked, ‘How well do you feel that these attributes apply to you currently,’ and are measured on a scale of -3 (extremely low on this trait) to +3 (extremely high on this trait). These traits are: ambitious, attractive face, attractive body, desires children, emotionally stable, enthusiastic about sex, faithful to partner, financially secure, generous, good sense of humor, healthy, independent, intelligent, kind and understanding, loyal, responsible, and sociable. Mate value is the summed score of these items. The MVI has been translated and adapted into Romanian for the purposes of the current study.
The Components of Mate Value Survey (CMVS)  is a 21-item self-report measure. It is based on the Self-Perceived Mating Success Scale (SPMSS) , but in addition to the aspects of mate value indexed by SPMSS, it includes aspects related to sociality, parenting, wealth, looks, relationships history, and fear of failure. The CMVS has adequate reliability , and has been adapted into Romanian for the purposes of this study.
Behavioral Inhibition System/Behavioral Activation System (BIS/BAS)  is a 20-item self-report questionnaire that consists of a Behavioral Inhibition subscale (making up the BIS) and three Behavioral Activation subscales (making up the BAS). Each item is rated on a four-point Likert scale, from 1 (strongly agree) to 4 (strongly disagree). A number of studies have indicated adequate psychometric properties [54, 55]. The BIS/BAS scales have been validated on the Romanian population in previous studies .
The Physical Health Questionnaire (PHQ)  is a brief 14-item self-report scale used to assess frequency of somatic symptoms (gastrointestinal problems, headaches, sleep disturbances, and respiratory problems). Items 1–11 are rated on a seven-point frequency scale, ranging from 1 (not at all) to 7 (all of the time). Items 12–14 have different frequency-related responses, but the participant uses the same seven-point frequency scale. Higher mean scores reflect better somatic health. The PHQ has shown good psychometric properties [57–60], and has been translated into Romanian for the purposes of this study.
The Santa Clara Strength of Religious Faith Questionnaire (SCSRFQ) is a brief, reliable and valid self-report measure assessing strength of religious faith and engagement, which is suitable for use with multiple religious traditions. It comprises 10 items, scored on a four-point Likert scale, with higher scores denoting increased levels of religious faith. The SCSRFQ has been widely used in medical, student, psychiatric, and general populations internationally, and has good psychometric properties [61–65]. The questionnaire has been translated and adapted into Romanian for the purposes of this study.
Brief COPE (B-COPE)  is a 28-item brief form of a previously published measure called the COPE inventory , which has proven to be useful in health-related research. Respondents rate the items on a four-point Likert scale, from 1 (I haven’t been doing this at all) to 4 (I’ve been doing this a lot). Scores are derived separately for two main categories of coping strategies, namely, ‘emotion focused’ and ‘problem focused’ coping. B-COPE has been successfully used on Romanian samples .
The Positive and Negative Affect Scale (PANAS)  is a 20-item self-report questionnaire, designed to assess mood. It distinguishes between positive and negative affect. Participants rate each item on a five-point Likert scale, from 1 (very slightly/not at all) to 5 (extremely) to indicate how they felt during the indicated timeframe. The PANAS can be used to assess mood on various time scales by altering the instructions. Possible time scales include moment, today, past few days, past week, past few weeks, past year, and general. For the purposes of this study, we used a 2-week interval. The validity and internal consistency of the PANAS are good, with test–retest reliability being the highest for the ‘general’ temporal instruction . The PANAS has been used previously on the Romanian population, and was found to have adequate psychometric properties [69, 70].
To explore the different mechanisms by which the two treatment approaches (ED-CT and CT) might lead to improvement (that is, the second set of additional outcomes), the following measures are administered.
The Automatic Thoughts Questionnaire (ATQ)  is a 15-item self-report measure used to assess depression-related cognitions. Participants rate on a five-point scale, (from 1 (never) to 5 (almost all the time)) how frequently they have had a given thought over the past week. A higher score shows a higher frequency of automatic thoughts. The psychometric properties of the ATQ have been adequately demonstrated in previous studies .
The Dysfunctional Attitudes Scale (DAS)  is a 40-item self-report instrument which measures attitudes that, according to the cognitive theory of depression, contribute to vulnerability for depression. Participants rate on a seven-point scale, from 7 (total disagreement) to 1 (total agreement), the level of personal concordance with the item presented. The higher the score, the more dysfunctional the participant’s attitudes. Adequate internal consistency and test-retest reliability for DAS have been reported in the literature .
The General Attitudes and Beliefs Scale (GABS)  is a 26-item self-report instrument that measures irrational beliefs related to six different content areas: achievement, approval, comfort, justice, self, and others. In addition, the scale includes a short index of rational beliefs. Participants rate on a five-point scale the level of agreement or disagreement with the item presented, from 1 (strongly disagree) to 5 (strongly agree). Adequate psychometric properties have been reported in the literature [75, 76].
The Attitude and Beliefs Scale II (ABS II)  is a 72-item instrument that measures irrational cognitions (that is, demandingness, global evaluation/self-downing, low frustration tolerance, and awfulizing) shown to be involved in the onset and maintenance of emotional distress, as well as their rational counterparts (preferential thinking, unconditional self-acceptance, frustration tolerance, and non-awfulizing). Each item is rated on a five-point Likert scale, from 0 (strongly disagree) to 4 (strongly agree). A total irrationality score is obtained by summing up the scores on each irrationally worded item, and the reverse scored responses on each rationally worded item. Higher scores indicate a higher level of irrationality.
The third set of additional outcomes contains the following measures.
The Working Alliance Inventory (WAI) [84, 85] is a 12-item self-report global measure of the therapeutic alliance. The WAI has three subscales: 1) emotional bond of trust and rapport between the counselor and client, 2) agreement about the overall goals of treatment, and 3) agreement about the tasks relevant for achieving these goals. Items are rated on a seven-point Likert scale and the scale has shown good internal consistency, as well as good construct, concurrent, and predictive validity [85–87]. The questionnaire has been translated and adapted into Romanian for the purposes of this study.
Treatment outcome expectancies are measured using 10-cm visual analogue scales (VASs). This approach has shown good reliability in multiple studies [88, 89]. Treatment outcome expectancies are measured at intake and at mid-treatment.
The intent to attend the next session is also assessed using the Intent-to-Attend Scale , a single-item measure. Participants rate their intention on a nine-point Likert scale.
After each therapy session, participants’ satisfaction with the treatment is evaluated using the Client Satisfaction Questionnaire [91–93], the eight-item version. The CSQ-8 assesses global patient satisfaction with a four-point Likert, scale and also provides a general score varying from 8 to 32. This questionnaire has been translated and adapted into Romanian for the purposes of this study.
All the instruments adapted into Romanian for the purposes of the present study were independently translated by two Romanian English-proficient PhD-level clinical psychologists with good knowledge of the constructs measured. Disagreements were resolved through discussions between the translators, and two Romanian senior clinical psychologists also reviewed and approved the final versions.
For the study, potential participants are provided with verbal and written information during the first appointment with a clinical psychologist. Written consent for the participation in the clinical evaluation part of the study is sought at this time. A second appointment is scheduled, in which the respondents are evaluated clinically. If the inclusion criteria are met, written consent for participation in the treatment part of the study is obtained, within a 2-week interval.
An a priori power analysis based on a medium effect size estimation indicated that a total of 100 participants are needed (planned main statistical test is ANOVA (repeated measures, between factors); f effect size: 0.247; statistical power: 0.80; α error probability: 0.05; two groups, two main measurements (pre-intervention and post-intervention); correlation between repeated measures: .50). Power analysis was computed using the G*Power 3.1.6 program . Consequently, we randomized a total of 100 participants. Following generation of the random numbers, we decided to use the first sequence of numbers for the participants’ allocation to the groups. This resulted in 43 participants randomized to the CT group, and 57 participants randomized to the ED-CT group.
An initial telephone interview screens out those people whose participation in the study is motivated by problems other than their mood. The potential subjects then undergo a clinical evaluation, performed by doctoral-level clinical psychologists certified by the Romanian Board of Psychologists, and currently supervised in their activity by senior psychologists. They have been trained in using the SCID  as part of their clinical program, at Babes-Bolyai University. Additionally, for the purposes of this study, all of them received specific practical training in administering the SCID modules used in the current protocol. To ensure the adequacy of the assessment procedure, all the initial clinical evaluations are audio recorded and randomly verified by a senior clinical psychologist. Moreover, all the potential eligible cases are discussed with the same senior clinical psychologist before enrolment. Every evaluation is audio recorded, to allow for reliability checks for depression diagnoses, performed by an independent evaluator, on 25% of randomly selected interviews. SCID  and BDI-II [24, 29] (see above) are used for purposes of evaluating eligibility.
Prospective participants are recruited into the treatment study by clinical psychologists at the Babes-Bolyai University Psychological Clinic. Potential participants are also referred by psychiatric clinics that collaborate with Babes-Bolyai University as well as by private practices. Additionally, media avenues (for example, local newspapers, radio, social networks) as well as posters and fliers are used for recruitment purposes.
Assignment to interventions
The participants are randomly assigned to one of the two conditions using a sequence generated by the software Randomizer.org. Randomization is performed by a research assistant using a simple (unrestricted) randomization sequence that assigns two unique numbers per participant; the number assigned is either 1 or 2, according to the number of experimental conditions. To conceal the allocation mechanism, the same research assistant puts the patient in touch with their therapist without revealing anything about the intervention protocol to be implemented by that therapist.
The CT and ED-CT therapy protocols are each delivered by two different psychotherapists. All four psychotherapists are certified by the Romanian Board of Psychologists, and have extensive training in CT, completed through the Romanian Association of Cognitive and Behavioral Psychotherapies. The two psychotherapists delivering the ED-CT protocol have received additional training in the evolutionary components of the ED-CT protocol. Under the direct supervision of the principal investigator, the therapists have undergone 6 weeks of training, following the protocol manual for the ED-CT group.
The principal investigator and the statisticians running the data analysis will remain blinded to the experimental condition until the completion of the study.
Data collection, management, and analysis
Each eligible patient is assigned a unique identification number and asked to complete the evaluation package, including the primary, secondary, and other outcomes, as well as demographic information (initial assessment). The same set of measures is administered after the final session (post-intervention assessment) and at 3 months after the final session (follow-up assessment). After sessions 4 and 8, patients also complete several measures of primary outcomes (that is, BDI-II), and other outcomes (ATQ, DAS, ABS II, PANAS, B-COPE, treatment outcome expectancies,WAI, CSQ-8, and Intent-to-Attend Scale). In addition, the participants complete the BDI-II, CSQ-8, and Intent-to-Attend Scale after each session.
To ensure high accuracy of data collection, all the measures are completed electronically, via a special system designed to reliably capture and organize the data points while minimizing the risk of missing responses. The system has been especially developed for the purposes of this study, and is secured on a server. Each participant uses their unique identification number to log on to the system. The therapists are responsible for assisting the patients in this process, and providing clarifications when needed.
To promote participant retention and follow-up completion, several strategies are being used. First, the participants receive a clear and complete description about the project, including, but not limited to, information regarding the type of psychotherapy offered, that is, CT, which is the standard of care in the psychological treatment for depression, having remission rates comparable with medication, and being more efficient than medication alone in the long term. The participants are also informed that the treatment is being provided free by therapists trained in the top-ranked Department of Clinical Psychology and Psychotherapy in the country , recently added, through its academic spin-off, the International Institute for the Advanced Studies of Psychotherapy and Applied Mental Health, to the Mapping of the European Research Infrastructure Landscape (MERIL) network . Because in Romania psychotherapy sessions are not reimbursed by health insurance companies, we expect that this financial factor will also act as a motivator for the patient to stay in treatment. Furthermore, the therapy sessions are scheduled in a flexible manner, according to the patient’s preferences. Additionally, the therapist will call the participant the day before the planned session for a brief check, and to ensure continuation in therapy. Most importantly, to ensure retention, at the end of each session the participants complete the ‘Intend-to-Attend’ one-item scale, which is meant to promote commitment to the therapeutic process as well as to detect any issues that might require the therapist’s special attention. Lastly, the therapists carefully prepare the end session of the therapy and explain to the participants that they will keep in touch. The therapists also remind the patients at this time that the free treatment was possible because of a research grant, which makes the collection of follow-up measurements essential.
The severity of, and improvement in the BDI-II scores within and between the groups will be examined using mixed-effects linear regression analysis with a random intercept and slope over time (four assessments: baseline, after sessions 4 and 8, post-treatment) and fixed effects for treatment assignment.) The 3-month follow-up data will be analyzed in a separate mixed-effects model. The main analysis will compare groups in terms of depression level (that is, diagnostic status and symptom intensity). Results on the other measures will be investigated in an exploratory manner. When analysis of secondary/other outcomes are performed, the error probability will be adjusted according to the number of group comparisons performed .
Monitoring study implementation
The management of unintended effects or harm (that is, clinically significant increase in depressive symptomatology, as measured by the BDI-II), is performed by the supervising clinical psychologist employed for this study, who monitors the clinical evaluations and therapy sessions. If necessary, the supervisor can decide to terminate the treatment/clinical assessment and make a further referral.
Ethics and dissemination
The study has been approved by the ethics commission at Babes-Bolyai University. As with any study on depression, there are ethical concerns that need to be addressed. First, the exclusionary criteria exclude people who pose an imminent danger to themselves or others. These people will be immediately referred to the appropriate services dealing with such cases. Second, if a patient’s condition worsens during the therapy, the supervising clinical psychologist can opt to terminate the treatment ahead of schedule and make an appropriate referral. Third, people with mental conditions other than depression are also excluded, and will be referred to the services best suited to dealing with their problems.
One arm of this clinical trial involves interventions that stem from an evolutionary understanding of human behavior. The role of the SCSRFQ scale, administered at intake, is to assess the strength of religious beliefs before the first session, when the ED-CT conceptualization takes place. Special care will be taken with the patients whose religious beliefs might make them less receptive to the theoretical framework of such interventions. In such cases, the therapist will be mindful of the patient’s beliefs, and explain the basic tenets of ED-CT in a very sensitive manner.
Finally, confidentiality and privacy are of paramount importance. The completed forms of the clinical instruments are kept in locked cabinets and the access to the electronic data is password-protected. The passwords are changed regularly, and the clinical assessment reports contain no identifying information.
The principal investigator and the research team intend to publish the trial results in a peer-reviewed journal, focusing on two main areas: 1) primary outcomes results and 2) mechanisms of change results. Presentations at international conferences on the topic are also envisioned. Furthermore, the intervention manual will be sent out for publication, and will be made available upon request from the first author.
This protocol describes a randomized trial comparing two interventions for depression: classic CT and the newly proposed ED-CT. As the costs of depression continue to mount , it is imperative that new approaches be tested and validated, and if successful, implemented. Given the high prevalence of depression and its projected costs, even incremental benefits of novel approaches can translate into billions of dollars in savings.
To our knowledge, this is the first attempt to integrate insights from evolutionary theories of depression into the treatment of this condition in a controlled manner. This study can thus add substantially to the body of knowledge on validated treatments for depression. The randomized controlled design is rigorous, allowing the authors to arrive at valid conclusions about the comparative efficiency of these two interventions at the end of the study.
There are, nonetheless, several caveats that must be acknowledged. As with any clinical trial testing psychotherapeutic interventions, therapist blinding is not possible. To minimize possible biases, the principal investigator will not be involved in any therapeutic sessions. In addition, because of the ethical concerns of keeping patients with depression on a waiting list for 12 weeks, the present study lacks a control group in that sense.
This randomized trial is a first step in the development of an evolutionary-driven intervention for depression. If the treatment is shown to be at least comparable with CT, then a future trial will examine whether this intervention is associated with lower relapse or other longer-term outcomes such as improved health.
Participant recruitment began on September 1, 2012. Randomization of the participants was performed on September 27, 2012. The first participant was enrolled on October 3, 2012.
- ABS II:
Attitude and Belief Scale II
Automatic Thoughts Questionnaire
Beck Depression Inventory, Second Edition
Behavioral Inhibition System/Behavioral Activation System
Components of Mate Value Survey
Client Satisfaction Questionnaire, 8-item version
Dysfunctional Attitudes Scale
Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition
Evolutionary-Driven Cognitive Therapy
Fitness Evaluation Scale
General Attitudes and Beliefs Scale
Major Depressive Disorder
Major Depressive Episode
Mate Value Inventory
Positive and Negative Affect Scale
Physical Health Questionnaire
Social Adjustment Scale
Santa Clara Strength of Religious Faith Questionnaire
The Structured Clinical Interview for DSM-IV
Working Alliance Inventory
World Health Organization
WHO Quality of Life BREF.
This study ismade possible by the generous support of a grant of the Romanian Authority for Scientific Research, CNCS-UEFISCDI, Project number PN-II-ID-PCE-2011-3-0230. The funding body had no role in the study design and implementation, writing the report, or the decision to submit the report for publication. We thank Drs David Buss, Todd Shackelford, and Aurelio J. Figueredo for their advice on the first drafts of the ED-CT manual. We also thank Dr Alina Rusu for her help.
- World Health Organization: Depression. [http://www.who.int/mediacentre/factsheets/fs369/en/] Last accessed: 10 May 2013
- Olesen J, Gustavsson A, Svensson M, Wittchen HU, Jönsson B: The economic cost of brain disorders in Europe. Eur J Neurol. 2012, 19: 155-162. 10.1111/j.1468-1331.2011.03590.x.View ArticlePubMed
- Beck AT: Cognitive Therapy and the Emotional Disorders. 1976, New York, NY: International Universities Press
- Beck AT: The current state of cognitive therapy: a 40-year retrospective. Arch Gen Psychiatry. 2005, 62: 953-959. 10.1001/archpsyc.62.9.953.View ArticlePubMed
- Beck AT: The evolution of the cognitive model of depression and its neurobiological correlates. Am J Psychiatry. 2008, 165: 969-977. 10.1176/appi.ajp.2008.08050721.View ArticlePubMed
- Cuijpers P, Geraedts AS, van Oppen P, Andersson G, Markowitz JC, van Straten A: Interpersonal psychotherapy for depression: a meta-analysis. Am J Psychiatry. 2011, 168: 581-592. 10.1176/appi.ajp.2010.10101411.PubMed CentralView ArticlePubMed
- Jakobsen JC: Review: interpersonal psychotherapy is effective as an acute or maintenance treatment for unipolar depression. Evid Based Ment Health. 2011, 14: 108-10.1136/ebmh.2011.100152.View ArticlePubMed
- Mufson L: Group interpersonal therapy reduces depression in adolescent survivors of war. Evid Based Ment Health. 2008, 11: 17-10.1136/ebmh.11.1.17.View ArticlePubMed
- Mufson L, Dorta KP, Wickramaratne P, Nomura Y, Olfson M, Weissman MM: A randomized effectiveness trial of interpersonal psychotherapy for depressed adolescents. Arch Gen Psychiatry. 2004, 61: 577-584. 10.1001/archpsyc.61.6.577.View ArticlePubMed
- Mufson L, Weissman MM, Moreau D, Garfinkel R: Efficacy of interpersonal psychotherapy for depressed adolescents. Arch Gen Psychiatry. 1999, 56: 573-579. 10.1001/archpsyc.56.6.573.View ArticlePubMed
- Gartlehner G, Hansen RA, Thieda P, DeVeaugh-Geiss AM, Gaynes BN, Krebs EE, Lux LJ, Morgan LC, Shumate JA, Monroe LG, Lohr KN: Comparative Effectiveness of Second-Generation Antidepressants in the Pharmacologic Treatment of Adult Depression. 2007, Rockville, MD: Agency for Healthcare Research and Quality (US)
- National Institute for Health and Clinical Excellence: The treatment and management of depression in adults. [http://www.nice.org.uk/nicemedia/live/12329/45888/45888.pdf] Last accessed: 22 May 2013
- Kelly MA, Cyranowski JM, Frank E: Sudden gains in interpersonal psychotherapy for depression. Behav Res Ther. 2007, 45: 2563-2572. 10.1016/j.brat.2007.07.007.PubMed CentralView ArticlePubMed
- National Institutes of Health: Depression. [http://www.nimh.nih.gov/health/topics/depression/index.shtml] Last accessed: 10 June 2013
- DeRubeis RJ, Hollon SD, Amsterdam JD, Shelton RC, Young PR, Salomon RM, O’Reardon JP, Lovett ML, Gladis MM, Brown LL, Gallop R: Cognitive therapy vs medications in the treatment of moderate to severe depression. Arch Gen Psychiatry. 2005, 62: 409-416. 10.1001/archpsyc.62.4.409.View ArticlePubMed
- Boland R, Keller M: Course and outcome of depression. Handbook of Depression. Edited by: Gotlib IH, Hammen HL. 2009, New York, NY: Guilford Press, 23-43. 2
- Gilmer WS, Trivedi MH, Rush AJ, Wisniewski SR, Luther J, Howland RH, Yohanna D, Khan A, Alpert J: Factors associated with chronic depressive episodes: a preliminary report from the STAR-D project. Acta Psychiatr Scand. 2005, 112: 425-433. 10.1111/j.1600-0447.2005.00633.x.View ArticlePubMed
- Wampold BE, Minami T, Baskin TW, Tierney SC: A meta-(re)analysis of the effects of cognitive therapy versus “other therapies” for depression. J Affect Disord. 2002, 68: 159-165. 10.1016/S0165-0327(00)00287-1.View ArticlePubMed
- Cuijpers P, Smit F, Bohlmeijer E, Hollon SD, Andersson G: Efficacy of cognitive–behavioural therapy and other psychological treatments for adult depression: meta-analytic study of publication bias. Br J Psychiatry. 2010, 196: 173-178. 10.1192/bjp.bp.109.066001.View ArticlePubMed
- Buss DM: Evolutionary Psychology: The New Science of the Mind. 1998, Boston, MA: Allyn & Bacon, 1
- Bailey KG, Gilbert P: Evolutionary psychotherapy: where from here?. Genes on the Couch. Explorations in Evolutionary Psychotherapy. Edited by: Gilbert P, Bailey KG. 2000, East Sussex: Brunner-Routledge, 333-348.
- Dobson KS, Shaw BF: Cognitive assessment with major depressive disorders. Cognit Ther Res. 1986, 10: 351-360.View Article
- Giosan C, Wyka KE: Is a successful High-K fitness strategy associated with better mental health?. Evol Psychol. 2009, 7: 28-39.View Article
- Beck AT, Steer RA, Ball R, Ranieri W: Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients. J Pers Assess. 1996, 67: 588-597. 10.1207/s15327752jpa6703_13.View ArticlePubMed
- Giosan C: “Slow” reproductive strategy: a negative predictor of depressive symptomatology. Aust J Psychol. 2013, 65: 156-162. 10.1111/ajpy.12016.View Article
- Kirsner BR, Figueredo AJ, Jacobs WJ: Self, friends, and lovers: structural relations among Beck Depression Inventory scores and perceived mate values. J Affect Disord. 2003, 75: 131-148. 10.1016/S0165-0327(02)00048-4.View ArticlePubMed
- Beck AT, Rush AJ, Shaw BF, Emery G: Cognitive Therapy of Depression. 1979, New York, NY: Guilford Press
- American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders DSM-IV-TR. 2000, Washington, DC: American Psychiatric Association, 4
- Beck AT, Steer AR, Brown GK: Manual for the Beck Depression Inventory—II. 1996, San Antonio, TX: The Psychological Corporation
- Nesse RM, Williams GC: Why Do We Get Sick? The New Science of Darwinian Medicine. 1994, New York, NY: Times Books
- Irons W: Adaptively relevant environments versus the environment of evolutionary adaptedness. Evol Anthropol. 1998, 6: 194-204. 10.1002/(SICI)1520-6505(1998)6:6<194::AID-EVAN2>3.0.CO;2-B.View Article
- Ellis A, Dryden W, DiGiuseppe R: The Practice of Rational Emotive Behavior Therapy. 2007, New York, NY: Springer Publishing Company
- Lejuez CW, Hopko DR, Hopko SD: A brief behavioral activation treatment for depression. Treatment manual. Behav Modif. 2001, 25: 255-286. 10.1177/0145445501252005.View ArticlePubMed
- Beck JS: Cognitive Therapy: Basics and Beyond. 1995, New York, NY: The Guilford Press, 1
- Ellis A: Reason and Emotion in Psychotherapy. 1994, Secaucus, NJ: Birch Lane: Carol Pub Group
- Ellis A: Reason and Emotion in Psychotherapy. 1962, New York, NY: Lyle Stuart
- First MB, Spitzer RL, Gibbon M, Williams JBW: Structured Clinical Interview for DSM-IV Axis I Disorders, Clinician Version. 1997, Washington, DC: American Psychiatric Publishing, Inc
- First MB, Spitzer RB, Gibbon M, Williams JBW: Interviu Clinic Structurat pentru tulburarile clinice de pe Axa 1 a DSM - Versiune clinica. 2007, Romanian Psychological Testing Services: Cluj-Napoca, CJ
- Beck AT, Ward CH: An inventory for measuring depression. Arch Gen Psychiatry. 1961, 4: 561-571. 10.1001/archpsyc.1961.01710120031004.View ArticlePubMed
- Beck AT: Inventarul de depresie Beck - Editia a doua (BDI-II). 2012, Romanian Psychological Testing Services: Cluj Napoca, CJ
- David D, Szentagotai A, Lupu V, Cosman D: Rational emotive behavior therapy, cognitive therapy, and medication in the treatment of major depressive disorder: a randomized clinical trial, post treatment outcomes, and six-month follow-up. J Clin Psychol. 2008, 64: 728-746. 10.1002/jclp.20487.View ArticlePubMed
- Weissman MM, Olfson M, Gameroff MJ, Feder A, Fuentes M: A comparison of three scales for assessing social functioning in primary care. Am J Psychiatry. 2001, 158: 460-466. 10.1176/appi.ajp.158.3.460.View ArticlePubMed
- Weissman MM, Prusoff BA, Douglas W, Harding PS, Myers JK: Social adjustment by self-report in a community sample and in psychiatric outpatients. J Nerv Ment Dis. 1978, 166: 317-326. 10.1097/00005053-197805000-00002.View ArticlePubMed
- Weissman MM: Social Adjustment Scale – Self-Report (SAS-SR) User’s Manual. 1999, Multi-Health Systems, Inc: North Tonawanda, NY
- Gameroff MJ, Wickramaratne P, Weissman MM: Testing the short and screener versions of the Social Adjustment Scale-Self-Report (SAS-SR). Int J Methods Psychiatr Res. 2012, 21: 52-65. 10.1002/mpr.358.PubMed CentralView ArticlePubMed
- World Health Organization: The World Health Organization Quality of Life (WHOQOL). [http://www.who.int/mental_health/publications/whoqol/en/index.html] Last accessed: 22 May 2013
- Hwang HF, Liang WM, Chiu YN, Lin MR: Suitability of the WHOQOL-BREF for community-dwelling older people in Taiwan. Age Ageing. 2003, 32: 593-600. 10.1093/ageing/afg102.View ArticlePubMed
- Jang Y, Hsieh CL, Wang YH, Wu YH: A validity study of the WHOQOL-BREF assessment in persons with traumatic spinal cord injury. Arch Phys Med Rehabil. 1890–1895, 2004: 85-
- Skevington SM, Lotfy M, O’Connell KA: The World Health Organization’s WHOQOL-BREF Quality of Life assessment: psychometric properties and results of the international field trial. A report from the WHOQOL group. Qual Life Res. 2004, 13: 299-310.View ArticlePubMed
- Giosan C: High-K Strategy Scale: a measure of the High-K independent criterion of fitness. Evol Psychol. 2006, 4: 394-405.View Article
- Fisher M, Cox A, Bennett S, Gavric D: Components of self-perceived mate value. J Soc Evol Cult Psychol. 2008, 2: 156-168.View Article
- Landolt M, Lalumiere M, Quinsey V: Sex differences in intra-sex variations in human mating tactics: an evolutionary approach. Ethol Sociobiol. 1995, 16: 3-23. 10.1016/0162-3095(94)00012-V.View Article
- Carver CS, White TL: Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: the BIS/BAS scales. J Pers Soc Psychol. 1994, 67: 319-333.View Article
- McFarland BR, Shankman SA, Tenke CE, Bruder GE, Klein DN: Behavioral activation system deficits predict the six-month course of depression. J Affect Disord. 2006, 91: 229-234. 10.1016/j.jad.2006.01.012.View ArticlePubMed
- Sava FA, Sperneac AM: Sensitivity to Reward and Sensitivity to Punishment rating scales: a validation study on the Romanian population. Pers Individ Dif. 2006, 41: 1445-1456. 10.1016/j.paid.2006.04.024.View Article
- Schat ACH, Kelloway EK, Desmarais S: The Physical Health Questionnaire (PHQ): construct validation of a self-report scale of somatic symptoms. J Occup Health Psychol. 2005, 10: 363-381.View ArticlePubMed
- Rogers KA, Kelloway EK: Violence at work: personal and organizational outcomes. J Occup Health Psychol. 1997, 2: 63-71.View ArticlePubMed
- Schat ACH, Kelloway EK: Reducing the adverse consequences of workplace aggression and violence: the buffering effects of organizational support. J Occup Health Psychol. 2003, 8: 110-122.View ArticlePubMed
- Schat ACH, Kelloway EK: Effects of perceived control on the outcomes of workplace aggression and violence. J Occup Health Psychol. 2000, 5: 386-402.View ArticlePubMed
- Spence JT, Helmreich RL, Pred RS: Impatience versus achievement strivings in the type A pattern: differential effects on students’ health and academic achievement. J Appl Psychol. 1987, 72: 522-528.View ArticlePubMed
- Freiheit SR, Sonstegard K, Schmitt A, Vye C: Religiosity and spirituality: a psychometric evaluation of the Santa Clara Strength of Religious Faith Questionnaire. Pastor Psychol. 2006, 55: 27-33. 10.1007/s11089-006-0029-y.View Article
- Plante TG, Boccaccini MT: The Santa Clara Strength of Religious Faith Questionnaire. Pastor Psychol. 1997, 45: 375-387. 10.1007/BF02230993.View Article
- Plante TG, Vallaeys CL, Sherman AC, Wallston KA: The development of a brief version of the Santa Clara Strength of Religious Faith Questionnaire. Pastor Psychol. 2002, 50: 359-368. 10.1023/A:1014413720710.View Article
- Plante TG: The Santa Clara Strength of Religious Faith Questionnaire: assessing faith engagement in a brief and nondenominational manner. Religions. 2010, 1: 3-8. 10.3390/rel1010003.View Article
- Storch EA, Roberti JW, Bravata E, Storch JB: Psychometric investigation of the Santa Clara Strength of Religious Faith Questionnaire—Short-Form. Pastor Psychol. 2004, 52: 479-483.View Article
- Carver CS: You want to measure coping but your protocol’s too long: consider the brief Cope. Int J Behav Med. 1997, 4: 92-100. 10.1207/s15327558ijbm0401_6.View ArticlePubMed
- Carver CS, Scheier MF, Weintraub JK: Assessing coping strategies: a theoretically based approach. J Pers Soc Psychol. 1989, 56: 267-283.View ArticlePubMed
- Watson D, Clark LA, Tellegen A: Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988, 54: 1063-1070.View ArticlePubMed
- Levine EL, Xu X, Yang L-Q, Ispas D, Pitariu HD, Bian R, Ding D, Capotescu R, Che H, Musat S: Cross-national explorations of the impact of affect at work using the State-Trait Emotion Measure: a coordinated series of studies in the United States, China, and Romania. Hum Perform. 2011, 24: 405-442. 10.1080/08959285.2011.614302.View Article
- Cristea IA, Matu S, Szentagotai TA, David D: The other side of rumination: reflective pondering as a strategy for regulating emotions in social situations. Anxiety Stress Coping. 2013, 26: 584-594. 10.1080/10615806.2012.725469.View ArticlePubMed
- Hollon SD, Kendall PC: Cognitive self-statements in depression: development of an automatic thoughts questionnaire. Cognit Ther Res. 1980, 4: 383-395. 10.1007/BF01178214.View Article
- Harrell TH, Ryon NB: Cognitive-behavioral assessment of depression: clinical validation of the automatic thoughts questionnaire. J Consult Clin Psychol. 1983, 51: 721-725.View ArticlePubMed
- Weissman AN, Beck A: Development and Validation of the Dysfunctional Attitude Scale: a Preliminary Investigation. [http://eric.ed.gov/?id=ED167619]
- Hammen C, Krantz SE: Measures of psychological processes in depression. Handbook of Depression: Treatment, Assessment, and Research. Edited by: Beckham EE, Leber WR. 1985, Homewood, IL: Dorsey Press, 408-444.
- Lindner H, Kirkby R, Wertheim E, Birch P: A brief assessment of irrational thinking: the Shortened General Attitude and Belief Scale. Cognit Ther Res. 1999, 23: 651-663. 10.1023/A:1018741009293.View Article
- Macavei B: Scala de Atitudini şi Convingeri II (ABS II): date preliminare pentru populaţia de limbă română. J Cogn Behav Psychother. 2002, 2: 105-122.
- David D: Scale de Evaluare Clinică. 2007, Romanian Psychological Testing Services: Cluj Napoca, CJ
- Moldovan R, Cobeanu O, David D: Cognitive bibliotherapy for mild depressive symptomatology: randomized clinical trial of efficacy and mechanisms of change. Clin Psychol Psychother. 2013, 20: 482-493. 10.1002/cpp.1814.View ArticlePubMed
- Vîslă A, Cristea IA, Szentágotai Tătar A, David D: Core beliefs, automatic thoughts and response expectancies in predicting public speaking anxiety. Pers Individ Dif. 2013, 55: 856-859. 10.1016/j.paid.2013.06.003.View Article
- Macavei B: Dysfunctional Attitudes Scale, Form A; norms for the Romanian population. J Cogn Behav Psychother. 2006, 6: 157-171.
- Fülöp IE: A confirmatory factor analysis of the Attitudes And Belief Scale 2. J Cogn Behav Psychother. 2007, 7: 159-170.
- David A, Ghinea C, Macavei B, Kallay E: A search for “hot” cognitions in a clinical and a non-clinical context: appraisal, attributions, core relational themes, irrational beliefs, and their relations to emotion. J Cogn Behav Psychother. 2005, 5: 1-42.
- David D, Schnur J, Belloiu A: Another search for the “hot” cognitions: appraisal, irrational beliefs, attributions, and their relation to emotion. J Ration Emot Cogn Behav Ther. 2002, 20: 93-131. 10.1023/A:1019876601693.View Article
- Horvath AO, Greenberg LS: The development of the Working Alliance Inventory. The Psychotherapeutic Process: A Research Handbook. Edited by: Greenberg LS, Pinsof VM. 1986, Guilford Press, 529-
- Horvath AO, Greenberg LS: Development and validation of the Working Alliance Inventory. J Couns Psychol. 1989, 36: 223-233.View Article
- Horvath AO, Symonds DB: Relation between working alliance and outcome in psychotherapy: a meta-analysis. J Couns Psychol. 1991, 38: 139-149.View Article
- Tichenor V, Hill CE: A comparison of six measures of working alliance. Psychotherapy (Chic). 1989, 26: 195-199.View Article
- Montgomery GH, Bovbjerg DH: Presurgery distress and specific response expectancies predict post-surgery outcomes in surgery patients confronting breast cancer. Health Psychol. 2004, 23: 381-387.View ArticlePubMed
- Montgomery GH, Kirsch I: Classical conditioning and the placebo effect. Pain. 1997, 72: 107-113. 10.1016/S0304-3959(97)00016-X.View ArticlePubMed
- Leon AC, Demirtas H, Hedeker D: Bias reduction with an adjustment for participants’ intent to drop out of a randomized controlled clinical trial. Clin Trials. 2007, 4: 540-547. 10.1177/1740774507083871.View ArticlePubMed
- Atkinson MJ, Sinha A, Hass SL, Colman SS, Kumar RN, Brod M, Rowland CR: Validation of a general measure of treatment satisfaction, the Treatment Satisfaction Questionnaire for Medication (TSQM), using a national panel study of chronic disease. Health Qual Life Outcomes. 2004, 2: 12-10.1186/1477-7525-2-12.PubMed CentralView ArticlePubMed
- Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD: Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann. 1979, 2: 197-207. 10.1016/0149-7189(79)90094-6.View ArticlePubMed
- Nguyen TD, Attkisson CC, Stegner BL: Assessment of patient satisfaction: development and refinement of a service evaluation questionnaire. Eval Program Plann. 1983, 6: 299-313. 10.1016/0149-7189(83)90010-1.View ArticlePubMed
- Schulz KF, Altman DG, Moher D, for the CONSORT Group: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomized trials. BMJ. 2010, 340: c332-10.1136/bmj.c332.PubMed CentralView ArticlePubMed
- Faul F, Erdfelder E, Lang AG, Buchner A: G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007, 39: 175-191. 10.3758/BF03193146.View ArticlePubMed
- National classification of Romanian psychology programs and departments. [http://chestionar.uefiscdi.ro/docs/programe_de_studii.pdf] Last accessed: 7 December 2013
- MERIL - Mapping of the European Research Infrastructure Landscape. [http://portal.meril.eu/converis-esf/publicweb/research_infrastructure/3446] Last accessed: 7 January 2014
- Demšar J: Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res. 2006, 7: 1-30.
- CDC - burden of mental illness - mental illness - mental health basics - mental health. [http://www.cdc.gov/mentalhealth/basics/burden.htm] Last accessed: 22 May 2013
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.