- Study protocol
- Open Access
- Open Peer Review
Reducing depressive symptomatology with a smartphone app: study protocol for a randomized, placebo-controlled trial
Trialsvolume 18, Article number: 215 (2017)
Depression has become one of the leading contributors to the global disease burden. Evidence-based treatments for depression are available, but access to them is still limited in some instances. As technology has become more integrated into mental health care, computerized cognitive behavioral therapy (CBT) protocols have become available and have been recently transposed to mobile environments (e.g., smartphones) in the form of “apps.” Preliminary research on some depression apps has shown promising results in reducing subthreshold or mild to moderate depressive symptoms. However, this small number of studies reports a low statistical power and they have not yet been replicated. Moreover, none of them included an active placebo comparison group. This is problematic, as a “digital placebo effect” may explain some of the positive effects documented until now. The aim of this study is to test a newly developed mobile app firmly grounded in the CBT theory of depression to determine whether this app is clinically useful in decreasing moderate depressive symptoms when compared with an active placebo. Additionally, we are interested in the app’s effect on emotional wellbeing and depressogenic cognitions.
Romanian-speaking adults (18 years and older) with access to a computer and the Internet and owning a smartphone are included in the study. A randomized, three-arm clinical trial is being conducted (i.e., active intervention, placebo intervention and delayed intervention). Two hundred and twenty participants with moderate depressive symptoms (i.e., obtaining scores >9 and ≤16 on the Patient Health Questionnaire, PHQ-9) will be randomized to the three conditions. Participants undergoing therapy, presenting serious mental health problems, or legal or health issues that would prevent them from using the app, as well as participants reporting suicidal ideation are excluded. Participants randomized to the active and placebo interventions will use the smartphone app for 6 weeks. A short therapist check-in via phone will take place every week. Participants in the delayed-intervention condition will be given access to the app after 6 weeks from randomization. The primary outcome is the level of depressive symptomatology. The intervention delivered through the app to the active condition includes psychoeducational materials and exercises based on CBT for depression, while the placebo intervention uses a sham version of the app (i.e., similar structure of courses and exercises).
To our knowledge, this study protocol is the first to test the efficacy of a smartphone app for depressive symptomatology in the form of a randomized controlled trial (RCT) that includes an active placebo condition. As such, this can substantially add to the body of evidence supporting the use of apps designed to decrease depression.
ClinicalTrials.gov, identifier: NCT03060200. Registered on 1 February 2017. The first participant was enrolled on 17 February 2017.
Depression is a highly prevalent and burdensome condition worldwide. According to the World Health Organization, by 2030 depression will be the main contributor to the global disease burden (GDB) .
While effective, evidence-based treatments for depression do exist, they are sometimes not accessed appropriately due to a variety of reasons. In fact, fewer than half of those in need of treatment (and in many countries, fewer than 10%) receive adequate care . Barriers to treatment access include stigma, logistical costs, or the limited availability of adequately trained therapists [3, 4]. In this context, increasing treatment accessibility for people suffering from depression is critical.
As technology has become more integrated into mental health care [5, 6] and Internet access has increased , computerized treatment protocols have been proposed as potential solutions to overcome the issue of treatment accessibility [8,9,10,11]. Cognitive behavioral therapy (CBT), one of the best empirically supported psychological treatments for depression , has been adapted for online formats, and research has shown that computerized CBT protocols for depression could yield results comparable to face-to-face CBT in both adult and youth samples [13, 14]. Furthermore, computerized CBT programs for depression show a higher moderate effect size compared to control conditions, with even better results in the case of assisted programs . Yet, many studies testing computerized CBT for depression are of low quality, few included an active placebo group, and even fewer have investigated the mechanisms of change . Moreover, the benefits of treatment have been reported to be rather short lived, the impact on functioning was found to be minimal, and high attrition rates seriously limited the potential clinical benefits . However, in the rush to develop highly accessible, attractive and flexible technological solutions for mental health problems, the problems associated with computerized CBT for depression have been largely ignored.
Framework and rationale of the present study
In the recent years, some computerized CBT protocols have transitioned to mobile environments (e.g., smartphones) in the form of “apps.” These apps have been designed to allow an even more flexible and personalized treatment for depression. However, since very few of them have ever been tested in randomized clinical trials  it is largely unclear if they are beneficial, or, perhaps more importantly, if they might have unintended side effects. Some of these apps claim to provide elements congruent to the best practice guidelines in the field (e.g., being CBT-inspired), but they vary widely in scope, content, and complexity. To our knowledge, none has provided comprehensive evidence-based support for their efficacy.
Several preliminary studies on some depression apps have shown promising results in reducing subthreshold or mild to moderate depressive symptoms [19,20,21,22,23,24]. Still, such studies are small (pilot studies), too few, and not replicated . Moreover, none of them included an active placebo comparison group. This is problematic, as a “digital placebo effect” may explain – at least partially – some of the positive effects documented by the few existing studies . Such placebo effects could be the result of a variety of factors such as cognitive distraction, behavioral activation (BA), positive expectations (demand effects), the perception of the smartphone as being an extension of self (which could result in feeling better just because the person receives messages and advice through a familiar, personal device;  or a combination of these.
In short, the evidence supporting the use of apps designed to decrease depression is mounting, but consistent, additional, experimentally sound work is needed before we can draw clear conclusions.
To discern between a genuine clinical effect and a placebo effect, we need to compare outcomes from participants using an actual app with those from participants using a sham version of it. The present study has been designed specifically to achieve this desiderate. We aim to test a newly developed mobile app firmly grounded in the CBT theory of depression to determine whether this app is clinically useful in decreasing moderate depressive symptoms when compared with an active placebo. Additionally, we are interested in the app’s potential to contribute to the reduction of general negative affect, increasing positive affect, and boosting satisfaction with life. Last, but not least, we aim to verify whether the usage of the tested app can modify depressogenic cognitions.
This study is a randomized, placebo-controlled trial examining the effects of an mHealth CBT intervention in reducing depressive symptomatology for people with moderate symptoms. Participants are randomly assigned to one of the three arms of the trial: (1) mHealth CBT intervention, (2) placebo intervention (PI), and (3) delayed intervention (wait-list; WL). Major assessments are at baseline, mid-intervention, post intervention, and 3-month follow-up. The participants randomized to the PI and WL trial arms are offered access to the mHealth app upon the completion of the study.
The Consolidated Standards of Reporting Trials (CONSORT) guidelines  and the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) Statement 2013  are followed (see also Additional file 1: SPIRIT 2013 Checklist: recommended items to address in a clinical trial protocol and related documents).
Participants are blinded to the nature of the placebo intervention, but they are informed that they have a 1 in 3 chance of being assigned to the PI group.
Generic description of the tested application
DCombat is an innovative smartphone app that uses the basic principles of CBT in treating depressive symptoms. It is available for download for iOS and Android and has the following features:
Profile and overview section: following the login, the first screen of the application (“profile” or homepage) offers the user the possibility of choosing and personalizing an avatar. On subsequent occasions, at every login, this first screen summarizes information about the user’s activity and therapeutic progress in a simple and attractive format: the user can check their current “energy level” reached from using the app, their progress through its contents. The app incorporates an attractive design in both the visual presentation and flow of activities [27, 28]. Borrowing from gamification strategies , the app integrates two graphical representations similar to role-play games: “Energy” and “Level.” Energy represents a percentage value that decreases over time if the app is not used. The objective is to keep the energy level as close to 100% as possible. Reading articles, completing CBT-inspired exercises and filling out questionnaires are all rewarded with an energy boost. Level represents the user’s progress through the educational articles – reading each article increases the level by 1. The goal is to reach the maximum level (i.e., level 12). The overview provided on the first screen also includes a chart representing the user’s progress in improving their mood over time, measured via a scale in the Evaluation section. The overview screen also provides tasks (similar to homework assigned used in face-to-face therapy) in the form of “missions” that are to be completed by the user. Over the course of the program different missions encourage the users to read articles, fill out questionnaires, plan daily activities, and practice rational thinking by doing the existing exercises. When completing missions users are awarded with “achievements” that provide positive feedback. Achievements are always presented on the profile screen to further incentivize and reward consistent app usage. (see Fig. 1 below, for an example of the profile and overview section)
Psychoeducation section: this section contains articles and self-help materials covering topics such as the causes of depression, the impact of dysfunctional thinking patterns and unproductive behaviors, healthy and unhealthy negative emotions, as well as a series of educational videos about relaxation techniques
Exercises: the app contains a series of guided cognitive restructuring and behavioral activation (BA) exercises, following the ABCDE model of emotional disturbance [30, 31], and the Brief Behavioral Activation Treatment for Depression described by Lejuez, Hopko, and Hopko , respectively. The cognitive restructuring exercises are based on a model where each emotion is assigned to several activating events and the specific underlying rational/irrational beliefs – so that the user is automatically guided through rational thinking patterns without the need for therapist feedback. The BA exercises allow the user to insert content in specific exercise tabs designed around goals, and pleasant activities to be used in the pursuit of these goals (see Fig. 2 for an overview of the “Exercises” section). Completing each activity and exercise is rewarded graphically through a notification and an increase of the Energy percentage (see Fig. 3 below, for an example of the Exercises section – cognitive restructuring exercise)
Evaluation section: within the app, the user can fill out questionnaires related to the study being conducted which include a mood inventory. The mood inventory updates the progress graph on the profile section, described earlier. Whenever a new evaluation is due, the user is notified and rewarded with more Energy after completing it.
“Messages” section: each week the users are encouraged, via automated messages, to read articles and use the exercises available. They are also reminded to complete that week’s assessment. Moreover, this section allows them to send messages to the research team regarding technical difficulties or other obstacles encountered in using the application’s interface. The user can also use this feature for clinical support or guidance.
The study population consists of Romanian adults with moderate depressive symptomatology. The study is being implemented through the Babeș-Bolyai University, Cluj-Napoca, Romania.
Healthy Romanian-speaking adults (18 years or older), with access to a computer, a smartphone (Android or iOS), and the Internet are included in the study. The Structured Clinical Interview for Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV) (SCID) , specifically, the Overview Module will be used to determine the general clinical status of the participants. A clinical psychologist will conduct a short interview aimed to screen for exclusion criteria (see below). Information on drug use and physical and psychological treatment status will be collected. In addition, to be included in the study, participants should report a Patient Health Questionnaire-9 (PHQ-9) score above 9, but no greater than 16.
Participants undergoing therapy (i.e., medication and/or psychotherapy), or presenting substance abuse problems, psychotic symptoms, organic brain disorders (e.g., dementia), self-injury or harming others, or serious health issues that would prevent from using the app, as well as participants reporting scores greater than 1 to question 9 (suicidal ideation) on the PHQ-9  are excluded.
The mHealth intervention
The mHealth CBT intervention comprises the following components: four online intervention modules with specific courses and exercises, activated gradually, a specific assignment for each module, regular automatic messages and assessments, and a therapist check-in per each module.
Courses represent the psychoeducational and therapeutic background of the intervention, and include the following topics: information on depression, psychological vulnerability, what CBT is, healthy and unhealthy negative emotions, how behaviors contribute to depression, psychological vulnerability, rational and irrational thoughts, treatment adherence, suicidal thoughts, sleep hygiene, social support, relaxation techniques, and relapse prevention
Exercises use the information presented in the courses and follow the structure of a regular therapy session and/or therapeutic homework
The following exercises are included in the app:
The Emotional Pulse exercise registers the user’s current activity and emotions (healthy or unhealthy)
The BA exercises – “My Goals” and “My Activities,” consisting of setting goals and building a list of rewards/pleasant activities to be used in the pursuit of these goals
The Find Irrational Thoughts exercise helps in identifying thoughts behind the emotions found with the Emotional Pulse exercise, and
The Change Irrational Thoughts exercise challenges negative/irrational thinking behind unhealthy emotions and replaces it with healthy, flexible, and functional thoughts
Module 1 of the intervention presents information on depression, introduces the user to the CBT approach, and discusses healthy and unhealthy emotions and behaviors. It also introduces the Emotional Pulse and My Goals exercises. Information on suicidal thoughts and treatment adherence is also available.
Module 2 presents information on psychological vulnerability and rational and irrational beliefs, while introducing the Find Irrational Thoughts and Change Irrational Thoughts exercises.
Module 3 presents information on relaxation techniques, also providing video support, along with information on sleep hygiene and social support.
Module 4 focuses on relapse prevention and continued practice of all the exercises.
Participants are informed that they should complete one module every 10 days, within 6 weeks.
Three clinical psychologists provide all clinical contact with the active and placebo intervention participants, via phone calls. Every call is audiorecorded with the participant’s consent. The total therapist time spent per participant is also recorded. The therapists are instructed to limit contact time to approximately 5 min per participant, unless more time is clinically indicated. The therapist check-in component has the role of monitoring app use and mood status, without engaging in therapy, but encouraging intervention adherence.
The placebo control group
The active placebo intervention will be delivered via the same platform and largely in the same format as the tested app: it will include largely the same sections and features as the original app (i.e., profile, courses, exercises, evaluation, and messages). The psychoeducation section, although mirroring the structure of the corresponding section in the original app, will include different content, elaborating on common sense strategies of overcoming depression (like positive thinking, listening to music, etc.) and general knowledge about mental and physical health-relevant topics. A Sticky Notes tab will be available in the exercises section, giving the user the possibility of adding content, while suggesting two possible topics: favorite quotes, and a reading journal.
The wait-list control group
Participants in the delayed-intervention group are placed on a wait-list for 6 weeks; then they are given full access to the application.
Outcomes and measures
The level of depressive symptomatology constitutes the primary outcome.
General positive and negative affect and satisfaction with life constitute the secondary outcomes which have been included to assess the efficacy of the application beyond its impact on specific clinical symptoms, e.g., as a possible tool for the improvement of life quality and general wellbeing.
Dysfunctional cognitions, irrational beliefs, and negative automatic thoughts (conceptualized as mechanisms of change) and BA and/or avoidance will be considered as possible predictors of the outcomes. Satisfaction with the application and data regarding the app usage are also assessed.
The instruments used for each of the abovementioned outcomes are presented below:
The PHQ-9  is a nine-question instrument designed to correspond to the Diagnostic and Statistical Manual of Mental Disorder, Fourth Edition, Revised Text (DSM-IV-TR)  diagnostic criteria for major depressive disorder. Respondents rate the items from 0 to 3 according to the frequency of their experience over the previous 2-week period (0 – not at all; 3 – nearly every day). The score can then be interpreted as indicating depression severity (no depression, mild, moderate, moderately severe, or severe depression).
Measures of primary, secondary, and other outcomes
The following measures have been adapted into Romanian and successfully used in two previous trials testing another version of the app, and they have shown adequate psychometric properties .
The level of depressive symptomatology is assessed with the Center for Epidemiologic Studies Depression Scale–Revised (CESD-R) [37, 38]. The CESD-R is a 20-item self-report instrument, which measures symptoms of depression in nine different groups: sadness (dysphoria), loss of interest (anhedonia), appetite, sleep, thinking/concentration, guilt (worthlessness), tiredness (fatigue), movement (agitation), and suicidal ideation. Participants rate each item on a 5-point Likert scale, from 0 (not at all or less than 1 day) to 4 (nearly every day for 2 weeks) to indicate how they felt or behaved during the last week or so. The total CESD-R score is calculated as a sum of responses to all 20 questions. The CESD-R exhibited good psychometric properties, including high internal consistency, strong factor loadings, and theoretically consistent convergent and divergent validity with anxiety, schizotypy, and positive and negative affect .
The Positive and Negative Affect Scale (PANAS)  is a 20-item self-report questionnaire designed to assess mood. It consists of 10 items that address positive affect (PA) and 10 items that address negative affect (NA). Participants rate each item on a 5-point Likert scale, from 1 (very slightly/not at all) to 5 (extremely) to indicate how they felt during the indicated time frame. The PANAS can be used to assess mood on various time scales by altering the instructions. For the purposes of this study we have used a 2-week time frame. The validity and internal consistency of the PANAS are good, with test-retest reliability being the highest for the “general” temporal instruction. The PANAS has been used previously on the Romanian population and was found to have adequate psychometric properties [41, 42].
Satisfaction with Life (SWL)  is a five-item scale designed to measure global cognitive judgments of one’s life satisfaction. Participants rate each of the five items using a 7-point scale that ranges from 7 (strongly agree) to 1 (strongly disagree). The SWL has been shown to be a valid and reliable measure of life satisfaction which can be used with a wide range of age groups [44, 45].
The Dysfunctional Attitudes Scale (DAS)  was designed to measure the intensity of dysfunctional attitudes, which, according to the cognitive theory of depression , contribute to vulnerability for depression. For the purposes of our study, we used the short form of this scale. The Dysfunctional Attitudes Scale–Short Form (DAS-SF)  consists of two subscales: “dependency” (6 items) and “perfectionism/performance evaluation” (11 items). The 17 items are rated on a 7-point Likert scale, from 1 (total disagreement) to 7 (total agreement). The DAS-SF possesses good psychometric properties in terms of model fit, reliability and convergent construct validity .
The Beliefs Scale (BS)  measures irrational beliefs. It consists of 20 items and responders indicate how much they agree or disagree with each item using a 5-point Likert scale that ranges from 1 (strongly disagree) to 5 (strongly agree). The BS shows good psychometric properties regarding construct and discriminant validity .
The Automatic Thoughts Questionnaire (ATQ)  is a 15-item self-report measure used to assess depression-related cognitions. Participants rate, on a 5-point Likert scale from 1 (never) to 5 (almost all the time), how frequently they have had a given thought over the past week. A higher score shows a higher frequency of automatic thoughts. The psychometric properties of the ATQ have been adequately demonstrated in previous studies . The ATQ has been successfully used previously on the Romanian population [53,54,55].
The Behavioral Activation for Depression Scale–Short Form (BADS-SF)  is an instrument designed to be administered weekly to measure changes in avoidance and activation over the course of the BA treatment for depression. The BADS consists of nine items grouped into two subscales (Activation and Avoidance/Rumination). Respondents rate each item on a 7-point Likert scale ranging from 0 (not at all) to 6 (completely). The scale enjoys good psychometric properties .
The Satisfaction with the Application Scale was specifically designed for this study. It consists of 10 items that assess users’ satisfaction with the application, its difficulty level, attractiveness, and subjective utility. The first eight items are rated on a 3-point scale, ranging from 0 to 2. Each response scale is personalized to the content of the item (e.g., How attractive did you find the exercises included in the application?: 0 = rather unattractive, 1 = attractive enough, 2 = very attractive). Item 9 assesses the application globally, with the participant being asked to give an overall grade between 1 (minimum) and 10 (maximum). Item 10 asks the participants if they would recommend the application to a friend (“yes” or “no” answer).
The Application Use Scale was also developed specifically for this study. It consists of eight items that assess weekly quantitative app usage aspects: the effort invested in homework (one item), number of practiced exercises (one item), number of read courses (one item), frequency of general application use (one item), and frequency of every exercise use (four items).
Potential participants will be assessed for eligibility through an initial assessment of depressive symptoms. The initial assessment phase consists of administration of the PHQ-9 and a short phone screening interview. Applicants who do not meet the inclusion criteria are informed via e-mail. They are given a summary score and interpretation for their PHQ-9 score and they are encouraged to discuss their problems with a professional, if necessary. Information on how to reach one – a clinical psychologist or a psychotherapist – is also provided.
After the initial assessment, the participants meeting the inclusion criteria will be randomly assigned to one of the three conditions: (1) active intervention condition – mHealth CBT (group 1), (2) the PI (group 2), or (3) the delayed-intervention condition (WL) (group 3) (see flow diagram in Fig. 4). Subsequent assessments consist of all the instruments presented in the “Outcome measures” section. Figure 5 shows the schedule of enrollment, interventions, and assessments which accords with the SPIRIT figure.
The participants in the active intervention and active placebo conditions are assessed at preintervention (time 1 – baseline), at mid-intervention (time 2 – 3 weeks after baseline), at post intervention (time 3 – 6 weeks after baseline), and at 3 months post intervention (time 4). The participants in the delayed-intervention condition are assessed before the waiting period (time 1 – baseline), at mid-waiting period (time 2 – 3 weeks after baseline), and at post waiting period (time 3 – 6 weeks after baseline).
Participants assigned to the active intervention condition will be given access to the online application along with explicit instructions regarding the use of all its sections. Participants will be given 6 weeks to complete the intervention, during which time weekly messages will be sent out to them. Messages include regular assignments designed for a complete and thorough use of the application’s courses and exercises, and encourage the review of materials whenever possible. However, participants are free to use the application at their own pace.
Similarly, the participants in the active placebo condition will be given access to a sham version of the app. During the 6-week intervention period they will be exposed to the same amount of online (i.e., in-app messages) and therapist communication as the active intervention participants.
After each week, participants’ app use is evaluated (see the Application Use Scale described above). Similarly, after each week of using the app, the participants are required to complete the CESD-R to monitor their depressive symptomatology and provide individualized in-app feedback on their emotional state.
The participants in the delayed-intervention condition are placed on a wait-list for 6 weeks, after which time they are given full access to the app.
A total of 165 participants with moderate depressive symptomatology was estimated. This is based on previous studies on the efficacy of mobile phone applications for depression, which reported small to moderate between-group effect sizes [19, 24]. An a priori sample size calculation was conducted with G*Power 188.8.131.52 [58, 59] for analysis of variance (ANOVA) (repeated measures, between factors), assuming an alpha level of 0.05, a statistical power of 0.80, and a small to medium effect size (f = 0.2). Since the current protocol has a therapist check-in component, a sample size recruitment target of N = 220 was set to allow for sample attrition, thus estimating a dropout rate of approximately 30%.
Possible participants are approached through ads on social networks. Those interested in using the application are asked to access the study’s website – www.binedispus.ro, read the information package, and follow the online standard recruitment procedure. They are subsequently contacted by phone, at which point the enrollment procedure is described and the short screening phone interview takes place.
Assignment to study group
The participants are randomly assigned to one of the three trial arms, using the software Randomizer.org. Randomization is performed by a research assistant using a simple (unrestricted) randomization sequence that assigns three unique numbers per participant; the number assigned is either 1, 2, or 3 according to the number of the experimental condition. To conceal the allocation mechanism, the same research assistant will monitor the assessments and allow access to the application for the participants in the wait-list control group after 6 weeks. The principal investigator and the statisticians running the data analysis will remain blinded to the study condition until the completion of the study.
Data collection, management, and analyses
Data collection methods
The initial assessment data are collected via the project website. Afterwards, a research assistant conducts telephone-screening interviews with potential participants to determine eligibility, and provides clinical screening reports. All subsequent assessment data are collected within the application, in the Evaluation section, and transferred to our servers using an encrypted, secure (https) industry-standard transfer protocol.
As far as participant retention and follow-up completion are concerned, the therapist check-in component of both the active and placebo interventions will play an important role. Besides being reminded of the specific assessment that needs to be completed after each intervention module, through the Messages section, the participants will also be encouraged by their assigned therapist to complete the assessments. Also, the therapist informs them that the weekly completion of the mood questionnaires allows the app to create a personalized profile of their mood, along with individualized visual feedback on their emotional state. Moreover, they are rewarded with more Energy after completing every assessment. Finally, for the follow-up assessments, the participants will receive new messages reminding them that free use of the app was possible because of a research grant, and thus data collection is essential. Additionally, participants are informed that they can attend an online psychological assessment with a clinical psychologist, based on the completion of follow-up questionnaires, if they wish to do so.
Post-treatment analyses involve an intent-to-treat (ITT) design with the first available data after the baseline carried forward.
Improvement in the primary outcomes measures scores within and between the groups will be examined using mixed-effects linear regression analyses with a random intercept and slope over time (four assessments: baseline, mid-intervention, post intervention, and follow-up) and fixed effects for intervention assignment. The main analysis will compare groups (active intervention, PI, and WL) in terms of the level of depressive symptoms. When the analysis of secondary/other outcomes is performed, the error probability will be adjusted according to the number of group comparisons performed.
App usage data and user activity will be examined by comparing, for example, the participants’ self-reported activity with their actual app usage as recorded by our software. This will inform us about any obstacles to user adherence to the protocol, as well as specific usage patterns.
Monitoring study implementation
Three clinical psychologists, members of the study team, screen for the risk of unintended effects or harm to the participants (i.e., clinically significant increase in depressive symptomatology as measured by the CESD-R). Every participant’s CESD-R score is assessed weekly and interpreted clinically by the clinician assigned to them. If the participant does not complete the CESD-R assessment, the clinician will address this issue during the phone check-in. If necessary, the therapist can recommend the interruption of the participant’s access to the application.
Ethics and dissemination
The Ethics Commission at Babeș-Bolyai University has approved this study. Although the intervention that it delivers cannot be considered a treatment for depressed people, it does target individuals with moderate depressive symptomatology who may be at risk for developing more severe depressive symptomatology. The screening process and the exclusionary criteria identify people who may be at risk for suicide. These people are immediately referred to the appropriate clinical services. If, during the use of the application, a participant’s condition worsens, the assigned clinician can recommend the interruption of that user’s access to the application. The project supervisor can further decide on such matters and, if necessary, make a further referral or recommendation. As far as data confidentiality is concerned, special efforts were made to secure the data online collection and storage. Both data collection means (i.e., via web browser of the mobile app) communicate with the server over industry-standard secure connections (i.e., https). The server stores the data in a password-protected database that is not publicly accessible. The system running our applications is kept up to date to prevent intrusions. Access to the electronic data is password-protected and only available to the project team of researchers and programmers. The passwords are changed regularly. The clinical screening reports contain no personal identifying information.
Information on the development of the application and its clinical relevance has been presented at several international and national conferences. A first exploratory study protocol on the efficacy of the app in reducing cognitive vulnerability and mild depressive symptoms has already been published . More information regarding research progress and dissemination can be found at the project’s designated website . This trial’s results will be submitted for publication in a peer-reviewed journal, focusing on primary and secondary outcomes results.
This study describes a randomized clinical trial testing a smartphone app aimed at reducing moderate depressive symptoms. The target of this trial represents people with moderate depressive symptomatology. As there is no current clear evidence about the efficacy of smartphone apps in reducing depressive symptomatology, despite some preliminary studies that have shown promising results [19,20,21,22,23,24], this research can contribute substantially to clarifying the therapeutic merits of mobile interventions.
This study’s main aim is to test a newly developed app based on the CBT theory of depression to determine primarily whether this app is clinically useful in decreasing moderate depressive symptoms when compared with an active placebo. To our knowledge, this is the first attempt to test the efficacy of a smartphone app for depressive symptomatology in the form of an RCT that includes an active placebo condition. As such, this can substantially add to the body of evidence supporting the use of apps designed to decrease depression.
Additionally, this study investigates the app’s potential to contribute to the reduction of general negative affect, increasing positive affect, boosting satisfaction with life, and modifying depressogenic cognitions.
Participant recruitment has begun on 15 February 2017. Randomization of the participants was performed on the same day.
Automatic Thoughts Questionnaire
Behavioral Activation for Depression Scale–Short Form
Cognitive behavioral therapy
Center for Epidemiologic Studies Depression Scale–Revised
Dysfunctional Attitudes Scale
Dysfunctional Attitudes Scale–Short Form
Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision
Global Disease Burden
Positive and Negative Affect Scale
Patient Health Questionnaire, 9-item version
Rational Emotive Behavior Therapy
Satisfaction with Life
World Health Organization
World Health Organization. Policies and practices for mental health in Europe. Meeting the challenges. 2008. http://www.euro.who.int/en/publications/abstracts/policies-and-practices-for-mental-health-in-europe.-meeting-the-challenges. Accessed 17 Aug 2015.
WHO. Depression facts sheet. http://www.who.int/en/. 2012. http://www.who.int/mediacentre/factsheets/fs369/en/. Accessed 11 May 2013.
Cuijpers P. The patient perspective in research on major depression. BMC Psychiatry. 2011;11:89.
Goldman LS, Nielsen NH, Champion HC. Awareness, diagnosis, and treatment of depression. J Gen Intern Med. 1999;14:569–80.
Deslich S, Stec B, Tomblin S, Coustasse A. Telepsychiatry in the 21st century: transforming healthcare with technology. Perspect Health Inf Manag AHIMA Am Health Inf Manag Assoc. 2013;10. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3709879/. Accessed 27 Sep 2016.
Mohr DC, Burns MN, Schueller SM, Clarke G, Klinkman M. Behavioral intervention technologies: evidence review and recommendations for future research in mental health. Gen Hosp Psychiatry. 2013;35:332–8.
Miniwatts Marketing Group. World Internet users and population stats. Internet World Stats. 2011. http://en.wikipedia.org/w/index.php?title=Internet&oldid=553100327. Accessed 23 Jun 2011.
Anderson P, Jacobs C, Rothbaum BO. Computer-supported cognitive behavioral treatment of anxiety disorders. J Clin Psychol. 2004;60:253–67.
Marks IM, Kenwright M, McDonough M, Whittaker M, Mataix-Cols D. Saving clinicians’ time by delegating routine aspects of therapy to a computer: a randomized controlled trial in phobia/panic disorder. Psychol Med. 2004;34:9–18.
Marks IM, Mataix-Cols D, Kenwright M, Cameron R, Hirsch S, Gega L. Pragmatic evaluation of computer-aided self-help for anxiety and depression. Br J Psychiatry J Ment Sci. 2003;183:57–65.
McCrone P, Knapp M, Proudfoot J, Ryden C, Cavanagh K, Shapiro DA, et al. Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br J Psychiatry J Ment Sci. 2004;185:55–62.
Cuijpers P, Berking M, Andersson G, Quigley L, Kleiboer A, Dobson KS. A meta-analysis of cognitive-behavioural therapy for adult depression, alone and in comparison with other treatments. Can J Psychiatry Rev Can Psychiatr. 2013;58:376–85.
Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5:e13196.
Richardson T, Stallard P, Velleman S. Computerised cognitive behavioural therapy for the prevention and treatment of depression and anxiety in children and adolescents: a systematic review. Clin Child Fam Psychol Rev. 2010;13:275–90.
Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009;38:196–205.
Mogoașe C, Cobeanu O, David O, Giosan C, Szentagotai A. Internet-based psychotherapy for adult depression: what about the mechanisms of change? J Clin Psychol. 2017;73:5–64.
So M, Yamaguchi S, Hashimoto S, Sado M, Furukawa TA, McCrone P. Is computerised CBT really helpful for adult depression?—A meta-analytic re-evaluation of CCBT for adult depression in terms of clinical implementation and methodological validity. BMC Psychiatry. 2013;13:113.
Anthes E. Mental health: there’s an app for that. Nature. 2016;532:20–3.
Birney AJ, Gunn R, Russell JK, Ary DV. MoodHacker mobile web app with email for adults to self-manage mild-to-moderate depression: randomized controlled trial. JMIR MHealth UHealth. 2016;4. doi:10.2196/mhealth.4231.
Burns MN, Begale M, Duffecy J, Gergle D, Karr CJ, Giangrande E, et al. Harnessing context sensing to develop a mobile intervention for depression. J Med Internet Res. 2011;13:e55.
Kauer SD, Reid SC, Crooke AHD, Khor A, Hearps SJC, Jorm AF, et al. Self-monitoring using mobile phones in the early stages of adolescent depression: randomized controlled trial. J Med Internet Res. 2012;14:e67.
Proudfoot J, Clarke J, Birch M-R, Whitton AE, Parker G, Manicavasagar V, et al. Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial. BMC Psychiatry. 2013;13:312.
Reid SC, Kauer SD, Khor AS, Hearps SJC, Sanci LA, Kennedy AD, et al. Using a mobile phone application in youth mental health—an evaluation study. Aust Fam Physician. 2012;41:711–4.
Watts S, Mackenzie A, Thomas C, Griskaitis A, Mewton L, Williams A, et al. CBT for depression: a pilot RCT comparing mobile phone vs computer. BMC Psychiatry. 2013;13:49.
Schulz KF, Altman DG, Moher D, for the CONSORT Group. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340(1):c332.
Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158:200–7.
Crutzen R, de Nooijer J, Brouwer W, Oenema A, Brug J, de Vries NK. A conceptual framework for understanding and improving adolescents’ exposure to Internet-delivered interventions. Health Promot Int. 2009;24:277–84.
Ritterband LM, Thorndike FP, Cox DJ, Kovatchev BP, Gonder-Frederick LA. A behavior change model for internet interventions. Ann Behav Med Publ Soc Behav Med. 2009;38:18–27.
Zichermann G, Cunningham C. Gamification by design: implementing game mechanics in web and mobile apps. Sebastopol: O’Reilly Media, Inc.; 2011.
Ellis A. Reason and emotion in psychotherapy. Carol Pub. Group: Secaucus; 1994.
Ellis A, Dryden W, DiGiuseppe R. The practice of rational emotive behavior therapy. New York: Springer Publishing Company; 2007.
Lejuez CW, Hopko DR, Hopko SD. A brief behavioral activation treatment for depression. Treatment manual. Behav Modif. 2001;25:255–86.
First MB, Spitzer RL, Williams JBW, Gibbon M. Structured clinical interview for DSM-IV (SCID). Washington, D.C.: American Psychological Association; 1997.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–13.
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition: DSM-IV-TR®. Washington: American Psychiatric Pub; 2000.
Giosan C, Mogoaşe C, Cobeanu O, Szentágotai Tătar A, Mureşan V, Boian R. Using a smartphone app to reduce cognitive vulnerability and mild depressive symptoms: study protocol of an exploratory randomized controlled trial. Trials. 2016;17:609.
Eaton W, Muntaner C, Smith C, Tien A, Ybarra M. Center for Epidemiologic Studies Depression Scale: review and revision (CESD and CESD-R). In: Maruish M, editor. The use of psychological testing for treatment planning and outcomes assessment. 3rd ed. Mahwah: Lawrence Erlbaum; 2004. p. 363–74.
Radloff LS. The CES-D scale a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1:385–401.
Van Dam NT, Earleywine M. Validation of the Center for Epidemiologic Studies Depression Scale-Revised (CESD-R): pragmatic depression assessment in the general population. Psychiatry Res. 2011;186:128–32.
Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: The PANAS scales. J Pers Soc Psychol. 1988;54:1063–70.
Cristea IA, Matu S, Szentagotai Tătar A, David D. The other side of rumination: reflective pondering as a strategy for regulating emotions in social situations. Anxiety Stress Coping. 2013;26:584–94.
Levine EL, Xu X, Yang L-Q, Ispas D, Pitariu HD, Bian R, et al. Cross-national explorations of the impact of affect at work using the state-trait emotion measure: a coordinated series of studies in the United States, China, and Romania. Hum Perform. 2011;24:405–42.
Diener E, Emmons RA, Larsen RJ, Griffin S. The Satisfaction with Life Scale. J Pers Assess. 1985;49:71–5.
Pavot W, Diener E, Colvin CR, Sandvik E. Further validation of the Satisfaction with Life Scale: evidence for the cross-method convergence of well-being measures. J Pers Assess. 1991;57:149–61.
Pavot W, Diener E. Review of the Satisfaction with Life Scale. Psychol Assess. 1993;5:164–72.
Weissman AN, Beck AT. Development and validation of the Dysfunctional Attitude Scale: a preliminary investigation. Chicago;1978. http://www.eric.ed.gov/ERICWebPortal/detail?accno=ED167619. Accessed 22 May 2013.
Beck AT. Cognitive therapy and the emotional disorders. Boston: International Universities Press; 1976.
de Graaf LE, Roelofs J, Huibers MJH. Measuring dysfunctional attitudes in the general population: the dysfunctional attitude scale (form A) revised. Cogn Ther Res. 2009;33:345–55.
Malouff JM, Schutte NS. Development and validation of a measure of irrational belief. J Consult Clin Psychol. 1986;54:860–2.
Malouff JM, Valdenegro J, Schutte NS. Further validation of a measure of irrational belief. J Ration Emotive Ther. 1987;5:189–93.
Hollon SD, Kendall PC. Cognitive self-statements in depression: development of an automatic thoughts questionnaire. Cogn Ther Res. 1980;4:383–95.
Harrell TH, Ryon NB. Cognitive-behavioral assessment of depression: clinical validation of the automatic thoughts questionnaire. J Consult Clin Psychol. 1983;51:721–5.
David D. Scale de evaluare clinică. Cluj Napoca: Romanian Psychological Testing Services; 2007.
Moldovan R, Cobeanu O, David D. Cognitive bibliotherapy for mild depressive symptomatology: randomized clinical trial of efficacy and mechanisms of change. Clin Psychol Psychother. 2013;20:482–93.
Vîslă A, Cristea IA, Szentágotai Tătar A, David D. Core beliefs, automatic thoughts and response expectancies in predicting public speaking anxiety. Personal Individ Differ. 2013;55:856–9.
Kanter JW, Mulick PS, Busch AM, Berlin KS, Martell CR. The Behavioral Activation for Depression Scale (BADS): psychometric properties and factor structure. J Psychopatology Behav Assess. 2007;29:191–202.
Manos RC, Kanter JW, Luo W. The Behavioral Activation for Depression Scale-short form: development and validation. Behav Ther. 2011;42:726–39.
Faul F, Erdfelder E, Buchner A, Lang A-G. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41:1149–60.
Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39:175–91.
Project Dcombat: a computerized preventative and therapeutic intervention for depression. http://dcombat.net/en/. Accessed 15 Apr 2017.
The authors thank CheckWare (Trondheim, Norway), for their support in the implementation of data collection and Prof. Tore Stiles (Norwegian University of Science and Technology – NTNU, Trondheim, Norway) for his feedback on the app features.
Availability of data and materials
Upon the completion of the study, supporting data will be available upon request.
CG, OC, and CM contributed to study design, drafted and revised the manuscript. CG and VM contributed to the app design and features. AS contributed to the design of the RCTs. RB developed the software. CG approved the final draft of the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
SPIRIT 2013 Checklist: recommended items to address in a clinical trial protocol and related documents. (DOC 122 kb)