- Study protocol
- Open Access
0Phobia – towards a virtual cure for acrophobia: study protocol for a randomized controlled trial
Trials volume 19, Article number: 433 (2018)
Virtual reality exposure therapy (VRET) has been shown to be as effective as traditional forms of in vivo exposure therapy for the treatment of specific phobias. However, as with in vivo exposure, VRET still involves relatively high costs and limited accessibility which makes it prohibitive for a large part of the population. Innovative methods using smartphone applications (apps) may improve accessibility and scalability of VRET. The aim of this study is to evaluate 0Phobia, a gamified self-guided VRET for acrophobia that is delivered through a smartphone app in combination with rudimentary cardboard virtual reality (VR) goggles.
Participants (N = 180, aged 18–65 years) with acrophobia symptoms will be recruited from the Dutch general population and randomized to either 0Phobia (n = 90) or a waitlist control condition (n = 90). 0Phobia will be delivered over a period of 3 weeks and includes psychoeducation, VR exposure, cognitive techniques, monitoring of symptoms, and relapse prevention. The primary outcome measure will be the Acrophobia Questionnaire. Secondary outcome measures will include user-friendliness, symptoms of anxiety, depression, and mastery. Assessments will take place online at baseline, directly after the intervention (post test) and at follow-up (3 months).
This study capitalizes on novel technology and recent scientific advances to develop an affordable and scalable treatment modality.
Netherlands Trial Register: NTR6442. Registered on 29 June 2017.
With lifetime prevalence estimates of between 8 and 15% [1, 2], specific phobias rank among the most prevalent mental disorders, along with depressive disorders and social phobia . The lifetime prevalence of specific phobias in the Netherlands is nearly 8%. Around 530,000 people in the Netherlands currently suffer from one or more specific phobias and each year there are 75,000 new cases with a specific phobia diagnosis . In the general EU population, 18.5 million people are estimated to suffer from a specific phobia . Acrophobia is the most prevalent of all specific phobia subtypes [5, 6]. Due to high treatment costs, long waiting lists, and a general reluctance to seek treatment , access to evidence-based therapy is currently limited. If left untreated, specific phobias can become chronic and increase the risk of developing other mental disorders, such as anxiety and depression, especially for women . Given the psychological burden that phobias carry, along with an increased risk of developing comorbid depressive and anxiety disorders, and the economic burden for society , there is an evident need for affordable and scalable self-help interventions.
Specific phobias have a lengthy history of clinical research and effective treatment exists . In exposure therapy a person is gradually exposed to the object or situation of their fear. Meta-analyses have repeatedly demonstrated the effectiveness of exposure to reduce anxiety levels of specific phobias in different settings (e.g., [10, 11]). In fact, exposure therapy is among the most effective treatments existing in psychological health care .
Virtual reality exposure therapy (VRET)
Over the past decades, a new type of treatment based on the principles of exposure therapy has emerged. This new form of exposure therapy relies on virtual reality (VR) rather than exposure “in vivo.” In VRET, artificially created computer-generated environments replace real-life settings. Individual studies as well as meta-analyses on treatment effectiveness for people suffering from anxiety disorders, and specific phobias in particular, have shown VRET to be as effective as traditional forms of exposure therapy in reducing anxiety (e.g., [12,13,14,15,16,17]). For example, in a recent meta-analysis of 14 studies , participants in the VRET condition for specific phobias improved significantly on behavioral assessments after VRET from pre to post test (aggregated uncontrolled effect size g = 1.23) as well as when compared with waitlist control subjects (g = 1.41). Additionally, there were no significant differences in terms of effectiveness between VRET and exposure in vivo at post test and follow-up (g = − 0.09 and 0.53, respectively), although results should be interpreted with caution as these studies were not adequately powered. Furthermore, in a meta-analysis by Opriş et al. , results demonstrated that VRET has better outcomes than waitlist controls, similar efficacy for VRET and cognitive behaviour therapy (CBT), and no difference in dropout rate between VRET and traditional exposure in vivo.
Aside from demonstrated effectiveness for anxiety disorders, and specific phobias in particular, VRET has a number of additional advantages over traditional “in vivo” treatment, such as the possibility to conduct it within the confines of the therapist’s office rather than having to go outside. Furthermore, VRET offers more flexibility in terms of sequencing, intensity of treatment, and graduality of exposure . That is, people can practice more often and with a larger variety of scenarios compared to in vivo exposure, which may optimize exposure therapy . Also, in VR, serious gaming elements can be integrated during exposure, which may reduce distress as compared with traditional exposure therapy . Continuous confrontation with phobic stimuli may be facilitated by a gamified VR content that can be played repeatedly [20, 21].
Nonetheless, in spite of having several advantages over traditional in vivo therapy, VRET still involves relatively high costs and limited accessibility which make it prohibitive for a large part of the population. Existing VRETs tend to require heavy graphic processing capabilities not found in ordinary computers and mobile devices. Finally, and importantly, existing VRETs still require the intervention of a therapist.
Mobile app interventions
Recent research has demonstrated the efficacy of mobile-app-based therapies for anxiety and depression [22, 23]. App-based mental health interventions based on CBT principles have shown to be effective in reducing mental health symptoms (e.g.,  for a review) and guided Internet interventions have proven potential to be cost-effective ( for a review, ).
Advantages of app-based interventions compared to traditional therapy include high accessibility, real-time progress monitoring, portability, flexibility, and cost-effectiveness . To the best of our knowledge, so far only one study has investigated the effectiveness of guided VRET using a mobile application and VR goggles. This intervention led to a significantly reduced fear of spiders , although older technology (red/blue anaglyph glasses and a computer monitor) was used. Another study, in which the effectiveness of guided VRET on a smartphone and VR goggles compared with traditional one-session exposure therapy for subjects with spider phobia, is currently being evaluated . To our knowledge, no studies have yet explored the feasibility and efficacy of (1) self-guided VRET delivered through a smartphone app using (2) low-cost VR goggles for acrophobia. Instead of high-end head mounted displays (e.g., Samsung Gear VR), we use rudimentary 10-dollar cardboard VR goggles. The aim of this project is to test a self-guided, stand-alone treatment modality for acrophobia symptoms through exposure therapy by integrating VR technology with a smartphone app. The acrophobia intervention will be tested for user-friendliness as well as its effectiveness in reducing acrophobia symptoms for adults from the general Dutch population with acrophobia symptoms using a randomized controlled trial (RCT) design. We hypothesize that participants in the experimental condition will show a significant reduction in acrophobia symptoms at post test and follow-up compared to baseline and significantly less acrophobia symptoms than the waitlist control condition.
A RCT will be carried out, in which the efficacy and user-friendliness of a self-guided, 3-week, mobile-app-based VR self-guided treatment “0Phobia” will be evaluated. In total, 180 participants from the Dutch general population will be randomized to two conditions: the experimental condition (0Phobia; n = 90) and a waitlist condition (n = 90). Measures will be taken at baseline and directly after the intervention (post test). After post-test assessment, the waitlist group will be granted access to the intervention. The experimental condition will receive a final follow-up questionnaire 3 months after baseline (follow-up). All measures will be completed online. Two reminders will be send (one by email, one by telephone) if necessary. This study has received ethical approval by the Medical Ethics Committee of the VU University Medical Center (registration number 2016–563) (Trial registration: NTR 6442). Figure 1 presents the flowchart of the study.
Advertisements with a call to participate in a VR mobile app study for acrophobia will be posted on several websites (e.g., proefpersonen.nl, Facebook) and in magazines (e.g., VU magazine). Media coverage in national television and radio broadcasts will provide additional publicity for the study. Potential participants are directed to the study website (http://www.0-phobia.nl) where information about the study is provided including eligibility criteria. Interested participants can leave their contact details at the website. The research team will send them a screening questionnaire to assess eligibility. Ineligible participants will be automatically directed to a screen explaining why they cannot participate in the study. The screening questionnaire assesses level of depression and suicidal thoughts, inclusion and exclusion criteria only. Participants excluded as a result of high levels of depression are advised to contact their general practitioner (GP). In case of high risk for suicide, participants are contacted by telephone by a member of the research team. The participant will be asked for permission to contact their GP.
Eligible participants receive an information letter and consent form with a return envelope. If necessary, they will be reminded by email to complete the informed consent (two reminders in total). After receiving the signed consent form, participants are invited to fill out an online screening battery. After completion, an independent researcher will assign participants to either the experimental condition or the waitlist condition based on the randomization list which is created by using Random Allocation Software. The participants will be send an email stating to which condition they are assigned. Participants assigned to the intervention condition will be sent the VR goggles by postal delivery – along with user instructions for the VR goggles, instructions to conduct the VR sessions (e.g., to start sitting and when anxiety decreases to stand up, to remove sharp objects in their vicinity to avoid injury, to practice each day at a set time), and instructions on how to download and use the 0Phobia app.
The app is accessed with a unique individual code on the participant’s own smartphone. Once the app is installed, participants can begin with 0Phobia intervention which they can follow for 3 weeks at their own pace. During this 3-week period participants receive weekly motivational emails with information reminding them to start or continue with 0Phobia to increase intervention adherence. These emails will be sent unconditional of app activity.
If participants have questions or experience severe distress, they are encouraged to contact the research team.
After module 6, participants are encouraged to seek out heights in real life. Therefore, participants who finish 0Phobia who have finished module 6 earlier than the 3 weeks will receive an email with a link to the Acrophobia Questionnaire (AQ ) in order to obtain estimates of the treatment on levels of acrophobia through VR exposure.
Directly following the conclusion of 0Phobia, participants are sent a link to the online post test. After completing the post test, the waitlist condition will be granted access to the 0Phobia therapy. After 3 months, participants in the experimental condition are asked to fill in the follow-up questionnaire.
Inclusion and exclusion criteria
A sample of 180 individuals (aged 18–65 years) with symptoms of acrophobia will be recruited among the Dutch population. Inclusion criteria are a sufficient level of AQ-Anxiety (AQ score of 45.45, which is one standard deviation below the mean of a previous acrophobic sample; [28, 29]) having access to an Android smartphone (Android v.5.1 Lollipop or higher, 4.7–5.5-in. screen and gyroscope) with Internet, and having provided informed consent. Participants outside the 18–65 years age range, participants with insufficient knowledge of the Dutch language, those under treatment for a specific phobia or taking psychotropic medication (unless on stable dosage for the previous 3 months and no changes planned during the study period), and participants with symptoms of severe depression (Patient Health Questionnaire (PHQ-9); total score > 19) or suicidality (Web Screening Questionnaire; WSQ, score 3; ), are excluded from participation. Suicidal ideation will be measured using one item about suicidal ideation from the Screening Questionnaire  that has been translated for the Dutch population in the WSQ : “has the idea of harming yourself, or taking your own life, recently come into your mind?” Answer options are: (1) “Definitely not”; (2) “I seriously considered it but I stopped myself”; (3) “I would do it given the opportunity.” Participants with a score of 3 will be excluded from participation and will be contacted by a member of the research team.
The primary outcome measure, the AQ, has been used for the power calculations. In previous RCTs using the AQ as an outcome measure, effect sizes of 0.79–1.42 [14, 15] were demonstrated. However, as the present intervention will use low-end cardboard VR goggles instead of expensive head-mounted displays, the current study uses a more conservative estimate for the post-treatment effect on the AQ. In order to detect a difference between the experimental and the waitlist control condition with a standardized effect size (Cohen’s d) of 0.50 (two-sided), an alpha of 0.05 and statistical power (1 − β) of 0.80, we need 64 participants in each condition (128 participants in total). With an anticipated dropout of 40%, this requires a total target sample size of 180 participants.
Randomization, blinding, and treatment allocation
A randomization list will be created with Random Allocation Software using block randomization of 6, 8, 10, and 12 blocks at an allocation ratio 1:1. Participants will be randomized into two groups: experimental or waitlist condition. The randomization list is kept by an independent researcher. This person reveals the next randomization outcome after every inclusion and thus ensures that the researchers are blind for treatment allocation. Due to the nature of the study, it is not possible to blind the participants for the randomization outcome.
0Phobia consists of six animated cognitive behavioral therapy (CBT)-based modules. The home screen (Fig. 2) features the six modules, each of which is consecutively unlocked, a “watch again” menu in which each of the instructions can be watched again, a menu providing access to the VR environment, and a “My 0Phobia” menu where participants can view the goals they have set for themselves for the intervention, their dysfunctional and functional thoughts, and their anxiety hierarchy for practicing in the real world.
Participants will follow the modules according to their own tempo and timing. Each module modules takes between 5 and 20 min to complete (see Table 1). The CBT content in the modules is provided by a virtual therapist using 2D animations and a voice-over (Fig. 2). The virtual therapist, “Tara,” guides the participant through the intervention and provides case examples in the form of a returning character, “Louise,” a theater manager who has overcome her own acrophobia (Fig. 2). Over the course of the modules Tara describes to Louise how her phobia emerged and developed, what the consequences were for her and how she resolved it (i.e., through exposure therapy and repeated practice, see Fig. 2). Louise also motivates the user to continue with 0Phobia.
Aside from the 2D animated environment, the intervention consists of a gamified immersive VR environment. From module 3 onwards, participants start to practice with exposure in the virtual environment, parallel to completing the remaining modules. The virtual environment is a gamified theater setting and within the story of the game, the participant is replacing Louise as the theater manager (see Fig. 2). To prepare the theater for the night’s performance, participants need to complete a number of assignments in the theater. Each of these assignments involve different levels of exposure to heights (from standing on a small ladder to standing on a ledge high above the stage). By looking at assets located on the theater floor that need to be collected, participants are encouraged to look down and face their fears.
Aside from the virtual theater, 0Phobia also contains four 360° videos that are also watched with the VR goggles in which participants stand on the top of a high building, cross a high suspension bridge, sit on a rooftop with their legs dangling over the edge, or stand on a high crane. In conjunction, the various virtual environment and 360° videos cover the entire exposure spectrum, from very-low- to very-high-intensity exposure. Based on the fear levels and performance the user receives feedback. When users rate their fear levels using a stare function in VR below a score of 3 on a 10-point scale, an automated feedback pops up mentioning that they can continue to the next level. When users rate their anxiety level between 4 and 7, they are advised to practice the same level again. When rated an anxiety level between 8 to 10, they need to practice the same level again before commencing to the next level. Subjects can return to practicing in VR as often as they like and gradually expose themselves to different heights and fear intensities. Although the importance of exposure in VR is stressed out in the 2D animations and participants are encouraged to practice in VR, participants can skip VR exposure and proceed to the next module, because for some people, fear levels may still be too high. After evaluating their automatic anxiety evoking thoughts, they can practice in VR exposure. Only during the exposure sessions will participants use the cardboard goggles.
Participants will have access to the mobile app after post test and follow-up. Usage data during this period will be collected. 0Phobia has been extensively user-tested throughout development process and modified according to user-feedback.
Primary outcome measure
The main outcome measures will be the 20-item anxiety subscale and the 20-item avoidance subscale of the Acrophobia Questionnaire (AQ; ). The AQ is a widely-used instrument with good psychometric properties . The anxiety subscale is measured using a 7-point Likert scale (0 = not anxious to 6 = extremely anxious), total score range 0–120. The avoidance subscale uses a 3-point Likert scale (“I would not avoid it” to “I would not do it under any circumstances”). Both subscales will be taken at baseline, directly after finishing the modules, at post test, and at follow-up. See Fig. 3.
Secondary outcome measures
Attitudes Towards Heights Questionnaire
The Attitudes Towards Heights Questionnaire (ATHQ; ), with minor modifications to the wording reported in  is a six-item measure in which individuals read pairs of dichotomous adjectives describing ways people may feel about heights (e.g., “Good/Bad,” “Safe/Dangerous”), and rate how they feel about elevated places on a scale of 0 (which corresponds with the first adjective) to 10 (which corresponds with the second adjective). The ATHQ has been used in several acrophobia treatment studies and is sensitive to treatment effects [34, 35]. The reliability is good . This questionnaire will be completed at baseline, post test, and follow-up.
Beck Anxiety Inventory
The Beck Anxiety Inventory (BAI; ) is a 21-item self-report questionnaire assessing symptoms of anxiety. Participants record how much they have been bothered by each symptom during the past week, including the day the questionnaire is administered (4-point Likert scale ranging from 0 = not at all to 3 = severely: “I could barely stand it”). The total score ranges from 0 to 63. Internal consistency is high (0.90–0.94) and convergent validity is good . This questionnaire will be completed at baseline, post test, and follow-up.
System Usability Scale
The System Usability Scale (SUS; ) will be used to measure the user-friendliness of the app. The SUS is composed of 10 statements that are scored on a 5-point Likert scale ranging from 1 = strongly agree to 5 = strongly disagree. Scores are converted to a new number, added up and then multiplied by 2.5 to convert the original scores to 0–100, with higher scores indicating better usability (for details, please see Bangor et al., 2008). This means that digital products that are at least passable have SUS scores above 68, with better products scoring in the high 70s to upper 80s. Truly superior products score above 90. Products with scores less than 70 should be considered candidates for increased scrutiny and continued improvement and should be judged to be marginal at best. Reliability of the scale is good . This questionnaire will be completed at post test.
Igroup Presence Questionnaire
The Igroup Presence Questionnaire (IPQ; ) is a 14-item questionnaire which assess realism and “presence,” i.e., the subjective feeling of being immersed in the virtual environment. Each of the items has five response categories from 1 = fully disagree to 5 = fully agree. Internal consistency is adequate. This questionnaire along with some open questions about user experience of the VR environment will be completed at post test.
The Pearlin Mastery Scale  is a seven-item scale to measure self-experienced control over a situation. Each of the seven items has five response categories ranging from 1 = totally disagree to 5 = totally agree. The questionnaire has good psychometric properties . This questionnaire will be completed at baseline, post test, and follow-up.
Patient Health Questionnaire
The nine-item mood module of the Patient Health Questionnaire (PHQ-9; ) is used to screen subjects for depressive disorders. The nine items are each scored on a 4-point Likert scale ranging from 0 to 3 (total score range 0–27). Sensitivity and specificity coefficients are good . This questionnaire will be completed at baseline, post test, and follow-up.
Ecological momentary assessment
Assessment of current anxiety level directly after exposure when using the 0Phobia app (one question: ‘How high was your anxiety at highest?’).
Two items will be included in the screening, the post-test, and the follow-up measure assessing whether participants have attended professional treatment or received medication for their specific phobia right before (screening), during (post test), or after (follow-up) the 0Phobia study.
Participants will rate the extent to which they experienced cybersickness while practicing in VR using three items adapted from the Simulator Sickness Questionnaire, (SSQ; [44, 45]), e.g., “How often did you experience any of the abovementioned symptoms while practicing in virtual reality” using a 3-point scale ranging from 0 (never) to 3 (always). Symptoms include eye strain, headache, pallor, sweating, dryness of mouth, fullness of stomach, disorientation, vertigo, ataxia, nausea, and vomiting . This questionnaire will be completed at post test.
Participants will be asked to report any potential vision impairments they have (e.g., wearing glasses, lazy eye, cataract, other). This questionnaire will be completed at post test.
Practice in real life
Two items will be used to determine the extent to which participants also practiced with height situations in real life. This questionnaire will be completed at post test and follow-up.
The primary outcome measure (AQ; ) and secondary study parameters (ATHQ, PHQ, IPQ, SUS, BAI, and Pearlin Mastery Scale) will be treated as continuous outcomes. Continuous variables will be presented as mean, standard deviation, and minimum and maximum number of observations. Categorical variables will be presented in terms of frequencies and percentages. Descriptive statistics of demographics and clinical outcomes will be compared between the experimental and the waitlist condition.
To assess whether attrition is non-random, we will construct a balancing table for background characteristics, pre-scores and other covariates in which participants with and without missing outcome observations are compared. Potential implications of non-random sample attrition on the observed treatment estimates will then be assessed by estimating treatment effect bounds for samples with non-random sample selection/attrition as proposed by Lee . Using this approach we are able to infer whether observed differences between the intervention and control groups can be explained by extreme, non-random sample selection. Depending on these results, missing outcome observations for participants will be imputed based on pre-scores and a set of background characteristics. The quantitative analysis of the primary and secondary endpoints will be performed on an intention-to-treat (ITT) basis following the per-protocol analysis. The primary analysis will be based on ITT. Potential dependency between outcome measures is addressed using multivariate analyses. Potential heterogeneity will be addressed by estimating treatment effects for subgroups (e.g., based on pre-scores). In order to understand the mechanisms by which observed differences are generated, a rich set of analyses is performed based on variation in (1) experiences when using the app (e.g., perceived user friendliness, ecological momentary assessment, cybersickness, VR vs 360°) and (2) intensity of using the app. Per-protocol analysis will be based on two groups: (1) those who returned the post-test and follow-up questionnaires (completers) and (2) those who completed 50% or more of the treatment modules and returned the questionnaires (adherent completers). Comparisons will be made between and within the groups before and after measurements.
Intention-to-treat and per-protocol analysis will be used on continuous scales using regression estimation standardized effect sizes (Cohen’s d) and confidence intervals will be calculated. Usage data through the mobile app (anxiety level during VR exposure, time spent in VR, number of VR sessions completed) will be collected during the study to model missing data. SPSS version 21 will be used for the analyses. A p value < 0.05 will be considered to indicate statistical significance. All design, implementation, and reporting will be carried out in accordance with Consolidated Standards of Reporting Trials (CONSORT) and Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guidelines (Additional file 1) [48,49,50].
Data monitoring and management
All data will be collected at the Section Clinical Psychology of VU University of Amsterdam by a staff member and handled confidentially. The data (baseline, AQ after module 6, post test, and follow-up data) will be captured electronically in a secured online survey platform . Through the 0Phobia app the following data is collected: anxiety level during VR exposure, time spent in VR, number of VR sessions completed, and information from three exercises (setting goals for the intervention, evaluating anxiety provoking thoughts and creating a personal fear hierarchy). The data will be coded which serves as a trial identifier consisting of four numbers and captured electronically in a secured online database, which is hosted on a server of our university. No personal identification data will be collected through the app. The data will be uploaded into the IBM SPSS database. Data from the different measurements will be kept in separate databases and merged into a master database only after data collection is completed and each individual database is locked. Data will be coded and the key connecting names to numbers will be kept in a separate, secure location in the principal investigator’s office. The data will be anonymized but linked with the trial identifier consisting of four numbers. Coded data will be electronically stored at the VU Amsterdam, separate from identifying information. Access will be password protected. Only the principal investigators and trial researchers will have access to the final dataset. All collected data will be used only for the purposes of this research. The project group will analyze the data, and both positive and negative trial results will be disclosed. The publication policy is in agreement with the publication statement of the CCMO (see: http://www.ccmo.nl). A data monitoring committee is not required by the Ethics Committee because of the low impact on the safety of the participants. No interim analysis is anticipated as this is not required for a trial of this type.
Previous studies in similar samples have shown that studies with VRET can be carried out safely, without a significant risk for unwanted effects (e.g., [18, 27, 32, 51]).The VR exposure environment uses gradual exposure which means that subjects start with relatively easy levels of height situations which induce a small amount of fear. When this situation becomes less fearful, they move on to the next level. In this way, fear levels are manageable. It is, nevertheless, possible that participants may get distressed, cybersick, or feel that they will lose their balance and fall during the intervention. In these cases, participants are instructed to remove their VR goggles. By removing them, feelings of distress, cybersickness or imbalance are immediately reduced. Furthermore, participants may experience distress while completing questionnaires when asked about mental health symptoms. However, administering these instruments is crucial to draw conclusions about the feasibility and efficacy of the intervention. In case of an undesirable emotional reaction both during the intervention as well as during the follow-up assessments, the research assistant and at least one experienced clinician (the principal investigator) can be contacted by the participant and will be available to provide support if necessary or desirable. Participants can always discontinue the intervention without providing any reasons.
Protocol amendments and publication
If necessary, protocol amendments will be submitted to the Ethics Committee and specified in the trial registry. There are no restrictions on reporting findings of this trial. Findings will be published in peer-reviewed journals.
The aim of this study is to evaluate effectiveness and user-friendliness of a self-guided VRET for acrophobia delivered through a smartphone app using cardboard VR goggles. Due to high treatment costs, long waiting lists, lack of health insurance coverage in the Netherlands, and a general reluctance to seek treatment, access to evidence-based therapy is currently limited. Given the psychological burden that phobias carry, the increased risk of developing comorbid depressive and anxiety disorders , and the heavy economic burden for society , there is a strong need for affordable and scalable self-guided interventions. Recent research into mobile apps as a method for treating psychiatric disorders are promising (e.g., [23, 52, 53]) and research into VRET as a treatment technique for specific phobias has shown positive results (see  for a review). The combination of a mobile app with affordable VR goggles is an innovative and promising scalable solution to deliver clinically validated mental health care for people suffering from specific phobias such as acrophobia. Advantages of an app-based VRET are lower costs, no waiting lists, better accessibility and participant retention, real-time progress monitoring, portability, and flexibility. Using a gamified exposure application, subjects may be more engaged and less distressed compared to traditional exposure therapy. Game elements may reduce distress as compared with traditional exposure therapy . With the possibility of playing the gamified VR contact repeatedly, continues confrontation of phobic stimuli may be facilitated .
In sum, the current study will assess the efficacy and user-friendliness of 0Phobia, a mobile-app-based gamified VR treatment for acrophobia, in a RCT. This study will add to the development of innovative and scalable delivery methods of evidence-based treatments.
Recruitment started March 2017 and is ongoing at the time of initial manuscript submission (June 2017).
Analysis of variance
Attitudes Towards Heights Questionnaire
Beck Anxiety Inventory
Cognitive behaviour therapy
Generalized linear models
Igroup Presence Questionnaire
Patient Health Questionnaire
Randomized controlled trial
Statistical Package of Social Science
System Usability Scale
Virtual reality exposure therapy
VU University Amsterdam
Web Screening Questionnaire
de Graaf R, Ten Have M, van Gool C, van Dorsselaer S. Prevalence of mental disorders and trends from 1996 to 2009. Results from the Netherlands mental health survey and incidence Study-2. Soc Psychiatry Psychiatr Epidemiol. 2012;47:203–13.
Kessler RC, Petukhova M, Sampson NA, Zaslavsky AM, Wittchen HU. Twelve-month and lifetime prevalence and lifetime morbid risk of anxiety and mood disorders in the United States. Int J Methods Psychiatr Res. 2012;21:169–84.
De Graaf R, Ten Have M, van Dorsselaer S. De psychische gezondheid van de Nederlandse bevolking. Utrecht: Nemesis-2: Opzet en eerste resultaten, Trimbos-Instituut; 2010.
Wittchen H-U, Jacobi F. Size and burden of mental disorders in Europe—a critical review and appraisal of 27 studies. Eur Neuropsychopharmacol. 2005;15:357–76.
Depla MF, Margreet L, van Balkom AJ, de Graaf R. Specific fears and phobias in the general population: results from the Netherlands mental health survey and incidence study (NEMESIS). Soc Psychiatry Psychiatr Epidemiol. 2008;43:200–8.
Stinson FS, Dawson DA, Chou SP, Smith S, Goldstein RB, Ruan WJ, Grant BF. The epidemiology of DSM-IV specific phobia in the USA: results from the National Epidemiologic Survey on alcohol and related conditions. Psychol Med. 2007;37:1047–59.
Garcia-Palacios A, Botella C, Hoffman H, Fabregat S. Comparing acceptance and refusal rates of virtual reality exposure vs. in vivo exposure by patients with specific phobias. Cyberpsychol Behav. 2007;10:722–4.
Trumpf J, Margraf J, Vriends N, Meyer AH, Becker ES. Specific phobia predicts psychopathology in young women. Soc Psychiatry Psychiatr Epidemiol. 2010;45:1161–6.
Kessler RC, Chiu WT, Demler O, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62:617–27.
Wolitzky-Taylor KB, Horowitz JD, Powers MB, Telch MJ. Psychological approaches in the treatment of specific phobias: a meta-analysis. Clin Psychol Rev. 2008;28:1021–37.
Kaczkurkin AN, Foa EB. Cognitive-behavioral therapy for anxiety disorders: an update on the empirical evidence. Dialogues Clin Neurosci. 2015;17:337.
Gonçalves R, Pedrozo AL, Coutinho ESF, Figueira I, Ventura P. Efficacy of virtual reality exposure therapy in the treatment of PTSD: a systematic review. PLoS One. 2012;7:e48469.
Morina N, Ijntema H, Meyerbröker K, Emmelkamp PM. Can virtual reality exposure therapy gains be generalized to real-life? A meta-analysis of studies applying behavioral assessments. Behav Res Ther. 2015;74:18–24.
Parsons TD, Rizzo AA. Affective outcomes of virtual reality exposure therapy for anxiety and specific phobias: a meta-analysis. J Behav Ther Exp Psychiatry. 2008;39:250–61.
Powers MB, Emmelkamp PM. Virtual reality exposure therapy for anxiety disorders: a meta-analysis. J Anxiety Disord. 2008;22:561–9.
Opriş D, Pintea S, García-Palacios A, Botella C, Szamosközi Ş, David D. Virtual reality exposure therapy in anxiety disorders: a quantitative meta-analysis. Depress Anxiety. 2012;29:85–93.
Raghav K, Van Wijk A, Abdullah F, Islam MN, Bernatchez M, De Jongh A. Efficacy of virtual reality exposure therapy for treatment of dental phobia: a randomized control trial. BMC Oral Health. 2016;16:25.
Krijn M, Emmelkamp PM, Olafsson RP, Biemond R. Virtual reality exposure therapy of anxiety disorders: a review. Clin Psychol Rev. 2004;24:259–81.
Craske MG, Treanor M, Conway CC, Zbozinek T, Vervliet B. Maximizing exposure therapy: an inhibitory learning approach. Behav Res Ther. 2014;58:10–23.
Botella C, Breton-Lopez J, Quero S, Baños RM, Garcia-Palacios A, Zaragoza I, Alcaniz M. Treating cockroach phobia using a serious game on a mobile phone and augmented reality exposure: a single case study. Comput Hum Behav. 2011;27:217–27.
Miloff A, Lindner P, Hamilton W, Reuterskiöld L, Andersson G, Carlbring P. Single-session gamified virtual reality exposure therapy for spider phobia vs. traditional exposure therapy: a randomized-controlled trial. In: The 8th scientific meeting of the International Society for Research on internet interventions, Seattle, USA, 7–9 April 2016; 2016.
Bakker David D. Mental health smartphone apps: review and evidence-based recommendations for future developments. JMIR Ment Health. 2016;3(1):e7. https://doi.org/10.2196/mental.4984
Donker T, Petrie K, Proudfoot J, Clarke J, Birch M-R, Christensen H. Smartphones for smarter delivery of mental health programs: a systematic review. J Med Internet Res. 2013;15:e247.
Donker T, Blankers M, Hedman E, Ljotsson B, Petrie K, Christensen H. Economic evaluations of Internet interventions for mental health: a systematic review. Psychol Med. 2015;45:3357–76.
McCrone P, Marks IM, Mataix-Cols D, Kenwright M, McDonough M. Computer-aided self-exposure therapy for phobia/panic disorder: a pilot economic evaluation. Cogn Behav Ther. 2009;38:91–9.
Litvin EB, Abrantes AM, Brown RA. Computer and mobile technology-based interventions for substance use disorders: an organizing framework. Addict Behav. 2013;38(3):1747–56.
Piercey CD, Charlton K, Callewaert C. Reducing anxiety using self-help virtual reality cognitive behavioral therapy. Games Health: Res Dev Clin Appl. 2012;1:124–8.
Cohen DC. Comparison of self-report and overt-behavioral procedures for assessing acrophobia. Behav Ther. 1977;8:17–23.
Steinman SA, Teachman BA. Cognitive processing and acrophobia: validating the heights interpretation questionnaire. J Anxiety Disord. 2011;25:896–902.
Donker T, van Straten A, Marks IM, Cuijpers P. A brief web-based screening questionnaire for common mental disorders: development and validation. J Med Internet Res. 2009;11:e19.
Gega L, Kenwright M, Mataix-Cols D, Cameron R, Marks IM. Screening people with anxiety/depression for suitability for guided self-help. Cogn Behav Ther. 2005;34:16–21.
Emmelkamp PMG, Krijn M, Hulsbosch AM, de Vries S, Schuemie MJ, van der Mast CAPG. Virtual reality treatment versus exposure in vivo: a comparative evaluation in acrophobia. Behav Res Ther. 2002;40:509–16.
Abelson JL, Curtis GC. Cardiac and neuroendocrine responses to exposure therapy in height phobics: desynchrony within the “physiological response system”. Behav Res Ther. 1989;27:561–7.
Coelho CM, Santos JA, Silvério J, Silva CF. Virtual reality and acrophobia: one-year follow-up and case study. Cyberpsychol Behav. 2006;9:336–41.
Emmelkamp PM, Bruynzeel M, Drost L, van der Mast CAG. Virtual reality treatment in acrophobia: a comparison with exposure in vivo. Cyberpsychol Behav. 2001;4:335–9.
Steinman SA, Teachman BA. Reaching new heights: comparing interpretation bias modification to exposure therapy for extreme height fear. J Consult Clin Psychol. 2014;82:404.
Beck AT. An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol. 1988;56:893.
Brown GK, Beck AT, Newman CF, Beck JS, Tran GQ. A comparison of focused and standard cognitive therapy for panic disorder. J Anxiety Disord. 1997;11:329–45.
Bangor A. An empirical evaluation of the system usability scale. Int J Hum Comput Interact. 2008;24:574.
Schubert T, Friedmann F, Regenbrecht H. The experience of presence: factor analytic insights. Presence Teleop Virt. 2001;10:266–81.
Pearlin LI, Schooler C. The structure of coping. J Health Soc Behav. 1978;19:2–21.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9. J Gen Intern Med. 2001;16:606–13.
Wittkampf KA, Naeije L, Schene AH, Huyser J, van Weert HC. Diagnostic accuracy of the mood module of the patient health questionnaire: a systematic review. Gen Hosp Psychiatry. 2007;29:388–95.
LaViola JJ Jr. A discussion of cybersickness in virtual environments. ACM SIGCHI Bull. 2000;32:47–56.
Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int J Aviat Psychol. 1993;3:203–20.
Survalyzer Nederland B.V. Utrecht; http://www.survalyzer.com. Accessed 12 July 2017.
Lee DS. Training, wages, and sample selection: estimating sharp bounds on treatment effects. Rev Econ Stud. 2009;76:1071–102.
Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. 2010;63(8):834–40.
Piaggio G, Elbourne DR, Pocock SJ, Evans SJW, Altman DG. Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. JAMA. 2012;308(24):2594–604.
Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.
Bouchard S, Côté S, St-Jacques J, Robillard G, Renaud P. Effectiveness of virtual reality exposure in the treatment of arachnophobia using 3D games. Technol Health Care. 2006;14:19–27.
Eysenbach G, Group C-E. CONSORT-EHEALTH: improving and standardizing evaluation reports of web-based and mobile health interventions. J Med Internet Res. 2011;13:e126.
Saeb S, Zhang M, Karr CJ, Schueller SM, Corden ME, Kording KP, Mohr DC. Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: an exploratory study. J Med Internet Res. 2015;17:e175.
The authors extend their gratitude to Bruno de Vos for designing 0Phobia, Wouter Houwen, Ruud op den Kelder, and Bas van Loon for programming 0Phobia, Rufus van Baardwijk for 0Phobia sound, InSession for development of 0Phobia, and Fabian Kiepe for the promotion of 0phobia.
This study represents independent research supported by the Dutch Organization for Scientific Research, Applied, and Technical Science (Nederlandse Organisatie voor Wetenschappelijk Onderzoek (NWO), Toegepaste en Technische Wetenschappen) with reference number 2016/STW/00099738, and NWO Creative Industrie-KIEM (reference number: 314–98-076). The views expressed are those of the author(s) and not necessarily those of the NWO.
Ethics approval and consent to participate
This study has received ethical approval by the Medical Ethics Committee of the VU University Medical Center (registration number 2016-563). Only participants who consent to participate in the trial will be included in the study. A copy of the consent form can be requested by contacting the corresponding author.
TD is married to the founder of InSession, the private company that, in collaboration with the Vrije Universiteit, developed the VR application 0Phobia used in the present study and which is intended for release on the open market. Hence, TD will not be involved in data analysis or any decisions related to the publication of findings. The other authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 Checklist: recommended items to address in a clinical trial protocol and related documents. (DOC 121 kb)
About this article
Cite this article
Donker, T., Van Esveld, S., Fischer, N. et al. 0Phobia – towards a virtual cure for acrophobia: study protocol for a randomized controlled trial. Trials 19, 433 (2018). https://doi.org/10.1186/s13063-018-2704-6
- Specific phobia
- Virtual reality
- Serious games