This article has Open Peer Review reports available.
Internet treatment for social anxiety disorder in Romania: study protocol for a randomized controlled trial
© Tulbure et al.; licensee BioMed Central Ltd. 2012
Received: 9 May 2012
Accepted: 27 September 2012
Published: 30 October 2012
Social anxiety disorder (SAD) is one of the most common anxiety disorders and is associated with marked impairments. However, a small proportion of individuals with SAD seek and receive treatment. Internet-administrated cognitive behavior therapy (iCBT) has been found to be an effective treatment for SAD. This trial will be the first Internet-delivered guided self-help intervention for SAD in Romania.
Participants with social anxiety disorder (N = 96) will be recruited via newspapers, online banners and Facebook. Participants will be randomized to either: a) an active treatment, or b) a waiting list control group.
The treatment will have a guided iCBT format and will last for nine weeks. Self-report questionnaires on social phobia, anxiety, depression, treatment credibility and irrational thinking will be used. All assessments will be collected pre, post and at follow-up (six months after intervention). Liebowitz Social Anxiety Scale – Self-Report version (LSAS-SR) will be the primary outcome measure and will be administrated on a weekly basis in both conditions.
The present randomized controlled trial investigates the efficacy of an Internet-administered intervention in reducing social anxiety symptoms in a culture where this form of treatment has not been tested. This trial will add to the body of knowledge on the efficacy of iCBT, and the results might lead to an increase of the accessibility of evidence-based psychological treatment in Romania.
KeywordsInternet-administrated cognitive behavior therapy Social anxiety disorder Social phobia Guided self-help Randomized controlled trial
Social anxiety disorder (SAD) affects 6.5% of Europeans (for lifetime prevalence, see), and is associated with marked impairments in personal, professional, and social life. SAD is associated with higher rates of divorce, alcohol consumption, suicide risk, and other forms of psychopathology[1, 2]. Everyday functioning is significantly altered, and greater financial dependence on family and/or state resources makes SAD a societal burden. Epidemiological data also reveal that only a small number of individuals seek and receive treatment for this condition, as SAD sufferers can delay seeking treatment for 28 years. Spontaneous remission of symptoms has been reported and is rare, and it is mainly by active interventions (psychological and pharmacological) that the course of SAD can be altered.
The Internet has grown rapidly across the world and the number of users increases steadily (http://www.internetworldstats.com). An association between SAD and Internet use has been found[5, 6], suggesting that socially anxious individuals use the Internet to search for information and to communicate with others. Moreover, communication via the Internet may be attractive to socially anxious individuals because it conceals physical appearance and aspects of behavior that in face-to-face interactions could be viewed as being negatively evaluated by others.
Given that the core features of SAD are the fear and avoidance of direct social interactions, guided Internet-administrated cognitive behavior therapy (iCBT) may constitute an attractive treatment option for persons with SAD. These individuals may be drawn to such treatment because they can engage in the therapeutic process from their private homes or offices and reduce the embarrassment and stigma of seeking treatment and going to a therapist’s office. However, there is a potential risk that isolation and avoidance is reinforced by not seeing the client in therapy. To counteract this propensity, iCBT for SAD includes not only cognitive restructuring sessions, but also real life exposure exercises where participants are encouraged to confront their fears in their daily life.
Andersson et al. were the first to test the efficacy of an iCBT for SAD. To maximize the effects, the nine online modules were augmented with two therapist-lead group exposure sessions. Treated individuals reduced their social anxiety symptoms, depression and general anxiety, showing clinical significant changes. Since then, other Internet-delivered interventions for SAD have been developed and tested in Australia, Spain, Sweden and Switzerland[10–17], supporting the short- and long-term benefits of such interventions. In a meta-analysis of eight studies, the overall efficacy of iCBT for SAD was found to be high for social anxiety symptoms (Cohen’s d test statistic = 0.86), and moderate for quality of life (d = 0.53) and comorbid anxiety and depression (d = 0.40). Recently Hedman et al. investigated the cost-effectiveness of a guided iCBT for SAD and a parallel group cognitive behavioral therapy (GCBT) intervention. While both treatments generated large cost reductions, the iCBT intervention was significantly less costly. This difference was mainly attributed to the therapist time required for each participant per week for the two interventions (that is., 5.5 minutes for iCBT versus 50.0 minutes for group CBT per week per patient). Because the savings generated by each treatment exceed their costs, Hedman et al. concluded that “society as a whole would be financially strengthened by making CBT for SAD more accessible” (p. 735). The new generation of self-help interventions delivered online represents a readily accessible and cost-effective avenue to increase treatment accessibility for SAD. Nevertheless, before including them in the evidence-based armamentarium, we should carefully investigate their efficacy in various contexts and cultures.
This study represents an extension and replication of previous trials examining the effectiveness of guided iCBT for individuals with SAD. To our knowledge, there are no published trials on iCBT for Romanian adults with SAD. To date, paxonline.ro is the only platform offering computer-assisted intervention for anxiety in Romania. This password-protected website offers online assessment, resources and interventions for patients with different forms of anxiety, but no controlled trials about its effectiveness have yet been published.
In our study, an individual treatment approach will be used not only because the active intervention is delivered online, but also because it has been argued that individual treatments may be superior to group treatments. Consequently, the primary aim of this study will be to investigate the efficacy of a treatment program called internet social phobia (iSOFIE) by comparing it to a waiting list control group. iSOFIE was derived from a previously tested Swedish program that has been shortened while retaining the main treatment ingredients. The program assists participants in understanding their condition, in restructuring their maladaptative thoughts, and in implementing the exposure exercises (i.e., which is known to be a key factor in symptoms reduction). A second aim of the study is to track the potential changes in participants’ thought patterns. While our intervention is primarily based on the cognitive- behavioral model of SAD, and no specific Rational Emotive Behavior Therapy (REBT),), will be implemented, it is hypothesized that the cognitive restructuring and exposure exercises will make participants less prone to irrational thinking - (as measured by the Attitude and Belief Scale-II (ABS-II),). To our knowledge, no study has investigated whether an iCBT program for SAD has the potential to alter participants’ irrational thinking patterns. Moreover, because this is the first guided iCBT interventions conducted in Romania, the treatment credibility of the program will be investigated. Finally, we will investigate predictors of outcome with a focus on the levels of SAD and associated anxiety symptoms.
We will conduct a randomized controlled trial (RCT) with two parallel groups: the iSOFIE and a waiting list control group. The study has been approved by the regional Institutional Review Board (30273 - 02/29/2012) and registered in clinicaltrials.gov (NCT01557894).
Participants will be recruited through advertisements in national and local Romanian newspapers, online banners, and the Facebook page specifically designed for this purpose. After the initial screening, all potential participants who score above the cut-off on the Leibowitz Social Anxiety Scale – Self-Report version (LSAS-SR)[26, 27], Social Phobia Inventory (SPIN), and Social Interaction and Anxiety Scale (SIAS) will be contacted for a structured telephone interview. The interview will be based on the Structured Clinical Interview (SCID) for of the Diagnostic and Statistical Manual of Mental Disorders - IV (DSM-IV),).
be over 18 years old
exceed the cutoff scores on SPIN, SIAS, and LSAS-SR
fulfill the DSM criteria for SAD on the Social Phobia Screening Questionnaire (SPSQ)
display no suicidal ideation (i.e., not exceed a score of 2 on the suicide item of (BDI-II) and not report parasuicidal behavior on the Screening Questionnaire of the SCID)
do not undergo other forms of treatment for SAD
have access to a computer connected to the Internet
if participants are on medication, the dose should be constant for at least 1 month, and participants should agree to keep the dosage unchanged for the whole time of the study
have SAD as the primary diagnosis on the SCID
have no diagnosis of psychosis or borderline personality disorder on the SCID
Group differences regarding in demographics and pre-treatment measures will be analyzed with using the chi square (χ 2) test and the independent sample t- test. The potential impact of the iSOFIE intervention will be analyzed using analysis of covariance (ANCOVA) or mixed model analysis, followed by the appropriate post-hoc analyses. Effect sizes for both within- and between subject designs will be calculated using Cohen’s d-test based on the pooled standard deviation (SD). For the post-treatment data, an intention-to-treat design will be used with appropriate estimation of missing values.
The trial will be powered to detect a between- group effect size of d = 0.60 at post-treatment (alpha = 0.05, two-tailed) at a power of 80% (1-β). A total of 96 participants will be needed for the study (i.e., that is, N = 48 per condition), when considering a potential dropout risk of 20% and intent-to-treat analysis with all included participants in the analyses. With such a sample, we have a reasonable chance to detect the potential statistical and clinically significant effect of the intervention.
Participants will be recruited via newspapers advertisements, a Facebook page created for this purpose, and the project’s website. They will be directed to the project’s website, advised to read the study presentation, and eventually register to participate. Before starting the screening process, interested participants will be advised to carefully read the online Informed Consent details, and to approve their voluntary participation in the trial.
Participants will then receive a code that allows them to access the following screening measures: LSAS-SR,[26, 27], SPIN,, SIAS,, SPSQ,, (BDI-II,), (ABS-II),[25, 35], and Anxiety Sensitivity Index (ASI),. All these measures are widely used in the literature and have good to excellent psychometric properties. Moreover, for LSAS-SR and SIAS, similar psychometric proprieties were found for both online and paper-and-pencil formats. Participants who score above the cut-off value of the social anxiety measures will be contacted for a telephone interview. In addition, participants’ results on the SPSQ form will also be inspected to see whether they meet the criteria for SAD according to the DSM-IV. The telephone interview is based on social phobia section of the Structural Clinical Interview for DSM-IV - Axis I Disorders: SCID I. Only participants who will meet the inclusion criteria will take part in the study.
Included participants will be randomized by an independent person to either: a) active training (iSOFIE) or b) the waiting list control group. The iSOFIE treatment manual is divided into nine modules and adapted for the Internet. Each module presents a different topic (that is., what is social anxiety, challenging your negative thinking, behavioral experiments, exposure etcetera.) and includes exercises, and essay questions (that is., homework to be sent in to the therapist). Participants are encouraged to explain what they have learned, provide thought records, describe their experiences during the exposure exercises. Based on their responses, an assessment is made of whether the participant is ready to continue. If so, the next module is made accessible. If not, the participant receives instructions on what needs to be completed before proceeding to the next module. The intervention takes nine weeks to be completed. The control group will not receive any active intervention during this time. To monitor participants’ symptoms and to analyze the possible mediating effects, all participants will be asked to fill in the LSAS-SR on a weekly basis.
By the end of the nine-week treatment period, all participants will be asked to complete the post-intervention assessment, which consists of the same measures used in the screening phase, with treatment satisfaction items added for the intervention group. The SAD section of the SCID interview will also be used as a categorical diagnostic measure. To evaluate long-term effects of the intervention, the follow-up data will be collected six months after the treatment. The waiting -list control group will receive treatment after the waiting period and will also be evaluated after they have completed the treatment, and at six months follow-up.
A secure software will facilitate correspondence between the participants and therapists. The online messaging system uses a protocol for encrypting information (Secure Sockets Layer) to ensure communication security over the Internet. All communication will be mediated through this online messaging system.
Primary outcome measures
Social anxiety symptoms will be assessed with more than one measure. The LSAS-SR presents 24 commonly anxiety-provoking situations, and asks participants to rate their fear and avoidance for each situation. The psychometric properties of the LSAS-SR are good to excellent and the scale captures symptom changes in both cognitive- behavioral and pharmacological interventions. The LSAS-SR has been recommended as a treatment monitoring, and treatment outcome, evidence-based measure in adults and adolescents.
The Social Phobia Inventory (SPIN,) is a brief (i.e., 17-item) self-report instrument measuring fear in social situations, avoidance of performance/social events, and physiological discomfort in social situations. Each item is rated on a 4-point scale, with higher scores corresponding to greater distress. The scale has good to excellent psychometric proprieties[28, 40] and has been recommended for clinical use.
The Social Interaction and Anxiety Scale (SIAS,) is a 20- item measure that assesses fears of general social interactions. The scale captures both social scrutiny fears and social interaction fears. For each item, respondents are asked to indicate the degree to which they feel the statement is characteristic or true of them on a five-point scale. The SIAS has sound psychometric properties.
The Social Phobia Screening Questionnaire (SPSQ,) is a measure used for diagnostic screening of SAD. The questionnaire presents both dimensional and categorical data, including impairment and duration of reported social anxiety. It has been used in several other studies of SAD[9, 13, 14, 41].
Secondary outcome measures
In addition to the social anxiety measures, we intend to capture participants’ anxiety sensitivity, depression level, and irrational thinking, using the Anxiety Sensitivity Index (ASI,), Beck Depression Inventory-II (BDI-II,[34, 42, 43]), and Attitude and Belief Scale-II (ABS-II,[25, 35]).
The Anxiety Sensitivity Index (ASI,) is a 16-item questionnaire that measures the beliefs about the social and somatic consequences of anxiety symptoms. The total ASI score ranges from 0 to 64, and is the sum of the scores on the 16 items. The scale has sound psychometric properties[36, 44, 45].
The Beck Depression Inventory-II (BDI-II,) is a 21-item self-report inventory widely used to assess DSM-IV depressive symptoms. Each item consists of four statements, scored 0– to 3, indicating increasing symptom severity. Sound psychometric proprieties have been reported for the BDI-II.
The Attitude and Belief Scale-II (ABS-II,) measures rational and irrational thinking as described by Albert Ellis. The scale was designed to capture four cognitive processes (namely., ‘demandingness’, ‘awfulizing’, ‘low frustration tolerance’, and ‘self-downing/global evaluation’) in three content areas (i.enamely., achievement, approval, and comfort). We selected the 72-item ABS-II because preliminary psychometrics are available for the Romanian population.
Reducing social anxiety can have important benefits in terms of both personal and societal costs[1, 2]. The present RCT investigates the efficacy of an Internet-administered intervention (iSOFIE) in a different cultural setting. Potential participants will be carefully screened using both self-report measures (namely., the LSAS-SR, SPIN, SIAS, SPSQ) and a clinical interview (the SCID for DSM-IV). After the nine-week intervention, all participants (that is., the active treatment group and the waiting list control group) will be asked to complete the post-treatment measures, and the follow-up assessment will be administered after 6 months. Besides capturing the intervention’s effectiveness in reducing social anxiety symptoms, potential changes in participants’ thinking patterns will be estimated. Data about treatment credibility and satisfaction will also be collected. Along with the hypothesized main effects, these data will provide a valuable feedback for optimizing future interventions.
Compared to the relatively new Internet-delivered interventions, face-to-face treatments appear to have stronger empirical support in the literature, and their credibility seems to be higher. However, the effects of the face-to-face treatments were recently compared with the effects of guided self-help for depression and anxiety, and no significant differences were found. It was argued that generalizing the results was hindered by the fact that participants were mainly self-referred (that is., clients interested in guided self-help applied for such trials, and the remaining category of clients applied for the face-to-face treatments). While it is true that some people may benefit more from guided self-help interventions, the fact that both treatments yielded similar effects cannot be discarded. Moreover, investigating the long-term effects of Internet-administered treatment for SAD, Hedman et al. found that the improvements in social anxiety symptoms were sustained 5 years after the treatment. This additional evidence supports the idea that guided self-help represents an effective and reliable way of helping anxiety sufferers via the Internet.
There are several limitations to our study that, if seen from a different perspective, suggest improvements for future research. First and foremost, having a passive wait list group does not offer the best control for the effects of expectancy or adherence to the treatment schedule. However, we hypothesized that such a design would be suitable for examining the main effects of an Internet-delivered intervention in a new context. Future studies could compare the effects of Internet-delivered CBT and other interventions (such as, acceptance and commitment therapy) and explore whether one of these alternative treatments is more effective in reducing social anxiety symptoms. Second, only self-report measures will be used to assess participants’ symptoms in this study. Despite their many desirable traits (such as., simplicity, ease of administration, etcetera.), self-reports also display some limits (such as, responses based on the frail human memory and judgment, social desirability, responses influenced by question order, question wording, etcetera.). Therefore, future studies could also capture the underlying cognitive process by using the new generation of implicit measures that indirectly capture various psychological constructs. For example, the possible changes in participants’ automatic information processes occasioned by an online intervention could be investigated using the Implicit Association Test or some other newly developed implicit measures. Finally, yet importantly, while Internet-delivered treatments have the advantage of increasing the accessibility of evidence-based interventions to a larger segment of the population, we suspect that the well-educated and computer savvy subgroup will mainly benefit from such programs. Alternative ways to increases treatment accessibility could be to offer straight forward, user-friendly programs that will not drive away beginners.
Overall, offering self-help materials with the support of new technologies constitutes a promising alternative for face-to-face treatments, and an effective way to disseminate evidence- based anxiety interventions. Using a predefined, and well-structured intervention that is available online decreases the number of therapist contact hours, and allows clinicians to assist a greater number of participants without sacrificing treatment efficacy. However, the costs and efforts needed for the development and maintenance of such specialized interventions, and for the appropriate training of new clinicians should not be underestimated. Because the initial costs for the platform development are relatively high, while the resources needed for maintenance and therapist contact hours are relatively low, it seems that once proven effective in an RCT, the optimal way of exploiting such platforms would be to attract a large number of clients. Considering the inverse ratio between the initial investment and the potential long-term benefits, it seems that using such platforms for a long time represents a cost-effective strategy worth pursuing.
The screening phase of this trial is planned for April and May, 2012.
This work was possible with the financial support of the Sectoral Operational Programme for Human Resources Development 2007-–2013, co-financed by the European Social Fund, under the project number POSDRU 89/1.5/S/60189 with the title ”Postdoctoral Programs for Sustainable Development in a Knowledge Based Society” (Grant awarded to BTT).
- Fehm L, Pelissolo A, Furmark T, Wittchen H-U: Size and burden of social phobia in Europe. Eur Neuropsychopharmacol. 2005, 15: 453-462. 10.1016/j.euroneuro.2005.04.002.View ArticlePubMedGoogle Scholar
- Patel AA, Knapp MM, Henderson JJ, Baldwin DD: The economic consequences of social phobia. J Affect Disord. 2002, 68: 221-233. 10.1016/S0165-0327(00)00323-2.View ArticlePubMedGoogle Scholar
- Oakley Browne MA, Wells JE, McGee MA, Team NZMHSR: Twelve-month and lifetime health service use in Te Rau Hinengaro: The New Zealand Mental Health Survey. Aust N Z J Psychiatry. 2006, 40: 855-864. 10.1080/j.1440-1614.2006.01904.x.View ArticlePubMedGoogle Scholar
- Rapee RM, Spence SH: The etiology of social phobia: empirical evidence and an initial model. Clin Psychol Rev. 2004, 24: 737-767. 10.1016/j.cpr.2004.06.004.View ArticlePubMedGoogle Scholar
- Erwin BA, Turk CL, Heimberg RG, Fresco DM, Hantula DA: The Internet: home to a severe population of individuals with social anxiety disorder?. J Anxiety Disord. 2004, 18: 629-646. 10.1016/j.janxdis.2003.08.002.View ArticlePubMedGoogle Scholar
- Shepherd R-M, Edelmann RJ: Reasons for internet use and social anxiety. Personal Individ Differ. 2005, 39: 949-958. 10.1016/j.paid.2005.04.001.View ArticleGoogle Scholar
- Andersson G, Carlbring P: Social phobia (Social anxiety disorder). Stepped care and e-Health: Practical applications to behavioral disorders. Edited by: O’Donohue WT, Draper CR. 2011, New York: Springer, 99-114.View ArticleGoogle Scholar
- Hofmann SG, Otto MW: Cognitive Behavioral Therapy for Social Anxiety Disorder, Evidence-Based and Disorder Specific Treatment Techniques. 2008, New York and London: Routledge Taylor & Francis GroupGoogle Scholar
- Andersson G, Carlbring P, Holmström A, Sparthan E, Furmark T, Nilsson-Ihrfelt E, Buhrman M, Ekselius L: Internet-based self-help with therapist feedback and in vivo group exposure for social phobia: a randomized controlled trial. J Consult Clin Psychol. 2006, 74: 677-686.View ArticlePubMedGoogle Scholar
- Berger T, Caspar F, Richardson R: Internet-based treatment of social phobia: a randomized controlled trial comparing unguided with two types of guided self-help. Behav Res Ther. 2011, 49: 158-169. 10.1016/j.brat.2010.12.007.View ArticlePubMedGoogle Scholar
- Berger T, Hohl E, Caspar F: Internet-based treatment for social phobia: a randomized controlled trial. J Clin Psychol. 2009, 65: 1021-1035. 10.1002/jclp.20603.View ArticlePubMedGoogle Scholar
- Botella C, Gallego MJ, Garcia-Palacios A, Guillen V, Baños RM, Quero S, Alcañiz M: An Internet-based self-help treatment for fear of public speaking: a controlled trial. Cyberpsychol Behav Soc Netw. 2010, 13: 407-421. 10.1089/cyber.2009.0224.View ArticlePubMedGoogle Scholar
- Carlbring P, Gunnarsdóttir M, Hedensjö L, Andersson G, Ekselius L, Furmark T: Treatment of social phobia: randomised trial of internet-delivered cognitive-behavioural therapy with telephone support. Br J Psychiatry. 2007, 190: 123-128. 10.1192/bjp.bp.105.020107.View ArticlePubMedGoogle Scholar
- Furmark T, Carlbring P, Hedman E, Sonnenstein A, Clevberger P, Bohman B, Eriksson A, Hallen A, Frykman M, Holmstrom A: Guided and unguided self-help for social anxiety disorder: randomised controlled trial. Br J Psychiatry. 2009, 195: 440-447. 10.1192/bjp.bp.108.060996.View ArticlePubMedGoogle Scholar
- Titov N, Andrews G, Choi I, Schwencke G, Mahoney A: Shyness 3: randomized controlled trial of guided versus unguided Internet-based CBT for social phobia. Aust N Z J Psychiatry. 2008, 42: 1030-1040. 10.1080/00048670802512107.View ArticlePubMedGoogle Scholar
- Titov N, Andrews G, Schwencke G: Shyness 2: treating social phobia online: replication and extension. Aust N Z J Psychiatry. 2008, 42: 595-605. 10.1080/00048670802119820.View ArticlePubMedGoogle Scholar
- Titov N, Andrews G, Schwencke G, Drobny J, Einstein D: Shyness 1: distance treatment of social phobia over the Internet. Aust N Z J Psychiatry. 2008, 42: 585-594. 10.1080/00048670802119762.View ArticlePubMedGoogle Scholar
- Tulbure BT: The efficacy of internet-supported intervention for social anxiety disorder: a brief meta-analytic review. Procedia-Social and Behavioral Sciences. 2011, 30: 552-557.View ArticleGoogle Scholar
- Hedman E, Andersson E, Ljótsson B, Andersson G, Rück C, Lindefors N: Cost-effectiveness of Internet-based cognitive behavior therapy vs. cognitive behavioral group therapy for social anxiety disorder: results from a randomized controlled trial. Behav Res Ther. 2011, 49: 729-736. 10.1016/j.brat.2011.07.009.View ArticlePubMedGoogle Scholar
- Miclea M, Ciucã A, Miclea S: How to produce e-content for e-mental health solutions. Basic guidelines. Cognition, Brain, Behavior An Interdisciplinary Journal. 2009, 13: 1-9.Google Scholar
- Aderka IM: Factors affecting treatment efficacy in social phobia: the use of video feedback and individual vs. group formats. J Anxiety Disord. 2009, 23: 12-17. 10.1016/j.janxdis.2008.05.003.View ArticlePubMedGoogle Scholar
- Furmark T, Holmström A, Sparthan E, Carlbring P, Andersson G: Social fobi - Effektiv hjälp med kognitiv beteendeterapi [Social phobia - Effective treatment with cognitive behavior therapy]. 2006, Stockholm: LiberGoogle Scholar
- Clark DM, Wells A: A cognitive model of social phobia. Social phobia: Diagnosis, assessment, and treatment. Edited by: Liebowitz MR. 1995, New York: Guilford Press, 69-93.Google Scholar
- Ellis A, Dryden W: Practice of Rational Emotive Behavior Therapy. 1997, New York: Springer Publishing Company, 2Google Scholar
- DiGiuseppe R, Leaf R, Exner T, Robin MV: The development of a measure of rational/irrational thinking. World Congress of Behavior Therapy. 1988, Edinburgh, ScotlandGoogle Scholar
- Baker SLS, Heinrichs NN, Kim H-JH, Hofmann SGS: The liebowitz social anxiety scale as a self-report instrument: a preliminary psychometric analysis. Behav Res Ther. 2002, 40: 701-715. 10.1016/S0005-7967(01)00060-2.View ArticlePubMedGoogle Scholar
- Liebowitz M: Social phobia. Mod Probl Pharmacopsychiatry. 1987, 22: 141-173.PubMedGoogle Scholar
- Connor KM, Davidson JR, Churchill LE, Sherwood A, Foa E, Weisler RH: Psychometric properties of the Social Phobia Inventory (SPIN). New self-rating scale. Br J Psychiatry. 2000, 176: 379-386. 10.1192/bjp.176.4.379.View ArticlePubMedGoogle Scholar
- Mattick RP, Clarke JC: Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behav Res Ther. 1998, 36: 455-470. 10.1016/S0005-7967(97)10031-6.View ArticlePubMedGoogle Scholar
- First MB, Gibbon M, Spitzer RL, Williams JBW: Structured clinical interview for DSM-IV Axis I Disorders (SCID-I). 1997, Washington D.C: American Psychiatric PressGoogle Scholar
- Little R, Rubin DB: Statistical analysis with missing data. 2002, New Jersey: John Wiley & Sons Inc;, 2Google Scholar
- Furmark T, Tillfors M, Everz P, Marteinsdottir I, Gefvert O, Fredrikson M: Social phobia in the general population: prevalence and sociodemographic profile. Soc Psychiatry Psychiatr Epidemiol. 1999, 34: 416-424. 10.1007/s001270050163.View ArticlePubMedGoogle Scholar
- Beck A, Steer R: Psychometric properties of the Beck depression inventory: twenty-five years of evaluation. Clin Psychol Rev. 1988, 8: 77-100. 10.1016/0272-7358(88)90050-5.View ArticleGoogle Scholar
- Macavei B: Scala de Atitudini si Convingeri-II (ABS-II) Date preliminare pentru populatia de limba româna [A Romanian adaptation of the Attitudes and Beliefs Scale-II (ABS-II)]. Romanian Journal of Cognitive and Behavioral Psychotherapies. 2002, 2: 105-122.Google Scholar
- Reiss SS, Peterson RAR, Gursky DMD, McNally RJR: Anxiety sensitivity, anxiety frequency and the prediction of fearfulness. Behav Res Ther. 1985, 24: 1-8.View ArticleGoogle Scholar
- Hedman E, Ljótsson B, Rück C, Furmark T, Carlbring P, Lindefors N, Andersson G: Internet administration of self-report measures commonly used in research on social anxiety disorder: a psychometric evaluation. Comput Hum Behav. 2010, 26: 736-740. 10.1016/j.chb.2010.01.010.View ArticleGoogle Scholar
- Rowa K, McCabe RE, Antony M: Specific phobia and social phobia. A guide to assessments that work. Edited by: Hunsley J, Mash EJ. 2008, New York: Oxford University Press, 207-228.View ArticleGoogle Scholar
- Tulbure BT, Szentagotai A, Dobrean A, David D: Evidence based clinical assessment of child and adolescent social phobia: a critical review of rating scales. Child Psychiatry Hum Dev. 2012, 43: 795-820. 10.1007/s10578-012-0297-y.View ArticlePubMedGoogle Scholar
- Antony MM, Coons MJ, McCabe RE, Ashbaugh A, Swinson RP: Psychometric properties of the social phobia inventory: further evaluation. Behav Res Ther. 2006, 44: 1177-1185. 10.1016/j.brat.2005.08.013.View ArticlePubMedGoogle Scholar
- Hedman E, Andersson G, Ljótsson B, Andersson E, Rück C, Mörtberg E, Lindefors N: Internet-based cognitive behavior therapy vs. cognitive behavioral group therapy for social anxiety disorder: a randomized controlled non-inferiority trial. PLoS One. 2011, 6: e18001-10.1371/journal.pone.0018001.View ArticlePubMedPubMed CentralGoogle Scholar
- Beck A, Ward C, Mendelson M: An inventory for measuring depression. Arch Gen Psychiatry. 1961, 4: 561-571. 10.1001/archpsyc.1961.01710120031004.View ArticlePubMedGoogle Scholar
- Beck AT, Steer RA, Brown GK: Manual for the Beck Depression Inventory-II. 1996, San Antonio: TX: Psychological CorporationGoogle Scholar
- Sandin BB, Chorot PP, McNally RJR: Anxiety sensitivity index: normative data and its differentiation from trait anxiety. Behav Res Ther. 2001, 39: 213-219. 10.1016/S0005-7967(00)00009-7.View ArticlePubMedGoogle Scholar
- Zinbarg RE, Barlow DH, Brown TA: Hierarchical structure and general factor saturation of the anxiety sensitivity index: evidence and implications. Psychol Assess. 1997, 9: 277-284.View ArticleGoogle Scholar
- Cuijpers P, Donker T, van Straten A, Li J, Andersson G: Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med. 2010, 40: 1943-1957. 10.1017/S0033291710000772.View ArticlePubMedGoogle Scholar
- Hedman E, Furmark T, Carlbring P, Ljótsson B, Rück C, Lindefors N, Andersson G: A 5-year follow-up of internet-based cognitive behavior therapy for social anxiety disorder. J Med Internet Res. 2011, 13: e39-e39. 10.2196/jmir.1776.View ArticlePubMedPubMed CentralGoogle Scholar
- Schwarz N: Self-reports: how the questions shape the answers. Am Psychol. 1999, 54: 93-105.View ArticleGoogle Scholar
- Greenwald AG, McGhee DE, Schwartz JL: Measuring individual differences in implicit cognition: the implicit association test. J Pers Soc Psychol. 1998, 74: 1464-1480.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.