This article has Open Peer Review reports available.
An internet-based self-help intervention for older adults after marital bereavement, separation or divorce: study protocol for a randomized controlled trial
© The Author(s). 2017
Received: 19 October 2016
Accepted: 15 December 2016
Published: 13 January 2017
Marital bereavement and separation or divorce are among the most stressful critical life events in later life. These events require a dissolution of social and emotional ties, adjustments in daily routine and changes in identity and perspectives for the future. After a normative grief or distress reaction, most individuals cope well with the loss. However, some develop a prolonged grief reaction. Internet-based self-help interventions have proved beneficial for a broad range of disorders, including complicated grief. Based on the task model and the dual-process model of coping with bereavement, we developed a guided internet-based self-help intervention for individuals who experienced marital bereavement, separation or divorce at least 6 months prior to enrolment. The intervention consists of 10 text-based self-help sessions and one supportive email a week. The primary purpose of this study is the evaluation of the feasibility and efficacy of the intervention compared with a waiting control group. The secondary purpose is to compare the effects in bereaved and separated participants. Furthermore, we aim to analyze other predictors, moderators and mediators of the outcome, such as age, psychological distress and intensity of use of the intervention.
The design is a randomized controlled trial with a waiting control condition of 12 weeks and a 24-weeks follow-up. At least 72 widowed or separated participants will be recruited via our study website and internet forums. Primary outcomes are reductions in grief symptoms, depression and psychological distress. Secondary outcome measures are related to loneliness, satisfaction with life, embitterment and the sessions.
The trial will provide insights into the acceptance and efficacy of internet-based interventions among adults experiencing grief symptoms, psychological distress and adaptation problems in daily life after spousal bereavement, separation or divorce. Findings will add to existing knowledge by (1) evaluating an internet-based intervention specifically designed for spousal bereavement and its consequences; (2) testing whether this intervention is equally effective for individuals after separation or divorce; and (3) suggesting adaptations to improve the efficacy of the intervention, selective indication and adaptations for different needs.
ClinicalTrials.gov, NCT02900534. Registered on 1 September 2016.
Marital bereavement and separation or divorce are among the most stressful critical life events in later life. Both events imply a dissolution of social and emotional ties. This deeply affects the attachment system, and requires acceptance of the loss as well as the formation of a new identity and a new perspective for the future. Both events involve the adaptation of daily routines, which can be even more challenging when social, physical and financial resources decline in later life .
Grief and psychological distress after bereavement or divorce are normative reactions. For most people, grief intensity weakens to a manageable degree within several weeks or months. After the most intensive period, grief is still present but the loss becomes gradually integrated and no longer hinders the processes of ongoing life. However, some individuals are less able to cope with bereavement or divorce and show severe prolonged grief symptoms or adaptation problems lasting more than 6 months [2–5]. Some individuals even develop a persistent complex bereavement disorder, which is characterized by separation distress, frequent or disabling cognitive, emotional and behavioural symptoms, such as avoidance of reminders of the loved one, difficulties moving on with life and functional impairment [6, 7].
Several theoretical models describe factors that are crucial for an adaptive adjustment to bereavement. The task model identifies four tasks of mourning, namely, accepting the reality of the loss, experiencing the pain of grief, adjusting to an environment without the deceased person, and withdrawing emotional energy and reinvesting it in another relationship . The dual-process model of coping with bereavement posits that a dynamic coping process oscillating between loss-oriented tasks, such as grief work, and restoration-oriented tasks, such as attending to life changes, is essential for adjustment . Coping with loss-oriented tasks involves positive reappraisal versus rumination, revisions of personal goals, positive and negative event interpretation, and expressing emotions toward the deceased. Restoration-oriented coping is focused on attending to life changes, engaging in new activities, distracting from grief, and finding new roles and identities.
These models also provide a theoretical background for interventions ranging from self-help groups and pastoral care to psychotherapy. Cognitive-behavioural interventions for complicated grief are often based on three components: (1) exposure, e.g. the confrontational technique of ‘revisiting’ the deceased person or telling the story of the loss; (2) cognitive reappraisal or restructuring of individual dysfunctional thoughts (e.g., guilt, anger) associated with the loss; and (3) integration and restoration [10, 11]. Internet-based interventions increasingly complement grief counselling or therapy [12–15]. The majority of internet interventions combine the presentation of a web-based self-help programme with minimal but regular therapist contact. In a recent meta-analysis, this internet-based guided self-help approach has proved to be as effective as face-to-face therapy for depressive symptoms, social anxiety disorder and other psychological or somatic disorders . Furthermore, internet-based interventions have advantages over face-to-face therapy. Benefits of internet-based approaches are low threshold accessibility, flexible usage, independent of time and place, usage at a self-determined pace, a high level of autonomy and privacy, and lower costs . These factors may be especially relevant for older adults. However, challenges of internet-based interventions include technological problems and lower computer literacy or unease using computers, which may be more prevalent in old age.
Exposure, cognitive reappraisal, and integration and restoration as treatment components have also been implemented and evaluated in two randomized controlled trials of internet-based self-help interventions for complicated grief after bereavement. One 5 week internet-based intervention consisted of two writing assignments a week of approximately 45 min . After every second assignment, participants received an email from a therapist with personal feedback and further instructions. This intervention addressed individuals who experienced symptoms of intrusion, avoidance, or maladaptive behaviour after the death of a significant other. The average age of the 55 participants was 37 years; all were women; 61% had lost a child and 10% their spouses. Effect sizes (Cohens d) for the comparison with the waiting group ranged from 0.96–1.74 for different outcome measures. Follow-up measures at 18 months confirmed the stability of these effects .
Another internet-based intervention comprised five structured confrontational writing assignments for individuals who experienced the death of a first-degree relative and who were significantly distressed . The average age of the 757 participants was 43 years; 94% were women; 43% lost a child and 30% their spouses. Effect sizes ranged from 0.19 for emotional loneliness to 0.30 for positive mood for short-term follow-up and 0.25 and 0.23 for long-term follow-ups. These effects were mediated by lower rumination. However, grief and depressive symptoms did not improve. Risk and baseline distress were not confirmed as moderators.
In contrast with these two studies, Litz and colleagues evaluated an internet-based intervention focusing on self-care, social reengagement and goal-focused activities . No formal exposure or cognitive reappraisal was included. Their randomized controlled trial targeted participants between 3 and 6 months after loss and aimed at exploring whether their intervention could prevent prolonged grief disorder. The intervention consisted of 18 sessions covering about 6 weeks, an initial phone call, and periodic brief emails from a therapist. The average age of the 84 participants was 55 years; 68% were women; 78% lost their spouses. The intervention resulted in Cohens d of 1.10 for the reduction in prolonged grief, 0.71 for depression and 0.51 for anxiety.
Finally, a recent study compared an internet-based exposure and behavioural activation treatment . The therapist-guided interventions consisted of six homework assignments over 6–8 weeks and a short feedback after each assignment. The 47 participants were randomly allocated to the two active treatment conditions and a waiting control group. The mean age was 46 years; 92% were women; 40% reported the death of a partner and 60% reported other losses. Both interventions reduced complicated grief, post-traumatic stress, and grief rumination, but only exposure had an effect on depression and brooding levels relative to the control group. Effect sizes ranged between d = 0.07 and d = 1.2. The effects of both interventions were maintained at the 3-month follow-up assessment. To the best of our knowledge, no internet-based self-help intervention has been evaluated for divorced individuals.
Based on the task model of mourning, and the dual-process model of coping with bereavement, we developed a guided internet-based self-help intervention called LIVIA. This intervention addresses individuals who experienced marital bereavement or divorce at least 6 months prior to enrolling in the study and are seeking help for coping with prolonged grief symptoms, psychological distress or adaptation problems in daily life.
This study adds to existing knowledge by (1) evaluating an internet-based intervention specifically designed for spousal bereavement and its consequences; (2) testing whether this intervention is equally effective for individuals who suffer from grief and psychological or behavioural adaptation problems after a separation or divorce; and (3) by including loss-oriented tasks, i.e. exposure and cognitive reframing elements, as well as restoration-oriented tasks, i.e. self-care, social reengagement and goal-focused activities. The combination of both components may increase effect sizes compared with previous studies.
The severity of grief symptoms is not a criterion for taking part in the study, but will be analyzed as a moderator variable. We assume that the internet-based self-help intervention leads to beneficial effects across the severity dimension of distress. Individuals who have already developed a prolonged grief disorder, but who are not willing to see a counsellor or therapist, may benefit from the comprehensive internet-delivered intervention. For individuals with less severe distress, a timely intervention may help to prevent the progress from a normal grief or separation reaction to a prolonged grief disorder.
- (1)To evaluate the effects of the guided internet-based self-help programme compared with a waiting control condition on:
Grief symptoms, psychological distress and depression (primary outcomes)
Loneliness, embitterment, satisfaction with life, and session-related outcomes (secondary outcomes)
- (2)To analyze moderators for the efficacy of the programme, i.e.:
Spousal bereavement versus separation or divorce
Severity of grief symptoms, psychological distress and depression at baseline
Age, sex and computer literacy
- (3)To explore mediators for the efficacy of the programme, i.e.:
Frequency of use of the programme
We specified the sample size needed for the different analyses conducting a power analysis based on a probability level of 0.05 and a power of 0.80 with G*Power  and a power analysis calculator for structural equation models . To test the efficacy of the intervention compared with the control condition, we expected a large effect of d = 0.80. Power analyses indicated a necessary sample size of 42 individuals for this most basic analysis. For the analysis of several predictor variables, as well as moderation and mediation effects using structural equation modelling, we assumed moderate effects of r = 0.30. Power analyses resulted in a sample size of 138 participants. Anticipating a drop-out rate of 40% at the 6 month follow-up, we aim at recruiting between 72 and 220 participants at baseline.
Recruitment is based on the LIVES longitudinal study and internet-self-help forums. All participants who reported difficulties with adjustment after marital bereavement or separation or divorce in the LIVES study receive an information letter about the self-help programme, with a link to the study website, from the LIVES study coordinator. Additionally, information about the intervention with a link to the study website is posted on several internet-based self-help forums.
All interested adults are required to complete baseline screening questionnaires and a telephone interview for assessing eligibility prior to randomization.
Experience of marital bereavement or a separation or divorce more than 6 months prior to enrolment in the study
Seeking help for coping with prolonged grief symptoms, psychological distress or the psychosocial adaptation to a life without the partner
Having access to an internet connection
Mastery of the German language
Provision of informed consent
Severe psychological or somatic disorders which need immediate treatment and acute suicidality (Beck Depression Inventory suicide item > 1 or suicidal ideation in the telephone interview).
No emergency plan: in the telephone interview, an emergency plan will be developed that specifies a health care professional, to whom participants can turn in an acute crisis. If no such person or health care service can be found, individuals are excluded from the intervention.
Concomitant psychotherapy, or prescribed drugs to treat depression or anxiety, if the prescription or dosage has changed in the month prior or during the self-help intervention.
Inability to follow the procedures of the study, e.g. due to comprehension problems.
Description of the intervention
Outline of the 10 self-help sessions of the internet-based intervention
Information about the self-help intervention, grief reactions, reactions to separation, predictors and treatment of complicated grief
2. Assessment of current situation
Information about and assessment of emotions in the context of the interpersonal loss, changes in life since the loss and obstacles for a positive adaptation
3. Fostering positive thoughts and emotions
Information about emotion regulation and cognitive-behavioural strategies to promote positive thoughts and emotions
Protocols for practising these strategies in daily life
4. Finding comfort
Suggestions for self-soothing strategies and exercises to promote positive feelings (e.g. diary for positive experiences)
Checklists for current physical, emotional and practical self-care, formulation of self-care goals and suggestions for implementing self-care behaviour in daily life
6. Accepting memories and pain
Writing tasks to integrate painful memories of the loss into the autobiographical memory and to be able to tell the story of the loss
7. Unfinished business
Identification of unfinished business and regrets, writing tasks to formulate unfinished business and to find ways to put issues at rest
8. Creating a new life without the partner
Identifying changes in daily life since the loss and sources of support and strengths before and after the loss
Information about post-traumatic growth
Identifying and activating resources in daily life
9. Social relationships
Clarifying current relationships using a sociogram
Defining goals related to social relationships, e.g. changing relationships, building up new social contacts, and suggestions for promoting social well-being
10. Redefinition of the relationship to the lost partner
Writing a farewell letter to the lost partner: saying good-bye and telling the lost partner about the future importance of the loss and how the participant will continue life without the lost partner
During the work with the text-based sessions, participants receive email support by psychologists of the Department of Clinical Psychology and Psychotherapy of the University of Bern. These weekly emails acknowledge and motivate participants in their work with the self-help programme and provide a weekly structure and support for technical problems. Participants can contact their supporters anytime with questions via a contact button in the self-help programme. The email-supporters are supervised by a fully trained psychotherapist.
Primary outcome measures
Grief symptoms are assessed using the German version of the Texas Revised Inventory of Grief . The Texas Revised Inventory of Grief is a widely used measure to assess the severity of grief symptoms. A recent factor analysis identified three factors for emotional response, thoughts, and non-acceptance regarding a loss . The German version of the Texas Revised Inventory of Grief is a 16-item measure to assess the severity of grief symptoms, from 1 = completely true to 5 = completely false.
Psychopathological distress is assessed using the German version of the Brief Symptom Inventory, a widely used 53-item measure to assess a broad range of somatic and psychopathological symptoms within 7 days prior to completing the questionnaire . Factors include depressed mood, somatic symptoms, information processing deficits, and interpersonal insecurity . Answer categories range from 0 = not at all to 4 = very much.
Depressive symptoms are assessed with the German version of the Beck Depression Inventory II . This measure consists of 21 items on a scale from 0 to 3.
Secondary outcome measures
Loneliness is assessed using the De Jong Gierveld Short Scale for Emotional and Social Loneliness . This is a six-item scale with answer categories from 0 = no to 5 = yes.
Embitterment is assessed with the short version of the Embitterment Scale, which consists of six items rated on a scale from 0 = I do not agree to 4 = I agree .
Life satisfaction is assessed with the German version of the Satisfaction with Life Scale [30, 31]. It consists of five items with answer categories from 1 = completely disagree to 7 = completely agree.
Session-related outcomes. We included nine items related to specific sessions of the intervention, e.g. self-rated knowledge about grief symptoms, self-care, self-soothing strategies, satisfaction with social relationships or the current life situation. Items are rated on scale from 1 = very little to 10 = very much.
Satisfaction with the self-help programme. Six items assess the evaluation of the quality of and the satisfaction with the intervention, and six items assess effects of the intervention related to mechanisms of change, i.e. mastery experiences, clarification experiences or insight, problem actuation, and resource activation. Response categories range from 1 = not at all to 4 = very much.
Predictors and moderators
Computer literacy is assessed using the first seven items of the Computer Literacy Scale for Older Adults . They assess experiences with the computer and the frequency with which participants engage in different computer-related tasks.
Demographic variables include sex, age, education, overall self-rated health, and details about the marital history and the loss of the partner or the separation or divorce.
Criteria for a persistent complex bereavement disorder according to the Diagnostic and Statistical Manual of Mental Disorders  are assessed in the telephone interview.
Suicidality is assessed in the telephone interview using the suicidality questions of the Brief Psychiatric Rating Scale .
Adherence and completion data, as well as data on the duration and the intensity of the use of the self-help intervention are collected within the platform.
Data collection and management
Data are assessed using online-questionnaires programmed in Qualtrics . Data integrity is enforced through a variety of mechanisms, i.e. referential data rules, valid values, range checks, and consistency checks. The option to choose a value from a list of valid codes and a description of what each code means is available where applicable. Checks are applied at the time of data entry into a specific field. In addition, data on the use of the self-help sessions are collected within the platform. All data will be saved in an anonymous way only identified by a code that is not related to the participant’s identity. Servers are protected by high-end firewall systems. Only the researchers directly involved in the study have access to the data.
Analysis will be conducted according to the intention-to-treat paradigm. Firstly, we will analyze the extent of missing data, explore the missing data patterns and determine the type of missing data (missing completely at randomization, missing at randomization, not missing at randomization). If the missing mechanism is missing at randomization, we will use multilevel regression analyses, which allow a different number of measurement points per participants and are thus less sensitive to missing data. We will include time (pre versus post-intervention measures and post-intervention versus follow-up measures), group (immediate access versus control condition), event (bereavement versus separation or divorce) and interaction terms as predictors of the outcome variables. Cohens d will be calculated as effect size for all observed outcome variables. To analyze the longitudinal interplay of predictor variables, we will conduct structural equation models. Analysis will be conducted in SPSS and Mplus.
The results of this study will provide insight into the acceptance and efficacy of an internet-based self-help intervention for adults who experience grief symptoms, psychological distress or adjustment problems in daily life after marital bereavement or separation or divorce. The outcomes for bereaved and separated or divorced participants will be compared. The analysis of other moderator variables may further aid future selective indication and adaptations for different needs.
Limitations of this study include the self-selectivity of the sample. It may be possible that older adults who are willing to take part in an internet-based self-help intervention have more cognitive resources and a higher education level.
We thank Jacqueline Aebersold and Lara Staeubli for contributing to the pilot study; Timo Stolz for the design of the logos; and all colleagues who contributed to the development of the intervention.
This project was funded by the Swiss National Science Foundation grant 51NF40-160590 granted to Dario Spini. The Swiss National Science Foundation had no role in the design of the study and collection, analysis, or interpretation of data, or in writing the manuscript.
Availability of data and materials
JB participated in the design of the study and the development of the intervention, and drafted the manuscript. TB participated in the design of the study and the development of the intervention, and programmed the self-help intervention. HJZ conceived the study and participated in its design and the development of the intervention. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Ethical approval has been obtained by the Cantonal Ethics committee Berne (BASEC2016-00180). We will obtain informed consent from all participants in the study.
Trial start date: June 2016.
Currently recruiting (N = 69, December 2016).
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Znoj H. Trennung, Tod und Trauer [Separation, death and grief]. Bern: Hogrefe; 2016.Google Scholar
- Aoun SM, Breen LJ, Howting DA, Rumbold B, McNamara B, Hegney D. Who needs bereavement support? A population based survey of bereavement risk and support need. PLoS One. 2015;10(3):e0121101.View ArticlePubMedPubMed CentralGoogle Scholar
- Shear MK, Ghesquiere A, Glickman K. Bereavement and complicated grief. Curr Psychiatry Rep. 2013;15(11):406.View ArticlePubMedGoogle Scholar
- Spahni S, Morselli D, Perrig-Chiello P, Bennett KM. Patterns of psychological adaptation to spousal bereavement in old age. Gerontology. 2015;61(5):456–68.View ArticlePubMedGoogle Scholar
- Perrig-Chiello P, Hutchison S, Morselli D. Patterns of psychological adaptation to divorce after a long-term marriage. J Soc Pers Relatsh. 2015;32(3):386–405.View ArticleGoogle Scholar
- Prigerson HG, Horowitz MJ, Jacobs SC, Parkes CM, Aslan M, et al. Prolonged grief disorder: psychometric validation of criteria proposed for DSM-V and ICD-11. PLoS Med. 2009;6(8):e1000121.View ArticlePubMedPubMed CentralGoogle Scholar
- American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-5®). Washington DC: American Psychiatric Publishing; 2013.View ArticleGoogle Scholar
- Worden JW. Grief counselling and grief therapy: a handbook for the mental health professional. 4th ed. New York: Springer Publishing Company; 2009.Google Scholar
- Stroebe M, Schut H. The dual process model of coping with bereavement: rationale and description. Death Stud. 1999;23(3):197–224.View ArticlePubMedGoogle Scholar
- Shear K, Frank E, Houck PR, Reynolds CF. Treatment of complicated grief: a randomized controlled trial. JAMA. 2005;293(21):2601–8.View ArticlePubMedGoogle Scholar
- Boelen PA, de Keijser J, van den Hout MA, van den Bout J. Treatment of complicated grief: a comparison between cognitive-behavioral therapy and supportive counseling. J Consult Clin Psychol. 2007;75(2):277–84.View ArticlePubMedGoogle Scholar
- Wagner B, Knaevelsrud C, Maercker A. Internet-based cognitive-behavioral therapy for complicated grief: a randomized controlled trial. Death Stud. 2006;30(5):429–53.View ArticlePubMedGoogle Scholar
- van der Houwen K, Schut H, van den Bout J, Stroebe M, Stroebe W. The efficacy of a brief internet-based self-help intervention for the bereaved. Behav Res Ther. 2010;48(5):359–67.View ArticlePubMedGoogle Scholar
- Litz BT, Schorr Y, Delaney E, Au T, Papa A, Fox AB, et al. A randomized controlled trial of an Internet-based therapist-assisted indicated preventive intervention for prolonged grief disorder. Behav Res Ther. 2014;61:23–34.View ArticlePubMedPubMed CentralGoogle Scholar
- Eisma MC, Boelen PA, van den Bout J, Stroebe W, Schut HA, et al. Internet-based exposure and behavioral activation for complicated grief and rumination: a randomized controlled trial. Behav Ther. 2015;46(6):729–48.View ArticlePubMedGoogle Scholar
- Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided internet‐based vs. face‐to‐face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta‐analysis. World Psychiatry. 2014;13(3):288–95.View ArticlePubMedPubMed CentralGoogle Scholar
- Schröder J, Berger T, Westermann S, Klein JP, Moritz S. Internet interventions for depression: new developments. Dialogues Clin Neurosci. 2016;18:203–12.PubMedPubMed CentralGoogle Scholar
- Wagner B, Maercker A. A 1.5‐year follow‐up of an internet‐based intervention for complicated grief. J Traum Stress. 2007;20(4):625–9.View ArticleGoogle Scholar
- LIVES Swiss National Centre of Competence in Research. Overcoming vulnerability: life course perspectives. Relationships in later life IP212. https://www.lives-nccr.ch/en/page/relationships-later-life-n51. Accessed 3 Oct 2016.
- Random.org. https://www.random.org. Accessed 3 Oct 2016.
- Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39(2):175–91.View ArticlePubMedGoogle Scholar
- Soper D. Calculator: a-priori sample size for structural equation models. http://www.danielsoper.com/statcalc/calculator.aspx?id=89. Accessed 3 Oct 2016.
- Znoj H. Texas-Revised Inventory of Grief: Validierung der deutschen Version TRIG-D. Psychosom Konsiliarpsychiatr. 2008;2(4):236–9.View ArticleGoogle Scholar
- Futterman A, Holland JM, Brown PJ, Thompson LW, Gallagher-Thompson D. Factorial validity of the Texas-Revised Inventory of Grief – present scale among bereaved older adults. Psychol Assessment. 2010;22(3):675–87.View ArticleGoogle Scholar
- Franke GH. BSI. Brief Symptom Inventory by LR Derogatis. German version. Göttingen: Beltz; 2000.Google Scholar
- Brodbeck J, Stulz N, Itten S, Regli D, Znoj H, Caspar F. The structure of psychopathological symptoms and the associations with DSM-diagnoses in treatment seeking individuals. Compr Psychiatry. 2014;55(3):714–26.View ArticlePubMedGoogle Scholar
- Kühner C, Buerger C, Keller F, Hautzinger M. Reliabilität und Validität des revidierten Beck-Depressionsinventars (BDI-II). Befunde aus deutschsprachigen Stichproben Nervenarzt. 2007;78(6):651–6.Google Scholar
- De Jong GJ, Van Tilburg T. The De Jong Gierveld Short Scales for Emotional and Social Loneliness: tested on data from 7 countries in the UN generations and gender surveys. Eur J Ageing. 2010;7(2):121–30.View ArticleGoogle Scholar
- Znoj H, Schnyder U. Verbitterungsfragebogen Kurzversion. Bern: University of Bern; 2014.Google Scholar
- Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess. 1985;49(1):71–5.View ArticlePubMedGoogle Scholar
- Schumacher J. SWLS – Satisfaction with life scale. Diagnostische Verfahren zu Lebensqualität und Wohlbefinden. Göttingen: Hogrefe; 2003.Google Scholar
- Sengpiel M, Dittberner D. The computer literacy scale (CLS) for older adults–development and validation. In: Herczeg M, Kindsmueller MC, editors. Mensch & Computer. Viel Mehr Interaktion. Muenchen: Oldenbourg Verlag; 2008. p. 7–16.Google Scholar
- Ventura J, Green MF, Foster M, Shaner A, Liberman RP. Training and quality assurance with the Brief Psychiatric Rating Scale: “the drift busters”. Int J Methods Psychiatr Res. 1993;3:221–44.Google Scholar
- Qualtrics. www.qualtrics.com. Accessed 3 Oct 2016.