Evaluation of a school-based intervention to promote mental health of refugee youth in Sweden (The RefugeesWellSchool Trial): study protocol for a cluster randomized controlled trial
Trials volume 22, Article number: 98 (2021)
Sweden is home to a large and growing population of refugee youths who may be at risk of mental health problems such as post-traumatic stress disorder (PTSD). Thus, there is a need for interventions that address mental health problems in these populations. Schools have been identified as an ideal setting for delivering such interventions as they offer a non-stigmatizing space and are often central to young refugees’ social networks. The RefugeesWellSchool trial in Sweden will investigate an intervention comprising two programmes: Teaching Recovery Techniques (TRT) and In-service Teacher Training (INSETT), delivered in a school setting, among refugee youth. TRT is a group-based programme for children and adolescents, informed by Trauma-Focused Cognitive Behavioral Therapy (TF-CBT). INSETT is a multi-module course for teachers providing information on trauma and the refugee experience to build teachers’ cultural competence and capacity for supporting refugee youths in schools.
This trial employs a cluster randomized-control design with two arms: (1) the intervention arm in which the TRT and INSETT programmes are offered (n = 350), (2) the wait-list control arm (n = 350) in which services are provided as usual until the TRT and INSETT programmes are offered approximately six months later. Data will be collected prior to the intervention, immediately following the intervention, and at three months post-intervention. Outcomes for the trial arms will be compared using linear mixed models or ANCOVA repeated measures as well as the Reliable Change Index (RCI).
This study will provide knowledge about the effectiveness of an intervention comprising two programmes: a group-based programme for youth reporting symptoms of PTSD and a training course for teachers, in order to build their competence and ability to support refugee youths in schools.
ISRCTN, ISRCTN48178969, Retrospectively registered 20/12/2019.
In 2015, Europe experienced the “refugee crisis” when millions of people were displaced. Displacement has continued and the number of refugees worldwide continues to grow . Thousands of refugees have entered Sweden, including many children and youth . Sweden is generally viewed as successful in its acceptance and reception of refugees, but it still experienced many challenges in providing quality services to refugees, especially during the height of the refugee crisis . Young refugees are an especially vulnerable population. Persistent stress, like that experienced by young refugees facing displacement, threats to their safety, unstable environmental and social conditions, as well as acculturation stress, contribute to the development of mental health problems [4,5,6]. Additionally, traumatic experiences, such as loss of relatives, experience of persecution and exposure to torture, physical and/or sexual violence, are also highly related to the development of mental health problems [7,8,9]. A high prevalence of mental health problems including post-traumatic stress disorder (PTSD), depression, and anxiety has been identified in young refugees [7, 10,11,12]. Thus there is a clear need for programs and interventions that quickly and efficiently address the mental health needs of young refugees.
Interventions have been developed to support mental health, recovery and resilience in refugee populations and schools have been identified as an ideal setting to implement such interventions [13,14,15]. Functionally, school-based interventions provide a unique opportunity to easily reach youth who may otherwise be isolated or unable to access services [14, 16,17,18,19].
Socially, schools are non-stigmatizing spaces, central to a refugee’s social network and a main contact point with the host society. Mental health interventions taking place in a school context may further promote the development of social support networks and positive intercultural relationships while countering stigma and discrimination [17, 18, 20].
Previous studies generally recommend Trauma-Focused Cognitive Behavioral Therapy (TF-CBT) for reducing symptoms of PTSD and other mental health problems in refugee children [21, 22]. An intervention based on TF-CBT is the Teaching Recovery Techniques (TRT) programme, developed by the Children and War Foundation in Norway and the UK . The TRT is a manualised group intervention, including both youth and caregiver sessions, aiming to promote coping and recovery from symptoms of PTSD in children aged eight and above with traumatic experiences. The TRT programme has been used effectively in several contexts such as Palestine and Gaza [24, 25] and post-tsunami Thailand . It has also been used in a Swedish context with 208 unaccompanied refugee minors . This pilot study showed that 84% of the youths reported moderate to severe depression at baseline, and that both depression symptoms and PTSD symptoms were significantly lowered after the intervention. A meta-analysis of 19 studies found that cognitive behavioral therapy interventions delivered in schools are effective in reducing PTSD symptoms among young people, including refugee youth . According to our knowledge, the TRT has not been evaluated in a Swedish school setting.
In addition to TF-CBT interventions targeting youth, teacher interventions might play an important role in promoting refugee youth’s mental health [20, 29,30,31,32]. An intervention targeting teachers working with refugee youth is the In-service Teacher Training (INSETT) programme [32, 33], aiming to strengthen teachers’ competence on how refugee experiences may affect school functioning and psychosocial wellbeing in youth upon resettlement in the new host country. [29, 32]. The programme enhances teachers’ ability to support young refugee students through promoting interethnic relationships with peers, school belonging, and supportive relationships between teachers and parents/caregivers . No previous research has evaluated the INSETT programme in a school setting.
To conclude, schools play an important role to promote refugee and migrant youth’s mental health. However, there is limited research on the impact of school-based interventions addressing mental health in refugee youth, especially in the Swedish context .
The RefugeesWellSchool trial in Sweden aims to strengthen the evidence base for two school-based programmes: TRT and INSETT, among refugee youth. The objectives of the trial are:
To investigate whether the TRT programme, delivered in a school setting, has a positive effect on mental health among youth who screened positive for PTSD symptoms in comparison to services as usual
To investigate whether the INSETT programme, delivered in a school setting, has a positive effect on teacher-parent collaboration and teacher multicultural competence in comparison to teachers who receive service as usual
To investigate whether the INSETT programme, delivered in a school setting, has a positive effect on mental health, social support and school belonging among youth whose teachers have received the INSETT programme, in comparison to youth whose teachers have not received the programme
To investigate whether the caregiver sessions of the TRT programme have a positive effect on parental/guardian mental health in comparison to parents/guardians who have not attended the caregiver sessions of the TRT programme
To describe the implementation of the TRT and INSETT programmes using process evaluation
To estimate the cost-effectiveness of the two programmes.
It is hypothesized that:
Youth who screened positive for PTSD symptoms and receive TRT will report fewer mental health problems, especially PTSD symptoms, as well as depression and anxiety symptoms, in comparison to youth who have not received the intervention (the waitlist-control).
Teachers who receive INSETT will report increased positive teacher-parent relationships and multicultural competence, in comparison to teachers who have not received the intervention (the wait-list control).
Youth whose teachers received the INSETT will report fewer mental health problems and higher levels of social support and school belonging, in comparison to youth whose teachers have not received the INSETT programme (the wait-list control).
Parents/guardians who attend TRT as caregivers will report fewer mental health problems, in comparison to parents/guardians who have not received the intervention (the wait-list control).
Both programmes generate health gains for reasonable costs
The trial is a cluster randomized-control design using two arms: the intervention arm, which receives the TRT and INSETT programmes, and the wait-list control arm, which receives services as usual until approximately six months after the study begins. The cluster is assigned by school and in an allocation ratio of 1:1. Assessment will take place at three time points: 1) at baseline, prior to the intervention beginning (T1); 2) immediately following the intervention (T2); and 3) three months post-intervention (T3). The trial will run from 2019 to 2021/2022. See Fig. 1 for an overview of assessments. The Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist is provided as an Additional file. The trial has been approved by the Regional Ethical Review Board in Uppsala (Dnr: 2019–031160), Sweden and registered with an international trial registry (ISRCTN 48178969).
The intervention will be implemented in schools that run classes for grades 7–9 and/or introduction classes for newcomer youths. Schools that are multi-ethnic, with the definition that at least 30% of their registered students have a background other than Swedish, will be included. Such schools will be identified using publicly available information on municipal websites. Schools from across Sweden, including rural, suburban, and urban areas, will be contacted.
Schools and participants
Schools are eligible to participate in the study if they meet the following inclusion criteria:
The school consents to participation.
The school is multi-ethnic, with 30% of its registered students having a non-Swedish background.
The school is a secondary or upper secondary school with students in grades 7–9 and/or in introduction classes for newcomers.
Teachers are eligible to participate if they meet the following criteria:
Teacher consents to participation
All youth within participating schools are eligible to participate in the data collection of this study if they meet the following criteria:
Youth’s legal guardian consents to participation if he/she is < 15 years.
Youth consents to participate if he/she is ≥15 years.
The TRT programme will only be offered to youth who meet the following inclusion criteria:
Youth’s legal guardian consents to participation if the youth is < 15 years.
Youth consents to participate if he/she is ≥15 years.
Youth has been in Sweden less than or equal to 6 years.
Youth has screened positive for PTSD symptoms (≥17 points) on the Children’s Revised Impact of Event Scale-8 (CRIES-8) .
Youth has no other ongoing mental health therapeutic intervention.
Parents/guardians are eligible to participate if they meet the following criteria:
Parents/guardians consent to participation.
Parents/guardians has a child who participates in the TRT programme.
Eligible schools are recruited through phone and email contact with municipalities, school directors, and principals. Schools are provided with information about the study, including study aims and methodology in order to inform their decision to participate. Eligible schools will be allocated to an intervention group or a wait-list control group.
Information meetings will be held for teachers, parents/guardians and youth to recruit participants. All participants will be provided with written information about the study and give their informed consent.
Baseline (T1) assessment with youths will be conducted through an online survey targeting whole classes and T1 assessment with teachers and parents/guardians will be conducted where participants are offered to either fill in the online survey or a paper version of the survey.
All youth will be screened with the CRIES-8  included in the baseline survey, for assessment of PTSD symptoms. The CRIES-8 includes four intrusion and four avoidance items pertaining to a specific traumatic event. Participants report the frequency of the symptoms in the previous week on a scale from 0 (not at all) to 1, 3 and 5 (often). The CRIES-8 has been found to have strong psychometric properties among children living in contexts where traumatic events are prevalent, including adequate discriminant and convergent validity and test-retest reliability . In addition, it has been shown to have good internal consistency its factor structure confirmed in a sample of unaccompanied refugee minors in Sweden .
In the intervention schools, youth who score 17 or above on the CRIES-8, which is the cut-off for PTSD symptoms, will be invited to participate in the TRT programme. The wait-list control schools will be informed about which youth scored above the cut-off of the CRIES, in order to provide services as usual. Furthermore, teachers in intervention schools will be offered the INSETT programme. The teachers in the wait-list control schools will be offered INSETT when all T3 follow-up data has been collected.
A Flow-chart for the trial procedure is shown in Fig. 2.
The intervention of this study comprises two programmes, TRT and INSETT (described below), which are delivered to the intervention group as well as to the wait-list control group, at a later stage.
Teaching Recovery Techniques
Teaching Recovery Techniques (TRT) is a manualised group intervention, developed by the Children and War Foundation . It is targeted to children and adolescents with PTSD symptoms and is based on TF-CBT, which is agreed to be the method of choice for reducing PTSD symptoms in these populations . Two group leaders who have completed a three-day training programme, provided by the Swedish non-government organization Children’s Right in Society, deliver TRT over seven consecutive weeks. TRT involves two caregiver sessions and seven youth sessions, where each session is two hours long. Caregiver sessions include an introduction to TRT, an overview of the content in the youth sessions, psychoeducation, and information on how to support the youth and seek care if needed. Youth sessions focus on psychoeducation, intrusion, arousal, avoidance, and coping strategies. Each session involves skills training, rehearsal of skills, and homework. The first youth session focuses on group members getting to know one another whereas the final session acts as a closing in which participants consolidate learning and talk about their experience of taking part in the programme.
In-service Teacher Training
In-service Teacher Training (INSETT) was developed by Lutine de Wal Pastoor at the Norwegian Centre for Violence and Traumatic Stress Studies (NKVTS) in Norway, and the Augeo Foundation in the Netherlands [32, 33]. The programme is designed to provide teachers with information and training related to trauma and the refugee experience to improve their cultural competency, sense of professional self-efficacy, and interrelationships with parents. It comprises three course modules and runs over a 10–12 week period. An essential part of the programme is an online course module to be completed individually, including eight sections totalling four to five hours of study. The online module topics includes traumatic experiences, stress, self-regulation, coping strategies, identity and belonging. Each section provides theory, various exercises and case studies, as well as references for further reading .
The remaining two modules consist of whole-day seminars delivered in a group setting. One seminar takes place prior to the online course and introduces the course structure along with fundamental terms and elementary information about the refugee experience. The other seminar takes place after the online course has been completed. It allows participants to consolidate learning and to share their experiences of the intervention.
Multiple measures will be used to collect data from youths, parents/guardians, and teachers at three time points: T1 (pre-intervention), T2 (post-intervention) and T3 (three months follow-up), see Fig. 1. Below, we outline the primary and secondary outcomes for each participant group.
Adolescents who receive TRT
For adolescents who receive TRT, the primary outcome is PTSD symptoms measured using the Children’s Revised Impact of Event Scale (CRIES-13) . The CRIES-13 includes 13 self-report items on intrusion, avoidance and arousal which are answered on a scale from 0 (not at all) to 1, 3 and 5 (often). Total scores on the scale range from 0 to 65 with a cutoff score of 30 or above. The scale has been shown to have good internal consistency, and to successfully categorize more than 75% of children with and without a PTSD diagnosis [35, 37].
Parents/guardians whose children receive TRT
For parents/guardians whose children receive TRT and who attend TRT as caregivers, the primary outcome is mental health, as measured using the General Health Questionnaire (GHQ-12)  which screens for non-specific mental health problems using 12 self-report items on a 4-point scale from 0 to 3. This measure has shown good psychometric properties among adults in a large German sample  and has specifically shown excellent discriminant validity in a Swedish context .
Teachers who receive INSETT
For teachers who receive INSETT, the primary outcomes are parent-teacher collaboration and multicultural competence. Parent-teacher collaboration is measured using the Trust Scale (TS) [41, 42]. TS measures levels of trust between parents and teachers, including the elements of predictability, dependability, and faith, by asking participants to report on their level of agreement with 13 statements about parents’ performance and attitudes from 0 (strongly disagree) to 3 (strongly agree). The scale has demonstrated psychometric properties elsewhere .
Multicultural competence is measured by the Teacher Multicultural Attitude Scale (TMAS)  which includes 20 items for teachers to self-report about the cultural competence of their teaching and attitudes about multiculturalism on a scale of 1 (strongly disagree) to 5 (strongly agree). The scale has demonstrated both validity and internal consistency in separate samples of teachers .
Adolescents whose teachers receive INSETT
For adolescents who do not receive TRT but whose teachers participate in INSETT, the primary outcome is school belonging, which will be measured using 9 items of the 18-item Psychological Sense of School Membership Scale (PSSMS) . The PSSMS captures student perceptions about caring relationships, acceptance, and rejection within their school  and uses a 5-point response scale from 1 (not at all true) to 5 (completely true). The measure has demonstrated both high internal consistency and criterion validity in previous research .
Adolescents who receive TRT
For adolescents who receive TRT, the secondary outcomes include additional aspects of mental health problems, namely internalizing and externalizing problems, symptoms of depression, anxiety symptoms, general well-being and life satisfaction. Internalizing and externalizing problems are measured using the Strengths and Difficulties Questionnaire (SDQ) . The SDQ is a widely known measure which comprises 25 items that can be divided into five subscales: emotional symptoms, hyperactivity, conduct problems, peer problems, and prosocial behavior. Each item is rated on a scale from 0 to 2 and each subscale has a total score range of 0–10. A total difficulties score can also be calculated as the sum of the emotional, conduct, hyperactivity and peer problems subscales, ranging between 0 and 40. The SDQ has previously demonstrated adequate psychometric properties in research on adolescents [48,49,50].
Symptoms of depression will be measured using the Patient Health Questionnaire-9 (PHQ-9) . Participants report how often they have experienced nine depression symptoms in the previous two weeks on a scale from 0 (not at all) to 3 (nearly every day). The PHQ-9 has been validated among adolescents and has been shown to have strong construct validity and appropriate sensitivity and specificity .
Furthermore, anxiety symptoms will be assessed through the Generalized Anxiety Disorder scale (GAD-7) , a 7-item self-report measure originally developed to screen for generalized anxiety disorder. Individual items are rated according to the frequency of their occurrence during the past 2 weeks on a scale from 0 (Not at all) to 3 (Nearly every day). The GAD-7 has shown adequate reliability and validity in previous studies .
General well-being and life satisfaction will be assessed using the Cantril ladder . The youth will be presented a picture of a ladder and asked to think about their life right now and place themselves on the ladder, choosing a number from 0 to 10 where 0 indicates the worst possible life satisfaction and 10 indicates the best. The Cantril Ladder measure will be used by the group leaders during the TRT sessions as part of a safety protocol and a check-in for the youth’s wellbeing.
In addition to mental health problems, other secondary outcomes for youth who receive TRT include number of stressors in daily life, social support, and resilience, perceived discrimination, school belonging and executive functioning. The Daily Stressors Scale for Young Refugees (DSSYR) is a 7-item self-report questionnaire that measures to what extent material stressors (insufficient housing, medical care, clothing/food and money) were experienced by the participants during the previous month; the questionnaire uses a five-point Likert scale from 1 (not) to 5 (very much) . According to our knowledge, the psychometric properties of DSSYR have not yet been assessed in previous research. The Multidimensional Scale of Perceived Social Support (MSPSS) [56, 57] will be used to assess social support. The MSPSS is a 12-item self-report questionnaire designed to measure perceived social support from three sources: family, and friends, using a five-point Likert scale from 0 (strongly disagree) to 5 (strongly agree). The scale has established reliability and strong factorial validity in previous research [56, 58]. Also, the existence of interethnic friendships and friendship satisfaction, will be assessed through specific items developed for this study. Resilience will be measured by the Child and Youth Resilience Measure (CYRM-12) . The CYRM is a 12-item self-report measure exploring the resources, i.e., individual, relational, communal and cultural, available to youth, that may bolster their resilience. It uses a 5-point Likert-scale ranging from 1 (not at all) to 5 (a lot), where higher scores equal to higher degree of higher resilience. Research has shown good reliability and sufficient content validity of the CYRM-12, when used among adolescents .
Furthermore, the 9-item scale Discrimination at Work/School of the Perceived Ethnic Discrimination Questionnaire-Community Version (PEDQ-CV)  will be used as a measure of experience of perceived discrimination. This scale includes items that refer to experiences of discrimination from school/work staff, classmates/colleagues or from other parts of society, and that are rated on a 4-point scale ranging from 1 (never happened) to 4 (always). Both the scale and the full PEDQ instrument have established good reliability and construct validity .
Also, 9 items of the 18-item Psychological Sense of School Membership Scale (PSSMS) , as described above, will be used as a measure of feelings of belonging at school.
Executive functioning will be measured using the Amsterdam Executive Function Inventory (AEFI)  on which youth report perceptions of their own executive functions. The AEFI is a brief self-report questionnaire to assess three components of the executive aspects of daily life behavior, namely Attention, Self-Control and Self-Monitoring, and Planning and Initiative. The scale includes 14 items, which are rated on a 3-point Likert scale where 1 = “not true,” 2 = “partly true,” and 3 = “true”. Adequate construct validity and reliability of the AEFI has been demonstrated .
Parents/guardians whose children receive TRT
For parents/guardians whose children receive TRT and who attend TRT as caregivers, secondary outcomes include PTSD symptoms, general health, teacher-parent collaboration, perceived discrimination and social support. Outcomes are measured using the Posttraumatic Stress Disorder-8 (PTSD-8)  which screens for PTSD symptoms using eight items aligned to the Diagnostic and Statistical Manual of Mental Disorders-IV (DSM-IV) criteria for PTSD. Its items are rated on a four-point Likert scale from 1 (not at all) to 4 (all the time). The PTSD-8 Questionnaire has established adequate psychometric properties in various samples .
An additional one-item on general health from the Short Form Health Survey (SF-36)  is also used as an outcome measure. The SF-36 is a multi-purpose, short-form health survey, containing 36 questions. The item used in the current trial is rated on a scale from 1 to 5, where 1 equals excellent and 5 equals poor. Overall, the SF-36 has demonstrated adequate psychometric properties in previous research .
To measure parent-teacher collaboration, the TS scale is used, as described above, but parents report on their beliefs about teachers [41, 42]. Experiences of discrimination are measured using the PEDQ-CV , and parents’ experiences of social support are measured using the Enriched Social Support Instrument (ESSI) . The ESSI is a 7-item self-report survey that assesses four attributes of social support: emotional, instrumental, informational, and appraisal. Items are rated on a scale from 1 (none of the time) to 5 (all of the time). Due to its brevity and psychometric properties, the ESSI has been deemed as an excellent screening tool for social support .
Teachers who receive INSETT
For teachers who receive INSETT, secondary outcomes include teachers’ self-efficacy, stress symptoms, work exhaustion/burnout, work engagement, and classroom atmosphere. Self-efficacy is measured using the Teachers’ Sense of Efficacy Scale (TSES) . The TSES directs teachers to respond to 12 items measuring their self-efficacy, given their current ability, resources, and opportunities in their present position. Participants respond to items on a scale from 1 (none at all) to 9 (a great deal). The TSES has established good reliability and factor structure in previous research .
Stress symptoms are measured by the Single Item Stress Index (SISI) , containing the following item “Stress means a situation in which a person feels tense, restless, nervous or anxious or is unable to sleep at night because his/her mind is troubled all the time. Do you feel this kind of stress these days?” The response is rated on 5-point Likert scale from 1 (not at all) to 5 (very much). The SISI has shown satisfactory content, criterion, and construct validity among adults in various samples .
Furthermore, work exhaustion/burnout will be measured by the Bergen Burnout Inventory (BBI) . The BBI comprises 15 self-report items that measure burnout through three scales: exhaustion at work, cynicism toward the meaning of work and the sense of inadequacy at work. All items are rated on a 6-point Likert-type scale ranging from 1 (completely disagree) to 6 (strongly agree). The instrument has demonstrated reliability and construct validity among adults in various samples . In the current study, we will use the work exhaustion scale, comprising five items.
Also, work engagement will be measured by items of the Utrecht Work Engagement Scale (UWES) . The UWES comprises 17 self-report items that can be divided into three subscales that reflect the underlying dimensions of engagement: Vigor, Dedication and Absorption. All items are scored on a 7-point frequency rating scale ranging from 0 (never) to 6 (always). The UWES has been found to have good internal consistency, factor structure and test-retest reliability . In this study, the items of the Dedication scale will be used to assess work engagement.
Finally, teachers’ perceptions of classroom atmosphere are measured using a scale developed in a psychosocial school intervention study . The scale comprises three items on bullying, disruptive behavior and enjoyment in the classroom. Items are rated on a scale from 1 (a little) to 5 (a lot). According to our knowledge, the psychometric properties of this scale have not yet been assessed in previous research.
Adolescents whose teachers receive INSETT
Additional aspects of social support, perceived discrimination and school belonging are the secondary outcomes for youth who do not receive the TRT programme but whose teachers received the INSETT programme. Social support is measured by the MSPSS [56, 57], as described above. Experience of discrimination are measured by the PEDQ-CV . Finally, the existence of interethnic friendships and friendship satisfaction is measured by questions developed for this study.
The study will also use items in order to gather demographic information. For example, items for youth and parents include information on age, gender, ethnicity, time spent in Sweden and asylum status. Additionally, items for teachers include information on age, gender, educational background, teaching experience and current teaching situation, e.g., subjects, grades and number of students. This data will be used for descriptive purposes to, examine the extent to which demographic characteristics are balanced between study groups, carry out attrition analyses and identify subgroups. The demographics questionnaire will be administered at T1.
Furthermore, during the TRT sessions, the Columbia-Suicide Severity Rating Scale (C-SSRS) Screen Version will be used part of a safety protocol for participants who indicate they have had thoughts they would be better off dead (ninth item on the PHQ-9) or ‘suffering’ on the Cantril Ladder (i.e. a score of 4 or below). The C-SSRS Screen Version is a 6-item structured interview or self-report measure that assesses the presence and severity of suicidal ideation and behavior and is commonly regarded as the “gold standard” for assessment of suicidal ideation and behavior in clinical trials . The safety protocol will be used in order to signpost or refer the youth to another service when needed. Frequency of using the protocol will be reported and any spontaneously reported adverse events will be recorded and managed accordingly by clinical expertise of the research team. Additionally, resources needed to deliver the various parts of the intervention will be collected based on professionals’ time, costs for materials handed out to participants and participant’s time.
No biological specimens will be collected as part of the trial.
Power calculations were conducted. With alpha set at 0.05, power at 0.80, and Rho = 0.05 (the intra-cluster correlation), a sample size of at least 40 clusters (i.e., schools) with 25 youths each was identified as necessary. Therefore, 500 youths per study arm (i.e., intervention or wait-list control) are needed, resulting in 1000 total participants. In order to account for an expected dropout rate of 20%, 1250 youths will be recruited in total.
In order to facilitate the recruitment of such a large number of participants, recruitment will be split between our Swedish study team and our research partners in Finland. The Swedish site will recruit 10 intervention clusters 10 waitlist-control clusters and with 35 youths in each cluster, resulting in 700 individuals total. Work planned and conducted by the Finnish partner site is outside the scope of this study protocol and will be reported on independently by their team.
A computed-generated randomization sequence will be used in order to allocate schools into the intervention and wait-list control arms, respectively. Block randomization will be used to ensure equivalence between intervention and waitlist-control schools. Randomization will be conducted prior to T1 and through an online, third party central randomization service named sealed envelope (www.sealedenvelope.com). One person of the research team, blinded to the schools, will run the randomization process. Researchers and schools will not be blinded to the group allocation, however. All schools will be informed on which group they have been allocated to.
Outcome data will be collected at three time points using a secure online platform . Paper surveys will also be made available to participants who may lack access to technology. Surveys are available in 26 languages. To promote and monitor adherence to the core design of the intervention, a fidelity checklist on paper will be distributed to group leaders, who will return the list to the research team after the program has been finished.
All participants will be given an anonymous identity number. This study is part of the larger EU Horizon 2020 project and outcome data will be shared with partner institutions including the Ghent University (Belgium), KU Leuven (Belgium), Copenhagen University (Denmark), University of Tampere (Finland), Norwegian Centre for Violence and Traumatic Stress Studies (NKVTS; Norway), Sussex University (UK), who are investigating other intervention programmes; discussion of these institutions’ work is outside the scope of this study protocol. Data will be exported/inputted into SPSS files for analyses, and saved on the university server, which is automatically backed up. All data will be stored and managed according current regulation on personal data management.
Qualitative focus group discussions with teachers, stakeholders and TRT group leaders will be carried out to explore how the intervention has been implemented, and which factors that facilitated or hindered the implementation process. All the focus groups will be transcribed verbatim and analyzed separately using content analysis . The analysis will start by reading all transcribed data inductively several times. Then, data will be read word by word to derive codes by highlighting words from the text that appeared to capture key thoughts or concepts. These text segments will be further organized and grouped to constitute categories.
All participants will be informed that the data provided will be treated confidentially and will be made aware that in published reports the results will be reported anonymously and at a group level, meaning that it will not be possible to identify any individual or attribute any information to them. Participants will be informed that if they disclose anything concerning their personal safety, the safety protocol will be implemented.
Baseline and demographic characteristics will be summarized using means and standard deviations (or medians or and interquartile ranges in case of skewed distributions) for continuous variables and frequencies and percentages for categorical variables. Various strategies will be employed in order to minimize the amount of missing data (e.g. sending out reminders for completing follow-ups) and reasons for drop-out will be reported. The possible impact of missing data will be examined via sensitivity analyses of augmented data sets and missing data will be handled through modern imputation techniques such as multiple imputation.
Outcomes for the trial arms will be compared using linear mixed models or ANCOVA repeated measures. The comparison of the trial arms will use the intention-to-treat framework where all participants are analyzed according to the trial arm they were randomized to, regardless of whether they received the intervention. Additionally, we will utilize the Complier Average Causal Effect (CACE) or per protocol frameworks where participants are analyzed according to which intervention they received .
For mental health outcome measures, we will also use the Reliable Change Index (RCI) and Clinically Significant Change (CSC) approaches, classifying participants as ‘recovered’, ‘improved’, ‘unchanged’ or ‘deteriorated’ . These approaches comprise measures of whether the change in scores is larger than expected due to outcome measure reliability and whether participants shifts from a clinical state to a non-clinical state. The proportions of classified participants will be compared across the trial arms.
Furthermore, fidelity, in terms of adherence and dose of the intervention, will be summarized using descriptive statistics. We will also compute moderation analyses in order to examine the associations between improvement status and participants’ characteristics (e.g., age and gender). Effect size measures such as Cohen’s d will be calculated in order to describe intervention effects.
For the economic evaluation, the outcomes and costs between the intervention and control groups will be compared using bootstrapped mixed model analyses. Two types of evaluations will be performed: (i) a cost-utility analysis with outcomes measured in Quality Adjusted Life Years (QALYs); and (ii) a cost-effectiveness analysis with proportion of participants classed as treatment success expressed as incremental cost-effectiveness ratios . SDQ score will be translated to utility values . Health gains in term of QALYs will be estimated using any change in utilities, at baseline and respective assessment points.
The cost-effectiveness ratios describe: (i) the price for one additional life year with full health gained, and (ii) the price to get an additional successfully treated participant. All statistical analyses will be computed using the SPSS and R softwares.
This study will address knowledge gaps in the scientific community by evaluating the school-based intervention comprising the TRT and INSETT programmes in an applied, school-based setting, using a long-term follow-up (i.e. three months) which allows for the investigation of long-term intervention effects. Data will be collected using multiple measures from multiple sources (i.e., parents/guardians, teachers and youth) consistent with best practices  and most of the measures used have adequate psychometric properties. The cluster randomized design has less statistical power than an ordinary randomized trial. However, it was deemed necessary to randomize schools in order to ensure that all students within the school would have the same opportunities for participation and not feel alienated or traumatized by not receiving access to the intervention at the same time as other classmates. Randomizing schools also reduces contamination and network effects within schools in comparison to randomization of individuals. Another potential limitation might be difficulties in receiving informed consent from parents/guardians. Therefore, the research team will work closely with each class mentor to collect consent from parents/guardians. The results of this study will be used to inform future decisions related to the provision of mental health and wellbeing interventions to refugee youth.
Protocol version 1, 2020-07-06. Recruitment of participants began 13/08/2018 and will continue to 31/12/2020.
Availability of data and materials
The results from this trial are due to be submitted for publication during spring 2021.
Authorship will be granted for substantive contributions to the design, conduct, interpretation and reporting of the trial. The ultimate decision on authorship will be made by the Principal.
Investigators (AS, ID). Publications will be made open access. The data sets generated during the current study will not be made open access, but can be made available upon request to the Principal Investigators (AS, ID) and according to the ethical approval.
Amsterdam Executive Function Inventory
Analysis of Covariance
Bergen Burnout Inventory
Complier Average Causal Effect
Child Health and Parenting
Children’s Revised Impact of Event Scale
Clinically Significant Change
Columbia-Suicide Severity Rating Scale
Child and Youth Resilience Measure
Diagnostic and Statistical Manual of Mental Disorders-IV
Daily Stressors Scale for Young Refugees
ENRICHED Social Support Instrument
General Health Questionnaire
In-service Teacher Training
Multidimensional Scale of Perceived Social Support
Norwegian Centre for Violence and Traumatic Stress Studies
Patient Health Questionnaire-9
Perceived Ethnic Discrimination Questionnaire-Community Version
Psychological Sense of School Membership scale
Post-traumatic stress disorder
QualityAd justed Life Year
Reliable Change Index
Randomized Controlled Trial
Strengths and Difficulties Questionnaire
Single Item Stress Index
Statistical Package for the Social Sciences
Trauma-Focused Cognitive Behavioral Therapy
Teacher Multicultural Attitude Scale
Teaching Recovery Techniques
Teachers’ Sense of Efficacy Scale
Utrecht Work Engagement Scale
UNHCR. https://www.unhcr.org/5d08d7ee7. UNHCR Global Trends 2019. Accessed 12 Oct 2019.
The Swedish Migration Agency https://www.migrationsverket.se/Om-Migrationsverket/Statistik/Asyl.html. The Swedish Migration Agency 2019. Accessed 25 Aug 2019.
Seidel FA, James S. Unaccompanied refugee minors in Sweden: challenges in residential care and the role of professional social work. Resid Treat Child Youth. 2019;36:83–101.
Jensen TK, Skårdalsmo EMB, Fjermestad KW. Development of mental health problems-a follow-up study of unaccompanied refugee minors. Child Adolesc Psychiatry Ment Health. 2014;8:29.
Jensen TK, Skar A-MS, Andersson ES, Birkeland MS. Long-term mental health in unaccompanied refugee minors: pre-and post-flight predictors. Eur Child Adolesc Psychiatry. 2019;28:1671–82.
Vervliet M, Lammertyn J, Broekaert E, Derluyn I. Longitudinal follow-up of the mental health of unaccompanied refugee minors. Eur Child Adolesc Psychiatry. 2014;23:337–46.
Fazel M, Reed RV, Panter-Brick C, Stein A. Mental health of displaced and refugee children resettled in high-income countries: risk and protective factors. Lancet. 2012;379:266–82.
Pacione L, Measham T, Rousseau C. Refugee children: mental health and effective interventions. Curr Psychiatry Rep. 2013;15:341.
Gadeberg A, Montgomery E, Frederiksen H, Norredam M. Assessing trauma and mental health in refugee children and youth: a systematic review of validated screening and measurement tools. Eur J Pub Health. 2017;27:439–46.
Salari R, Malekian C, Linck L, Kristiansson R, Sarkadi A. Screening for PTSD symptoms in unaccompanied refugee minors: a test of the CRIES-8 questionnaire in routine care. Scand J Public Health. 2017;45:605–11.
Tam SY, Houlihan S, Melendez-Torres G. A systematic review of longitudinal risk and protective factors and correlates for posttraumatic stress and its natural history in forcibly displaced children. Trauma Violence Abuse. 2017;18:377–95.
Blackmore R, Gray KM, Boyle JA, et al. Systematic Review and Meta-Analysis: The Prevalence of Mental Illness in Child and Adolescent Refugees and Asylum Seekers. J Am Acad Child Adolesc Psychiatry. 2019;59:705–14.
Fazel M, Doll H, Stein A. A school-based mental health intervention for refugee children: an exploratory study. Clin Child Psychol Psychiatry. 2009;14:297–309.
Fazel M, Garcia J, Stein A. The right location? Experiences of refugee adolescents seen by school-based mental health services. Clin Child Psychol Psychiatry. 2016;21:368–80.
Reynolds AD, Bacon R. Interventions supporting the social integration of refugee children and youth in school communities: a review of the literature. Adv Soc Work. 2018;18:745–66.
Fazel M, Kohrt BA. Prevention versus intervention in school mental health. Lancet Psychiatry. 2019;6:969–71.
Horswood D, Baker J, Fazel M, Rees S, Heslop L, Silove D. School factors related to the emotional wellbeing and resettlement outcomes of students from refugee backgrounds: protocol for a systematic review. Syst Rev. 2019;8:107.
Fazel M, Betancourt TS. Preventive mental health interventions for refugee children and adolescents in high-income settings. Lancet Child Adolescent Health. 2018;2:121–32.
Fazel M. A moment of change: facilitating refugee children's mental health in UK schools. Int J Educ Dev. 2015;41:255–61.
de Wal Pastoor L. The mediational role of schools in supporting psychosocial transitions among unaccompanied young refugees upon resettlement in Norway. Int J Educ Dev. 2015;41:245–54.
Keeshin BR, Strawn JR. Psychological and pharmacologic treatment of youth with posttraumatic stress disorder: an evidence-based review. Child Adolescent Psychiatric Clin. 2014;23:399–411.
Nosè M, Ballette F, Bighelli I, et al. Psychosocial interventions for post-traumatic stress disorder in refugees and asylum seekers resettled in high-income countries: systematic review and meta-analysis. PLoS One. 2017;12:e0171030.
Yule W, Dyregrov A, Raundalen M, Smith P. Children and war: the work of the children and war Foundation. Eur J Psychotraumatol. 2013;4:18424.
Barron IG, Abdallah G, Smith P. Randomized control trial of a CBT trauma recovery program in Palestinian schools. J Loss Trauma. 2013;18:306–21.
Barron IG, Abdallah G, Heltne U. Randomized control trial of teaching recovery techniques in rural occupied Palestine: effect on adolescent dissociation. J Aggress Maltreat Trauma. 2016;25:955–73.
Pityaratstian N, Piyasil V, Ketumarn P, Sitdhiraksa N, Ularntinon S, Pariwatcharakul P. Randomized controlled trial of group cognitive behavioural therapy for post-traumatic stress disorder in children and adolescents exposed to tsunami in Thailand. Behav Cogn Psychother. 2015;43:549–61.
Sarkadi A, Ådahl K, Stenvall E, et al. Teaching recovery techniques: evaluation of a group intervention for unaccompanied refugee minors with symptoms of PTSD in Sweden. Eur Child Adolesc Psychiatry. 2018;27:467–79.
Rolfsnes ES, Idsoe T. School-based intervention programs for PTSD symptoms: a review and meta-analysis. J Trauma Stress. 2011;24:155–65.
Brenner ME, Kia-Keating M. Psychosocial and academic adjustment among resettled refugee youth. Ann Rev Comparative Int Educ. 2016;30:221–49.
Uslu F, Gizir S. School belonging of adolescents: the role of teacher–student relationships, peer relationships and family involvement. Educ Sci Theory Pract. 2017;17:63–82.
de Wal Pastoor L. Reconceptualising refugee education: exploring the diverse learning contexts of unaccompanied young refugees upon resettlement. Intercult Educ. 2017;28:143–64.
de Wal Pastoor L. In-Service Teacher Training (INSETT) - Psychosocial support for young refugees and migrants in schools. Intervention Manual - Content, themes and implementation. Working paper 20.02.2019. Oslo: Norwegian Centre for Violence and Traumatic Stress Studies; 2019.
Augeo Foundation. https://www.augeo.nl/en. Augeo Foundation, 2020. Accessed 10 Feb 2020.
Sullivan AL, Simonson GR. A systematic review of school-based social-emotional interventions for refugee and war-traumatized youth. Rev Educ Res. 2016;86:503–30.
Perrin S, Meiser-Stedman R, Smith P. The Children's revised impact of event scale (CRIES): validity as a screening instrument for PTSD. Behav Cogn Psychother. 2005;33:487–98.
Deeba F, Rapee RM, Prvan T. Psychometric properties of the Children’s revised impact of events scale (CRIES) with Bangladeshi children and adolescents. PeerJ. 2014;2:e536.
Verlinden E, van Meijel EP, Opmeer BC, et al. Characteristics of the Children's revised impact of event scale in a clinically referred Dutch sample. J Trauma Stress. 2014;27:338–44.
Goldberg D, Williams P. General health questionnaire (GHQ). Swindon, Wiltshire, UK: nferNelson; 2000.
Romppel M, Braehler E, Roth M, Glaesmer H. What is the general health Questionnaire-12 assessing?: dimensionality and psychometric properties of the general health Questionnaire-12 in a large scale German population sample. Compr Psychiatry. 2013;54:406–13.
Lundin A, Åhs J, Åsbring N, et al. Discriminant validity of the 12-item version of the general health questionnaire in a Swedish case-control study. Nordic J Psychiatry. 2017;71:171–9.
Lerkkanen M-K, Kikas E, Pakarinen E, Poikonen P-L, Nurmi J-E. Mothers’ trust toward teachers in relation to teaching practices. Early Child Res Q. 2013;28:153–65.
Adams KS, Christenson SL. Differences in parent and teacher trust levels: implications for creating collaborative family-school relationships. Spec Serv Sch. 1998;14:1–22.
Kikas E, Poikonen PL, Kontoniemi M, Lyyra AL, Lerkkanen MK, Niilo A. Mutual trust between kindergarten teachers and mothers and its associations with family characteristics in Estonia and Finland. Scand J Educ Res. 2011;55:23–37.
Ponterotito JG, Baluch S, Greig T, Rivera L. Development and initial score validation of the teacher multicultural altitude survey. Educ Psychol Meas. 1998;58:1002–16.
Goodenow C. The psychological sense of school membership among adolescents: scale development and educational correlates. Psychol Sch. 1993;30:79–90.
You S, Ritchey KM, Furlong MJ, Shochet I, Boman P. Examination of the latent structure of the psychological sense of school membership scale. J Psychoeduc Assess. 2011;29:225–37.
Hagborg WJ. An investigation of a brief measure of school membership. Adolescence. 1998;33:461.
Goodman R. Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2001;40:1337–45.
Svedin C-G, Priebe G. The strengths and difficulties questionnaire as a screening instrument in a community sample of high school seniors in Sweden. Nordic J Psychiatry. 2008;62:225–32.
Bentley N, Hartley S, Bucci S. Systematic review of self-report measures of general mental health and wellbeing in adolescent mental health. Clin Child Fam Psychol Rev. 2019;22:225–52.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–13.
Richardson LP, McCauley E, Grossman DC, et al. Evaluation of the patient health Questionnaire-9 item for detecting major depression among adolescents. Pediatrics. 2010;126:1117–23.
Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166:1092–7.
Plummer F, Manea L, Trepel D, McMillan D. Screening for anxiety disorders with the GAD-7 and GAD-2: a systematic review and diagnostic metaanalysis. Gen Hosp Psychiatry. 2016;39:24–31.
Cantril H. Pattern of human concerns. New Brunswick, NJ: Rutgers University Press; 1965.
Zimet GD, Dahlem NW, Zimet SG, Farley GK. The multidimensional scale of perceived social support. J Pers Assess. 1988;52:30–41.
Canty-Mitchell J, Zimet GD. Psychometric properties of the multidimensional scale of perceived social support in urban adolescents. Am J Community Psychol. 2000;28:391–400.
Zimet GD, Powell SS, Farley GK, Werkman S, Berkoff KA. Psychometric characteristics of the multidimensional scale of perceived social support. J Pers Assess. 1990;55:610–7.
Liebenberg L, Ungar M, LeBlanc JC. The CYRM-12: a brief measure of resilience. Can J Public Health. 2013;104:e131–e5.
Brondolo E, Kelly KP, Coakley V, et al. The perceived ethnic discrimination questionnaire: development and preliminary validation of a community version 1. J Appl Soc Psychol. 2005;35:335–65.
Van der Elst W, Ouwehand C, van der Werf G, Kuyper H, Lee N, Jolles J. The Amsterdam executive function inventory (AEFI): psychometric properties and demographically corrected normative data for adolescents aged between 15 and 18 years. J Clin Exp Neuropsychol. 2012;34:160–71.
Hansen M, Andersen TE, Armour C, Elklit A, Palic S, Mackrill T. PTSD-8: a short PTSD inventory. Clin Pract Epidemiol Mental Health. 2010;6:101.
Ware JE Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36): I. conceptual framework and item selection. Med Care. 1992;30:473–83.
Ware JE Jr, Gandek B. Overview of the SF-36 health survey and the international quality of life assessment (IQOLA) project. J Clin Epidemiol. 1998;51:903–12.
Mitchell PH, Powell L, Blumenthal J, et al. A short social support measure for patients recovering from myocardial infarction: the ENRICHD social support inventory. J Cardiopulmonary Rehabil Prev. 2003;23:398–403.
Gottlieb BH, Bergen AE. Social support concepts and measures. J Psychosom Res. 2010;69:511–20.
Tschannen-Moran M, Hoy AW. Teacher efficacy: capturing an elusive construct. Teach Teach Educ. 2001;17:783–805.
Duffin LC, French BF, Patrick H. The Teachers' sense of efficacy scale: confirming the factor structure with beginning pre-service teachers. Teach Teach Educ. 2012;28:827–34.
Elo A-L, Leppänen A, Jahkola A. Validity of a single-item measure of stress symptoms. Scand J Work Environ Health. 2003;29:444–51.
Salmela-Aro K, Rantanen J, Hyvönen K, Tilleman K, Feldt T. Bergen burnout inventory: reliability and validity among Finnish and Estonian managers. Int Arch Occup Environ Health. 2011;84:635–45.
Schaufeli WB, Salanova M, González-Romá V, Bakker AB. The measurement of engagement and burnout: a two sample confirmatory factor analytic approach. J Happiness Stud. 2002;3:71–92.
Schaufeli WB, Bakker AB, Salanova M. The measurement of work engagement with a short questionnaire: a cross-national study. Educ Psychol Meas. 2006;66:701–16.
Björklund K, Liski A, Samposalo H, et al. “Together at school”-a school-based intervention program to promote socio-emotional skills and mental health in children: study protocol for a cluster randomized controlled trial. BMC Public Health. 2014;14:1042.
Posner K, Brown GK, Stanley B, et al. The Columbia–suicide severity rating scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatr. 2011;168:1266–77.
Schmitz C. Limesurvey: an open source survey tool. limesurvey project Hamburg, Germany. URL http://www.limesurvey.org. 2012. Accessed 5 June 2019.
Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62:107–15.
Peugh JL, Strotman D, McGrady M, Rausch J, Kashikar-Zuck S. Beyond intent to treat (ITT): a complier average causal effect (CACE) estimation primer. J Sch Psychol. 2017;60:7–24.
Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research; 1992.
Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Oxford: Oxford university press; 2015.
Furber G, Segal L, Leach M, Cocks J. Mapping scores from the strengths and difficulties questionnaire (SDQ) to preference-based utility values. Qual Life Res. 2014;23:403–11.
Achenbach TM. Commentary: definitely more than measurement error: but how should we understand and deal with informant discrepancies? J Clin Child Adolesc Psychol. 2011;40:80–6.
The authors gratefully acknowledge the support of The Children and War Foundation, The Augeo Foundation, and the Children’s Rights in Society.
Organizational structure and responsibilities
The principal investigators (AS, ID) and lead researchers (FO, ND, IF) are responsible for the design and conduct of the trial, preparation and revisions of the study protocol and meetings with the national stakeholder group. The stakeholder group is an advisory group consisting of a politician, a school director, researchers, refugee parents, refugee youths, teachers, a counselor and a regional integration coordinator. The stakeholder group is responsible for reviewing the implementation process and give feedback on the interventions, as well as reviewing the questionnaires. A Data Monitoring Committee (DMC) has not been formed and no independent auditing will take place. Interim data monitoring will be conducted regularly in order to inform aspects of trial conduct, such as participant recruitment. The ultimate decision on any amendments to the trial protocol or conduct will be made by the Principal Investigators (AS, ID).
The trial sponsor is Uppsala University, Box 256, Uppsala, 751 05, Sweden.
The trial has received funding from the European Union’s Horizon 2020 research and.
innovation programme under grant agreement No 754849. The funder has had no involvement in the design of the study or the writing of the manuscript, and will have no involvement in the collection, analysis or interpretation of data. Open Access funding provided by Uppsala University.
Ethics approval and consent to participate
This study was approved by the Regional Ethics Review Board in Uppsala on 24/07/2019 (ref:2019–031160). Any amendments to the protocol will be communicated to the Ethics Committee and approval will be sought before proceeding. Any modifications will be added to ISRCTN and communicated to relevant parties. Informed consent will be obtained from all study participants.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original online version of this article was revised: 1) A minor correction to reference 32. 2) A minor correction of a sentence on page 5. 3) Rewording of two paragraphs on pages 2 and 5.
About this article
Cite this article
Durbeej, N., McDiarmid, S., Sarkadi, A. et al. Evaluation of a school-based intervention to promote mental health of refugee youth in Sweden (The RefugeesWellSchool Trial): study protocol for a cluster randomized controlled trial. Trials 22, 98 (2021). https://doi.org/10.1186/s13063-020-04995-8
- Teaching recovery techniques
- In-service teacher training
- Post-traumatic stress disorder
- Refugee youths
- School setting