Skip to main content

E-Mental-Health aftercare for children and adolescents after partial or full inpatient psychiatric hospitalization: study protocol of the randomized controlled DigiPuR trial

Abstract

Background

During reintegration to daily school life following psychiatric hospitalization, children and adolescents are confronted with various challenges and are at risk for rehospitalization. Tailored post-discharge services could support a successful readjustment and accompany the high-risk transition period after discharge. The study DigiPuR (“Digital gestützte Psychotherapie und Reintegration,” digitally supported psychotherapy and reintegration) aims to establish and to evaluate an innovative digital aftercare program to alleviate challenges during reintegration and improve cross-sectoral care.

Methods

DigiPuR is a randomized controlled trial comparing a digital aftercare service with regular aftercare (TAU) (planned N = 150, 25 children/adolescents, 25 parents, and 25 teachers in each group). In the intervention group, direct communication via secure and regular video calls until 8 weeks after discharge and a secure messenger system between the hospital, family, and school, as well as, if needed, external support systems, are established. A longitudinal pre-post-follow-up assessment at admission, discharge, and 8, 24, and 36 weeks after discharge takes place supplemented by a daily smartphone-based ambulatory assessment from a triadic perspective of patients, parents, and teachers. Primary outcomes include whether participants in the intervention group have fewer readmissions and higher treatment satisfaction and health-related quality of life as well as lower symptom severity than participants in the control group.

Discussion

The present study is essential to address the cross-sectoral challenges associated with reintegration into daily (school) life following child and adolescent psychiatric hospitalization and to determine possible needed adaptations in partial or full inpatient settings. If applicability and efficacy of the aftercare service can be demonstrated, integration into regular care will be sought.

Trial registration

ClinicalTrials.govNCT04986228. Registered on August 2, 2021

Peer Review reports

Background

The prevalence of mental disorders among children and adolescents in Germany and worldwide is between 13 and 18% [1, 2]. For the treatment of mental disorders, in addition to outpatient services, there are partial and full inpatient services as more intensive types of treatment [3]. In 2020, 53,436 patients received full inpatient treatment in child and adolescent psychiatry in Germany [4]. Correspondingly, utilization of the limited inpatient beds in the area of child and adolescent psychiatry is high, with about 89% of available beds in Germany in 2019 being in use [5]. Besides the two areas of general psychiatry and psychosomatics/psychotherapy, this figure is among the highest utilization rates in all departments in German hospitals [5]. Rehospitalization rates have been reported to range from 12 to 57% with percentages tending to be higher for longer follow-up periods [6,7,8,9,10,11,12], but most readmissions occurring within the first 3 months after discharge [8,9,10].

After discharge following psychiatric hospitalization, children and adolescents are confronted with various challenges, emerging predominantly in the academic, social, and emotional domain [13,14,15,16]. Academically, children and adolescents need to make up missed school work, with some additionally transferring to a new class or school [14,15,16]. Socially, children and adolescents report fears of explaining their absence, concerns to lose friendships, and experiences of bullying and stigmatization [14,15,16,17]. Emotionally, despite substantial symptom reduction during inpatient treatment, intense negative or overwhelming emotions and residual symptoms often persist or reappear after discharge [14,15,16, 18, 19]. About 87% of children and adolescents require further assistance after discharge [20]. A seamless transition to outpatient follow-up treatment is desirable, as transfer of therapeutically achieved treatment progress into daily situations usually succeeds only with targeted practice and accompaniment, due to the context dependence of symptomatic behavior [21, 22]. In practice, however, long waiting times, in Germany averaging 5 weeks for an initial consultation and 18 weeks to begin outpatient psychotherapy [23], often prevent a seamless transition between treatment sectors. In case of a child or adolescent starting treatment with a previously unknown outpatient psychotherapist, a sustainable therapeutic relationship, as well as motivation for further treatment, must be newly established, further complicating the transition between inpatient and outpatient care.

Important attachment figures, such as parents or teachers, can help children and adolescents cope with transition-related challenges [24], and it is important to involve them in inpatient psychiatric treatment [25]. Higher parental involvement is associated with a lower risk of the child being rehospitalized [9]. Furthermore, worsening student-teacher relationships as well as increased bullying experiences after hospitalization are associated with higher levels of suicidal ideation in the immediate post-discharge period [26]. However, for many attachment figures, a child’s psychiatric hospitalization is also associated with strain and distress and they often report feelings of incompetence and uncertainties about how to suitably support the child [13, 19, 27, 28]. Supporting attachment figures in the form of providing psychoeducation, strengthening resources, and developing competencies and coping strategies so that they can better understand the child’s situation and adequately deal with it is required and helpful for a successful reintegration [13, 24, 27].

Sufficient and tailored post-discharge support services for patients and their attachment figures could support a successful readjustment and accompany the challenging transition period after discharge [13, 29]. Ideally, case-leading therapists of inpatient treatment seamlessly accompany the reintegration phase for some more weeks after discharge and support readjustment to daily (school) life as well as transfer of treatment successes. The case-leading therapists know the case and all parties involved from the former treatment and can therefore offer support to all parties within the existing therapeutic relationship. This, however, requires sufficient monetary and time resources from all stakeholders.

E-Mental-Health services support people with mental strains through information and communication technologies [30] and offer enormous potential to improve health care [31, 32]. Advantages include a wide reach for treatment services, lack of travel time with more flexible and tailored scheduling for appointments, and low-threshold services [33, 34]. Moreover, the created distance, for example in therapy via videoconferencing, can lead to less dependence on the therapist and to greater disinhibition in statements as well as to additional information by seeing patients in their home environment, which can be helpful for treatment [33]. Demand and use for E-Mental-Health services has once again considerably increased and taken on particular relevance since the beginning of the COVID-19 pandemic [33, 35, 36]. Especially in the context of aftercare, E-Mental-Health services can complement inpatient treatment and close the gap to outpatient treatment by relying on existing therapeutic relationships to seamlessly support the transition from psychiatric hospital to daily life in a low-threshold manner [34, 37]. A recent review on discharge interventions from inpatient child and adolescent mental health care identified only two randomized controlled trials in this area, none of which examined a digitally supported intervention [29]. However, one feasibility study discussed in the review [29] showed a general interest in downloading a smartphone-based application for a digital safety plan at the time of discharge [38]. Studies on the efficacy of digital aftercare services for adults suggest beneficial impacts on patients’ post-discharge development [39,40,41,42,43].

The innovative aftercare program DigiPuR (“Digital gestützte Psychotherapie und Reintegration”, digitally supported psychotherapy and reintegration) aims to stabilize and ideally expand treatment successes after partial or full inpatient child and adolescent psychiatric treatment, therefore reducing a worsening of symptoms and rehospitalizations. In the intervention group, direct communication via secure and regular video calls and a messenger system between the hospital, family, and school, as well as, if needed, external support systems, are established. Thereby, problems can be identified and addressed early from multiple perspectives and transitions into outpatient structures can be arranged where necessary. Taking the social environment of children and adolescents into consideration when examining emotional and behavioral problems is consistent with the principle of multisystemic therapy [44]. Efficacy of this digital aftercare in the intervention group is compared to an active control group with regular aftercare within a randomized controlled trial using a naturalistic parallel group study design. A longitudinal pre-post-follow-up assessment at admission, discharge, and 8, 24, and 36 weeks after discharge supplemented by a daily smartphone-based ambulatory assessment from a triadic perspective of patients, parents, and teachers allows for a close investigation of between-person differences and within-person processes in patients’ daily lives. The supplemented ambulatory assessment moreover allows ecologically valid measurements in participants’ daily lives, at the same time reducing retrospective bias [45]. Answers from the ambulatory assessment are graphically processed for the therapists on a weekly basis during aftercare [37]. The assessments are based on the comprehensive conceptual model of outcomes of mental health care for children and adolescents [46]. Accordingly, treatment success and service effectiveness are not only considered as symptom reduction on the individual level, but also related to interactions with the environment in different settings (e.g., home, school, community) [46]. The model proposes five outcome domains (symptoms, functioning, consumer perspectives, environments, systems) in which impact of interventions can be seen [46]. To address these domains, the assessments in DigiPuR include a multi-perspective view on the reintegration phase and instruments used for assessment reflect the domains. The comprehensive assessment serves to examine the general applicability and acceptance as well as the efficacy of this new digital aftercare program for the development of structures specifically for aftercare. Implementing DigiPuR in clinical practice thereby requires a balancing of scientific comparability and practical feasibility in the conception of the design as well as in the scientific evaluation, focusing on aftercare which is flexible and tailored to the needs of the individual patients.

Hypotheses

DigiPuR examines whether the reintegration of children and adolescents after their stay in a psychiatric hospital can be facilitated by digitally supported, cross-contextual aftercare. Four hypotheses emerge for the primary outcomes. First, we hypothesize readmission rates to be lower at the post- and follow-up time points in the intervention group than in the control group (treatment-as-usual; TAU). Second, we hypothesize satisfaction with treatment to be higher at the post-time point in the intervention group than in the control group. Third, we hypothesize health-related quality of life to develop better over time (pre-post follow-up) in the intervention group than in the control group. We do not necessarily expect the intervention group to improve in absolute values over time, as measures can decline after discharge, indicated by high rates of readmissions [8, 10]. Rather, we expect the intervention group to develop better over time than the control group, meaning that even a stabilization of values might be considered a success. Fourth, we hypothesize symptom severity to develop better over time (pre-post follow-up) in the intervention group than in the control group. In line with the last two hypotheses, a better development in the intervention group than in the control group is also expected for the secondary outcomes on stress, self-efficacy, and perceived competence, including ambulatory assessment on well-being, affect, sleep quality, school situation, and social relationships.

Methods

This manuscript includes information on all Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT, checklist in Additional file 1) [47].

Participants and recruitment

Recruitment of participants takes place at the Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy at the University Hospital of Psychiatry and Psychotherapy Tuebingen, Germany, and is embedded in the regular routines of the hospital (see Fig. 1). Potentially, all children and adolescents who are patients in the department’s child therapy ward, adolescent therapy ward, day hospital for children, or day hospital for adolescents; a relevant primary attachment figure (a parent or caregiver from a residential group); and optionally teachers from the child’s or adolescent’s school are eligible to participate in the study. The children and adolescents are usually between 6 and 18 years old. We aim to investigate N = 50 triplets (n = 25 children/adolescents, n = 25 parents, and n = 25 teachers in each group). While sufficient German language skills are an inclusion criterion, the specific indication for partial or full inpatient treatment, type of diagnosis, or time of discharge are not. Transition to regular outpatient treatment is also not an exclusion criterion, as DigiPuR aims to form a good transition to outpatient structures in coordination with all involved parties. The study exclusion criteria are kept minimal to allow as many patients as possible to access the aftercare program. DigiPuR study staff are in weekly communication with the therapists in the department’s therapy wards and day hospitals to identify participants. In case of acute psychological strains during the study, the procedure is analogous to conventional psychotherapy with emergency presentation at the responsible hospital. If emergency care result in an inpatient stay of less than 2 weeks, participation in the study is continued (ambulatory assessment continues, intervention components resume after discharge) and, in case of more than 2 weeks, discontinued. A pilot phase of the study was conducted in early 2021, followed by recruitment from March 2021 to June 2022.

Fig. 1
figure 1

Recruitment process

Randomization and blinding

Participants are assigned to the intervention or control group after having given written informed consent to participate in the study. Children or adolescents, their parents, and their teachers are always assigned to the same group. A randomization list with equal proportions of both groups was generated with the software R (based on the function “sample”) [48] before the start of the study. Participants are successively assigned to one of the two groups according to the order of their recruitment (date of written informed consent) using the randomization list. Only after inclusion in the study, DigiPuR study staff look up the assignment in the randomization list and record the assignment in the coding list, which is kept locked in a cabinet and only accessible to the study management. They inform therapists about the group assignment by e-mail and participants during the technical briefing by a video or phone call or on site at the hospital. Blinding of participants, case-leading therapists, and conducting study staff is not possible due to the different nature of treatment in the two groups. Data evaluation, however, is blinded, as group allocation is coded without knowledge of the data analysts.

Interventions

In a naturalistic parallel group study design, DigiPuR compares a new digitally supported aftercare in the intervention group with TAU aftercare in the control group (see Fig. 2). Aftercare is provided in both groups, with aftercare in the control group being the same as the procedure for non-participation (i.e., TAU). Case-leading therapists working in the partial or full inpatient sector conduct the aftercare in both groups but are otherwise not involved in planning and evaluating the study. Documentation of aftercare appointments in both groups is handled digitally by the case-leading therapists using predefined input fields on relevant aspects in the hospital’s internal software programs. For both aftercare treatments following the partial or full inpatient stay, no additional risks are to be expected. There is no anticipated harm and no compensation for participating in the study. If there are any queries or complaints about the study or the data management, participants can contact the appropriate study-independent office by e-mail or telephone at any time using the contact details on the participant information form. DigiPuR study staff work in the research department and are at no time involved in the therapeutic process, but are contact persons for questions regarding, for example, technical difficulties of participants or the case-leading therapists.

Fig. 2
figure 2

Time schedule of the study for both groups. = video/phone call. = messenger = aftercare appointment at the hospital

Intervention group

In the intervention group, children and adolescents take part in six video calls with the case-leading therapist of the previous partial or full inpatient hospital treatment. These video calls take place weekly during the first 4 weeks after discharge, then every 2 weeks until 8 weeks after discharge and last up to 50 min, depending on the individual needs of the patient as determined by the therapists. Participants take part in these six video calls from their homes. The case-leading therapist decides whether parents and, if required, responsible persons from external support systems such as youth services, outpatient psychotherapists, psychiatrists, and pediatricians also participate in the video calls. Content of the video calls depends on the case and is linked to previous partial or full inpatient behaviorally oriented psychotherapy with focus on transfer of learned strategies into daily routines. A weekly goal is worked out with the child or adolescent in each video call and written down on a worksheet so that its achievement can be assessed retrospectively at the next session. The case-leading therapist deciding on duration, participants, and content allows the aftercare program to be sufficiently flexible and well adapted to the needs of the patients. Reducing the frequency of aftercare from weekly to biweekly video calls aims to gradually strengthen the patient’s autonomy and allows support in the home environment with personal contact to the therapist, but without time-consuming and costly travel time.

The child’s or adolescent’s and parents’ agreement provided, additionally one or more teachers from the child’s or adolescent’s school participate in up to three 30- to 45-min video or telephone calls, separate from the family’s appointments, with the hospital’s case-leading therapist in the period up to 8 weeks after discharge. The German handbook Psychische Erkrankungen im schulischen Umfeld (Mental disorders in the school environment) is intended to support teachers additionally by providing information and support beyond the three calls. We developed this handbook primarily for schools in the state of Baden-Wuerttemberg, Germany in response to the internally identified needs of teachers for more knowledge about mental disorders and how to deal with students with mental disorders. It covers the following topics: (1) knowledge about mental disorders, (2) dealing with mental disorders in daily school life, (3) returning after a psychiatric hospitalization, (4) dealing with mental emergencies, (5) finding an appropriate attitude, (6) hints for talking to affected students, (7) taking care of yourself, and (8) school programs for health promotion (publication of the handbook is planned after the end of this study; for more information, please contact the corresponding author). The contents of the handbook are possible subjects of video or telephone calls with teachers, with different key aspects depending on the specific case.

All children or adolescents, parents, and teachers in the intervention group can send a direct message via messenger function to the case-leading therapist via the app movisensXS [49], individualized by the authors as the PANDA-App (Psychiatrische Aufenthalte – Nachsorge Durch App, Psychiatric Stays – Aftercare Through App). Messages can refer to, for example, content issues or organizational matters, but do not contain personal data such as names or locations due to data security restrictions. The case-leading therapists receive these messages via their professional e-mail address and can reply to messages in the browser after logging in to the Movisens platform. This messenger service must, however, not be used for emergency contacts, as those must be made via the regular emergency number of the responsible hospital.

Control group (TAU)

In the control group, children and adolescents and their parents are usually given a 50-min follow-up consultation with the case-leading therapist from the previous partial or full inpatient treatment in the hospital about 6 weeks after discharge. This corresponds to the usual aftercare treatment (TAU) in the Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy at the University Hospital of Psychiatry and Psychotherapy Tuebingen, Germany.

Evaluation

Evaluation of DigiPuR includes a pre-post-follow-up assessment and an ambulatory assessment phase (see Fig. 2). All assessments are carried out in the same manner for the intervention and the control group. Adherence of participants regarding the assessment data is continuously and timely monitored by checking the return of questionnaires and the documentation of aftercare appointments. In case of multiple missing data, study staff inquire by phone. There are weekly project meetings to discuss trial conduct and progress. Internal reports document and provide information on project progress on a quarterly basis. As the trial is a low-risk intervention, there is no trial auditing.

Pre-post-follow-up assessment

Admission and discharge assessment as part of the standard hospital assessment are carried out on paper questionnaires (in exceptions where necessary online) through trained staff during the partial or full inpatient hospital stay in the period from preliminary talk to admission until 1 week after admission and in the period from 1 week before discharge until discharge (pre). For the post, follow-up 1, and follow-up 2 assessment (8, 24, and 36 weeks after discharge), the participants receive an e-mail containing a link for an online survey on the SoSci Survey platform [50], which they can respond to at home via the browser of their computer, tablet, or smartphone within 1 week. At each time point of assessment, the survey lasts no longer than about 45 min.

Ambulatory assessment

The ambulatory assessment consists of daily questions about well-being, affect, sleep quality, the school situation, and social relationships that children and adolescents (30 items), the participating parent or caregiver (17 items), and, if teachers participate, a teacher (10 items), answer on their personal or a study smartphone via the app movisensXS [49] (see Fig. 3). The children’s and adolescents’ items are presented in written and audiovisual form, so that children who are not yet able to read confidently can have the items read aloud. Ambulatory assessment takes place every day between 5 and 9 o’clock in the evening from 2 weeks before discharge to 8 weeks after discharge and takes a maximum of 5 min per day. Teachers answer the items only on school days and have a larger time frame to respond to increase adherence by being more flexible. Children and adolescents, parents, and teachers are reminded of the daily survey by alarms and can postpone alarms three times. The data collected in the ambulatory assessment is evaluated individually on a weekly basis by summarizing all answers and preparing them graphically (see Fig. 4). The case-leading therapist can use this overview of the participants answers during the last week(s) as a basis for the next regular video call.

Fig. 3
figure 3

Display of the app with one example item from the ambulatory assessment and with the identification figure PANDA

Fig. 4
figure 4

Sample excerpt from the weekly graphical evaluation of the ambulatory assessment data for the therapist. o data point. missing. Color coding for school attendance (green = yes, yellow = partial, red = no, gray = no school day)

With the start of the ambulatory assessment, all participants receive a short technical briefing, in which the app movisensXS [49] is installed on the participant’s Android smartphone or a study smartphone. When using their own smartphones, the participants can be reimbursed for data used for the daily surveys. After installation of the app movisensXS [49], all technical components of the study are briefly explained and tested: (1) the app movisensXS [49] with messenger function, (2) the video phone program VidyoConnect [51], (3) the university hospital’s own cloud service for the pseudonymized worksheets of the weekly goals and other therapy materials, and (4) the online platform SoSci Survey [50] for post- and follow-up surveys. Despite the intuitive and simple handling of all components, all participants receive written, illustrated instructions. For further questions or in case of technical difficulties, the study contact details (e-mail address and telephone number) are also included in the instruction.

Instruments

The instruments used in DigiPuR (see Table 1) are chosen to cover the five domains (symptoms, functioning, consumer perspectives, environments, systems) of the comprehensive conceptual model of outcomes of mental health care for children and adolescents [46]. The instruments and scales used in the pre-post-follow-up assessment and the ambulatory assessment are briefly described in the following, sorted according to the five domains. Item formulations were adapted where necessary so that they are understandable and suitable for both children and adolescents. Items are only presented if their content is relevant to the respective group (e.g. items on satisfaction with the program for video calls only when it was used). Primary outcomes are number of readmissions, satisfaction with treatment, health-related quality of life, and symptom severity; all others are secondary outcomes (see Table 1). As there is a great heterogeneity of diagnoses in the patient sample, the evaluation aims to assess the reintegration phase and the well-being of patients globally and across disorders. General constructs relevant to different disorders were selected and instruments were used for comparability across the age range.

Table 1 Overview of assessed outcomes, assigned domains, instruments, and raters at the different study time points

DISYPS-III SCREEN (Diagnostic System for Mental Disorders according to ICD-10 and DSM-5 for Children and Adolescents - III Screening questionnaire)

The DISYPS-III SCREEN [52] contains five superordinate scales for overall symptomatology, internalizing and externalizing behaviors, contact behavior, and functional impairment and distress, as well as seven disorder-specific subscales. In the present study, overall symptomatology is utilized to evaluate the symptom severity from the perspective of the patients (self-evaluation questionnaire SBB; 55 items), parents, and teachers (external evaluation questionnaire FBB; 55 items). In addition to the superordinate scales, the corresponding disorder-specific subscales are analyzed. The manual reports satisfying psychometric properties (internal consistency of the overall symptomatology: Cronbach’s α = .91 for SBB and α = .92 for FBB, disorder-specific subscales between α = .49 and α = .85).

Questionnaire based on the SSKJ 3-8R (Questionnaire for the Survey of Stress and Stress Coping in Childhood and Adolescence – Revision)

The SSKJ 3-8R [53] contains three parts: (1) stress vulnerability, (2) stress coping strategies, and (3) stress symptomatology and well-being. In the present study, a self-developed questionnaire based on items of the SSKJ 3-8R measures children and adolescents’ (1) stress vulnerability with seven items on seven different situations and (2) stress coping strategies with 30 items on five scales. Deviating from the original version, the items on stress coping strategies are answered only in relation to one situation, which the children and adolescents choose beforehand from the previous stressful seven situations. The manual reports for the original version satisfying psychometric properties (internal consistencies between α = .67 and α = .89; retest reliabilities between rtt = .61 and rtt = .82).

Self-efficacy scales

Self-efficacy in dealing with social demands in children and adolescents is assessed via the scale WIRKSOZ [54] with eight items (internal consistency α = .60). School-related self-efficacy of children and adolescents is assessed via the scale WIRKSCHUL [54] with seven items (internal consistency ranges from α = .70 to α = .73). For the assessment of teachers’ self-efficacy in relation to students with mental disorders and in relation to the student to be reintegrated, 5 of the total 10 items of the Teacher Self-Efficacy scale, WIRKLEHR [54], were selected for the present study and adapted thematically in each case. Internal consistency of the original WIRKLEHR scale ranges from α = .76 to α = .81. To assess parents’ social self-efficacy in dealing with their child, the first 8 of the total of 10 items from the WIRKLEHR scale were thematically adapted and combined to form the WIRKELTERN scale.

KIDSCREEN-27

The KIDSCREEN-27 [55] measures the health-related quality of life of children and adolescents with 27 items on five dimensions (physical well-being, psychological well-being, relationship with parents and autonomy, peers and social support, school environment). In the present study, health-related quality of life is assessed from the perspective of both the child or adolescent and the participating parent. The manual reports satisfying psychometric properties (internal consistency between α = .80 and α = .84; intraclass correlation coefficients for retest reliability between .61 and .74).

Emotional exhaustion and enthusiasm for teaching

The scales emotional exhaustion (4 items; internal consistency between α = .74 and α = .82) [56] and enthusiasm for teaching (3 items, number 4, 5 and 6 selected; internal consistency between α = .69 and α = .81) [56] are used in the present study to assess teachers’ occupational well-being (see also [70]).

Questionnaire based on the FBB (Questionnaire for the Assessment of Treatment)

The FBB [57] is a German questionnaire used for therapy evaluation and quality assurance of psychotherapeutic and psychiatric treatments of children, adolescents, and families in research and practice. In addition to overall satisfaction with the treatment, outcome quality (treatment success) and process quality (course of treatment) are measured as subjective assessments of treatment. In the present study, four self-developed versions (patients: 20 items, parents: 21 items, therapists: 27 items, teachers: 14 items) adapted from items of the FBB are used, in which the word “treatment” was specified by “aftercare treatment”. In the patient version, item number 13 on video recordings was deleted because there are no video recordings in the present study. Item number 5 was added to the therapist version, asking about relationships in school in addition to relationships in the family. In addition, a version for teachers was designed from 14 items of the parent version of the FBB. The manual reports for the original versions satisfying psychometric properties (internal consistency between α = .63 and α = .94 for all raters; retest reliabilities for patients and parents ranged from rtt = .36 to rtt = .79).

SUS (System Usability Scale)

Satisfaction with the technical components is assessed among children and adolescents (23 items), parents (23 items), teachers (22 items), and therapists (15 items; no items regarding the app). The 10 items of the widely used technology-independent questionnaire SUS [58] were thematically adapted to the aftercare app and the program for the video calls, both used in the present study (e.g., “I thought the aftercare app was easy to use”). A study of the factor structure of the SUS reported an internal consistency of α = .92 [71]. Further self-developed items asked about things that did not work (all raters), preferences in aftercare (children and adolescents, parents, therapists), and the usefulness and inclusion of the weekly graphic evaluation (therapists).

Expectation of change

Patients’ and parents’ expectation of change regarding the aftercare is assessed as a covariate with 4 thematically adapted items (e.g., “I think that through DigiPuR I will cope better with my daily life”) from the scale Patient’s expectation of change of the questionnaire for measuring common factors in psychotherapy (FERT; factorial reliability of the original scale with 8 items ρϲ = .94) [59].

EBI (Eltern-Belastungs-Inventar)

The EBI [60] is the German version of the Parenting Stress Index [72] and measures parental stress with 48 items. In the present study, parental stress is assessed by means of the total scale and the twelve subscales. The manual reports satisfying psychometric properties (internal consistency of the total score α = .95 and of the subscales between α = .61 and α = .83; retest reliability rtt = .87 for total scale).

BSCL (Brief Symptom Checklist)

The BSCL [61] contains 53 items to assess psychological strain in self-judgment on three global indices and nine scales. In the present study, the BSCL is used as a covariate to assess psychological strain in parents. The manual reports satisfying psychometric properties (internal consistency for the total score α = .97 and for all scales α ≥.72; retest reliability rtt = .87 for the total score and rtt ≥.64 for all scales).

Competence self-concept in dealing with students

Teachers’ competence self-concept in dealing with students is assessed with four items [62]. A recent study reported an internal consistency of α = .77 [73].

Professional competence in dealing with students with mental disorders

The professional competence of teachers in dealing with students with mental disorders is exploratively examined. Orientated on the framework model of teachers’ professional competence [74], seven competence facets relevant to the present study (professional, pedagogical-psychological, organizational, and counseling knowledge as well as motivational orientations, self-regulation, and beliefs/values attitudes) were thematically adapted: knowledge about mental disorders (5 items), knowledge about dealing with the student with mental disorders (11 items), knowledge about mental emergencies (3 items), knowledge about counseling of affected persons (8 items), motivation and self-efficacy (13 items), self-regulation (8 items), and responsibility and relationship with students with mental disorders (13 items). For this purpose, items of different studies from the field of Mental Health Literacy [63,64,65] and from teacher survey studies [54, 56, 66] were selected, thematically adapted where necessary as well as own items were developed.

Hospital documentation on general information

General and professional information about participants is obtained from hospital documentation and anamnesis forms for families (e.g., diagnoses, medications, level of psychosocial functioning, duration of treatment) and is collected from teachers at study inclusion (e.g., years in the profession, type of school, teaching load, professional contact with students with mental disorders). Further information for a health economic evaluation is obtained by analyzing controlling data (e.g., percentage of readmissions; travel times; contact via messenger) and the therapist’s documentation (e.g., worksheets on weekly goals; missed appointments; cooperation with support systems; implementation of therapy suggestions).

Ambulatory assessment

Ambulatory assessment items contain information on children and adolescents’ general well-being (1 item; self-development), affect (12 items) [67], sleep quality (2 items) [67], school absenteeism (2 items; self-development), school day (4 items; three items to perceived success at school [68] and one item adapted from the KIDSCREEN-27 [55]), and relationship with peers (4 items) [69], parents (4 items; adapted from [69]), and teachers (1 item; adapted from the KIDSCREEN-27 [55]). Parents make corresponding statements in the ambulatory assessment about their own general well-being (1 item; self-development) and affect (12 items) [67], as well as about their child’s general well-being (1 item; self-development) and their relationship with the child (3 items; adapted from [69]). Teachers make statements in the ambulatory assessment about the support they receive from the hospital (1 item; self-development) and about contact with the student being reintegrated (filter question). If there was contact with the student, teachers make statements about their general well-being, their well-being in their role as a teacher, and the well-being of the student (1 item each; self-development) as well as about the teacher-student relationship (1 item; adapted from the KIDSCREEN-27 [55]) and the school day (4 items; three items adapted from [68] to perceived success of the child at school and one item adapted from the KIDSCREEN-27 [55]). Additional comments or observations about the day can be indicated by parents and teachers in an open response format at the end of each assessment.

Statistics

Calculation of the sample size

It is planned to include a total of N = 50 triplets (total sample approximately 150 persons) with 50 children and adolescents (n = 25 per group), one attachment figure (parent or caregiver) each and, if possible, at least one associated teacher each. Estimation of sample size is based on recently published randomized controlled trials, in which the efficacy of digital treatment for children and adolescents with mental disorders is compared with control conditions [75,76,77] and on the anticipated number of discharges of the department during the course of the study (average treatment duration of 3 months with approximately 10 children per ward).

Statistical analyses

All analyses are conducted using R software [48]. All outcome variables measured pre-post-follow-up will be analyzed with separate mixed ANOVAs. Preprocessing of the data and calculation of individual values will be done according to the respective manual. Predictors will be group (intervention vs. control) and time point, as well as their interaction. Treatment success would be demonstrated by a significant interaction effect of group and time point, being shown, through adequate post hoc test, to be due to different time-effects in the two groups. We do not necessarily expect the intervention group to improve in absolute values over time, as measures can decline after discharge. Rather, we expect the intervention group to develop better over time than the control group, meaning that even a stabilization of values might be considered a success. This better development in the intervention group than in the control group should be evident in the information provided by patients themselves, as well as by parents and teachers.

The successful reintegration into daily (school) life is conceptualized besides the pre-post-follow-up assessment by the data collected in the ambulatory assessment. All ambulatory assessment data will be analyzed with multi-level models [78]. We expect the reports from patients, parents, and teachers in the intervention group to show a significantly more positive trend over time in terms of their general well-being, affect, sleep quality, school absenteeism, situation in class, and the relationship with parents, peers, and teachers, than those in the control group. Statistically, these effects are shown by a significant interaction of the within-person time trends of these reports with group membership, being due to participants in the intervention group developing better (or less bad) than participants in the control group. Variables will be adequately centered, and appropriate fixed and random effects will be included in the models.

Few missing data are expected due to ongoing monitoring. Missing data from single items of the standardized questionnaires will be handled appropriately according to the instructions in the manual. In case of complete questionnaires missing for a participant, this participant will be excluded from all ANOVAs containing this questionnaire. As multi-level models can handle missing data quite well, if they are at least missing at random, no data will be excluded from those analyses. However, appropriate variables (e.g., age, symptom severity) will be used to investigate if the missingness structure can be explained by them, rendering it to be not at random. In that case, those variables will be included in the according models to account for this non-randomness.

Due to the confidentiality of patient health data, data sets cannot be made publicly available. Access is only granted to study management who supervise data management and have a duty of confidentiality.

Data security and storage

Procedure for data management was approved by the data protection officer and the IT security officer of the University Hospital Tuebingen, Germany. The collection and storage of all data is pseudonymized and stored for 10 years. All questionnaires are labeled with an anonymous personal code of the participant. Data can only be assigned to individuals based on a coding list, which is continually updated by hand, kept locked, and only accessible to study management. The coding list will be destroyed at the end of the study.

Pre-assessment

All information used in paper form for the study at admission and discharge will be kept in the participating child’s or adolescent’s medical record and is additionally entered pseudonymously into a spreadsheet file, so that the information can only be assigned to the other data by the personal code.

Post- and follow-up assessment

Data collected with SoSci Survey [50] at post and follow-up is protected by SSL encryption (HTTPS) Extended Validation (EV) both when filling in the questionnaire and when retrieving the collected data. Data is hosted on an ISO27001-certified server in Germany. The provider protects against data loss and access by third parties by means of a firewall.

Ambulatory assessment

Data from the ambulatory assessment will be encrypted, ensuring that the collected data cannot be accessed by unauthorized persons even if the device is lost. All data connections (i.e., both the communication between the smartphone and the server and the communication between the server and the researcher’s browser) are encrypted using 256-bit SSL encryption. Furthermore, participants are instructed not to indicate personal data that could be used to identify the children and adolescents, parents, teachers, or other persons (e.g., names, locations, etc.), neither when answering the questions nor in the messages in the app movisensXS [49].

Video calls

The program VidyoConnect [51] for the video calls in the intervention group is a standard software certified by the university hospital. No data is recorded during use. Participants are instructed not to produce and distribute any audio or visual material of the sessions.

Cloud

The firewall-protected cloud of the university hospital is used for the exchange of files with participants. It meets particularly high security requirements and is approved for the storage of anonymized or pseudonymized patient data. Participants receive a link with a password to their own folder in which the therapist can store worksheets (e.g., documentation of weekly goals) and information in PDF format. There is never a name or other identifiable information on the materials. Access to the folder in the cloud is restricted to the therapist and the respective participant.

Storage locations and dissemination

At the end of the study, all participant data is deleted from the servers used by movisensXS [49] and SoSci Survey [50] as well as the cloud of the university hospital. From this point on, the pseudonymized data of the participants are stored in the form of a spreadsheet file exclusively on the drive of the university hospital, to which only authorized staff have access, and evaluated with the help of statistical analysis software. Paper-pencil data are entered twice, compared with the help of an R-script [48] and checked for errors. Evaluation data from the online surveys are summarized into a data set by means of an R-script [48] without reference to specific individuals. Participants do not receive individual feedback on their data. Instead, the anonymized results will be published in scientific journals and presented at conferences and in the hospital. The study is monocentric and has no data monitoring committee as it is a low-risk intervention.

Discussion

DigiPuR is a longitudinal randomized controlled trial comparing regular aftercare (TAU) in the control group with a novel, digital aftercare service in the intervention group. In the intervention group, regular video calls take place with all parties involved during the reintegration phase until 8 weeks after discharge. In addition, patients, parents, and teachers have a direct communication channel to the therapist via a secure messenger system. This is intended to stabilize treatment successes after discharge and, if necessary, to accompany the transition to outpatient services. This paper describes the naturalistic parallel group study design of DigiPuR and its evaluation. Besides pre-post-follow-up surveys, an ambulatory assessment provides ecologically valid daily data on the reintegration phase from the triadic perspective of patients, parents, and teachers. Psychological strains and exacerbations should thus be recognized at an early stage, addressed and hence readmissions reduced.

Limiting factors that should be considered in the interpretation of the results include that questionnaires in the evaluation are used across the age range of both children and adolescents. This was necessary to ensure sufficient comparability but implied adapting item formulations to a wide age range with possible limitations regarding psychometric properties of questionnaires used. Second, due to the different nature of treatment in the two groups, blinding of participants, therapists, and study staff is not possible. Data analysis, however, is blinded, as group allocation is coded without knowledge of the data analysts. Third, the time required for aftercare appointments and the assessments may be a barrier to study participation and is likely to be weighed against the personal benefits of increased support during the reintegration phase. However, the decision for study enrollment takes place before randomized group assignment, so any potential bias should not affect group comparisons.

Results will show whether DigiPuR can increase participants’ health-related quality of life and reduce a worsening of symptoms as well as rehospitalizations. It is expected that the digitally supported, seamless, and regular aftercare appointments involving family and school attachment figures in the intervention group will contribute to a successful reintegration. DigiPuR is designed to improve cross-sectoral child and adolescent psychiatric health care, but in doing so, also to provide further training in this area for teachers in the educational system. Expanding the spectrum of traditional services by establishing digital media as contemporary, widespread, and practicable tools in daily clinical practice can improve child and adolescent psychiatric care because a wider spectrum offers more treatment options in general, as well as more possibilities to adapt treatment to the characteristics and needs of individual patients [34, 79]. The COVID-19 pandemic, as an unforeseen crisis that came along with considerable mental stress for many children and adolescents [80,81,82,83], may simultaneously act as an accelerator in establishing E-Mental-Health in health care [84]. In this regard, the expansion of digital infrastructure that occurred in the wake of the COVID-19 pandemic and the associated broader use of digital media can be expected to have a beneficial impact on DigiPuR. Barriers for using digital media can be expected to decrease further, willingness to communicate without being tied to a specific location will increase, and technical skills will improve. E-Mental-Health is expected to advance mental health care by being accessible, available, attractive, and cost-effective [85] and should go along with collaborative research from science and practice in naturalistic settings [86]. In case of efficacy and successful implementation of DigiPuR in clinical daily processes, an integration of DigiPuR into regular care is possible and planned.

Trial status

The trial is ongoing (10-29-2021, version 1, start of recruitment: March 2021, estimated end of recruitment: June 2022)

Availability of data and materials

Data cannot be made available due to confidentiality of patient health data. However, the statistical code and all study materials will be available from the corresponding author on reasonable request, and any questions about the procedure are welcome. Contact for more information on the study: digipur@med.uni-tuebingen.de or 004970712962535.

Abbreviations

BSCL:

Brief Symptom Checklist

DigiPuR:

Study name (Digital gestützte Psychotherapie und Reintegration – Digitally supported psychotherapy and reintegration)

DISYPS-III SCREEN:

Diagnostic System for Mental Disorders according to ICD-10 and DSM-5 for Children and Adolescents - III Screening questionnaire

EBI:

Eltern-Belastungs-Inventar (German version of the Parenting Stress Index)

FBB:

Fragebogen zur Beurteilung der Behandlung (German Questionnaire for the assessment of treatment)

KIDSCREEN-27:

KIDSCREEN questionnaire with 27 items

PANDA:

App name in the ambulatory assessment

SSKJ 3-8R:

Fragebogen zur Erhebung von Stress und Stressbewältigung im Kindes- und Jugendalter – Revision (German Questionnaire for the Survey of Stress and Stress Coping in Childhood and Adolescence)

SUS:

System Usability Scale

TAU:

Treatment-as-usual

References

  1. Polanczyk GV, Salum GA, Sugaya LS, Caye A, Rohde LA. Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J Child Psychol Psychiatr. 2015;56:345–65.

    Article  Google Scholar 

  2. Barkmann C, Schulte-Markwort M. Prevalence of emotional and behavioural disorders in German children and adolescents: a meta-analysis. J Epidemiol Commun Health. 2012;66:194–203.

    Article  Google Scholar 

  3. Remschmidt H, Belfer M. Mental health care for children and adolescents worldwide: a review. World Psychiatry. 2005;4:147–53.

    PubMed  PubMed Central  Google Scholar 

  4. Statistisches Bundesamt. Pauschalierendes Entgeltsystem für Psychiatrie und Psychosomatik (PEPP). 2021. https://www.destatis.de/DE/Themen/Gesellschaft-Umwelt/Gesundheit/Krankenhaeuser/Tabellen/pauschalierendes-entgeltsystem-psychiatrie-psychosomatik.html?nn=210520. Accessed 09 Mar 2022.

  5. Statistisches Bundesamt. Gesundheit: Grunddaten der Krankenhäuser 2019. 2021. https://www.destatis.de/DE/Themen/Gesellschaft-Umwelt/Gesundheit/Krankenhaeuser/Publikationen/Downloads-Krankenhaeuser/grunddaten-krankenhaeuser-2120611197004.html. Accessed 09 Mar 2022.

  6. Fontanella CA, Pottick KJ, Warner LA, Campo JV. Effects of medication management and discharge planning on early readmission of psychiatrically hospitalized adolescents. Soc Work Mental Health. 2010;8:117–33.

    Article  Google Scholar 

  7. Cheng C, Chan CW, Gula CA, Parker MD. Effects of outpatient aftercare on psychiatric rehospitalization among children and emerging adults in Alberta, Canada. Psychiatr Serv. 2017;68:696–703.

    Article  PubMed  Google Scholar 

  8. Fontanella CA. The influence of clinical, treatment, and healthcare system characteristics on psychiatric readmission of adolescents. Am J Orthopsychiatr. 2008;78:187–98.

    Article  Google Scholar 

  9. Blader JC. Symptom, family, and service predictors of children’s psychiatric rehospitalization within one year of discharge. J Am Acad Child Adolesc Psychiatr. 2004;43:440–51.

    Article  Google Scholar 

  10. James S, Charlemagne SJ, Gilman AB, Alemi Q, Smith RL, Tharayil PR, et al. Post-discharge services and psychiatric rehospitalization among children and youth. Adm Policy Ment Health Ment Health Serv Res. 2010;37:433–45.

    Article  Google Scholar 

  11. Arnold EM, Goldston DB, Ruggiero A, Reboussin BA, Daniel SS, Hickman EA. Rates and predictors of rehospitalization among formerly hospitalized adolescents. Psychiatr Serv. 2003;54:994–8.

    Article  PubMed  Google Scholar 

  12. Gearing RE, Mian I, Sholonsky A, Barber J, Nicholas D, Lewis R, et al. Developing a risk-model of time to first-relapse for children and adolescents with a psychotic disorder. J Nerv Ment Dis. 2009;197:6–14.

    Article  PubMed  Google Scholar 

  13. Tougas A-M, Rassy J, Frenette-Bergeron É, Marcil K. “Lost in Transition”: a systematic mixed studies review of problems and needs associated with school reintegration after psychiatric hospitalization. School Mental Health. 2019;11:629–49.

    Article  Google Scholar 

  14. Clemens EV, Welfare LE, Williams AM. Tough transitions: mental health care professionals’ perception of the psychiatric hospital to school transition. Resid Treat Child Youth. 2010;27:243–63.

    Article  Google Scholar 

  15. Preyde M, Parekh S, Warne A, Heintzman J. School reintegration and perceived needs: the perspectives of child and adolescent patients during psychiatric hospitalization. Child Adolesc Soc Work J. 2017;34:517–26.

    Article  Google Scholar 

  16. Preyde M, Parekh S, Heintzman J. Youths’ experiences of school re-integration following psychiatric hospitalization. J Can Acad Child Adolesc Psychiatr. 2018;27:22–32.

    Google Scholar 

  17. McBride S, Preyde M. Loneliness and social isolation in a sample of youth hospitalized for psychiatric illness. Child Adolesc Soc Work J. 2022;39:157-66. https://doi.org/10.1007/s10560-020-00723-y.

  18. Savina E, Simon J, Lester M. School reintegration following psychiatric hospitalization: an ecological perspective. Child Youth Care Forum. 2014;43:729–46.

    Article  Google Scholar 

  19. Simon JB, Savina EA. Transitioning children from psychiatric hospitals to schools: the role of the special educator. Resid Treat Child Youth. 2010;27:41–54.

    Article  Google Scholar 

  20. Böge I, DeKeijzer D, Fegert JM, Schulze U. Schnittstellenkoordination von systemübergreifenden Hilfen für Kinder und Jugendliche mit psychischen Beeinträchtigungen. Kindheit und Entwicklung. 2020;29:138–46.

    Article  Google Scholar 

  21. Drugli MB, Larsson B. Children aged 4–8 years treated with parent training and child therapy because of conduct problems: generalisation effects to day-care and school settings. Eur Child Adolesc Psychiatr. 2006;15:392–9.

    Article  Google Scholar 

  22. Corpus N, Schepker R, Fegert JM, Boege I. Eltern und Patienten als Subjekt der Behandlung. Psychotherapeut. 2014;59:378–84.

    Article  Google Scholar 

  23. Bundespsychotherapeutenkammer. Studie: Ein Jahr nach der Reform der Psychotherapie-Richtlinie: Wartezeiten 2018. 2018. https://www.bptk.de/wp-content/uploads/2019/01/20180411_bptk_studie_wartezeiten_2018.pdf. Accessed 09 Mar 2022.

  24. Clemens EV, Welfare LE, Williams AM. Elements of successful school reentry after psychiatric hospitalization. Prev Sch Fail. 2011;55:202–13.

    Article  Google Scholar 

  25. Sharfstein SS. Goals of inpatient treatment for psychiatric disorders. Ann Rev Med. 2009;60:393–403.

    Article  CAS  PubMed  Google Scholar 

  26. Marraccini ME, Resnikoff AW, Brick LA, Brier ZM, Nugent NR. Adolescent perceptions of school before and after psychiatric hospitalization: predicting suicidal ideation. Sch Psychol. 2021;37:119–32.

    Article  PubMed  Google Scholar 

  27. Weller BE, Faulkner M, Doyle O, Daniel SS, Goldston DB. Impact of patients’ psychiatric hospitalization on caregivers: a systematic review. Psychiatr Serv. 2015;66:527–35.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Blizzard AM, Weiss CL, Wideman R, Stephan SH. Caregiver perspectives during the post inpatient hospital transition: a mixed methods approach. Child Youth Care Forum. 2016;45:759–80.

    Article  Google Scholar 

  29. Chen A, Dinyarian C, Inglis F, Chiasson C, Cleverley K. Discharge interventions from inpatient child and adolescent mental health care: a scoping review. Eur Child Adolesc Psychiatr. 2020;31(6):857–78. https://doi.org/10.1007/s00787-020-01634-0.

    Article  Google Scholar 

  30. Lal S, Adair CE. E-mental health: a rapid review of the literature. Psychiatr Serv. 2014;65:24–32.

    Article  PubMed  Google Scholar 

  31. Hollis C, Falconer CJ, Martin JL, Whittington C, Stockton S, Glazebrook C, et al. Annual research review: digital health interventions for children and young people with mental health problems – a systematic and meta-review. J Child Psychol Psychiatry. 2017;58:474–503.

    Article  PubMed  Google Scholar 

  32. Domhardt M, Steubl L, Baumeister H. Internet-and mobile-based interventions for mental and somatic conditions in children and adolescents. Zeitschrift für Kinder-und Jugendpsychiatrie und Psychotherapie. 2020;48:33–46.

    Article  PubMed  Google Scholar 

  33. Feijt M, de Kort Y, Bongers I, Bierbooms J, Westerink J, IJsselsteijn W. Mental health care goes online: practitioners’ experiences of providing mental health care during the COVID-19 pandemic. Cyberpsychol Behav Soc Network. 2020;23:860–4.

    Article  Google Scholar 

  34. Bauer S, Golkaramnay V, Kordy H. E-Mental-Health. Psychotherapeut. 2005;50:7-15. https://doi.org/10.1007/s00278-004-0403-0.

  35. Van Daele T, Karekla M, Kassianos AP, Compare A, Haddouk L, Salgado J, et al. Recommendations for policy and practice of telepsychotherapy and e-mental health in Europe and beyond. J Psychother Integr. 2020;30:160–73.

    Article  Google Scholar 

  36. Ellis LA, Meulenbroeks I, Churruca K, Pomare C, Hatem S, Harrison R, et al. The Application of e-mental health in response to COVID-19: scoping review and bibliometric analysis. JMIR Mental Health. 2021;8:e32948.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Bauer S, Moessner M. Technology-enhanced monitoring in psychotherapy and e-mental health. J Mental Health. 2012;21:355–63.

    Article  Google Scholar 

  38. Gregory JM, Sukhera J, Taylor-Gates M. Integrating smartphone technology at the time of discharge from a child and adolescent inpatient psychiatry unit. J Can Acad Child Adolesc Psychiatry. 2017;26:45–50.

    PubMed  PubMed Central  Google Scholar 

  39. Ebert D, Tarnowski T, Gollwitzer M, Sieland B, Berking M. A transdiagnostic internet-based maintenance treatment enhances the stability of outcome after inpatient cognitive behavioral therapy: a randomized controlled trial. Psychother Psychosomat. 2013;82:246–56.

    Article  Google Scholar 

  40. Kordy H, Golkaramnay V, Wolf M, Haug S, Bauer S. Internetchatgruppen in Psychotherapie und Psychosomatik. Psychotherapeut. 2006;51:144–53.

    Article  Google Scholar 

  41. Zwerenz R, Becker J, Knickenberg RJ, Siepmann M, Hagen K, Beutel ME. Online self-help as an add-on to inpatient psychotherapy: efficacy of a new blended treatment approach. Psychother Psychosomat. 2017;86:341–50.

    Article  Google Scholar 

  42. Hennemann S, Farnsteiner S, Sander L. Internet-and mobile-based aftercare and relapse prevention in mental disorders: a systematic review and recommendations for future research. Internet Intervent. 2018;14:1–17.

    Article  Google Scholar 

  43. Zwerenz R, Baumgarten C, Becker J, Tibubos A, Siepmann M, Knickenberg RJ, et al. Improving the course of depressive symptoms after inpatient psychotherapy using adjunct web-based self-help: follow-up results of a randomized controlled trial. J Med Internet Res. 2019;21:e13655.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Henggeler SW. Multisystemic therapy. Resid Treat Child Youth. 2001;18:75–85.

    Article  Google Scholar 

  45. Trull TJ, Ebner-Priemer U. Ambulatory assessment. Ann Rev Clin Psychol. 2013;9:151–76.

    Article  Google Scholar 

  46. Hoagwood K, Jensen PS, Petti T, Burns BJ. Outcomes of mental health care for children and adolescents: I. A comprehensive conceptual model. J Am Acad Child Adolesc Psychiatry. 1996;35:1055–63.

    Article  CAS  PubMed  Google Scholar 

  47. Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586.

    Article  PubMed  PubMed Central  Google Scholar 

  48. R Development Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2008.

    Google Scholar 

  49. movisens GmbH. movisensXS Library v4856. Karlsruhe: movisens GmbH; 2021.

    Google Scholar 

  50. Leiner DJ. SoSci Survey (Version 3.2.19) [Computer software]. 2019. Available from: https://www.soscisurvey.de.

  51. Vidyo Inc. VidyoConnectTM, version 20.4.0. 2021. Available from: https://www.vidyo.com/video-conferencing-solutions/product/desktop-video-calling.

  52. Döpfner M, Görtz-Dorten A. Diagnostik-System für psychische Störungen nach ICD-10 und DSM-5 für Kinder und Jugendliche - III (DISYPS-III). Göttingen: Hogrefe; 2017.

    Google Scholar 

  53. Lohaus A, Eschenbeck H, Kohlmann C-W, Klein-Heßling J. Fragebogen zur Erhebung von Stress und Stressbewältigung im Kindes- und Jugendalter – Revision (SSKJ 3-8 R). Göttingen: Hogrefe; 2018.

    Google Scholar 

  54. Schwarzer R, Jerusalem M. Skalen zur Erfassung von Lehrer- und Schülermerkmalen: Dokumentation der psychometrischen Verfahren im Rahmen der Wissenschaftlichen Begleitung des Modellversuchs Selbstwirksame Schulen. Berlin: Universität Berlin; 1999.

    Google Scholar 

  55. The KIDSCREEN Group Europe. The KIDSCREEN-27 Questionnaire - quality of life questionnaire for children and adolescents. Lengerich: Pabst Science Publishers; 2006.

    Google Scholar 

  56. Kunter M, Baumert J, Leutner D, Terhart E, Seidel T, Dicke T, et al. Dokumentation der Erhebungsinstrumente der Projektphasen des BilWiss-Forschungsprogramms von 2009 bis 2016. Frankfurt am Main: Goethe-Universität Frankfurt; 2016.

    Google Scholar 

  57. Mattejat F, Remschmidt H. Fragebogen zur Beurteilung der Behandlung (FBB). Göttingen: Hogrefe; 1999.

    Google Scholar 

  58. Brooke J. SUS - a quick and dirty usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, McClelland IL, editors. Usability evaluation in industry. London: Taylor & Francis; 1996. p. 189–94.

    Google Scholar 

  59. Vollmann K. Construction and evaluation of a questionnaire for measuring common factors in psychotherapy (FERT) [dissertation]. Tuebingen: Eberhard Karls University Tuebingen; 2010. Available from: http://nbn-resolving.de/urn:nbn:de:bsz:21-opus-47705

    Google Scholar 

  60. Tröster H. Eltern-Belastungs-Inventar (EBI): Deutsche Version des Parenting Stress Index (PSI) von R. R. Abidin. Göttingen: Hogrefe; 2010.

    Google Scholar 

  61. Franke GH. Brief-Symptom-Checklist (BSCL). Göttingen: Hogrefe; 2017.

    Google Scholar 

  62. Kunz Heim D, Trachsler E, Rindlisbacher S, Nido M. Schulen als Lernumgebungen für Lehrerinnen und Lehrer: Zusammenhänge zwischen Schulkontext, persönlichen Merkmalen und dem Weiterlernen von Lehrpersonen. Kreuzlingen: Pädagogische Hochschule Thurgau; 2007.

    Google Scholar 

  63. Hatcher AK. Measuring mental health literacy in education. Electron Thesis Dissert Reposit. 2018:5313 https://ir.lib.uwo.ca/etd/5313/.

  64. Reinke WM, Stormont M, Herman KC, Puri R, Goel N. Supporting children’s mental health in schools: teacher perceptions of needs, roles, and barriers. Sch Psychol Q. 2011;26:1–13.

    Article  Google Scholar 

  65. Daniszewski TD. Teachers’ mental health literacy and capacity towards student mental health. Electron Thesis Dissert Reposit. 2013:1165 https://ir.lib.uwo.ca/etd/1165/.

  66. Blömeke S, Kaiser G, Lehmann R. TEDS-M 2008. Professionelle Kompetenz und Lerngelegenheiten angehender Primarstufenlehrkräfte im internationalen Vergleich. Münster, Germany: Waxmann; 2010.

    Google Scholar 

  67. Könen T, Dirk J, Leonhardt A, Schmiedek F. The interplay between sleep behavior and affect in elementary school children’s daily life. J Exper Child Psychol. 2016;150:1–15.

    Article  Google Scholar 

  68. Neubauer AB, Schmidt A, Schmiedek F, Dirk J. Dynamic reciprocal relations of achievement goal orientations with daily experiences of success and failure: an ambulatory assessment study. 2020. https://doi.org/10.31234/osf.io/uypex.

  69. Schmidt A, Dirk J, Schmiedek F. The importance of peer relatedness at school for affective well-being in children: between-and within-person associations. Soc Dev. 2019;28:873–92.

    Article  Google Scholar 

  70. Aldrup K, Klusmann U, Lüdtke O, Göllner R, Trautwein U. Student misbehavior and teacher well-being: testing the mediating role of the teacher-student relationship. Learn Instruct. 2018;58:126–36.

    Article  Google Scholar 

  71. Lewis JR, Sauro J. The factor structure of the system usability scale. In: Kurosu M, editor. Human centered design, HCII 2009, lecture notes in computer science 5619. Berlin: Springer; 2009. p. 94–103. https://doi.org/10.1007/978-3-642-02806-9_12.

    Chapter  Google Scholar 

  72. Abidin RR. Parenting stress index: professional manual (3rd edition). Odessa: Psychological Assessment Resources; 1995.

    Google Scholar 

  73. Kunz Heim D, Sandmeier A, Hänggi Y, Safi N, Cina A. Training zum Umgang mit Unterrichtsstörungen: Effekte auf die Gesundheit von Lehrkräften. Zeitschrift für Erziehungswissenschaft. 2019;22:925–44.

    Article  Google Scholar 

  74. Baumert J, Kunter M. Stichwort: Professionelle Kompetenz von Lehrkräften. Zeitschrift für Erziehungswissenschaft. 2006;9:469–520.

    Article  Google Scholar 

  75. Chang SW, Kuckertz JM, Bose D, Carmona AR, Piacentini J, Amir N. Efficacy of attention bias training for child anxiety disorders: a randomized controlled trial. Child Psychiatry Human Dev. 2019;50:198–208.

    Article  Google Scholar 

  76. Conaughton RJ, Donovan CL, March S. Efficacy of an internet-based CBT program for children with comorbid high functioning autism spectrum disorder and anxiety: a randomised controlled trial. J Affect Disord. 2017;218:260–8.

    Article  PubMed  Google Scholar 

  77. Lenhard F, Andersson E, Mataix-Cols D, Rück C, Vigerland S, Högström J, et al. Therapist-guided, internet-delivered cognitive-behavioral therapy for adolescents with obsessive-compulsive disorder: a randomized controlled trial. J Am Acad Child Adolesc Psychiatry. 2017;56:10–9.

    Article  PubMed  Google Scholar 

  78. Raudenbush SW, Bryk AS. Hierarchical linear models: applications and data analysis methods. Thousand Oaks, London, New Delhi: Sage Publications, Inc; 2002.

    Google Scholar 

  79. Moessner M, Bauer S. E-Mental-Health und internetbasierte Psychotherapie. Psychotherapeut. 2017;62:251–66.

    Article  Google Scholar 

  80. Ravens-Sieberer U, Kaman A, Otto C, Adedeji A, Devine J, Erhart M, et al. Mental health and quality of life in children and adolescents during the COVID-19 pandemic — results of the COPSY study. Deutsches Ärzteblatt International. 2020;117:828–9.

    PubMed  PubMed Central  Google Scholar 

  81. Ravens-Sieberer U, Kaman A, Otto C, Adedeji A, Napp A-K, Becker M, et al. Seelische Gesundheit und psychische Belastungen von Kindern und Jugendlichen in der ersten Welle der COVID-19-Pandemie–Ergebnisse der COPSY-Studie. Bundesgesundheitsblatt-Gesundheitsforschung-Gesundheitsschutz. 2021;64:1512–21. https://doi.org/10.1007/s00103-021-03291-3:1-10.

  82. Orgilés M, Morales A, Delvecchio E, Mazzeschi C, Espada JP. Immediate psychological effects of the COVID-19 quarantine in youth from Italy and Spain. Front Psychol. 2020;11:579038. https://doi.org/10.3389/fpsyg.2020.579038.

    Article  PubMed  PubMed Central  Google Scholar 

  83. United Nations. Policy brief: COVID-19 and the need for action on mental health. 2020. https://www.un.org/sites/un2.un.org/files/un_policy_brief-covid_and_mental_health_final.pdf. .

    Google Scholar 

  84. Wind TR, Rijkeboer M, Andersson G, Riper H. The COVID-19 pandemic: the ‘black swan’for mental health care and a turning point for e-health. Internet Interv. 2020;20:100317. https://doi.org/10.1016/j.invent.2020.100317.

    Article  PubMed  PubMed Central  Google Scholar 

  85. Mohr DC, Riper H, Schueller SM. A solution-focused research approach to achieve an implementable revolution in digital mental health. JAMA Psychiatry. 2017;75:113–4. https://doi.org/10.1001/jamapsychiatry.2017.3838.

    Article  Google Scholar 

  86. Fernández-Álvarez J, Fernández-Álvarez H. Videoconferencing psychotherapy during the pandemic: exceptional times with enduring effects? Front Psychol. 2021;12:589536. https://doi.org/10.3389/fpsyg.2021.589536.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to thank our student assistants for their support: Tanja Weiß, Alina Neubert, Mario Eich, Celina Mäncher, Lena Kleinschroth, and Ida Hinderer.

Funding

Open Access funding enabled and organized by Projekt DEAL. This trial is funded by the Ministry of Social Affairs and Integration Baden-Wuerttemberg, Germany (53-5400.1-005/09), which supports promising projects from outpatient and inpatient care, cross-sector care, nursing, and personalized medicine as part of the strategy for digitalization in medicine and nursing. The Ministry, however, is not involved in planning, implementation, data evaluation, and publication of the study. The infrastructure for conducting the study is provided by the Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy at the University Hospital of Psychiatry and Psychotherapy Tuebingen, Germany.

Author information

Authors and Affiliations

Authors

Contributions

TJR, CG, and JS raised the research funding from the Ministry of Social Affairs and Integration Baden-Wuerttemberg, Germany. All authors designed and prepared (mainly responsible by JS and MF) as well as implemented, coordinated, and conducted (mainly responsible by JK and MF) the trial. MF wrote the first draft of this manuscript, which was critically revised by all co-authors. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Marlene Finkbeiner.

Ethics declarations

Ethics approval and consent to participate

The study is approved (August 2020) by the Ethics Committee of the Medical Faculty of the Eberhard Karls University and the University Hospital Tuebingen (020/2020BO1; Gartenstraße 47, 72074 Tuebingen, Germany) and is consistent with the current version of the Declaration of Helsinki. Due to the participation of teachers in DigiPuR, the study was additionally approved (August 2020) by the Ministry of Education, Youth and Sports of Baden-Wuerttemberg, Germany (31-6499.20/1332/1). All participants are informed in advance by trained study staff, both verbally and in writing, about intention, procedure, and the data protection concept of the study as well as possible publications of anonymized research results. They are informed that they can discontinue their participation in the study at any time and arrange for their data to be deleted without incurring any disadvantages. In addition, participants can obtain information on the project homepage, where the flyer is available for download and a film presents audiovisual information on the study. For organizational purposes, a study telephone number and a study-related e-mail account have been set up at the Center for Data Processing at the University of Tuebingen, Germany, to which all study staff have access. Participants are only included in the study with written consent of the child or adolescent and their legal guardians. Participation in the study by a caregiver from a residential group and/or teachers always requires the written consent of the child or adolescent and his or her legal guardians. If, contrary to expectations, there are changes or deviations from the planned course of the study, these will be communicated to the Ethics Committee in an amendment and reviewed accordingly.

Consent for publication

Included in the participant information and consent form.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

 SPIRIT checklist.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Finkbeiner, M., Kühnhausen, J., Schmid, J. et al. E-Mental-Health aftercare for children and adolescents after partial or full inpatient psychiatric hospitalization: study protocol of the randomized controlled DigiPuR trial. Trials 23, 713 (2022). https://doi.org/10.1186/s13063-022-06508-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-022-06508-1

Keywords