Skip to main content

Effectiveness of an interactive web-based health program for adults: a study protocol for three concurrent controlled-randomized trials (EVA-TK-Coach)

This article has been updated

Abstract

Background

A healthy lifestyle can help prevent diseases that impair quality of life and lead to premature death. The Techniker health insurance fund offers a comprehensive online health program to support users in achieving their health goals of Increasing Fitness, Losing and Maintaining Weight, or Smoking Cessation.

Methods

The aim of this study is to test the long-term effectiveness of the web-based TK-HealthCoach with regard to the primary outcomes of increased physical activity, sustainable weight reduction, and smoking abstinence. We are conducting three interconnected, randomized controlled trials (RCT), one for each health goal, within which participants are allocated to an intervention group (interactive online health program) or a control group (non-interactive online health program).

The effects of the intervention groups compared to the control groups will be analyzed by multi-level models for change. Participants’ data are captured via online questionnaires before the program starts (baseline t0), again when it ends (t1), and later at two follow-up surveys (t2 and t3); the latter 12 months after t1. We are documenting socio-demographic, health-related, and psychological variables as well as usage behavior data of the programs.

According to our sample size calculation, we have to enroll 1114 participants in each Losing and Maintaining Weight and Increasing Fitness RCT and 339 participants in the Smoking Cessation RCT. Additionally, 15–20 participants in the interactive smoking-cessation program will be invited to qualitative telephone interviews with the aim to obtain detailed information concerning utilization, compliance, and satisfaction.

The online RCTs’ inclusion criteria are: adults of each gender regardless of whether they are insured with Techniker health insurance fund. Persons with impairments or pre-existing conditions require a medical assessment as to whether the program is suitable for them. Specific exclusion criteria apply to each program/RCT.

Discussion

We assume that study participants will improve their health behavior by using the offered online health programs and that each health goal’s intervention group will reveal advantages regarding the outcome variables compared to the control groups. Study enrollment started on January 1, 2020.

Trial registration

German Clinical Trials Register, Universal Trial Number (UTN): U1111-1245-0273. Registered on 11 December 2019

Peer Review reports

Background

Consumer habits and working conditions strongly influence each member of society’s lifestyle. Smoking, low physical activity and obesity lead to increased individual health risks, e.g., for cardiovascular diseases, cancer, diabetes mellitus, musculoskeletal diseases, etc., putting a very high financial burden on the healthcare system. Recommendations have been made globally and programs developed to support a healthy lifestyle [1,2,3]. The earlier a healthy lifestyle is implemented, the less likely one is to suffer from the consequences of tobacco consumption, low physical activity, or obesity. However, lifestyle changes are particularly hard to realize when disease-related burdens are not yet apparent. Moreover, people free of cardiovascular diseases but carrying risks like smoking, hypertension, diabetes mellitus, and obesity who initially took statins or antihypertensive drugs decreased physical activity and increased weight, as Korhonen et al. found in their cohort study with > 41,000 participants [4].

Digital programs promoting primary prevention can play an important role for working-age adults. There are already many commercial and non-commercial online programs to support preventive health behavior, although the variety on offer is immense, as is their quality [5]. Some online programs were tested in randomized-controlled trials, but as their content, duration, and possibilities of interactivity differed, the effectiveness varied widely. However, results show that the more individualized and interactive online interventions are aligned, the stronger are their effects [6,7,8,9,10,11,12,13]. Nevertheless, we must keep in mind that strong interactivity and close ties to a web-based program may also make participants feel overly obliged, which may cause users to quit the program prematurely. Particular motivational and volitional factors for changing health behavior are therefore very important [14, 15]. The content of an E-Coach, its individual usability and degree of interaction, and its technical functionality and design are playing an important role to encourage user’s program adherence and thus a successful change in behavior [14].

Digital health services are often highly commercialized, and there is a myriad of health programs of very different quality offered by commercial and non-commercial institutions and health insurers. It is difficult for users to assess the effectiveness and security of the programs. Ineffective health programs are not only unnecessarily costly—they may also cause harm or demotivate participants sustainably.

It is therefore necessary to ensure that such digital applications make their benefits and effectiveness transparent to potential users [16,17,18]. Furthermore, scientific and comparable quality criteria should be developed to support both customers and health care providers choose or offer effective digital health programs.

To improve disease prevention, the German Techniker (TK) health insurance fund developed, with support from experts in medicine, sports science, psychology, and motivational psychology, a comprehensive online health coach to encourage users to achieve individual health goals. Three of these health goals—Increasing Fitness, Losing and Maintaining Weight and Smoking Cessation—will be independently examined by the Section of Health Care Research and Rehabilitation Research (SEVERA) and Medical Center Freiburg and the Department of Sport and Sport Science (IfSS)—both located in the University of Freiburg.

SEVERA is mainly responsible for coordinating the overall study and its summative evaluation, which is being carried out via three online randomized controlled trials (RCTs) (one for each health goal). It is also responsible for the formative evaluation of the intervention and control group programs with the Smoking Cessation health goal.

The IfSS is responsible for two substudies conducting sports and nutritional medical examinations of participants living in the postal code area 79 (South Baden). The protocol of these substudies will be published separately. The IfSS will also evaluate the usage behavior data from the Increasing Fitness and Losing and Maintaining Weight programs.

Methods/design

Study aim, design, and setting

The aim of this study is to test the long-term effectiveness of the TK-HealthCoach with regard to these primary outcomes: increased physical activity, weight loss, and smoking abstinence. An online randomized controlled trial (RCT) of parallel design is being conducted as part of the summative evaluation for each of the three health goals Increasing Fitness, Losing and Maintaining Weight, and Smoking Cessation. The aim is to examine if participants of interactive online programs achieve higher effects on study outcomes than participants of non-interactive programs.

Adults across Germany intending to lose weight, increase their fitness or quit smoking are invited to participate in one of the online studies. We are planning to recruit a total of approximately N = 2567 participants in the three online RCTs. In addition to these online RCTs, the Department for Sport and Sport Science (IfSS), University of Freiburg is conducting two medical substudies on the health goals Increasing Fitness and Losing and Maintaining Weight. The aim of these two substudies is to determine long-term physiological effectiveness as a result of behavioral changes. Since the precondition for participating in either substudy is to fill out the online questionnaires, the total number of participants to be recruited has to increase by n = 336 to n = 2903 (sample size calculation see Table 5).

Formative evaluations will be conducted in addition to the TK-HealthCoach’s summative evaluation. These include (a) detailed quantitative analyses of usage behavior data and (b) qualitative interviews with persons participating in the intervention group of the online RCT Smoking Cessation.

Study period of each RCT includes the program runtime of the health goals (Smoking Cessation: six weeks; Increasing Fitness and Losing and Maintaining Weight: 12 weeks) as well as another twelve-month follow-up after the program’s completion.

Participant data is being captured via online questionnaires at these time points:

  • Baseline t0: after registration and before the program starts

  • Follow-up t1: after completing the program

    • Smoking Cessation: after 6 weeks

    • Increasing Fitness and Losing and Maintaining Weight: after 12 weeks

  • Follow-up t2:

    • Smoking Cessation: 4 months after completing the program

    • Increasing Fitness and Losing and Maintaining Weight: 6 months after completing the program

  • Follow-up t3: 12 months after completing the program in all three RCTs.

The data on program usage will be recorded during the entire study period.

In the RCT Smoking Cessation qualitative telephone interviews will be carried out once the t1 questionnaires have been completed.

Research questions and hypothesis

The following questions and hypotheses are being investigated in this study

  1. 1.

    What effects do the online programs within the three health goals Losing and Maintaining Weight, Increasing Fitness, and Smoking Cessation have on the primary and secondary outcomes variables reported by participants?

    We assume that we will observe statistically significant improvements with small to medium effect sizes for each program.

  2. 2.

    Will the intervention groups (interactive health programs) in each RCT reveal stronger effects on primary and secondary outcomes in comparison to the control groups (non-interactive health programs)? We will test the hypothesis that the intervention groups’ changes in the primary and secondary outcomes are more positive than the control groups’. Our focus is on long-term effects so we will analyze the change between baseline (t0) and 1 year after the intervention finishes (t3), while short-term effects are part of the secondary analyses. We expect small to medium effect sizes from the comparison between these two groups.

  3. 3.

    Does the intensity of use of health programs have an impact on their effects?

    The hypothesis we test is that study participants who use their health program more frequently and intensively achieve better outcomes than study participants who use the program less often or less intensively.

  4. 4.

    How satisfied with the programs offered are the study participants in the intervention- and control groups? This question will be examined exploratively in secondary analyses.

Study population and recruitment procedure

The process of the three online-RCTs, each with parallel groups and equal distribution, is presented in the flowchart (Fig. 1).

Fig. 1
figure 1

Flowchart of three RCTs to evaluate the TK-HealthCoach. See Table 4 for sample size details. N = absolute number; t = measurement time point

Inclusion criteria

Healthy persons (male/female/diverse), aged 18 years and older, regardless of whether they are insured with TK health insurance fund, are eligible to participate. Interested persons with impairments or pre-existing conditions require a medical assessment as to whether the program is suitable for them. Participation is only permitted on the condition that interested persons provide truthful information with regard to their health status. Each person can only choose one health goal and therefore participate in only one RCT.

Specific inclusion criteria for the “Smoking Cessation” RCT

Only people who smoke at baseline (t0) can take part in the “Smoking Cessation” online RCT.

Specific inclusion criteria for semi-standardized telephone interviews

Only participants in the “Smoking Cessation” online RCT’s intervention group and those who have completed the t1 online questionnaire can register for these interviews.

Exclusion criteria

People will be excluded from participating in the program or study if

  • Their health impairments which, according to a medical assessment, partially or completely rule out participation in the chosen online health program,

  • They are already participating in another study aiming to change behavior towards the health goal in question.

Specific exclusion criteria for the Losing and Maintaining Weight RCT

  • Pregnancy or breastfeeding,

  • Waist circumference > 200 cm or body mass index (BMI) > 40 kg/m2,

  • Currently underweight or underweight after a weight loss of 3 kg,

Interested persons are asked to calculate their BMI (link offered).

Specific exclusion criteria for the Increasing Fitness RCT

  • Pregnancy,

  • Currently underweight

Persons with waist circumference > 200 cm or BMI > 40 kg/m2 must obtain a medical assessment that allows participation in the health program.

Interested persons are asked to calculate their BMI (link offered).

Specific exclusion criteria for the Smoking Cessation RCT

Interested persons cannot participate if they have already quit smoking, even if it is only for a few days.

Specific exclusion criteria for the telephone interview

  • Any restrictions making a telephone survey impossible, such as severe communication difficulties.

Recruitment procedure

From January 1 to 17 of June 2020, a total of N = 2903 study participants have to be recruited in all RCTs, including the local medical substudies. The number of participants who have to be enrolled in the online studies is N = 2567.

Recruitment activities and information are being disseminated via online and print media. These include various information provided via channels of the TK health insurance (websites, newsletters, blogs etc.), advertisements on Google, and different health media. Advertisements in the local press and radio, the intranet of the University of Freiburg and its Medical Center, and a local display of flyers serve to recruit specifically for the regional medical substudies.

People intending to change their health behavior find brief information about the study and its objectives on the project’s homepage. As specific inclusion and exclusion criteria apply to each of the three programs or RCTs respectively, detailed study information is provided on each program entry.

If interested persons give their informed consent to participate in the program and study, and after completing their registration, they will as participants receive the first health goal-specific questionnaire by e-mail (baseline t0).

Participants in the Increasing Fitness or Losing and Maintaining Weight RCTs living in the postal code area 79 are offered the possibility to enroll in the medical substudies after filling out the t0 questionnaire. These substudies entail sports and nutritional medical examinations (details will be published in the study protocol of the medical substudies).

Randomization

After completing the baseline questionnaire, the online RCT participants are given access to their selected online health program. While accessing the program, the participants in each online RCT are allocated at random to the interactive online health program (intervention group) or the non-interactive online health program (control group). Randomizations take place separately for each RCT Increasing Fitness, Losing and Maintaining Weight, and Smoking Cessation via permuting block randomization with variable block sizes of 4, 6, and 8. The participants are assigned to the intervention or control group automatically according to randomization lists. These randomization lists for each RCT were created by SEVERA, applying the software RITA, version 1.50 [19], and transmitted on May 28, 2019, to the IT Company (Vilua Healthcare GmbH), responsible for operating the online program and online survey. The randomization lists cannot be influenced by participants, the IT Company, or the health program’s provider.

We chose permuting block randomization to ensure equal distribution in the intervention and control groups in case of deviations between the numbers of targeted and indeed enrolled participants.

Blinding of the study participants is not possible due to their informed consent to participate in one of two different health-program forms (interactive vs. non-interactive). By participating actively in the interventions, they will be immediately aware of the group to which they have been allocated. Blinded data analysis cannot be ensured either, since the data collected may indicate the study-arm affiliation.

Interventions

All study participants are given access to a health goal-specific, web-based online program with the difference being that the intervention group is offered a comprehensive, interactive program and the control group a less extensive, non-interactive program.

All participants have access to a personal profile page where they find their personal registration data, study information, and declaration of consent as well as the possibility to unsubscribe from the study and/or program.

Intervention groups

Participants in the intervention groups are given access to the technically guided, interactive programs FitnessCoaching, WeightLossCoaching, or SmokingCessationCoaching.

The recommended duration of participation in FitnessCoaching and WeightLossCoaching is 12 weeks, that in SmokingCessationCoaching 6 weeks.

The overall aim of each coaching module is to guide users step by step to their health goal and prepare them to continue after the coaching. For this, the users are asked to compile their activities and will then receive a tailored plan and technically guided psychological input to achieve sustainable, positive health effects. Each coaching module contains specific tools to help avoid relapsing. In addition, participants are advised by experts from the IT Company on request.

Individual action planning: A common feature of the three coaching modules is their multimodality, interactivity and individual applicability. Each program starts with an anamnesis specific to the chosen health goal. Based on those results, participants plan individual activities with adaptable intensity. All selectable activities are accompanied by video-, audio- or reading instructions. Since many activities benefit different health goals, the participants can choose their individual activities across all three coaching modules—with the exception that the SmokingCessationCoaching activities cannot be selected by participants in FitnessCoaching or WeightLossCoaching.

To enhance health-related knowledge, users are given access to a comprehensive, evidence-based knowledge area divided into different articles. The program pre-filters relevant content for the user. Nevertheless, each user in the intervention group can access all information, regardless of their coaching module.

Weekly planned activities, specific articles, and advice as well as test-tools and daily motivation tips are displayed on an individual dashboard personalized to accommodate each user’s current progress.

Logging results, feedback, and motivation: All activities carried out, data from activity trackers, self-tests, nutrition and smoking protocols, as well as read articles, etc., can be logged on by participants. Pop-up toasts or notifications depending on the progress of the participants give feedback on attained goals, motivate user to continue, or suggest specific barrier management. The latter is implemented in the FitnessCoaching and the SmokingCessationCoaching.

A personal profile page contains an overview of each participant’s progress in weight loss and physical activity or days not smoking. It also contains the study information and informed consent form as well as buttons to withdraw participation in the study or program. At the end of each coaching module (after 6 or 12 weeks, respectively), a review page containing an overview of each participant’s goals and attainments is displayed.

Specificities of the coaching modules

  • The WeightLossCoaching focuses on a sustainable change in diet and the principle of balanced nutrition. The aim is that participants reduce their weight by a maximum of 5 kg within a 12-week period. Its main tool, based on the concept of energy density [20], is a comprehensive protocol of nutrition and physical activity by which an individual’s optimal energy requirements are calculated. An extensive cookbook with recipes is available.

  • The FitnessCoaching main elements are training plans for strength, endurance, and mobility characterized by progressive training loads through various sports activities such as pilates, back training, yoga, circuit training, Nordic walking, jogging, and cycling. Additional physical activities can be added.

  • The SmokingCessationCoaching applies the cold-turkey strategy and has a modular structure. Users can get themselves ready for the smoking-cessation date during a preparation phase lasting a maximum 14 days, followed by a 4-week weaning phase. The SmokingCessationCoaching includes meditation and mindfulness modules. Additionally, participants are invited to take part in an individual telephone counseling entailing up to four consultations. The counselors are especially trained to carry out this intervention (for details see supplement 1) (Table 1).

Table 1 Number of specific components of each coaching module

Control groups

The control group participants are given access to a non-interactive online health program according to their selected health goal. They receive evidence-based information with advice to attain their goals. This information is divided into different lessons on a website especially designed for each health goal. Study participants are unable to link training plans, protocols or data from activity trackers to the program. A personal profile page contains study information, the informed consent form, and buttons to withdraw participation in the study or program.

After the trial-dependent program ends, all participants, regardless of their study arm, will be given access to the trial-independent interactive TK-HealthCoach. This will be possible for all persons regardless of their membership in the TK health insurance fund. While the development of each trial-dependent coaching module (used by study participants) was concluded at the beginning of the study, the trial-independent TK-HealthCoach has been expanded to incorporate new coaching modules, i.e., AntistressCoaching.

Data collection

Due to summative and formative evaluations, different types of data will be collected in this study. Self-reported outcomes will be surveyed via online questionnaires at all measurement time points (t0, t1, t2, t3). Users withdrawing their participation in the study or the health program prematurely, will receive a short logoff questionnaire upon deregistration to assess reasons for study termination. Usage behavior data will be stored from all participants who log onto their health program, from their first to their last login. Qualitative data will be collected during telephone interviews with participants in the intervention group in the Smoking Cessation RCT.

Sports and nutritional medical data will be collected by the IfSS as part of the two substudies. Physiological outcomes will be evaluated in each via four medical examinations (t0, t1, t2, t3). Completing the online questionnaire is a precondition for participating in one of the medical substudies. Detailed information on this data collection will be published in a separate study protocol.

Quantitative data

Online questionnaires: baseline (t0) and catamnesis (t1–t3)

Online questionnaires specifically designed for each health goal are applied in all RCTs to survey socio-demographic, health-related, and psychological variables.

The variables and constructs of the online questionnaire surveys of all RCTs at the four measurement time points are shown in Tables 2, 3, and 4. We used validated instruments whenever possible. The wording in some instruments has been modified and other questions newly developed by the research team. A new questionnaire to investigate eating behavior [21] has been developed as part of the medical preliminary study (details see separate study protocol of the medical substudies [22].

Table 2 Variables of three health goal-specific questionnaires: sociodemographic and baseline variables
Table 3 Variables of three health goal-specific questionnaires: primary outcomes and secondary outcomes
Table 4 Variables of three health-specific questionnaires: confounder, use, evaluation, and cancelation of the programs

Before the online implementation, we pretested the questionnaires for understandability and usability by applying a “think-aloud method” with 11 participants (see supplement 2). Additionally, four of our research team members tested the questionnaires in advance through an expert review. During the process of online implementation and technical realization, two members of the research team monitored the rigorous implementation and web-based display of the questionnaires.

Usage behavior data

Usage behavior data will be collected from all participants engaged in the web-based health programs (intervention- and control groups) from their first to their last login. These data are partially collected at the participant level (frequencies and duration of program logins, logged activities [only intervention group]), and partially aggregated (page views).

Qualitative data

Participants in the SmokingCessationCoaching (only participants in the intervention group of the corresponding RCT) will be invited to participate in a telephone interview after completing the t1-questionnaire. The duration of each interview will be 30–45 min.

Program compliance, usage intensity, motivation, and user satisfaction as well as smoking history and sociodemographic data will be surveyed by SEVERA-team researchers posing the following key questions.

The pretested interview guideline includes the following key questions:

  1. 1.

    What experiences did you have with the smoking cessation program?

  2. 2.

    How did you feel in the smoking cessation preparation phase?

  3. 3.

    How was your first day not smoking?

  4. 4.

    From your point of view, how was the program’s usability?

  5. 5.

    Did you take advantage of the personal telephone counseling offered in the SmokingCessationCoaching? If so, can you tell me about your experiences? If not, why did you not engage with the telephone counseling?

  6. 6.

    What motivated you to begin this non-smoking program (also in comparison to other programs)?

  7. 7.

    How satisfied were you with this non-smoking program and why?

  8. 8.

    Would you recommend this smoking cessation program to others? If so, why would you recommend it, and if not, why would you not recommend it to others?

  9. 9.

    Sociodemographic data: age, gender, native language, graduation, professional qualification, employment, and experience with computer-aided programs.

  10. 10.

    Smoking history

    1. a)

      Are you currently a smoker?

      1. i.

        If no: How long have you not smoked a cigarette?

      2. ii.

        If no: How confident are you that you will manage to keep from smoking and why?

      3. iii.

        If yes: What are the reasons that you currently smoke?

      4. iv.

        If yes: Would you like to go through the program again, or where would you prefer to start?

    2. b)

      How long did you smoke?

    3. c)

      How many cigarettes a day did/do you smoke?

    4. d)

      When did/do you smoke your first cigarette in the morning?

    5. e)

      Have you tried to quit smoking before? (If so, how often? How successfully?)

    6. f)

      Had you participated in any other smoking cessation programs before this online program? (If so, which?)

    7. g)

      Have you used nicotine-replacement products as a cigarette alternative? (If so, which ones?)

Data management

All quantitative research data are recorded and stored with individual pseudonyms by Vilua Healthcare GmbH (https://vilua.com/services/). Vilua has years of experience managing large datasets related to health programs and research projects and applies high quality standards in terms of data protection and data management.

Since the study started, Vilua sends at regular 2-day intervals datasets to SEVERA which include the number of received baseline-questionnaires in each health goal, randomized users of the programs, as the well as the number of questionnaires of all the following assessment time points distributed, received, and blocked due to exceeding the response time (eight weeks maximum). Due to this monitoring process, the research teams and Vilua are reviewing whether online recruitment and e-mailing of the questionnaires are technically successful. Users are able to contact Vilua the SEVERA and/or IfSS to address technical problems. Possible irregularities are immediately clarified between Vilua and scientific staff members of SEVERA and existing problems (e.g., failures in the storage of usage behavior data, feedback from users about technical errors, etc.) are logged by Vilua, SEVERA, and the IfSS.

The TK health insurance fund will have no access to this study’s raw data, but is only informed about the progress. There exist no competing interests.

In addition, SEVERA regularly prepares monitoring reports and communicates them to all the collaboration partners. The reports support the decision-making process, shared by the entire project team, to strengthen recruitment efforts and, finally, to complete the recruitment.

Data from the questionnaires are assessed approximately every 14 to 30 days for control purposes. Usage behavior data from the program are transferred at larger intervals. The data transfers are carried out by Vilua via a secure cloud of the Medical Center – University of Freiburg. The data are conducted via comma-separated values (csv) format and merged into the statistic program Statistical Package for the Social Sciences (SPSS) data files (IBM SPSS; Version 26), R (Version 4.0.3), and IDE R Studio (Version 1.2.5033).

After plausibility checks conducted by the scientific staff members of SEVERA, data analyses will be performed by SEVERA and IfSS.

The telephone interviews will be stored digitally as audio files and analyzed by scientific staff of SEVERA. Due to data protection requirements, parts of the interviews including personal information on the participants will be deleted by research assistants. A separate ID will be used to pseudonymize the interviews. The transcriptions of the audio recordings will be conducted by an external office. The data will be transferred via the secured connection to the file server provided by this office. To carry out the qualitative data analysis (QDA), the software MAXQDA (Version2020) will be used.

The TK health insurance fund will have no access to this study’s raw data but is only informed about the recruitment progress.

Study outcomes and data analyses

Summative evaluation

Our four major research questions for this project are illustrated above.

We will use a linear mixed model (LMM) for the primary outcomes weight loss (kilogram) and fitness (BSA-Score), and for the outcome smoking cessation, we use a generalized linear model (GLMM) because of the dichotomous outcome variable (Smoking yes/no). The cluster variable is the person-id (level 2-group variable) with the time point nested within it (level 1 measurement), that permits us to model individual and group level changes [23,24,25]. For each primary outcome, we apply the following basic model with cross-level interaction and random slopes:

Level 1: Outcome = β0j + β1jtime + βnjXnj + rij

Level 2: β0j = γ00 + γ01group + γ0nZ0n + uoj

$$ {\beta}_{1j}={\gamma}_{10}+{\gamma}_{11}\ast group+{u}_{1j} $$

“Group” will be a dichotomous variable, which contrasts the intervention group vs. the control group. ’Time’ consists of four time points coded with 0 to 3.

Possible covariates (see Table 4) will enter the model at level 1 (X) when they are measured at more than one time point or at level 2 (Z) when they are only measured at baseline. The covariates differ in type and number between the three coaches. The components X and Z are therefore only placeholders. The covariates considered may represent real-life conditions of participants existing independently of the program; they can be beneficial or detrimental to participants’ goal attainment or outcomes. The social environment in particular may be conducive or an obstacle [26,27,28,29,30]. The importance of social and emotional support from people, who are close, is also pointed out by the NICE guideline Behaviour Change: individual approaches [31]. Tiredness and a decrease in drive and activity are indications of mood disorders. Self-efficacy, motivation and intention to change, as well as functional or physical limitations are predictors for behavioral change and associated with mental health, health status, and comorbidities [32,33,34,35,36,37,38,39,40]. Furthermore, it is likely that additional addictive behaviors and low degree of mental health will make smoking cessation more difficult [33, 41, 42]. Since past behavior predicts future behavior, as confirmed in a meta-analysis [43], preconditions such as mental health, health status comorbidity, additional addictive behavior, but also social support, assessed at baseline, are considered as program-independent covariates of primary outcomes. We use these covariates, along with sex, age, and primary outcome at baseline to adjust the statistical models in the analyses. In these models, coefficient γ10 refers to the change over time of the intervention groups (hypothesis 1), while coefficient γ11 refers to the difference in change between intervention and control group (hypothesis 2).

For the analyses of secondary outcomes, measuring mean changes over time (see Table 3), we use linear mixed models analogous to the primary outcomes in weight loss and fitness. Differences between intervention and control groups in for example “Health related goal intention” or “Perceived goal attainment” will be analyzed using t tests.

To test the dose-effect association (hypothesis 3), the outlined model will be adapted—here, we only use the intervention group, so the group variable will be dropped. Instead of the group variable, a variable that code the use (e.g., number of logins) of the coach will enter the model at level 2.

All metric covariates at level 1 will be group mean-centered, while metric covariates at level 2 will be grand mean-centered. Categorical variables enter as dummy-coded (0/1) variables.

Post-hoc analyses with correction for multiple testing will be conducted to identify changes between specific time points to analyze short-term effects, e.g., between t0 and t1. As effect size, with their 95% confidence intervals, we will calculate Cohen’s d bases on the t values from the pairwise comparisons from the LMM respective odds ratio for the GLMM.

In the case of the SmokingCessationCoaching, we will drop the baseline (T0) from the model, because every case concerns smoking. It is, therefore, not possible to calculate the odds ratio for the change between baseline and post-intervention. Instead, we will use the difference in smoking cessation at post intervention between both groups as the effect size.

Furthermore, we will apply structural equation modeling to test various models for assessing potential mediators of the intervention effect on outcomes.

The analyses are carried out according to the intention-to-treat principle (ITT). In ITT, all randomized participants will be considered in the main analyses. In per-protocol analyses (PP), only those participants will be included who have been randomized, have participated at all time points, and filled out corresponding primary outcomes. The randomization condition for study participants was that they accessed the program at least once.

Sensitivity analysis and missing values

We will compare the results from intention-to-treat (ITT) analyses with per-protocol analyses (PP) and drop-out analyses. We test if participants, who have continuously taken part in the online survey, achieve better outcomes. Due to different procedures to impute missing values (see below), we will use linear mixed models, (a) with imputed covariates on ITT and PP analyses and (b) without covariates in ITT and PP analyses to compare the raw change in outcomes over time.

In addition, we will consider data on program use, (a) between intervention- and control-groups and (b) within intervention groups, between participants who use the program only once and those who use it multiple times.

In the missing value analysis, we analyze the patterns of missing values as well as frequency for cases and variables. The missing values will be imputed using multiple imputation (MI) technique, if the assumption of missing at random (MAR) or missing complete at random (MCAR) holds.

The imputation approach differs between ITT and PP because in PP, we only include participants without missing values on outcome criteria in the analysis. Therefore, only missing values on predictor variables will be imputed, but not for the outcome variables, while in the ITT analysis, predictor variables as outcome variables will be imputed too.

Formative evaluation

Our fourth and final investigative aim is to characterize the intervention- and control-group participants’ ways of use and satisfaction with their corresponding online program as further secondary outcomes. To that end, the first step will be to conduct a descriptive analysis; in step 2, we will test via regression models our hypotheses regarding predictors of satisfaction.

The telephone interviews with users of the SmokingCessationCoach (intervention group of the corresponding RCT) will be analyzed taking a qualitative content analysis approach. The transcripts of the interviews will be coded and analyzed according to a deductive and inductive approach. We will form main- and subcategories out of the identified themes. Deductive main categories will correspond to the main topics of the interview guideline. Inductive categories will result from additional content mentioned by the participants in the interviews. Subcategories will form subordinate topics or different ratings of a main category. According to the categorization system, transcripts will be coded, ordered, summarized and systematically interpreted [44]. For illustration purposes, the presentation of the results will include individual quotes of the participants.

Sample size calculation

Randomized controlled trials

We calculated the sample size for each randomized controlled trial (RCT) separately (see Table 5) by considering the effect sizes of the primary outcomes in comparable trials [8,9,10,11], the α-error (0.05), and the power we were striving for (1 − β = 0.80). Our power analyses were done using GPOWER software. While we assumed a general online-RCT dropout rate of 50% [45, 46], we estimate a dropout rate of about 15% in the medical substudies in light of experiences with similar studies involving personal medical examinations. We have accounted for an additional 10% buffer for the online RCTs.

Table 5 Sample size calculations for the three RCTs including medical substudies

Interviews

We plan to conduct 15 to 20 interviews with participants in the RCT Smoking Cessation intervention group. This calculation is based in particular on previous experience and is expected to lead to saturation of information. We further assume that this number of users will agree to participate in a telephone interview (approx. 20% of the users in the RCT Smoking Cessation intervention group). If further information is required after 15 interviews, up to 5 more interviews will be conducted.

Incentives

After the trial-dependent program ends, all participants, irrespective of their study arm, will be given access to the trial-independent, interactive TK-HealthCoach. This is possible for all study participants regardless of membership in the TK health insurance fund. While the development of the trial-dependent programs (those used for study participants) was stopped at the beginning of the study, the trial-independent TK-HealthCoach is being expanded with new Coaching modules such as AntistressCoaching.

Participants who filled out all four questionnaires will receive a shopping voucher worth € 25. For returning the t1 and t2 questionnaires participants will receive discount coupons for the purchase of activity trackers. Interview partners will receive in addition a shopping voucher worth € 30. All vouchers will be sent by e-mail.

Discussion

Main objective of this study is to analyze the effectiveness of the LosingWeightCoach, FitnessCoach, and SmokingCessationCoach health programs by comparing their respective intervention and control groups. We assume that study participants can improve their health behavior by engaging in the offered health programs and that each health program’s intervention group will reveal a benefit in attaining primary and secondary outcomes in comparison to control groups.

The results of our formative evaluation including the responses in the logoff questionnaires, drop-out analysis, broad usage behavior data, and qualitative interviews will enrich our interpretation of the summative results and enable detailed insight into the satisfaction and usability of the programs. Finally, this study will be essential to developing quality criteria for web-based health programs.

Trial status

Protocol version number 3; date of approval: 2019 July 25 (amendment: 2019 October 28).

Study enrollment began on January 1, 2020. After the first 6 weeks, we noticed that the Losing and Maintaining Weight health goal was chosen much more often than the Increasing Fitness health goal. As we had expected, recruitment for the Smoking Cessation health goal was continuous and good. We therefore tried to draw more attention to the Increasing Fitness health goal by adjusting keywords and budget of the online ads.

In line with our study’s risk management, we consider that, as studies involving digital interventions and digital surveys are notorious for encouraging a rather low level of personal commitment, the risk of program drop-outs or study discontinuations is higher than in trials involving personal, face-to-face contacts [45, 46]. In addition, common technical problems on the part of the provider or user can increase dropout rates. For these reasons, individuals interested in the study and its participants are able to contact the participating institutions by phone and/or e-mail to obtain personal advice. Nevertheless, the dropout rate could exceed the estimated 50% rate associated with all online RCTs. Dropouts could occur if participants are dissatisfied with the programs or in case of unpredictable events such as the rapid spread of the coronavirus in Germany since March 2020 and potential problems associated with general high attention, the health of participants, technical problems due to the congestion in the internet, etc. Therefore, we are monitoring the response rates at t1 and, if necessary, will raise the number of participants to be recruited. We closed recruitment on 05 October 2020.

Availability of data and materials

The datasets generated and analyzed during the current study will neither be shared with scientists outside this cooperation project nor with other third parties. The reason for this decision is that it cannot currently be guaranteed that anonymized data will not be de-anonymized in the future because of various data available on the internet. Therefore, the collected data will remain under control of the cooperation partners in this project. Data will be anonymized three years after completion of the study and the research data will be deleted after 10 years.

PL declares that he receives a fee from the TK for technical support for the consultant interface and for evaluating the SmokingCessationCoaching; this includes travel expenses. PL has no connections to the tobacco, e-cigarette, or pharmaceutical industry. There are no other conflicts of interest.

RB declares that he receives a fee from TK for cooperating on health issues in the TK’s department of Health Care Management. In this context, RB’s travel expenses are reimbursed. There are no other conflicts of interest.

Change history

  • 28 October 2021

    The article's Funding section has been updated.

Abbreviations

BMI:

Body mass index

BRAHMS:

Berlin Risk Appraisal and Health Motivation Study

BSA:

Physical Activity and Sport Activity Questionnaire

CG:

Control group

csv:

Comma-separated values; file format

DFG:

German Research Foundation

DRKS:

German Clinical Trial Register

€:

Euro

F:

Increasing Fitness

SEV:

German Eating Behavior Scale

FIMA:

Questionnaire for Health-Related Resource Use in an Elderly Population

FTND:

Fagerstrom Tolerance Questionnaire

GDPR:

European General Data Protection Regulation

GPOWER:

Software used to carry out the sample size calculation

ID:

Identification number

IfSS:

Department of Sport and Sport Science

IG:

Intervention group

IRES:

Indicators of Rehab Status Questionnaire

JCA:

Joint Controller Agreement

KoMo:

Comorbidity Score

M:

Mean

Max:

Maximum

MAXQDA:

Software used to carry out the qualitative data analysis

Min:

Minimum

N/n:

Absolute number

PHQ-2:

Patient Health Questionnaire

PIQ-20:

Partner Interaction Questionnaire

QDA:

Qualitative data analysis

RCT:

Randomized controlled trial

RITA:

Randomization In Treatment Arms; randomization program for clinical trials used to carry out the randomization lists

S:

Smoking cessation

SD:

Standard deviation

SEVERA:

Section of Health Care Research and Rehabilitation Research

SF-12:

Short Form 12

SPSS:

Statistical Package for the Social Sciences, software used to carry out statistical analyses

t0, t1, t2, t3:

Measurement time point 0 (baseline) and follow ups 1, 2, and 3

TK:

Techniker health insurance fund

UTN:

Universal trial number

VO2 :

Oxygen saturation

vs:

Versus

W:

Losing and Maintaining Weight

WHO-ASSIST:

Alcohol, Smoking and Substance Involvement Screening Test

References

  1. World Health Organization (WHO). Report on the Global Tobacco Epidemic. Geneva: World Health Organization; 2019. Available from: https://www.who.int/publications-detail/who-report-on-the-global-tobacco-epidemic-2019-offer-help-to-quit-tobacco-use. Accessed 29 May 2020.

  2. World Health Organization (WHO). Diet, nutrition and the prevention of chronic diseases: Report of a Joint WHO/FAO Expert Consultation. Geneva: World Health Organization; 2003. Available from: https://apps.who.int/iris/bitstream/handle/10665/42665/WHO_TRS_916.pdf?sequence=1. Accessed 29 May 2020.

  3. World Health Organization (WHO). Global recommendations on physical activity for health. Geneva: World Health Organization; 2010. Available from https://apps.who.int/iris/bitstream/handle/10665/44399/9789241599979_eng.pdf?sequence=1. Accessed 29 May 2020.

  4. Korhonen MJ, Pentti J, Hartikainen J, Ilomäki J, Setoguchi S, Liew D, et al. Lifestyle changes in relation to initiation of antihypertensive and lipid-lowering medication: a cohort study. J Am Heart Assoc. 2020;9:e014168. https://doi.org/10.1161/JAHA.119.014168.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Lucht M, Bredenkamp R, Boeker M, Kramer U. Gesundheits- und Versorgungs-Apps. Freiburg: Studienzentrum Freiburg, Universitätsklinikum Freiburg; 2015. p. 129. Available from: https://docplayer.org/2645845-Gesundheits-und-versorgungs-appshintergruende-zu-deren-entwicklung-und-einsatz.html. Accessed 29 May 2020.

  6. Foster C, Richards J, Thorogood M, Hillsdon M. Remote and web 2.0 interventions for promoting physical activity. Cochrane Database Syst Rev. 2013;9:CD010395. https://doi.org/10.1002/14651858.CD010395.pub2. Epub ahead of print. PMID: 24085594.

  7. Oosterveen E, Tzelepis F, Ashton L, Hutchesson MJ. A systematic review of eHealth behavioral interventions targeting smoking, nutrition, alcohol, physical activity and/or obesity for young adults. Prev Med. 2017;99:197–206. https://doi.org/10.1016/j.ypmed.2017.01.009.

    Article  PubMed  Google Scholar 

  8. Sherrington A, Newham JJ, Bell R, Adamson A, McColl E, Araujo-Soares V. Systematic review and meta-analysis of internet-delivered interventions providing personalized feedback for weight loss in overweight and obese adults. Obes Rev. 2016;17(6):541–51. https://doi.org/10.1111/obr.12396.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Davies CA, Spence JC, Vandelanotte C, Caperchione CM, Mummery WK. Meta-analysis of internet-delivered interventions to increase physical activity levels. Int J Behav Nutr Phys Act. 2012;9(1):52. https://doi.org/10.1186/1479-5868-9-52.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Chambliss HO, Huber RC, Finley CE, McDoniel SO, Kitzman-Ulrich H, Wilkinson WJ. Computerized self-monitoring and technology-assisted feedback for weight loss with and without an enhanced behavioral component. Patient Educ Couns. 2011;85(3):375–82. https://doi.org/10.1016/j.pec.2010.12.024.

    Article  PubMed  Google Scholar 

  11. Whittaker R, McRobbie H, Bullen C, Rodgers A, Gu Y. Mobile phone-based interventions for smoking cessation. Cochrane Database Syst Rev. 2016;4(4):CD006611. https://doi.org/10.1002/14651858.CD006611.pub4. PMID: 27060875; PMCID: PMC6485940.

  12. Richards J, Thorogood M, Hillsdon M, Foster C. Face-to-face versus remote and web 2.0 interventions for promoting physical activity. Cochrane Database Syst Rev. 2013;(9):CD010393. https://doi.org/10.1002/14651858.CD010393.pub2. PMID: 24085593.

  13. Riffenburg KM, Spartano NL. Physical activity and weight maintenance: the utility of wearable devices and mobile health technology in research and clinical settings. Curr Opin Endocrinol Diabetes Obes. 2018;25(5):310–4. https://doi.org/10.1097/MED.0000000000000433.

    Article  PubMed  Google Scholar 

  14. van Genugten L, Dusseldorp E, Webb TL, van Empelen P. Which combinations of techniques and modes of delivery in internet-based interventions effectively change health behavior? A Meta-Analysis J Med Internet Res. 2016;18(6):6. https://doi.org/10.2196/jmir.4218.

    Article  Google Scholar 

  15. Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res. 2010;12(1):1. https://doi.org/10.2196/jmir.1376.

    Article  Google Scholar 

  16. The Lancet. Does mobile health matter? Lancet. 2017;390(10109):2216. https://doi.org/10.1016/S0140-6736(17)32899-4. PMID: 29165258.

  17. Wykes T, Schueller S. Why reviewing apps is not enough: transparency for trust (T4T) principles of responsible health app marketplaces. J Med Internet Res. 2019;21(5):e12390. https://doi.org/10.2196/12390.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Asthana S, Jones R, Sheaff R. Why does the NHS struggle to adopt eHealth innovations? A review of macro, meso and micro factors. BMC Health Serv Res. 2019;19(1):984. https://doi.org/10.1186/s12913-019-4790-x.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Pahlke F, König IR, Zielger A. Randomization In Treatment Arms (RITA): Ein Randomisierungs-Programm für klinische Studien. Inform Biom Epidemiol Med Bio. 2004;35(1):1–22.

    Google Scholar 

  20. Schusdziarra V, Hausmann M, Wiedemann C, Hess J, Barth C, Wagenpfeil S, et al. Successful weight loss and maintenance in everyday clinical practice with an individually tailored change of eating habits on the basis of food energy density. Eur J Nutr. 2011;50(5):351–61. https://doi.org/10.1007/s00394-010-0143-6.

    Article  PubMed  Google Scholar 

  21. Wurst R, Brame J, Ramsenthaler C, König D, Fuchs R. A questionnaire to assess eating behavior: structure and validity and responsiveness of a new German eating behavior scale (SEV). Article submitted in December 2020.

  22. Brame J, König D. Health effects of a 12-week web-based lifestyle intervention program in healthy adults - Formative Evaluation of the TK-HealthCoach (FitnessCoaching/WeightLossCoaching). Study registration DRKS00016512; 2019. German Clinical Trials Register (DRKS). Available from: https://www.drks.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00016512. Accessed 29 May 2020.

  23. Singer JD, Willett JB. Applied longitudinal data analysis. Modeling change and event occurrence. New York: Oxford University Press; 2003.

    Book  Google Scholar 

  24. Gibbons RD, Hedeker D, DuToit S. Advances in analysis of longitudinal data. Annu Rev Clin Psychol. 2010;6(1):79–107. https://doi.org/10.1146/annurev.clinpsy.032408.153550.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Kwok OM, Underhill AT, Berry JW, Luo W, Elliott TR, Yoon M. Analyzing longitudinal data with multilevel models: an example with individuals living with lower extremity intra-articular fractures. Rehabil Psychol. 2008;53(3):370–86. https://doi.org/10.1037/a0012765.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Rieger E, Lee YF, Monaghan C, Zwickert K, Murray K. Measuring social processes regarding eating, physical activity, and weight in higher-weight people: the weight-related interactions Scale (WRIS). Eat Weight Disord. 2021. https://doi.org/10.1007/s40519-021-01208-2. Epub ahead of print. PMID: 34041685.

  27. Karfopoulou E, Costas AA, Avgeraki E, Kosmidis MH, Yannakoulia M. The role of social support in weight loss maintenance: results from the MedWeight study. J Behav Med. 2016;39(3):511–8. https://doi.org/10.1007/s10865-016-9717-y.

    Article  PubMed  Google Scholar 

  28. Cohen S. Social relationships and health. Am Psychol. 2004;59(8):676–84. https://doi.org/10.1037/0003-066X.59.8.676.

    Article  PubMed  Google Scholar 

  29. Osman A, Amodei N, Lamb RJ. Further psychometric analysis of the 20-item Partner Interaction Questionnaire in an adult sample of smokers. Psychol Addict Behav. 2019;33(6):567–73. https://doi.org/10.1037/adb0000477.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Kiernan M, Moore SD, Schoffman DE, Lee K, King AC, Taylor CB, et al. Social support for healthy behaviors: scale psychometrics and prediction of weight loss among women in a behavioral program. Obesity. 2012;20(4):756–64. https://doi.org/10.1038/oby.2011.293.

    Article  PubMed  Google Scholar 

  31. National Institute for Health and Care Excelence (NICE). Behaviour change: individual approaches. Public health guideline PH49, 2014/19; Behaviour change: individual approaches (nice.org.uk).

  32. Glattacker M, Meixner K, Farin E, Jäckel WH. Development and psychometric testing of a rehabilitation specific comorbidity score. Physikalische Medizin, Rehabilitationsmedizin, Kurortmedizin. 2007;17(5):260–70. https://doi.org/10.1055/s-2007-970405.

    Article  Google Scholar 

  33. West R, Evins AE, Benowitz NL, Russ C, McRae T, Lawrence D, et al. Factors associated with the efficacy of smoking cessation treatments and predictors of smoking abstinence in EAGLES. Addiction. 2018;113(8):1507–16. https://doi.org/10.1111/add.14208. Epub 2018 Mar 30. PMID: 29508470; PMCID: PMC6055735.

  34. Clayborne ZM, Colman I. Associations between depression and health behaviour change: findings from 8 cycles of the Canadian Community Health Survey. Can J Psychiatr. 2019;64(1):30–8. https://doi.org/10.1177/0706743718772523.

    Article  Google Scholar 

  35. O'Connor EA, Whitlock EP, Gaynes B, Beilet TL. Screening for depression in adults and older adults in primary care: an updated systematic review. Rockville (MD): Evidence Syntheses, No. 75, Agency for Healthcare Research and Quality (US); 2009.

    Google Scholar 

  36. McKercher C, Patton GC, Schmidt MD, Venn AJ, Dwyer T, Sanderson K. Physical activity and depression symptom profiles in young men and women with major depression. Psychosom Med. 2013;75(4):366-74. https://doi.org/10.1097/PSY.0b013e31828c4d53. Epub 2013 Apr 10. PMID: 23576769.

  37. Bauman AE, Reis RS, Sallis JF, Wells JC, Loos RJ, Martin BW. Correlates of physical activity: why are some people physically active and others not? Lancet. 2012;380(9838):258–71. https://doi.org/10.1016/S0140-6736(12)60735-1.

    Article  PubMed  Google Scholar 

  38. Scholz U, Nagy G, Göhner W, Luszczynska A, Kliegel M. Changes in self-regulatory cognitions as predictors of changes in smoking and nutrition behaviour. Psychol Health. 2009;24(5):545–61. https://doi.org/10.1080/08870440801902519.

    Article  PubMed  Google Scholar 

  39. Ufholz KE, Harlow LL. Modeling multiple health behaviors and general health. Prev Med. 2017;105:127–34. https://doi.org/10.1016/j.ypmed.2017.08.003.

    Article  PubMed  Google Scholar 

  40. Ryan K, Dockray S, Linehan C. A systematic review of tailored eHealth interventions for weight loss. Digital Health. 2019;5:1–23.

    Article  Google Scholar 

  41. Okoli CT, Khara M. Smoking cessation outcomes and predictors among individuals with co-occurring substance use and/or psychiatric disorders. J Dual Diagn. 2014;10(1):9–18. https://doi.org/10.1080/15504263.2013.866860.

    Article  PubMed  Google Scholar 

  42. Quisenberry AJ, Pittman J, Goodwin RD, Bickel WK, D’Urso G, Sheffer CE. Smoking relapse risk is increased among individuals in recovery. Drug Alcohol Depend. 2019;202:93–103. https://doi.org/10.1016/j.drugalcdep.2019.07.001.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Zhang CQ, Zhang R, Schwarzer R, Hagger MS. A meta-analysis of the health action process approach. Health Psychol. 2019;38(7):623–37. https://doi.org/10.1037/hea0000728.

    Article  PubMed  Google Scholar 

  44. Kuckartz U. Qualitative Inhaltsanalyse. Methoden, Praxis, Computerunterstützung. 4th Edition. Beltz Juventa, Weinheim Basel; 2018. ISBN 978-3-7799-3682-4.

  45. Kohl LF, Crutzen R, de Vries NK. Online prevention aimed at lifestyle behaviors: a systematic review of reviews. J Med Internet Res. 2013;15(7):e146. https://doi.org/10.2196/jmir.2665.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Kelders SM, Kok RN, Ossebaard HC, van Gemert-Pijnen JE. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res. 2012;14(6):e152. https://doi.org/10.2196/jmir.2104.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Schenk L, Bau AM, Borde T, Butler J, Lampert T, Neuhauser H, Razum O, Weilandt C. Mindestindikatorensatz zur Erfassung des Migrationsstatus. Bundesgesundheitsbl. 2006;49:853–60. https://doi.org/10.1007/s00103-006-0018-4.

  48. Gerdes N, Bührlen B, Jäckel WH. Indikatoren des Reha-Status – IRES (Version 3.1.). Bad Säckingen: Hochrhein-Institut für Rehabilitationsforschung; 2002.

  49. Seidl H, Bowles D, Bock J-O, Brettschneider C, Greiner W, König HH, et al. FIMA - Questionnaire for Health-Related Resource Use in an Elderly Population: Development and Pilot Study. Gesundheitswesen. 2015;77(1):46–52. https://doi.org/10.1055/s-0034-1372618.

    Article  CAS  PubMed  Google Scholar 

  50. Renner B, Hahn A, Schwarzer R. Risiko und Gesundheitsverhalten : Dokumentation der Meßinstrumente des Forschungsprojekts "Berlin Risk Appraisal and Health Motivation Study" (BRAHMS).]. Freie Universität Berlin.  Inst. für Arbeits-, Organisations- und Gesundheitspsychologie. 1996. ISBN: 3-00-000631-1.

  51. Fuchs R, Klaperski S, Gerber M, Seelig H. [Measurement of Physical Activity and Sport Activity With the BSA Questionnaire] Zeitschrift für Gesundheitspsychologie. 2015;23(2):60–76. English version available from: https://www.sport.uni-freiburg.de/de/institut/Arbeitsbereiche/psychologie/messinstrumente/Messung%20der%20Sport%20und%20Bewegungsaktivitaet. Accessed 29 May 2020.

  52. Ajzen I, Madden T. Prediction of goal directed behavior: attitudes, intentions, and perceived behavioral control. J Exp Soc Psychol. 1986;22(5):453–74. https://doi.org/10.1016/0022-1031(86)90045-4.

    Article  Google Scholar 

  53. Fuchs R, Seelig H, Göhner W, Schlatterer M, Ntoumanis N. The two sides of goal intentions: Intention self-concordance and intention strength as predictors of physical activity. Psychol Health. 2017;32(1):110–26. https://doi.org/10.1080/08870446.2016.1247840.

    Article  PubMed  Google Scholar 

  54. Seelig H, Fuchs R. Measuring sport- and movement-related self concordance. Z Sportpsychol. 2006;13(4):121–39. https://doi.org/10.1026/1612-5010.13.4.121.

    Article  Google Scholar 

  55. Ochsner S, Scholz U, Hornung R. Testing phase-specific self-efficacy beliefs in the context of dietary behaviour change. Appl Psychol Health Well Being. 2013;5(1):99–117. https://doi.org/10.1111/j.1758-0854.2012.01079.x.

    Article  PubMed  Google Scholar 

  56. Jäkle C, Keller S, Baum E, Basler HD. Scales for the measurement of self-efficacy and decisional balance in the process of behavioral change in smokers. Diagnostica. 1999;45(3):138–46. https://doi.org/10.1026//0012-1924.45.3.138.

    Article  Google Scholar 

  57. Krämer L, Fuchs R. Barrieren und Barrierenmanagement im Prozess der Sportteilnahme [Barriers and barrier management in physical exercise: Introduction of two new assessment instruments]. Zeitschrift für Gesundheitspsychologie. 2010;18(4):170–82. https://doi.org/10.1026/0943-8149/a000026.

  58. Sniehotta FF, Scholz U, Schwarzer R. Action plans and coping plans for physical exercise: a longitudinal intervention study in cardiac rehabilitation. Br J Health Psychol. 2006;11:23–37. https://doi.org/10.1348/135910705X43804.

    Article  PubMed  Google Scholar 

  59. Popova L, Owusu D, Weaver SR, Kemp CB, Mertz CK, Pechacek TF, et al. Affect, risk perception, and the use of cigarettes and e-cigarettes: a population study of U.S. adults. BMC Public Health. 2018;18(1):395. https://doi.org/10.1186/s12889-018-5306-z.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Fagerstrom KO, Schneider NG. Measuring nicotine dependence: a review of the Fagerstrom Tolerance Questionnaire. J Behav Med. 1989;12(2):159–82. https://doi.org/10.1007/BF00846549.

    Article  CAS  PubMed  Google Scholar 

  61. Morfeld M, Kirchberger I, Bullinger M. SF-36. Fragebogen zum Gesundheitszustand. 2nd. edition. Göttingen: Hogrefe; 2011.

  62. Löwe B, Kroenke K, Gräfe K. Detecting and monitoring depression with a two-item questionnaire (PHQ-2). J Psychosom Res. 2005;58(2):163–71. https://doi.org/10.1016/j.jpsychores.2004.09.006. PMID: 15820844.

  63. Schütz CG, Daamen M, van Niekerk C. Deutsche Übersetzung des WHO ASSIST Screening-Fragebogens. SUCHT. 2005:51(5);265–71. https://doi.org/10.1024/2005.05.02.

  64. Fuchs R, Wurst R. Skala zur sozialen Unterstützung zum Sporttreiben (SozUSpo). Article in preparation.

  65. Zimmer D, Lindinger P, Mitschele U. Neue Wege in der verhaltenstherapeutischen Behandlung des Rauchens. Teil 2: Prädiktoren der Veränderungen. Verhaltenstherapie. 1993;3(4):312–6. https://doi.org/10.1159/000258795.

    Article  Google Scholar 

Download references

Acknowledgements

First and foremost, we thank in advance all those who will participate in this study. Thanks go to Hanna Kampling for supporting us at the beginning of this huge project. The article processing charge was funded by the Baden-Wuerttemberg Ministry of Science, Research and Art and University of Freiburg in the funding program Open Access Publishing. We would like to express special thanks to Irina Kopman from Vilua Healthcare GmbH for her excellent cooperation and detailed explanation of all technical details. We thank the staff of Vilua Healthcare GmbH for their implementation of the questionnaires content in an online format, sending out the questionnaires, data storage, and data management tasks of the Company and for being a reliable contact for users with questions about technology and program content. Many thanks also to Dr. Nicole Knaack, Dr. Kerstin Hofreuter-Gätgens, and Dagmar Köppel from the Techniker health insurance fund for their consistently solution-oriented communication in all questions relating to conduct the study. Special thanks to Layla Nieden from the Institute of Medical Biometry and Statistics for translating those questionnaires and items for which English sources are not available. Finally, we thank the professional translator Carole Cürten for the English proofreading of this manuscript, as well as Rebekka Allen, scientific assistant at SEVERA, for English proofreading of the revised manuscript.

Funding

Funding: This evaluation was commissioned by the Techniker health insurance fund.

Techniker Krankenkasse

Bramfelder Straße 140

22305 Hamburg

Germany

http://www.tk.de

Role of study sponsor: The sponsor of the study, the Techniker health insurance fund, did not exert influence on study design, data collection or management, the data analysis or interpretation, and on writing or scientific publication of any results.

The Techniker sponsors recruiting measures as announcements of the study on their websites (www.tk.de) and uses media such as the “TK newsletter” and Twitter. In addition, the Techniker finances digital and printed advertisements for the recruitment of study participants and incentives for participants who fill out the online questionnaires or take part in qualitative telephone interviews.

The Techniker does not receive any case-based or personal data on the participants but is given insight into aggregated data (e.g., number of recruited participants) and results. The results can be used by the sponsor for their own publications in social media, websites, presentations, press releases, etc.

The article processing charge was funded by the Baden-Wuerttemberg Ministry of Science, Research and Art and University of Freiburg in the funding program Open Access Publishing. Open Access funding enabled and organized by Projekt DEAL.

Author information

Authors and Affiliations

Authors

Contributions

IT1 is the first author of this study protocol. She coordinates all tasks involving planning, implementation, data management, and evaluation of the overall study. She is mainly responsible for the formative evaluation of usage behavior data from the SmokingCessationCoaching. She is the contact person for questions regarding the online study.EF1 participated in developing the study design, in project coordination and project management, and worked on statistical analyses.GM1 is mainly responsible for the development and implementation of the questionnaires for the online studies, monitoring the technical implementation of questionnaires and corresponding with the IT Company, supporting tasks concerning data management.CS1 supported the development and implementation of the questionnaires for the online study and data management (especially the data protection concept and data monitoring issues). He translated the German consent form for study participants into English. MS1: As part of the study protocol revision, MS specified the data analysis plan together with EF and IT. MS implemented the data monitoring process. MB1 was involved in developing the data protection concept and is mainly responsible for the qualitative interview study of the SmokingCessationCoaching. RA1 is on the team for the qualitative interview study of the SmokingCessationCoaching. As such, he is involved in developing of the interview guidelines, the evaluation strategy, and the implementation and analyses of the interviews. He checked the translations of the German questionnaires and questionnaire items. JB2 participated in developing the study design and takes on all tasks associated with planning, implementing, and evaluating the formative and summative medical substudies (Increasing Fitness, Losing and Maintaining Weight). She is responsible for the data management of both substudies in the IfSS. DK2 participated in developing the study design and is responsible for the formative and summative medical substudies (Increasing Fitness, Losing and Maintaining Weight). DK is the principal medical doctor of the study. RW2 is responsible for the formative evaluation of usage -behavior data of the FitnessCoaching module and was involved in testing the technical implementation of questionnaires by conducting pretests. She participated in developing the study design. RF2 participated in developing the study design and was involved in the selection and adaption of the psychological assessment instruments. PL3 supported develop the study design, focusing especially on the smoking cessation RCT. RB4 supported develop the study design. IT, EF GM, CS, MB, JB, DK, RW, and RF conceived the overall study and its implementation. They were supported by RB and PL. All authors were involved in drafting the manuscript and revised it critically. All authors read and approved the final manuscript. 1Section of Health Care Research and Rehabilitation Research (SEVERA), Medical Center – University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany 2Department of Sport and Sport Science, University of Freiburg, Freiburg, Germany 3Scientific Working Group in Smoking Cessation (WAT), Tübingen, Germany 4Clinical Trials Unit UMG, University Medical Center Göttingen, Georg-August-University, Göttingen, Germany.

Corresponding author

Correspondence to Iris Tinsel.

Ethics declarations

Informed consent and data protection

According to the ethics guidelines and European General Data Protection Regulation, participants have to give informed consent to participate in the study.

Informed consent: Before registering in the online study and health program, all interested persons must actively confirm (by ticking a checkbox) that they meet the conditions for participation in the program, have read the study information, and agree to the conditions. Finally, they must actively agree to participate in the study. Participants can download and/or print out the study information and declaration of consent immediately and/or later. Persons who unsubscribe from the health program or the study will receive an e-mail with a link to download the study information and declaration of consent.

Data protection for the study participants is guaranteed in accordance with the European General Data Protection Regulation (GDPR). Staff members involved in the project are committed to such data protection through their institutions.

A data protection concept was drawn up for this project which was approved by the data protection officer of the Medical Center – University of Freiburg. This data protection concept includes a Joint Controller Agreement (JCA) that has been accepted by the data protection officers of all project partners involved and signed at the highest management level in those institutions.

All personal data on the participants in the online RCTs will be stored and recorded separately from pseudonymized research data by the Vilua healthcare GmbH. Vilua will share only pseudonymized or aggregated research data to the SEVERA and the IfSS. One exception concerns contact details on participants in the RCT Smoking Cessation who registered for a telephone interview, which will be executed by SEVERA. This will affect approximately 15–20 people in the intervention group. A further access to contact details of a limited number of participants is necessary as part of the medical substudies, since the examinations are organized and carried out by the IfSS (details will be published elsewhere).

All participants can withdraw from their study participation or from the online health program at any time without any disadvantages. Their personal data will be deleted immediately. The research data collected up to that point will remain anonymous. No further data will be recorded.

Persons can withdraw from the study participation but still continue to engage in their specific health program. In this case, research data is no longer collected and recorded research data will be anonymized.

All surveyed data will be anonymized 3 years after study completion and completely deleted teen years after the publication of the study results.

Harms and risk

Participation in the online studies and the online health programs are not expected to cause harms or risks—especially considering the inclusion and exclusion criteria with which the users have to agree. If participants have any questions or feel uncomfortable, they can always contact the program's customer service or the study contact persons. All inquiries and possible health problems will be logged. In case of health problems, the principal medical doctor of the study (Prof. Dr. med. D. König) will be informed. The procedure for dealing with very unlikely but possible risks during the medical examinations in the two substudies has been approved by the Ethics Committee Freiburg and will be published elsewhere.

Publication rules

The main results of studies concerning the effectiveness of health programs are to be published in scientific journals. These publications will be prepared under the leadership of SEVERA, which, as the main institution responsible for evaluation, will also be responsible for data analysis. The other scientific project participants will be involved in these publications. All scientific project participants aim to publish further publications on questions of interest, for which appropriate authorships will be determined according to the usual rules.

Ethics approval and consent to participate

This study received a favorable opinion from the ethics commission of Albert-Ludwigs University, Medical Center, Freiburg (vote no. 237/19) on 25 July 2019. Based on results of a feasibility study (ethics approval No 40918, study registration in the German Clinical Trial Register DRKS-ID: DRKS00016512), an amendment with minor modification to the study protocol was rational and positively judged by the ethics commission of Albert-Ludwigs University, Medical Center, Freiburg on 22 October 2019.

Trial registration: This study is registered in the German Clinical Trials Register https://www.drks.de/drks_web/ with the registry ID DRKS00020249 at 11 December 2019. The universal Trial Number (UTN) is: U1111-1245-0273; International Clinical Trials Registry Platform http://apps.who.int/trialsearch/Trial2.aspx?TrialID=DRKS00020249

Recruiting of participants started 1 January 2020.

If, contrary to expectations, changes to the protocol were required, the following process would be initiated: amendment of the study protocol and submission to the Ethics Committee for approval, participants to be informed via the program website and by Vilua via email. To inform researchers, we would amend entries in the German Clinical Trials Register (DRKS). Finally, we would ask the editors of “BMC trials” to publicize a correction, linked to the original study protocol.

Consent for publication

Not applicable

Competing interests

The Techniker health insurance fund contracted SEVERA to plan and coordinate this overall study and to carry out the online RCTs, as well as to conduct the formative evaluation of the SmokingCessationCoaching via qualitative interviews and analyses of the usage behavior data. On the basis of the declaration of independent scientific study implementation and publication by the Techniker, IT, GM, CS, MS, MB, RA, and EF declare that they have no conflicts of interest.

JB, DK, RW, and RF (IfSS) declare that (a) the formative and summative evaluation of the TK-HealthCoach (the Increasing Fitness and Losing and Maintaining Weight health goals) is supported by the TK, that (b) content-related advice on the further development of the Increasing Fitness and Losing and Maintaining Weight health goals is supported by the TK, and that (c) the publication of the evaluation results will be supported by the TK by their covering the publication fees of the respective journals. For the aforementioned topics (a) and (b), travel expenses are included. There are no other conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tinsel, I., Metzner, G., Schlett, C. et al. Effectiveness of an interactive web-based health program for adults: a study protocol for three concurrent controlled-randomized trials (EVA-TK-Coach). Trials 22, 526 (2021). https://doi.org/10.1186/s13063-021-05470-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-021-05470-8

Keywords