Skip to main content

The Canadian Healthy Life Trajectories Initiative (HeLTI) Trial: a study protocol for monitoring fidelity of a preconception-lifestyle behaviour intervention

Abstract

Background

In evaluating technology-based behaviour change interventions, it is increasingly important to have a monitoring plan for intervention fidelity. It is important to maintain intervention fidelity to ensure that the theory-based intervention that is being tested is what causes the observed changes, particularly for eHealth behaviour change interventions. In this protocol, we outline the intervention fidelity and monitoring protocol for Healthy Life Trajectory Initiative (HeLTI) Canada, a randomized controlled trial evaluating the effect of a preconception-early childhood technology-based intervention delivered by public health nurses among pregnancy-planning women and their partners to optimize child growth and development.

Methods

The HeLTI Canada fidelity protocol is based on the National Institutes of Health Behaviour Change Consortium (NIH BCC) Treatment Fidelity Framework, outlining the following components of intervention fidelity: study design, provider training, intervention delivery, intervention receipt, and intervention enactment. The intervention fidelity components and associated monitoring strategies were developed to align with the HeLTI Canada approach. Strategies for intervention fidelity monitoring include a pre-post written evaluation of training, standardization of provider training, use and monitoring of activity logs, and intervention session checklists. Possible challenges to intervention fidelity include provider turnover due to the length of the trial and lack of ability to directly monitor participant behaviour change in real-life settings. Details about intervention fidelity monitoring are provided in detail. The study launched in January 2021 and is currently recruiting.

Discussion

Using the NIH BCC Treatment Fidelity Framework, HeLTI Canada has a robust framework for monitoring and reporting intervention fidelity to improve intervention validity, ability to assess intervention effectiveness, and transparency.

Trial registration

ISRCN ISRCTN13308752. Registered on February 29, 2019.

Peer Review reports

Introduction

Over the past 25 years, there has been rapid growth in digital and mobile health technology, facilitating a rise in technology-based interventions targeting change in health behaviours, such as diet, exercise, and sleep [1]. Technology-based interventions can offer advantages over traditional, in-person interventions, such as increased accessibility and convenience for participants, reduced cost, and the ability to tailor based on individual needs. However, they can also present challenges such as a lack of face-to-face intervention, lower uptake and adoption, and technological difficulties.

Due to the unique implementation factors in technology-based behavioural interventions, intervention fidelity monitoring is of particular importance. Intervention fidelity refers to the methodological strategies and practices used to monitor, enhance, and evaluate the reliability and validity of behavioural interventions [2]. It is important to maintain intervention fidelity to ensure that the theory-based intervention that is being tested is what causes the observed changes.

Despite the importance of fidelity in behavioural interventions, many behavioural trials do not report intervention fidelity protocols or outcomes [3], although existing protocols are available as guidance [4, 5]. A systematic review found that less than 5% of studies reported any treatment fidelity data [6]. This paucity of information on intervention fidelity reporting and fidelity protocol development contributes to the difficulty in the replication and translation of results into practice [2]. Therefore, the purpose of this paper is to describe the intervention fidelity protocol adopted by Healthy Life Trajectory Initiative (HeLTI) Canada, a randomized controlled trial evaluating a preconception-early childhood telephone-based intervention with tailored eHealth resources for women and their partners to optimize growth and development among children in Canada [7]. The protocol was developed using the National Institutes of Health (NIH) Treatment Fidelity Framework, designed by the Behaviour Change Consortium (BCC) [2].

Methods

HeLTI Canada overview

The Healthy Life Trajectories Initiative (HeLTI) was developed in partnership with funders from Canada, India, China, and South Africa and in collaboration with the World Health Organization to address the increasing burden of non-communicable diseases (NCDs)—including obesity, diabetes, cardiovascular disease, and poor mental health—around the world. There are four separate but harmonized intervention studies implemented in Soweto, Mysore, Shanghai, and all across Canada. All projects are focused on developing evidence-based interventions that span from preconception across pregnancy and into the postnatal period with the goal of improving maternal, infant and child health, and ultimately the life-long well-being of the child.

The HeLTI Canada study will recruit 5230 women planning a pregnancy within the next 3 years, their partners (if applicable), and their child aged 3 to 12 months (if applicable) across Canada to evaluate whether the 4-phase ‘preconception to early childhood’ life course intervention (preconception, pregnancy, infancy, and early childhood) can, among children born in the trial, at age 5 years: (1) reduce overweight and obese status, (2) reduce zBody Mass Index (zBMI) and improve zBMI trajectories, (3) reduce adiposity, (4) improve cardiometabolic risk factors, (5) enhance development and school readiness, and (6) improve health behaviours including nutrition, physical activity, screen time, and sleep [7]. It will also examine the impact of the intervention on parental outcomes across time. Ethics approval was obtained by St. Michael’s Hospital (Research Ethics Board [REB]# 18–309) and the University of Alberta (REB# 000,092,107).

The HeLTI Canada intervention, with its foundation on public health and primary care platforms and eHealth technologies, takes a ‘cumulative impact’ approach designed to improve health behaviours and reduce modifiable risk factors that influence child obesity. The intervention starts before conception and continues through to early childhood. It is evidence-based, professionally facilitated, proactive, individualized, multifaceted, and sex- and gender-specific, and it builds on existing research and clinical resources while recognizing the growing trend of e-Health [8]. Local public health nurses participate in providing the intervention to ensure it is tailored to local circumstances. Two core strategies will be used throughout the 4 phases: (1) telephone-based collaborative care provided by a HeLTI nurse and (2) HeLTI Canada website with individualized webpage and eHealth resources based on participant needs. Telephone contacts will last 15 to 45 min, based on individual needs. This monitoring will facilitate the early detection of risks that can be targeted. Evidence-based eHealth resources selected by HeLTI Canada co-investigators and experts for targeting health behaviours (e.g. nutrition, physical activity, sleep) and health risks (e.g. depression, smoking cessation, parenting stress) will be easily accessible on a mobile device, tablet, or computer and will enable us to provide innovative and engaging support to participants with diverse health issues.

Intervention fidelity protocol

The NIH Treatment Fidelity Framework, designed by the BCC [2], has been used to explore the quality of fidelity reporting in health behaviour fields and across behaviour change research. The NIH Treatment Fidelity Framework proposes that the five domains of intervention fidelity listed below are necessary when reporting the results of behavioural intervention trials: (1) study design (e.g. how an intervention was intended to be delivered and includes theoretical frameworks, intended dose, intended content and intended qualifications of intervention providers), (2) intervention provider training (e.g. what specific methods will be used to train providers and maintain provider skills throughout the intervention, (3) intervention delivery (e.g. how well the providers adhere to the intended intervention and includes information about actual dose and content delivered, (4) intervention receipt (e.g. how well the intervention addresses participants’ comprehension of and ability to use learned skills during intervention the intervention period), and (5) intervention enactment (e.g. participants’ ability to use these skills and implement their plans outside of formal intervention sessions).

The following sections outline the five areas of fidelity and the corresponding protocols developed for the HeLTI Canada study (May 2022, version 1). In addition to the development of intervention fidelity protocols, a fidelity monitoring plan (Table 1) was also developed to ensure adherence to the fidelity protocols. Because fidelity strategies are only effective if rigorously implemented, the monitoring plan is intended to ensure the fidelity strategies developed are consistently executed throughout the duration of the study. We used the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) reporting guidelines [9] and is outlined in Table 2.

Table 1 Overview of HeLTI Canada fidelity monitoring plan
Table 2 Schedule of enrolment, interventions, and assessments for HeLTI Canada fidelity outcomes

Domain 1: Intervention fidelity strategies to monitor study design

Intervention fidelity practices related to study design are intended to ensure that a study can adequately test its hypotheses in relation to its underlying theory and clinical processes [2]. According to the NIH Treatment Fidelity Framework, intervention fidelity goals in this category (see Table 1) include establishing procedures outlined below.

Ensure the same intervention dose within conditions

This goal reflects the need to ensure that the intervention ‘dose’ (i.e. number, frequency, and length of contact) is adequately described and is the same for each participant within each arm. A HeLTI Canada intervention manual and a HeLTI Canada nurse training manual have been developed by the HeLTI Canada co-investigators team for use in telephone sessions and will be reviewed on an ongoing basis as needed. Intervention information is outlined in a checklist for each session, as well as in the intervention manual. Included in these manuals are Collaborative Care Scripts which provide scripts for the first contact with a participant, active intervention contact, and continuation intervention contact for each of the four study phases. Intervention activity logs, session checklists, and fidelity checklists have been developed to ensure the intervention is standardized and consistently provided to all trial participants in the intervention group, independent of the HeLTI nurse. Due to the nature of this collaborative care intervention, a fixed length, number, or frequency of intervention cannot be stipulated upfront, given that it is according to the participant’s needs and desires. It is expected to be diverse. However, all information regarding the number, length, and frequency of intervention sessions will be recorded for each, and any deviations from the protocol will be captured. These documents will also be used to ensure intervention fidelity and to determine intervention dosage.

Ensure equivalent dose across conditions

This goal reflects the need to ensure that the intervention dose is the same across conditions, such as having an equal number of contacts, the same length of time, and using the same type of information during each contact. The trial coordinator will monitor the intervention sessions via bi-weekly report checks and messages posted on the discussion board that allows the trial coordinator to verify that the intervention is being conducted with the appropriate frequency and provide feedback to the HeLTI nurse who inputted the information. A random 10% sample of all active participant logs is chosen for a bi-monthly audit that provides insight into whether behaviour change techniques are being emphasized by the nurses. At the participant level, the resources available to participants on the HeLTI Canada App are monitored annually to ensure behaviour change techniques are incorporated into the intervention. Adherence to these fidelity measures is also actively monitored through monthly intervention fidelity group sessions between the HeLTI Nurses and the HeLTI Canada team, including the HeLTI Canada lead principal investigator and the lead trainers of the HeLTI Canada intervention.

Plan for implementation setbacks

Planning for study design implementation setbacks allows investigators to remedy any deviations from the original study design. In HeLTI Canada, the nurses are the main mechanism by which the intervention is delivered. Therefore, the primary fidelity strategy developed is to hire and train several highly experienced public health nurses to mitigate any potential implementation setbacks that may arise from telehealth coach transition, sick leave, or vacation. Training extra providers beyond those needed ensures availability to re-assign current participants or to assign newly recruited participants avoiding needing to train new providers in a hurry. Additionally, consideration for ongoing hiring of public health nurses will be considered depending on the number of nurses who may exit the study to allow sufficient time to train new nurses. An exit interview will be conducted by the trial coordinator to understand attrition among the HeLTI nurses who leave the trial.

Domain 2: Fidelity strategies to monitor provider training

An important area of intervention fidelity is assessing and improving the training of providers to ensure that they have been satisfactorily prepared to deliver the intervention to study participants [2]. The adequacy of training to implement the intervention needs to be evaluated and monitored on an individual basis both during and after the training process. General strategies in this category include standardizing training, measuring skill acquisition by providers, and having procedures in place to prevent drift in skills over time (see Table 3).

Table 3 Fidelity of study design strategies and monitoring plan for HeLTI Canada (domain 1)

Standardized provider training

It is important that training is given to providers in a similar manner to boost provider training fidelity. All HeLTI Canada public health nurses will be trained in Healthy Conversation Skills (HCS) prior to engaging with any participants. The HCS is an engagement strategy based on a social-cognitive model of health behaviour, which emphasizes the role of increasing confidence in promoting behaviour change [10]. It is based on the understanding that providing participants with knowledge alone is insufficient to change behaviour unless they are also motivated and empowered to change. Its focus of Making Every Contact Count is about recognizing opportunities to talk to people about their well-being using the skills of asking and listening. HeLTI nurses will use their skills to explore the barriers that participants in the intervention group have to change their behaviour and ways of overcoming these barriers and setting goals for change. This approach appears more effective than comparable forms of counselling in eliciting behaviour change [11], where even brief interactions can be effective in producing small but important changes in behaviour [12].

In HeLTI Canada, detailed job descriptions are developed to ensure performance criteria can be monitored. All HeLTI Canada nurses are trained in a group setting with a detailed training manual developed and distributed. The manual outlines the study goals, objectives, and design as well as proper intervention delivery and essential skills and training. Training of HeLTI nurses in HCS follows a manual developed by the Medical Research Council (MRC) Lifecourse Epidemiology Unit and consists of a structured 2-day session with supervision for the first 6 months. The same master trainers will be used as much as feasible to ensure the training is provided consistency to all newly hired nurses. Additionally, telephone support from HeLTI Canada Office is available as needed for consultation and support and a HeLTI nurse listserv is available to provide peer support. Training records are kept, ensuring each provider completes all training.

Ensure provider skill acquisition

Training provides the foundation for initial skill development and ensuring skill acquisition is necessary to ensure providers provide the intervention as designed. The main skills needed in HeLTI Canada are HCS and the use of evidence-based behaviour change techniques to assist participants with behaviour change. Several strategies are built into HeLTI to solidify skill acquisition including role-playing and walking through potential scenarios that may arise during telephone sessions. Follow-up refresher training will occur after 6 months of intervention initiation and as needed thereafter. Problem-solving sessions and debriefing will occur during follow-up training and via the HeLTI nurse listserv. This portion of the fidelity protocol is monitored via monthly intervention fidelity group sessions and bi-monthly audits of the intervention logs. In the event an audit reveals a lack of skill acquisition, the principal investigator (PI) is notified and can assist coaches with additional training as needed.

The web-based app is also a core element of the intervention. This tool will offer easy access to the eHealth resources recommended by the public health nurse and individualized to the participant’s risks and goals. The resources were selected by a team of co-investigators and experts and evaluated using published validated evaluation tools (i.e. Mobile Application Rating Scale (MARS) or DISCERN checklists) to ensure the quality of the information [13] with feedback obtained from nurses and participants. This process of resource selection and revision will be performed systematically and constantly throughout the full duration of the intervention. In the case of the emergence of new valid tools, we can easily include these tools and make them available to the participants.

Minimize ‘drift’ in provider skills

This goal is to ensure that HeLTI Canada nurses do not lose their skills over time. Due to the length and intensity of the intervention (between preconceptions to when the child born in the study is 5 years old), monitoring nurses’ skills over time is critical to ensure the intervention is implemented consistently. HeLTI Canada includes preventive measures to prevent provider drift such as self-monitoring and team collaboration. Nurses are expected to self-monitor their skills using the telephone session checklists described above. The bi-weekly review of the intervention logs also acts as a barrier to drift allowing the PI to assess provider skills throughout the data collection period. Monthly intervention fidelity group sessions occur to discuss intervention issues and reinforce activities. As mentioned above, follow-up training will occur as recommended and required. The HeLTI trial coordinator and programme managers will be available (email, text, telephone) to provide overall support and provide assistance with emergency situations or when safety protocols are triggered. In addition to the written pre-post evaluation of the HCS skills and impact immediately after training, a 1-year follow-up evaluation of how HCS is being implemented in practice is planned.

Accommodate provider differences

Because differences such as professional background and previous experience can affect the way study staff implement an intervention, the NIH BCC recommends building measures to ensure provider training is adequate and appropriate based on their individualized level and skill. Within HeLTI Canada, the standardized training previously mentioned allows for the specific skills required for intervention delivery to be honed and accentuated within providers regardless of inherent differences. All HeLTI Canada nurses have received training as mentioned above, and all HeLTI intervention providers are registered nurses with a degree background with a minimum of 5–10 years of public health nursing experience in the province of Ontario or Alberta. Thus, an effort has been taken to minimize intervention-provider differences. HeLTI Canada nurses are also asked to complete a self-report satisfaction questionnaire to understand their comfort level and confidence with intervention implementation.

Domain 3: Fidelity strategies to monitor intervention delivery

Intervention fidelity processes that monitor and improve the delivery of the intervention so that it is provided as intended are essential [2]. General goals in this category include using procedures to standardize delivery and checking for protocol adherence (see Table 4).

Table 4 Monitoring provider training for HeLTI Canada (domain 2)

Control for provider differences

Differences between nurses have the potential to influence participant behaviour. Work style, credibility, or personality differences may inadvertently affect participant treatment adherence. In order to account for this, all participants will complete a ‘satisfaction with HeLTI Canada intervention’ questionnaire 3 months into each new phase. Included in this questionnaire is a therapeutic alliance measure. Provider differences that may influence treatment delivery can be pointed out and addressed in ongoing staff trainings. Additionally, a participant feedback protocol has been developed. All of this will be accounted for in data analysis.

Reduce differences within treatment

To reduce differences within the intervention, a comprehensive training manual with scripts for the first contact with a participant, active intervention contact, and continuation intervention contact for each of the four study phases has been developed and distributed to all HeLTI Canada nurses, as mentioned above. Session checklists have been developed to guide intervention activities and will be monitored through bi-monthly reports by the trial coordinator, as well as the activity logs. Should the activity logs reflect deviation from the intervention protocol, the intervention provider will receive appropriate feedback and additional training if necessary. The discussion board and the monthly intervention fidelity group session will also ensure adherence to these fidelity measures.

Ensure adherence to the treatment protocol

Several strategies are in place to ensure participants receive the treatment dose and content as designed. Session checklists have been developed to guide intervention delivery and content (Table 5). Activity call logs will be reviewed for intervention adherence and log completion by the trial coordinator. Call logs ensure that all participants are receiving equivalent number and frequency of calls by tracking the dates and times of scheduled interactions as well as coach adherence to the missed call protocol. The checklists and call logs are audited monthly. Additionally, HeLTI nurses’ notes will be reviewed by the trial coordinator for non-specific intervention effects.

Table 5 Monitoring intervention delivery for HeLTI Canada (domain 3)

Minimize contamination between the groups

In terms of minimizing contamination between the groups, the HeLTI Canada intervention is not available publicly, so the risk of contamination is low. The intervention is telephone-based with eHealth resources that are specifically provided to participants via a secure web-based app. Because HeLTI is an individual-level intervention carried out within the digital environment, the chances of participants from different treatment groups interacting are less than in traditional clinic-based interventions.

Domain 4: Intervention fidelity strategies to monitor intervention receipt

Receipt of intervention involves monitoring and improving the participant’s ability to not only understand but also act on behaviour changes skills provided during the intervention (Table 6). Participant receipt of treatment is crucial for technology-based studies. Unlike clinic-based behavioural interventions where participants regularly engage in face-to-face contact with providers, telehealth involves minimal in-person contact, and many interactions rely on written or verbal communication where providers may miss non-verbal cues of comprehension. HeLTI Canada will take the following strategies to monitor participant uptake.

Table 6 Monitoring receipt of intervention for HeLTI Canada (domain 4)

Ensure participant comprehension

Study outcomes should ideally be interpreted under the assumption that all participants fully understood what was being asked of them during the intervention. Strategies to ensure participant comprehension of treatment protocols increase the likelihood that participant outcomes reflect the effectiveness or ineffectiveness of the treatment, rather than a product of variances in participant comprehension. The HCS approach underpins the HeLTI Canada intervention and is inherently based on using tools to support and empower women and their families to plan for change. This approach recognizes that individuals coming up with their own solution are more likely to take ownership of it. The HCS uses the Making Every Contact Count approach, an evidence-based methodology to improve individuals’ health and well-being by helping them change their behaviour. Rather than telling people what to do, Making Every Contact Count is about recognizing opportunities to talk to people about their well-being using the skills of asking and listening. It is then about empowering people to seek out their own solutions to supporting their own health and well-being. Therefore, at each contact with participant, participant comprehension is assessed and ensure understanding to move forward with their goal as decided on by themselves.

Ensure participant’s ability to use cognitive skills

Behavioural interventions such as HeLTI Canada encourage participants to employ cognitive skills such as problem-solving, goal setting, and action planning to meet their goals. The use of HCS enables nurses to gauge participants’ ability to use these cognitive skills through the use of open-ended questions and participant-led goal-setting. HeLTI nurses will provide structured sessions at specified time periods to assist participants to achieve their goals. HeLTI nurses will use exploratory questions to guide the participant to problem-solve barriers and identify solutions to overcome obstacles to achieving goals. Indicators of inadequate cognitive skills include participants setting vague or ambiguous goals, continual failure to meet goals, resistance to goal progression, or ongoing reporting of the same barriers to goal achievement. Participants rate how confident they are in achieving their goals at the beginning and end of the session. Detailed confidential notes taken by nurses after each phone call also serve as a fidelity strategy to ensure participant utilization of these cognitive skills. These narrative notes provide space for nurses to analyse the participant’s progress and are a valuable source of qualitative data that can be used to interpret participant outcomes.

Ensure participant’s ability to perform behavioural skills

Several behavioural skills are needed to successfully participate in the HeLTI study. Participants are expected to engage with technology daily, participate in regular exercise, and understand and engage with other activities throughout the study period. The online and telephone-based study design presents challenges to ensuring participant’s ability to perform all behavioural skills since actual observations of participant’s daily behaviour are outside the scope of the study design. Participant ability is continually assessed throughout the duration of the study by regular reviews of nurses’ notes. Additionally, participants co-develop their goals with the nurses and rate their confidence in their ability to achieve these goals in each session.

Domain 5: Intervention fidelity strategies to monitor enactment of intervention skills (Table 7 )

Table 7 Monitoring enactment of intervention skills for HeLTI Canada (domain 5)

The final domain refers to the performance of learned skills that result in behaviour change in real-life settings to evaluate participants’ actual performance of skills in the intended situations and at the appropriate time [2]. HeLTI Canada will evaluate this domain using the following approaches.

Ensure participants’ use of cognitive skills

As previously discussed, cognitive skills such as problem-solving, goal-setting, and action planning are emphasized to help participants meet their goals. The main way adherence to these cognitive skills is assessed is through telephone sessions. Goals are reviewed with the participant, and progression is discussed at each session. Activity logs document all participant interaction with HeLTI nurses and discrepancies between participant’s verbalized intentions to utilize cognitive skills, and their actual use of cognitive skills can be addressed as needed during the coaching sessions. Selected eHealth resources are provided in individualized participant webpages in the HeLTI Canada mobile app and website. The frequency of the calls permits nurses to follow up with participants in a timely manner regarding any new strategies or goals expressed by participants in previous phone calls.

Ensure participant’s use of behavioural skills

Similar to monitoring cognitive skills, regular telephone calls are one of the main strategies in place to ensure participants use behavioural skills. At the beginning of each phase, a detailed risk assessment is completed to determine participant progress in behaviour change and the need for continued or new goals. Activity logs are continued from each session to the next to track changes and the use of new behavioural skills. Online questionnaires (conducted through REDCap) are linked to phase goals to monitor specific behaviour change and intervention effectiveness will be completed at specified follow-up time points by participants in both intervention and control groups. In addition to self-monitoring, participants are asked to engage with the technology provided and utilize the behaviour change resources distributed. Periodic checks of participant logins to the online platforms, as well as the time spent in various sections of the platform, provide insight into participant engagement with these resources.

Discussion

Assessing intervention fidelity is important when determining the effectiveness of technology-based behavioural interventions given the inherent variability within and across interventions. This paper provides an overview of the intervention fidelity protocol for HeLTI Canada, an ongoing randomized controlled trial of a technology-based behavioural intervention delivered by nurses from preconception to when the child born in the trial is 5 years old.

Intervention fidelity monitoring within technology-based interventions should be planned from the outset while acknowledging that fidelity strategies may need to be adapted if they are proving ineffective. Strengths of the current intervention fidelity approach include regular and ongoing monitoring of intervention providers (i.e. HeLTI nurses), using a standardized approach to intervention provision and training using a well-established Healthy Conversation Skills approach, and ongoing tracking of intervention fidelity. For example, one advantage of technology-based interventions is the potential to facilitate fidelity monitoring, which can lead to increased protocol adherence. In HeLTI Canada, participant sessions are tracked as they occur as are all other contacts between the HeLTI nurse and participant allowing for easier review of treatment dose. Furthermore, embedding HeLTI nurse call checklists within the REDCap platform can improve fidelity by ensuring that important content is discussed during each contact.

Possible challenges to intervention fidelity during HeLTI Canada included potential high provider turnover due to the length of the trial and lack of ability to directly monitor behaviour change in real-life settings. Both of these challenges were likely exasperated during the COVID-19 pandemic due to the high burnout and work-related stress among nurses [14] as well as ongoing challenges with in-person assessment. However, a strength of the HeLTI Canada intervention during the COVID-19 pandemic is that the intervention is provided primarily through technology, including telephone calls and web-based intervention, minimizing disruption to the intervention itself.

The benefit of monitoring intervention fidelity during an ongoing behaviour change trial ensures that the intervention is provided consistency throughout, rather than noting intervention drift at the end of the trial. Given that HeLTI Canada is a multi-year study, it is essential to have these strategies in place to ensure that investigators take necessary steps along the way to remedy any deviations from the protocol.

Trial status

Recruitment began January 2021, and we anticipate recruitment will be completed in 2025.

Conclusion

Following the NIH BCC recommendation, HeLTI Canada has outlined strategies to monitor and evaluate intervention fidelity related to our technology-based behavioural intervention. Ensuring intervention fidelity requires thoughtful application with effort dedicated to the design of effective strategies that will protect the internal validity of the study. We have presented a protocol for the application of fidelity strategies in HeLTI to improve the scientific findings of our technology-based behaviour change intervention with the goal to evaluate its feasibility, acceptability, and efficacy.

Availability of data and materials

No data is available.

Abbreviations

BCC:

Behaviour Change Consortium

HeLTI:

Healthy Life Trajectory Initiative

HCS:

Healthy Conversation Skills

MARS:

Mobile Application Rating Scale

MCR:

Medical Research Council

NCD:

Non-communicable diseases

NIH:

National Institutes of Health

PI:

Principal investigator

REB:

Research ethics board

SPIRIT:

Standard Protocol Items: Recommendations for Interventional Trials

zBMI:

ZBody Mass Index

References

  1. Dugas M, Gao GG, Agarwal R. Unpacking mHealth interventions: a systematic review of behavior change techniques used in randomized controlled trials assessing mHealth effectiveness. Digital Health. 2020;6:2055207620905411. https://doi.org/10.1177/2055207620905411.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23:443–51. https://doi.org/10.1037/0278-6133.23.5.443.

    Article  PubMed  Google Scholar 

  3. Slaughter SE, Hill JN, Snelgrove-Clarke E. What is the extent and quality of documentation and reporting of fidelity to implementation strategies: a scoping review. Implementation Science. 2015;10:129. https://doi.org/10.1186/s13012-015-0320-3.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Sineath A, Lambert L, Verga C, Wagstaff M, Wingo BC. Monitoring intervention fidelity of a lifestyle behavioral intervention delivered through telehealth. mHealth. 2017;3:35–35.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Devito Dabbs A, Song M-K, Hawkins R, Aubrecht J, Kovach K, Terhorst L, et al. An intervention fidelity framework for technology-based behavioral interventions. Nurs Res. 2011;60:340–7.

    Article  PubMed  Google Scholar 

  6. Shingleton R, Palfai T. Technology-delivered adaptations of motivational interviewing for health-related behaviors: a systematic review of the current research. Patient Educ Couns. 2016;99:17–35.

    Article  PubMed  Google Scholar 

  7. Dennis CL, Marini F, Dick JA, Atkinson S, Barrett J, Bell R, et al. Protocol for a randomised trial evaluating a preconception-early childhood telephone-based intervention with tailored e-health resources for women and their partners to optimise growth and development among children in Canada: a healthy life trajectory. In BMJ Open. 2021;11:1–12.

    Article  Google Scholar 

  8. Edwards N, Mill J, Kothari AR. Multiple intervention research programs in community health. Can J Nurs Res. 2004;36:40–54 https://pubmed.ncbi.nlm.nih.gov/15133918/.

    PubMed  Google Scholar 

  9. Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin J, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. Br Med J. 2013;346:1–42.

    Article  Google Scholar 

  10. Bandura A. Self-efficacy: the exercise of control. New York: W.H. Freeman and Company; 1997.

    Google Scholar 

  11. Lundahl BW, Burke BL. The effectiveness and applicability of motivational interviewing: a practice-friendly review of four meta-analyses. J Clin Psychol. 2009;65:1232–45.

    Article  PubMed  Google Scholar 

  12. McCambridge J, Strang J. The efficacy of single-session motivational interviewing in reducing drug consumption and perceptions of drug-related risk and harm among young people: results from a multi-site cluster randomized trial. Addiction. 2004;99:39–52.

    Article  PubMed  Google Scholar 

  13. Vanderloo LM, Carsley S, Agarwal P, Marini F, Dennis CL, Birken C. Selecting and evaluating mobile health apps for the healthy life trajectories initiative: development of the eHealth resource checklist. JMIR mHealth uHealth. 2021;9:1–8.

    Article  Google Scholar 

  14. Sriharan A, Ratnapalan S, Tricco AC, Lupea D. Women in healthcare experiencing occupational stress and burnout during COVID-19: a rapid review. BMJ Open. 2021;11:e048861. https://doi.org/10.1136/bmjopen-2021-048861.

Download references

Funding

This work was supported by the Canadian Institutes of Health Research (CIHR), grant number HLC-154502. The funders did not have a role in the study design.

Author information

Authors and Affiliations

Authors

Contributions

The authors read and approved the final manuscript. Conceptualization: C-LD, CB, and RCB. Data curation: FM. Formal analysis: N/A. Funding acquisition: C-LD and CB. Investigation: FM. Methodology: C-LD, CB, RCB, AP, and FM. Project administration: FM, C-LD, and CB. Resources: C-LD. Software: N/A. Supervision: C-LD, CB, and RCB. Validation: C-LD. Visualization: C-LD, FM, AP, and JD. Writing—original draft preparation: C-LD, FM, and AP. Writing—review and editing: C-LD, CB, RCB, AP, FM, and JD.

Corresponding author

Correspondence to Cindy-Lee Dennis.

Ethics declarations

Ethics approval and consent to participate

Ethics approval was obtained by St. Michael’s Hospital (REB# 18–309) and the University of Alberta (REB# 000092107). Written, informed consent to participate will be obtained from all participants.

Consent for publication

N/A.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dennis, CL., Marini, F., Prioreschi, A. et al. The Canadian Healthy Life Trajectories Initiative (HeLTI) Trial: a study protocol for monitoring fidelity of a preconception-lifestyle behaviour intervention. Trials 24, 262 (2023). https://doi.org/10.1186/s13063-023-07271-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-023-07271-7

Keywords