Skip to main content
  • Study protocol
  • Open access
  • Published:

Enhancing COVID Rehabilitation with Technology (ECORT): protocol for an open-label, single-site randomized controlled trial evaluating the effectiveness of electronic case management for individuals with persistent COVID-19 symptoms

Abstract

Background

As of May 2022, Ontario has seen more than 1.3 million cases of COVID-19. While the majority of individuals will recover from infection within 4 weeks, a significant subset experience persistent and often debilitating symptoms, known as “post-COVID syndrome” or “Long COVID.” Those with Long COVID experience a wide array of symptoms, with variable severity, including fatigue, cognitive impairment, and shortness of breath. Further, the prevalence and duration of Long COVID is not clear, nor is there evidence on the best course of rehabilitation for individuals to return to their desired level of function. Previous work with chronic conditions has suggested that the addition of electronic case management (ECM) may help to improve outcomes. These platforms provide enhanced connection with care providers, detailed symptom tracking and goal setting, and access to relevant resources. In this study, our primary aim is to determine if the addition of ECM with health coaching improves Long COVID outcomes at 3 months compared to health coaching alone.

Methods

The trial is an open-label, single-site, randomized controlled trial of ECM with health coaching (ECM+) compared to health coaching alone (HC). Both groups will continue to receive usual care. Participants will be randomized equally to receive health coaching (± ECM) for a period of 8 weeks and a 12-week follow-up. Our primary outcome is the WHO Disability Assessment Scale (WHODAS), 36-item self-report total score. Participants will also complete measures of cognition, fatigue, breathlessness, and mental health. Participants and care providers will be asked to complete a brief qualitative interview at the end of the study to evaluate acceptability and implementation of the intervention.

Discussion

There is currently little evidence about the optimal treatment of Long COVID patients or the use of digital health platforms in this population. The results of this trial could result in rapid, scalable, and personalized care for people with Long COVID which will decrease morbidity after an acute infection. Results from this study will also inform decision making in Long COVID and treatment guidelines at provincial and national levels.

Trial registration

ClinicalTrials.gov NCT05019963. Registered on 25 August 2021.

Peer Review reports

Administrative information

Note: The numbers in curly brackets in this protocol refer to Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist item numbers. The order of the items has been modified to group similar items (see http://www.equator-network.org/reporting-guidelines/spirit-2013-statement-defining-standardprotocol-items-for-clinical-trials/).

Title {1}

Enhancing COVID Rehabilitation with Technology (ECORT): Protocol for an open-label, single site randomized controlled trial evaluating the effectiveness of electronic case management for individuals with persistent COVID-19 symptoms.

Trial registration {2a and 2b}.

ClinicalTrials.gov NCT05019963

Protocol version {3}

Version 23 Feb 2022

Funding {4}

This study is funded by the Canadian Institutes of Health Research (CIHR). The funders have no role in the design or conduct of the study or the decision to publish results.

Author details {5a}

(1) Clinical Epidemiology Program, Ottawa Hospital Research Institute (2) Department of Psychiatry, University of Ottawa (3) Department of Mental Health, The Ottawa Hospital, (4) Department of Surgery, The Ottawa Hospital (5) Ontario Workers Network, The Ottawa Hospital (6) Ottawa, Canada (7) Division of Infectious Disease, University of Ottawa (8) School of Epidemiology and Public Health, University of Ottawa (9) Department of Medicine, University of Ottawa (10) Centre of Infection, Immunity, and Inflammation, University of Ottawa (11) Department of Pharmacy, The Ottawa Hospital (12) School of Pharmaceutical Sciences, University of Ottawa (13) Division of Physical Medicine and Rehabilitation, University of Ottawa (14) Bruyère Research Institute (15) Parkinson’s Disease and Movement Disorders Center, Division of Neurology, Department of Medicine, The Ottawa Hospital (16) Neuroscience Program, Ottawa Hospital Research Institute (17) University of Ottawa Brain and Mind Research Institute (18) Department of Psychology, The Ottawa Hospital (19) School of Psychology, University of Ottawa (20) Public Health Agency of Canada (21) Department of Medicine, The Ottawa Hospital (22) Department of Biochemistry, Microbiology and Immunology, University of Ottawa

Name and contact information for the trial sponsor {5b}

Trial Sponsor: Ottawa Hospital Research Institute (OHRI)

Contact name: Dr. Duncan Stewart

Address: 501 Smyth Road, Ottawa, ON K1H 8L6

Telephone: (613) 798-5555, ext.79017

Email: djstewart@ohri.ca

Role of sponsor {5c}

The sponsor (OHRI) had no role in the design of this study and will not have any role during its execution, analyses, interpretation of the data, or decision to submit results.

Introduction

Background and rationale {6a}

In March 2020, the World Health Organization (WHO) declared the novel coronavirus (COVID-19) a global pandemic. At the time of writing this protocol in February 2022, Ontario had confirmed more than 628,000 cases of SARS-CoV-2 since testing began. Most recently, estimates in May 2022 show this number has climbed to 1.3 million cases [1]. For most of these patients, symptoms resolve within 4 weeks of onset. However, it is becoming apparent that a significant subset of infected patients are experiencing symptoms that persist long after the typical course of acute viral infection. These individuals experience a wide constellation of symptoms, with variable intensity over time and often varying from initial acute presentation [2,3,4,5,6]. Currently, the prevalence and duration is not clear, nor is there evidence on the best course of rehabilitation for individuals to return to their desired level of function.

What is post-COVID syndrome?

The National Institute for Healthcare and Excellence (NICE) defines two distinct groups: ongoing symptomatic COVID (symptoms for 4–12 weeks) and post-COVID syndrome, which describes those with ongoing symptoms, not better explained by another diagnosis, for 12 weeks or longer [7]. The most common symptom experienced is persistent fatigue, followed by dyspnea, cognitive issues such as “brain fog” and cardiothoracic issues [2, 5, 6, 8]. Other symptoms include headaches, muscle and joint pain, persistent cough, and psychiatric conditions [2, 6, 8, 9]. An early study found that nearly half of the sample had also experienced a decrease in their quality of life [6]. It is unclear who is most at risk for developing post-COVID syndrome. While severe illness or long time to acute recovery is predictably associated with poor long-term outcomes, more than 35% of individuals with mild illness failed to return to baseline health status [10]. Women [2, 4] and ethnic minorities [11] may also be at higher risk. Previous research from the SARS pandemic also suggests that social disadvantage, such as job loss or social stigma, were also risk factors for long-term symptoms [12]. The heterogeneous nature of symptoms and risk factors suggest that an “organ-based” or classification approach will not provide optimal outcomes for these patients. An integrated model for rehabilitation, including interdisciplinary care, enhanced case management, and screening tools, should be examined [13, 14].

Nomenclature

There are at least four terms employed to describe persistent COVID symptoms, including “Long COVID,” “COVID-19 syndrome,” “post COVID-19 syndrome,” or “post-acute sequelae of SARS-CoV-2 infection” [2]. We have chosen to refer to the condition as Long COVID as this seems to be the term most preferred by patients [15].

Case management in COVID-19 rehabilitation

Previous work with chronic conditions has suggested that using digital health platforms can improve outcomes [16, 17]. These platforms usually have a patient facing app and a clinician facing dashboard and allow personalization of information and resources to the user; the tracking of symptoms, often assisted by the smartphone’s biometric sensors; contain educational resources; allow for goal setting and monitoring; facilitate collaborative care; and, create a connection between the patient and their clinician [18]. Although the size of the effect varies by condition and intervention [16, 17], these platforms are often low burden to disseminate and adaptable to individual schedules and may increase access to specialized care to patients across rural and remote regions.

Despite the explosion in e-health and coaching platforms available, a recent systematic review found there were few high-quality trials examining the effectiveness of the intervention or its individual components [19]. These platforms have been used across multiple disorders including diabetes [20,21,22], mental health [23,24,25], and cancer recovery [26, 27]. These e-health platforms also offer the opportunity for improved communication between the patient, caregivers, and care providers, increasing both understanding of and adherence to treatment protocols [18, 25, 28, 29]. In the case of Long COVID, the addition of a case management platform may prove particularly beneficial. As information is changing rapidly, patients may have more questions about their health concerns and their treatment plan. With electronic case management, clinicians can readily push new resources and information to patients and offer caregivers a more meaningful role.

Rationale

The most comprehensive relevant guideline regarding Long COVID is the NICE “COVID-19 rapid guideline; managing the long-term effects of COVID-19” published in December 2020 [7]. The guideline made key recommendations for research including “What is the clinical effectiveness of different service models of multimodality/multidisciplinary post-COVID-19 syndrome rehabilitation in improving patient-reported outcomes (such as quality of life).” The NICE guideline also recommended that patients use symptom diaries or a tracking app to monitor their goals, recovery, and any changes in their symptoms. This proposal directly addresses this recommendation, as the NICE guidelines provide no research to support this approach [7]. We aim to utilize these recommendations to evaluate what possible service models incorporating electronic case management (ECM) will improve outcomes in this population.

Objectives {7}

Primary objective

The primary objective of this trial is to determine if adding ECM with health coaching to usual care improves participant quality of life after 3 months for patients who present to hospital outpatient clinics experiencing Long COVID.

We hypothesize that adding ECM with health coaching to usual care will improve outcomes at 3 months compared to usual care alone.

Secondary objectives

The key secondary objectives of this study are to determine (1) the cost-effectiveness of adding ECM to usual care for Long COVID patients; (2) what factors predict outcomes at 3 months in patients with Long COVID; (3) if the addition of ECM affects Long COVID symptoms; and (4) how a personalized rehabilitation program supported by a digital platform could be implemented for individuals with Long COVID.

We hypothesize that adding ECM to usual care will be cost-effective from a public-payer’s perspective. We also hypothesize that people with Long COVID who had severe acute COVID infections, adverse childhood experiences, recent negative life events, or a strong sense of injustice at baseline will have poorer outcomes at 3 months. Lastly, we hypothesize that those with ECM will show more improvement across outcome measures at 12 weeks.

Following the Medical Research Council guidance on developing and evaluating complex interventions [30], we will conduct a process evaluation guided by the RE-AIM implementation framework [31].

Trial design {8}

The proposed study is a 12-month open-label, parallel group, randomized controlled trial. Participants will be allocated 1:1 into either electronic case management (ECM+) with health coaching plus usual care or health coaching plus usual care alone (HC). Due to the nature of the intervention, it will not be possible to blind clinicians or patients to the allocation.

Methods: participants, interventions, and outcomes

Study setting {9}

This single-site study will be conducted at the Ottawa Hospital Research Institute (OHRI). Recruitment will occur through two different streams to increase the diversity of participants. The first stream is a clinic that sees Ontario workers who were infected by SARS-CoV-2 at their worksite, who have made a claim to the Ontario Workplace Safety and Insurance Board (WSIB) and are assessed by the Ontario Workers Network (OWN) based at The Ottawa Hospital (TOH). The second stream are clinics within TOH which are seeing patients with Long COVID. These are clinics specifically for people with Long COVID, for example within the rehabilitation service, or specialist clinics that are seeing people with Long COVID such as respirology, infectious diseases, or psychiatry.

Eligibility criteria {10}

Participants will be recruited from TOH. Participants will be approached by an individual in their circle of care if they meet the eligibility criteria outlined in Table 1.

Table 1 Eligibility criteria

COVID-19 testing eligibility

Effective December 30, 2021, the government of Ontario significantly restricted the eligibility for PCR testing. The general public is no longer eligible for symptomatic PCR testing (https://news.ontario.ca/en/backgrounder/1001387/updated-eligibility-for-pcr-testing-and-case-and-contact-management-guidance-in-ontario). Rapid Antigen Tests (RAT) are also significantly limited in Ontario and these results are not officially reported to any health agency. Additionally, in early 2020, testing was unavailable or highly limited. A previously approved, but not implemented, version of this protocol limited eligibility to PCR test only. To ensure that we are able to enroll individuals, inclusion criteria for testing will not be limited to PCR. The preferred confirmation of eligibility will remain a PCR test 12 weeks prior. Second line of eligibility confirmation will be a positive RAT 12 weeks prior. Third line will be for the participant to confirm a suspected case of COVID-19 indicating they were experiencing symptoms at least 12 weeks prior. Determination of a suspected case will follow the Ottawa Public Health Guidelines (https://www.ottawapublichealth.ca/en/public-health-topics/resources/Documents/Self-Isolation-Flowchart_EN.pdf) summarized in Table 2.

Table 2 Suspected COVID-19 eligibility criteria

Potential participants will be asked to confirm that symptoms were a minimum of 12 weeks ago, and the delegated research staff will document the date and the list of symptoms experienced. The Principal Investigator will then make the final determination about inclusion in the study.

Access to technology

Participants are not required to have a smartphone with a data plan in order to participate in the intervention arm. Participants will be able to access their patient dashboard from their computer or tablet with internet access. Participants who do not have any available options to access the platform and are randomized to the intervention arm will be provided with one pre-paid smartphone with voice and data services for the duration of their study participation. Provision of a second phone in the event of loss or theft will be evaluated on a case-by-case basis.

Who will take informed consent? {26a}

All informed consent discussions will be completed by a site-delegated study staff member, such as a research coordinator or research assistant.

Additional consent provisions for collection and use of participant data and biological specimens {26b}

As per institutional guidelines, participants will be asked to complete a “Consent to Communicate by Email” form prior to completing the informed consent discussion. Participants will be asked permission to share their de-identified trial data in an open access database, in line with Canadian Institutes of Health Research (CIHR) best practice. This trial does not involve collecting biological specimens for storage.

Interventions

Explanation for the choice of comparators {6b}

Utilizing the NICE COVID-19 treatment guideline, we have selected a comparator group that will be able to answer the question “What is the clinical effectiveness of different service models of multimodality/multidisciplinary post-COVID-19 syndrome rehabilitation in improving patient-reported outcomes (such as quality of life)?” The comparator group will receive usual care and health coaching as required. We chose to compare this to health coaching plus electronic case management in the intervention group as this addresses one of the recommended research questions in the NICE guidelines “What is the clinical effectiveness of different service models of multimodality/multidisciplinary post-COVID-19 syndrome rehabilitation in improving patient-reported outcomes (such as quality of life)?”

Intervention description {11a}

Control arm: health coaching plus usual care (HC)

Assessment

Participants randomized to the control arm will be offered assessment by a clinician, guided by the WHO Post COVID-19 CRF (https://www.who.int/publications/i/item/global-covid-19-clinical-platform-case-report-form-(crf)-for-post-covid-conditions-(post-covid-19-crf-)). This is a clinical tool developed by the WHO to guide and document the sequelae of COVID-19 and to ensure that clinical and rehabilitation needs are identified.

Investigation

Clinician judgment will be used to decide on further testing needed for clinical care.

Management

Control participants will receive a rehabilitation plan developed with their health professional that will be implemented in the 8 weeks after their initial consultation (baseline visit) and access to a personal health coach. The implementation will involve face to face or virtual care from a registered health professional provided by the clinic or research staff. This may be a combination of, but not limited to, occupational therapy, physical therapy, and/or social work/counselling services. The frequency of treatment visits will depend on the individual treatment plan after assessment. All participants will receive access to a health coach.

Experimental arm: electronic case management plus usual care

Participants randomized to the experimental arm will receive assessment, investigation and management as outlined above plus access to an electronic case management platform – NexJ Connected Wellness (https://nexjhealth.com/), supported by a personal health coach and which complements the rehabilitation plan. This would include, for example, setting targets for activity that would be monitored with NexJ; educational materials; and, support with medication adherence by reminders. The NexJ platform will include the following sections: Case Plans with Educational Workbooks, Trusted Educational Content (Health Library), Symptom Tracking, Goal Setting, and Reporting.

Timing of sessions

All participants will receive health coaching sessions up to once a week. Participants who are using NexJ will have assigned content between sessions. Due to the heterogeneous nature of Long COVID presentation, timing of clinical rehabilitation sessions will be individualized based on the treatment plan. This information will be recorded for each participant.

Criteria for discontinuing or modifying allocated interventions {11b}

Decisions about modifying individual rehabilitation care or health coaching will be made in collaboration with the most responsible healthcare provider and the Principal Investigator. No predefined criteria will be used with respect to modifying individual interventions.

The trial will be stopped if more than 25% of participants in the intervention group experience at least a 20% increase in severity in their WHODAS sum score. There will be no stopping criteria for benefit given the short duration of the study.

Strategies to improve adherence to interventions {11c}

No particular strategy will be implemented to improve adherence to the intervention as this is an outcome of the study. As part of the process evaluation, we are examining factors affecting adherence to the intervention. We will evaluate any differences in adherence between the treatment and intervention groups.

Relevant concomitant care permitted or prohibited during the trial {11d}

As outlined in Table 1, only other trials providing treatment for Long COVID will be prohibited. All other concomitant care is permitted and will be documented.

Provisions for post-trial care {30}

In the event of a study-related injury or illness, participants will be provided with appropriate medical treatment and care. Financial compensation for lost wages, disability, or discomfort due to an injury or illness is not generally available. After study completion, participants will not have access to the NexJ Connected Wellness platform as this is not publicly available. The participants’ most responsible care provider will ensure a transition back to or continuation of standard care, as required.

Outcomes {12}

Primary outcome

To evaluate the primary outcome, improvement in quality of life, we will use the total sum score of the WHO Disability Assessment Scale (WHODAS 2.0) self-assessment. The WHODAS is a 36-item self-report questionnaire measuring health and disability from the previous 30 days across six domains of functioning: cognition, mobility, self-care, getting along, life activities, and participation. Responses are scored on a 5-point Likert scale: None [0], Mild [1], Moderate [2], Severe [3], and Extreme/Cannot Do [4] [32].

The WHODAS 2.0 has been validated using a cross-cultural approach in 19 countries and within 4 subgroups (general population, populations with physical problems, populations with mental or emotional problems, and populations with problems related to substance use). The WHODAS 2.0 showed excellent overall test-retest reliability (ICC=0.98) and internal consistency (Cronbach’s alpha = 0.98). The survey also showed good cross-cultural sensitivity and concurrent validity [32].

Secondary outcomes

Long COVID characteristics

To describe the population and their experience with Long COVID, we will administer the WHO Post COVID Case Report Form (CRF) Modules 1, 2, and 3 at baseline and only Module’s 2 and 3 at 12 weeks [33]. The CRF Module 1 captures demographics, pregnancy, pre-COVID health status, and details about the acute COVID infection. CRF Modules 2 and 3 collect vaccination status, occupational status, functioning, post-COVID symptoms, clinical tests, and scales (including neurological, radiographic, blood tests, heart and lung function, mental health, function, and musculoskeletal tests), new diagnoses or complications related to COVID infection, health service use, and symptoms [33]. The CRF will be completed using health record review whenever possible, with missing information completed by interview with the participant.

Currently, little is known about the long-term consequences of infection with COVID-19. In response to this, the WHO has created the WHO Post COVID Case Report Form, which will allow health care providers internationally to collect information on COVID-19 systematically. The use of this CRF will allow for the trial dataset to be aligned with the global WHO Clinical Platform and contribute to expanding our knowledge on Post-COVID-19 condition(s).

All other secondary outcome measures are described in Table 3.

Table 3 Secondary outcomes

Predictors and potential confounders

At the first assessment, we will collect information on predictors and potential confounders as listed in Table 4.

Table 4 Predictors, potential confounders and effect modifiers

Process evaluation

To inform the implementation of the intervention beyond the clinical trial and describe the intervention process, we will use the RE-AIM framework [31]. We will assess Reach by recording what proportion of eligible patients participate in the trial and comparing characteristics of participants to non-participants. Effectiveness will be assessed in the clinical trial and separately stratified by sex. We will also record dropouts by sex and severity. We will conduct qualitative interviews with participants to better understand the reasons for participating, the experience of using the NexJ app, and any reasons for drop out. We will use a thematic analysis and aim to complete at least 20 user interviews and will continue until we achieve data saturation. We will gather usage data from NexJ. Adoption at the setting level will be assessed by comparing uptake in the different clinics supplemented by qualitative interviews with clinical staff. Adoption at the staff level will compare high referrers to the study to low referrers and doing qualitative interviews with staff in each group. Implementation will be assessed with a study specific-adherence scale. Maintenance at an individual and setting level will be assessed using the Consolidated Framework for Implementation Research (CFIR) to inform qualitative interviews with key stakeholders to identify barriers and facilitators to introducing NexJ in outpatient clinics.

Economic evaluation

We will conduct a cost-utility analysis of an electronic case management system compared with usual care from a perspective of the publicly funded health care system. Costs and outcomes will be assessed within the follow-up period of the trial. Resources and associated costs required to set up and operate a unique instance of the NexJ platform will be estimated from the budget review and staff interview. We will collect health care utilization data, such as hospitalization, emergency department visits, physician visits, prescriptions, and the efficacy of the intervention, from the concurrent trials. We will derive health utility value from the EQ-5D-5L using the Canadian validated algorithm [61], Quality-Adjusted Life Years (QALYs) will be estimated using the total area under the curve method [62]. Unit costs for each health care resource will be obtained from Canadian Sources. Costs will be expressed in 2021 Canadian Dollars.

Participant timeline {13}

Administration will occur as per the Time and Events Schedule in Table 5. Clinical visits will occur as needed and will be determined during the initial assessment. Clinical visits are not outlined in the time and event schedule as these are a part of routine care. Self-report measures will be completed at home prior to each study visit using the study Electronic Data Capture System (EDCS). Participants will be able to leave and return to the questionnaires whenever they need to complete them. It is anticipated the first and last visit will take approximately 45 min, while weeks 4 and 8 will take approximately 30 min. Participants will complete the WHODAS first and all responses are mandatory. All other self-report measures will be completed in a structured order.

Table 5 Time and events schedule

Sample size {14}

We have based the sample size calculation on the sum of domain scores of the WHODAS 36, as the recommended assessment for Long COVID patients [33]. At the time of writing this protocol, there were no published scores of the WHODAS 36 in people with Long COVID. Therefore, we have based our sample size calculation on WHODAS 36 scores from 25 randomly selected patients attending an existing clinic for Long COVID at TOH run by OWN. These patients had a mean sum of domain scores of 17 (SD=4). The minimally important clinical difference on the WHODAS 36 is about a 10% change in scores [32]. Using these assumptions, we need to recruit at least 126 participants (63 in each group) to have 80% power to detect a 10% change in scores assuming an alpha of 0.05. Allowing for 20% drop out would mean a recruitment target of 152 (76 in each group) people.

Recruitment {15}

Participants will be recruited at TOH through two potential recruitment streams. The first clinic sees Ontario workers who were infected by SARS-CoV-2 at their worksite, who have made a claim to the Ontario WSIB and are assessed by the OWN based at TOH. The second stream is any clinics within TOH which are seeing patients with Long COVID. These are either clinics specifically for people with Long COVID, for example within respirology, infectious diseases, or psychiatry. The anticipated flow of recruitment is outlined in Fig. 1 below.

Fig. 1
figure 1

Patient flow

Assignment of interventions: allocation

Sequence generation {16a}

Randomization will be done remotely by the Ottawa Methods Centre (OMC) through an electronic randomization system. Participants will be randomized at enrollment by a delegated study staff member. As participants are created in the ECDS, they are automatically randomized. The delegated study staff member will be informed of the allocation at the time of randomization.

Allocation will be a 1:1 ratio into the treatment arms. Participants will be stratified by sex and duration of symptoms. The reasons for stratification by sex are that the mortality rate in males is higher than in females and that outcomes may be affected by gendered occupations [63,64,65,66]. We will stratify by the duration of symptoms into two groups: (1) those who at enrolment have had symptoms since the onset of their index illness for 12 to 23 weeks, and (2) those who have had symptoms at enrolment for 24 weeks or longer, which is consistent with the classification of Long COVID in the NICE guidelines. We are stratifying for duration of illness as this is one of the main determinants of outcomes.

Concealment mechanism {16b}

Not applicable. Since the interventions are assigned through random computer generation, allocations are not visible in advance, and no concealment is required.

Implementation {16c}

Once participants have consented and completed screening determining eligibility, they will be registered in the ECDS and randomization system by the delegated research staff member. Once the participant is registered, the system will automatically allocate the participant to the intervention.

Assignment of interventions: blinding

Who will be blinded {17a}

Due to the nature of the intervention, a behavioral intervention where both patient and clinician must use an electronic platform, it is not possible to blind either group to their allocation. Data analysts and manuscript writers will be blind to the identity of the two groups which will be referred to as group A and group B. Once initial manuscript preparation is complete, the groups will be unblinded. We will also assess potential bias in recruitment during an interim analysis.

Procedure for unblinding if needed {17b}

Not applicable—all participants and treating clinicians are unblinded to the intervention.

Data collection and management

Plans for assessment and collection of outcomes {18a}

All self-reported outcome measures will be administered via the EDCS for all study visits. Interview measures, when done remotely, will be completed using a videoconferencing platform. Information from the WHO Post-COVID Assessment CRF will be entered by delegated study staff into the EDCS.

Cognitive assessments will be administered by a trained research staff member. The delegated study staff member will receive direct training from an experienced Psychologist, including rehearsal and independent evaluation, prior to administration with participants.

Plans to promote participant retention and complete follow-up {18b}

A major difficulty in all clinical research is ensuring participants attend their visits and stay enrolled in the study. Efforts will be made to minimize the time between being approached about the study and the baseline visit. We anticipate lost to follow-up to be no more than 20%. While there is currently no available literature on the lost to follow-up rates for Long COVID rehabilitation, the case management platform we are using has demonstrated significantly higher levels of retention in difficult to treat populations [24]. For those participants in the intervention arm, daily and weekly reminders will be programmed into the NexJ Connected Wellness platform to encourage regular use and increase connectedness with the platform, increasing retention.

We will implement an escalated approach if contact is lost with individuals between study visits. The appropriate response will be determined in collaboration with the Principal Investigator, particularly if there is a potential safety concern. If contact is made with the participant and they are no longer interested in participating, the delegated study staff member will make every effort to ascertain why they are withdrawing their consent. Participants will be sent the link to complete their self-report questionnaires at each time point unless they have withdrawn their consent for participation.

Data management {19}

All study outcome data will be directly entered into an EDCS. Data will be automatically coded, and the code will be described using a data dictionary. Range checks will be included for illogical entries. Missing items will be flagged for self-entry; however, participants can bypass the warning. A delegated study staff member will follow-up on the missing entry to confirm if the question was missed or the participant is refusing to answer.

The EDCS is a username- and password-protected web-based system. All network, server security and privacy settings are regularly tested and comply with Health Canada recommendations and Good Clinical Practice (GCP) for secured data management services [67, 68]. The EDCS is hosted on a physical server, not in the cloud, that is located at TOH data center in a secure server room with access limited to authorized personnel behind lock doors. The web/database server is behind the TOH firewalls. The OHRI website is secured with the highest rating from Entrust SSL virtual test. The data transfer between the client and server is protected with Entrust SSL 256-bit encryption. All data transfers between the client computers/browsers and the server/database are encrypted via https.

Confidentiality {27}

All records will automatically be assigned a unique Participant ID during randomization. The Participant ID will be recorded on a master linking log. The master linking log will be password-protected and stored with limited access as per institutional policy. The Participant ID will appear on all documentation included in a participant’s research chart, including study forms and correspondence, in order to maintain participant confidentiality. All correspondence with participants will be de-identified, removing names and other potentially identifying information, prior to being included in the study chart. Some documentation will remain identifiable including the Informed Consent Form, the Participant Information Form, and the Emergency Contact Form. These will not be stored with documentation identified with a Participant ID. Hard copy documentation will be stored in a double locked area (e.g., locked cabinet and secure office space). Study documents will be password-protected, and a log is kept separately from the documents so that access to the files is not lost in the event of staff turnover or during the archiving period. Electronic documents will not be stored on mobile devices (such as a USB or directly on a laptop).

Documents requiring de-identification must use an approved method. Electronic documents must be redacted so that the information removed cannot be recovered at a later time utilizing a tool such as Adobe Pro “Redact” feature, permanently obscuring the data. Hardcopy documentation will be redacted using only a “china marker,” which completely obscures the data. Sharpie, pen, and other writing tools are not permitted as they do not permanently obscure/destroy the data.

Participants’ study information will not be released unless a delegated study staff member obtains written permission from the participant or where required by law. Participants will not be identified in study presentations or publications. Once all study activities are complete, all study records and data exports will be archived at a secure storage facility for a period of 10 years, as per the applicable Network of Networks (N2) Standard Operating Procedure (SOP) and GCP regulations. The 10-year period will begin from the date the last informed consent form is signed.

Plans for collection, laboratory evaluation, and storage of biological specimens for genetic or molecular analysis in this trial/future use {33}

Not applicable. There are currently no ancillary trials planned.

Statistical methods

Statistical methods for primary and secondary outcomes {20a}

The OMC will complete all data analyses. Baseline characteristics will be presented as means (or medians) with associated measures of variation for continuous variables, or frequencies and proportions for categorical data. We will use an intention-to-treat analysis based on all randomized participants. Additionally, we will analyze the primary and secondary outcomes based on the treatment received. Analyses will utilize a Gender-Based Analysis Plus (GBA+) focused Health Equity Impact Assessment (HEIA) [69] approach to examine how sex and gender interact with socioeconomic status, age, race/ethnicity, and rural/urban residence.

Analysis of primary and secondary outcomes will use relative risks and mean differences and be calculated and presented with 95% Confidence Intervals (CI). We will include subgroup analyses of participants by age, sex, and severity of Long COVID. The effects of group (control vs. experimental), Long COVID severity, and adverse childhood events on the linear change over time in the primary outcome (measured at 4 time points) will be analyzed using hierarchical regression. Bivariate associations between primary and secondary outcomes (and among secondary outcomes) measured at baseline and at the end of the study will be estimated with Pearson correlation coefficients (or Spearman correlation coefficients for non-parametric data).

Economic evaluation

Results of a cost-utility analysis will be presented as incremental cost per QALY gained. The incremental cost and incremental outcome will be estimated using generalized linear models that explicitly allow for the modelling of normal and non-normal distributional forms of data. The incremental cost-effectiveness ratio will be obtained through the difference in the mean costs of the two strategies divided by the difference in the mean QALYs for each strategy as denoted by the coefficient of the intervention indicator variables. Uncertainty in the analysis will be addressed by estimating 95% CIs using a non-parametric bootstrapping method. For this study, we will obtain 10,000 estimates of costs and outcomes for each strategy. Results from the bootstrapping exercise will also be used to show cost-effectiveness acceptability curves, which represent the probability of NexJ being cost-effective over a range of willingness to pay values that the health system may be willing to pay for an additional unit of QALY.

Interim analyses {21b}

We will do a health equity impact assessment at 6 months to ensure the study has addressed potential health inequities in recruitment, treatment, and assessment using the Ontario HEIA tool [69].

Methods for additional analyses (e.g., subgroup analyses) {20b}

Not applicable. There are currently no planned subgroup analyses.

Methods in analysis to handle protocol non-adherence and any statistical methods to handle missing data {20c}

Efforts will be made to minimize missing data, although it is possible that some amount of missing data may occur. We will examine the pattern of missing data by comparing characteristics of participants with missing data to those of participants with complete data to examine the assumption of missing at random. In the case of substantial missingness (e.g., >5%), missing covariates and outcomes will be imputed using multiple imputation with m=10 imputed data sets prior to analysis.

Plans to give access to the full protocol, participant-level data, and statistical code {31c}

The Principal Investigator will retain ownership of the dataset through the 10-year archiving period. The protocol will be made available open access and will be published, at a minimum, on an open science platform such as Open Science Framework or medRxiv. The anonymized data set will be shared on an open science platform, such as Open Science Framework or Zenodo. The anonymized dataset may also be shared with the WHO to facilitate global post-COVID-19 research and treatment efforts.

Oversight and monitoring

Composition of the coordinating center and trial steering committee {5d}

Committee

Responsibilities

Membership

Trial Steering Committee

Approval of the final protocol; reviewing and advising on progress of study; facilitation of study conduct; end point evaluation; manuscript coordination; knowledge translation

Investigators as listed, other members as outlined in the Trial Steering Committee charter.

Trial Management Committee (Coordinating Centre responsibilities)

Protocol management; study documentation; ethics, contracts; study planning; day-to-day activities; budgets, monitoring; data verification; randomization; support study registered health professionals; investigator support for trial activities; liaise with platform service provider; organize steering committee meetings; implement steering committee action items

Principal Investigator, co-Principal Investigator, Clinical Research Program Manager, Clinical Research Coordinator, Clinical Research Assistant

Composition of the data monitoring committee, its role and reporting structure {21a}

An independent Data and Safety Monitoring Committee (DSMC) has been convened to assess the progress of the clinical trial, the integrity of the data, and the safety of all participants and to provide recommendations to the Principal Investigator(s). The members of the DSMC serve in an individual capacity and provide their expertise and recommendations. The DSMC will review cumulative study data to evaluate safety, study conduct, scientific validity, and data integrity of the study. A charter will outline the full responsibilities of the DSMC. At a minimum, the general responsibilities of the DSMC will be:

  • To evaluate any reports of safety-related events in the study to ensure the ongoing safety of participants;

  • To consider factors external to the study when relevant information becomes available, such as scientific or therapeutic developments that may have an impact on the safety of the participants or the ethics of the study;

  • To review the conduct of the study;

  • To make recommendations to continue, modify, or terminate the study.

Membership will be comprised of four independent, interdisciplinary members. Possible fields of expertise include statistics/biostatistics, epidemiology, methodology, psychiatry, and the ethics of clinical trials. Members will be identified in the DSMC charter.

Adverse event reporting and harms {22}

Participant wellbeing and safety will be monitored by the Investigators and Registered Health Professionals (RHPs), within the restrictions of their respective professional colleges. Adverse events will be collected at each study visit. SOPs will be developed for escalation of participant safety concerns, for example by setting a threshold increase on mental health scales where the Principal Investigator, or appropriate most responsible care provider, is notified for follow-up. If a significant worsening of symptoms occurs, the individual notified or Principal Investigator will follow-up with the participant and will provide intervention as necessary. Reporting of adverse events and serious adverse events will follow institutional procedures as laid out in SOPs and Research Ethics Board (REB) guidance.

Participants may find some questions in the questionnaires uncomfortable. Participants may refuse to answer any questions to which they do not want to respond. Expected adverse events include worsening fatigue, decline in symptoms reported at baseline related to the study intervention, and eye strain/fatigue from using the smartphone application.

Frequency and plans for auditing trial conduct {23}

An internal study monitor will be selected prior to the start of the trial. The monitor will not be involved in data collection activities and will be one step removed from the clinical trial. Before the launch of recruitment, the internal monitor will ensure that appropriate training has been completed and documented for all delegated study staff.

After enrollment of the first participant, the internal study monitor will review all documentation for this participant to ensure any errors or challenges are identified and resolved before being carried through subsequent participants. Throughout the duration of the study, the internal monitor will perform monitoring visits on a minimum quarterly basis, or more frequently as needed based on recruitment rates. An internal monitoring plan will guide the process and materials to be reviewed at each visit, as well as follow-up procedures.

At the end of study, the monitor will lead the study close out activities in collaboration with the study staff to ensure that all study records and essential documentation are complete and ready for analysis, REB closure, and archiving.

Throughout the study, the OHRI Clinical Facilitators may also audit the study. These audits may be planned or unplanned. If an audit is requested, the study team will assist the OHRI in completing their review of the study. If the internal monitor discovers significant or repeated issues in their monitoring visits, they may request the assistance of the OHRI Clinical Facilitators for their recommendations.

Plans for communicating important protocol amendments to relevant parties (e.g., trial participants, ethical committees) {25}

Any subsequent modifications to the study protocol, including changes to study objectives, study design, patient population, sample sizes, study procedures, or significant administrative changes will be agreed upon by the Investigators and submitted to the REB of record for review and approval prior to implementation. Participants will be informed in writing of any modifications or new information that may impact their willingness to participate in the study. If required, participants may also be asked to sign a Consent Update Form, as approved by the REB.

Dissemination plans {31a}

We plan to take a diverse approach to our knowledge mobilization and dissemination plan. We have engaged the Public Health Agency of Canada (PHAC) as Knowledge Users in our study. PHAC will work with the investigator team to identify relevant targets of knowledge exchange activities within the federal health portfolio, as well as with national and international stakeholders. Primary outcomes publications refer to any presentation or publication that presents data on the primary outcome measure as detailed in this protocol. The primary outcome publication will be submitted within 6 months of the completion of data collection. The primary outcomes publication will be open access and any secondary publications will be made open access whenever possible.

All study results will be released to study participants, the general medical community, the general public, and other identified stakeholders. Other forms of dissemination include academic publications, conference presentations, stakeholder meetings, and presentations to the general public. Lay knowledge products will be designed in collaboration with lived experience partners to ensure that dissemination is impactful and relevant to the community.

Discussion

There is currently little evidence about the optimal treatment of Long COVID patients or the use of digital health platforms in this population. There are currently no systematic reviews of treatment for Long COVID and much of the existing literature is considered low-quality evidence. Important operational issues relate to the privacy and confidentiality of any information stored on the app; however, the study team has ensured safeguards are in place to minimize this risk. Additionally, navigating virtual visits and fluctuating lockdowns poses variable challenges throughout the duration of the study. The protocol has been designed to be delivered hybrid or fully virtual, if required, to seamlessly accommodate any changes in access to in-person resources. The results of this trial could result in rapid, scalable, and personalized care for people with Long COVID which will decrease morbidity after an acute infection. Results from this study will also inform decision making in Long COVID and treatment guidelines at provincial and national levels.

Trial status

This study received initial approval by the OHSN-REB in September 2021, with an amended protocol approved (protocol version date 23 Feb 2022). Recruitment was opened in May 2022. At the time of writing this manuscript, one participant had been enrolled. The estimated completion date for primary data collection is May 2023.

Availability of data and materials {29}

The Principal Investigator will retain ownership of the dataset through the 10-year archiving period. Once the primary outcomes manuscript is published, the anonymized data set will be shared on an open access platform, such as Open Science Framework or Zenodo. Prior to this, any data required to support the protocol can be supplied upon request to the Principal Investigator (SH).

Abbreviations

ACE-Q:

Adverse Childhood Events Questionnaires

ASSIST:

Alcohol, Smoking and Substance Interview Screening Test

AUDIT:

Alcohol Use Disorders Identification Test

CI:

Confidence Interval

CIHR:

Canadian Institutes of Health Research

COWAT:

Controlled Oral Word Association Test

CRF:

Case Report Form

DSMC:

Data and Safety Monitoring Committee

ECM:

Electronic Case Management

EDCS:

Electronic Data Capture System

FNRS:

Fatigue Numeric Rating Scale

FSS:

Fatigue Severity Scale

GAD-7:

Generalized Anxiety Disorder 7-item scale

GBA+:

Gender-Based Analysis Plus

HEIA:

Health Equity Impact Assessment

HVLT-R:

Hopkins Verbal Learning Test-Revised

GCP:

Good Clinical Practice

IEQ-SF:

Injustice Experience Questionnaire – Short Form

N2:

Network of Networks

NICE:

National Institute for Healthcare and Excellence

OHRI:

Ottawa Hospital Research Institute

OHSN-REB:

Ottawa Health Sciences Network Research Ethics Board

OMC:

Ottawa Methods Centre

OWN:

Ontario Workers Network

PCL-5:

PTSD Checklist-5

PCR:

Polymerase chain reaction

PHAC:

Public Health Agency of Canada

PHQ-9:

Patient Health Questionnaire 9-item scale

PNRS:

Pain Numeric Rating Scale

PSQI:

Pittsburgh Sleep Quality Index

QALY:

Quality-adjusted life years

RAT:

Rapid Antigen Test

REB:

Research Ethics Board

RHP:

Registered Health Professional

SOP:

Standard Operating Procedure

O-TMT:

Oral Trail Making Test

TOH:

The Ottawa Hospital

WAIS-IV:

Weschler’s Adult Intelligence Scale - 4th Edition

WEMWBS:

Warwick-Edinburgh Mental Wellbeing Scale

WHO:

World Health Organization

WHODAS:

WHO Disability Assessment Scale

WSIB:

Workplace Safety and Insurance Board

References

  1. Government of Ontario. All Ontario: case numbers and spread. 2021 [cited 2021 Jul 12]. Available from: https://covid-19.ontario.ca/data

    Google Scholar 

  2. Mahmud R, Rahman M, Rassel M, Monayem F, Sayeed S, Islam M, et al. Post-COVID-19 syndrome among symptomatic COVID-19 patients: a prospective cohort study in a tertiary care center of Bangladesh. PLoS One. 2021;16(4):e0249644.

  3. Nehme M, Braillard O, Alcoba G, Aebischer Perone S, Courvoisier D, Chappuis F, et al. COVID-19 symptoms: longitudinal evolution and persistence in outpatient settings. Ann Intern Med. 2020;174(5):723–5.

    Article  PubMed  Google Scholar 

  4. Huang C, Huang L, Wang Y, Li X, Ren L, Gu X, et al. 6-month consequences of COVID-19 in patients discharged from hospital: a cohort study. Lancet. 2021;397(10270):220–32.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Salmon-Ceron D, Slama D, De Broucker T, Karmochkine M, Pavie J, Sorbets E, et al. Clinical, virological and imaging profile in patients with prolonged forms of COVID-19: a cross-sectional study. J Infect. 2021;82(2):e1–4.

    Article  CAS  PubMed  Google Scholar 

  6. Carfì A, Bernabei R, Landi F. Persistent symptoms in patients after acute COVID-19. JAMA. 2020;324(6):603–5.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  7. National Institute for Health and Care Excellence, Royal College of General Practitioners, Healthcare Improvement Scotland. COVID-19 rapid guideline: managing the long-term effects of COVID-19. NICE Guidelines. 2020. Available from: https://www.nice.org.uk/guidance/ng188/resources/covid19-rapid-guideline-managing-the-longterm-effects-of-covid19-pdf-66142028400325

    Google Scholar 

  8. Davis H, Assaf G, McCorkell L, Wei H, Low R, Re’em Y, et al. Characterizing long COVID in an international cohort: 7 months of symptoms and their impact. EClinicalMedicine. 2021;38:101019.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Taquet M, Geddes JR, Husain M, Luciano S, Harrison PJ. 6-month neurological and psychiatric outcomes in 236 379 survivors of COVID-19: A retrospective cohort study using electronic health records. Lancet Psychiatry. 2021;S2215-0366(21):00084–5 [cited 2021 Apr 12]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/33836148.

  10. Tenforde MW, Kim SS, Lindsell CJ, Billig Rose E, Shapiro NI, Files DC, et al. Symptom duration and risk factors for delayed return to usual health among outpatients with COVID-19 in a multistate health vare systems network — United States, March–June 2020. Morb Mortal Wkly Rep. 2020;69(30):993–8.

    Article  CAS  Google Scholar 

  11. Ayoubkhani D, Khunti K, Nafilyan V, Maddox T, Humberstone B, Diamond I, et al. Post-covid syndrome in individuals admitted to hospital with covid-19: retrospective cohort study. BMJ. 2021;372:n693.

  12. Lam MHB, Wing YK, Yu MWM, Leung CM, Ma RCW, Kong APS, et al. Mental morbidities and chronic fatigue in severe acute respiratory syndrome survivors long-term follow-up. Arch Intern Med. 2009;169(22):2142–7.

    Article  PubMed  Google Scholar 

  13. Gilmutdinova IR, Kolyshenkov VA, Lapickaya KA, Trepova AS, Vasileva VA, Prosvirnin AN, et al. Telemedicine platform COVIDREHAB for remote rehabilitation of patients after COVID-19. Eur J Transl Myol. 2021;31(2):9783.

    Article  PubMed Central  Google Scholar 

  14. Yan Z, Yang M, Lai CL. Long covid-19 syndrome: a comprehensive review of its effect on various organ systems and recommendation on rehabilitation plans. Biomedicines. 2021;9(8):966.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Callard F, Perego E. How and why patients made Long Covid. Soc Sci Med. 2021;268:113426.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Hamine S, Gerth-Guyette E, Faulx D, Green BB, Ginsburg AS. Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review. J Med Internet Res. 2015;17(2):e52.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Epstein E, Patel N, Maysent K, Taub PR. Cardiac rehab in the COVID era and beyond: mHealth and other novel opportunities. Curr Cardiol Rep. 2021;23(5):42.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Archer J, Bower P, Gilbody S, Lovell K, Richards D, Gask L, et al. Collaborative care for depression and anxiety problems. Cochrane Database ofSystematic Rev. 2012;10(10):CD006525.

    Google Scholar 

  19. Dejonghe LAL, Becker J, Froboese I, Schaller A. Long-term effectiveness of health coaching in rehabilitation and prevention: a systematic review. Patient Educ Couns. 2017;100(9):1643–53.

    Article  PubMed  Google Scholar 

  20. Wayne N, Ritvo P. Smartphone-enabled health coach intervention for people with diabetes from a modest socioeconomic strata community: single-arm longitudinal feasibility study. J Med Internet Res. 2014;16(6):e149.

  21. Wayne N, Perez DF, Kaplan DM, Ritvo P. Health coaching reduces HbA1c in type 2 diabetic patients from a lower-socioeconomic status community: a randomized controlled trial. J Med Internet Res. 2015;17(10):e224.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Pludwinski S, Ahmad F, Wayne N, Ritvo P. Participant experiences in a smartphone-based health coaching intervention for type 2 diabetes: a qualitative inquiry. J Telemed Telecare. 2016;22(3):172–8.

    Article  PubMed  Google Scholar 

  23. MacLean S, Corsi DJ, Litchfield S, Kucharski J, Genise K, Selaman Z, et al. Coach-facilitated web-based therapy compared with information about web-based resources in patients referred to secondary mental health care for depression: randomized controlled trial. J Med Internet Res. 2020;22(6):e15001.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Ritvo P, Knyahnytska Y, Pirbaglou M, Wang W, Tomlinson G, Zhao H, et al. Online mindfulness-based cognitive behavioral therapy intervention for youth with major depressive disorders: randomized controlled trial. J Med Internet Res. 2021;23(3):e24380.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Hatcher S, Heisel M, Ayonrinde O, Campbell JK, Colman I, Corsi DJ, et al. The BEACON study: protocol for a cohort study as part of an evaluation of the effectiveness of smartphone-assisted problem-solving therapy in men who present with intentional self-harm to emergency departments in Ontario. Trials. 2020;21(1):925.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Alibhai SMH, Santa Mina D, Ritvo P, Sabiston C, Krahn M, Tomlinson G, et al. A phase II RCT and economic analysis of three exercise delivery methods in men with prostate cancer on androgen deprivation therapy. BMC Cancer. 2015;15(1):312.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Ritvo P, Obadia M, Santa Mina D, Alibhai S, Sabiston C, Oh P, et al. Smartphone-enabled health coaching intervention (iMOVE) to promote long-term maintenance of physical activity in breast cancer survivors: protocol for a feasibility pilot randomized controlled trial. JMIR Res Protoc. 2017;6(8):e165.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Mackie C, Dunn N, Maclean S, Testa V, Heisel M, Hatcher S. A qualitative study of a blended therapy using problem solving therapy with a customised smartphone app in men who present to hospital with intentional self-harm. Evid Based Ment Health. 2017;20(4):118–22.

    Article  PubMed  Google Scholar 

  29. Curran D, Lauzon J, Quon DMS. Feasibility of an interactive coaching app to enhance post-concussion outpatient care. Front Med Technol. 2021;3:17.

  30. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350(mar19 6):h1258 [cited 2019 Mar 11]. Available from: http://www.bmj.com/.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.

  32. Üstün TB, World Health Organization. Measuring health and disability: Manual for WHO Disability Assessment Schedule WHODAS 2.0. Geneva: World Health Organization; 2010.

    Google Scholar 

  33. World Health Organization. Global COVID-19 clinical platform case report form (CRF) for post COVID condition (Post COVID-19 CRF) 2021. Available from: https://www.who.int/publications/i/item/global-covid-19-clinical-platform-case-report-form-(crf)-for-post-covid-conditions-(post-covid-19-crf-)

    Google Scholar 

  34. Saurman J, Vickers K, Rodriguez A, Andrews M, Gradone A, Jean K, et al. The utility of the Oral Trail Making Test in telehealth assessments with cognitively impaired older adults. Alzheimers Dement. 2021;17:e054781.

    Article  Google Scholar 

  35. Abraham E, Axelrod BN, Ricker JH. Application of the oral trail making test to a mixed clinical sample. Arch Clin Neuropsychol. 1996;11(8):697–701.

    Article  Google Scholar 

  36. Ashendorf L, Jefferson AL, O’Connor MK, Chaisson C, Green RC, Stern RA. Trail Making Test errors in normal age, mild cognitive impairment and dementia. Arch Clin Neuropsychol. 2008;23(2):129–37.

    PubMed  Google Scholar 

  37. Brandt J. 1. BJTHVLTD of a new memory test with six equivalent forms. CN 1991; The Hopkins Verbal Learning Test: development of a new memory test with six equivalent forms. Clin Neuropsychol. 1991;5(2):125–42.

  38. Strauss EA, Spreen O. Compendium of neuropsychological tests. Administration, norms, and commentary. 3rd ed. Oxford: Ocford University Press; 2006.

    Google Scholar 

  39. Weiss LG, Saklofske DH, Coalson DL, Raiford SE. WAIS-IV clinical use and interpretation: scientist-practitioner perspectives. San Diego: Elsevier Science & Technology; 2010.

  40. Waters GS, Caplan D. The reliability and stability of verbal working memory measures. Behav Res Methods Instrum Comput. 2003;35(4):550–64.

    Article  PubMed  Google Scholar 

  41. Sumerall SW, Timmons PL, James AL, Ewing MJM, Oehlert ME. Expanded norms for the controlled oral word association test. J Clin Psychol. 1997;53(5):517–21.

    Article  CAS  PubMed  Google Scholar 

  42. Tombaugh TN, Kozak J, Rees L. Normative data stratified by age and education for two measures of verbal fluency: FAS and animal naming. Arch Clin Neuropsychol. 1999;14(2):167–77.

    CAS  PubMed  Google Scholar 

  43. Wittkampf KA, Naeije L, Schene AH, Huyser J, van Weert HC. Diagnostic accuracy of the mood module of the Patient Health Questionnaire: a systematic review. Gen Hosp Psychiatry. 2007;29(5):388–95.

    Article  PubMed  Google Scholar 

  44. Spitzer RL, Kroenke K, Williams JBW, Lowe B. A brief measure for assessing generalized anxiety disorder. Arch Intern Med. 2006;166(10):1092–7.

    Article  PubMed  Google Scholar 

  45. Buysse DJ, Reynolds III CF, Monk TH, Berman SR, Kupfer DJ. The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research. Psychiatry Research. 1989;28(2):193–213.

  46. Blevins CA, Weathers FW, Davis MT, Witte TK, Domino JL. The Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5): development and initial psychometric evaluation. J Trauma Stress. 2015;28(6):489–98.

    Article  PubMed  Google Scholar 

  47. Rabin R, de Charro F. EQ-5D: a measure of health status from. Ann Med. 2001;33:337–43.

    Article  CAS  PubMed  Google Scholar 

  48. Carey KB, Carey MP, Chandra PS. Psychometric evaluation of the Alcohol Use Disorders Identification Test and Short Drug Abuse Screening Test with psychiatric patients in India. J Clin Psychiatry. 2003;64(7):767–74.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Humeniuk R, Ali R; WHO ASSIST Phase II Study Group. Validation of the Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) and Pilot Brief Intervention. Geneva: World Health Organization; 2006.

  50. Humeniuk R, Ali R, Babor TF, Farrell M, Formigoni ML, Jittiwutikarn J, et al. Validation of the alcohol, smoking and substance involvement screening test (ASSIST). Addiction. 2008;103(6):1039–47.

    Article  PubMed  Google Scholar 

  51. Krupp LB, Larocca NG, Muir Nash J, Steinberg AD. The fatigue severity scale: application to patients with multiple sclerosis and systemic lupus erythematosus. Arch Neurol. 1989;46(10):1121–3.

    Article  CAS  PubMed  Google Scholar 

  52. Minnock P, Kirwan J, Bresnihan B. Fatigue is a reliable, sensitive and unique outcome measure in rheumatoid arthritis. Rheumatology. 2009;48(12):1533–6.

    Article  PubMed  Google Scholar 

  53. Jensen MP, Turner JA, Romano JM, Fisher LD. Comparative reliability and validity of chronic pain intensity measures. Pain. 1999;83(2):157–62.

    Article  CAS  PubMed  Google Scholar 

  54. Boonstra AM, Stewart RE, Köke AJA, Oosterwijk RFA, Swaan JL, Schreurs KMG, et al. Cut-off points for mild, moderate, and severe pain on the Numeric Rating Scale for Pain in patients with chronic musculoskeletal pain: variability and influence of sex and catastrophizing. Front Psychol. 2016;7:1466. Available from: https://www.frontiersin.org/articles/10.3389/fpsyg.2016.01466/full.

  55. Bestall JC, Paul EA, Garrod R, Garnham R, Jones PW, Wedzicha JA. Usefulness of the Medical Research Council (MRC) dyspnoea scale as a measure of disability in patients with chronic obstructive pulmonary disease. Thorax. 1999;54(7):581–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  56. Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, et al. The Warwick-Dinburgh mental well-being scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5(1):63.

  57. Trousselard M, Steiler D, Dutheil F, Claverie D, Canini F, Fenouillet F, et al. Validation of the Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) in French psychiatric and general populations. Psychiatry Res. 2016;245:282–90.

    Article  PubMed  Google Scholar 

  58. Maheswaran H, Weich S, Powell J, Stewart-Brown S. Evaluating the responsiveness of the Warwick Edinburgh Mental Well-Being Scale (WEMWBS): group and individual level analysis. Health Qual Life Outcomes. 2012;10(156):1–8.

  59. Sullivan MJL, Adams H, Horan S, Maher D, Boland D, Gross R. The role of perceived injustice in the experience of chronic pain and disability: scale development and validation. J Occup Rehabil. 2008;18(3):249–61.

  60. Felitti VJ, Anda RF, Nordenberg D, Williamson DF, Spitz AM, Edwards V, et al. Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults: the adverse childhood experiences (ACE) study. Am J Prev Med. 1998;14(4):245–58.

  61. Xie F, Pullenayegum E, Gaebel K, Bansback N, Bryan S, Ohinmaa A, et al. A time trade-off-derived value set of the EQ-5D-5L for Canada. Med Care. 2016;54(1):98–105.

    Article  PubMed  Google Scholar 

  62. Manca A, Hawkins N, Sculpher MJ. Estimating mean QALYs in trial-based cost-effectiveness analysis: the importance of controlling for baseline utility. Health Econ. 2005;14(5):487–96.

    Article  PubMed  Google Scholar 

  63. Bai F, Tomasoni D, Falcinella C, Barbanotti D, Castoldi R, Mulè G, Augello M, Mondatore D, Allegrini M, Cona A, Tesoro D. Female gender is associated with long COVID syndrome: a prospective cohort study. Clin Microbiol Infect. 2022;28(4):611.e9–16.

  64. Izcovich A, Ragusa MA, Tortosa F, Marzio MAL, Agnoletti C, Bengolea A, et al. Prognostic factors for severity and mortality in patients infected with COVID-19: a systematic review. PLoS One. 2020;15(11):e0241955.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  65. Rovere-Querini P, De Lorenzo R, Conte C, Brioni E, Lanzani C, Yacoub MR, et al. Post-COVID-19 follow-up clinic: depicting chronicity of a new disease. Acta Biomed. 2020;91(9-S):22–8.

    CAS  PubMed  PubMed Central  Google Scholar 

  66. Sudre CH, Murray B, Varsavsky T, Graham MS, Penfold RS, Bowyer RC, et al. Attributes and predictors of long COVID. Nat Med. 2021;27:626–31.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  67. Government of Canada. Safeguarding your research. 2021. Available from: https://www.ic.gc.ca/eic/site/063.nsf/eng/h_97955.html.

  68. International Council for Harmonisation of Tecnical Requirements for Pharmaceuticals for Human Use. Integrated Addendum to ICH E6(R1): Guideline for Good Clinical Practice E6(R2). 2016. Available from: https://database.ich.org/sites/default/files/E6_R2_Addendum.pdf.

  69. Ministry of Health. Health Equity Impact Assessment Tool (HEIA): Governemnt of Ontario; 2008. [cited 2021 Jul 12]. Available from: https://www.health.gov.on.ca/en/pro/programs/heia/tool.aspx

Download references

Acknowledgements

Not applicable.

Funding

This study is funded by the Canadian Institutes of Health Research (CIHR). The funders have no role in the design or conduct of the study or the decision to publish results.

Author information

Authors and Affiliations

Authors

Contributions

SH is the Principal Investigator; he conceived the study, led the proposal and protocol development. JW is the co-Principal Investigator; he conceived the study, contributed to development of the proposal and protocol. NE is the Clinical Research Program Manager; she drafted the proposal and the protocol. KT is a co-Investigator and Health Economist; she designed the cost-effectiveness analysis plan. DC is a co-Investigator and biostatistician; he developed the statistical analysis plan. All authors contributed to the proposal, refinement of the study protocol, and all authors read and approved the final manuscript.

Corresponding author

Correspondence to Simon Hatcher.

Ethics declarations

Ethics approval and consent to participate {24}

Ethics approval for this study has been granted by the Ottawa Health Sciences Network Research Ethics Board (OHSN-REB) (Protocol ID: 20210533-01H). Written, informed consent to participate will be obtained from all participants.

Consent for publication {32}

Model consent form available from corresponding author on request.

Competing interests {28}

MK has consulting or speaking fees, unrelated to this trial or intervention, from HLS, Janssen, Otsuka, and Lundbeck in the last 2 years. TM, unrelated to this trial or intervention, has been a consultant for CHDI, Sunovion, Valeo Pharma, Roche, Biogen, and nQ Medical and has been involved in Speakers Bureaus for Abbvie and Valeo Pharma.

The other authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hatcher, S., Werier, J., Edgar, N.E. et al. Enhancing COVID Rehabilitation with Technology (ECORT): protocol for an open-label, single-site randomized controlled trial evaluating the effectiveness of electronic case management for individuals with persistent COVID-19 symptoms. Trials 23, 728 (2022). https://doi.org/10.1186/s13063-022-06578-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-022-06578-1

Keywords