- Study protocol
- Open Access
Feasibility of the Enhancing Participation In the Community by improving Wheelchair Skills (EPIC Wheels) program: study protocol for a randomized controlled trial
Trials volume 14, Article number: 350 (2013)
Many older adults rely on a manual wheelchair for mobility but typically receive little, if any, training on how to use their wheelchair effectively and independently. Standardized skill training is an effective intervention, but limited access to clinician trainers is a substantive barrier. Enhancing Participation in the Community by Improving Wheelchair Skills (EPIC Wheels) is a 1-month monitored home training program for improving mobility skills in older novice manual wheelchair users, integrating principles from andragogy and social cognitive theory. The purpose of this study is to determine whether feasibility indicators and primary clinical outcome measures of the EPIC Wheels program are sufficiently robust to justify conducting a subsequent multi-site randomized controlled trial.
A 2 × 2 factorial randomized controlled trial at two sites will compare improvement in wheelchair mobility skills between an EPIC Wheels treatment group and a computer-game control group, with additional wheelchair use introduced as a second factor. A total of 40 community-dwelling manual wheelchair users at least 55 years old and living in two Canadian metropolitan cities (n = 20 × 2) will be recruited. Feasibility indicators related to study process, resources, management, and treatment issues will be collected during data collection and at the end of the study period, and evaluated against proposed criteria. Clinical outcome measures will be collected at baseline (pre-randomization) and post-intervention. The primary clinical outcome measure is wheelchair skill capacity, as determined by the Wheelchair Skills Test, version 4.1. Secondary clinical outcome measures include wheelchair skill safety, satisfaction with performance, wheelchair confidence, life-space mobility, divided-attention, and health-related quality of life.
The EPIC Wheels training program offers several innovative features. The convenient, portable, economical, and adaptable tablet-based, home program model for wheelchair skills training has great potential for clinical uptake and opportunity for future enhancements. Theory-driven design can foster learning and adherence for older adults. Establishing the feasibility of the study protocol and estimating effect size for the primary clinical outcome measure will be used to develop a multi-site randomized controlled trial to test the guiding hypotheses.
Clinical Trials NCT01740635.
Canada has a rapidly growing aging population; over the next 50 years, the proportion of older people is expected to double to more than one in four . With age, the risk of a disabling health condition increases; mobility is the most prevalent area of impairment among older adults in Canada . The number of wheelchairs provided to address mobility issues among older adults is also rising. In 2001, an estimated 81,000 Canadians 65 years and older required a wheelchair for mobility  – a rate four times the national average. A 2004 study  reported that among multiple assistive device users, the manual wheelchair (MWC) was considered third most important, behind eyeglasses and canes. However, the wheelchair also represents a substantial cost to consumers and the health care system. Beyond the cost of purchase, which varies from several hundred to thousands of dollars, our clinical experience has demonstrated that the process of assessment, procurement, fitting, and delivery can reach $10,000 or more. These systemic costs are squandered if older adults are unable to use their wheelchair effectively to participate in important activities of life.
Merely acquiring a wheelchair does not guarantee independence or satisfactory performance with functional activities. In particular, environmental factors, such as carpet, ramps, curbs, gravel, and poor sidewalk conditions, present barriers to mobility and self-propulsion. In Canada, over 90% of older MWC users experienced restricted performance in at least one major life activity  (compared with 15% of those without a mobility device) and nearly 60% require assistance from a family member or other care provider for even basic mobility . Restricted mobility is associated with reduced participation and a loss in social connectedness , which can lead to feelings of isolation, stress, and low self-esteem, impacting overall quality of life . A 2006 study of stroke survivors adjusting to wheelchair use identified substantial restriction in caregivers’ social roles and an increased burden of care . In Canada, 25% of caregivers of the elderly are over 65 years themselves , and risk both acute and overuse injury when assisting with wheelchair use .
In addition, MWC users are at risk of tips and falls, which often result in injury. In Canada, the yearly incidence of tips or falls is estimated to be 5.2%, with 4.2% resulting in injury and 2.5% requiring a visit to an emergency department . In the United States in 2005, wheelchair-related accidents resulted in one death per week and treatment for a hospitalized injury was estimated at $25,000 to 75,000 .
Providing comprehensive skills training is effective, but relies on considerable 1:1 training time. The Wheelchair Skills Training Program  is the only structured training program reported in the literature. An expert clinician provides personal training, typically requiring four to eight sessions of an hour or more. Several studies have demonstrated the Wheelchair Skills Training Program to be safe and practical [12, 13], and randomized controlled trials report a significant improvement in skill capacity among adult MWC users during inpatient rehabilitation  and in the community . Improvements in safety with skill performance have also been reported . While the evidence indicates such training is effective, there has not been widespread clinical adoption and as a result older adults receive little or no structured wheelchair skills training. Even among younger populations receiving inpatient rehabilitation, only 17 to 18% of wheelchair users receive any formal training [17, 18], which typically focuses on such skills as transferring from the wheelchair to the bed, toilet, or bathtub. A survey of older veterans who were prescribed a wheelchair post-stroke found 53% had received no instruction at all on wheelchair use . Another study of US veterans reported that more than 50% had difficulty with even basic wheelchair propulsion, despite having access to a trained clinician and a custom-fitted wheelchair .
Several factors contribute to the current situation of inadequate training. First, many clinicians do not have sufficient knowledge of (or ability to demonstrate) wheelchair skills . Second, other competing demands are often prioritized over wheelchair training during in-hospital rehabilitation. Older adults are frequently discharged with a temporary (standard) wheelchair and delivery of a customized wheelchair occurs in community settings, when therapists’ time is limited. Finally, funding for home care and community-based services in Canada and the United States has been in decline and is insufficient to support clinician-intensive training either before or after discharge [21, 22]. Often, the time and travel demands for both consumers and clinicians make traditional skills training cost-prohibitive . Long wait lists and the inaccessibility of rehabilitation services, particularly in rural areas, further exacerbate the problem [23, 24].
Delivering rehabilitation training as a monitored or self-managed home program among older adults has been effective for a variety of outcomes including strengthening , physical activity , self-care [21, 27] and exercise [28, 29]. Home programs are advantageous because they allow privacy for the user, occur in a familiar context, can be conveniently integrated into the user’s schedule, and do not require the time, effort, and expense of travel . Adherence to any intervention is critical to its effectiveness. A 2010 Cochrane review of exercise interventions found those interventions that incorporated social cognitive theory (that is, self-efficacy), were monitored, and increasingly graded complexity of the activity were more effective in improving adherence, frequency, and duration of exercise .
Computer-related devices are becoming increasingly useful for rehabilitation interventions, with advances in affordability, size, portability, accessibility, and user-interface simplicity. Computer and popular gaming systems have shown promising results in rehabilitation by casting therapy in a more engaging and enjoyable context. Their use for physical activity training in rehabilitation among older adults has demonstrated high participation rates, increased motivation, and tolerance for activity, and trends toward improvement in fitness .
The Enhancing Participation in the Community by Improving Wheelchair Skills program (EPIC Wheels) is an individualized home training program that optimizes learning for older adults while limiting the time demands of expert trainers. The program content and delivery was developed using principles of andragogy (adult learning) [32, 33] and social cognitive (self-efficacy) [34, 35] theory. Using an affordable computer tablet device, EPIC Wheels provides a customized and mobile structured training program for in-chair or tabletop use at home and in the community. A touch-screen audiovisual display features interactive training and practice activities, and wireless Internet connectivity enables trainee-trainer communication and remote trainer monitoring. The EPIC Wheels program is 1 month long and includes a minimum of 10 hours of training and practice. Training includes two personalized sessions with a wheelchair expert; one at the outset and the second at the mid-point of the program.
Prior to moving to a large-scale randomized controlled trial (RCT), it is not only critical but also prudent to ensure that the feasibility indicators and the proposed clinical measures are sufficiently robust. This paper describes the objectives and design of the EPIC Wheels feasibility study that will be used to construct and implement a comprehensive, multi-site RCT trial that directly assesses the guiding hypotheses.
These have been selected to assess the feasibility of study methods and procedures, including:
Process issues of subject recruitment, consent, retention, and perceived benefit.
Resource issues of treatment adherence, burden of data collection, incorporating a health utility index, and intervention burden.
Management issues of tablet reliability, subject processing, and protocol administration.
Treatment issues of safety, response, and treatment effect.
Primary clinical outcome
The aim of the study is to evaluate the effect of EPIC Wheels on wheelchair skill capacity and obtain an estimate of the treatment effect size.
Secondary clinical outcome
The secondary aims are to evaluate the effect of EPIC Wheels on wheelchair skill safety, wheelchair use confidence, satisfaction with activity performance, mobility, divided-attention, and health-related quality of life.
This study uses a two-site RCT to compare differences in older adults’ wheelchair mobility skills between an EPIC Wheels (treatment) group and a cognitive training (control) group, introducing 'extra wheeling’ as a second factor. A 2 × 2 factorial design randomly assigns subjects using a 1:1:1:1 allocation ratio between four groups: EPIC Wheels, EPIC Wheels with extra wheeling, cognitive training, and cognitive training with extra wheeling. To support balance between groups and masking of assignment, a central computerized randomization algorithm was designed by our statistician, with an undisclosed block size and stratified by site (n = 20 at each site). Once subjects are enrolled, a tester collects baseline data before a study coordinator contacts the statistician to obtain group assignment. A trainer will initiate contact with the subject and implement the 1-month program, after which time the tester will re-administer the outcome measures (see Figure 1). To address bias, subjects will be instructed not to discuss their program; separate trainers will be used for the treatment and control groups at each site; and testers will be blinded to group allocation. A protocol is included for control group trainers to identify the potential value of the control intervention for wheelchair mobility and strategies to prevent participant attrition.
The protocol for this study has been approved by the Research Ethics Boards at the University of British Columbia (Approval number, H12-02043) and the University of Manitoba (Approval number, HS15818), as well as the research review committee of the regional health authority for each site. All study subjects, and their caregivers, will provide informed consent prior to enrolment. The study was funded through a peer-reviewed operating grant from the Canadian Institutes of Health Research (MOP-123240).
A total of 40 community-dwelling MWC users living in two Canadian cities (20 at each site) will be recruited on a voluntary basis. Each site will have 20 participants, with five participants in each of four groups: treatment with extra wheeling, treatment without extra wheeling, control with extra wheeling, and control without extra wheeling. To optimize the impact of the treatment, individuals with less than one year of MWC use will be recruited. Novice users are still developing routines and patterns of wheelchair use and are potentially more amenable to adapting their mobility techniques . Subjects will be ≥55 years old; live in the community within the metropolitan boundaries; self-propel a MWC ≥1 hour/day; use their MWC for mobility inside and outside their home; have used a MWC for <1 year; and have a caregiver willing to attend training sessions and supervise home training. There are no specific diagnostic criteria for enrolment; however, subjects must be able to propel a wheelchair with both hands. Individuals will be excluded if they cannot communicate and complete study questionnaires in English; anticipate a health condition or procedure that contraindicates training (for example, surgery scheduled which would impair physical activity); or are currently receiving outpatient therapy that includes wheelchair mobility training. A caregiver for each participant will also provide consent to participate in the study, and both subject and caregiver will indicate whether they are willing to be contacted for follow-up after the study is complete.
To address the feasibility indicators, the number of subjects is large enough to represent the target population and assess the feasibility criteria . In addition, the sample size is powered to detect a statistically significant difference between groups and provide a reasonable estimate of a treatment effect. With a 2 × 2 factorial design, sample size can be calculating using each main factor independently, and then determined by selecting the larger of the two estimates . Our calculations are based on the primary clinical outcome measure (the Wheelchair Skills Test version 4.1, WST), as this will be used in subsequent EPIC Wheels studies. Research in the field of wheelchair skills training is still maturing, with three published studies using actual users, and given the novel home program approach an α of 0.10 was selected to ensure a potentially beneficial treatment effect would not go undetected (Type I error rate). Given the absence of data regarding the impact of extra wheeling, we opted to use a comparable effect size (f = 0.54) in the second factor calculation. To minimize the risk of identifying such an effect merely by chance (Type II error), the study is powered at 90%. Based on a sample size calculation for analysis of covariance (ANCOVA) each of the four groups would require eight subjects for a total of 32 participants. In previous Canadian trials, a 9 to 18% dropout rate has been reported; conservatively adjusting for a 25% dropout rate (32/0.75), a total study N of 44 is planned (n = 11 for each group).
Previously published studies have used younger or mixed age populations; data specific to older adults are not available. We obtained permission to use a data subset (adults >50 years) from a yet-to-be published study (F Routhier, personal communication) that provided WST change scores following training and powered our study to capture a comparable change (m = 9.3%; s = 9.5%). A difference of 9.3% corresponds to an acquisition of three additional skills on the WST; previous studies report that subjects perceive a clinically important difference with such improvements [17, 18]. In fact, the skills performed on the WST are sequenced from simple (for example, rolling forwards) to moderate (for example, propelling on carpet) to complex (for example, ascending a 10° ramp). Research literature reporting on MWC use among older adults specifically implicates carpet, inclines, curbs, gravel, and poor sidewalk conditions as barriers to independent mobility . Acquisition of even one of these important skills could quite reasonably represent a minimally clinically important difference (MCID) to wheelchair users, their caregivers, and those providing training. No formal MCID has been established for the WST; however, using data from a Canadian trial , a smallest detectable difference calculation suggests that a difference of 9.2% would exceed any measurement error or noise . A reliability change index calculation indicates that 3.0% is the minimal detectable change required and is a reasonable proxy for MCID .
Subjects attend an initial session with their respective trainer for 90 to 120 minutes, including orientation to the computer tablet. Subjects are provided with a prepared study tablet and printed reference handbook to engage in their home training program for 2 weeks, with a minimum of 150 minutes of tablet-based activity per week. After 2 weeks, subjects attend a second session with their trainer for 60 to 90 minutes and then continue with their home training program for an additional 2 weeks. The trainer makes follow-up telephone contact at the end of weeks 1 and 3.
The EPIC Wheels program requires trainees to engage in wheelchair activity that they might not otherwise undertake. While it is unlikely that such additional wheelchair use alone would substantially increase skill acquisition or proficiency, to address this potentially confounding variable subjects are randomly allocated into extra wheeling and non-extra wheeling subgroups. Subjects in the extra wheeling subgroups are asked to perform an additional 75 minutes of unstructured wheelchair wheeling per week, which can occur in their home or in the community. Extra wheeling is defined as participants propelling their wheelchair in addition to what they would typically do in the course of daily activities. For these subjects, the training tablet presents a prompting question every 24 hours asking how many minutes of extra wheeling they have performed. Subjects toggle up and down in 5-minute increments and enter their data before the tablet returns to the training activities. Trainers can encourage subjects to increase their extra wheeling activity during follow-up phone calls and training visits if target levels have not been met.
Treatment group (EPIC wheels)
EPIC Wheels trainers are occupational therapists with ≥5 years of clinical experience in wheelchair provision and training, who have received a 2-day comprehensive orientation program. Each training session is administered using a protocol and checklist. Trainers select a subset of skills and training activities to incorporate into the home training program based on ability, safety, and relevance for the subject. The EPIC Wheels home program includes a comprehensive, structured library of educational material and training activities, organized in a hierarchy from simple to complex. Trainers monitor a subject’s progress through online access to tablet usage data and re-assessment during the second training session, revising the home program with more advanced skills and activities.
The home program component is delivered using a 10-inch (≈25 cm) portable ASUS® computer tablet (ASUSTek, Markham, ON). The tablet is menu driven and interactive, using a touch-screen interface. Training is provided in a multi-modal format with illustrations and videos, allowing detailed step-by-step guidance and slow-motion demonstrations. Female and male actors, both close to 70 years of age, were used to provide age-appropriate models in the videos. Practice activities can be clearly demonstrated and include imitative, function-based, and interactive game-related activities. The tablet is mounted on a rigid platform with a simple strap that wraps around the subject’s thighs for use in a wheelchair. A 'progress’ icon provides daily updates on the number of minutes practiced per week to reinforce adherence. Subjects can exchange voicemail with their trainer using an integrated applet. Subjects receive a mobile Internet device for voicemail and data transfer or update capability, but the tablet operates as a single-function device with all other applications disabled.
Control group (cognitive training)
Control group subjects also attend two sessions with their trainer to address attention balance through exposure to study personnel. In addition, they receive an identical tablet pre-loaded with computer games to account for tablet device and activity exposure. Nine different games address problem solving (for example, Tetris, Cogs); word, math, and memory challenges (for example, Scrabble, Sudoku); and dexterity or response skills (for example, Marble Saga, Cut the Rope). Each training session is administered using a protocol and checklist. During the first session, the trainer discusses the potential benefits of computer-game training on cognition and motor function, and how these can positively impact wheelchair mobility. Trainers provide an orientation to the cognitive games and operation of the tablet device. During the second session, the trainer discusses subjects’ current community activities and experience using the wheelchair via a structured discussion guide, and provide verbal information related to barriers encountered, as well as any additional review or training related to the cognitive training games. To minimize attrition and provide wheelchair skill-specific information, the consent form informs control group subjects that they will receive a DVD with a condensed EPIC Wheels education program after the post-intervention data collection is complete.
The home training schedule for both groups targets a minimum of 1 or 2 sessions/day, 15 to 30 minutes in length, at least 5 days per week (minimum 150 minutes/week). These guidelines are based on the National Blueprint consensus document on promoting physical activity for adults over 50 years, which advocates that lifestyle- or endurance-related activity of moderate intensity should be undertaken for at least 30 minutes (in bouts of at least 10 minutes) 5 to 7 days per week . The minimum training time is at least comparable to 1:1 training time in other clinical studies using structured wheelchair skills training, where a significant improvement in skill capacity was observed [17–19]. Adherence to this schedule is achievable, as demonstrated by a study of home-based training program for improving hand function among stroke survivors (n = 77; m = 57 years) which obtained 96% compliance for 1.3 hours of training per day, 7 days per week over 5 weeks .
The EPIC Wheels program incorporates extensive safety-related material, including teaching the safest mobility strategies; use of safety equipment; recognizing unsafe situations; and seeking assistance when skills are insufficient to address environmental barriers. At the initial training session, subjects are provided with protective wheeling gloves. Caregivers attend and participate in both training sessions and encouraged to supervise home training activities. A fitted spotter’s strap and demonstration and instruction are provided for caregiver use during training to prevent wheelchair tips. Operating a wheelchair in the community carries innate risks that cannot be entirely eliminated; however, EPIC Wheels offers education and training designed to minimize risks of wheelchair operation. This knowledge should reduce the risk of a fall or injury that subjects might be exposed to in their everyday use of a MWC had they not received this program. Any unsafe performance observed during training is addressed immediately with corrective feedback. Subjects are encouraged to contact the coordinator immediately if they experience unusual discomfort, pain, or physical symptoms. A data and safety monitoring board, consisting of a statistician, a physiatrist, and a physical therapist, review accumulating indicator data and advise the investigators regarding safety issues, evidence of benefit, and need for modification to the study design . Adverse events are documented by the trainer and reported to the data and safety monitoring board and the ethics review board.
Computer technology uptake
The use of a computer tablet to deliver the home training program offers advantages of portability, audiovisual versatility, flexible configuration, and real-time updating. Although older adults are less likely than younger people to embrace technologies, such as computers, their use of computers continues to grow. Studies in the United States between 2006 and 2010 found 84% of those over 60 years had experience with computers  and 40% of those over 65 years are regular computer and Internet users . Use of a tablet involves some new learning, and age-related declines in memory and fluid intelligence may restrict uptake. These issues are addressed through self-paced training, structures for successful experiences to build confidence, and by adapting the interface for familiarity and ease of use with minimal memory requirements [44, 45]. Consumer, caregiver, and clinician input were incorporated during the EPIC Wheels program development to ensure the delivery format addresses these concerns.
At baseline, wheelchair device characteristics are collected using a modified wheelchair specification form . Descriptive characteristics including age, sex, marital status, highest level of education, primary diagnosis related to MWC use, length of time using the MWC, and propulsion method are collected along with cognitive status measured using the Standardized Mini-Mental Status Exam . Handgrip strength has been demonstrated to be an accurate surrogate measure of overall strength  and is measured using a JamarTM 5030J1 dynamometer (Sammons Preston Rolyan, Chicago, IL).
Feasibility indicators for process, resources, management, and treatment characteristics are collected during study administration and at the study’s end. Process indicators include recruitment, consent, and retention rates at each site. Retention is a critical factor for subsequent clinical trials; follow-up with all discontinued participants regarding their reason for dropout will inform future study design and sample size calculations. A post-treatment participant questionnaire is used to evaluate perceived benefit. Resource indicators are monitored by tracking study staff time logs and tablet usage data. Management issues are evaluated using a trainer evaluation form and by tablet reliability or loss data. Treatment indicators include reporting of adverse events and statistical analysis of the treatment effect.
The clinical outcome measures are collected at baseline (pre-randomization) and post-treatment (1 month). The primary outcome is wheelchair skill capacity, measured using the Wheelchair Skills Test 4.1 (WST) . The WST is a structured assessment with 32 discrete mobility skills required to perform social roles in the community, each scored dichotomously as pass or fail, producing a total skill capacity score (0 to 100%) with a higher score reflecting more skills acquired. The WST is sufficiently sensitive to detect proximal effects of training; can be completed in approximately 30 minutes; and does not demonstrate floor or ceiling effects . Two systematic reviews of available wheelchair skill outcome measures confirmed that the WST has the strongest psychometric properties and has been used most extensively in clinical trials [49, 50]. The WST has demonstrated reliability for test-retest (intraclass correlation coefficient (ICC) = 0.90), intra-rater (ICC = 0.96), and inter-rater (ICC = 0.97) administration . Construct validity has been supported by significant relationships with predictive variables of age, sex, MWC experience, diagnosis, and use of a lightweight wheelchair, which together accounted for 35% of variability in WST score using multiple regression (adjusted R 2 = 0.35) . Concurrent validity has been established through positive correlation with two criterion measures: therapists’ global assessment of user ability (R S = 0.39 - 0.40) and the Functional Independence Measure (admission score R S = 0.38; discharge score R S = 0.31) [16, 51].
Secondary clinical outcomes reflect more distal impacts of the intervention. Given the dearth of evidence in the literature, there is substantial value in understanding the relationship between skill acquisition and safety, confidence, community participation, mobility, and utility. Seven secondary measures contribute to discerning a clinically important impact of the EPIC Wheels intervention.
WST 4.1 skill safety. The WST also provides a total skill safety score (0-100%) reflecting the number of skills addressed in a safe manner (higher score indicates greater safety), regardless of whether the skill is acquired or not. This is of considerable importance, since training also involves learning to recognize risks and limitations.
Wheelchair Outcome Measure (WhOM). The rehabilitation literature strongly suggests the use of measures of user-identified activities of relevance and perceived satisfaction with performance [52–54]. Using an interview format, MWC users are asked to identify relevant activities and rate them for both importance and satisfaction, using an 11-point scale (0 to 10), with higher scores indicating greater importance or satisfaction. The WhOM demonstrates reliability and validity in use among older adults (Test-retest ICC = 0.77 to 1.00; correlation with QUEST r s = 0.36 to 0.45) .
Wheelchair Use Confidence Scale for Manual Wheelchair Users (WheelCon-M 3.0). Self-efficacy has been identified as a key component in the performance of wheelchair mobility skills  and preliminary research has suggested that standardized training can increase wheelchair confidence among older adults . The WheelCon is a self-report questionnaire composed of 65 statements related to confidence using a wheelchair in activities and environments, each rated on a scale from 0 (not confident) to 100 (completely confident), producing a total mean score of 0 to 100 . A 2010 study evaluated test-retest reliability (ICC = 0.84) and significant correlation with comparison measures supporting its validity .
Life-Space Assessment (LSA). The LSA is a 20-item questionnaire that tracks the wheelchair user’s travel on a continuum of five environments from the home to outside of town , and capturing mobility habits over a 4-week period, including frequency of travel and level of assistance required. Scores vary from 0 to 120 and are weighted for frequency and level of assistance, with higher scores reflecting further distance from home, greater frequency of travel, and less assistance required. Evaluation of the LSA among power wheelchair users found excellent test-retest reliability (ICC = 0.87) .
Health Utility Index Mark 3 (HUI3). Health utility measurement is useful in performing cost-utility and cost-effectiveness analyses of new rehabilitation interventions. National guidelines for healthcare economic analyses strongly advocate the use of a validated measure of health-related quality of life, which can be converted to quality-adjusted life years gained, so as to fully inform funding decisions . The HUI3 is a brief questionnaire that asks subjects about their health status, deriving both single- and multiple-attribute utilities to ascertain quality-adjusted life years , and meets the criteria for a valid health-related quality-of-life utility score . Each single-attribute utility is scored between 0.00 and 1.00 and the multiple-attribute utility scale is scored from -0.36 to 1.00, with higher scores reflected better health and quality of life. Our study is not sufficiently powered to undertake a cost-utility analysis, but will determine the feasibility of collecting cost-utility data in a larger RCT and estimate what changes in health-related quality of life might be anticipated.
Wheeling While Talking test (WheelTalk). Wheelchair mobility is a complex skill and prone to risk of tips, falls, and potential injury, particularly with older adult users, where motor and cognitive function may decline with age. The WheelTalk is a new divided-attention assessment for wheelchair users. Scoring reflects the additional number of seconds required to complete a slalom course during the dual-task versus motor task-only condition, with a larger time differential indicating poorer performance. Initial evaluation with residents in a long-term care facility demonstrated reliability for test-retest (ICC = 0.92), intra-rater (ICC = 1.00) and inter-rater (ICC = 1.00) administration . Collecting data in this study will allow investigation of associations between performance and wheelchair skill, safety, and other demographic factors, contributing to validation of this tool.
Data logger. To capture level of activity while in the wheelchair, a data logger (three-axis self-recording accelerometer X16-1C, Gulf Coast Data Concepts, Waveland, MS) is mounted on the drive wheel spokes of each subject’s wheelchair. The data logger is a small, unobtrusive 'black box’ that collects drive wheel movement via an accelerometer over a period of 6 to 10 days. Distance travelled and bouts of travel will be calculated, with larger values reflecting more activity. Collecting these data will allow description and comparison of wheeling patterns and extent of activity among participants. Data loggers are installed at the first training session and removed at the second training session, approximately 2 weeks later.
Study analyses will consider study feasibility indicators as well as clinical (statistical) outcomes. Means and standard deviations (for continuous variables) and frequencies and proportions (for categorical variables) will be used to summarize case mix and outcome variables for groups. Qualitative comparison of variable balance will be made, including determination of prognostic importance . Descriptive statistics of training time and number of training sessions (collected via tablet usage data) will be used to evaluate adherence and explore potential associations between training intensity and measured outcomes.
A detailed description of the feasibility indicators and measurement criteria is provided in Additional file 1. Feasibility indicators will be treated as binary, with 'success’ indicating that the protocol is sufficiently robust to move forwards with the large RCT with only small or no adaptation required, and 'revise’ indicating a need for more substantive change before proceeding. The number and extent of objectives requiring revision will determine whether the feasibility study data can be conflated with those produced in a larger subsequent RCT.
Post-treatment WST skill capacity scores will be compared in the treatment and control groups using analysis of covariance (ANCOVA), controlling for baseline score as a covariate for the primary analysis . Borm et al.  demonstrate that correlation between pre- and post-intervention scores (ρ) influences analysis power; when ρ > 0.5, change score is more powerful than direct post-intervention comparison. However, when ρ lies between 0.2 and 0.8, ANCOVA (controlling for baseline score) further reduces the required sample size by 10 to 40% over change score. Given that preliminary data suggest ρ ~ 0.5 (F Routhier, personal communication), ANCOVA should provide the most powerful analysis, in addition to reducing error variance and allowing modification when statistical assumptions are not met . Unequal cell sizes will be accommodated using Method 1 adjustment  and diagnostic assessments made for model assumptions. Significance testing (P) and marginal means with 95% confidence intervals will be estimated. Effect size (partial η 2) will be calculated as a ratio of the effect and total sums of squares, with a 95% confidence interval. To preserve prognostic balance, primary analysis will be based on intention to treat; however, since one objective is to estimate the treatment effect, secondary analysis on a per-protocol basis (subjects who adhere to treatment) will also be conducted, for comparison .
One argument for potential improvement in wheelchair skills using the EPIC Wheels program is the inducement of subjects to use their wheelchair more, rather than the specific content of the training program. Our factorial design, with extra wheeling as a second factor, will attempt to address this question. Initial analysis will contrast the two main effects: training (EPIC Wheels versus cognitive games) and extra wheeling (yes versus no). Secondary analysis of the interaction contrast between factors may delineate whether additional wheeling has a synergistic or antagonistic effect on the training program.
ANCOVA will be used to compare post-treatment scores between groups for WST skill safety, wheelchair confidence (WheelCon), safety risk (WheelTalk), and mobility (LSA) as a secondary analysis. In each case, baseline score will be used as a covariate. Subjects’ satisfaction with performance of meaningful activities (WhOM score) will be analyzed using analysis of variance (ANOVA). Mean administration time for the HUI3 will be calculated and a preliminary evaluation of change in the treatment group will be conducted. Endpoints and change analyses will also be conducted to compare their precisions with ANCOVA. Summary and descriptive statistics for distance and speed (mean and standard deviation) and bouts of activity (counts) will be calculated for the data logger data.
The EPIC Wheels study is intended to establish the feasibility of a novel intervention designed to improve wheelchair skills and safety among older adult manual wheelchair users. The EPIC Wheels program is innovative in several respects. First, it offers evidence-based skills training in a home training format that has greater potential for clinical uptake. While structured training has been demonstrated to improve skill capacity, access to and related costs of one-on-one training with an expert clinician has restricted widespread adoption. Consolidating the majority of training in a home program with remote electronic monitoring by the clinician makes for a more viable option from an economic and convenience standpoint. Second, EPIC Wheels has a theory-driven design to increase effectiveness among older adults and enhance program adherence, explicitly incorporating principles of social cognitive theory (self-efficacy) and andragogy (adult learning) into the content and delivery format. In addition, older adult stakeholder groups including MWC users, their caregivers, and clinician trainers, were intimately involved during the 1-year program development process. Research related to capacity and a principled teaching method for older adults to learn wheelchair mobility skills is sparse, and this study may provide important new evidence. Third, the use of commercially available and relatively inexpensive tablet technology provides a flexible and versatile mobile training interface. Trainees can practice with the tablet on their wheelchair in their home or community environment and communicate remotely with their trainer, while clinicians can monitor training activity and communication through a web-based interface at their convenience. Finally, the factorial study design will allow broader inferences about the contributions of increased wheelchair activity and the specific attributes of the EPIC Wheels training program, as well as an interaction between these factors.
Owing to the nature of feasibility studies, several inherent limitations arise and will be addressed in the larger multi-site RCT study to follow. The potential for recruitment of novice older adult MWC users is unknown: this is an important feasibility indicator to address for future planning. Assessment of skill retention will not be addressed at this stage. Control group subjects may be more likely to drop out. Providing control group trainers with structured strategies to maintain subject enthusiasm; weekly subject contact; engaging and fun cognitive computer games, and provision of a condensed training DVD at the study conclusion will help mitigate this risk. Demonstration of a treatment effect may lack generalizability, owing to the restricted age group being targeted. Age is inversely related to motor skill acquisition, including wheelchair mobility skills. We anticipate that a training program proven to be effective with older adults should have at least as large a treatment effect in younger and stronger individuals; however, this assumption is as yet untested.
The feasibility indicators of this study will be used to construct and implement a comprehensive, multi-site RCT trial that directly measures the guiding hypotheses. This subsequent study will address skill retention using a 6-month follow-up evaluation. A large RCT will directly address evaluation of important changes in wheelchair skill and safety; wheelchair use confidence; mobility and community participation; and cost-effectiveness. Evidence for the effectiveness of EPIC Wheels would inform clinical best practice and provide justification for a pilot project where a single trainer coordinates service to a large group of wheelchair users across a broad geographical area. EPIC Wheels has great potential for use across age and diagnostic groups, including training for individuals who live in rural and remote locations where access to rehabilitation programs is not practical. EPIC Wheels provides versatility, as it can be delivered on multiple platforms including computers, tablets, smart phones, and traditional DVD. Furthermore, the inherent capacity of the tablet device (that is, GPS, accelerometers) can be incorporated into future EPIC Wheels versions to collect real-time user data on wheelchair performance; to create interactive training activities or games; to evaluate skill performance; and integration with other commercially available technology.
Approval has been obtained from the university Research Ethics Boards and regional health authority Research Review Committees at both sites. All study staff have been hired and trained at both sites and recruitment is currently underway.
Analysis of covariance
Analysis of variance
- EPIC Wheels:
Enhancing participation in the community by improving wheelchair skills
Health utilities index mark 3
Minimally clinically important difference
Randomized controlled trial
Wheeling while talking test
Wheelchair outcome measure
Wheelchair skills test, version 4.1.
Cranswick K, Dosman D: Eldercare: What We Know Today. 2008, Ottawa: Statistics Canada, Catalogue no. 11–008
Statistics Canada: Participation and Activity Limitation Survey 2006: Labour Force Experience of People with Disabilities in Canada. 2008, Ottawa, Catalogue no. 89-628-X
Shields M: Use of wheelchairs and other mobility support devices. Health Rep. 2004, 15: 37-41.
Mann WC, Llanes C, Justiss MD, Tomita M: Frail older adults’ self-report of their most important assistive device. Occup Ther J Res. 2004, 24: 4-12.
Finlayson M, van Denend T: Experiencing the loss of mobility: perspectives of older adults with MS. Disabil Rehabil. 2003, 25: 1168-1180. 10.1080/09638280310001596180.
Simpson RC, LoPresti EF, Cooper RA: How many people would benefit from a smart wheelchair?. J Rehabil Res Develop. 2008, 45: 53-72. 10.1682/JRRD.2007.01.0015.
Laliberte Rudman D, Hebert D, Reid D: Living in a restricted occupational world: the occupational experiences of stroke survivors who are wheelchair users and their caregivers. Can J Occup Ther. 2006, 73: 141-152.
Kirby RL, Mifflen NJ, Thibault DL, Smith C, Best KL, Thompson KJ, MacLeod DA: The manual wheelchair-handling skills of caregivers and the effect of training. Arch Phys Med Rehabil. 2004, 85: 2011-2019. 10.1016/j.apmr.2004.02.014.
Kirby RL, Ackroyd-Stolarz SA, Brown MG, Kirkland SA, MacLeod DA: Wheelchair-related accidents caused by tips and falls among noninstitutionalized users of manually propelled wheelchairs in Nova Scotia. Am J Phys Med Rehabil. 1994, 73: 319-330. 10.1097/00002060-199409000-00004.
Gavin-Dreschnack D, Nelson A, Fitzgerald S, Harrow J, Sanchez-Anguiano A, Ahmed S, Powell-Cope G: Wheelchair-related falls: current evidence and directions for improved quality care. J Nurs Care Qual. 2005, 20: 119-127. 10.1097/00001786-200504000-00006.
Kirby RL: Wheelchair Skills Program Version 4.1. [http://www.wheelchairskillsprogram.ca/eng/trainers_archive.php]
Coolen AL, Kirby RL, Landry J, MacPhee AH, Dupuis D, Smith C, Best KL, MacKenzie DE, MacLeod DA: Wheelchair skills training program for clinicians: a randomized controlled trial with occupational therapy students. Arch Phys Med Rehabil. 2004, 85: 1160-1167. 10.1016/j.apmr.2003.10.019.
Kirby RL, Dupuis DJ, Macphee AH, Coolen AL, Smith C, Best KL, Newton AM, Mountain AD, MacLeod DA, Bonaparte JP: The Wheelchair Skills Test (version 2.4): measurement properties. Arch Phys Med Rehabil. 2004, 85: 794-804. 10.1016/j.apmr.2003.07.007.
MacPhee AH, Kirby RL, Coolen AL, Smith C, MacLeod DA, Dupuis DJ: Wheelchair skills training program: a randomized clinical trial of wheelchair users undergoing initial rehabilitation. Arch Phys Med Rehabil. 2004, 85: 41-50.
Best KL, Kirby RL, Smith C, MacLeod DA: Wheelchair skills training for community-based manual wheelchair users: a randomized controlled trial. Arch Phys Med Rehabil. 2005, 86: 2316-2323. 10.1016/j.apmr.2005.07.300.
Ozturk A, Ucsular FD: Effectiveness of a wheelchair skills training programme for community-living users of manual wheelchairs in Turkey: a randomized controlled trial. Clin Rehabil. 2011, 25: 416-424. 10.1177/0269215510386979.
Karmarkar AM, Collins DM, Kelleher A, Ding D, Oyster M, Cooper RA: Manual wheelchair-related mobility characteristics of older adults in nursing homes. Disabil Rehabil Assist Technol. 2010, 5: 428-437. 10.3109/17483107.2010.481346.
Smith C, Kirby RL: Manual wheelchair skills capacity and safety of residents of a long-term care facility. Arch Phys Med Rehabil. 2011, 92: 663-669. 10.1016/j.apmr.2010.11.024.
Garber SL, Bunzel R, Monga TN: Wheelchair utilization and satisfaction following cerebral vascular accident. J Rehabil Res Dev. 2002, 39: 521-534.
Ganesh S, Hayter A, Kim J, Sanford J, Sprigle S, Hoenig H: Wheelchair use by veterans newly prescribed a manual wheelchair. Arch Phys Med Rehabil. 2007, 88: 434-439. 10.1016/j.apmr.2006.12.045.
Gill TM, Baker DI, Gottschalk M, Peduzzi PN, Allore H, Byers A: A program to prevent functional decline in physically frail, elderly persons who live at home. N Engl J Med. 2002, 347: 1068-1074. 10.1056/NEJMoa020423.
Tousignant M, Dubuc N, Hebert R, Coulombe C: Home-care programmes for older adults with disabilities in Canada: how can we assess the adequacy of services provided compared with the needs of users?. Health Soc Care Community. 2007, 15: 1-7.
Sanford JA, Griffiths PC, Richardson P, Hargraves K, Butterfield T, Hoenig H: The effects of in-home rehabilitation on task self efficacy in mobility-impaired adults: a randomized clinical trial. J Am Geriatr Soc. 2006, 54: 1641-1648. 10.1111/j.1532-5415.2006.00913.x.
Tousignant M, Boissy P, Corriveau H, Moffet H: In home telerehabilitation for older adults after discharge from an acute hospital or rehabilitation unit: a proof-of-concept study and costs estimation. Disabil Rehabil Assist Technol. 2006, 1: 209-216. 10.1080/17483100600776965.
Layne JE, Sampson SE, Mallio CJ, Hibberd PL, Griffith JL, Das SK, Flanagan WH, Castaneda-Sceppa C: Successful dissemination of a community-based strength training program for older adults by peer and professional leaders: the people exercising program. J Am Geriatr Soc. 2008, 56: 2323-2329. 10.1111/j.1532-5415.2008.02010.x.
Jette AM, Rooks D, Lachman M, Lin TH, Levenson C, Heislein D, Giorgetti MM, Harris BA: Home-based resistance training: predictors of participation and adherence. Gerontologist. 1998, 38: 412-421. 10.1093/geront/38.4.412.
Hoenig H, Sanford JA, Butterfield T, Griffiths PC, Richardson P, Hargraves K: Development of a teletechnology protocol for in-home rehabilitation. J Rehabil Res Develop. 2006, 43: 287-298. 10.1682/JRRD.2004.07.0089.
Campbell AJ, Robertson MC, Gardner MM, Norton RN, Tilyard MW, Buchner DM: Randomised controlled trial of a general practice programme of home based exercise to prevent falls in elderly women. BMJ. 1997, 315: 1065-1069. 10.1136/bmj.315.7115.1065.
Tinetti ME, Baker DI, McAvay G, Claus EB, Garrett P, Gottschalk M, Koch ML, Trainor K, Horwitz RI: A multifactorial intervention to reduce the risk of falling among elderly people living in the community. N Engl J Med. 1994, 331: 821-827. 10.1056/NEJM199409293311301.
Jordan JL, Holden MA, Mason EE, Foster NE: Interventions to improve adherence to exercise for chronic musculoskeletal pain in adults. Cochrane Database Syst Rev. 2010, 1: CD005956-doi: 10.1002/14651858.CD005956.pub2
Aarhus R, Gronvall E, Larsen SB, Wollsen S: Turning training into play: embodied gaming, seniors, physical training and motivation. Gerontechnology. 2011, 10: 110-120.
Merriam SB: Andragogy and self-directed learning: pillars of adult learning theory. New Dir Adult Cont Educ. 2001, 89: 3-13.
Shaughnessy M, Resnick BM: Using theory to develop an exercise intervention for patients post stroke. Top Stroke Rehabil. 2009, 16: 140-146. 10.1310/tsr1602-140.
Bandura A: Self-Efficacy: The Exercise of Control. 1997, New York: WH Freeman and Company
Knowles MS: The Modern Practice of Adult Education: From Pedagogy to Andragogy. 1980, New York: The Adult Education Company
Altman DG: Comparability of randomised groups. Statistician. 1985, 34: 125-136. 10.2307/2987510.
Montgomery MM, Peters TJ, Little P: Design, analysis and presentation of factorial randomised controlled trials. BMC Med Res Method. 2003, 3: 26-30. 10.1186/1471-2288-3-26.
Beaton DE, Boers M, Wells GA: Many faces of the minimal clinically important difference (MCID): a literature review and directions for future research. Curr Opin Rheumatol. 2002, 14: 109-114. 10.1097/00002281-200203000-00006.
Cress ME, Buchner DM, Prohaska T, Rimmer J, Brown M, Macera C, Dipietro L, Chodzko-Zajko W: Best practices for physical activity programs and behavior counseling in older adult populations. J Aging Phys Act. 2005, 13: 61-74.
Alon G, Sunnerhagen KS, Geurts AC, Ohry A: A home-based, self-administered stimulation program to improve selected hand functions of chronic stroke. Neuro Rehabil. 2003, 18: 215-225.
DeMets DL: Data and safety monitoring boards. Encyclopedia of Biostatistics. Edited by: Armitage P, Colton T. 1998, Chichester: Wiley, 1066-1071.
Czaja SJ, Charness N, Fisk AD, Hertzog C, Nair SN, Rogers WA, Sharit J: Factors predicting the use of technology: findings from the Center for Research and Education on Aging and Technology Enhancement (CREATE). Psychol Aging. 2006, 21: 333-352.
Charness N, Fox MC, Mitchum AL: Lifespan cognition and information technology. Handbook of Lifespan Psychology. Edited by: Fingerman K, Berg C, Antonnuci T, Smith J. 2010, New York: Springer
Callahan JS, Kiker DS, Cross T: Does method matter? A meta-analysis of the effects of training method on older learner training performance. J Manag. 2003, 29: 663-680.
Jay GM, Willis SL: Influence of direct computer experience on older adults’ attitude toward computers. J Gerontol Psychol Sci. 1992, 47: P250-P257.
Wheelchair Skills Training Program. Wheelchair Specifications Form. [http://www.wheelchairskillsprogram.ca]
Molloy D, Alemayehu E, Roberts R: Reliability of a standardized mini-mental state examination compared with the traditional mini-mental state examination. Am J Psychiatry. 1991, 148: 102-105.
Friedman LM, Furberg CD, DeMets DL: Fundamentals of Clinical Trials. 2010, New York: Springer Science + Business Media, 4
Kilkens OJ, Post MW, Dallmeijer AJ, Seelen HA, van der Woude LH: Wheelchair skills tests: a systematic review. Clin Rehabil. 2003, 17: 418-430. 10.1191/0269215503cr633oa.
Kirby RL, Swuste J, Dupuis DJ, MacLeod DA, Monroe R: The wheelchair skills test: a pilot study of a new outcome measure. Arch Phys Med Rehabil. 2002, 83: 10-18. 10.1053/apmr.2002.26823.
Hammel J, Magasi S, Heinemann A, Whiteneck G, Bogner J, Rodriguez E: What does participation mean? An insider perspective from people with disabilities. Disabil Rehabil. 2008, 30: 1445-1460. 10.1080/09638280701625534.
Hoenig H, Giacobbi P, Levy CE: Methodological challenges confronting researchers of wheeled mobility aids and other assistive technologies. Disabil Rehabil Assist Technol. 2007, 2: 159-168. 10.1080/17483100701374405.
Mallinson T, Fischer H: Rehabilitation research. Am J Occup Ther. 2010, 64: 506-514. 10.5014/ajot.2010.09080.
Mortenson WB, Miller WC, Auger C: Issues for the selection of wheelchair-specific activity and participation outcome measures: a review. Arch Phys Med Rehabil. 2008, 89: 1177-1186. 10.1016/j.apmr.2008.01.010.
Demers L, Weiss-Lambrou R, Ska B: The Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0): an overview and recent progress. Technol Disabil. 2002, 14: 101-105.
Rushton PW, Miller WC: Development of an assessment to measure self-efficacy with wheelchair mobility [abstract]. Can J Occup Therap. 2009, 76: [http://www.caot.ca/conference/2009/OnSite%2009.pdf]
Sakakibara B, Miller WC, Souza M, Nikolova V, Best KL: Wheelchair skills training to improve confidence with using a manual wheelchair among older adults: a pilot study. Arch Phys Med Rehabil. 2013, 94: 1031-1037. 10.1016/j.apmr.2013.01.016.
Rushton PW, Miller WC, Lee Kirby R, Eng JJ, Yip J: Development and content validation of the wheelchair use confidence scale: a mixed-methods study. Disabil Rehabil Assist Technol. 2011, 6: 57-66. 10.3109/17483107.2010.512970.
Rushton PW, Miller WC, Mortenson WB, Garden J: Satisfaction with participation using a manual wheelchair among individuals with spinal cord injury. Spinal Cord. 2010, 48: 691-696. 10.1038/sc.2009.197.
Auger C, Demers L, Gelinas I, Miller WC, Jutai JW, Noreau L: Life-space mobility of middle-aged and older adults at various stages of usage of power mobility devices. Arch Phys Med Rehabil. 2010, 91: 765-773. 10.1016/j.apmr.2010.01.018.
Auger C, Demers L, Gelinas I, Routhier F, Jutai J, Guerette C, Deruyter F: Development of a French-Canadian version of the Life- Space Assessment (LSA-F): content validity, reliability and applicability for power mobility device users. Disabil Rehabil Assist Technol. 2009, 4: 31-41. 10.1080/17483100802543064.
Torrance GW, Furlong W, Feeny D: Health utility estimation. Expert Rev Pharmacoecon Outcomes Res. 2002, 2: 99-108. 10.1586/1473718.104.22.168.
Canadian Agency for Drugs and Technologies in Health: Guidelines for the Economic Evaluation of Health Technologies: Canada. 2006, Ottawa, 3
Jones CA, Feeny D, Eng K: Test-retest reliability of health utilities index scores: evidence from hip fracture. Int J Technol Assess Health Care. 2005, 21: 393-398.
Horsman J, Furlong W, Feeny D, Torrance G: The Health Utilities Index: concepts, measurement properties and applications. Health Qual Life Outcomes. 2003, 1: 54-10.1186/1477-7525-1-54.
Giesbrecht E, Miller WC: Development of the wheeling while talking test. Rehabilitation Engineering and Assistive Technology Society of North America Conference Proceedings: 20–24 June 2013. 2013, Bellevue, WA, [http://resna.org/conference/proceedings/2013/PDF%20Versions/Outcomes/Student%20Papers/Giesbrecht.pdf]
Tabachnick BG, Fidell LS: Using Multivariate Statistics. 2007, Boston, MA: Pearson Education Inc, 5
Borm GF, Fransen J, Lemmens WA: A simple sample size formula for analysis of covariance in randomized clinical trials. J Clin Epidemiol. 2007, 60: 1234-1238. 10.1016/j.jclinepi.2007.02.006.
Dimitrov DM, Rumrill PD: Pretest-posttest designs and measurement of change. Work. 2003, 20: 159-165.
Overall JE, Spiegel DK: Concerning least squares analysis of experimental data. Psychol Bull. 1969, 72: 311-322.
Moncur R, Larmer J: Clinical applicability of intention-to-treat analyses. McMaster Univ Med J. 2009, 6: 39-41.
This study was funded by an operating grant from the Canadian Institutes of Health Research (MOP-123240). EMG is supported by a doctoral fellowship from the Canadian Institutes of Health Research.
The authors declare that they have no competing interests.
WCM was responsible for administration of the grant, oversight of the study, and first site lead. JJE provided guidance with the research design and implementation. IMM was instrumental in the development of the tablet software applications and provided ongoing technology design and support for the computer tablet software application. CHG provided expertise in the RCT design and analysis as well as cost-utility and cost-effectiveness evaluation. RLW contributed to the program evaluation and development research phase. EMG was primarily responsible for development of the intervention, pilot testing, and the second site lead. EMG wrote the first draft of the manuscript and all authors reviewed and contributed to the final version.
Electronic supplementary material
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Giesbrecht, E.M., Miller, W.C., Eng, J.J. et al. Feasibility of the Enhancing Participation In the Community by improving Wheelchair Skills (EPIC Wheels) program: study protocol for a randomized controlled trial. Trials 14, 350 (2013). https://doi.org/10.1186/1745-6215-14-350
- Cognitive computer games
- Home-based training
- Manual wheelchair
- Older adults