A Randomized trial of an Asthma Internet Self-management Intervention (RAISIN): study protocol for a randomized controlled trial
© Morrison et al.; licensee BioMed Central Ltd. 2014
Received: 13 February 2014
Accepted: 2 May 2014
Published: 24 May 2014
The financial costs associated with asthma care continue to increase while care remains suboptimal. Promoting optimal self-management, including the use of asthma action plans, along with regular health professional review has been shown to be an effective strategy and is recommended in asthma guidelines internationally. Despite evidence of benefit, guided self-management remains underused, however the potential for online resources to promote self-management behaviors is gaining increasing recognition. The aim of this paper is to describe the protocol for a pilot evaluation of a website ‘Living well with asthma’ which has been developed with the aim of promoting self-management behaviors shown to improve outcomes.
The study is a parallel randomized controlled trial, where adults with asthma are randomly assigned to either access to the website for 12 weeks, or usual asthma care for 12 weeks (followed by access to the website if desired). Individuals are included if they are over 16-years-old, have a diagnosis of asthma with an Asthma Control Questionnaire (ACQ) score of greater than, or equal to 1, and have access to the internet. Primary outcomes for this evaluation include recruitment and retention rates, changes at 12 weeks from baseline for both ACQ and Asthma Quality of Life Questionnaire (AQLQ) scores, and quantitative data describing website usage (number of times logged on, length of time logged on, number of times individual pages looked at, and for how long). Secondary outcomes include clinical outcomes (medication use, health services use, lung function) and patient reported outcomes (including adherence, patient activation measures, and health status).
Piloting of complex interventions is considered best practice and will maximise the potential of any future large-scale randomized controlled trial to successfully recruit and be able to report on necessary outcomes. Here we will provide results across a range of outcomes which will provide estimates of efficacy to inform the design of a future full-scale randomized controlled trial of the ‘Living well with asthma’ website.
This trial is registered with Current Controlled Trials ISRCTN78556552 on 18/06/13.
KeywordsAsthma Self-management Adherence E-health Randomized controlled trial Complex intervention Inhaled corticosteroids Behaviour change
Asthma is common, affecting an estimated 300 million people worldwide. The financial costs associated with asthma care continue to increase, while care remains suboptimal - patients continue to overestimate their asthma control, tolerating more symptoms and greater limitations than necessary[3, 4]. Promoting self-management, including the use of asthma action plans, along with regular health professional review has been shown to be an effective strategy leading to improved outcomes including improved quality of life, lower rates of healthcare contacts, and fewer days off work and school, and is a recommendation in worldwide asthma guidelines[5–9]. Self-management support aims to improve outcomes in a number of ways: better recognition of deterioration of symptoms, more appropriate responses to exacerbations, and optimizing adherence to medication. Improving adherence to inhaled corticosteroids is crucial to avoid exacerbations, improve day to day control, and reduce the risk of hospitalization and death. Adherence to treatments in many chronic illnesses is low and asthma is no exception[12, 13]. Research into non-adherence suggests several rationales, but in common with other chronic conditions recurring themes relate to doubts about the need for the medications in the first place, and concerns about potential side-effects of treatments[12, 14].
Despite evidence of benefits, guided self-management remains underused[9–11]. Online interactive tools to support asthma self-management in general have been trialed out with the UK and there is increasing evidence that they may be safe and effective, enabling patients to take a more proactive role, improving asthma quality of life scores and symptoms (and in some cases forced expiratory volume in 1 second (FEV1))[15–18], and potentially demonstrating cost-effectiveness. This suggests that making effective use of available technologies may have the potential to increase uptake of self-management behaviors in those with asthma, without additional cost. How best to achieve this is still not clear.
‘Living well with asthma’ resource development
We developed an online resource ‘Living well with asthma’ which aims to promote optimal self-management behaviors known to lead to improved outcomes. Exploratory focus group discussions with adults with asthma and primary care nurses clarified the key features deemed most important in a website. These data, along with a preceding literature review, informed the initial development of a prototype of the website. The actual content of the pages within the website was developed and refined iteratively with input from adults with asthma, practice nurses, general practitioners, a sociologist, human computer interactions researchers, respiratory physicians, and a health psychologist. Further refinement of the content was undertaken using ‘Think aloud’ studies with adults with asthma. These were undertaken by DM, and participants fed back in real time their views on the contents and usability. Initially this was on paper mock-ups of proposed web pages, and latterly on actual ‘Living well with asthma’ webpages. ‘Think aloud’ studies are a recognized method of gaining information about users’ views in real time as they navigate around a website, providing information about usability and feeding into further development and refinement of the website[21, 22]. The ‘Living well with asthma’ website was developed as a standalone resource which should complement face-to-face asthma reviews, but does not require health professional involvement.
A full description of the website development will be available in a forthcoming publication.
Rationale for the evaluation methods
Guidance for the development of complex interventions recommends pilot and feasibility studies prior to formal evaluations[23, 24]. A pilot study is a version of the main study that is run in miniature to test whether the components of the main study can all work together, whereas a feasibility study is used to estimate important parameters that are needed to design the main study, such as ease of recruitment, standard deviations of outcome measures, and follow-up rates[25, 26]. This study aims to address both issues. Feasibility and piloting are essential to ensure that planned progression to a full-scale randomized controlled trial (RCT) is appropriate in the first place and if it can be undertaken with appropriate power to achieve definitive results. This early evaluation must be broad enough to provide information both about how a full-scale RCT may work in practice but should also have consideration for how the resource may be used beyond the evaluation. Feasibility is investigated through measuring recruitment and retention rates and collecting usability data about the website itself. Measuring clinical outcomes will allow for the collection of important data on the efficacy of the intervention and for the estimation of effect sizes in any future larger RCT.
This study aims firstly to assess the feasibility of conducting a RCT of the clinical effectiveness of an online asthma resource aimed at promoting adherence in adults with poorly controlled asthma, using the ‘Living well with asthma’ resource. Secondly, as a pilot study the aim is to provide estimates of recruitment and retention rates, as well as estimates of the variability of clinical and behavioral outcome measures to inform power calculations for a definitive trial. The study will collect a range of information about the way the intervention was used, including but not limited to: the most and least visited pages, the length of time the intervention was accessed, and how often it was accessed. Finally, this pilot and feasibility study also aims to identify any potential problems to be addressed, and allow for further development of the resource, before a further evaluation.
We hypothesize that this intervention, which has been designed with end user involvement and aims to improve adherence to therapy using multiple strategies (educational information, attitudinal arguments, self-monitoring, and reminders), will result in improved symptom control and quality of life measures in adults with asthma.
Ethical approval and trial registration
Ethical approval for this study was granted by the West of Scotland Research Ethics Committee (ref 13/WOS/004) in March 2013. All participants provided written informed consent. The trial was conducted in accordance with national laws, Good Clinical Practice guidelines and the Declaration of Helsinki 2002. This trial is registered with Current Controlled Trials ISRCTN78556552.
Recruitment, randomization and blinding
Inclusion and exclusion criteria
1. Written informed consent
1. Unstable asthma
2. Age 16 years or older
2. Presence of active lung disease other than asthma
3. Diagnosis of asthma by a health professional and duration of asthma symptoms ≥ 1 year.
3. Mental impairment or language difficulties that make informed consent impossible.
4. Asthma Control Questionnaire score (6 questions version) greater than or equal to 1 (suggesting poorly controlled asthma)
4. Terminal illness
5. Ability to access the internet (excluding via smart phone or tablet).
5. Cognitive impairment.
Consenting participants fulfilling our inclusion and exclusion criteria are being randomized using a third party automated telephone interactive voice response system. Participants will self-complete all questionnaires. Due to the nature of the intervention the blinding of the researcher is not practical, however data will be entered and managed by the Robertson Centre for Biostatistics (RCB), University of Glasgow, and the researcher will take no role in this. The data will be analyzed by a researcher blinded to the allocation of the groups.
This resource will not advise medication changes directly, but if indicated, may suggest making an appointment with a nurse or doctor for review. Clear advice will be presented for seeking help in an emergency.
Those randomized to usual care will be advised to continue to manage their asthma as they would usually. After the follow-up visit at 12 weeks, participants in the control group will be offered 12 weeks of access to the website if they choose.
The primary endpoints for this study are: recruitment and retention rates at 12 weeks from baseline, web usability, and changes at 12 weeks from baseline for ACQ and AQLQ scores. Recruitment and retention rates will be measured as well as usage data at 12 weeks, including number of times users logged in and total length of time logged in, number of times individual pages were viewed, and length of time spent on each page.
The first secondary endpoint for this study will be changes at 12 weeks from baseline for Patient Activation Measure (PAM) score, EQ-5D score (generic measure of health related quality of life), the Morisky Medication Adherence Scale (MMAS), lung function (via pre bronchodilator spirometry FEV1, FEV1/FVC (forced vital capacity), peak expiratory flow (PEF) performed to American Thoracic Society (ATS) s tandards, and fractional exhaled nitric oxide levels (FeNO) performed to ATS standards.
The second secondary endpoint will be changes in the Problematic Experiences of Therapy Scale (PETS) score at 12 weeks in the intervention group only. The third secondary endpoint will be self-reported healthcare utilization including: routine visit to GP or practice nurse because of asthma, visit to GP because of asthma requiring oral steroids, hospital admission (and length of stay) because of asthma requiring oral steroids, emergency or out of hours’ visit because of asthma requiring oral steroids, and emergency or out of hours’ visit of patients to the GP or GP visit to patient at home because of asthma requiring oral steroids. The fourth secondary endpoint will be self-reported medication utilization including: changes in the level of adherence to prescribed preventer medications, changes to the average number of reliever puffs taken per week, intensification of treatment, or step-up of asthma medications (as defined by British Thoracic Society/Scottish Intercollegiate Guidelines Network (BTS/SIGN) guidelines, and step-down of asthma medications (as defined by BTS/SIGN guidelines).
Statistical considerations and data handling
While this study is not powered to detect differences in clinical measures, we will report estimates of effect sizes with a 95% confidence interval. The primary objectives include determining recruitment and retention rates to inform the feasibility of running a full-scale trial. We shall recruit 50 participants to estimate these quantities with reasonable precision. For example, if we invite 100 participants to recruit 50, the recruitment rate would be estimated with a confidence interval of ± 10%. Patient characteristics and outcomes will be summarized at baseline, at follow-up, and as changes over baseline. Study groups will be compared using baseline-adjusted linear regression (analysis of covariance (ANCOVA). The effects of baseline and intermediate data on patient outcomes will be explored using linear regression. The variability of outcome data will be used to estimate the sample size required for a definitive study.
The RCB, part of the Glasgow Clinical Trials Unit (a fully registered UKCRN Clinical Trials Unit) are managing the randomization procedures and the trial data. Case report forms (CRF) will be used to collect study data. The CRF has been developed by the researcher and the RCB. The RCB are responsible for collating study data.
Trial management group and patient safety
The routine management of the trial will be coordinated by the trial management group. This will comprise the chief investigator (DM) and four co-investigators (FM, SW, NT, and AM). This group will monitor the progress of the trial to ensure that the protocol is adhered to. This group will meet bimonthly, with monthly recruitment reports via email. Any changes to the study protocol will be following agreement with the trial management group, and subject to approval from Research and Development at NHS Greater Glasgow and Clyde, and the West of Scotland Research Ethics Committee, where required.
The study will end when the trial management group agrees that either the planned sample size has been achieved or the recruitment is so poor that completion of the trial is not feasible.
Only adverse events that are outcome measures will be recorded. All serious adverse events (SAEs) will be recorded at follow-up. All SAEs will be assessed for causality, expectedness, and severity. This assessment is the responsibility of the chief investigator (CI). The trial team will record all SAEs. The CI will endeavor to obtain sufficient information to determine the causality of the adverse event and must provide an opinion of the causal relationship between each SAE and the study intervention. The accumulated SAEs will be sent to the sponsor and the West of Scotland Research Ethics Committee in an annual safety report. Detailed records of all SAEs will be held in the trial master file.
Annual safety reports
It shall be the responsibility of the trial management group on behalf of the sponsor to submit, once a year throughout the clinical trial, or on request, a safety report to the West of Scotland Research Ethics Committee.
The increasing burden of chronic disease on healthcare providers is well known, and promoting self-care is a strategy for shifting this burden away from healthcare providers. The Internet may provide a cost-effective medium for doing this. Piloting of complex interventions is considered best practice and will maximize the potential of any future full-scale RCT to successfully recruit and be able to report on necessary outcomes. Here we report on feasibility outcomes such as recruitment, retention, and usability of the intervention being investigated, and undertake piloting of an intervention which will aim to determine clinical efficacy.
Recruitment was initiated in June 2013, with the first patient randomized in September 2013, and is ongoing as of February 2014.
Asthma Control Questionnaire
Asthma Quality of Life Questionnaire
American Thoracic Society
British Thoracic Society/Scottish Intercollegiate Network
Case Report Form
Controlled Trial of Investigational Medicinal Product
Fractional Exhaled Nitric Oxide
- FEV1 :
Forced Expiratory Volume in 1 second
Forced Vital Capacity
Morisky Medication Adherence Scale
Patient Activation Measure
Peak Expiratory Flow
Problems of Experienced Therapy Scale
Robertson Centre for Biostatistics
Randomized Controlled Trial
Serious Adverse Event.
Thanks to the Chief Scientist Office who funded this project (ref CAF 11/08). The authors would also like to thank Professor Mike Thomas who provided feedback during protocol development, and Professor Lucy Yardley for her assistance in modifying the PETS questionnaire for use in this study.
- Masoli M, Fabian D, Holt S, Beasley R, Global Initiative for Asthma (GINA) Program: The global burden of asthma: executive summary of the GINA Dissemination Committee report. Allergy. 2004, 59: 469-478. 10.1111/j.1398-9995.2004.00526.x.View ArticlePubMedGoogle Scholar
- Bahadori K, Doyle-Waters MM, Marra C, Lynd L, Alasaly K, Swiston J, Fitzgerald JM: Economic burden of asthma: a systematic review. BMC Pulm Med. 2009, 9: 24-10.1186/1471-2466-9-24.View ArticlePubMedPubMed CentralGoogle Scholar
- Rabe KF, Adachi M, Lai CKW, Soriano JB, Vermeire PA, Weiss KB, Weiss ST: Worldwide severity and control of asthma in children and adults: the global asthma insights and reality surveys. J Allergy Clin Immunol. 2004, 114: 40-47. 10.1016/j.jaci.2004.04.042.View ArticlePubMedGoogle Scholar
- Haughney J, Barnes G, Partridge M, Cleland J: The living & breathing study: a study of patients’ views of asthma and its treatment. Prim Care Respir J. 2004, 13: 28-35. 10.1016/j.pcrj.2003.11.007.View ArticlePubMedGoogle Scholar
- British Thoracic Society: British guideline on the management of Asthma. Thorax. 2008, SupplIV: iv1-iv121.Google Scholar
- Powell H, Gibson PG: Options for self-management education for adults with asthma [Systematic Review]. Cochrane Database Syst Rev. 2002, CD004107:Google Scholar
- Thoonen BP, Schermer TR, van den Boom G, Molema J, Folgering H, Akkermans RP, Grol R, van Weel C, van Schayck CP: Self-management of asthma in general practice, asthma control and quality of life: a randomised controlled trial. Thorax. 2003, 58: 30-36. 10.1136/thorax.58.1.30.View ArticlePubMedPubMed CentralGoogle Scholar
- Gibson PG, Powell H, Wilson A, Abramson MJ, Haywood P, Bauman A, Hensley MJ, Walters EH, Roberts JJL: Self-management education and regular practitioner review for adults with asthma [Systematic Review]. Cochrane Database Syst Rev. 2002, CD001117-Google Scholar
- GINA: From the Global Strategy for Asthma Management and Prevention, Global Initiative for Asthma (GINA). 2012, Available from: http://www.ginasthma.org/ Google Scholar
- Aarne L: Guided self management of asthma − how to do it. BMJ. 1999, 319: 759-760. 10.1136/bmj.319.7212.759.View ArticleGoogle Scholar
- Sims EJ, Price D, Haughney J, Ryan D, Thomas M: Current control and future risk in Asthma management. Allergy Asthma Immunol Res. 2011, 3: 217-225. 10.4168/aair.2011.3.4.217.View ArticlePubMedPubMed CentralGoogle Scholar
- Horne R: Compliance, adherence, and concordance: implications for asthma treatment. Chest. 2006, 130: 65S-72S. 10.1378/chest.130.1_suppl.65S.View ArticlePubMedGoogle Scholar
- Heaney LG, Horne R: Non-adherence in difficult asthma: time to take it seriously. Thorax. 2012, 67: 268-270. 10.1136/thoraxjnl-2011-200257.View ArticlePubMedGoogle Scholar
- Pound P, Britten N, Morgan M, Yardley L, Pope C, Daker-White G, Campbell R: Resisting medicines: a synthesis of qualitative studies of medicine taking. Soc Sci Med. 2005, 61: 133-155. 10.1016/j.socscimed.2004.11.063.View ArticlePubMedGoogle Scholar
- van der Meer V, Bakker MJ, van den Hout WB, Rabe KF, Sterk PJ, Kievit J, Assendelft WJ, Sont JK, SMASHING (Self-Management in Asthma Supported by Hospitals, ICT, Nurses and General Practitioners) Study Group: Internet-Based Self-management plus education compared with usual care in Asthma. Ann Intern Med. 2009, 151: 110-120. 10.7326/0003-4819-151-2-200907210-00008.View ArticlePubMedGoogle Scholar
- Chan DS, Callahan CW, Hatch-Pigott VB, Lawless A, Proffitt HL, Manning NE, Schweikert M, Malone FJ: Internet-based home monitoring and education of children with Asthma is comparable to ideal office-based care: results of a 1-year Asthma in-home monitoring trial. Pediatrics. 2007, 119: 569-578. 10.1542/peds.2006-1884.View ArticlePubMedGoogle Scholar
- Rasmussen LM, Phanareth K, Nolte H, Backer V: Internet-based monitoring of asthma: a long-term, randomized clinical study of 300 asthmatic subjects. J Allergy Clin Immunol. 2005, 115: 1137-1142. 10.1016/j.jaci.2005.03.030.View ArticlePubMedGoogle Scholar
- Hashimoto S, Brinke AT, Roldaan AC, van Veen IH, Moller GM, Sont JK, Weersink EJ, van der Zee JS, Braunstahl GJ, Swinderman AH, Sterk PJ, Bel EH: Internet-based tapering of oral corticosteroids in severe asthma: a pragmatic randomised controlled trial. Thorax. 2011, 66: 514-520. 10.1136/thx.2010.153411.View ArticlePubMedGoogle Scholar
- Van DMV, Van den Hout WB, RABE KF, Bakker MJ, Sterk PJ, Assendelft WJ, Kievit J, Sont JK: Cost-effectiveness of internet-based self-management compared with usual care in asthma. PLoS One. 2011, 6: e27108-10.1371/journal.pone.0027108.View ArticleGoogle Scholar
- Morrison D, Wyke S, Agur K, Cameron EJ, Docking RI, MacKenzie AM, McConnachie A, Raghuvir V, Thomson NC, Mair FS: Digital Asthma self-management interventions: a systematic review. J Med Internet Res. 2014, 16: e51-10.2196/jmir.2814.View ArticlePubMedPubMed CentralGoogle Scholar
- Hinchliffe A, Mummery WK: Applying usability testing techniques to improve a health promotion website. Health Promot J Austr. 2008, 19: 29-35.PubMedGoogle Scholar
- Vizri RA: Refining the test phase of usability evaluation: how many subjects is enough?. Hum Factors. 1992, 34: 457-468.Google Scholar
- Medical Research Council: Developing and evaluating complex interventions: new guidance. 2008, London: MRCGoogle Scholar
- Public Health Guidance NICE: Behaviour Change at Population, Community and Individual Levels. 2007, London: NICEGoogle Scholar
- Arain M, Campbell MJ, Cooper CL, Lancaster GA: What is a pilot or feasibility study? a review of current practice and editorial policy. BMC Med Res Methodol. 2010, 10: 67-10.1186/1471-2288-10-67.View ArticlePubMedPubMed CentralGoogle Scholar
- Lancaster GA, Dodd S, Williamson PR: Design and analysis of pilot studies: recommendations for good practice. J Eval Clin Pract. 2004, 10: 307-312. 10.1111/j..2002.384.doc.x.View ArticlePubMedGoogle Scholar
- Juniper EF, O’Byrne PM, Guyatt GH, Ferrie PJ, King DR: Development and validation of a questionnaire to measure asthma control. Eur Respir J. 1999, 14: 902-907. 10.1034/j.1399-3003.1999.14d29.x.View ArticlePubMedGoogle Scholar
- Juniper EF, Guyatt GH, Cox FM, Ferrie PJ, King DR: Development and validation of the mini Asthma quality of life questionnaire. Eur Respir J. 1999, 14: 32-38. 10.1034/j.1399-3003.1999.14a08.x.View ArticlePubMedGoogle Scholar
- Hibbard JH, Mahoney ER, Stockard J, Tusler M: Development and testing of a short form of the patient activation measure. Health Serv Res. 2005, 40: 1918-1930. 10.1111/j.1475-6773.2005.00438.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Group EQ: EuroQol–a new facility for the measurement of health-related quality of life: the EuroQol group. Health Pol. 1990, 16: 199-208.View ArticleGoogle Scholar
- Morisky DE, Ang A, Krousel-Wood M, Ward HJ: Predictive validity of a medication adherence measure in an outpatient setting. J Clin Hypertens (Greenwich). 2008, 10: 348-354. 10.1111/j.1751-7176.2008.07572.x.View ArticleGoogle Scholar
- Miller MR, Hankinson J, Brusasco V, Burgos F, Casaburi R, Coates A, Crapo R, Enright P, van der Grinten CP, Gustafsson P, Jensen R, Johnson DC, MacIntyre N, McKay R, Navajas D, Pedersen OF, Pellegrino R, Viegi G, Wanger J: Standardisation of spirometry. Eur Respir J. 2005, 26: 319-338. 10.1183/09031936.05.00034805.View ArticlePubMedGoogle Scholar
- ATS/ERS: ATS/ERS recommendations for standardized procedures for the online and offline measurement of exhaled lower respiratory nitric oxide and nasal nitric oxide, 2005. Am J Respir Crit Care Med. 2005, 171: 912-930.View ArticleGoogle Scholar
- Yardley L, Kirby S: Evaluation of booklet-based self-management of symptoms in meniere disease: a randomized controlled trial. Psychosom Med. 2006, 68: 762-769. 10.1097/01.psy.0000232269.17906.92.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.