Evaluation of a real-time virtual intervention to empower persons living with HIV to use therapy self-management: study protocol for an online randomized controlled trial
© Côté et al.; licensee BioMed Central Ltd. 2012
Received: 14 February 2012
Accepted: 21 September 2012
Published: 5 October 2012
Living with HIV makes considerable demands on a person in terms of self-management, especially as regards adherence to treatment and coping with adverse side-effects. The online HIV Treatment, Virtual Nursing Assistance and Education (Virus de I’immunodéficience Humaine–Traitement Assistance Virtuelle Infirmière et Enseignement; VIH-TAVIE™) intervention was developed to provide persons living with HIV (PLHIV) with personalized follow-up and real-time support in managing their medication intake on a daily basis. An online randomized controlled trial (RCT) will be conducted to evaluate the efficacy of this intervention primarily in optimizing adherence to combination anti-retroviral therapy (ART) among PLHIV.
A convenience sample of 232 PLHIV will be split evenly and randomly between an experimental group that will use the web application, and a control group that will be handed a list of websites of interest. Participants must be aged 18 years or older, have been on ART for at least 6 months, and have internet access. The intervention is composed of four interactive computer sessions of 20 to 30 minutes hosted by a virtual nurse who engages the PLHIV in a skills-learning process aimed at improving self-management of medication intake. Adherence constitutes the principal outcome, and is defined as the intake of at least 95% of the prescribed tablets. The following intermediary measures will be assessed: self-efficacy and attitude towards antiretroviral medication, symptom-related discomfort, and emotional support. There will be three measurement times: baseline (T0), after 3 months (T3) and 6 months (T6) of baseline measurement. The principal analyses will focus on comparing the two groups in terms of treatment adherence at the end of follow-up at T6. An intention-to-treat (ITT) analysis will be carried out to evaluate the true value of the intervention in a real context.
Carrying out this online RCT poses various challenges in terms of recruitment, ethics, and data collection, including participant follow-up over an extended period. Collaboration between researchers from clinical disciplines (nursing, medicine), and experts in behavioral sciences information technology and media will be crucial to the development of innovative solutions to supplying and delivering health services.
CE 11.184 / NCT 01510340
KeywordsRandomized controlled trial Web-based study People living with HIV Self-management program Adherence Anti-retroviral therapy
The morbidity and mortality rates of people infected with HIV has declined dramatically since the advent in 1996 of combination antiretroviral therapy (ART) and the use of appropriate prophylaxis against opportunistic infections [1, 2]. Formerly classified as a terminal illness, HIV infection is today considered a chronic disease. Although ART cannot eradicate HIV, existing antiviral therapies suppress viral replication and thus make it possible to maintain and improve the immune function of infected individuals. However, adherence to treatment is key to preventing treatment failure and the development of antiviral drug resistance.
A certain degree of non-adherence might have an effect on treatment outcome, depending on pattern and medication. For example, individuals who skip treatment on consecutive days (sustained interruption) are at higher risk of presenting a detectable viral load than are those who skip an equal number of doses non-consecutively (interspersed missed doses) [3, 4]. Furthermore, it has been recognized that, because of their long half-lives and potency, certain types of medication, such as non-nucleoside reverse-transcriptase inhibitors (NNRTIs) and boosted protease inhibitors (PIs), are more forgiving of moderate levels of adherence [5, 6]. Notwithstanding, poor adherence remains a major risk factor in virologic failure and the development of resistance . Therefore, developing interventions to boost and sustain ART adherence has become a crucial objective in the field of HIV management.
Interventions to foster adherence
Treatment adherence immediately arose as a key issue after the introduction of ART. The need to develop appropriate support interventions to foster adherence was crucial at the time, and it remains strong today, despite the fact that regimens have grown simpler  (smaller doses, fewer pills) and easier to tolerate over time. After all, ART constitutes a lifetime commitment on the part of the infected individual. Since 2003, the results of pilot studies have demonstrated the feasibility of interventions to influence adherence [9–12], and some interventions evaluated in experimental studies have shown a potential to optimize adherence [13–22]. A systematic review of treatment adherence interventions intended for persons living with HIV (PLHIV)  suggested that individual interventions targeting medication management skills were associated with improved adherence outcomes (n = 10 studies). In their systematic review of interventions intended to optimize medication adherence among other groups, Haynes et al.  indicated that only 36 of the 83 interventions examined were associated with improved adherence. Kripalani et al. reported similar results in their review focused on a chronically ill group. Of the 37 randomized trials reviewed, 20 produced a significant change in at least one adherence marker, and over half of these interventions (n = 11) had an effect on clinical markers.
In light of these mixed results, Haynes et al.  stressed the need for novel approaches to support treatment adherence. Recent reviews by Bärnighausen et al.  and Horvarth et al.  have suggested that interventions assisted by information and communication technologies, such as text messages sent via mobile phone, could effectively increase adherence in sub-Saharan Africa. Thus, tailored interventions and the use of information technologies open up interesting possibilities for developing innovative interventions geared to optimizing treatment adherence and reaching a broader patient base across vast geographical areas.
Information and communications technologies: a promising avenue for providing support to people living with HIV
In the field of health education, there is a growing and apparently inevitable tendency to use information and communication technology (ICT), such as web applications and software systems, as interactive means of information transmission [28–31]. These technologies make it possible not only to present a large amount of information in a more user-friendly way, but also for users to access, at their convenience, information better adapted to their own needs. This characteristic greatly facilitates the active learning process at the heart of the development and reinforcement of health behavior self-management skills [32–34].
Tailored interventions are defined as change strategies intended for a given person based on their specific characteristics, identified beforehand through an individual evaluation [35, 36]. What distinguishes these interventions is the fact that the change strategy targets the needs of one particular person rather than those of a group, and that the messages and feedback conveyed are adapted to individual factors related to a given health behavior . This makes it possible to achieve more significant results as the person feels more engaged by the messages and in turn engages more readily in the proposed strategies [38–40].
The combined benefits of tailored interventions and of the use of ICT make this type of intervention more effective than traditional health education interventions . Studies have confirmed the efficacy of this type of intervention on the adoption of various health behaviors, including quitting smoking [41–45], reducing the amount of fat in the diet [46, 47], increasing the consumption of fruit and vegetables [48, 49], and engaging in early cancer detection [50, 51]. In the field of HIV, ICT has been used to encourage the adoption of safe behaviors whether in terms of sexual practices or use of syringes [52–56].
In their review of computer-assisted tailored interventions delivered online, Lustria and colleagues  identified 30 studies (out of the 503 found between 1996 and 2007) where the applications targeted four health behaviors (nutrition (n = 10), physical activity (n = 7), tobacco use (n = 7), alcohol consumption (n = 3)) , as well as ‘other behavior’ (n = 3). In their analysis, they sought in particular to describe the mechanisms used to put into operation the concept of tailored interventions and to implement online interventions. They found a wide variety of approaches being used, and highlighted the importance of pursuing research in this domain.
The systematic review (n = 24 studies) by Murray et al.  supported the effects of computer-assisted interventions for individuals living with a chronic condition in terms of knowledge acquisition, changes to health behavior, self-efficacy, perceived social support, and other clinical markers. These technologies have been used for individuals living with asthma , diabetes [60–62], heart disease [63–66], and HIV [67, 68]. On the whole, what emerges is that these technologies can be used with a variety of groups of different ages [69–73]. The use of different ICTs in the field of health education shows that they are effective in transferring knowledge and developing the skills needed for health promotion and management of the demands inherent to illness [29, 30].
Regarding access to these technologies, 175 million adults  in the USA reportedly used the internet in 2010 to obtain health-related information. According to the results of a Harris poll, 88% of adults online have searched the web for such information. Moreover, in 2009, Statistics Canada  reported that 80% of Canadians 16 years of age or over used the internet at home for personal reasons, and this percentage represented 21.7 million users. These Canadian data also showed that 70% of people used the internet to search for medical information and for health-related purposes (74% of women and 66% of men). In Quebec, the second most densely populated province in Canada, the NETendances survey conducted by CEFRIO-Léger Marketing  showed that 79.1% of Québécois had used the internet in the previous 7 days.
To date, web applications have been developed to support primary and secondary prevention efforts for tobacco use, physical activity, nutrition, use of certain health examinations, and the adoption of safe sexual behaviors. However, few tailored interventions have used this educational approach in tertiary prevention to support treatment adherence. Living with HIV makes considerable demands on a person in terms of self-management, especially regarding adherence to lifelong therapy and coping with adverse side-effects. PLHIV must play a more active role in this management, thus breaking with the traditional paternalistic health model in which the patient has a more passive role. Instead, the health professional becomes a care partner and mentor who empowers the PLHIV to take charge of the situation. Consequently, it is imperative that innovative ways should be found to provide assistance and follow-up to PLHIV. From this point of view, we believe that the use of ICTs can constitute an effective approach to treatment management by providing PLHIV with support in the form of messages that target and are adapted to their needs. Such virtual follow-up would be complementary to existing clinical follow-up. Given the persistent or long-term nature of ART, finding new ways to support PLHIV who are on such treatment seems an avenue worth exploring.
Drawing on the recommendations of the National Institutes of Health (NIH)  regarding the four phases of research on interventions in the field of health sciences, we plan to evaluate the efficacy of an online virtual intervention in optimizing adherence to antiretroviral medication intake by PLHIV (phase III). The study will rest on preliminary work (phases I and II) that served to clearly identify the predictors of treatment adherence by PLHIV , and will develop and validate the content of the intervention in question , and create the corresponding web application .
Based on a philosophy of empowerment, the HIV Treatment, Virtual Nursing Assistance and Education (Virus de l’immunodéficience Humaine–Traitement Assistance Virtuelle Infirmière et Enseignement; VIH-TAVIE™a) web application makes it possible to develop and strengthen the skills needed for PLHIV to self-manage their treatment while boosting their sense of self-efficacy with respect to the daily intake of medication . This application was developed in accordance with the systematic analytic process proposed by Bartholomew et al.[81, 82], and rests on explanatory and predictive models of health behaviors . The specificity of this application lies in its action mechanism based on Bandura’s theory of behavioral change , which targets the development and reinforcement of skills, that is, the individual’s ability to act.
The web application is composed of four interactive computer sessions hosted by a virtual nurse who engages the PLHIV in a skills-learning process aimed at improving self-management of medication intake. The skills covered (motivational, self-awareness, problem-solving, emotion-regulation, social) allow the PLHIV to integrate the therapeutic regimen in their daily routine, manage adverse side-effects, handle problem situations that might interfere with medication intake, interact with health professionals, and mobilize their social support network. Aside from delivering tailored teaching, the virtual nurse refers to the experiences of other individuals who coped with similar situations successfully. During these sessions, the virtual nurse provides feedback and positive reinforcement on the individual’s personal style and methods and on the acquired skills. The interactive system is designed to allow repeated applications and backtracking depending on the individual’s needs. Moreover, at each session, feedback is provided on the significant elements of the previous session. The individual’s profile is personalized as a function of their needs and characteristics, thus giving the profile a tailored fit. Furthermore, the computer innovation underlying the virtual intervention allows to create new pages , thus allowing the system administrator the flexibility to add or modify page models and content depending on the context.
The study has been approved by the Research Ethics Board of the Université de Montréal and the Research Center of the Centre Hospitalier de l’Université de Montréal.
We opted for an online randomized controlled trial (RCT) to evaluate the efficacy of the virtual intervention (web application) primarily in influencing ART adherence. Adherence is a behavioral indicator that can be predicted in part by cognitive and affective variables, particularly sense of self-efficacy and attitude towards antiretroviral medication intake . These variables are in turn explained by perceived social support, relationship with health professionals, and absence of adverse effects. These intermediate variables, which are the targets of our intervention, will allow effective change in the short term. They constitute mediators capable of explaining the intervention’s effect on adherence. There will be three measurement times: baseline (T0), after 3 (T3) and 6 months (T6) of baseline measurement. Participants will be drawn from a convenience sample and will be randomly assigned either to an experimental group that will use our web application, or to a control group that will be presented with a list of various websites of interest.
The primary hypothesis is that a higher proportion of participants in the experimental group will prove treatment-adherent at T6 compared with the control group. The explanatory hypothesis is that the following variables are mediators that can explain the intervention’s effect on adherence: sense of self-efficacy, attitude towards antiretroviral medication intake, degree of symptom-related discomfort, and perceived social support (T0, T3, T6).
We aim to recruit a sample of 232 participants, that is, 116 per group. The PLHIV who will participate in the study must be at least 18 years of age and on ART for at least 6 months. The reason for the latter criterion is that we wish the therapy-management intervention to focus on adherence over time rather than on treatment initiation. Internet access is another inclusion criterion. This will introduce a selection bias in the study; however, the bias will be offset by the inherent value in evaluating an innovative service-delivery method that, in the near future, could reach a vast number of people at low cost and, thus, constitute an important option for providing follow-up to groups with a chronic health problem. In this study, both the experimental group and the control group will be composed of PLHIV with similar characteristics, who have internet access and who use it to obtain information relative to their health condition.
The sample size was estimated based on the studies by Tuldrà et al. and Pradier et al.  carried out with PLHIV, and on the systematic review by Haynes et al. of adherence-related interventions intended for various groups. In the study by Tuldrà et al. , there was a difference of 25 percentage points between the control group and the experimental group in terms of treatment adherence (69% vs. 94%, respectively). For Pradier et al., the proportion of treatment-adherent participants was 58% in the experimental group and 63% in the control group at the start of the study, and 75% and 60% respectively after the intervention. We calculated our sample size on the assumption that the proposed intervention (the web application) will increase the percentage of treatment-adherent participants in the experimental group by 20%. The percentage of treatment-adherent participants at the start of the study will be the same as that reported by Godin et al.  (that is, 50%), given that our recruitment pool is very similar to theirs. This is a conservative assumption given that the variance in the difference between the two proportions will be larger, with the benchmark proportion set at about 50%. Consequently, the sample size required to detect a difference of 20% (50% treatment-adherent participants in the control group versus 70% in the experimental group) will be larger than for other scenarios with the same 20-point difference. Hence, to detect a difference of 20 percentage points at 80% power and a χ2 test two-tailed α value of 0.05, the required sample size is 186 participants, that is, 93 per group. As we are assuming a 20% attrition rate (that is, the same rate seen in the studies by Goujard et al.  and Tuldrà et al.), the sample size has been set at 232 participants. With a sample of 186 participants completing the study, the statistical power will be enough to detect a moderate effect on the intermediate variables. In particular, with n = 186, an α value of 0.05 (two-tailed Student’s t-test) will allow detection of the difference between the two percentages, corresponding to a standard deviation of 50% and power of greater than 90%.
The virtual intervention consists of four computer sessions of 20 to 30 minutes in length. There will be a 1-week interval between sessions to ensure the progressive acquisition and consolidation of skills, thus, access will be controlled and pre-determined within this interval. It will be possible at all times for participants to revisit previous sessions. Access will be unlimited in terms of intensity, frequency, and time of use throughout the duration of the study. Delivering an intervention by computer affords a key advantage in that it allows complete control of the content. Moreover, the intervention’s parameters are recorded, thus making it possible to obtain a reliable picture of the actual intensity, duration, and frequency of the intervention. These data will be available for subsequent analyses.
Participants in the control group will be invited to consult, at their convenience and from the location of their choice, a list of pre-determined websites offering information on antiretroviral medications, their side-effects, and their interactions.
Adherence will constitute the principal outcome, and for the purposes of the study, it will be evaluated through a self-administered questionnaire that was developed for and validated on the target population in accordance with recommendations relative to the measure of treatment adherence . The questionnaire comprises seven items that serve to determine how many times a person forgets to take their medication. The questionnaire is designed to place the respondent in a context where events and situations could lead to lapses. The questionnaire’s validity was assessed (sensitivity 71%; specificity 72%; correct classification 72%; odds ratio 6.15) using immunologic (CD4 count) and virologic (viral load) parameters as validation criteria. Adherence was defined as the intake of at least 95% of the prescribed tablets. Although there is no clear minimum cut-off point defining what constitutes sufficient ART adherence for achieving optimal treatment efficiency , this is generally set at between 90% and 95% . Self-reported viral load and CD4 counts will also be recorded.
The intermediary measures will be assessed by means of validated instruments. Self-efficacy regarding medication intake will be measured using 12 items rated on a 5-point Likert scale (here is an example of an item: “I can take my antiretroviral medications even if I’m in the company of people who don’t know I’m seropositive”). These items are adapted from a scale developed by Godin et al.  and have previously been used on a large sample (n = 399). To adapt the instrument to our context (that is, antiretroviral medication intake), the items have been reformulated by expert consensus following the results of a focus group and of a literature review, and on the basis of Bandura’s theoretical model of self-efficacy. A content validation has also been carried out.
Attitude toward medication intake will be evaluated through six items rated on a five-point Likert scale. These items emerged from focus groups of PLHIV who were on treatment. A preliminary version of the instrument was tested on 35 PLHIV. The scale was previously used on a large sample (n = 399) , obtaining a Cronbach’s α coefficient of 0.83 and a test-retest reliability coefficient of 0.72.
Symptom-related discomfort will be measured using the Self-Completed HIV Symptom Index . This 20-item instrument determines using a scale of 1 to 4 whether symptoms are present (0 = absence) and the degree of discomfort experienced. The instrument has been validated on 188 PLHIV, and it was found to have acceptable psychometric properties, including good construct validity.
Social support will be evaluated using the Medical Outcome Survey [88, 89]. One dimension of social support will be measured by subscale of emotional support, which has eight item, each of which is rated on a five-point Likert scale. The instrument has been found to have good content validity and appreciable internal consistency.
A sociodemographic questionnaire will cover personal characteristics such as sex, age, family situation, level of education, employment situation, number of children, and questions about HIV, the therapeutic regimen, and presence of symptoms.
Recruitment and online data collection
The study will be conducted entirely online. The project will be advertised on the websites of resources available to PLHIV, where a hyperlink and a banner will be inserted to redirect parties interested in participating in the online research. The targeted resources include partner clinics, community agencies, and other organizations that deliver teaching, care, treatment, or follow-up to PLHIV. In addition, health professionals and stakeholders will be invited to inform their PLHIV about the study. To promote the project among PLHIV, different communication strategies will be used: 1) traditional methods, such as poster and information brochures; and 2) technological or virtual methods, by advertising the study on websites of organizations (medical clinics, association for PLHIV) that are often visited by PLHIV.
Individuals who will visit the study’s website will view a short video clip of testimonials by a few PLHIV, then they will be given information on the study. After accepting the conditions of the study and consenting to take part in it, they will sign up for the study by providing an email address and a pseudonym. Each participant will be validated through an email address check. Once this step is completed, a hyperlink will be emailed to allow participants to access the first questionnaire online on the website, and only after having completing this questionnaire will they be randomly assigned by the computer system to the experimental group or the control group. Participants in the control group will be invited to consult pre-determined websites that offer information on ART and its associated side-effects. Participants in the experimental group will be offered the virtual intervention through the web application. At 3 and 6 months after the initial measurement, participants will complete the online questionnaires again. A reminder to this effect will be emailed to them in the days prior to the scheduled measurement. Participants will be compensated for their time spent on the study with a gift certificate for each measurement time completed.
Type of analysis used
To establish whether the experimental and control groups are equivalent, the means and medians of the continuous variables and the frequency distributions of the discrete variables will be compared using descriptive analyses. The principal analyses will focus on comparing the two groups in terms of treatment adherence (the study’s main outcome, considered as a binary variable with adherent being ≥ 95% and non-adherent > 95%) at the end of follow-up at T6. An intention-to-treat (ITT) analysis will be carried out to evaluate the true value of the intervention in a real context. Consequently, in the following analyses, all participants will be assessed in their respective randomization group as to whether they are following the procedure or have been lost to attrition during follow-up. In accordance with the principles of ITT, participants who drop out and those for whom there is no adherence measure at T6 will be considered as non-adherent.
The primary hypothesis is that the VIH-TAVIE intervention will increase the proportion of treatment-adherent patients at T6. This hypothesis will be tested using a χ2 test with 1 degree of freedom. If preliminary analyses show that the two groups differ on certain characteristics, multivariate logistic regression will be used to adjust the intervention’s effect on these characteristics, which will be considered as potential confounding variables. In this case, the two-tailed Wald’s test will be used to test the intervention’s adjusted effect.
For the secondary analyses, the two groups will be compared on all the repeated measures of adherence (T3 to T6) using a generalized estimating equation (GEE) approach that generalizes the logistic regression for longitudinal data with repeated measures of the binary measure . We will assume that the covariance matrix has an auto-regressive structure of order = 1 to account for inter-correlations between repeated measures (over the course of follow-up) with the same participants. The difference between repeated measures of adherence (T3 and T6) will constitute the binary dependent variable. The binary intervention indicator, the indicator of time since the follow-ups (3 and 6 months) and, if necessary, the confounding variables, will be included as independent variables. Finally, the interaction between the intervention effect and the time effect will be added to the GEE model and will be tested to verify whether the intervention’s effect on adherence varies over time. In the GEE analyses, a conservative approach will be used and, accordingly, all missing data for the dependent variable (adherence) will be replaced with ‘non-adherent’. The same approach will be used to evaluate the effects of the intervention on the repeated measures of the intermediary variables. However, given that these variables will be measured by means of quantitative scales, a linear mixed model for repeated measures of a continuous dependent variable  will be used instead of the GEE model.
Challenges of an online randomized controlled trial
Carrying out this online RCT poses various challenges, particularly in terms of recruitment, ethics, and data collection, including participant follow-up over an extended period .
First, to attract and retain the online participation of PLHIV interested in the study, the team sought the help of web design experts. This help led to the development of a brand image (concept of branding) by an artistic director, who created a logo that would carry the image of the study and be easily recognizable by our target group. This branding set the tone (in terms of color and visuals) for our website pages, which were created to be visually attractive to participants. More specifically, upon reaching the first page of the website, participants will listen to testimonials by a few PLHIV about their own experiences with medication intake and with browsing the web in search of health-related information. Aside from being an interesting and dynamic visual tool, testimonials have been used to allow potential participants to identify with the intervention, and to humanize and personify the web-based study. These testimonials also have the potential to strengthen the branding of the intervention. Then, in a short video clip, the research coordinator and a project spokesperson will present information on the study, including its aim and inclusion criteria, and explain what participation entails.
Various communication strategies will be used to promote the study among PLHIV. First, traditional methods of dissemination will be used, such as publishing advertisements or short articles in magazines aimed at PLHIV, and distributing information brochures and posters to the clinics and community organizations targeted. Second, an internet-based approach will also be used, consisting of posting a hyperlink to our study on the websites of organizations (medical clinics, association for PLHIV, community groups) frequently visited by PLHIV. In this regard, Birnbaum  suggested that such organizations should run advertisements in their electronic newsletters. A list of targeted internet media will be compiled in collaboration with key informants working with PLHIV in community organizations. There are other methods of online recruitment, such as reaching target groups through chatrooms, sending e-mails to pre-established lists of participants, or posting banners on popular websites [94, 95]; however, we will not use these latter strategies in our study. According to Noseck et al. , even if posting advertising banners is a popular way of promoting a study, it remains a costly means of recruitment and ‘is not the most effective at netting traffic’ (, p. 167).
One of the risks that remain difficult to control or prevent in a virtual environment is having the same person participate more than once in a given study [93, 95, 96]. Although the incidence of this happening has been shown to be small, at 3%, [93, 97], certain strategies can be used to detect or prevent it and reduce the risk of its occurrence, including warning participants to register only once, asking for an email address and a password at registration, and filtering data that seem to be identical[93, 95, 96].
The ethical aspects of online studies have been discussed by various authors [98–101]. The topic has received special attention because of the online research environment in itself, where there’s no direct interaction between researchers and participants [95, 96]. Among other things, consent to participate can be presented in the form of a statement to be read and checked off before clicking on a button labeled ‘I accept’. A button labeled ‘withdraw’ or ‘quit the study’  will also be accessible to allow participants the freedom to drop out of the study at any time. As proposed by Hewson  and Nosek et al. , a ‘debriefing page’ and contact information for a resource person in the event of questions or problems will also be provided. The information must be presented in such a way as to properly inform participants but without overwhelming them with data, which could cause difficulties and discourage subjects from participating.
The security and confidentiality of electronic data in online studies are serious concerns that necessitate the implementation of stringent measures. The data collected through the online questionnaires will be stored on a secure server located at the research center where the research work is carried out. Only system administrators will have access to the data on the server. To protect the identity of participants, only an email address and a pseudonym will be requested from participants, as this information is necessary to ensure follow-up and disseminate results, as pointed out by Michalak and Szabo . Using a firewall, encrypting the data, protecting passwords, and separating the sociodemographic data from the experimental data (linking them through a code) reduces the risk of an unauthorized third party accessing confidential content [95, 101]. A database has been planned to support the subsequent direct transfer of the data to analysis software (the SPSS package; SPSS Inc., Chicago, IL, USA) in order to facilitate data analysis.
As emphasized by Bull et al. , online longitudinal evaluations entail following up participants and completing various measures. According to Bull et al. and Bennett and Glasgow , online studies have a lower retention rate than that of traditional studies, and attrition rates of 40% are not uncommon. However, Schubart et al. and Bull et al.  highlighted a number of elements that foster a high retention rate in online studies, including the availability of a health professional to provide feedback, the dynamic qualities of the study website, and the inclusion of a clinician coach, such as a nurse, in the intervention. All of these will be considered in this study.
For the purpose of encouraging participants to continue with the study, reminder e-mails (maximum of three to four) will be sent out at 7-day intervals prior to measurement. Bull and colleagues  noted that e-mails alone were not sufficient to communicate with participants, and that a variety of communication modes should be used. They suggested that participants should be asked to provide other contact details such as home and mobile telephone numbers, and a home address. According to these authors, a balance must be struck between guaranteeing confidentiality and ensuring follow-up. Because the technology we plan to use is complex and can present many problems and bugs, we plan to assign a resource person (technical support) to help users in this regard. According to Paul and colleagues , this constitutes a key source of support if the research budget allows it.
A research project that unfolds entirely online necessitates that all parties share an understanding of the specific terminology used by the various experts involved and of the role played by the professionals in each of the project’s teams (computer programming, multimedia, clinical). It is necessary to ‘think virtual’, that is, to make sure that procedures applied in the real world are operational online. Transposing research procedures to an entirely virtual research intervention entails anticipating the entire sequence of participation and follow-up of the target persons. Making this shift is not easy. Indeed, the absence of a common language between research, clinical, and web media teams, as well as a mutual misunderstanding of the needs of each group (researchers versus tech support teams, for instance), calls for a great deal of clarification and numerous meetings to make the technical operations required by the project possible. This collaboration between researchers from clinical disciplines (nursing and medicine), experts in behavioral and educational sciences, and information technology and media experts is crucial to the development of innovative solutions to supplying and delivering services to those who need them.
However, without the contribution of community partners and other clinical collaborators, such a study could not be carried out easily. Their support and expertise are invaluable at all levels, particularly in planning and developing the different stages of the online study (for example, using testimonials was our partners’ idea). Our partners will also be involved in promoting the study, recruiting participants, and ultimately transferring and implementing the virtual intervention.
Data collection was started in February 2012.
aThe acronym VIH-TAVIE (Virus de l’immunodéficience Humaine–Traitement Assistance Virtuelle Infirmière et Enseignement) contains a wordplay in French that can be rendered in English as ‘live your life’.
The study is funded by the Fonds de la recherche en santé du Québec (FRSQ, 2008–2012). JC has received a clinical research bursary (Junior 2) from the FRSQ (2009–2013) to support her research program on innovative virtual interventions that are intended for individuals living with a chronic health problem. The TAVIE platform received financial support from the Réseau Sidami du FRSQ.
- Casalino E, Wolff M, Ravaud P, Choquet C, Bruneel F, Regnier B: Impact of HAART advent on admission patterns and survival in HIV-infected patients admitted to an intensive care unit. AIDS. 2004, 18: 1429-1433. 10.1097/01.aids.0000131301.55204.a7.View ArticlePubMed
- Hogg RS, Yip B, Kully C, Craib KJ, O'Shaughnessy MV, Schechter MT, Montaner JSG: Improved survival among HIV-infected patients after initiation of triple-drug antiretroviral regimens. Can Med Assoc J. 1999, 160: 659-665.
- Genberg B, Wilson I, Bangsberg D, Arnsten J, Goggin K, Remien R, Simoni J, Gross R, Reynolds N, Rosen M: Patterns of antiretroviral therapy adherence and impact on HIV RNA among patients in North America. AIDS. 2012, 26: 1415-1423. 10.1097/QAD.0b013e328354bed6.PubMed CentralView ArticlePubMed
- Parienti J-J, Das-Douglas M, Massari V, Guzman D, Deeks SG, Verdon R, Bangsberg DR: Not All Missed Doses Are the Same: Sustained NNRTI Treatment Interruptions Predict HIV Rebound at Low-to-Moderate Adherence Levels. PLoS One. 2008, 3: e2783-10.1371/journal.pone.0002783.PubMed CentralView ArticlePubMed
- Bangsberg DR: Less than 95% Adherence to Nonnucleoside Reverse-Transcriptase Inhibitor Therapy Can Lead to Viral Suppression. Clin Infect Dis. 2006, 43: 939-941. 10.1086/507526.View ArticlePubMed
- Martin CP, Fain MJ, Klotz SA: The older HIV-positive adult: A critical review of the medical literature. Am J Med. 2008, 121: 1032-1037. 10.1016/j.amjmed.2008.08.009.View ArticlePubMed
- Gardner EM, Burman WJ, Steiner JF, Anderson PL, Bangsberg DR: Antiretroviral medication adherence and the development of class-specific antiretroviral resistance. AIDS. 2009, 23: 1035-1046. 10.1097/QAD.0b013e32832ba8ec.PubMed CentralView ArticlePubMed
- Guidelines for the use of antiretroviral agents in HIV-1-infected adults and adolescents.http://aidsinfo.nih.gov/guidelines,
- De Bruin M, Hospers HJ, Van den Borne HW, Kok G, Prins JM: Theory -and evidence-based intervention to improve adherence to antiretroviral therapy among HIV-infected patients in The Netherlands: a pilot study. AIDS Patient Care STDS. 2005, 19: 384-393. 10.1089/apc.2005.19.384.View ArticlePubMed
- Dilorio C, Resnicow K, McDonnell M, Soet J, McCarthy F, Yeager K: Using a motivational interviewing to promote adherence to antiretroviral medications: a pilot study. J Assoc Nurses AIDS Care. 2003, 14: 52-62.View Article
- Kalichman SC, Cherry J, Cain D: Nurse-delivered antiretroviral treatment adherence intervention for people with low literacy skills and living with HIV/AIDS. J Assoc Nurses AIDS Care. 2005, 16: 3-15.View ArticlePubMed
- Shegog R, Markham CM, Leonard AD, Bui TC, Paul ME: “+CLICK”: pilot of a web-based training program to enhance ART adherence among HIV-positive youth. AIDS Care. 2011, 24: 310-318.View ArticlePubMed
- Chiou PY, Kuo BI, Lee MB, Chen YM, Chuang P, Lin PC: A program of symptom management for improving quality of life and drug adherence. J Adv Nurs. 2006, 55: 169-179. 10.1111/j.1365-2648.2006.03902.x.View ArticlePubMed
- Goujard C, Bernard N, Sohier N, Peyramond D, Lançon F, Chwalow J, Benoit A, Delfraissy J-F: Impact of a patient education program on adherence to HIV medication: a randomized clinical trial. J Acquir Immune Defic Syndr. 2003, 34: 191-194. 10.1097/00126334-200310010-00009.View ArticlePubMed
- Holzemer WL, Bakken S, Portillo CJ, Grimes R, Welch J, Wantland D, Mullan JT: Testing a nurse-tailored HIV medication adherence intervention. Nurs Res. 2006, 55: 189-197. 10.1097/00006199-200605000-00005.View ArticlePubMed
- Javanbakht M, Prosser P, Grimes T, Weinstein M, Farthing C: Efficacy of an individualized support program with contingent reinforcement among nonadherent HIV-positive patients. J Int Assoc Physicians AIDS Care. 2006, 5: 143-150. 10.1177/1545109706291706.View Article
- Koenig LJ, Pals SL, Bush T, Stratford D, Ellerbrock TV, Palmore MP: Randomized controlled trial of an intervention to prevent adherence failure among HIV-infected patients initiating antiretroviral therapy. Health Psychol. 2008, 27: 159-169.View ArticlePubMed
- Pradier C, Bentz L, Spire B, Tourette-Turgis C, Morin M, Souville M, Rebillon M, Fuzibet J, Pesce A, Dellamonica P, Moatti J: Efficacy on an educational and counseling intervention on adherence to highly active antiretroviral therapy: french prospective controlled study. HIV Clin Trials. 2003, 4: 121-131. 10.1310/BRBV-3941-H1PP-NDRY.View ArticlePubMed
- Weber R, Christen L, Christen S, Tschopp S, Hansjoerg Z, Schnedier C, Schmitt J, Opravil M, Günthard HF, Ledergerber B: Effect of individual cognitive behaviour intervention on adherence to antiretroviral therapy: prospective randomized trial. Antivir Ther. 2004, 9: 85-95.PubMed
- Williams BA, Fennie PK, Bova AC, Burgess DJ, Danvers AK, Dieckhaus DK: Home visits to improve adherence to highly active antiretroviral therapy: a randomized controlled trial. J Acquir Immune Defic Syndr. 2006, 42: 314-321. 10.1097/01.qai.0000221681.60187.88.View ArticlePubMed
- Chung MH, Richardson BA, Tapia K, Benki-Nugent S, Kiarie JN, Simoni JM, Overbaugh J, Attwa M, John-Stewart GC: A Randomized Controlled Trial Comparing the Effects of Counseling and Alarm Device on HAART Adherence and Virologic Outcomes. PLoS Med. 2011, 8: e1000422-10.1371/journal.pmed.1000422.PubMed CentralView ArticlePubMed
- da Costa TM, Barbosa BJP, e Costa DAG, Sigulem D, de Fátima MH, Filho AC, Pisa IT: Results of a randomized controlled trial to assess the effects of a mobile SMS-based intervention on treatment adherence in HIV/AIDS-infected Brazilian women and impressions and satisfaction with respect to incoming messages. Int J Med Inf. 2012, 81: 257-269. 10.1016/j.ijmedinf.2011.10.002.View Article
- Rueda S, Park-Wyllie LY, Bayoumi AM, Tynan AM, Antoniou TA, Rourke SB, Glazier RH: Patient support and education for promoting adherence to highly active antiretroviral therapy for HIV/AIDS. Cochrane Database Syst Rev. 2006, 3: CD001442-PubMed
- Haynes RB, Ackloo E, McDonald HP, Yao X: Interventions for enhancing medication adherence. Cochrane Database Syst Rev. 2008, 2: CD000011-PubMed
- Kripalani S, Yao X, Haynes RB: Interventions to enhance medication adherence in chronic medical conditions: a Systematic review. Arch Intern Med. 2007, 167: 540-549. 10.1001/archinte.167.6.540.View ArticlePubMed
- Bärnighausen T, Chaiyachati K, Chimbindi N, Peoples A, Haberer J, Newell M-L: Interventions to increase antiretroviral adherence in sub-Saharan Africa: a systematic review of evaluation studies. Lancet Infect Dis. 2011, 11: 942-951. 10.1016/S1473-3099(11)70181-5.PubMed CentralView ArticlePubMed
- Horvath T, Azman H, Kennedy G, Rutherford G: Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. Cochrane Database Syst Rev. 2012, 3: CD009756-PubMed
- Dorr D, Bonner LM, Cohen AN, Shoai RS, Perrin R, Chaney E, Young AS: Informatics systems to promote improved care for chronic illness: a literature review. J Am Med Inform Assoc. 2007, 14: 156-163. 10.1197/jamia.M2255.PubMed CentralView ArticlePubMed
- Lewis D: Computers in patient education. Comput Inform Nurs. 2003, 21: 88-96. 10.1097/00024665-200303000-00010.View ArticlePubMed
- Nguyen HQ, Carrieri-Kohlman V, Rankin SH, Slaughter R, Stulbarg MS: Internet-based patient education and support interventions: a review of evaluation studies and directions for future research. Comput Biol Med. 2004, 34: 95-112. 10.1016/S0010-4825(03)00046-5.View ArticlePubMed
- Young AS, Chaney E, Shoai R, Bonner L, Cohen AN, Doebbeling B, Dorr D, Goldstein MK, Kerr E, Nichol P, Perrin R: Information technology to support improved care for chronic illness. J Gen Intern Med. 2007, 22: 425-430. 10.1007/s11606-007-0303-4.PubMed CentralView ArticlePubMed
- Bental DS, Cawsey A, Jones R: Patient information systems that tailor to the individual. Patient Educ Couns. 1999, 36: 171-180. 10.1016/S0738-3991(98)00133-5.View ArticlePubMed
- Lewis D: Computer-based approaches to patient education. J Am Med Inform Assoc. 1999, 6: 272-282. 10.1136/jamia.1999.0060272.PubMed CentralView ArticlePubMed
- Revere D, Dunbar PJ: Review of computer-generated outpatient health behavior interventions. J Am Med Inform Assoc. 2001, 8: 62-79. 10.1136/jamia.2001.0080062.PubMed CentralView ArticlePubMed
- Kreuter MW, Bull FC, Clark EM, Oswald DL: Understanding how people process health information: a comparaison of tailored and untailored weight loss materials. Health Psychol. 1999, 18: 1-8.View Article
- Kreuter MW, Farrell D, Olevitch L, Brennan L: Tailored Health Messages: Customizing Communication with Computer Technology. 1999, Mahwah, NJ: Lawrence Erlbaum
- Kreuter MW, Skinner CS: Tailoring, what's in a name?. Health Educ Res. 2000, 15: 1-4. 10.1093/her/15.1.1.View ArticlePubMed
- Dijkstra A: Working mechanisms of computer-tailored health education: evidence from smoking cessation. Health Educ Res. 2005, 20: 527-539. 10.1093/her/cyh014.View ArticlePubMed
- Dijkstra A, De Vries H: The development of computer-generated tailored interventions. Patient Educ Couns. 1999, 36: 193-203. 10.1016/S0738-3991(98)00135-9.View ArticlePubMed
- De Vries H, Brug J: Computed-tailored interventions motivating people to adopt health promoting behaviours: Introduction to a new approach. Patient Educ Couns. 1999, 36: 99-105.View ArticlePubMed
- Lancaster T, Stead LF: Self-help interventions for smoking cessation. Cochrane Database Syst Rev. 2003
- Velicer WF, Prochaska JO: An expert system intervention for smoking cessation. Patient Educ Couns. 1999, 36: 119-129. 10.1016/S0738-3991(98)00129-3.View ArticlePubMed
- Walters ST, Wright JA, Shegog R: A review of computer and Internet-based interventions for smoking behavior. Addict Behav. 2006, 31: 264-277. 10.1016/j.addbeh.2005.05.002.View ArticlePubMed
- Strecher VJ: Computer-tailored smoking cessation materials: a review and discussion. Patient Educ Couns. 1999, 36: 107-117. 10.1016/S0738-3991(98)00128-1.View ArticlePubMed
- Strecher VJ, Wang C, Derry H, Wildenhaus K, Johnson C: Tailored intervention for multiple risk behaviors. Health Educ Res. 2002, 17: 619-26. 10.1093/her/17.5.619.View ArticlePubMed
- Brug J, Campbell M, van Assema P: The application and impact of computer-generated personalized nutrition education: a review of the literature. Patient Educ Couns. 1999, 36: 145-156. 10.1016/S0738-3991(98)00131-1.View ArticlePubMed
- De Bourdeaudhuij I, Stevens V, Vandelanotte C, Brug J: Evaluation of an interactive computer-tailored nutrition intervention in a real-life setting. Ann Behav Med. 2007, 33: 39-48. 10.1207/s15324796abm3301_5.View ArticlePubMed
- Baker AH, Wardle J: Increasing fruits and vegetable intake among adults attending colorectal cancer screening. Cancer Epidemiol Biomark Prev. 2002, 11: 203-206.
- Pérez-Rodrigo C, Wind M, Hildonen C, Bjelland M, Aranceta J, Klepp KI, Brug J: The pro-children intervention: applying the intervention mapping protocol to develop a school-based fruit and vegetable promotion programme. Ann Nutr Metab. 2005, 49: 267-277. 10.1159/000087249.View ArticlePubMed
- Jerant A, Kravitz RL, Rooney M, Amerson S, Kreuter M, Franks P: Effects of a tailored interactive multimedia computer program on determinants of colorectal cancer screening: a randomized controlled pilot study in physician offices. Patient Educ Couns. 2007, 66: 67-74. 10.1016/j.pec.2006.10.009.View ArticlePubMed
- Nooijer J, Lechner L, Candel M, de Vries H: A randomized controlled study of short-term and long-term effects of tailored information versus general information on intention and behavior related to early detection of cancer. Cancer Epidemiol Biomark Prev. 2002, 11: 1489-1491.
- Gilbert P, Ciccarone D, Gansky SA, Bangsberg DR, Clanon K, McPhee SJ, Calderon SH, Bogetz A, Gerbert B: Interactive "video doctor" counseling reduces drug and sexual risk behaviors among HIV-positive patients in diverse outpatient settings. PLoS One. 2008, 3: e1988-10.1371/journal.pone.0001988.PubMed CentralView ArticlePubMed
- Kiene SM, Barta WD: A brief individualized computer-delivered sexual risk reduction intervention increases HIV/AIDS preventive behavior. J Adolesc Health. 2006, 39: 404-410. 10.1016/j.jadohealth.2005.12.029.View ArticlePubMed
- Lau JTF, Lau M, Cheung A, Tsui HY: A randomized controlled study to evaluate the efficacy of an internet-based intervention in reducing HIV risk behaviors among men who have sex with men in Hong Kong. AIDS Care. 2008, 20: 1-9. 10.1080/09540120701450425.View Article
- Marsch LA, Bickel WK: Efficacy of computer-based HIV/AIDS education for injection drug users. Am J Health Behav. 2004, 28: 316-326. 10.5993/AJHB.28.4.3.View ArticlePubMed
- Gagnon H, Godin G, Alary M, Bruneau J, Otis J: A randomized trial to evaluate the efficacy of a computer-tailored intervention to promote safer injection practices among drug users. AIDS Behav. 2010, 14: 538-548. 10.1007/s10461-009-9651-x.View ArticlePubMed
- Lustria MLA, Cortese J, Noar SM, Gulueckauf RL: Computer-tailored health interventions delivered over the web: Review and analysis of key components. Patient Educ Couns. 2009, 74: 156-173. 10.1016/j.pec.2008.08.023.View ArticlePubMed
- Murray E, Burns ME, See Thai S, Lai R, Nazareth I: Interactive health communication applications for people with chronic disease (review). Cochrane Database Syst Rev. 2009, 1: CD000389-
- Joseph CLM, Peterson E, Havstad S, Johnson CC, Hoerauf S, Stringer S, Gibson-Scipio W, Ownby DR, Elston-Lafata J, Pallonen U, Strecher V: A web-based, tailored asthma management program for urban African-American high school students. Am J Respir Crit Care Med. 2007, 175: 888-895. 10.1164/rccm.200608-1244OC.PubMed CentralView ArticlePubMed
- Hee-Sung K: Impact of web-based nurse's education on glycosylated hemoglobin in type 2 diabetic patients. J Clin Nurs. 2007, 16: 1361-1366. 10.1111/j.1365-2702.2007.01506.x.View ArticlePubMed
- Kim CJ, Kang DH: Utility of a web-based intervention for individuals with type 2 diabetes: the impact on physical activity levels and glycemic control. Comput Inform Nurs. 2006, 24: 337-345. 10.1097/00024665-200611000-00008.View ArticlePubMed
- Wangberg SC: An internet-based diabetes self-care intervention tailored to self-efficacy. Health Educ Res. 2008, 23: 170-179.View ArticlePubMed
- Beranova E, Sykes C: A systematic review of computer-based softwares for educating patients with coronary heart disease. Patient Educ Couns. 2007, 66: 21-28. 10.1016/j.pec.2006.09.006.View ArticlePubMed
- Evangelista LS, Stromberg A, Westlake C, Ter-Galstanyan A, Anderson N, Dracup K: Developing a web-based education and counseling program for heart failure patients. Prog Cardiovasc Nurs. 2006, 21: 196-201. 10.1111/j.0889-7204.2006.05229.x.View ArticlePubMed
- Strömberg A, Dahlström U, Fridlund B: Computer-based education for patients with chronic heart failure. A randomised controlled multicentre trial of the effects on knowledge, compliance and quality of life. Patient Educ Couns. 2006, 64: 128-135. 10.1016/j.pec.2005.12.007.View ArticlePubMed
- Westlake C, Evangelista LS, Strömberg A, Ter-Galstanyan A, Vazirani S, Dracup K: Evaluation of a web-based education and counseling pilot program for older heart failure patients. Prog Cardiovasc Nurs. 2007, 22: 20-26. 10.1111/j.0889-7204.2007.05703.x.View ArticlePubMed
- Gustafson DH, Hawkins R, Boberg E, Pingree S, Serlin RE, Graziano F, Chan CL: Impact of a patient-centered, computer-based health information/support system. Am J Prev Med. 1999, 16: 1-9.View ArticlePubMed
- Gustafson DH, Hawkins RP, Boberg EW, McTavish F, Owens B, Wise M, Berhe H, Pingree S: CHESS: 10 years research and development in consumer health informatics for broad population, including the underserved. Int J Med Inf. 2002, 65: 169-177. 10.1016/S1386-5056(02)00048-5.View Article
- Gustafson DH, Hawkins R, McTavish F, Pingree S, Chen WC, Volrathonchai K, Serlin RC: Internet-based interactive support for cancer patients: are integrated systems better?. J Commun. 2008, 58: 238-257. 10.1111/j.1460-2466.2008.00383.x.PubMed CentralView ArticlePubMed
- Helwig A, Lovelle A, Guse C, Gottlieb M: An office-based internet patient education system: a pilot system. J Fam Pract. 1999, 48: 123-127.PubMed
- Roberto AJ, Zimmerman RS, Carlyle KE, Abner EL: A computer-based approach to preventing pregnancy, STD, and HIV in rural adolescents. J Health Commun. 2007, 12: 53-76. 10.1080/10810730601096622.View ArticlePubMed
- Tetzlaff L: Consumer informatics in chronic Illness. J Am Med Inform Assoc. 1997, 4: 285-300. 10.1136/jamia.1997.0040285.PubMed CentralView ArticlePubMed
- Winzelberg A, Eppstein D, Eldredge K, Wilfley D, Dasmahapatra R, Dev P, Taylor C: Effectiveness of an internet-based program for reducing risk factors in eating disorders. J Consult Clin Psychol. 2000, 68: 346-350.View ArticlePubMed
- "Cyberchondriacs" on the Rise? Those who go online for healthcare information continues to increase.http://www.harrisinteractive.com/NewsRoom/HarrisPolls/tabid/447/mid/1508/articleId/448/ctl/ReadCustom%20Default/Default.aspx,
- Canadian Internet Use Survey.http://www.statcan.gc.ca/daily-quotidien/100510/dq100510a-eng.htm,
- Utilisation d’Internet au Québec en novembre. 2011,http://blogue.cefrio.qc.ca/2011/11/utilisation-dinternet-au-quebec-en-novembre-2011, Internet use in Quebec on November 2011,
- National Institutes of Health: Grants and funding opportunities.http://grants.nih.gov/grants/oer.htm,
- Godin G, Côté J, Naccache H, Lambert LD, Trottier S: Predictors of adherence to antiretroviral therapy: A one year longitudinal study. AIDS Care. 2005, 17: 493-504. 10.1080/09540120412331291715.View ArticlePubMed
- Côté J, Godin G, Ramirez P, Gagnon ML, Rouleau G: Program development for enhancing adherence to antiretroviral therapy among persons living with HIV. AIDS Patient Care STDS. 2008, 22: 965-975. 10.1089/apc.2008.0124.View ArticlePubMed
- Côté J, Ramìrez-Garcia P, Rouleau G, Saulnier D, Guéhéneuc YG, Hernandez A, Godin G: A nursing virtual intervention: Real-time support for managing antiretroviral therapy. Comput Inform Nurs. 2011, 29: 43-51. 10.1097/NCN.0b013e3181f9dc02.View ArticlePubMed
- Bartholomew LK, Parcel GS, Kok G, Gottlieb NH: Intervention Mapping: Designing Theory- and Evidence-Based Health Promotion Programs. 2001, Mountain View, CA: Mayfield Publishing Co
- Bartholomew LK, Parcel GS, Kok G, Gottlieb NH: Planning Health Promotion Programs: An Intervention Mapping Approach. 2006, San Francisco: Jossey-Bass
- Bandura A: Self-efficacy: The exercice of control. 1997, New York: Freeman
- Tuldrà A, Fumaz CR, Ferrer MJ, Bayés R, Arno A, Balagué M, Bonjoch A, Jou A, Negredo E, Parades R: Prospective randomized two-arm controlled study to determine the efficacy of a specific intervention to improve long-term adherence to highly active antiretroviral therapy. J Acquir Immune Defic Syndr. 2000, 25: 221-228. 10.1097/00126334-200011010-00003.View ArticlePubMed
- Godin G, Gagné C, Naccache H: Validation of a self-reported questionnaire assessing adherence to antiretroviral medication. AIDS Patient Care STDS. 2003, 17: 325-332. 10.1089/108729103322231268.View ArticlePubMed
- Ortego C, Huedo-Medina TB, Llorca J, Sevilla L, Santos P, Rodriguez E, Warren MR, Vejo J: Adherence to highly active antiretroviral therapy (HAART): a meta-analysis. AIDS Behav. 2011, 15: 1381-1396. 10.1007/s10461-011-9942-x.View ArticlePubMed
- Justice AC, Holmes W, Gifford AL, Rabeneck L, Zackin R, Sinclair G, Weissman S, Neidig J, Marcus C, Chesney M: Development and validation of a self-completed HIV symptom index. J Clin Epidemiol. 2001, 54: S77-S90. 10.1016/S0895-4356(01)00449-8.View ArticlePubMed
- Badia X, Podzamczer D, Garcìa M, López-Lavid C, Consiglio E, Spanish MOS-HIV and MQOL-HIV Validation Group: A randomized study comparing instruments for measuring health-related quality of life in HIV-infected patients. Medical Outcomes Study HIV Health Survey. AIDS. 1999, 13: 1727-1735. 10.1097/00002030-199909100-00017.View ArticlePubMed
- Badia X, Podzamcer D, Casado A, López-Lavid C, García M, Spanish MOS-HIV and MQOL-HIV Validation Group: Evaluating changes in health status in HIV-infected patients: Medical Outcomes Study-HIV and Multidimensional Quality of Life-HIV quality of life questionnaires. AIDS. 2000, 14: 1439-1447. 10.1097/00002030-200007070-00018.View ArticlePubMed
- Liang K, Zeger S: Longitudinal data analysis using generalized linear models. Biometrics. 1986, 7: 13-22.View Article
- Bryk A, Raudenbush S, Congdon R: Hierarchical Linear and Nonlinear Modeling With the HLM/2L and HLM/3L programs. 1996, Chicago, IL: Scientific Software International
- Bennett GG, Glasgow RE: The delivery of public health interventions via the Internet: actualizing their potential. Annu Rev Public Health. 2009, 30: 273-292. 10.1146/annurev.publhealth.031308.100235.View ArticlePubMed
- Birnbaum MH: Human Research and Data Collection via the Internet. Annu Rev Psychol. 2004, 55: 803-832. 10.1146/annurev.psych.55.090902.141601.View ArticlePubMed
- Bull S, Lloyd L, Rietmeijer C, McFarlane M: Recruitment and retention of an online sample for an HIV prevention intervention targeting men who have sex with men: the Smart Sex Quest Project. AIDS Care. 2004, 16: 931-943. 10.1080/09540120412331292507.View ArticlePubMed
- Nosek BA, Banaji MR: E-Research: Ethics, security, design, and control in Psychological Research on the Internet. J Soc Issues. 2002, 58: 161-176. 10.1111/1540-4560.00254.View Article
- Smith MA, Leigh B: Virtual subjects: Using the Internet as an alternative source of subjects and research environment. Beh Res Meth. 1997, 29: 496-505. 10.3758/BF03210601.View Article
- Gosling SD, Vazire S, Srivastava S, John OP: Should we trust web-based studies?. Am Psychol. 2004, 59: 93-104.View ArticlePubMed
- Beddows E: The Methodological Issues Associated with Internet-Based Research. Int J Emerg Tech & Society. 2008, 6: 124-139.
- Hewson C: Conducting research on the internet. The Psychologist. 2003, 16: 290-293.
- Michalak EE, Szabo A: Guidelines for Internet Research: An update. Eur Psychol. 1998, 3: 70-75.
- Paul J, Seib R, Prescott T: The internet and clinical trials: Background, online resources, examples and issues. J Med Internet Res. 2005, 7: e5-10.2196/jmir.7.1.e5.PubMed CentralView ArticlePubMed
- Schubart JR, Stuckey HL, Ganeshamoorthy A, Sciamanna CN: Chronic health conditions and Internet Behavioral Interventions. Comput Inform Nurs. 2011, 29: TC9-TC20.View ArticlePubMed
- Bull S, Pratte K, Whitesell N, Rietmeijer C, McFarlane M: Effects of an Internet-based intervention for HIV prevention: the Youthnet trials. AIDS Behav. 2009, 13: 474-487. 10.1007/s10461-008-9487-9.View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.