- Study protocol
- Open Access
Using smartphones to decrease substance use via self-monitoring and recovery support: study protocol for a randomized control trial
Trials volume 18, Article number: 374 (2017)
Alcohol abuse, other substance use disorders, and risk behaviors associated with the human immunodeficiency virus (HIV) represent three of the top 10 modifiable causes of mortality in the US. Despite evidence that continuing care is effective in sustaining recovery from substance use disorders and associated behaviors, patients rarely receive it. Smartphone applications (apps) have been effective in delivering continuing care to patients almost anywhere and anytime. This study tests the effectiveness of two components of such apps: ongoing self-monitoring through Ecological Momentary Assessments (EMAs) and immediate recovery support through Ecological Momentary Interventions (EMIs).
The target population, adults enrolled in substance use disorder treatment (n = 400), are being recruited from treatment centers in Chicago and randomly assigned to one of four conditions upon discharge in a 2 × 2 factorial design. Participants receive (1) EMAs only, (2) EMIs only, (3) combined EMAs + EMIs, or (4) a control condition without EMA or EMI for 6 months. People in the experimental conditions receive smartphones with the apps (EMA and/or EMI) specific to their condition. Phones alert participants in the EMA and EMA + EMI conditions at five random times per day and present participants with questions about people, places, activities, and feelings that they experienced in the past 30 min and whether these factors make them want to use substances, support their recovery, or have no impact. Those in the EMI and EMA + EMI conditions have continual access to a suite of support services. In the EMA + EMI condition, participants are prompted to use the EMI(s) when responses to the EMA(s) indicate risk. All groups have access to recovery support as usual. The primary outcome is days of abstinence from alcohol and other drugs. Secondary outcomes are number of HIV risk behaviors and whether abstinence mediates the effects of EMA, EMI, or EMA + EMI on HIV risk behaviors.
This project will enable the field to learn more about the effects of EMAs and EMIs on substance use disorders and HIV risk behaviors, an understanding that could potentially make treatment and recovery more effective and more widely accessible.
ClinicalTrials.gov, ID: NCT02132481. Registered on 5 May 2014.
Cost estimates of 60 major illnesses place alcohol use disorders as the second most costly health problem and other drug use disorders as the seventh most costly health problem in the US . Both conditions relate to higher rates of risk behaviors associated with the human immunodeficiency virus (HIV). The three conditions represent three of the top 10 modifiable behavioral causes of death in the US. .
Studies indicate that effective strategies for managing substance use disorders (SUDs) must address their chronic and cyclical nature [3,4,5,6,7]. Untreated SUDs create circumstances, such as needle use and trading sex for drugs, that increase HIV risk , disease burden, and mortality [9, 10]. Although continuing care with monitoring has been associated with better outcomes for SUDs , as it has been for other chronic conditions , patients with SUDs rarely receive it [12, 13]. Mobile technology can provide tools for ongoing monitoring and assessment and access to recovery support interventions anytime and anywhere, thus offering the potential to radically improve the odds of a patient’s sustained recovery.
In recent decades, information and communication technologies (ICTs) have provided a number of options for self-monitoring, self-management, and self-initiated accessibility to care, including Internet programs [14, 15], telephone support [16, 17], telephone continuing care [18,19,20,21], text messaging [22, 23], and multiservice interventions . Recently, attention has focused on using smartphones as a platform for providing multiple services. A recent meta-analysis  identified six smartphone applications (apps), four of which had been rigorously evaluated. Two demonstrated an association with reduced alcohol use, including the app used in the research described below.
Using Ecological Momentary Assessments (EMAs) to self-monitor and change behavior
Fundamental to effectively self-managing recovery is one’s ability to monitor the interplay between one’s internal states (e.g., feelings, cravings) and external factors (e.g., people, places, activities) that have been shown to influence recovery. EMAs help people to self-monitor behaviors at the time and in the context in which they occur. Self-monitoring asks patients to note internal and external factors that take place with a target behavior such as substance use. Behavioral self-monitoring has been employed for several decades both as a means of studying behavior and as a component of therapeutic interventions . In behavioral therapy, it has been used both as an assessment and an intervention to change behavior. Self-monitoring is often considered a key component of self-management  because it can give patients insight into the dynamic relationship between these factors and the target behavior . Problem behaviors, such as SUDs, may be affected by multiple factors that may not be obvious to the individual but are revealed through frequent self-monitoring. The frequency and duration of scheduled EMAs can influence the impact of self-monitoring on behavior change. For example, Kauer and colleagues  demonstrated that increasing the rate of monitoring from one to six times a day was related to increased emotional self-awareness and subsequent reductions in depressive symptoms. Frequent self-monitoring has helped curtail risky behaviors under theories related to mindfulness and relapse prevention [28, 30,31,32].
Using EMA responses to predict risk
In addition to monitoring in real time the factors related to target behaviors, EMAs have been used to calculate the risk for new episodes of the target behavior—e.g., in schizophrenia [33,34,35]. Chih et al.  found that relapse to substance use could be predicted using information from a weekly survey on use in the prior week and risk and protective factors. In a pilot test with adolescents, Dennis et al.  developed a model of predictive analytics using three categories of risk based on the EMA used in this study. The predictive value of this model will be prospectively tested in the current study.
Using Ecological Momentary Interventions (EMIs) to provide immediate intervention
Ecological Momentary Interventions (EMIs) are provided during people’s everyday lives (i.e., in real time) anywhere they spend time (i.e., the real world) [38, 39]. EMIs vary in their level of human interactivity . At the high end of the range, patients may access a live therapist for a full therapy session or response to an emergency  or get help from peers or family [42, 43]. At the low end of the range, interventions may rely on educational components, breathing exercises, and relaxation recordings . A common limitation of previous studies is that EMIs are self-initiated; and even though EMIs are often available 24/7, individuals do not necessarily access them in response to risky situations [45, 46].
Using EMA responses to prompt EMI use
One response to these issues is to use EMA responses to tailor the delivery of EMIs rather than rely on the individual to initiate EMI use. One previously used method of tailoring involves having participants preidentify high-risk times and scheduling the delivery of EMIs during these risky times, as has been done in some smoking cessation studies [47,48,49,50]. Although this strategy works well when target behaviors are highly predictable, many are not. An alternative is to use EMA responses that indicate risk to trigger the automatic delivery of EMIs. This tailoring method requires that the circumstances that trigger the delivery of the intervention be clearly defined and measurable. Because substance use and many high-risk behaviors are discrete events with identifiable antecedents and consequences, they are ideal for integrating EMAs and EMIs.
This study will advance the field by using data from multiple daily EMAs to provide immediate feedback to participants about their risk of use and interventions (EMIs) designed to reduce risk and increase abstinence [51, 52]. Our team’s pilot study  demonstrated that using Addiction – Comprehensive Health Enhancement Support System (A-CHESS) within an hour of the EMA was associated with reducing by half the risk for use in the next 7 days. This finding will be prospectively tested in the current study with a factorial design. One important empirical question the study addresses is whether links between EMAs and EMIs improve outcomes beyond the effects of EMAs and EMIs alone. The primary goal of the trial is to examine the effect of combining, over 6 months, frequent self-monitoring (via EMAs) with immediate interventions (via EMIs) on days of abstinence from drugs and alcohol and, secondarily, number of HIV risk behaviors.
Aims and hypotheses
The aims of this randomized controlled trial (RCT) are to (1) test the effect of EMAs, EMIs, and EMAs + EMIs on days of abstinence from alcohol and other drugs, (2) test the effect of EMAs, EMIs, and EMAs + EMIs on HIV risk behaviors, and (3) evaluate the extent to which changes in days of abstinence mediate the effect of EMAs, EMIs, and EMAs + EMIs on HIV risk behaviors. The primary hypothesis is that (H1) participants assigned to (H1a) EMAs, (H1b) EMIs, and (H1c) EMAs + EMIs will have, compared with control-group participants, more days of abstinence from drugs and alcohol in the 6 months post discharge from treatment. The two secondary hypotheses are that (H2) participants assigned to EMAs, EMIs, and EMAs + EMIs will have, compared with control-group participants, fewer HIV risk behaviors in the 6 months post discharge, and that (H3) days abstinent at 3 months post discharge will mediate the effects of EMAs, EMIs, and EMAs + EMIs on HIV risk behavior at 6 months post discharge.
Participants are randomly assigned in a 2 × 2 factorial design to receive EMAs only, EMIs only, combined EMAs + EMIs, or recovery support as usual (control). Participants in the three EMA/EMI groups receive a smartphone and training. Individuals in the two groups receiving EMIs can initiate at any time a suite of interventions designed to support recovery. In the EMAs + EMIs group, participants receive feedback directly after they complete each EMA; risky EMA responses are used to encourage EMI use.
Men and women are eligible if they: (1) are 18 years old or older, (2) met criteria for SUDs in the year prior to treatment intake, (3) currently live in Chicago, (4) can communicate in English, and (5) are cognitively able to provide informed consent. Individuals are ineligible if they: (1) currently live outside Chicago or plan to live outside of Chicago during the 6 months of the study, (2) expect to be in jail, prison, or another setting that would prevent the use of smartphones, (3) are unable to use a smartphone because of a disability or health condition, (4) are unwilling to learn to use a smartphone or to complete a survey using a smartphone, (5) are admitted to a treatment program that provides intensive services post discharge, (6) have a recovery coach and have been in contact with the recovery coach in the last 30 days, (7) fail the Short Blessed cognitive impairment test , and (8) have ever been diagnosed with, or told by a physician that they have, schizophrenia and/or are bi-polar.
Participants in all four randomization groups receive recovery support as usual (RSAU), which includes relapse-prevention training. All participants also visit the research office twice during the first month of the intervention period and at months 3 and 6 after enrollment to complete surveys and for urine monitoring. Participants in the three treatment groups receive an Android phone after randomization. Table 1 shows the intervention components by group; the interventions are described below.
Recovery support as usual (control group)
Standard discharge practice is to provide a recovery plan and relevant referrals in the community. A recent RCT that examined RSAU for patients discharged from one of the main recruitment sites indicated that 37% of clients attended self-help in the community, 41% participated in substance-free structured activities, and about 14% returned to treatment within 6 months . Participants also receive relapse-prevention training, during which they review how people, places, things, and feelings can support their recovery and/or operate as triggers.
Participants in the EMA-only condition receive a 2-h training on how to use the phone, how EMAs can help with self-monitoring, and procedures for completing the EMAs. During participants’ two visits to the research office in month 1, research staff check participants’ proficiency in using the phone, offering help as necessary. EMAs are delivered five times a day within a range of 16 h established by the participant. EMAs consist of the same set of 28 questions with possible answers. Although the questions and answers remain the same, the order of the questions and the order of the answers vary randomly. Questions ask participants to record their recent substance use, HIV risk behaviors (e.g., needle use, unprotected sex), and exposure in the last 30 min to internal and external protective and risk factors (people, places, activities, and feelings), and then to rate the extent to which these factors support their recovery, make them want to use drugs or alcohol, or have no impact. Participants receive a “thank-you” when they complete the EMA. Each EMA takes 2 to 3 min to complete.
Participants in the EMI-only condition receive a 2-h training on how to use the phone, how EMIs relate to relapse prevention or HIV risk reduction, and how to access each EMI. Like those in the EMA condition, EMI-group participants have their proficiency with the phone checked during their two research office visits in month 1, getting help if needed.
EMIs come from A-CHESS, a smartphone system designed to provide continuing care for patients with alcohol use disorders . A-CHESS was tested in a randomized clinical trial and found to reduce risky drinking days . The system, which is informed by Marlatt’s relapse prevention model , includes information about addiction and recovery, reminders about motivators and healthy coping mechanisms, healthy activities sent through alerts and shared calendars, distractions from craving and negative affect through games and social networking, personal stories about others in recovery, and social supports. Social support is important for managing several chronic diseases [54, 55] and is an integral part of A-CHESS. The goal of the social support tools is to develop for each user a network that can help when the user feels at risk of a lapse [56, 57]. A-CHESS social supports are discussion groups (with use guidelines and monitoring), the support team , and text messaging [59,60,61].
Although A-CHESS reduced risky drinking days among participants who had it versus the control group, the clinical trial raised issues that the design of the current study will allow us to examine. For example, participants rated themselves on protective and risk factors weekly, which made the ratings subject to recall bias; opportunities to intervene in the moment of greatest need were lost if users did not initiate use of A-CHESS in the moment; and “teachable moments”—when participants might have consciously linked risk factors to their desire for or actual use of alcohol—may have been lost.
EMAs + EMIs
Participants in the EMA + EMI condition receive the interventions described above, with EMI training taking place a week after EMA training. In pilot studies, we found that participants could easily learn to operate the phone and complete EMAs one week and then integrate EMIs the next week, but doing all the training at once was too much. Like participants in the EMA group, participants in the combined group receive a thank-you when they complete an EMA, but in addition, they receive a message related to their risk of relapse—high, moderate, or low. Relapse risk is based on a participant’s EMA responses from the last 7 days (i.e., their substance use in the past 30 min, past week, or more than a week ago). Each level of risk has a corresponding set of messages; one message from the appropriate set is randomly selected and sent to the participant after the EMA is completed. For example, a participant with a low risk of relapse receives a randomly selected message from the set of low-risk messages. Below this risk-adjusted message, participants always see the menu of EMIs.
Setting, recruitment, and training procedures
Research staff are screening and recruiting participants from two treatment agencies in Chicago (Family Guidance, Haymarket), as well as providing all interventions, follow-up and assessments described here. During the intake process for treatment, staff members give study candidates an overview of the study and an informational flyer and then complete a brief screen to determine eligibility. Individuals who are eligible and agree to participate sign a Consent Form agreeing to be contacted by research staff. Once individuals complete three outpatient sessions or 3 days of residential treatment, researchers contact study candidates to verify contact information and inform candidates that once they are discharged from treatment, they qualify for the next eligibility phase and research staff will be in contact again.
Once candidates are discharged from treatment for any reason or have not attended an outpatient session in 4 weeks, which researchers verify through treatment records, eligible candidates are scheduled for study training. Because smartphones are not allowed on residential units, participants in residential treatment become eligible for training either upon discharge or termination from treatment.
At the beginning of the training session, researchers complete the informed consent process to enroll patients, administer the Global Appraisal of Individual Needs – Quick version 3 (GAIN-Quick 3; discussed further below), and collect locator data and a urine specimen. Next, participants are randomly assigned to one of the four conditions. All individuals participate in relapse-prevention training, after which participants in the control condition leave; those in the other three conditions participate in a smartphone training to ensure they can operate the phone. Next, individuals in the EMA-only and EMA + EMI conditions participate in EMA training; participants in the EMI-only condition receive the EMI training.
Figure 1 shows the flow of participants through the trial.
Participants are randomly assigned to receive recovery support as usual (control), EMAs only, EMIs only, or combined EMAs + EMIs. Randomization uses urn randomization  with a base rate of 25% per condition stratified by participant characteristics (gender, race, age, recruitment cohort, level of comfort using a smartphone), pretreatment measures of the dependent variables (days of abstinence, HIV risk behaviors), and prerandomization treatment (level of care, length of stay, type of discharge) to increase the likelihood that participants are distributed similarly across conditions. Urn randomization adjusts the probability of assignment to a condition in ways that simultaneously minimize differences in multiple stratification variables [63, 64]. Only the research coordinator and protocol monitor responsible for scheduling, proficiency testing, and protocol supervision have access to information about who is in each condition. The research coordinator informs participants of their group assignment, describes the next steps, schedules training, and provides an appointment card for the next office visit.
Table 2 shows the key measures used in the study, which are described below.
Researchers trained and supervised by Scott and Dennis interview participants using the 25-min Global Appraisal of Individual Needs Quick Version 3 (GAIN-Q3) . The GAIN-Q3 includes screeners with four to six questions on the recency of symptoms in nine problem areas (school, work, health, stress, HIV risk behaviors/victimization, internalizing disorders, externalizing disorders, substance use disorders, and crime/violence). These screeners were constructed to be correlated at .9 or more with the 11 to 43 symptoms in the full GAIN and cut points with approximately 90% sensitivity, specificity, and area under the curve compared with the full GAIN in the nine areas. Days-of-use measures have been validated against the timeline follow-back , collateral , records , and urine [66,67,68] and saliva tests . The GAIN-Q3 also includes summary measures for health care utilization, functional impairment, quality of life, and life satisfaction.
Urine drug screens
Interviews are supplemented with on-site urine screens. Urine will be tested on-site with CLIAA-waived QuikScreen cups using an immunochromatographic assay for rapid (2 to 5 min) qualitative results based on the Substance Abuse and Mental Health Service Authority (SAMHSA)-standard cutoffs for alcohol (20 mg/dl or 0.02% BAC), amphetamine/methamphetamine (1000 ng/ml), cannabis (50 ng/ml), cocaine/benzoylecgonine (300 ng/ml), and opiates/morphine (2000 ng/ml) .
Measurement process/data collection
The team is implementing  follow-up procedures, which reliably produce over 90% follow-up rates across studies involving over 40,000 patients regardless of population for follow-up periods ranging from 3 months to 15 years. Steps include: (1) collecting contact information and Consent-to-be-contacted Forms and giving the participant an appointment card, (2) verifying participant contact information, (3) conducting outreach for past-due participants and discussing the situations at weekly research case review meetings, (4) mailing thank-you cards to participants, (5) scheduling follow-up appointments, (6) mailing 3- and 6-week post-enrollment flyers to participants and their collaterals, (7) implementing returned-mail procedures, (8) calling participants 6 weeks before 3- and 6-month research interview appointments to confirm date and location, (9) conducting outreach for unconfirmed cases and reviewing them at weekly meetings, (10) completing follow-up interviews and scheduling next appointments, and (11) implementing a no-show protocol. Progress is being monitored with daily management reports. These procedures help maintain participant contact even for controls and information about whether a phone is lost, stolen, or damaged. Data collected at assessments are identified by study ID, not participant name. The form linking study IDs to names and the data themselves are kept in GAINS ABS, a secure electronic data management system.
For the primary outcome (H1) power analysis, we assumed a sample size of 400 with treatment intake records/services data from the provider (for covariates), interviews by research staff at three time points for the main analysis (baseline and 3 and 6 months), a completion rate of 90 + % per wave of 100 participants, a moderate effect size of Cohen’s d = .4 based on Cox’s formula  for converting the odds ratio from a pilot study to effect size d = LN(1.9)/1.65 = .4)), a target of at least 90% power with a family wise alpha of < .017 on the three a-priori orthogonal contrasts testing the hypothesized effects of EMA, EMI, and their interaction on the primary outcome (days of abstinence), and at least 80% power for all six pairwise comparisons with a family wise alpha of < .0083. The effective n for power calculations in repeated measures analysis varies between a lower bound of the number of unique people (N = 400 people) and an upper bound of observations from baseline and completed follow-up or 1120 observations (O = (400 people + 90% × 400 people × 2 follow-ups) = 1120) as a function of the Intraclass Correlation Coefficient (ICC) associated with the individual and the number of repeated measures (RM) per person (effective n’ = O/(1 + ICC(RM − 1)). In prior samples from the proposed recruitment site , the ICC of the days of abstinence between enrollment, 3, and 6 months post enrollment was .52, resulting in an effective n’ of 549 (n’ = 1120/(1 + .52(3 − 1)) = 549) and 98% power for a two-tailed test of p < .017. Note that in the special case of a balanced 2 × 2 as proposed here, the power for the interaction test is the same as each of the main effects [71,72,73,74]. In the same study, the ICC of the HIV Risk Behavior Scale was .51, resulting in an effective n’ of 554 and 99% power for a two-tailed test of alpha < .05. For the six possible pairwise comparisons, the effective sample size (n’ = 275 per pair for H1 and H2) will be sufficient to have 80% power for a two-tailed test of p < .0083. Following the recommendations of Piantadosi , we have powered this design for the most conservative pairwise tests so that we can look at the efficacy of each combination (EMA, EMI, EMA + EMI) relative to the control and their comparative effectiveness with each other. For mediation analysis (H3), the tests should have 90% + power for a two-tailed test of p < .05 for an indirect effect size of d = .22 or more.
Recruitment began in June 2015; the intervention period ends in April 2018. Figure 2 shows the study schedule of enrollment, intervention, and assessments.
Participants complete their intake and enrollment interviews before randomization. Based on past experience, we expect to complete 90% or more of the 3- and 6-month post-enrollment interviews and have less than 1% missing data on core items. Multiple imputations will be used to replace missing data to allow the least biased estimate for each analysis . To further reduce potential bias, analyses will be rechecked by running them without missing data. If differences result, a general latent variable framework  will be used to analyze non-ignorable or systematic missingness that tests whether missing data are qualitatively different by condition.
Analysis for aims 1 and 2
We will evaluate the effects of EMAs, EMIs, and EMAs + EMIs on the days of abstinence (H1) and HIV risk behaviors (H2) measured from enrollment to 6 months after enrollment using multilevel structural equation modeling (MSEM) with mixed effects in MPlus (version 6.1). The analysis will model observations (level 1) nested within participants (level 2), with participants modeled as a random factor. Random assignment to the four groups will be modeled as a level 2 predictor in the 2 × 2 factorial design  with the three planned orthogonal contrasts shown earlier in Table 1. To be conservative, a Bonferroni correction for family wise error (p = 05/3 = 0.017) will be used on primary outcome (days of abstinence) in the three a-priori hypothesis tests for the effect of getting EMA or not (H1a), EMI or not (H1b), and their interaction (H1c). As noted earlier, self-monitoring via EMAs is expected to change behavior. Based on the preliminary studies, we expect EMIs to have an effect in their own right and for the combined EMA + EMI condition to have an additional effect (i.e., an interaction). This and all analyses will use an intent-to-treat approach (i.e., participants are analyzed as assigned regardless of their actual level of participation). Prerandomization participant characteristics, severity, and treatment experience used for urn randomization will be checked for any group differences and used in a propensity score covariate to further reduce unexplained variance. Restricted maximum likelihood estimation (REML) will be used within condition to allow the use of all available data. If there is a significant effect for H1 or H2, we will also examine all six of the possible pairwise comparisons, using an experiment-wise error of .05 and a pairwise test alpha of .05/6 tests = .0083.
Mediation analysis (aim 3)
H1 and H2 will provide a test of the direct effects of randomization. To evaluate mediation (H3), we will evaluate (1) the extent to which a direct effect exists between days of abstinence in months 1 to 3 post enrollment and HIV risk behaviors in months 4 to 6 post enrollment (i.e., is the path coefficient significant?) and (2) the extent to which including days of abstinence eliminates or reduces the direct effect of the EMAs, EMIs, and EMAs + EMIs on HIV risk behaviors using the Preacher et al.  framework for testing mediation in MSEM with REML in MPlus. Note that to ensure temporal precedence, we have purposely set up random assignment at the time of enrollment, days of abstinence from months 1 to 3 post enrollment, and HIV risk behaviors in months 4 to 6 post enrollment. Loss of statistical significance in the direct path coefficient from the intervention conditions to the HIV risk behaviors would indicate full mediation; a reduction in the path coefficient would indicate partial mediation. The statistical significance of the reduction will be evaluated using MacKinnon’s  joint-significance testing of the path z-scores, with a Sobel test using a standard error based on bootstrapping and criteria of p < .05 on the degree of change. We expect the increased days of abstinence to be the primary mediator of change in HIV risk behaviors, consistent with data from our prior research [6, 7, 81, 82].
Combined and additional analyses
Each of the above relationships will be combined to test the overall conceptual model using MSEM with REML in MPlus as part of testing mediation. To better understand for whom the intervention is working, we will also examine whether participant characteristics (including gender, race, age, and familiarity with smartphones), pretreatment days of abstinence and HIV risk behavior, and pre-enrollment treatment experiences moderate any of the observed effects in the combined model using a multigroup MSEM with mixed effects in MPlus.
Contribution to science and practice
This study will inform the field about whether smartphone EMAs have an independent effect on addiction recovery. It will assess whether EMAs can help patients to monitor multiple risk factors such as people, places, activities, and feelings. It will also provide evidence about whether feedback from EMAs encouraging participant use of EMIs increases the use of EMIs, which ultimately may reduce relapse to substance use and extend recovery. We will also test whether reduced substance use in the EMA + EMI arm leads to fewer HIV risk behaviors. Finally, frequent and regular EMA monitoring of risk of relapse mitigates the biases resulting from retrospective reporting and will likely enhance our understanding of the proximal antecedents of relapse and improve the timeliness and appropriateness of interventions. This information may lead to improved treatment and recovery interventions for people with substance use disorders.
Recruiting prospective participants at treatment initiation but not consenting and enrolling them until discharge from treatment has led to slower recruitment than expected. Many more people than expected are ineligible because they live outside the city of Chicago or have a recovery coach with whom they are been actively involved in the past 30 days.
We are finding in this study, unlike prior studies using only EMIs, that participants make heavy use of streaming video and/or music and this is straining the budget for data contracts. In previous research with smartphone apps, we have had one or two people per study overuse the data plan, but in this study so far, we are finding that nearly half of participants have at least 1 month of very heavy data use. We are analyzing use data to try to identify which apps are resulting in the overages.
The trial has received ethical approval and as of 28 February 2017 we have enrolled 343 participants.
Addiction – Comprehensive Health Enhancement Support System
Ecological Momentary Assessment
Ecological Momentary Intervention
Global Appraisal of Individual Needs Quick Version 3
Human immunodeficiency virus
Recovery support as usual
Substance use disorders
Kirschstein R. Disease-specific estimates of direct and indirect costs of illness and NIH support: fiscal year 2000 update. Bethesda: Department of Health and Human Services, National Institutes of Health, Office of the Director; 2000.
Mokdad AH, Marks JS, Stroup DF, Gerberding JL. Actual causes of death in the United States, 2000. JAMA. 2004;291(10):1238–45.
Dennis ML, Scott CK, Funk RR. An experimental evaluation of recovery management checkups (RMC) for people with chronic substance use disorders. Eval Program Plann. 2003;26(3):339–52.
Scott CK, Dennis ML, Foss MA. Utilizing recovery management checkups to shorten the cycle of relapse, treatment reentry, and recovery. Drug Alcohol Depend. 2005;78(3):325–38.
Scott CK, Dennis ML. Results from two randomized clinical trials evaluating the impact of quarterly recovery management checkups with adult chronic substance users. Addiction. 2009;104(6):959–71.
Dennis ML, Scott CK. Four-year outcomes from the Early Re-Intervention (ERI) experiment using Recovery Management Checkups (RMCs). Drug Alcohol Depend. 2012;121(1-2):10–7.
Scott CK, Dennis ML, Lurgio AJ. The effects of specialized probation and Recovery Management Check-Ups (RMCs) on treatment participation, substance use, HIV-risk behaviors, and recidivism among female offenders: main findings of a three-year experiment using subject by intervention interaction analysis. J Exp Criminol. 2017. doi: 10.1007/s11292-016-9281-z.
Miller M. A model to explain the relationship between sexual abuse and HIV risk among women. AIDS Care. 1999;11(1):3–20.
McKenna MT, Michaud CM, Murray CJ, Marks JS. Assessing the burden of disease in the United States using disability-adjusted life years. Am J Prev Med. 2005;28(5):415–23.
Mathers CD, Loncar D. Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med. 2006;3(11):e442.
McLellan AT, McKay JR, Forman R, Cacciola J, Kemp J. Reconsidering the evaluation of addiction treatment: from retrospective follow‐up to concurrent recovery monitoring. Addiction. 2005;100(4):447–58.
McLellan AT, Lewis DC, O’Brien CP, Kleber HD. Drug dependence, a chronic medical illness: implications for treatment, insurance, and outcomes evaluation. JAMA. 2000;284(13):1689–95.
White WL, Boyle M, Loveland D. Alcoholism/addiction as a chronic disease: from rhetoric to clinical reality. Alcohol Treat Q. 2002;20(3-4):107–29.
Heapy AA, Higgins DM, Cervone D, Wandner L, Fenton BT, Kerns RD. A systematic review of technology-assisted self-management interventions for chronic pain: looking across treatment modalities. Clin J Pain. 2015;31(6):470–92.
Walsh S, Golden E, Priebe S. Systematic review of patients’ participation in and experiences of technology-based monitoring of mental health symptoms in the community. BMJ Open. 2016;6(6):e008362.
Cacciola JS, Camilleri AC, Carise D, Rikoon SH, McKay JR, McLellan AT, et al. Extending residential care through telephone counseling: initial results from the Betty Ford Center Focused Continuing Care protocol. Addict Behav. 2008;33(9):1208–16.
Boschen MJ, Casey LM. The use of mobile telephones as adjuncts to cognitive behavioral psychotherapy. Prof Psychol. 2008;39(5):546.
Godley MD, Coleman-Cowger VH, Titus JC, Funk RR, Orndorff MG. A randomized controlled trial of telephone continuing care. J Subst Abuse Treat. 2010;38(1):74–82.
Horng FF, Chueh KH. Effectiveness of telephone follow-up and counseling in aftercare for alcoholism. J Nurs Res. 2004;12(1):11–20.
McKay JR, Lynch KG, Shepard DS, Ratichek S, Morrison R, Koppenhaver J, et al. The effectiveness of telephone-based continuing care in the clinical management of alcohol and cocaine use disorders: 12-month outcomes. J Consult Clin Psychol. 2004;72(6):967–79.
McKay JR. Is there a case for extended interventions for alcohol and drug use disorders? Addiction. 2005;100(11):1594–610.
Krishna S, Boren SA, Balas EA. Healthcare via cell phones: a systematic review. Telemed J E Health. 2009;15(3):231–40.
Suffoletto B, Callaway C, Kristan J, Kraemer K, Clark DB. Text-message-based drinking assessments and brief interventions for young adults discharged from the emergency department. Alcohol Clin Exp Res. 2012;36(3):552–60.
Bosworth K, Espelage D, DuBay T, Daytner G, Karageorge K. Preliminary evaluation of a multimedia violence prevention program for adolescents. Am J Health Behav. 2000;24(4):268–80.
Meredith SE, Alessi SM, Petry NM. Smartphone applications to reduce alcohol consumption and help patients with alcohol use disorder: a state-of-the-art review. Adv Health Care Technol. 2015;1:47–54.
Carter BL, Day SX, Cinciripini PM, Wetter DW. Momentary health interventions: where are we and where are we going? In: Stone AA, Shiffman S, Atienza AA, Nebeling L, editors. The science of real-time data capture: self reports in health research. New York: Oxford; 2007. p. 289–307.
Wichers M, Hartmann JA, Kramer IM, Lothmann C, Peeters F, van Bemmel L, et al. Translating assessments of the film of daily life into person-tailored feedback interventions in depression. Acta Psychiatr Scand. 2011;123(5):402–3.
Freedman MJ, Lester KM, McNamara C, Milby JB, Schumacher JE. Cell phones for ecological momentary assessment with cocaine-addicted homeless patients in treatment. J Subst Abuse Treat. 2006;30(2):105–11.
Kauer SD, Reid SC, Crooke AH, Khor A, Hearps SJ, Jorm AF, et al. Self-monitoring using mobile phones in the early stages of adolescent depression: randomized controlled trial. J Med Internet Res. 2012;14(3):e67.
Marlatt G, Gordon J. Relapse prevention: maintenance strategies in the treatment of addictive disorders. New York: Guilford; 1985.
Marlatt GA. Highlights of harm reduction: a personal report from the first national harm reduction conference in the United States. In: Marlatt GA, editor. Harm reduction: pragmatic strategies for managing high-risk behaviors. New York: Guilford Press; 1998. p. 3–29.
Witkiewitz K, Marlatt GA. Relapse prevention for alcohol and drug problems: that was Zen, this is Tao. Am Psychol. 2004;59(4):224–35.
Spaniel F, Vohlidka P, Hrdlicka J, Kozeny J, Novak T, Motlova L, et al. ITAREPS: information technology aided relapse prevention programme in schizophrenia. Schizophr Res. 2008;98(1-3):312–7.
Spaniel F, Vohlidka P, Kozeny J, Novak T, Hrdlicka J, Motlova L, et al. The information technology aided relapse prevention programme in schizophrenia: an extension of a mirror-design follow-up. Int J Clin Pract. 2008;62(12):1943–6.
Spaniel F, Hrdlicka J, Novak T, Kozeny J, Hoschl C, Mohr P, et al. Effectiveness of the information technology-aided program of relapse prevention in schizophrenia (ITAREPS): a randomized, controlled, double-blind study. J Psychiatr Pract. 2012;18(4):269–80.
Chih MY, Patton T, McTavish FM, Isham AJ, Judkins-Fisher CL, Atwood AK, et al. Predictive modeling of addiction lapses in a mobile health application. J Subst Abuse Treat. 2014;46(1):29–35.
Dennis ML, Scott CK, Funk RR, Nicholson L. A pilot study to examine the feasibility and potential effectiveness of using smartphones to provide recovery support for adolescents. Subst Abus. 2015;36(4):486–92.
Patrick K, Intille SS, Zabinski MF. An ecological framework for cancer communication: implications for research. J Med Internet Res. 2005;7(3):e23.
Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol. 2010;15(Pt 1):1–39.
Simon GE, Ludman EJ, Rutter CM. Incremental benefit and cost of telephone care management and telephone psychotherapy for depression in primary care. Arch Gen Psychiatry. 2009;66(10):1081–9.
Depp CA, Mausbach B, Granholm E, Cardenas V, Ben-Zeev D, Patterson TL, et al. Mobile interventions for severe mental illness: design and preliminary data from three approaches. J Nerv Ment Dis. 2010;198(10):715–21.
Gustafson DH, Hawkins R, Boberg E, Pingree S, Serlin RE, Graziano F, et al. Impact of a patient-centered, computer-based health information/support system. Am J Prev Med. 1999;16(1):1–9.
Han JY, Shah DV, Kim E, Namkoong K, Lee SY, Moon TJ, et al. Empathic exchanges in online cancer support groups: distinguishing message expression and reception effects. Health Commun. 2011;26(2):185–97.
Robinson TN, Patrick K, Eng TR, Gustafson D. An evidence-based approach to interactive health communication: a challenge to medicine in the information age. Science Panel on Interactive Communication and Health. JAMA. 1998;280(14):1264–9.
Gustafson DH, McTavish FM, Chih MY, Atwood AK, Johnson RA, Boyle MG, et al. A smartphone application to support recovery from alcoholism: a randomized clinical trial. JAMA Psychiat. 2014;71(5):566–72.
Heron KE. Ecological Momentary Intervention [EMI]: incorporating mobile technology into a disordered eating treatment program for college women. Syracuse: Syracuse University; 2011.
Lazev A, Vidrine D, Arduino R, Gritz E. Increasing access to smoking cessation treatment in a low-income, HIV-positive population: the feasibility of using cellular telephones. Nicotine Tob Res. 2004;6(2):281–6.
Obermayer JL, Riley WT, Asif O, Jean-Mary J. College smoking-cessation using cell phone text messaging. J Am Coll Health. 2004;53(2):71–8.
Rodgers A, Corbett T, Bramley D, Riddell T, Wills M, Lin RB, et al. Do u smoke after txt? Results of a randomised trial of smoking cessation using mobile phone text messaging. Tob Control. 2005;14(4):255–61.
Vidrine DJ, Arduino RC, Gritz ER. Impact of a cell phone intervention on mediating mechanisms of smoking cessation in individuals living with HIV/AIDS. Nicotine Tob Res. 2006;8 Suppl 1:S103–8.
Moos RH. Theory-based processes that promote the remission of substance use disorders. Clin Psychol Rev. 2007;27(5):537–51.
Oslin DW, Cary M, Slaymaker V, Colleran C, Blow FC. Daily ratings measures of alcohol craving during an inpatient stay define subtypes of alcohol addiction that predict subsequent risk for resumption of drinking. Drug Alcohol Depend. 2009;103:131–6.
Titus JC, Feeney T, Smith DC, Rivers TL, Kelly LL, Dennis ML. Global Appraisal of Individual Needs–Q3 3.2 (GAIN-Q3): administration, clinical interpretation and brief intervention. Normal: Chestnut Health Systems; 2003. Retrieved from www.gaincc.org/instruments.
Gallant MP. The influence of social support on chronic illness self-management: a review and directions for research. Health Educ Behav. 2003;30(2):170–95.
DiMatteo MR. Social support and patient adherence to medical treatment: a meta-analysis. Health Psychol. 2004;23(2):207–18.
Walton MA, Blow FC, Bingham CR, Chermack ST. Individual and social/environmental predictors of alcohol and drug use 2 years following substance abuse treatment. Addict Behav. 2003;28(4):627–42.
Stalcup SA, Christian D, Stalcup J, Brown M, Galloway GP. A treatment model for craving identification and management. J Psychoactive Drugs. 2006;38(2):189–202.
McTavish FM, Chih MY, Shah D, Gustafson DH. How patients recovering from alcoholism use a smartphone intervention. J Dual Diagn. 2012;8(4):294–304.
Alemi F, Mosavel M, Stephens RC, Ghadiri A, Krishnaswamy J, Thakkar H. Electronic self-help and support groups. Med Care. 1996;34 Suppl 10:Os32–44.
Ouimette P, Humphreys K, Moos RH, Finney JW, Cronkite R, Federman B. Self-help group participation among substance use disorder patients with posttraumatic stress disorder. J Subst Abuse Treat. 2001;20(1):25–32.
Ouimette P, Moos RH, Finney JW. PTSD treatment and 5-year remission among patients with substance use and posttraumatic stress disorders. J Consult Clin Psychol. 2003;71(2):410.
Charpentier PA. Urn randomization program gRand v1.10. New Haven: Yale University; 2003.
Stout RL, Wirtz PW, Carbonari JP, Del Boca FK. Ensuring balanced distribution of prognostic factors in treatment outcome research. J Stud Alcohol Suppl. 1994;12:70–5.
Wei LJ, Lachin JM. Properties of the urn randomization in clinical trials. Control Clin Trials. 1988;9(4):345–64.
Dennis ML, Funk R, Godley SH, Godley MD, Waldron H. Cross-validation of the alcohol and cannabis use measures in the Global Appraisal of Individual Needs (GAIN) and Timeline Followback (TLFB; Form 90) among adolescents in substance abuse treatment. Addiction. 2004;99 Suppl 2:120–8.
Dennis M, Godley SH, Diamond G, Tims FM, Babor T, Donaldson J, et al. The Cannabis Youth Treatment (CYT) study: main findings from two randomized trials. J Subst Abuse Treat. 2004;27(3):197–213.
Godley MD, Godley SH, Dennis ML, Funk R, Passetti LL. Preliminary outcomes from the assertive continuing care experiment for adolescents discharged from residential treatment. J Subst Abuse Treat. 2002;23(1):21–32.
Lennox RD, Dennis ML, Scott CK, Funk RR. Combining psychometric and biometric measures of substance use. Drug Alcohol Depend. 2006;83(2):95–103.
Substance Abuse and Mental Health Services Administration (SAMHSA). Notice of proposed revisions to the Mandatory Guidelines for Federal Workplace Drug Testing Programs. Federal Register, 25 November 2008 (73 FR 71858), Section 3.4. Rockville: Substance Abuse and Mental Health Services Administration, Department of Health and Human Services; 2015.
Scott CK. A replicable model for achieving over 90% follow-up rates in longitudinal studies of substance abusers. Drug Alcohol Depend. 2004;74(1):21–36.
Cox DR. The analysis of binary data. London: Methuen; 1970.
Shaw R, Festing MF, Peers I, Furlong L. Use of factorial designs to optimize animal experiments and reduce animal use. ILAR J. 2002;43(4):223–32.
Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: Lawrence Erlbaum Associates; 1988.
Box GEP, Hunger JS, Hunter WG. Statistics for experimenters: design, innovation, and discovery. 2nd ed. Wiley Series in Probability and Statistics. Hoboken: Wiley; 2005.
Piantadosi S. Clinical trials: a methodologic perspective. New York: Wiley; 2005.
Schafer JL, Graham JW. Missing data: our view of the state of the art. Psychol Methods. 2002;7(2):147.
Muthen B, Asparouhov T, Hunter AM, Leuchter AF. Growth modeling with nonignorable dropout: alternative analyses of the STAR*D antidepressant trial. Psychol Methods. 2011;16(1):17–33.
Fisher RA, editor. The design of experiments. 8th ed. Edinburgh: Oliver and Boyd; 1966.
Preacher KJ, Zyphur MJ, Zhang Z. A general multilevel SEM framework for assessing multilevel mediation. Psychol Methods. 2010;15(3):209–33.
MacKinnon DP, Fairchild AJ, Fritz MS. Mediation analysis. Annu Rev Psychol. 2007;58:593–614.
Dennis ML, Scott CK, Johnson K. Recovery management using mobile phones: momentary ecological assessments and interventions for women offenders in recovery. 120th Annual Convention of the American Psychological Association. 2012.
Scott CK, Dennis ML. The first 90 days following release from jail: findings from the Recovery Management Checkups for Women Offenders (RMCWO) experiment. Drug Alcohol Depend. 2012;125(1-2):110–8.
The authors thank Kim Johnson for assistance in preparing an earlier version of the manuscript. We thank the study participants for their time and support and Roberta Johnson for her excellent input and editing on this paper.
The study was supported by National Institute on Drug Abuse grant no. DA035789. The funder has no role in study design, the interpretation of data, or the publication of results.
Availability of data and materials
This is not applicable as this is a design paper.
Ethics approval and consent to participate
Participation was voluntary. The study received approval from the Chestnut Health Systems’ Institutional Review Board (IRB Study No. 1091-0114) and is registered at Clinical Trials.gov (NCT02132481). Chestnut’s IRB acted as a Centralized Ethics Committee for the two substance use treatment agencies from which participants were recruited. The study complies with the relevant Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) and World Health Organization (WHO) Checklist (see Additional file 1).
Consent for publication
Informed written consent was received for publication of the manuscript and figures. The Consent Form is held by the authors and their institution and is available for review by the Editor-in-Chief.
Author Dr. Gustafson has a shareholder interest in CHESS Mobile Health, a small business that develops web-based health care technology for patients and family members. This relationship is extensively managed by the authors and the University of Wisconsin. All other authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1:
SPIRIT 2013 Checklist: Recommended items to address in a clinical trial protocol and related documents. (DOC 141 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Scott, C.K., Dennis, M.L. & Gustafson, D.H. Using smartphones to decrease substance use via self-monitoring and recovery support: study protocol for a randomized control trial. Trials 18, 374 (2017). https://doi.org/10.1186/s13063-017-2096-z
- Ecological momentary assessment
- Ecological momentary intervention
- Substance use disorder
- Recovery support