Skip to main content
Download PDF

A call for consensus in defining efficacy in clinical trials for opioid addiction: combined results from a systematic review and qualitative study in patients receiving pharmacological assisted therapy for opioid use disorder

Trials volume 21, Article number: 30 (2020) Cite this article

Abstract

Background

Given the complex nature of opioid addiction treatment and the rising number of available opioid substitution and antagonist therapies (OSAT), there is no ‘gold standard’ measure of treatment effectiveness, and each successive trial measures a different set of outcomes which reflect success in arbitrary or opportune terms. We sought to describe the variation in current outcomes employed across clinical trials for opioid addiction, as well as determine whether a discrepancy exists between the treatment targets that patients consider important and how treatment effectiveness is measured in the literature.

Methods

We searched nine commonly used databases (e.g., EMBASE, MEDLINE) from inception to August 1, 2015. Outcomes used across trials were extracted and categorized according to previously established domains. To evaluate patient-reported goals of treatment, semi-structured interviews were conducted with 18 adults undergoing methadone treatment.

Results

We identified 60 trials eligible for inclusion. Once outcomes were categorized into eight broad domains (e.g., abstinence/substance abuse), we identified 21 specific outcomes with furthermore 53 subdomains and 118 measurements. Continued opioid use and treatment retention were the most commonly reported measures (46%, n = 28). The majority of patients agreed that abstinence from opioids was a primary goal in their treatment, although they also stressed goals under-reported in clinical trials.

Conclusions

There is inconsistency in the measures used to evaluate the effectiveness of OSATs. Individual and population level decision making is being guided by a standard of effect considered useful to researchers yet in direct conflict with what patients deem important.

Trial registration

PROSPERO, CRD42013006507.

Peer Review reports

Background

Information retrieved from the highest quality evidence—most often from randomized controlled trials (RCTs)—is used to inform health care decisions at individual and population levels. From the development of research questions to decisions regarding “significant” treatment targets, the research community exerts a strong influence on the generation of evidence. The end users of this evidence—whether this be physicians, policy makers, or patients—rely on the expert opinion of researchers to design studies and ultimately trust they select the appropriate outcomes to reflect treatment success. Despite best interests, the value of many pharmacological interventions is commonly evaluated on their observed effect across different biochemical and surrogate measurements [1]. Frequently these measurements neither reflect nor acknowledge the values and preferences of the populations they are meant to serve. Patient-important outcomes reflect the health concerns, fears regarding adverse drug reactions, treatment goals, and overall values of patient populations. These outcomes are often underrepresented in comparison to biologic measurements closely associated with the physiologic disease process [1]. For instance, the majority of trials within the diabetes literature include primary endpoints such as blood glucose level as an indicator of efficacy due to its direct relation to the pathophysiology of diabetes. Outcomes such as death, stroke, infection, pain function, or delayed wound healing have significant impact on patients’ lives, yet are often underreported [2]. Unfortunately, patient-important outcomes are often neglected in trials aimed to establish treatment benefit; this deficit is of substantial concern to the growing evidence base in opioid addiction, known formally as opioid use disorder (OUD) [3].

Given the complex nature of OUD treatment and the rising number of available pharmacological opioid substitution and antagonist therapies (OSAT), there is no “gold standard” measure of treatment effect and each successive trial measures a different set of treatment outcomes which reflect success in arbitrary or opportune terms [4,5,6]. Commonly included endpoints comprise attrition rates, illicit substance use, presence of medical and psychiatric comorbidity, social function as measured by current housing arrangements, collective neighborhood income, educational achievement, employment, and involvement in criminal activity [4,5,6]. The variation in the selection of outcomes as well as the marked range of definitions, instruments, and measurements of specific outcomes demand the need for further research to establish a summary of the current outcomes utilized in the literature, as well as determine which outcomes reflect patients’ values and preferences for the end goals of addiction treatment.

In the current study, we sought to outline the current outcomes employed in clinical trials for opioid addiction, as well as to determine whether a divide exists between the treatment targets patients consider important and those selected to evaluate efficacy in the literature.

Methods

This study was completed in two phases. In the first phase of the study we completed a systematic review which aimed to describe outcomes used in the current literature to establish effectiveness of different OSATs. The second phase aimed to determine patient’s perspectives of successful addiction treatment with emphasis on the patient’s end-goals of therapy. Phase 1 of this study used the previously published protocol for a systematic review and network meta-analysis comparing OSAT interventions for OUD during which we also extracted the listing of outcomes reported within each study [7]. The literature search was completed in August 2015; this was not updated for the current study given that the emphasis is not on establishing a superior therapy for addiction, but rather to provide a summary of the outcome measures employed across clinical trials comprising the main body of evidence.

Phase 1: systematic review to establish outcomes used in the current literature

Methodology

The collective body of evidence for OSAT trials was identified using results from a previous systematic review. A summary of the methods for this work are described in the published protocol [7]. The original systematic review utilized for this study was registered in the PROSPERO database (CRD42013006507) and adheres to the PRISMA guidelines [8].

Studies included in the previously published review were limited to trials evaluating pharmacological therapies for opioid addiction in general addiction populations; any studies in special populations, including prison, were excluded. No studies were eliminated based on outcome selection. All primary investigators listed on the NIH Clinical Trial Registry from eligible studies identified during the title screening were contacted for inquires regarding any publications resulting from their trials. The original review placed no constraints on language or date of publication. Animal studies and incomplete studies (pilot, preliminary reports) were excluded. Methodological quality assessment was conducted using the Cochrane Risk of Bias Tool for RCTs.

Summary of outcomes used across OSAT trials

The primary aim of the current study was to summarize all outcome domains and subdomains and their definitions and outcomes measurements/instruments used for each outcome in trials of OSAT for OUD. Data extraction forms were constructed and pilot tested for use in this review. We abstracted the sample size, mean age, eligibility criteria, intervention description, dose, approaches to missing data, outcome definition, outcome measurement, covariates included in regression models if adjusted analyses were performed, and the statistical association reported (e.g., odds ratio (OR), relative risk (RR)).

To provide an organized summary, we structured outcomes into broader categories according to the domains proposed by commonly used measurement scales evaluating addiction severity (i.e., the Addiction Severity Index (ASI) [9] and Maudsley Addiction Profile (MAP)) [10]. These tools evaluate treatment response using the broader domains of substance use behavior, physical and mental health, and social functioning [9, 10]. Both tools are practical and provide a global assessment of patients’ physical and social functioning. Our outcome domains included physical health, psychiatric health and symptoms, abstinence and substance use behavior, and personal and social functioning. Some studies used additional outcomes that did not conform to these domains; thus, we included global quality of life and addiction severity assessments (including global addiction severity, intervention adherence, acceptance of intervention, and resource utilization (e.g., hospital admission) as additional domains. This categorization of outcome domains and subdomains provides researchers and clinicians with an overview of the current outcomes used to assess patients’ responses to OSAT.

All outcomes used across trials included in this review were extracted and categorized according to the above described criteria.

Phase 2: qualitative interviewing of patients on pharmacological treatment for OUD

Recruitment and interview methodology

Patients were recruited from two opioid addiction treatment centers in Ontario, Canada using purposive sampling. The research collaborative between the Population Genomics Program at McMaster University and the Canadian Addiction Treatment Centers (CATC) provided a framework for study recruitment, data collection, data analysis, and follow-up. Eligibility criteria included: patients ≥ 18 years, currently receiving an opioid substitution therapy including methadone maintenance treatment or buprenorphine, able to understand and speak English, and able to provide informed consent [11]. The Hamilton Integrated Research Ethics Board (HiREB) approved this study (HiREB study ID 0168). This study adheres to the STROBE guidelines [12].

Qualitative methods were used to establish patients’ perspectives of successful addiction treatment. Structured open-ended interviews were conducted to explore each patient’s end-goals of therapy. These interviews identified common themes with regard to addiction treatment goals. The interviews were transcribed and analyzed for themes, clarifications, and deeper understanding of the topics outlined above [11].

Convenience sampling was utilized between two addiction treatment clinics. Recruiting from two separate sites allowed for a broader patient demographic to be covered, as socioeconomic status and homelessness rates were known to differ between sites. Flyers advertising the study were posted at both clinical sites. All patients eligible for recruitment were also approached and informed about the study objectives by the clinic’s healthcare staff. Upon gaining informed consent, patients were given a demographic questionnaire and interviewed by two investigators using structured questions and open-ended questions. No one else was present at these interviews. All patients included in the study were given a $5 gift card at the end of the interview [11].

Interviews were conducted by an addiction specialist nurse, Carolyn Platter (BScNurs), and two female research coordinators, Julia Woo (BHSc) and Anuja Bhalerao (BHSc). These team members have performed hundreds of interviews in this population since working with the McMaster GENOA research collaborative. The interviewers were selected in efforts to minimize potential bias generated during data collection. These team members had no previous stake in the research question or design of this study. All interviewers underwent ethics and sensitivity training prior to meeting the patients, as per McMaster University Research Ethics Board Guidelines. Each team member has completed the Tri-Council Policy Statement course. The patients recruited into the study had not been previously interviewed by the team members and we are confident there was no relationship between participants and interviewers prior to the interview. Participants were briefed as to the goals of the study, particularly our aim of establishing whether current research accurately reflects what they wish to gain from treatment.

Interviews were completed using a structured piloted questioning tool with prompts; patients were approached allowing for open-ended answers. Each interview was audio recorded for later transcription. Each interviewer also made field notes, which were used to aid in later transcription. Each interview transcript was carefully investigated for insight into the major research question, “How would you measure success in methadone maintenance or buprenorphine treatment?” We also provided patients a list of commonly anticipated treatment goals and asked them to rank which aspect of recovery meant the most to their addiction treatment. Patients were allowed to rank up to four items. The list provided a summary of different potential goals across substance abuse, physical health, emotional stability, and personal functioning domains. A register of these goals in addition to the interview tool can be found in Additional file 1. The interviews lasted approximately 40 min and were conducted on site at the treatment facility between September 2015 and February 2016. Interviews were conducted until responses to the major research questions were saturated, having no new themes emerge [11]. Patients were not provided transcribed copies of their interview.

Analysis

Interviews were transcribed and evaluated for the common definitions of success in addiction treatment as well as aspects of recovery patients found important. Two primary interviewers (AB, JW) were responsible for coding the data, unaided by software. This process was later reviewed by all members of the team. These responses were coded according to the broader domains proposed by popular measurement scales evaluating addiction severity: the ASI [9] and MAP [10]. Additional domains not included in the MAP or ASI were also added. These domains included global quality of life and addiction severity assessments (including global addiction severity measure scores), intervention adherence, acceptance of intervention, and resource utilization (e.g., hospital admission) [11].

Due to the small size and limited power of our sample, no statistical tests were conducted in reference to significant differences between the participants at the two sites [11].

Results

Phase I: findings from the systematic review

An annotated flow diagram of the study selection process is presented in Fig. 1. We searched databases since inception to August 1, 2015 and identified 6077 articles. We identified 60 trials with a combined participant sample of 13,341 patients eligible for full text extraction [13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72]. A summary of the included trials is available in Additional file 1. Table 1 summarizes the outcome domains and subdomains used across trials included in this study; the outcomes are categorized into broad domains, outcome domains, subdomains, and the specific measurements. Within the eight broadest domains (abstinence and substance use behavior, physical health, psychiatric health and symptoms, personal and social functioning, resource utilization, intervention adherence, intervention acceptance, and global quality of life and addiction severity) are 21 more specific outcome domains (e.g., illicit opioid use, illicit non-opioid substance use), and across these outcomes there exist 53 separate definitions or measurements.

Fig. 1
figure 1

The preferred reporting items for systematic reviews and meta-analyses (PRISMA) flow diagram

Full size image
Table 1 Summary of all clinical and social outcomes used to establish effectiveness for trials in opioid addiction
Full size table

Of the 60 trials eligible for inclusion in this review, retention in treatment was the most commonly measured and reported outcome. Of the 28 studies reporting retention in treatment as their primary outcome, 16 different interventions were evaluated. The second most commonly reported outcome was illicit opioid use, which took 17 definitions and a further eight variations in measurement. The wide-ranging definitions for illicit opioid use included 1) the frequency of use in the form of the mean number or days of use or the percentage of positive urine screens, 2) the mean time patients remain abstinent on therapy or time until the first positive opioid urine screen is observed, 3) the number of participants per treatment arm who fulfill a predefined criteria for “success” or “failure” according to their opioid use consumption patterns, and 4) the global severity of opioid use as scored from a validated tool. Further variations arose based on the measurement of opioid use, which included urine toxicology screening with directly observed or non-observed sampling, toxicology screening with hair samples, validated addiction severity measurement tools, as well as weekly activity summaries or self-report.

General physical health outcomes comprised the largest differences in both conceptualization and measurement. Physicians’ perception of disease, cardiac function, immune system function, pain severity, and the presence of physical comorbidity were among the commonly measured aspects of general physical health.

Phase II: qualitative interviewing of patients on pharmacological treatment for opioid addiction

A total of 18 individuals from two treatment centers participated in this study. Sixteen of the participants were currently undergoing MMT at the time of recruitment and two participants were receiving buprenorphine but had received MMT at least one year prior. The mean age of the participants was 36.11 (standard deviation = 10.01) years with majority female (67%) and of Caucasian ethnicity (89%). Participants in one site had a higher mean income ($48,750 vs $35, 000) and were more likely to be employed (63% vs 40%) compared to the second site’s participants, which is expected as the second site was selected purposefully to be economically different. All participants were interviewed in a single session and no repeated sessions were necessitated during the course of this study.

Qualitative interview

The majority of participants (61.1%) identified their main goal of methadone treatment as being abstinence from drugs. This goal was clearly indicated by patients, including statements like: “Just being completely off of drugs. To never touch drugs again.” Close to a third of these individuals had a more specific goal of being off of methadone completely (38%). One participant stated specifically (as seen in the following direct quote) that even though they are sober, their ultimate goal is to be “clean” from all opioids.

“When someone tells me I’m not sober because I’m on methadone. I tell them I may not be clean because I’m putting this medication in my body but I am sober. I want to be clean. To me, I’m sober right now, I have been sober for two and a half years. I haven’t touched the drugs for two and a half years. At the end of it, I want to be off the methadone completely but I want to be able to taper down till I no longer need it anymore and I want to look back and say that was just a phase in my life. I took the necessary steps to make myself better and I accomplished that. And all the things that I accomplished being on methadone too. So yeah, I just want to get off of it completely, eventually”

Others did not desire to be off methadone and specified methadone was helping them. One participant’s main goal was for pain control and not to be off methadone, as it helped them function and be able to move. When asked if they were hoping to get completely off methadone they responded saying, “I don’t know if I ever will. I see my doses being reduced but until my health problems are resolved, I have absolutely no problem being on it if it has to be for the rest of my life.”

Other goals of methadone treatment that were not as common included being able to get back to their usual lives and able to maintain it, to not be sick, and to manage addictions not only related to drugs but in other domains of their life. Participant’s verbatim responses are summarized in Table 2. The percentages presented above reflect an assessment of patient responses presented in Table 2.

Table 2 Verbatim answers to qualitative interview to understand goals of therapy
Full size table

Response to predetermined treatment goals

Seventeen out of the 18 participants completed the section indicating which aspect of recovery meant the most to their addiction treatment. Please refer to Fig. 2 for a graphical summary of patients’ first ranked treatment goals. This graphical summary was generated using the individual patient data reported in Table 3, whereby the frequency of participants ranked goals of care was calculated and subsequently presented as a percentage.

Fig. 2
figure 2

First ranked treatment goals among patients receiving OSAT. Patients ranking of treatment goals from a “pre-determined” list provided during the qualitative interview. Patients were asked to rank which aspect of recovery was most important to their addiction treatment goals. Patients were allowed to rank up to four items. The figure illustrates the first ranked items

Full size image
Table 3 Patients’ responses to predetermined treatment goals
Full size table

Abstinence from opioid use was the most commonly selected outcome overall followed by stability of relationships, reduced money spent on drugs, reduced drug craving, employment, regaining physical health, pain control, coping, reduced depression, stable housing, improved sexual function, decreased risk of overdose, reduced injecting, and reduced anxiety overall across all participants’ four outcome choices. The most commonly selected primary outcome for participants was abstinence from opioid use, with 47% (8) of participants selecting it as their first choice; 16.6% (3) chose money spent on drugs as their second most important outcome. Participant’s outcomes are summarized in Table 3.

Discussion

Findings from this study outline the current outcomes employed in clinical trials for opioid addiction, and also provide a unique insight into the treatment goals patients consider important when receiving pharmacological therapies for OUD.

Results from the secondary review of outcome measures employed in OUD trials highlights a major lack of consensus in our evidence base when determining appropriate end-points for establishing treatment effectiveness for OSATs. A substantial number of outcomes as well as variations in the definitions and measurements of the same outcomes were reported across trials. Despite the overwhelming collection of outcomes employed by trialists, substance use—specifically opioid—and treatment retention remain the most consistently reported. Trialists seldom explored pharmacological effect on personal and social functioning outcomes such as criminal behavior, employment, relationships, and personal stability end-points, including type of accommodation (20%, n = 12).

The most commonly employed outcomes used to establish effectiveness were in stark contrast to the goals for treatment patients described in the qualitative interviews performed for the second phase of our study. While the majority of patients agreed that abstinence and reduction in opioid use was a primary goal in their treatment, they also stressed goals for therapy comprising employment, improved relationship stability, reduction in the money spent on drugs, as well as improvements in physical and psychiatric symptoms such as pain, depression, and anxiety. Regrettably, these outcomes were rarely reported or of primary focus in the clinical trials.When assessing the comparative effectiveness of all interventions among patients receiving OSATs, retention in treatment was the most consistently measured and reported outcome across trials (46%, n = 28). In direct contrast to staying on treatment, our interviews with patients demonstrate an eagerness to complete therapy and get off the methadone treatment regime as a recurrent theme.

Outcome selection bears serious implications for the interpretation of the results as well as our ability to extrapolate such findings in a wider clinical context. These methodological shortcomings highlight the need for new assessment strategies for opioid addiction treatment options, where future efforts should consider targeting the objective assessment of treatment effectiveness employing long-term follow-up using administrative data-linkage for trial participants to evaluate hard long-term outcomes such as incidence of hepatitis, HIV, cardiovascular abnormalities, and mortality. Among the trials included in this review, three evaluated the impact of interventions on mortality [41, 60] or cardiac function [44].

Trials evaluating OSATs suffer from poor methodological quality [73]. A combination of small sample size, poor design, highly stringent eligibility criteria, effect estimates with tremendous imprecision, short-follow up time, missing data, and a major lack of consensus over patient-important outcomes has led to an accumulation of a large yet very weak body of evidence. Whether it be illicit opioid use or risky behavior, the large number of definitions and measurements used to assess the same attribute suggest the need for more consensus in the field and understanding of what treatment outcomes are most important to addiction patients.

The evidence generated for this review was gathered from our previous work which aimed to determine the most effective pharmacotherapy for opioid use disorder [7]. An important finding from our original included the lack of standardization in outcome selection, in addition to the overall absence of discourse on patient-important outcomes in opioid use disorder. We felt strongly that this topic required a thorough discussion in a stand-alone paper and would be further complemented by the addition of qualitative interviews establishing patient values and preferences. We acknowledge the limitations posed by not updating our search strategy for the current study, particularly the lack of representation of studies conducted since the onset of the opioid crisis. However, our emphasis remains not establishing a superior therapy for addiction, which would require the most up-to-date assessment of all evidence, but rather to provide a summary of the outcome measures employed across clinical trials comprising the main body of evidence, which is largely captured in our current review, and likely would remain unchanged.

Efforts to map the health values and preferences of these 18 participants across all outcomes identified in the systematic review would have provided unique perspective to our current evaluation of the evidence. We hesitated to perform this analysis in light of the small sample size and absence of full representation of the outcome domains and subdomains identified from our review in the interview tool. Thus, any effort to draw conclusions regarding the representation of patient values in trial outcome selection could be explained by our lack of representation of the full list of trial outcomes in the interview tool.

Involvement of participants from our qualitative study phase in order to obtain a group consensus of the most valued goals of care would have been an instrumental addition to our evaluation of current OUD outcomes. Unfortunately, we did not hold ethics approval for that type of focus group work. It is clear a core outcomes set is needed in the field of OUD, which will require a larger, more representative study of all stakeholders. We maintain the key objectives of this work were to generate a discourse for patient-important outcomes in the OUD literature, and ultimately to provide the foundation for future researchers to explore this question in a larger representative sample.

Conclusions

In agreement with current guidelines, our study demonstrates there is limited consistency in the outcomes used to evaluate the effectiveness of OSATs [74, 75]. More concerning, our treatment recommendations and clinical decisions are being guided by a standard of effect considered useful to researchers yet in direct conflict with what patients deem important. This is a substantial limitation in the literature. Without the identification of a measurable treatment outcome that has an impact on and significance to patients, services, and the population as a whole, all the investment in trials will result in inadequate and inconsistent “efficacy” with limited, if any, external validity. We demonstrate here the need for an established set of OSAT outcomes guided by all stakeholders to inform clinicians of the true efficacy of these therapies and guide trialists to ensure our future understanding of these treatments accurately reflects the priorities of our patient population.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

GENOA:

Genetics of opioid addiction

HiREB:

Hamilton Integrated Research Ethics Board

OSATs:

Opioid substitution and antagonist therapies

OUD:

Opioid use disorder

PRISMA:

Preferred reporting items for systematic reviews and meta-analyses

RCT:

Randomized controlled trial

References

  1. Deshpande PR, Rajan S, Sudeepthi BL, Abdul Nazir CP. Patient-reported outcomes: a new era in clinical research. Perspect Clin Res. 2011;2:137–44.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Montori VM, Wang YG, Alonso-Coello P, Bhagra S. Systematic evaluation of the quality of randomized controlled trials in diabetes. Diabetes Care. 2006;29:1833–8.

    Article  PubMed  Google Scholar 

  3. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (5th ed.). 2013. https://doi.org/10.1176/appi.books.9780890425596.

  4. Mattick Richard P, Breen C, Kimber J, Davoli M. Methadone maintenance therapy versus no opioid replacement therapy for opioid dependence. Cochrane Database Syst Rev. 2009. https://doi.org/10.1002/14651858.CD002209.pub2.

  5. Hedrich D, et al. The effectiveness of opioid maintenance treatment in prison settings: a systematic review. Addiction. 2012;107:501–17.

    Article  PubMed  Google Scholar 

  6. Li Y, Kantelip J-P, Gerritsen-van Schieveen P, Davani S. Interindividual variability of methadone response. Mol Diagn Ther. 2008;12:109–24.

    Article  CAS  PubMed  Google Scholar 

  7. Dennis BB, Naji L, Bawor M, Bonner A, Varenbut M, Daiter J, Plater C, Pare G, Marsh DC, Worster A, Desai D. The effectiveness of opioid substitution treatments for patients with opioid dependence: a systematic review and multiple treatment comparison protocol. Syst Rev. 2014;3:105.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Shamseer L, et al. Preferred reporting items for systematic review and meta-analysis protocols (prisma-p) 2015: Elaboration and explanation. BMJ. 2015;349:g7647.

    Article  Google Scholar 

  9. McLellan AT, et al. The fifth edition of the Addiction Severity Index. J Subst Abus Treat. 1992;9:199–213.

    Article  CAS  Google Scholar 

  10. Marsden J, Gossop G, Stewart D, Best D, Farrell M, Lehmann P, Edwards C, Strang J. The Maudsley Addiction Profile (MAP): A brief instrument for assessing treatment outcome. Addiction. 1998;93(12):1857–67.

    Article  CAS  PubMed  Google Scholar 

  11. Woo J, et al. “Dont judge a book by its cover”: a qualitative study of methadone patients’ experiences of stigma. Subst Abus Res Treat. 2017. https://doi.org/10.1177/1178221816685087.

  12. von Elm E, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007;335:806–8.

    Article  Google Scholar 

  13. Ahmadi J, Ahmadi K. Controlled trial of maintenance treatment of intravenous buprenorphine dependence. Ir J Med Sci. 2003;172:171–3.

    Article  CAS  PubMed  Google Scholar 

  14. van den Brink W, et al. Medical prescription of heroin to treatment resistant heroin addicts: two randomised controlled trials. BMJ. 2003;327:310.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Ling W, Wesson DR, Charuvastra C, Klett CJ. A controlled trial comparing buprenorphine and methadone maintenance in opioid dependence. Arch Gen Psychiatry. 1996;53:401–7.

    Article  CAS  PubMed  Google Scholar 

  16. Schottenfeld RS, Chawarski MC, Mazlan M. Maintenance treatment with buprenorphine and naltrexone for heroin dependence in Malaysia: a randomised, double-blind, placebo-controlled trial. Lancet. 2008;371:2192–200.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Johnson RE, et al. A placebo controlled clinical trial of buprenorphine as a treatment for opioid dependence. Drug Alcohol Depend. 1995;40:17–25.

    Article  CAS  PubMed  Google Scholar 

  18. Ahmadi J, Moosavinasab M, Babaee M, Firoozabadi A, Mohagheghzadeh M, et al. F. H. Treatment of heroin dependence. Ger J Psychiatry. 2004;7:1–5.

    Google Scholar 

  19. Ahmadi J. A controlled trial of buprenorphine treatment for opium dependence: the first experience from Iran. Drug Alcohol Depend. 2002;66:111–4.

    Article  CAS  PubMed  Google Scholar 

  20. Yancovitz SR, et al. A randomized trial of an interim methadone maintenance clinic. Am J Public Heal. 1991;81:1185–91.

    Article  CAS  Google Scholar 

  21. Sees KL, et al. Methadone maintenance vs 180-day psychosocially enriched detoxification for treatment of opioid dependence: a randomized controlled trial. JAMA. 2000;283:1303–10.

    Article  CAS  PubMed  Google Scholar 

  22. Strain EC, Stitzer ML, Liebson IA, Bigelow GE. Comparison of buprenorphine and methadone in the treatment of opioid dependence. Am J Psychiatry. 1994;151:1025–30.

    Article  CAS  PubMed  Google Scholar 

  23. Soyka M, Zingg C, Koller G, Kuefner H. Retention rate and substance use in methadone and buprenorphine maintenance therapy and predictors of outcome: results from a randomized study. Int J Neuropsychopharmacol. 2008;11:641–53.

    Article  CAS  PubMed  Google Scholar 

  24. March JC, Oviedo-Joekes E, Perea-Milla E, Carrasco F. Controlled trial of prescribed heroin in the treatment of opioid addiction. J Subst Abus Treat. 2006;31:203–11.

    Article  Google Scholar 

  25. Comer SD, et al. Injectable, sustained-release naltrexone for the treatment of opioid dependence: a randomized, placebo-controlled trial. Arch Gen Psychiatry. 2006;63:210–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Eder H, et al. Comparative study of the effectiveness of slow-release morphine and methadone for opioid maintenance therapy. Addiction (Abingdon, England). 2005;100:1101–9.

    Article  Google Scholar 

  27. Eissenberg T, et al. Dose-related efficacy of levomethadyl acetate for treatment of opioid dependence. A randomized clinical trial. JAMA. 1997;277:1945–51.

    Article  CAS  PubMed  Google Scholar 

  28. Jaffe JH, et al. Methadyl acetate vs methadone. A double-blind study in heroin users. JAMA. 1972;222:437–42.

    Article  CAS  PubMed  Google Scholar 

  29. Kamien JB, Branstetter SA, Amass L. Buprenorphine-naloxone versus methadone maintenance therapy: A randomised double-blind trial with opioid-dependent patients. Heroin Addict Relat Clin Probl. 2008;10:5–18.

    Google Scholar 

  30. King VL, et al. A 12-month controlled trial of methadone medical maintenance integrated into an adaptive treatment model. J Subst Abus Treat. 2006;31:385–93.

    Article  Google Scholar 

  31. Oviedo-Joekes E, et al. Diacetylmorphine versus methadone for the treatment of opioid addiction. N Engl J Med. 2009;361:777–86.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Oviedo-Joekes E, March JC, Romero M, Perea-Milla E. The Andalusian trial on heroin-assisted treatment: a 2 year follow-up. Drug Alcohol Rev. 2010;29:75–80.

    Article  PubMed  Google Scholar 

  33. Potter JS, et al. Buprenorphine/naloxone and methadone maintenance treatment outcomes for opioid analgesic, heroin, and combined users: findings from starting treatment with agonist replacement therapies (START). J Stud Alcohol Drugs. 2013;74:605–13.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Robertson JR, et al. Addressing the efficacy of dihydrocodeine versus methadone as an alternative maintenance treatment for opiate dependence: A randomized controlled trial. Addiction. 2006;101:1752–9.

    Article  PubMed  Google Scholar 

  35. Saxon AJ, et al. Buprenorphine/Naloxone and methadone effects on laboratory indices of liver health: a randomized trial. Drug Alcohol Depend. 2013;128:71–6.

    Article  CAS  PubMed  Google Scholar 

  36. Anglin MD, Conner BT, Annon J, Longshore D. Levo-alpha-acetylmethadol (LAAM) versus methadone maintenance: 1-year treatment retention, outcomes and status. Addiction. 2007;102:1432–42.

    Article  PubMed  Google Scholar 

  37. Schwartz RP, Kelly SM, O’Grady KE, Gandhi D, Jaffe JH. Interim methadone treatment compared to standard methadone treatment: 4-month findings. J Subst Abus Treat. 2011;41:21–9.

    Article  Google Scholar 

  38. Schwartz RP, et al. A randomized controlled trial of interim methadone maintenance. Arch Gen Psychiatry. 2006;63:102–9.

    Article  PubMed  Google Scholar 

  39. Strain EC, Stitzer ML, Liebson IA, Bigelow GE. Buprenorphine versus methadone in the treatment of opioid dependence: self-reports, urinalysis, and addiction severity index. J Clin Psychopharmacol. 1996;16:58–67.

    Article  CAS  PubMed  Google Scholar 

  40. Wolstein J, et al. A randomized, open-label trial comparing methadone and Levo-Alpha-Acetylmethadol (LAAM) in maintenance treatment of opioid addiction. Pharmacopsychiatry. 2009;42:1–8.

    Article  CAS  PubMed  Google Scholar 

  41. Ling W, Charuvastra VC, Kaim SC, Klett CJ. Methadyl acetate and methadone as maintenance treatments for heroin addicts: a Veterans Administration cooperative study. Arch Gen Psychiatry. 1976;33:709–20.

    Article  CAS  PubMed  Google Scholar 

  42. White JM, et al. Relationship between LAAM-methadone preference and treatment outcomes. Drug Alcohol Depend. 2002;66:295–301.

    Article  CAS  PubMed  Google Scholar 

  43. Kosten TR, Schottenfeld R, Ziedonis D, Falcioni J. Buprenorphine versus methadone maintenance for opioid dependence. J Nerv Ment Dis. 1993;181:358–64.

    Article  CAS  PubMed  Google Scholar 

  44. Wedam EF, Bigelow GE, Johnson RE, Nuzzo PA, Haigney MCP. QT-interval effects of methadone, levomethadyl, and buprenorphine in a randomized trial. Arch Intern Med. 2007;167:2469–75.

    Article  CAS  PubMed  Google Scholar 

  45. Woody GE, et al. Extended vs short-term buprenorphine-naloxone for treatment of opioid-addicted youth: a randomized trial. JAMA. 2008;300:2003–11.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Kakko J, Svanborg KD, Kreek MJ, Heilig M. 1-year retention and social function after buprenorphine-assisted relapse prevention treatment for heroin dependence in Sweden: a randomised, placebo-controlled trial. Lancet. 2003;361:662–8.

    Article  CAS  PubMed  Google Scholar 

  47. Fischer G, et al. Buprenorphine versus methadone maintenance for the treatment of opioid dependence. Addiction (Abingdon, England). 1999;94:1337–47.

    Article  CAS  Google Scholar 

  48. Krook AL, et al. A placebo-controlled study of high dose buprenorphine in opiate dependents waiting for medication-assisted rehabilitation in Oslo, Norway. Addiction. 2002;97:533–42.

    Article  CAS  PubMed  Google Scholar 

  49. Ling W, et al. Buprenorphine maintenance treatment of opiate dependence: a multicenter, randomized clinical trial. Addiction. 1998;93:475–86.

    Article  CAS  PubMed  Google Scholar 

  50. Lintzeris N, et al. Implementing buprenorphine treatment in community settings in Australia: experiences from the Buprenorphine Implementation Trial. Am J Addict. 2004;13(Suppl 1):S29–41.

    Article  PubMed  Google Scholar 

  51. Mattick RP, et al. Buprenorphine versus methadone maintenance therapy: a randomized double-blind trial with 405 opioid-dependent patients. Addiction. 2003;98:441–52.

    Article  PubMed  Google Scholar 

  52. Neri S, et al. Randomized clinical trial to compare the effects of methadone and buprenorphine on the immune system in drug abusers. Psychopharmacology. 2005;179:700–4.

    Article  CAS  PubMed  Google Scholar 

  53. Shufman EN, et al. The efficacy of naltrexone in preventing reabuse of heroin after detoxification. Biol Psychiatry. 1994;35:935–45.

    Article  CAS  PubMed  Google Scholar 

  54. Pani PP, Maremmani I, Pirastu R, Tagliamonte A, Gessa GL. Buprenorphine: a controlled clinical trial in the treatment of opioid dependence. Drug Alcohol Depend. 2000;60:39–50.

    Article  CAS  PubMed  Google Scholar 

  55. Schottenfeld RS, Pakes JR, Kosten TR. Prognostic factors in Buprenorphine- versus methadone-maintained patients. J Nerv Ment Dis. 1998;186:35–43.

    Article  CAS  PubMed  Google Scholar 

  56. Preston KL, Umbricht A, Epstein DH. Methadone dose increase and abstinence reinforcement for treatment of continued heroin use during methadone maintenance. Arch Gen Psychiatry. 2000;57:395–404.

    Article  CAS  PubMed  Google Scholar 

  57. Schottenfeld RS, et al. Methadone versus buprenorphine with contingency management or performance feedback for cocaine and opioid dependence. Am J Psychiatry. 2005;162:340–9.

    Article  PubMed  Google Scholar 

  58. Fudala PJ, et al. Office-based treatment of opiate addiction with a sublingual-tablet formulation of buprenorphine and naloxone. N Engl J Med. 2003;349:949–58.

    Article  CAS  PubMed  Google Scholar 

  59. Strain EC, Stitzer ML, Liebson IA, Bigelow GE. Dose-response effects of methadone in the treatment of opioid dependence. Ann Intern Med. 1993;119:23–7.

    Article  CAS  PubMed  Google Scholar 

  60. Hartnoll RL, et al. Evaluation of heroin maintenance in controlled trial. Arch Gen Psychiatry. 1980;37:877–84.

    Article  CAS  PubMed  Google Scholar 

  61. Strang J, et al. Supervised injectable heroin or injectable methadone versus optimised oral methadone as treatment for chronic heroin addicts in England after persistent failure in orthodox treatment (RIOTT): a randomised trial. Lancet. 2010;375:1885–95.

    Article  CAS  PubMed  Google Scholar 

  62. Zaks A, Fink M, Freedman AM. Levomethadyl in maintenance treatment of opiate dependence. JAMA. 1972;220:811–3.

    Article  CAS  PubMed  Google Scholar 

  63. Strain EC, Bigelow GE, Liebson IA, Stitzer ML. Moderate- vs high-dose methadone in the treatment of opioid dependence: a randomized trial. JAMA. 1999;281:1000–5.

    Article  CAS  PubMed  Google Scholar 

  64. Petitjean S, et al. Double-blind randomized trial of buprenorphine and methadone in opiate dependence. Drug Alcohol Depend. 2001;62:97–104.

    Article  CAS  PubMed  Google Scholar 

  65. Guo S. Efficacy of naltrexone hydrochloride for preventing relapse among opiate dependent patients after detoxification. Hong Kong J Psychiatry. 2001;11:2–8.

    Google Scholar 

  66. Krupitsky EM, et al. Naltrexone for heroin dependence treatment in St. Petersburg, Russia. J Subst Abus Treat. 2004;26:285–94.

    Article  Google Scholar 

  67. San L, Pomarol G, Peri JM, Olle JM, Cami J. Follow-up after a six-month maintenance period on naltrexone versus placebo in heroin addicts. Br J Addict. 1991;86:983–90.

    Article  CAS  PubMed  Google Scholar 

  68. Krupitsky EM, et al. Naltrexone with or without fluoxetine for preventing relapse to heroin addiction in St. Petersburg, Russia. J Subst Abus Treat. 2006;31:319–28.

    Article  Google Scholar 

  69. Giacomuzzi SM, Ertl M, Kemmler G, Riemer Y, Vigl A. Sublingual buprenorphine and methadone maintenance treatment: a three-year follow-up of quality of life assessment. Scientific World J. 2005;5:452–68.

    Article  CAS  Google Scholar 

  70. Haasen C, et al. Heroin-assisted treatment for opioid dependence: randomised controlled trial. Br J Psychiatry. 2007;191:55–62.

    Article  PubMed  Google Scholar 

  71. Johnson RE, Jaffe JH, Fudala PJ. A controlled trial of buprenorphine treatment for opioid dependence. JAMA. 1992;267:2750–5.

    Article  CAS  PubMed  Google Scholar 

  72. Krupitsky E, et al. Randomized trial of long-acting sustained-release naltrexone implant vs oral naltrexone or placebo for preventing relapse to opioid dependence. Arch Gen Psychiatry. 2012;69:973–81.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  73. Dennis BB, et al. Opioid substitution and antagonist therapy trials exclude the common addiction patient: a systematic review and analysis of eligibility criteria. Trials. 2015;16:1.

    Article  Google Scholar 

  74. Bruneau J, et al. Management of opioid use disorders: a national clinical practice guideline. Can Med Assoc J. 2018;190:E247–57.

    Article  Google Scholar 

  75. Methadone maintenance treatment program standards and clinical guidelines. The College of Physicians and Surgeons of Ontario; 2011.

Download references

Acknowledgements

We would like to sincerely thank everyone who contributed to the completion of this project. We would like to specially thank Arnav Agarwal and Joshua Kong for their initial help with the screening and data abstraction of studies. This project would not have been possible without the great collaboration cemented between GENOA and the CATC.

Funding

This work was supported by a CIHR Drug Safety and Effectiveness Network (DSEN) grant (grant number 126639) and CIHR (sponsor award number 156306). The funders had no role in study design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript.

Author information

Authors and Affiliations

  1. McMaster University Internal Medicine Residency Program, Department of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Canada

    Brittany B. Dennis & Monica Bawor

  2. Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada

    Brittany B. Dennis, Nitika Sanger, Andrew Worster, Lehana Thabane & Zainab Samaan

  3. Department of Family Medicine Residency Program, Michael G. Degroote School of Medicine, McMaster University, Hamilton, Canada

    Leen Naji

  4. Department of Psychiatry and Behavioural Neurosciences, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L8, Canada

    Carolyn Plater, Natasha Baptist-Mohseni, Alannah Hillmer & Zainab Samaan

  5. Department of Medicine, Hamilton General Hospital, Hamilton, Canada

    Andrew Worster

  6. University of Toronto Faculty of Medicine, University of Toronto, Toronto, Canada

    Julia Woo & Anuja Bhalerao

  7. Faculty of Science, Department of Psychology, McGill University, Montreal, Canada

    Danielle Rice

  8. Center for Practice Changing Research, Ottawa Hospital Research Institute, Ottawa, Canada

    Danielle Rice

  9. Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada

    Kim Corace

  10. University of Ottawa Institute of Mental Health Research, Ottawa, ON, Canada

    Kim Corace

  11. Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada

    Brian Hutton

  12. School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada

    Brian Hutton

  13. WHO Collaborating Centre for Knowledge Translation and Health Technology Assessment in Health Equity, Bruyère Research Institute, Ottawa, Canada

    Peter Tugwell

  14. Centre for Evaluation of Medicine, Hamilton, Canada

    Lehana Thabane

  15. System Linked Research Unit, Hamilton, Canada

    Lehana Thabane

  16. Population Genomics Program, Chanchlani Research Center, McMaster University, Hamilton, Canada

    Zainab Samaan

Authors
  1. Brittany B. Dennis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nitika Sanger
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Monica Bawor
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Leen Naji
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Carolyn Plater
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Andrew Worster
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Julia Woo
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Anuja Bhalerao
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Natasha Baptist-Mohseni
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Alannah Hillmer
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Danielle Rice
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Kim Corace
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Brian Hutton
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Peter Tugwell
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Lehana Thabane
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Zainab Samaan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

ZS, BBD, and LT led the development of the project. BBD, NS, MB, LN, CP, AW, JW, AB, NBM, AH, KC, BH, DR, PT, ZS, and TB contributed to the development of the research protocol, which is published in the journal Systematic Reviews. BBD, NS, MB, LN, CP, AW, JW, AB, NBM, AH, KC, BH, DR, PT, ZS, and TB contributed to interpreting the data and writing the manuscript. ZS had full access to data from this investigation and she is accountable for the reliability of the data and the accuracy of all analyses performed. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Zainab Samaan.

Ethics declarations

Ethics approval and consent to participate

Participants were recruited as part of the Genetics of Opioid Addiciton (GENOA) research collaborative between McMaster University and the Population Genomics Program. GENOA is a prospective cohort investigation approved by the Hamilton Integrated Research Ethics Board. Amendments to the GENOA study protocol to include new questions as part of our interview tool to allow for qualitative interviews exploring patient important outcomes was approved (HIREB #0168).

Consent for publication

This study does not include any individual person’s data requiring consent for publication.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Interview tool: the interview tool used in qualitative interviews. Table S1. Summary of included trials: table summarizing important information from all trials included in this systematic review, including the journal, number of participants, and Cochrane risk of bias score.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dennis, B.B., Sanger, N., Bawor, M. et al. A call for consensus in defining efficacy in clinical trials for opioid addiction: combined results from a systematic review and qualitative study in patients receiving pharmacological assisted therapy for opioid use disorder. Trials 21, 30 (2020). https://doi.org/10.1186/s13063-019-3995-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-019-3995-y

Keywords

Trials

ISSN: 1745-6215