- Open Access
Reporting of harm in randomized controlled trials evaluating stents for percutaneous coronary intervention
Trials volume 10, Article number: 29 (2009)
The aim of this study was to assess the reporting of harm in randomized controlled trials evaluating stents for percutaneous coronary intervention.
The study design was a methodological systematic review of randomized controlled trials. The data sources were MEDLINE and the Cochrane Central Register of Controlled Trials. All reports of randomized controlled trials assessing stent treatment for coronary disease published between January 1, 2003, and September 30, 2008 were selected.
A standardized abstraction form was used to extract data.
132 articles were analyzed. Major cardiac adverse events (death, cardiac death, myocardial infarction or stroke) were reported as primary or secondary outcomes in 107 reports (81%). However, 19% of the articles contained no data on cardiac events. The mode of data collection of adverse events was given in 29 reports (22%) and a definition of expected adverse events was provided in 47 (36%). The length of follow-up was reported in 95 reports (72%). Assessment of adverse events by an adjudication committee was described in 46 reports (35%), and adverse events were described as being followed up for 6 months in 24% of reports (n = 32), between 7 to 12 months in 42% (n = 55) and for more than 1 year in 4% (n = 5). In 115 reports (87%), numerical data on the nature of the adverse events were reported per treatment arm. Procedural complications were described in 30 articles (23%). The causality of adverse events was reported in only 4 articles.
Several harm-related data were not adequately accounted for in articles of randomized controlled trials assessing stents for percutaneous coronary intervention.
Trials manuscript: 5534201182098351 (T80802P)
Since the development of balloon angioplasty and the introduction of stents for percutaneous coronary intervention, stent technology has rapidly evolved . The technology now includes bare metal, polymer-coated, drug-eluting stents and, more recently, biodegradable and bioactive stents .
In fact, the first stent was implanted in humans in 1986, and by 1999, 84.2% of percutaneous coronary interventions involved stenting . By the end of 2004, drug-eluting stents were used in nearly 80% of percutaneous coronary interventions in the United States, and within 3 years, several million drug-eluting stents had been implanted worldwide [1–3].
This widespread dissemination of the technology may have been achieved at the expense of insufficient assessment of harm [4–7]. Recent reports have highlighted safety concerns with drug-eluting stents, related to late adverse clinical events caused by late stent thrombosis . Given the lack of large-scale randomized clinical trials with long-term follow-up of sufficient power to analyze clinical efficacy and safety of drug-eluting stents, there is an ongoing debate regarding the long-term safety of drug-eluting stents [9–15].
This debate raises the issue of the assessment and reporting of harm in randomized controlled trials evaluating stents . Previous studies have shown that data pertaining to harm are underreported in articles of randomised controlled trials [17–20]. Further, compared to reports pertaining to drugs, reports of trials assessing nonpharmological treatments more often lack descriptions of harm . Therefore, we aimed to assess the reporting of harm in randomized controlled trials evaluating coronary stents.
Search strategy and study selection
We identified all reports of RCTs assessing stents that were published between January 1, 2003, and September 30, 2008. We searched MEDLINE using the PubMed interface and the Cochrane Central Register of Controlled Trials (issue 1, 2005) using the terms implantable device OR stents [Mesh Terms] and cardiovascular disease [Mesh Terms] with a limitation to clinical trials published in English.
One author assessed the retrieved articles and screened the titles and abstracts to identify relevant studies. We included articles only if the study was identified as an RCT, was published as a full-text article, and assessed stents for PCI. We excluded case series, uncontrolled studies, articles published as abstracts only, editorials, news, correspondence sections, articles not including a complete description of the methods, and trials assessing other implantable devices (e.g., pacemaker, defibrillator, or cardiac valve) or stents in other vascular diseases. Reports of RCTs assessing technical interventions or surgical procedures where the use of stents was not systematically required were also excluded. We screened articles for duplicate publication (ie, the same trial published with results from different lengths of follow-up), and selected only the original articles.
From a review of the relevant literature, we generated a standardized data collection form that was iterated within the research team [14, 15]. Before data extraction, as a calibration exercise, two members of the team (M.E., I.B.) independently evaluated a separate set of 20 reports. A meeting followed in which the ratings were reviewed and disagreements resolved by consensus. One reviewer (M.E.) independently completed all data extractions. A second member of the team (I.B.) reviewed a random sample of 25 articles as a quality assurance exercise. The data abstraction form is available upon request.
We collected data on trial characteristics: year of publication, funding source (public support, manufacturer support or mixed), number of centers, sample size, main outcome, experimental treatment (type of stent; specific procedure of implantation such as intravascular ultrasound-guidance, and the control treatment (stent, specific procedure of stent implantation, surgery, angioplasty, pharmacological treatments or other treatments).
Gathering data for the reporting of harm involved a systematic collection of the nature of adverse events, methods used to collect harm-related information, length of follow-up, nature and severity of adverse events, adverse events causally related to treatment, and procedural complications (ie, stent loss, dissection). Since in stent trials, the main outcome is frequently a composite of cardiac death, myocardial infarction, revascularisation and/or stroke (ie, Major Adverse Cardiac Events [MACE] or Major Adverse Cardiac and (Cerebrovascular) Events [MAC(C)E]), we checked whether the harm-related data reported pertained to only MACE or MACCE, or also to other adverse events such as bleeding.
We also checked whether an adjudication committee evaluated adverse events and whether a Data Safety Monitoring Board (DSMB) was reported as being involved in the oversight of the trial, for patient safety. Data on these committees included the description of the members, whether adjudication committees were blinded and whether specific rules for submitting adverse events to the committees were reported.
Finally, as recommended by Ioannidis et al., we measured the space allocated to adverse events in the results sections (ie, proportion of lines dedicated to reporting adverse events) to evaluate the quality of reporting harm-related data .
Continuous variables are reported with descriptive statistics: mean, standard deviation (SD), median (lower quartile; upper quartile) and minimum and maximum values. Categorical variables are described with frequencies and percentages.
The analysis of the space dedicated to the reporting of harm was evaluated by use of Student's t-test, Wilcoxon test or Spearman correlation as appropriate for the following factors: funding sources (manufacturer vs. public funding), type of stent (bare metal vs. polymer-coating or drug-eluting), impact factor of journal, whether the journal endorsed the CONSORT Statements, and location of the trials (North America or other countries).
All data analyses involved use of SAS for Windows, Release 9.1 (SAS Institute, Cary, North Carolina USA).
We screened the titles and abstracts of 867 potentially eligible reports, examined the full text of 255 articles, and identified 132 studies meeting our inclusion criteria. The full screening process was previously published .
The trial characteristics are described in Table 1. In brief, 15% of reports (n = 20) were published in a general medical journal. The median sample size was 389 patients (Q1 to Q3 109.5 – 496.5). Most trials were multicenter (48%, n = 63). The median number of centers was 15.4 (Q1 to Q3 1 – 22). However, in one-third of the reports, the number of centers involved was not reported or was unclear. The experimental treatment was described as a bare metal stent in 31% of reports (n = 41), a polymer-coated stent in 14% (n = 19), a drug-eluting stent in 49% (n = 64) and a strategy of stent use in 6% (n = 8). The control treatment was a stent in 67% of reports (n = 88) (bare metal stents in 61 reports and drug-eluting or polymer-coated stents in 27), another strategy of stent implantation in 8% (n = 10), balloon angioplasty in 18% (n = 24) and coronary artery surgery in 8% (n = 10). The source of funding was totally or partially private in almost half of the reports (42%, n = 56) but was not reported in 43% (n = 57).
Major cardiac adverse events
Major cardiac adverse events (death, cardiac death, myocardial infarction or stroke) were reported as the primary outcome in only 26% of reports (n = 34), as secondary outcomes (ie, clearly reported in the methods or in the results section) in 45% (n = 60) and as both primary and secondary outcomes in 10% (n = 13). In 19% of reports (n = 25), no data were provided on the rate of major cardiac adverse events.
Assessment of harm
The reporting of the methods used to assess harm-related data is presented in Table 2.
The collection of the nature of adverse events was described in 83% of reports (n = 110), and the methods used for collecting data for at least some adverse events were given in 22% (n = 29). A definition of expected adverse events was provided in 36% of reports (n = 47), with a grading system for severity given in 7. Adverse events were adjudicated by an event committee in 35% of the reports (n = 46), with the committee membership described in 50% (n = 23/46) and the assessment of adverse events by the committee reported as blinded in 78% (n = 36/46). The specific rules for submitting adverse events to the adjudication committee were given in only six articles out of 132.
When focusing on adverse events other than cardiac or cerebrovascular events, (eg. bleeding), the systematic collection of the nature of adverse events and the method of data collection were provided in only 36% (n = 47) and 12% (n = 16) of reports, respectively.
Length of follow-up
Adverse events were described as being followed up for less than 1 month in 2% of reports (n = 3), up to 6 months in 34% (n = 24), between 7 and 12 months in 42% (n = 55) and more than 1 year in 4% (n = 5). However, the time frame of surveillance for adverse events was not reported in 22% of reports (n = 29).
Reporting of harm
The reporting of harm-related data is presented in Table 3. In 87% of reports (n = 87), numerical data on the nature of adverse events per treatment arm were given. These details were reported for adverse events other than MAC(C)E in half of the reports. The severity of adverse events per arm was reported with numerical data in 86% of reports (n = 114) but pertained to events other than MAC(C)E in only 13% (n = 17). Procedural complications were reported in 23% of articles (n = 30). The causality of adverse events was given in only 4 articles; adverse events were attributed to medical gestures during the implantation procedure.
Data Safety Monitoring Board (DSMB)
A DSMB was described in 14% of the reports (n = 18), with description of its full membership given in 15 of these (83%). The DSMB was described as adjudicating adverse events in 61% of reports (n = 11/18). In only 8 reports was the DSMB described as evaluating the totality of adverse events (serious or not). A DSMB was more often reported in trials assessing drug-eluting stents. The study sample size was higher in trials reporting than not reporting a DSMB (mean [SD] 798.3 [462.9] vs. 323.9 [357.9]).
Space allocated to harm reporting within the articles
The mean proportion of space allocated to describing harm in the results section, the tables and figures, was 24%, 21% and 17%, respectively. The space allotted to descriptions of harm did not differ according to funding source, type of stent, journal impact factor or length of follow-up.
This study assessed the reporting of harm in published randomized controlled trials evaluating coronary stents published over a 6-year period. Our results suggest that harm-related data receive substantial coverage in these reports in which major cardiac adverse events are frequently evaluated as primary or secondary outcomes. However, the reporting of important issues is lacking and could be improved upon .
Although cardiac events are essential outcomes for trials assessing coronary stents, surprisingly, in 19% of the articles, data on these events were not reported (although they may have been collected). Further, the assessment and reporting of harm mainly focused on cardiac adverse events and neglected other events such as bleeding.
The methods used to collect data on harm and the definition of expected adverse events were insufficiently described. Only one third of reports described the evaluation of harm by an adjudication committee, but descriptions of how the committee functioned were lacking. Nevertheless, perceived differences in the treatment safety profile may result simply from the use of different methods or different definitions . Determining whether a patient has reached a clinical event such as cardiac death involves some subjectivity . For this reason, the US Food and Drug Administration and the European Medicine Agency recommend assessing clinical events by adjudication committees [25, 26]. The importance of such committees has been outlined in several studies showing the classification of events changed in about 20% to 30% of cases after assessment by such a committee [22, 27–30]. In addition, we found that the length of follow-up was short (less than 1 year in most reports), even though many case reports described late thrombosis occurring more than 14 or 20 months after implantation [16–18].
Finally, a DSMB was described in only 14% of reports. Nevertheless, a DSMB is required for clinical trials large enough to detect important effects in mortality and irreversible morbidity rates, when the risk of a treatment is unknown, and when a therapy has a known risk of severe side effects . These criteria were fulfilled in most of the trial reports we selected. When a DSMB is planned, certain information concerning its governance and a monitoring plan should be provided: the DSMB should be independent of the sponsor, and its members should not have any potentially disqualifying conflicts of interest in the outcome of the trial . Members with appropriate qualifications for defined roles should be chosen. However, the functioning of these committees was insufficiently described in our reports to allow for adequate appraisal.
This study has some limitations. We assessed only reports of randomized controlled trials, not the trials themselves, and failure to report is not necessarily equivalent to failure to actually carry out the procedure. Further, data on the time frame of surveying adverse events could have been reported in follow-up studies, but we focused on only the initial publication of the trial results.
In conclusion, this study highlights that several harm-related data are not adequately accounted for in initial published reports of randomized controlled trials, here trials of stent treatment for coronary diseases.
data safety monitoring board
major adverse cardiac events
major adverse cardiac and cerebrovascular events
percutaneous coronary intervention
randomized controlled trial
Serruys PW, Kutryk MJ, Ong AT: Coronary-artery stents. N Engl J Med. 2006, 354: 483-495. 10.1056/NEJMra051091.
Erbel R, Di Mario C, Bartunek J, Bonnier J, de Bruyne B, Eberli FR, Erne P, Haude M, Heublein B, Horrigan M, Ilsley C, Böse D, Koolen J, Lüscher TF, Weissman N, Waksman R, PROGRESS-AMS (Clinical Performance and Angiographic Results of Coronary Stenting with Absorbable Metal Stents) Investigators: Temporary scaffolding of coronary arteries with bioabsorbable magnesium stents: a prospective, non-randomised multicentre trial. Lancet. 2007, 369: 1869-1875. 10.1016/S0140-6736(07)60853-8.
Maisel WH: Unanswered questions – drug-eluting stents and the risk of late thrombosis. N Engl J Med. 2007, 356: 981-984. 10.1056/NEJMp068305.
Nebeker JR, Virmani R, Bennett CL, Hoffman JM, Samore MH, Alvarez J, Davidson CJ, McKoy JM, Raisch DW, Whisenant BK, Yarnold PR, Belknap SM, West DP, Gage JE, Morse RE, Gligoric G, Davidson L, Feldman MD: Hypersensitivity cases associated with drug-eluting coronary stents: a review of available cases from the Research on Adverse Drug Events and Reports (RADAR) project. J Am Coll Cardiol. 2006, 47: 175-181. 10.1016/j.jacc.2005.07.071.
Bavry AA, Kumbhani DJ, Helton TJ, Borek PP, Mood GR, Bhatt DL: Late thrombosis of drug-eluting stents: a meta-analysis of randomized clinical trials. Am J Med. 2006, 119 (12): 1056-61. 10.1016/j.amjmed.2006.01.023.
Bavry AA, Chiu JH, Jefferson BK, Karha J, Bhatt DL, Ellis SG, Whitlow PL: Development of coronary aneurysm after drug-eluting stent implantation. Ann Intern Med. 2007, 146: 230-232.
Farb A, Boam AB: Stent thrombosis redux – the FDA perspective. N Engl J Med. 2007, 356: 984-987. 10.1056/NEJMp068304.
Pfisterer M, Brunner-La Rocca HP, Buser PT, Rickenbacher P, Hunziker P, Mueller C, Jeger R, Bader F, Osswald S, Kaiser C, BASKET-LATE Investigators: Late clinical events after clopidogrel discontinuation may limit the benefit of drug-eluting stents: an observational study of drug-eluting versus bare-metal stents. J Am Coll Cardiol. 2006, 48: 2584-2591. 10.1016/j.jacc.2006.10.026.
Camenzind E, Steg PG, Wijns W: Stent thrombosis late after implantation of first-generation drug-eluting stents: a cause for concern. Circulation. 2007, 115: 1440-1455. 10.1161/CIRCULATIONAHA.106.666800. discussion 1455.
Serruys PW, Daemen J: Are drug-eluting stents associated with a higher rate of late thrombosis than bare metal stents? Late stent thrombosis: a nuisance in both bare metal and drug-eluting stents. Circulation. 2007, 115: 1433-1439. 10.1161/CIRCULATIONAHA.106.666826. discussion 1439.
Lagerqvist B, James SK, Stenestrand U, Lindback J, Nilsson T, Wallentin L: Long-term outcomes with drug-eluting stents versus bare-metal stents in Sweden. N Engl J Med. 2007, 356: 1009-1019. 10.1056/NEJMoa067722.
Kastrati A, Mehilli J, Pache J, Kaiser C, Valgimigli M, Kelbaek H, Menichelli M, Sabaté M, Suttorp MJ, Baumgart D, Seyfarth M, Pfisterer ME, Schömig A: Analysis of 14 trials comparing sirolimus-eluting stents with bare-metal stents. N Engl J Med. 2007, 356: 1030-1039. 10.1056/NEJMoa067484.
Mauri L, Hsieh WH, Massaro JM, Ho KK, D'Agostino R, Cutlip DE: Stent thrombosis in randomized clinical trials of drug-eluting stents. N Engl J Med. 2007, 356: 1020-1029. 10.1056/NEJMoa067731.
Stone GW, Moses JW, Ellis SG: Safety and efficacy of sirolimus- and paclitaxel-eluting coronary stents. N Engl J Med. 2007, 356: 998-1008. 10.1056/NEJMoa067193.
Spaulding C, Daemen J, Boersma E, Cutlip DE, Serruys PW: A pooled analysis of data comparing sirolimus-eluting stents with bare-metal stents. N Engl J Med. 2007, 356: 989-997. 10.1056/NEJMoa066633.
Tung R, Kaul S, Diamond GA, Shah PK: Narrative review: drug-eluting stents for the management of restenosis: a critical appraisal of the evidence. Ann Intern Med. 2006, 144: 913-919.
McFadden EP: Late thrombosis in drug-eluting coronary stents after discontinuation of antiplatelet therapy). Lancet. 2004, 364 (9444): 1519-21. 10.1016/S0140-6736(04)17275-9.
Ioannidis JP, Evans SJ, Gotzsche PC, O'Neill RT, Altman DG, Schulz K, Moher D, CONSORT Group: Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004, 141: 781-788.
Ioannidis JP, Lau J: Improving safety reporting from randomised trials. Drug Saf. 2002, 25: 77-84. 10.2165/00002018-200225020-00002.
Papanikolaou PN, Churchill R, Wahlbeck K, Ioannidis JP: Safety reporting in randomized trials of mental health interventions. Am J Psychiatry. 2004, 161: 1692-1697. 10.1176/appi.ajp.161.9.1692.
Ethgen M, Boutron I, Baron G, Giraudeau B, Sibilia J, Ravaud P: Reporting of harm in randomized, controlled trials of nonpharmacologic treatment for rheumatic disease. Ann Intern Med. 2005, 143: 20-25.
Ethgen M, Boutron I, Steg Ph-G, Roy C, Ravaud P: Quality of Reporting Internal and External Validity Data from Randomized Controlled Trials Evaluating Stents for Percutaneous Coronary Intervention. BMC Medical Research. BMC Med Res Methodol. 2009, 9: 24-10.1186/1471-2288-9-24.
Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, CONSORT Group: Methods and processes of the CONSORT Group: example of an extension for trials assessing nonpharmacologic treatments. Ann Intern Med. 2008, 148 (4): W60-6.
Naslund U, Grip L, Fischer-Hansen J, Gundersen T, Lehto S, Wallentin L: The impact of an end-point committee in a large multicentre, randomized, placebo-controlled clinical trial: results with and without the end-point committee's final decision on end-points. Eur Heart J. 1999, 20: 771-777. 10.1053/euhj.1998.1351.
Research USFaDACfBEa: Guidance for Clinical Trial Sponsors On the establishment and Operation of Clinical Trial Data Monitoring Committees. http://www.fda.gov/CBER/gdlns/clindatmon.pdf
Agency EM: Committee for Medicinal Products for Human Use. http://www.emea.europa.eu/pdfs/human/ewp/587203en.pdf
Ives DG, Fitzpatrick AL, Bild DE, Psaty BM, Kuller LH, Crowley PM, Cruise RG, Theroux S: Surveillance and ascertainment of cardiovascular events. Ann Epidemiol. 1995, 5: 278-285. 10.1016/1047-2797(94)00093-9.
Mahaffey KW, Roe MT, Dyke CK, Newby LK, Kleiman NS, Connolly P, Berdan LG, Sparapani R, Lee KL, Armstrong PW, Topol EJ, Califf RM, Harrington RA: Misreporting of myocardial infarction end points: results of adjudication by a central clinical events committee in the PARAGON-B trial. Second Platelet IIb/IIIa Antagonist for the Reduction of Acute Coronary Syndrome Events in a Global Organization Network Trial. Am Heart J. 2002, 143: 242-248. 10.1067/mhj.2002.120145.
Mahaffey KW, Harrington RA, Akkerhuis M, Kleiman NS, Berdan LG, Crenshaw BS, Tardiff BE, Granger CB, DeJong I, Bhapkar M, Widimsky P, Corbalon R, Lee KL, Deckers JW, Simoons ML, Topol EJ, Califf RM, For the PURSUIT Investigators: Systematic adjudication of myocardial infarction end-points in an international clinical trial. Curr Control Trials Cardiovasc Med. 2001, 2: 180-186. 10.1186/CVM-2-4-180.
Mahaffey KW, Harrington RA, Akkerhuis M, Kleiman NS, Berdan LG, Crenshaw BS, Tardiff BE, Granger CB, DeJong I, Bhapkar M, Widimsky P, Corbalon R, Lee KL, Deckers JW, Simoons ML, Topol EJ, Califf RM, For the PURSUIT Investigators: Disagreements between central clinical events committee and site investigator assessments of myocardial infarction endpoints in an international clinical trial: review of the PURSUIT study. Curr Control Trials Cardiovasc Med. 2001, 2: 187-194. 10.1186/CVM-2-4-187.
Cairns JA, Hallstrom A, Held P: Should all trials have a data safety and monitoring committee?. Am Heart J. 2001, 141: 156-163. 10.1067/mhj.2001.112501.
Slutsky AS, Lavery JV: Data safety and monitoring boards. N Engl J Med. 2004, 350: 1143-1147. 10.1056/NEJMsb033476.
Dr Sophie Rushton-Smith provided editorial assistance in the preparation of this manuscript, which was funded by the Association Naturalia et Biologia.
Ph. Gabriel Steg has the following disclosures:
• Research Grant: sanofi-aventis (significant)
• Speakers bureau (all modest): Boehringer-Ingelheim, BMS, GSK, Medtronic, Nycomed, sanofi-aventis, Servier
• Consulting/advisory board (all modest): Astellas, AstraZeneca, Bayer, Boehringer-Ingelheim, BMS, Endotis, GSK, Medtronic, MSD, Nycomed, sanofi-aventis, Servier, The Medicines Company
• Stockholding: none
All other authors have no disclosures
The authors declare that they have no competing interests.
Conception and design: ME, IB, CR, PhGS, PhR
Acquisition of data: ME, IB
Analysis and interpretation of data: ME, IB, CR, PGS, PR
Drafting the manuscript: ME, IB
About this article
Cite this article
Ethgen, M., Boutron, I., Steg, P.G. et al. Reporting of harm in randomized controlled trials evaluating stents for percutaneous coronary intervention. Trials 10, 29 (2009). https://doi.org/10.1186/1745-6215-10-29
- Percutaneous Coronary Intervention
- Major Cardiac Adverse Event
- Bare Metal
- Bare Metal Stents
- Coronary Stents