Skip to main content
Download PDF

Registration, publication, and outcome reporting among pivotal clinical trials that supported FDA approval of high-risk cardiovascular devices before and after FDAAA

Trials volume 22, Article number: 817 (2021) Cite this article

Abstract

Background

Selective registration, publication, and outcome reporting of clinical trials distort the primary clinical evidence that is available to patients and clinicians regarding the safety and efficacy of US Food and Drug Administration (FDA)-approved medical devices. The purpose of this study is to compare registration, publication, and outcome reporting among pivotal clinical trials that supported FDA approval of high-risk (class III) cardiovascular devices before and after the FDA Amendment Act (FDAAA) was enacted in 2007.

Methods

Using publicly available data from ClinicalTrials.gov, FDA summaries, and PubMed, we determined registration, publication, and reporting of findings for all pivotal clinical studies supporting FDA approval of new high-risk cardiovascular devices between 2005 and 2020, before and after FDAAA. For published studies, we compared both the primary efficacy outcome with the FDA’s Premarket Approval (PMA) primary efficacy outcome and the published interpretation of findings with the FDA reviewer’s interpretation (positive, equivocal, or negative).

Results

Between 2005 and 2020, the FDA approved 156 high-risk cardiovascular devices on the basis of 165 pivotal trials, 48 (29%) of which were categorized as pre-FDAAA and 117 (71%) as post-FDAAA. Post-FDAAA, pivotal clinical trials were more likely to be registered (115 of 117 (98%) vs 24 of 48 (50%); p < 0.001), to report results (98 of 117 (87%) vs 7 of 48 (15%); p < 0.001) on ClinicalTrials.gov, and to be published (100 or 117 (85%) vs 28 of 48 (58%); p < 0.001) in peer-reviewed literature when compared to pre-FDAAA. Among published trials, rates of concordant primary efficacy outcome reporting were not significantly different between pre-FDAAA trials and post-FDAAA trials (24 of 28 (86%) vs 96 of 100 (96%); p = 0.07), nor were rates of concordant trial interpretation (27 of 28 (96%) vs 93 of 100 (93%); p = 0.44).

Conclusions

FDAAA was associated with increased registration, result reporting, and publication for trials supporting FDA approval of high-risk medical devices. Among published trials, rates of accurate primary efficacy outcome reporting and trial interpretation were high and no different post-FDAAA.

Peer Review reports

Background

In 1976, Congress passed the Medical Device Amendments to the Food, Drug, and Cosmetic (FD&C) Act. This act established three classes for medical devices based on the regulatory controls necessary to provide reasonable assurance of their safety and efficacy [1, 2]. The most tightly regulated devices—those that support or sustain human life, are of substantial importance in preventing impairment of human health, or could pose an unreasonable risk of illness or injury—are categorized as class III (high-risk) devices [2]. High-risk medical devices, such as stents, valves, sealants, and catheters, are regulated through the FDA’s Premarket Approval (PMA) pathway. Under the PMA pathway, device manufacturers are required to submit premarket clinical evidence that provides reasonable assurance of device safety and effectiveness [3]. Pivotal clinical studies are generally the primary clinical evidence on which the FDA bases its approval decisions because they are designed to meet the aforementioned regulatory requirements, demonstrating both the safety and efficacy of the device for the intended use [4]. Given the widespread use of high-risk medical devices in clinical practice, the quality and transparency of clinical data supporting their approval are of paramount importance to patient health and well-being [5].

Between January 2000 and December 2010, less than 50% of studies supporting PMA of novel, high-risk cardiovascular devices were published, and more than 30% of these publications presented primary endpoint results that were different, or could not be compared, to those in the corresponding FDA documents [6]. Discrepancies between registered and published outcomes of clinical trials are common [7]. These practices, known as selective publication and selective outcome reporting, distort the evidence available to patients and clinicians when making care decisions regarding the use of medical devices [8,9,10]. In 2007, the US FDA Amendment Act (FDAAA) was enacted, mandating clinical trial registration and result reporting on ClinicalTrials.gov for all ongoing and forthcoming trials of FDA-regulated products [8, 11, 12]. It has been reported that post-enactment of FDAAA, pivotal efficacy trials supporting the approval of new drugs for cardiovascular disease, diabetes mellitus, and neuropsychiatric disease were significantly more likely to be registered, be published, and have reported outcomes concordant with those submitted to FDA [9, 13, 14]. However, no studies have examined the impact of FDAAA on the registration and reporting of clinical trials supporting FDA approval of medical devices.

Accordingly, we sought to characterize registration, result reporting, publication, and outcome reporting for pivotal studies supporting high-risk cardiovascular devices before and after the implementation of FDAAA. We focused on cardiovascular devices because they account for more than half of all FDA PMAs [15]. Furthermore, we focused on pivotal studies because they are the definitive studies designed to evaluate medical device safety and effectiveness that are used as the basis of FDA’s regulatory decisions [15, 16]. The results of our study will inform future policy and regulatory efforts to ensure transparency and unbiased results reporting of the clinical trials supporting FDA approval of high-risk medical devices.

Methods

Identification of high-risk cardiovascular medical devices

One author (MJS) identified novel, high-risk cardiovascular medical devices from the publicly accessible FDA PMA database (www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpma/pma.cfm) between January 1, 2005, and January 1, 2020, excluding automated external defibrillators (AEDs), studies that had missing data, and summaries that leveraged a meta-analysis for the pivotal study (Fig. 1). We excluded AEDs because FDA published a final order on January 29, 2015, stating that AED clinical study information can be leveraged from both published studies and clinical data previously submitted under the 510(k) process instead of requiring the conduct of a pivotal trial to support FDA approval [17]. Otherwise, devices were selected if they met both of the following parameters: “Cardiovascular” under advisory committee and “Originals Only” under supplement type. All devices were characterized by the following using publicly available information on the FDA website: FDA review type (priority/standard), implantable designation (yes/no), life-sustaining designation (yes/no), and combination product (yes/no). Sponsor company management (public/private) was also determined by Google searching the sponsor company name along with “publicly traded,” “stock price,” “IPO,” or “privately held.”

Fig. 1
figure 1

Sample construction of the novel, high-risk cardiovascular devices approved by the US FDA between 2005 and 2020

Full size image

Characterization of pivotal clinical trials

For each device, one author (MJS) then identified the pivotal clinical studies that supported device approval from the “Summary of Safety and Effectiveness” documents. Pivotal clinical studies supporting approvals were categorized as pre-FDAAA if the clinical trial primary completion date was before December 26, 2007 (the date the policy took effect), in a manner described previously [9]; all other studies were categorized as post-FDAAA. Also, we categorized pivotal trials by specific design characteristics: use of randomization (yes/no), use of blinded allocation (yes/no), primary efficacy endpoint (surrogate marker/clinical outcome or scale), and study center and patient enrollment numbers. These metrics have been widely reported as assessing the validity and quality of clinical trials [9, 13, 18,19,20].

Study characteristics and data were abstracted from the FDA summaries by one author (MJS); a 10% subsample (17 devices) was randomly selected for validation by a second author (JLJ) at the beginning of data extraction. There were no disagreements in the 7 product/study characteristics extracted from FDA summaries and other sources (e.g., FDA review pathway, life-sustaining designation, implantable designation, combination product, company management, and use of randomization and blinding): percent agreement = 100% (119/119).

Following this independent validation, JLJ verified all device extractions for which MJS had been unable to identify clinical trial registration, result reporting, or publication, or for which MJS determined there was discordance in results reported or trial interpretation. There were a total of 132 transparency measure extractions for these devices, on which MJS and JLJ agreed on 97 and disagreed on 35 (percent agreement of 73.5%). Among these 35 disagreements, 3 related to trial registration, 5 to result reporting, 18 to publication, 8 to result concordance, and 1 to interpretation concordance. All disagreements were resolved via consensus among all authors. This process demonstrated that the initial search was overly reliant on the ClinicalTrials.gov hyperlinks, which were not always accurately reported and do not reliably identify trial publications [21]. Afterwards, the search strategy was revised and repeated to identify publications using and comparing clinical trial titles, product names, methods, number of study centers, enrollment numbers, primary efficacy endpoints, primary results, and study sponsors.

Identification of trials on ClinicalTrials.gov and published in the peer-reviewed literature

For each pivotal trial identified from FDA documents, we conducted a comprehensive search of ClinicalTrials.gov and PubMed’s listing of MEDLINE-indexed journals to identify any corresponding trial registration or publication, respectively. One author (MJS) conducted the initial search; a second author (JLJ) reviewed all pivotal trials for which a clinical trial registration or publication was not identified after the initial search by MJS; differences (n = 3 and 18, respectively) were reconciled by consensus among all authors. All document and website searches were performed during July 2020. Our search strategy included using and comparing clinical trial titles, product names, methods, number of study centers, enrollment numbers, primary efficacy endpoints, primary results, and study sponsors. While more recent FDA PMAs include ClinicalTrials.gov registration hyperlinks and ClinicalTrials.gov manually and automatically indexes corresponding publications of results to their registration by National Clinical Trial (NCT) number, these identification numbers did not reliably identify pivotal trial registrations and publications for older PMAs, consistent with prior reviews [21]. Among publications identified in PubMed, abstracts and conference reports were excluded. Publications reporting multiple studies, such as reviews and meta-analyses, were also excluded unless the results of each study were analyzed and discussed individually at the level of detail as one would expect from a full-length publication.

Comparison to corresponding publications

First, for each pivotal trial for which a publication was identified, we compared the primary effectiveness endpoint specified in the FDA documents with the effectiveness endpoint specified as primary in the publication. If there was more than one primary effectiveness endpoint reported in the FDA documents, we verified the one that matched the primary endpoint specified in the publication. If none of the specified primary endpoints matched, we categorized the primary effectiveness outcomes reported as discordant. If one matched, we determined whether the primary effectiveness endpoint result reported in the FDA documents was the same as the result reported in the publication. The outcomes reported were categorized as concordant if they shared all five defined elements of an endpoint (i.e., domain, measure, metric, method of aggregation, and timepoint) and were an exact numerical match or if there was a relative difference of less than 5% when compared to the FDA PMA, a conservative estimate intending to identify clinically meaningful differences while recognizing that there might be changes in analytical approaches over time [22]. Otherwise, the outcomes reported were categorized as discordant, as well as if the documented primary endpoint in the FDA materials was included in the publication but reported as a secondary outcome and if the primary endpoint in the FDA documentation pre-specified with the FDA was switched by the sponsor in their FDA documentation from what was pre-specified in a protocol or a registry entry. Second, for each pivotal trial for which a publication in the peer-reviewed literature was identified, we compared the overall study interpretation between the two sources. The overall interpretation was categorized as positive, equivocal, or negative based on the FDA officer’s language in the “Effectiveness Conclusions” and “Overall Conclusions” subsections of the “Summary of Safety and Effectiveness” document and the author’s language in the conclusion of the publication; the FDA and publication interpretation were categorized as concordant or discordant. One author (MJS) conducted the outcome comparisons; a second author (JLJ) verified the outcome comparisons classified as discordant by MJS and differences were reconciled by consensus among all authors.

Statistical analysis

We determined the rate of ClinicalTrials.gov registration, ClinicalTrials.gov result reporting, and PubMed publication for all identified pivotal trials, overall and stratified by device and design characteristics. We then determined the overall rate of concordant primary outcome reporting between the FDA PMA summaries and corresponding publications, as well as the overall rate of concordance between the FDA PMA reviewer’s interpretations and the trial publication’s interpretations. Summary statistics were calculated for each comparison, presented as numbers, percentages, means, standard deviations, and ranges, as appropriate. Chi-square and two-tailed Fisher exact tests were used to compare rates pre- and post-FDAAA of registration, result reporting, publication, concordant outcome reporting, and concordant interpretation, as appropriate. All statistical tests were two-tailed and used the Bonferroni method to correct our alpha value to account for multiple comparisons of five transparency measures across the sample of clinical trials for these devices: (1) registration, (2) result reporting, (3) publication, (4) concordant outcome reporting, and (5) concordant interpretation. Statistical significance was set at p ≤ 0.01. Analyses were performed using Microsoft Excel (version 16.35) and SPSS (version 27).

Research guidelines and ethics

This study was prepared in accordance with the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline for cross-sectional studies [23]. The study did not require institutional review board approval or patient informed consent because it was based on publicly available information and involved no patient records.

Results

Between 2005 and 2020, the FDA approved 156 novel, high-risk cardiovascular devices (Table 1). Among these, 16 (10%) approvals were designated for priority review, 84 (54%) were life-sustaining, 123 (79%) were implantable, 29 (19%) were combination products, and 60 (38%) had private sponsor company management.

Table 1 Novel, high-risk cardiovascular devices approved by the US FDA between 2005 and 2020
Full size table

We identified a total of 179 pivotal clinical trials supporting these 156 approvals, of which 165 met our inclusion criteria (Fig. 1), among which 48 (29%) were categorized as pre-FDAAA and 117 (71%) as post-FDAAA. Overall, 59 (36%) of these pivotal trials were randomized, 21 (13%) were blinded, 103 (62%) were from publicly held companies, 19 (12%) supported devices with priority review status, 32 (19%) supported combination products, 132 (80%) supported implantable devices, and 89 (54%) supported life-sustaining devices.

Trial registration, result reporting, and publication

Among the 165 pivotal trials that met our inclusion criteria, 139 (84%) were registered on ClinicalTrials.gov, 105 (76%) had results posted on ClinicalTrials.gov, and 128 (78%) were published in the peer-reviewed literature. Compared to pre-FDAAA pivotal trials, post-FDAAA trials were more likely to be registered on ClinicalTrials.gov (115 of 117 (98%) vs 24 of 48 (50%); p < 0.001), to report results on ClinicalTrials.gov (98 of 117 (84%) vs 7 of 48 (15%); p < 0.001), and to be published (100 of 117 (85%) vs 28 of 48 (58%); p < 0.001) (Table 2). Trials registered on ClinicalTrials.gov were more likely to be published than those not registered (121 of 139 (87%) vs 7 of 26 (27%); p < 0.001). Pre-FDAAA, implantable designation was associated with a greater likelihood of registration (21 of 36 (58%) vs 3 of 12 (25%); p = 0.05) and life-sustaining designation was associated with a greater likelihood of result reporting or publication (18 of 24 (75%) vs 11 of 24 (46%); p = 0.04; Table 3). Post-FDAAA, there were no significant differences in registration, result reporting, or publication when stratified by device or trial design characteristics (Table 4).

Table 2 Registration, result reporting, and publication of clinical trials supporting US FDA cardiovascular device approvals between 2005 and 2020, pre- and post-FDAAA (n = 165)
Full size table
Table 3 Registration and result reporting or publication of clinical trials supporting US FDA cardiovascular device approvals between 2005 and 2020, stratified by study and device characteristics, pre-FDAAA (n = 48)
Full size table
Table 4 Registration and result reporting or publication of clinical trials supporting US FDA cardiovascular device approvals between 2005 and 2020, stratified by study and device characteristics, post-FDAAA (n = 117)
Full size table

Concordant outcome reporting and trial interpretation

A primary effectiveness outcome and the main result were reported in the FDA documents for all pivotal trials, pre- and post-FDAAA. Overall, 37 of 165 (22%) trials were not published, precluding primary effectiveness outcome comparison. Among 120 of 128 (94%) published trials, the primary endpoint specified in the FDA documents was the same endpoint specified as primary in the publication; among these, the primary endpoint result reported in the FDA documents was the same or within 5% of the result reported in the publication for 120 (100%) trials. Rates of concordant primary effectiveness outcome reporting were not significantly different between published pre-FDAAA and post-FDAAA trials (24 of 28 (86%) vs 96 of 100 (96%); p = 0.07) (Table 5).

Table 5 Outcome reporting and interpretation concordance of published clinical trials supporting US FDA cardiovascular device approvals between 2005 and 2020, pre- and post-FDAAA (n = 128)
Full size table

Among the 48 pre-FDAAA trials, FDA reviewers characterized 45 (94%) as positive, 2 (4%) as equivocal, and 1 (2%) as negative, whereas among the 117 post-FDAAA trials, FDA reviewers characterized 105 (90%) as positive, 3 (3%) as equivocal, and 9 (8%) as negative (Fig. 2). Overall, 116 of 150 (77%) positive trials were published, 4 of 5 (80%) equivocal trials, and 8 of 10 (80%) negative trials. Among published trials, rates of concordant interpretation were not significantly different between pre-FDAAA trials and post-FDAAA trials (27 of 28 (96%) vs 93 of 100 (93%); p = 0.44). All 8 discordant trials, 1 pre-FDAAA and 7 post-FDAAA, were published in a manner that conveyed a more positive interpretation than that of the FDA reviewer. No trials were published in a manner that conveyed a more negative interpretation than that of the FDA reviewer.

Fig. 2
figure 2

US FDA reviewer trial interpretation and publication, along with a published interpretation of the trial findings, for novel cardiovascular devices approved by the US FDA between 2005 and 2020, pre- and post-FDAAA. US FDA reviewer trial interpretation as positive, equivocal, or negative. A Pre-FDAAA; B Post-FDAAA

Full size image

Discussion

In our study of all pivotal studies supporting high-risk cardiovascular devices approved by the FDA through the PMA pathway from 2005 to 2020, we found that implementation of FDAAA, which mandated clinical trial registration and result reporting, was associated with higher rates of pivotal trial registration, result reporting, and publication, but no differences in the accuracy of outcome reporting and trial interpretation among published studies. These results suggest that the legislation has improved transparency and unbiased result reporting of clinical trials, potentially mitigating selective publication and outcome reporting, which can thereby ensure that patient care decisions are based on more complete and accurate research.

Our study demonstrates that 98% of post-FDAAA trials were registered on ClinicalTrials.gov, 85% reported their results on ClinicalTrials.gov, and 85% were published in the peer-reviewed literature. These rates are high but lag behind those reported for new drugs [9, 13]. Impressive clinical trial registration and result reporting after FDAAA enactment was expected given the explicit requirement to require trial registration among all trials investigating FDA-regulated products. However, there is still room for improvement because 2% of post-FDAAA trials remain unregistered on ClinicalTrials.gov, 15% have not posted their results on ClinicalTrials.gov, and 15% remain unpublished in the peer-reviewed literature. As required by law, rates of registration and reporting of results on ClinicalTrials.gov should be 100%. Potential reasons for the reported inability to reach 100% may include publications reporting on different cohorts than the original trials or that trials were published before observations accrued or after statistical analyses were refined [24]. Continued study, building on prior investigations examining characteristics of trials associated with lower rates of registration and reporting of results on ClinicalTrials.gov, and trial publication, is warranted. Additionally, follow-up studies will be needed to see whether these rates persist or improve.

Among post-FDAAA trials, publication rate in the peer-reviewed literature was higher when compared to the rate of 80% observed among studies supporting FDA approval of novel, high-risk cardiovascular devices between January 2011 and December 2013 [25]. Although it continues to greatly exceed the rate of 49% observed for trials supporting FDA-approved, high-risk cardiovascular devices between January 2000 and December 2010 [6], given that these pivotal trials represent the best evidence of medical device safety and effectiveness, there is no reason that the clinical and research community should not expect a publication rate of 100%. Also, 96% of published studies reported primary effectiveness outcomes in a manner concordant with FDA reviews, which is nearly identical to a prior study of medical device publication and result reporting [25]. Our rate may be more representative of concordant result reporting post-FDAAA because we analyzed 15 years of FDA approvals post-FDAAA while the aforementioned study analyzed 3 years post-FDAAA. Our specificity in matching the five elements for a defined endpoint (i.e., domain, measure, metric, method of aggregation, and timepoint) when determining primary effectiveness endpoint concordance may have reduced the rates that we report [22]. Future studies exploring the implications of primary endpoints switched within the FDA documents and between the FDA documents and the publications are warranted. Nonetheless, our results showed higher rates than the initial study of selective reporting for medical devices that reported a rate of 69% for both identical and similar primary endpoint reporting, which when binned most closely matched our “concordant outcome reporting” statistic, in pivotal high-risk cardiovascular device trials between 2000 and 2010 [6].

We found that 93% of published trial interpretations were concordant with FDA reviews, which is slightly lower than a prior study of medical device publication and result reporting [25] but again may be more representative of concordant interpretation reporting post-FDAAA because of our larger sample size. There were no significant differences in rates of publication when examining device and design characteristics among pre- and post-FDAAA trials, which differs from a previous report of cardiovascular device research that found both publicly held company sponsors and life-sustaining device designation to be associated with the likelihood of publication [25]. Of note, the FDAAA Final Rule, which clarifies and expands the regulatory requirements and procedures for submitting registration and result information for certain trials to ClinicalTrials.gov, became effective on January 18, 2017, and responsible parties were required to comply on April 18, 2017 [26, 27]. In our analysis, 23 studies were completed after implementation and 20 studies were completed after responsible parties were required to comply. Despite FDAAA not being fully implemented until 2017 with The Final Rule, we nevertheless observed a large associated impact. Due to the recency of The Final Rule, future investigation on the impact of this policy is warranted.

There are several limitations to be considered in the interpretation of our findings. First, we only looked at trials supporting FDA approval of high-risk cardiovascular devices. Our results may not be generalizable to all high-risk medical devices and should be confirmed for FDA approvals in other therapeutic areas. Second, our study is cross-sectional and observational, and we can only establish associations, not causal conclusions, about the impact of FDAAA. Third, we limited our search of trial registration to ClinicalTrials.gov and excluded the use of other clinical trial registration sites. That said, US law requires trial registration of FDA-regulated products on ClinicalTrials.gov. Fourth, our study was focused on the reporting and publication of primary efficacy endpoints and interpretations and did not examine reporting or publication of secondary efficacy and safety endpoints. Finally, publication interpretations depended on if they acknowledged a success or failure in meeting their target effectiveness endpoints. Standardized methods for this decision would have allowed for greater reproducibility and potentially more accuracy [28].

Conclusion

FDAAA was associated with higher rates of clinical trial registration on ClinicalTrials.gov, result reporting, and publication in the peer-reviewed literature for trials supporting FDA approval of high-risk cardiovascular medical devices. Among published trials, rates of accurate primary efficacy outcome reporting and trial interpretation were high and no different post-FDAAA. These findings have important implications for understanding the potential impact of the FDAAA and informing future policy and regulatory efforts to ensure transparency and unbiased results reporting of the clinical trials supporting FDA approval of high-risk medical devices.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

FDA:

Food and Drug Administration

FDAAA:

Food and Drug Administration Amendment Act

PMA:

Premarket Approval

AED:

Automated External Defibrillator

NCT:

National Clinical Trial

STROBE:

Strengthening the Reporting of Observational Studies in Epidemiology

References

  1. Federal Food, Drug, and Cosmetic Act (FD&C act). https://catalog.archives.gov/id/299847.

  2. Medical device amendments of 1976. https://www.govinfo.gov/content/pkg/STATUTE-90/pdf/STATUTE-90-Pg539.pdf.

  3. Premarket approval (PMA). https://www.fda.gov/medical-devices/premarket-submissions/premarket-approval-pma.

  4. Design considerations for pivotal clinical investigations for medical devices. https://www.fda.gov/media/87363/download.

  5. Chalmers I. Underreporting research is scientific misconduct. JAMA. 1990;263(10):1405–8. https://doi.org/10.1001/jama.1990.03440100121018.

    CAS  Article  PubMed  Google Scholar 

  6. Chang L, Dhruva SS, Chu J, Bero LA, Redberg RF. Selective reporting in trials of high risk cardiovascular devices: cross sectional comparison between premarket approval summaries and published reports. BMJ. 2015;350:h2613. https://doi.org/10.1136/bmj.h2613.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Jones CW, Keil LG, Holland WC, Caughey MC, Platts-Mills TF. Comparison of registered and published outcomes in randomized controlled trials: a systematic review. BMC Med. 2015;13:282–3. https://doi.org/10.1186/s12916-015-0520-3.

    Article  PubMed  PubMed Central  Google Scholar 

  8. The Food and Drug Administration Amendments Act of 2007. Public law 110-85. https://www.gpo.gov/fdsys/pkg/PLAW-110publ85/pdf/PLAW-110publ85.pdf.

  9. Phillips AT, Desai NR, Krumholz HM, Zou CX, Miller JE, Ross JS. Association of the FDA amendment act with trial registration, publication, and outcome reporting. Trials. 2017;18(1):333-3. https://doi.org/10.1186/s13063-017-2068-3 [doi].

    CAS  Article  Google Scholar 

  10. Hart B, Lundh A, Bero L. Effect of reporting bias on meta-analyses of drug trials: reanalysis of meta-analyses. BMJ. 2012;344(jan03 1):d7202. doi: bmj.d7202 [pii]. https://doi.org/10.1136/bmj.d7202.

    Article  PubMed  Google Scholar 

  11. Zarin DA, Fain KM, Dobbins HD, Tse T, Williams RJ. 10-year update on study results submitted to ClinicalTrials.gov. N Engl J Med. 2019;381(20):1966–74. https://doi.org/10.1056/NEJMsr1907644.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Zarin DA, Tse T, Sheehan J. The proposed rule for U.S. clinical trial registration and results submission. N Engl J Med. 2015;372(2):174–80. https://doi.org/10.1056/NEJMsr1414226.

    CAS  Article  PubMed  Google Scholar 

  13. Zou CX, Becker JE, Phillips AT, Garritano JM, Krumholz HM, Miller JE, et al. Registration, results reporting, and publication bias of clinical trials supporting FDA approval of neuropsychiatric drugs before and after FDAAA: A retrospective cohort study. Trials. 2018;19(1):581. https://doi.org/10.1186/s13063-018-2957-0. https://doi.org/10.1186/s13063-018-2957-0.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008;358(3):252–60. https://doi.org/10.1056/NEJMsa065779.

    CAS  Article  PubMed  Google Scholar 

  15. Rathi VK, Krumholz HM, Masoudi FA, Ross JS. Characteristics of clinical studies conducted over the total product life cycle of high-risk therapeutic medical devices receiving FDA premarket approval in 2010 and 2011. JAMA. 2015;314(6):604–12. https://doi.org/10.1001/jama.2015.8761.

    CAS  Article  PubMed  Google Scholar 

  16. Downing NS, Aminawung JA, Shah ND, Krumholz HM, Ross JS. Clinical trial evidence supporting FDA approval of novel therapeutic agents, 2005-2012. JAMA. 2014;311(4):368–77. https://doi.org/10.1001/jama.2013.282034 [doi].

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  17. Effective date of requirement for premarket approval for automated external defibrillator systems. https://www.federalregister.gov/documents/2015/01/29/2015-01619/effective-date-of-requirement-for-premarket-approval-for-automated-external-defibrillator-systems.

  18. Chalmers TC, Smith H Jr, Blackburn B, Silverman B, Schroeder B, Reitman D, et al. A method for assessing the quality of a randomized control trial. Control Clin Trials. 1981;2(1):31–49. doi: 0197-2456(81)90056-8 [pii]. https://doi.org/10.1016/0197-2456(81)90056-8.

    CAS  Article  PubMed  Google Scholar 

  19. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJM, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17(1):1–12. doi: 0197-2456(95)00134-4 [pii]. https://doi.org/10.1016/0197-2456(95)00134-4.

    CAS  Article  PubMed  Google Scholar 

  20. Moher D, Jadad AR, Tugwell P. Assessing the quality of randomized controlled trials. Current issues and future directions. Int J Technol Assess Health Care. 1996;12(2):195–208. https://doi.org/10.1017/s0266462300009570.

    CAS  Article  PubMed  Google Scholar 

  21. Bashir R, Bourgeois FT, Dunn AG. A systematic review of the processes used to link clinical trial registrations to their published results. Syst Rev. 2017;6(1):123-3. https://doi.org/10.1186/s13643-017-0518-3 [doi].

    Article  Google Scholar 

  22. Mayo-Wilson E, Fusco N, Li T, Hong H, Canner JK, Dickersin K, et al. Multiple outcomes and analyses in clinical trials create challenges for interpretation and research synthesis. J Clin Epidemiol. 2017;86:39–50. doi: S0895-4356(17)30121-X [pii]. https://doi.org/10.1016/j.jclinepi.2017.05.007.

    Article  PubMed  Google Scholar 

  23. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. https://www.equator-network.org/reporting-guidelines/strobe/.

  24. Talebi R, Redberg RF, Ross JS. Consistency of trial reporting between ClinicalTrials.gov and corresponding publications: one decade after FDAAA. Trials. 2020;21(1):675–9. https://doi.org/10.1186/s13063-020-04603-9 [doi].

    Article  PubMed  PubMed Central  Google Scholar 

  25. Phillips AT, Rathi VK, Ross JS. Publication of clinical studies supporting FDA premarket approval for high-risk cardiovascular devices between 2011 and 2013: a cross-sectional study. JAMA Intern Med. 2016;176(4):551–2. https://doi.org/10.1001/jamainternmed.2015.8590 [doi].

    Article  PubMed  Google Scholar 

  26. FDAAA 801 and the final rule (42 CFR part 11). https://www.ecfr.gov/cgi-bin/text-idx?SID=e617ec4da22678f934787ed565bbaa5a&mc=true&node=pt42.1.11&rgn=div5.

  27. Zarin DA, Tse T, Williams RJ, Carr S. Trial reporting in ClinicalTrials.gov - the final rule. N Engl J Med. 2016;375(20):1998–2004. https://doi.org/10.1056/NEJMsr1611785 [doi].

    Article  PubMed  PubMed Central  Google Scholar 

  28. Boutron I, Dutton S, Ravaud P, Altman DG. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010;303(20):2058–64. https://doi.org/10.1001/jama.2010.651 [doi].

    CAS  Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This project was supported by the Frank H. Netter MD School of Medicine Summer Research Fellowship. This funding was solely used for living expenses and was not used in the design of the study or collection, analysis, and interpretation of data or in writing the manuscript.

Author information

Authors and Affiliations

  1. Frank H. Netter MD School of Medicine at Quinnipiac University, North Haven, CT, USA

    Matthew J. Swanson

  2. Yale School of Medicine, New Haven, CT, USA

    James L. Johnston

  3. Section of General Medicine and the National Clinician Scholars Program, Department of Internal Medicine, Yale School of Medicine, PO Box 208093, New Haven, CT, 06520, USA

    Joseph S. Ross

  4. Department of Health Policy and Management, Yale School of Public Health, New Haven, CT, USA

    Joseph S. Ross

  5. Center for Outcomes Research and Evaluation, Yale-New Haven Hospital, New Haven, CT, USA

    Joseph S. Ross

Authors
  1. Matthew J. Swanson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. James L. Johnston
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Joseph S. Ross
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

MJS was responsible for the conception, design, acquisition of data, analysis and interpretation of the data, and drafting and revision of the manuscript. JLJ was responsible for the acquisition of data, analysis and interpretation of the data, and critical revisions for important intellectual content. JSR was responsible for the conception, design, analysis, and interpretation of the data, and drafting and revision of the manuscript. JSR provided supervision. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Joseph S. Ross.

Ethics declarations

Ethics approval and consent to participate

Because our examination of trial publications did not involve human subjects, ethics committee review was not required by the Yale University Human Research Protection Program. Consent to participate is not applicable.

Consent for publication

Not applicable.

Competing interests

JLJ has received support from the FDA through the Yale-Mayo Clinic Center for Excellence in Regulatory Science and Innovation (CERSI) program. JSR currently receives research support through Yale University from Johnson and Johnson to develop methods of clinical trial data sharing; from the Medical Device Innovation Consortium as part of the National Evaluation System for Health Technology (NEST); from the Food and Drug Administration for the Yale-Mayo Clinic Center for Excellence in Regulatory Science and Innovation (CERSI) program (U01FD005938); from the Agency for Healthcare Research and Quality (R01HS022882); from the National Heart, Lung and Blood Institute of the National Institutes of Health (NIH) (R01HS025164, R01HL144644); and from the Laura and John Arnold Foundation to establish the Good Pharma Scorecard at Bioethics International. MJS declares that he has no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Swanson, M.J., Johnston, J.L. & Ross, J.S. Registration, publication, and outcome reporting among pivotal clinical trials that supported FDA approval of high-risk cardiovascular devices before and after FDAAA. Trials 22, 817 (2021). https://doi.org/10.1186/s13063-021-05790-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-021-05790-9

Keywords

  • Clinical trials
  • Publications
  • Device approval
  • United States Food and Drug Administration

Trials

ISSN: 1745-6215