Study factors associated with the incompletion of clinical trials that include pediatric patients: a retrospective analysis of the European Clinical Trials Database and a lesson from the European region

Abstract

Background

Incomplete clinical trials for pediatric drug development result in a lack of adequate scientific evidence for providing appropriate medication to pediatric populations; this is especially true for Japan. Thus, using the European Clinical Trials Database (EudraCT), this study aimed to identify the factors related to the study design and administration that lead to incompletion of clinical trials that included pediatric patients.

Methods

We focused on clinical trials that included patients under the age of 18 registered in the database, named as the European Clinical Trials Database between January 1, 2014, and December 31, 2018. Two groups of trials were identified: “all cases completed” and “not all cases completed,” reflecting whether they were completed in all participating countries/regions or not. To identify the factors of the occurrence of “not all cases completed,” a logistic regression analysis was performed to calculate the odds ratios and 95% confidence intervals. In total, 142 clinical trials (95 “all cases completed” and 47 “not all cases completed”) were analyzed.

Results

The logistic regression analysis showed the number of countries in which a clinical trial was conducted to be the only significant factor (odds ratio: 1.3; 95% confidence interval: 1.1-1.5); this was identified as the primary factor for the occurrence of “not all cases completed” in the clinical trials that included pediatric patients.

Conclusion

Our findings suggest that the feasibility of clinical trials that include pediatric patients, such as whether the countries in which the trial is to be conducted are suitable, must be considered prior to the trial.

Background

There are approximately 7000 known rare diseases, [1] 65% of which are serious and have no effective treatment. Two-thirds of these diseases can emerge by the age of 2 years, and 35% have a likelihood of causing death within 1 year [2].

In many countries, and especially in Japan, drug development for pediatric populations has not been adequately implemented, and this has been referred to as the “therapeutic orphan” dilemma [3]. Although some drugs contain labels describing the indications for administration or dosages for pediatric patients, off-label use of medications without official authorization for pediatric indications from regulatory agencies is prevalent. In Japan, while several off-label indications in pediatric patients are reimbursed by the public health insurance system in limited conditions [2], off-label use also frequently occurs in clinical practice within routine health care and its regulatory systems. The use of off-label or unlicensed drugs in Japan is entirely excluded from side effects therapy according to the Relief System for Sufferers from Adverse Drug Reactions by the Law for the Pharmaceuticals and Medical Devices Agency. This system denies any opportunity for recompense from the regulatory agency, even when side effects emerge in pediatric patients [2].

Several previous attempts to promote pediatric drug development in Japan have been made, including (1) investigator-initiated clinical trials, (2) the establishment of the Council on Unapproved Drugs/Off-Label Use to recommend the clinical development strategy for regulatory approval, (3) the extension of the statutory re-examination periods for drugs after their initial marketing authorization since 2010, and (4) additional premium pricing for pediatric drugs, which increased drug prices by 5–20% since 2016. However, the effectiveness of these countermeasures has been negligible since they have not been legally enforced in Japan.

In contrast, the USA has implemented regulations such as the Best Pharmaceuticals for Children Act in 2002 and the Pediatric Research Equity Act (PREA) in 2003, [4, 5] while the EU implemented the Pediatric Regulation in 2017 [5, 6]. Notably, pediatric clinical trials in the EU commence after phase 1, at an earlier stage than in the United States, to ensure that the drugs are simultaneously commercially available for all patients, including pediatric patients. However, even though such effective and efficient regulations for pediatric drug development exist, a limited number of clinical trials have been conducted, especially trials involving premature infants, infants, toddlers, and children receiving life support [7].

In contrast to the well-established clinical trial designs for adult patients, the availability of existing methodologies for pediatric clinical trials for the development of new drugs is relatively limited to the industry, academia, and regulators. Several pediatric clinical trials have proven to be less than successful, [8] further highlighting the need to examine clinical trial designs for pediatric drug development [9].

Thus, the aim of this study was to identify the factors related to the study design or study administration that was associated with incomplete clinical trials that included pediatric patients, using the European Clinical Trials Database (EudraCT).

Methods

Definitions for investigated clinical trials

In this study, the term “all cases completed” is used to define clinical trials that were conducted in single or multiple countries that achieved the status of “completed” in all geographic regions. Specifically, this term was used for the trials that have “been completed in accordance with the full requirements of the protocol” [10].

However, the “not all cases completed” label refers to clinical trials that were conducted in single or multiple countries that did not achieve the status of “completed” in all regions. Such clinical trials were additionally classified as either “not authorized,” “temporarily halted,” or “prematurely ended,” according to the definitions provided in the “How to search the EU Clinical Trials Register,” published by the European Medicines Agency (EMA) on April 28, 2014. “Not authorized” refers to “a trial for which a negative ethics committee opinion was issued” in any of EU member states, [10] and that could therefore not be initiated in that state. The label “temporarily halted” refers to “a trial that has been temporarily interrupted. Reasons for such an interruption are varied, ranging from an interruption in the supply of an investigational medicinal product that needed to wait for the authorization of a substantial amendment to the protocol.” “Prematurely ended” refers to “a trial that ended before the completion of the all procedures described in the protocol. Reasons for a premature end can be related to the lack of product safety or efficacy, or lack of trial feasibility.”

Data source

To obtain the data of interventional clinical trials, we systematically searched EudraCT database [11]. EudraCT is a European database developed by the EMA for all interventional clinical trials on medicinal products authorized in the European Union (EU) and those authorized outside the EU/European Economic Area (EEA) provided they formed part of a Pediatric Investigation Plan (PIP) from 1 May 2004 onwards. This database contains clinical trial protocols and study results that are publicly and readily available without any limitations of use (https://www.clinicaltrialsregister.eu/ctr-search/search). All clinical trials in this database are coded with a EudraCT number.

Trial selection

The trial data were collected from EudraCT using the advanced search engine in this site. The eligible trials were defined according to the following criteria: (1) all countries “except for those outside EU/EEA,” (2) the date (between January 1, 2014, and December 31, 2018) when the trial information was first entered into the EudraCT database by a competent national authority or a third country data provider, and (3) the study status of “trials with results.” These searches were conducted on February 7, 2019. The target clinical trials comprised interventional phase 2 or 3 trials including pediatric subjects (newborns: 0–27 days; infants and toddlers: 28 days–23 months; children: 2–11 years; and adolescents: 12–17 years).

Next, we classified the trials based on the above definitions for investigated clinical trials. The clinical trials that were not initiated at all did not meet the definitions for “all cases completed” or “not all cases completed” and were therefore excluded from the analysis.

Data collection and variables

We collected the data related to the study design of each clinical trial for analysis. For instance, we examined the type of disease on which the clinical trial focused, whether the disease was rare, the trial phase, whether the trial was randomized, whether the trial was double-blind, the number of enrolled participants, whether the trial included infants and toddlers, the number of countries in which the clinical trial was conducted, the year the clinical trial started, and the length of the trial period (in days).

Next, we collected data related to the administrative aspects of each clinical trial. We examined whether the clinical trial formed part of a pediatric investigation plan (PIP) authorized by a competent authority, the sponsor type, whether the clinical trial had undergone substantial protocol amendments, whether there were no protocol amendments after starting a clinical trial, whether the clinical trial was interrupted globally, and the trial’s “not all cases completed” status (i.e., “not authorized,” “temporarily halted,” or “prematurely ended”).

Main outcome

The main outcome of this study was the identification of the factors that led to the occurrence of a “not all cases completed” status in clinical trials that included pediatric patients.

Analysis

Data on the study design and administration of clinical trials were summarized by categories of “all cases completed” or “not all cases completed.” We calculated a median and a range (minimum–maximum) for continuous variables and a proportion for categorical variables. The differences between the categories “all cases completed” and “not all cases completed” were tested using chi-square tests or Fisher’s exact tests in the case of categorical variables, and the Mann-Whitney U test in the case of continuous variables. A two-sided alpha level of p <  0.05 was used for statistical significance.

To identify the factors influencing the occurrence of trials with “not all cases completed,” multivariate logistic regression analysis (simultaneous forced entry) was performed to calculate odds ratios (ORs) and 95% confidence intervals (95% CIs). The four variables were a priori fixed into the logistic model: PIP, rare disease, enrollment of “newborns” or “infants and toddlers,” and the number of countries in which the clinical trial was conducted. Spearman’s rank correlation coefficients were calculated to check for multicollinearity between every combination of two variables among the four forced-entry independent variables. All statistical analyses were performed using JMP® 14 (SAS Institute Inc., Cary, NC, USA).

Ethics statement

Since this was a retrospective study using publicly available official materials published on the EMA websites, none of the data included personal information that would render the subjects identifiable. Accordingly, an ethical review was not required for this study.

Results

Trial selection

At first, we extracted 1629 clinical trials with results from the EudraCT. From these, 1391 clinical trials were excluded. These included those in a study phase earlier than 2 (n = 270) and those excluding pediatric patients (n = 1315), leaving 238 clinical trials. Finally, 96 clinical trials that were not initiated due to not being authorized in any of the competent authorities in the EU were excluded (Fig. 1).

Fig. 1

Flow diagram for study selection

Trial characteristics

In total, 142 clinical trials were identified and analyzed (95 “all cases completed” and 47 “not all cases completed”; Fig. 1). The study characteristics are summarized in Table 1. All of the clinical trials in the following disease categories were terminated without achieving the pre-specified number of study samples (that is, trials of the “not all cases completed” group): gastrointestinal disorders (two trials), pregnancy, puerperium and perinatal conditions (two trials), psychiatric disorders (two trials), reproductive system and breast disorders (four trials), and vascular disorders (two trials).

Table 1 Summary of the target diseases of the clinical trial

Design of clinical trials

For both groups, phase 3 was the most common trial phase (“all cases completed,” n = 50, 52.6%; “not all cases completed,” n = 22, 46.8%). Randomized clinical trials accounted for 58 of the “all cases completed” (61.1%) group and 30 of the “not all cases completed” (63.8%) group; however, double-blind trials accounted for less than 50% of the cases in both groups (“all cases completed,” n = 42, 44.2%; “not all cases completed,” n = 19, 40.4%). For both groups, the lowest median number of pediatric patients in the age categories of newborns and infants and toddlers was zero among the clinical trials. However, the “all cases completed” group had a slightly but significantly higher median number of adolescent participants (eight patients) compared with the “not all cases completed” group (one patient; p = 0.03). Further, the “not all cases completed” group had no children and one adolescent patient per trial on average. The proportion of clinical trials that included newborns or infants and toddlers was approximately 20% in both groups (“all cases completed,” n = 19, 20%; “not all cases completed,” n = 10, 21.7%). The median (minimum–maximum) number of the countries participating in the trials was two (1–10) for the “all cases completed” group, and four (1–18) for the “not all cases completed” group (p <  0.001). Finally, the median trial period was longer for the “not all cases completed” group, at 723.5 days, than in the “all cases completed” group, at 616 days (Table 2), but is insignificant.

Table 2 Summary of the study designs of the clinical trials

Study administration of clinical trials

In total, 18.9% (18 of 95) of the “all cases completed” group were planned by the PIP, compared to 27.7% (13 of 47) of the “not all cases completed” group (p = 0.24). The proportion of clinical trials with no protocol amendments after starting trials was approximately 40% for both groups. Global interruptions of the clinical trial were present in 14.9% of the “not all cases completed” group (n = 4, 8.5%), and the “prematurely ended” clinical status was detected in 43 of the cases in this group (91.5%; Table 3).

Table 3 Summary of the administration of the clinical trials

Factors of the occurrence of “not all cases completed”

There was no multicollinearity suggested by the correlation analysis among these independent variables. The results of the logistic regression analysis for the identification of factors influencing the occurrence of “not all cases completed” are shown in Table 3. Only the number of countries in which the clinical trial was conducted was identified as a significant factor (OR: 1.3; 95% CI [1.1, 1.5]; Table 4).

Table 4 Factors related to incomplete clinical trials (N = 138)

Discussion

This study sought to identify the factors related to the occurrence of “not all cases completed” in clinical trials by analyzing the key characteristics of clinical trials that included pediatric patients in the EudraCT database. The results showed that the number of countries in which a clinical trial was conducted was significant, which influenced the successful completion of clinical trials that included pediatric patients.

Most clinical trials that were included in the analysis were in phase 3 and conducted by commercial companies. A small number of clinical trials were planned by the PIP, targeted for a rare disease. There were no significant differences between the “all cases completed” and “not all cases completed” groups for these trial factors. We found that two variables significantly differed between the groups: the number of enrolled participants, particularly adolescents, and the number of countries where the clinical trials were conducted. The “not all cases completed” group had fewer patients enrolled than the “all cases completed” group, especially in the studies with adolescents, but involved a larger number of countries in the clinical trials. In a previous study that involved a systematic review of research conducted over the past 30 years regarding the reasons for failure of clinical trials, slow enrollment of patients was indicated as the reason why trials were expanded by adding new study sites or countries [12]. These changes may lead to ad hoc protocol amendments and delays in research progress. In another report, the main cause of study failure was reported to be a small sample size [13]. This finding suggests that a large number of participating countries could possibly be related to the premature termination of clinical trials, which may be ascribable to the potential burden of handling the different regulations and administrations of clinical trials across participating countries [13, 14]. Actually, lower numbers of patients were enrolled during the limited trial period in the “not all cases completed” group, which highlights problems reported for the multi-regional clinical trials, such as a lack of infrastructure and miscommunication. This may be the result of differences in the cultures and healthcare systems across the participating countries [15, 16].

Future steps for pediatric clinical trials

Our findings suggest that, when conducting multi-regional clinical trials involving several countries, the feasibility of completing the trials as planned should be ensured. Several aspects should be considered in advance, including suitable trial design and effective administration, such as study procedures.

International cooperation for clinical trials that target small populations, such as rare disease or pediatric drug development, should be investigated further. Previous studies of EU-based trials have illustrated the importance of harmonization in clinical trial procedures where the trials conducted are necessary for pediatric clinical trials, given the rise of multicenter and multinational research [17]. It was reported that the key challenge these trials faced was overcoming the lack of harmonization of the status of several procedures across different countries. The International Council for Harmonization of Technical Requirements for Pharmaceuticals for Human Use (ICH) harmonized E17 guidelines, and the General Principles for Planning and Design of Multi-regional Clinical Trials adopted on 16 November 2017 [18] provide recommendations for study designs involving multi-regional clinical trials. Utilizing these guidelines might increase their acceptability in the global regulatory environment.

In addition, clinical trials involving small groups may require multi-regional or multi-site designs to efficiently address the issue of participant shortage. Additionally, increased efforts to enhance cooperation among study sites and regions are needed. Effective drug development planning has been described in Section 4 (“drug development planning”) and Section 4.4 (“feasibility”) of the ICH E8 (R1) General Considerations for Clinical Studies draft guidelines [19]. Further, the use of master protocol or research networks for specific small disease groups might be effective for promoting clinical trials across multiple regions and countries [20].

In summary, our findings suggest that difficulties exist in coordinating and operating global, multicenter studies that include pediatric populations, possibly due to differences in regulations or administrative procedures across regions. There are several aspects to be considered and addressed, such as developing support systems for clinical trials and improving infrastructure or funding systems [21]

There are three important limitations in this study. First, the approach used here cannot be applied to the clinical trials conducted in countries outside of the EU; therefore, the results and interpretation are not geographically generalizable. Future studies are warranted to investigate the reasons behind the incompletion of pediatric clinical trials in other regions with different advanced regulatory systems, such as the USA and Japan. In Japan, there is no database of clinical trials with study protocols and results presently available. Second, we were unable to take into consideration the details of the study design, such as the duration of intervention and the strength of its invasiveness because of lack of coded data in this database, which would provide a more comprehensive picture of the clinical trials included in the study. Finally, public or academic studies without industrial promotion may suffer more difficulties to complete; however, our study is unlikely to make a concrete conclusion on the impact of public/private study because of the inclusion of a small number of public trials.

Conclusions

This study is the first study to use EudraCT to clarify the factors associated with failures in the clinical trials that include pediatric patients. Our findings highlight the importance of careful consideration of the study protocol requirements and the feasibility of study logistics, especially for multi-regional clinical trials.