Skip to main content

Restoring Study PRGF: a randomized clinical trial on plasma rich in growth factors for knee osteoarthritis

Abstract

Background

A randomized clinical trial assessing plasma rich in growth factors (PRGF) versus hyaluronic acid for knee osteoarthritis was published in 2012 (sponsor trial ID BTI-01-EC/07/ART). Evidence of misreporting was discovered following access to unpublished materials. In accordance with the principles of the Restoring Invisible and Abandoned Trials (RIAT) initiative, we sought to re-analyse Study PRGF based on the unpublished trial materials.

Methods

Reanalysis was made possible primarily based on two unpublished study documents (original trial protocol and final report) obtained from the authors of the original publication. A call to action, calling on the authors to correct the original publication, was publicly issued. The involved ethics committee was repeatedly approached and extensive discussion with the authors ensued. After no agreement to correct the paper was reached, we embarked on this restoration. Reanalysis was focused on providing updated analyses for efficacy and safety.

Results

The efficacy of PRGF was not statistically different from hyaluronic acid for any prespecified primary or secondary efficacy outcomes. For the primary endpoint, the percent of patients on PRGF compared to hyaluronic acid with a decrease >40% in WOMAC pain subscale score was 5.4% higher; 95% confidence interval (CI) −10.4% to 21.3%; p = 0.505. This differs from the original publication that reported a non-prespecified primary endpoint (decrease >50% in WOMAC pain subscale score) which was 14.1% higher; 95% CI 0.5 to 27.6%; p=0.044. Furthermore, in contrast to the article statement that all the adverse events disappeared in 48 h, at least two patients in the hyaluronic arm and five patients in the PRGF arm reported persistent adverse events. Inadequate disclosure of conflicts of interest in the original publication was also noted.

Conclusions

This reanalysis of Study PRGF found no clinically or statistically significant benefit from PRGF compared to hyaluronic acid. The restoration of Study PRGF shows the urgency of important changes to trial reporting and oversight practices. In the future, timely access to all clinical trial documents is needed to minimize the risk of reporting bias. Similarly, ethics committees should be ready to intervene whenever a case of potential misconduct arises.

Trial registration

This is a RIAT project, whose original trial was approved and registered on 19 December 2007 by the Ethics Committee of the Basque Country, Spain, as BTI-01-EC/07/ART.

Peer Review reports

Background

There is substantial concern within the scientific community about the profusion of incompletely reported and misreported studies. Projects such as the Restoring Invisible & Abandoned Trials (RIAT) initiative (https://restoringtrials.org), which was launched in 2013 [1], are aimed at providing a more accurate picture of the evidence with medicines and, consequently, a better care of patients by clinicians. The basic procedures consist of getting access to the underlying data of a trial, comparing the results with those published in journals, contacting the original authors to discuss discrepancies and correct the publication if errors are demonstrated, to promote a more accurate dissemination of the effects of an intervention [2]. With assistance from the RIAT Support Center (currently housed at the University of Maryland School of Pharmacy), several research teams have been able to conduct trial restorations [3]. The reanalysis of paroxetine Study 329 is probably the most recognized RIAT project thus far [4]. Nevertheless, globally considered just a small number of reanalyses of randomized clinical trials have been conducted and published by entirely independent researchers [5].

In this article, we present the results of our RIAT reanalysis of a clinical trial on plasma rich in growth factors (PRGF) known as BTI-01-EC/07/ART, hereafter referred to as Study PRGF. The original study was sponsored by BTI Biotechnology Institute (BTI). We acknowledge the work of the original investigators. This double-blind, randomized controlled trial was designed to assess the efficacy and safety of PRGF compared with hyaluronic acid for adults suffering from symptomatic knee osteoarthritis. It was reported in Arthroscopy: The Journal of Arthroscopic and Related Surgery in 2012 by Mikel Sánchez et al. [6]. Early in 2019, our publicly funded research team, hereafter referred to as the RIAT researchers, was commissioned to evaluate the evidence on the efficacy and safety of platelet-rich plasma (PRP) and analogues in traumatology. As a result of the literature review, the high-impact Study PRGF was retrieved and closely analysed. The publication by Sánchez and colleagues claimed superiority for PRGF over hyaluronic acid in alleviating symptoms of mild to moderate knee osteoarthritis with a similar safety profile. However, this conclusion was at odds with the full dossier of the clinical trial. This was concerning, in particular because the article had a large influence on practice by supporting the use of PRP and its derivatives at a time when these products were not widely known. Based on that, our main objective was to re-analyse Study PRGF according to the full available information for the trial.

Chronologically, on 8 January 2019, the RIAT researchers asked the study’s corresponding author for the related protocol, final report and Ethics Committee resolutions, which were granted on 14 January 2019. Once the dossier was reviewed, the RIAT researchers wrote again on 21 January 2019 to explain in detail every detected concern, asking for clarification. From that time on, two phone calls and twelve emails were exchanged. In accordance with RIAT procedures, the RIAT researchers made public on 27 March 2019 the need to correct the article and simultaneously informed the contact author about this ‘call to action’ [7]. The study authors responded by email on 3 June 2019, refusing any responsibility and stating that the Ethics Committee endorsed them. The ethics committee provided a letter on 20 June 2019. The RIAT researchers tried repeatedly to get information directly from the Ethics Committee but failed. Considering that this alleged support did not solve the major misreporting identified in the article, the RIAT researchers reiterated the need of a more substantial correction; the authors rejected this proposal on 26 June 2019.

Study PRGF was a multicentre, 24-week, double-blind, randomized controlled trial [6]. According to the protocol, BTI’s declared objective was to evaluate the short and medium-term efficacy and safety of PRGF in the symptomatic treatment of knee osteoarthritis. Secondary aims were to investigate biological markers in peripheral fluids that may reflect time phases of disease progression. The ultimate goal was to assess disease evolution and monitor treatment through objective biological outcomes. The hypothesis was that PRGF would improve pain symptoms compared with HA in patients affected by knee degeneration. Study recruitment of patients took place between January 2008 and November 2009, and the study was completed on September 2010 [6].

Methods

We reassessed the data of Study PRGF in accordance with the RIAT recommendations. To this purpose and apart from the involved published article, we used as principal sources the following documents: (1) full original protocol, (2) ethics committee approval resolution, (3) final study report (summary version). All of them were accessed on request from the contact author of the original publication. Other related documents (Statistical Plan Analysis, study database, set of documents reviewed by the Ethics Committee and alleged final report dated November 2011) were also requested from the study authors with no response from their side.

According to RIAT recommended procedures [1], our methods are those previously set out in the January 2008 protocol for Study PRGF. When the methods used and published by Sánchez and colleagues differed from the protocol, we followed the original protocol. No official amendments to the protocol have ever been proved. In cases when the protocol was not precise enough, we decided by consensus standard methods to present the data in an appropriate way and inform explicitly on our decision.

Participants

A total of 187 participants were recruited at three clinical sites in the Basque Country (Spain). Potential candidates were informed in a first visit about the aims and methods of the clinical trial. Those patients showing interest in the trial were asked to sign an informed consent document. Basal blood and radiological tests were carried out whenever needed. All inclusion and exclusion criteria (Table 1) had to be met before entering the study in a subsequent ‘diagnostic visit’. Once included, each participant received a booklet to be filled in at home, including the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) questionnaire. As a result of this process, 176 participants were eventually randomized to the pre-planned interventions.

Table 1 Inclusion and exclusion study criteria according to the protocol body text

Interventions

Each included participant was randomized to receive infiltrations of the affected knee (3 injections on a weekly basis) with either PRGF-Endoret® (BTI) or hyaluronic acid (Euflexxa®, Copenhagen, Denmark). PRGF-Endoret® was prepared from autologous peripheral blood at each treatment visit by following subsequent steps of blood extraction, centrifugation and plasma fractioning. Plasma rich in platelets without leukocytes was then pipetted and activated with calcium chloride before infiltrated. Compliance was not considered a useful outcome to be estimated due to the fact that both interventions were administered by the researchers. Acetaminophen intake, the only permitted medication for pain relief throughout the trial period, was registered during the trial.

Sample size

Sample size calculation was initially stated in the protocol based on the original main outcome, the percentage of patients with a decrease >40% in the score in the WOMAC pain subscale at the final visit with respect to baseline (which is similar to a pain improvement >40%). Null hypothesis was set as no difference in that outcome between both interventions. A statistical power of 80% and α=0.05 were established, comparing two proportions by using the bilateral X2 test for independent samplings. Assuming that the proportion of participants reaching the main outcome was expected at 25% in the experimental group versus 10% in the control group, a total of 102 participants were estimated per arm. An anticipated dropout rate of approximately 5% was then considered, setting the final number of participants to 222 (111 per group). However, in the published article [6], the key parameter for the primary outcome measure was changed (decrease >50% instead of >40%) without amending the sample size calculation. In addition, study power (90%) and assumed proportion of patients achieving the main outcome (30% in the experimental group and 12% in the control group), was also amended without any changes to the sample size calculation. The final report did not inform on the potential reasons behind the gap between the calculated sample size and the total number of enrolled patients (187 participants), which may indicate that the trial was in practice underpowered.

Randomization and blinding

A stratified randomization in blocks of four was performed by using a specific software developed by GlaxoSmithKline (C4 Study Design Pack). Each centre was considered as one stratum. Randomized numbers were generated and assigned to participants, which were subsequently allocated to one study group, PRGF or hyaluronic acid. Sealed envelopes were used to conceal treatment allocation until the moment before applying the treatment.

Both participants and independent outcome assessors remained blinded to treatment assignment. Clinical researchers were not blinded due to relevant differences between both interventions in terms of appearance and viscosity. As for participants, peripheral blood was drawn from all patients regardless their assigned treatment and the infiltration area was hidden while the injection was given. Outcome assessors were not involved in infiltrating included participants.

Outcomes

According to the original protocol, participants were expected to be assessed 1, 2, and 6 months after the last treatment infiltration for the following outcomes:

Primary efficacy outcome

The prespecified primary efficacy outcome was a clinically significant improvement in pain, measured as the percentage of patients with a decrease >40% in the score in the WOMAC pain subscale at the final visit with respect to baseline. This outcome was not presented in the published article but only in the unpublished final report.

Secondary efficacy outcomes

The prespecified secondary efficacy outcomes were as follows:

  • Clinically significant improvement in pain, measured as the percentage of patients with a pain decrease >40% in the score in the Visual Analogue Scale (VAS) and Lequesne index at the final visit with respect to baseline. These outcomes were not presented in the published article but they were in the unpublished final report.

  • Clinically significant improvement in physical function, measured as the percentage of patients with a decrease ≥30% in the score in the Lequesne index and WOMAC scale at the final visit with respect to baseline. These outcomes were not presented either in the published article or in the final report.

  • Quality of life (questionnaire SF-12). This outcome was not presented either in the published article or in the unpublished final report.

  • Degree of joint mobility, measured by using a goniometer. This outcome was not presented in the published article but it was in the unpublished final report.

  • Use of acetaminophen. This outcome was presented in the published article and also in the unpublished final report.

  • Investigational biologic markers in plasma and synovial liquid; inflammatory markers as C-reactive protein; anabolic and angiogenic growth factors; synovial function markers as hyaluronic acid and YKL-40; indicators of cartilage anabolic/catabolic imbalance. These outcomes were not presented either in the published article or in the unpublished final report.

Leaving aside the aforementioned pre-planned outcomes, the study authors included in the published article several primary and secondary outcomes not prespecified in the original protocol (Table 2). We could not find any document that provided any scientific rationale for these post hoc changes, and the outcomes are therefore not reported in detail in this paper.

Table 2 Prespecified and published primary and secondary outcomes

Safety outcomes

A record of complications and/or adverse events with imputation scale was performed. In accordance with the protocol, any sort of circumstances considered by researchers as an adverse event was to be recorded in detail in the booklet, including surgical or postsurgical complications. Non-severe adverse events or those not considered as related to interventions were expected to be listed within the annual report and/or final report.

Statistical analysis

With regard to the statistical analysis, RIAT investigators adhere to the original protocol procedures linked only to primary and secondary prespecified outcomes. A database was created to register and extract data from every endpoint described in the study protocol, including a statistical analysis when needed [8] (see Additional file 1). Thus, any other exploratory analysis has been discarded from our reanalysis unless a compelling justification is explicitly offered. A descriptive analysis of the sample was performed, providing with demographic and clinical data. Quantitative outcomes, such as body mass index (BMI) and age, were estimated by reporting the mean, standard deviation and range. Regarding the qualitative ones, such as sex, marital status, education level, physical activity, medical history, medications and osteoarthritis radiologic severity, a frequency analysis was carried out. Basal comparability for both intervention groups was tested. The efficacy outcomes were assessed by using either a X2 test or a Student’s t test, depending on their qualitative or quantitative status. Beyond the scope of our re-analysis, focused on clinical efficacy and safety outcomes, several secondary variables were assessed by an analysis of covariance including intervention, centre and radiological severity as factors and BMI, age and acetaminophen consumption as covariates.

Efficacy analyses were prespecified to be conducted using a per-protocol (PP) approach, which was followed in the unpublished final report. The protocol also mentioned an intention-to-treat (ITT) approach to be used in dropout analysis. This latter alternative was chosen by the study authors to report the outcome results in the published article. In order to keep a conservative strategy, RIAT investigators decided to provide both analyses where possible. Regarding safety outcomes, all adverse events were individually described and a frequency analysis by intervention arm was compared by performing a X2 test. A blood test was planned one month after the last treatment infiltration. All statistical analyses were carried out by the sponsor.

Missing values were jointly dealt by the sponsor, lead researcher and statistician to decide on the last meaningful data (probably a last observation carried forward method but not confirmed) for any individual case.

The final unpublished report was used as the main source of data for all outcomes except the non-preplanned primary outcome and use of acetaminophen, as data for these variables were only available in the article publication.

Results

Table 3 presents the baseline characteristics of the intervention groups, including those already showed in the original article [6] (see Table 2, page 1074) and other variables (marital status, education level, Lequesne/VAS pain subscales and degree of joint mobility) only communicated in the final report (pages 13–14). No imbalance was detected for any characteristic taken into consideration.

Table 3 Basal characteristics according to the journal article and unpublished final report

A total of 176 participants underwent randomization (PRGF=89, HA=87). Reasons for exclusion before randomization included BMI out of range, high radiological severity and knee deformity (genu varus). After randomization, subjects were excluded because of non-permitted non-steroidal anti-inflammatory drugs (NSAID) consumption, steroid infiltrations or other surgical procedures not allowed by protocol. A total of 10 patients from the PRGF arm (11.2%) and 13 from the HA arm (14.9%) were excluded/withdrawn after being randomized. There have been registered three different reasons for exclusion: NSAID consumption (4 in the PRGF arm; 3 in the HA arm), corticosteroid infiltration (1 in the PRGF arm; 5 in the HA arm), and surgery procedures (2 in the PRGF arm; 1 in the HA arm). Also, some participants (2 in the PRGF arm; 4 in the HA arm) decided to withdraw their consent mainly due to perceived uselessness. Generally speaking, a visual inspection does not reveal relevant imbalances beyond a more frequent use of corticoid infiltrations in the hyaluronic acid arm.

Efficacy

A per-protocol efficacy analysis was defined in the protocol (page 41), which was coherent with the final unpublished report on this issue. However, the corresponding publication reported an intention-to-treat analysis instead of the pre-planned per-protocol analysis. Table 4 shows the per-protocol and intention-to-treat analyses for all pre-planned primary and secondary outcomes with available results, plus the non-preplanned primary outcome (percentage of patients with a decrease >50% in the score in the WOMAC pain subscale). There was a crucial discrepancy affecting the primary outcome between our analysis, which remained faithful to the protocol and final unpublished report documents, and that published by the study authors. As Table 4 displays, no statistically significant differences between both arms were identified for any primary or secondary pre-planned outcome when the final unpublished report is considered. When a decrease >50% in the WOMAC pain subscale was selected as the main outcome in a post hoc approach, inconclusive evidence from PP and ITT analyses could be drawn. In addition, the confidence interval shown by the only statistically significant result 14.1% (0.5–27.6) is wide enough as to likely include non-clinically significant differences. The protocol listed several pre-planned secondary outcomes (% patients with a function increase ≥30% in the score in Lequesne and WOMAC, quality of life, investigational/inflammatory markers and indicators of cartilage metabolic imbalance) which sadly were not available from any source.

Table 4 Primary and secondary outcomes in per-protocol and intention to treat population a

Harms

Table 5 presents the number of adverse events found in this study summarized by type of analysis, Ahlbäck grade and relation to treatment in accordance with researchers’ assessment. Around one in three participants suffered an adverse event, with no differences between both treatment groups regardless the analysis performed (per-protocol or intention-to-treat). Serious or unexpected adverse events were rare and equally distributed between the PRGF and HA groups.

Table 5 Adverse events registered in the clinical trial

Regarding causality, local researchers judged most of recorded adverse events (>90%) unrelated to the interventions. It should be recognized that assessing causality is always a challenging task. Nonetheless, further clarification on the followed criteria to determine a potential relation is lacking, particularly when this judgement can be seen as highly subjective. For example, there were eleven participants in the study who suffered from knee pain as an adverse event [eight participants in the PRGF arm (four of them persistent) and three in the hyaluronic arm (one of them persistent)]. Beyond the higher numerical prevalence of this adverse event (AE) in the PRGF arm, there remain some concerns on how a relation to the intervention was fully discarded for all but one case.

Finally, persistent adverse events were numerically more common in the PRGF arm (5 out of 26 AEs) than in the HA acid arm (2 out of 24 AE). Even if these figures cannot imply a real difference between both arms, they are not in line with the authors’ statement when declared in the publication that all adverse events disappeared in 48 hours.

Discussion

Main findings and contrast with original published article

Our RIAT appraisal of Study PRGF underlined that no substantial differences in pain relief and other efficacy estimates were proved when adult participants with knee osteoarthritis were treated with plasma rich in growth factors or hyaluronic acid. As far as safety is concerned, there is no sound evidence about a different profile between both interventions, while some data on type and persistent adverse events make advisable further research. This analysis is well aligned with the final report authored by Sánchez and colleagues but it is not the case concerning the published article in Arthroscopy [6].

We assessed and reported the Study PRGF in accordance with the original protocol, which had no amendments reported by the study authors or the corresponding ethics committee. The re-assessment of the dossier has shown a marked discrepancy in the main efficacy outcome based on the fact that unlike study authors, in the analysis the RIAT investigators stuck to the protocol and original final report. A specific section in the protocol devoted to ethical considerations (page 35) clearly stated that ‘no changes or deviations of the protocol will be permitted without evidence of approval’. However, the authors reported a non-approved main efficacy outcome, which should be seen as a protocol major change, reaching statistically significant differences in favour of the investigational product. It has been previously described that changes to endpoints can compromise the scientific integrity of a trial, leading to misguided research and suboptimal patient care [9].

Our re-analysis has shown in detail how an inappropriate shift in a primary outcome can dramatically influence final results. In this sense, it should be noted that the original statistical analysis was performed by the own trial sponsor, which stresses the need to rely on fully independent bodies for this crucial task.

Other issues such as secondary outcomes reported but not pre-specified and vice versa and the unexpected change in the analysis plan from a per-protocol to an intention-to-treat strategy were also identified. Theoretically, such a switch might have come from the journal review process or a late realization from the original team that intention-to-treat was most appropriate. However, the change should have been explained and justified in the original work, as should the switch of the primary outcome from 40% to 50% reduction. Interestingly, as Table 4 indicates, not only a shift in the original main outcome resulted in statistically significant differences between both interventions but also was needed a change from the preplanned per-protocol strategy to an intention-to-treat analysis. As it has been shown previously, up to thirteen secondary outcomes were either preplanned in the protocol or included in the published report. Despite that, no mention to the need for multiple testing correction has been found. Nonetheless, there were no statistically significant findings to be emphasized for any secondary outcome, so in practical terms corrections were not essential for this analysis.

With regard to harms caused by the interventions, inconsistencies between text and figures appeared on persistent symptoms. Finally, the study authors failed to report their conflicts of interest in the authorship and publication of this article. In particular, one of them (EA) was the Scientific Director of the BTI Biotechnology Institute, manufacturer of PRGF-Endoret®, and others (JJA, SP, GO) were employees of the company [6].

Agreements and disagreements with other studies

Beyond the clinical trial carried out by Sánchez et al. [6], it is not uncommon to find other studies [10,11,12,13] and even systematic reviews [14] claiming that PRPs and PRGFs are safe and effective. However, an overview on platelet-rich plasma injections for knee osteoarthritis published in 2019 by the National Institute for Health and Care Excellence (NICE) declared that, despite no major safety concerns have risen, ‘evidence on efficacy is limited in quality’, ‘long-term clinical effectiveness is unknown’ and ‘outcome measures of self-reported pain relief and knee function are subjective and may be confounded by various factors’ [15].

When studies are examined individually, there are important and repeated weaknesses: no randomization [12, 13], no placebo group [6, 10,11,12,13, 16], low patients number [10,11,12,13, 16, 17], short follow-up period [12], lack of blinding [11,12,13, 16] or conflicts of interest [6, 10, 11], among others. Even the selected comparator in many of these trials, hyaluronic acid, might not have been a wise decision. NICE is not recommending the use of intra-articular hyaluronic acid injections since 2014, given its relatively short intra-articular persistence estimated from just a few hours to days [18]. Bearing in mind all these aspects, we can gather that uncertainty is still the prevailing situation. Our research results match well with this statement, providing evidence of a supposedly poorly driven clinical trial within those a priori more prominent studies in its field.

RIAT procedures

Compared to previous exercises, basically represented by the Study 329 [4], this RIAT process has probably entailed less complexity in its analyses but a similar demanding effort and perseverance. The dialogue with the study authors extended over 6 months and 16 total email messages. At first, gaining access to the protocol, final report and ethics committee approval was not an issue but the same could not be said of other relevant data. In particular, the specific Statistical Analysis Plan, the full set of documents reviewed by the ethics committee and the individual patient data, as well as a claimed but never facilitated report dated November 2011, were requested and unfortunately not provided by the study authors. On the other hand, we can confirm that Trials has had the opportunity to review all available information. Readers interested in verifying our analysis are strongly encouraged to contact the corresponding author of the original publication to obtain the original documents. Additionally, we share the Study 329 RIAT team’s view that individual patient level data are crucial when assessing adverse events [4]. To a certain extent, this lack of information could make our analysis less informative than intended. Nonetheless, it strongly underlines the necessity of a much wider transparency policy when a clinical trial is published.

Following the RIAT principles, the study authors were offered from the beginning the possibility to correct themselves all detected inaccuracies. A call to action was publicly issued and sent to the study authors [7]. Once clearly established their refusal to make any amendment, the journal where the trial was originally published was contacted and appropriately informed. As we have documented in a past publication [19], journals are often reluctant to correct or retract their articles even when serious flaws have been proved. In this particular case, the journal finally discarded any kind of retraction, amendment or re-publication process and invited our team to publish a letter summarizing our main concerns [20], which was subsequently replied by the study authors [21] and accompanied by an editors’ note.

The Osteoarthritis Research Society International (OARSI) assessed in 2000 the optimal cut-offs to be applied for the OARSI responder criteria regarding several settings, including knee intra-articular specific drugs for osteoarthritis [22]. The prioritized proposal (proposition A) estimated a 40% relative change as high improvement in pain for these drugs. Four years later, the performance of the OARSI 2000 sets of criteria was evaluated and a simpler set of responder criteria across all settings was adopted for osteoarthritis, which included a high improvement in pain or in function ≥50% and absolute change ≥20 points [23]. Given this context, the authors reasoned in their letter in favour of using the OARSI 2004 Guideline [23]. However, this document was published 4 years before the study protocol was completed and its recommendations did not restrict the condition of ‘responder’ to pain improvement by at least 50%, but they also added the need to cause a change in the WOMAC pain subscale of at least 20 points in absolute terms [23]. Thus, there was no time justification for adopting the OARSI Guideline recommendation in 2010/2011, once the study was finished, nor was the OARSI recommendation taken up in its entirety by the authors. Additionally, it is not clear why the impact of the supposedly harder goal (50% vs 40%) affected in a much greater extent to the control group than to the experimental one, as Table 4 shows.

And fourth, we would be pleased if our experience led to a deep reflection on the future role of ethics committees, reinforcing their commitment with the best practices in research. To fulfil this important mission over the entire life of a clinical trial, these committees would need adequate and well-trained resources, as well as the ability to take action when a case of malpractice is detected.

Strengths and limitations

Study PRGF was a randomized controlled trial with a modest sample size, although larger than most studies in its field [10,11,12,13, 16, 17]. The trial maximum follow-up was only 6 months, not being useful to provide information on long-term outcomes, of great importance in chronic conditions such as osteoarthritis. According to the Ahlbäck score, 87% of included participants had a radiological severity <3, which is focused on those patients with less impairment, limiting the generalizability of the results. Additionally, it must be taken into account that, in normal practice, PRPs and its derivatives are mostly used in high-severity patients as a last resort, a setting far from that investigated in the present study.

Beyond the specific characteristics of the trial, evidence of several protocol violations has been proved over the RIAT process, clearly undermining the results showed by the original journal publication. On the other side, the RIAT development has been feasible due to the access to two major sources of data (protocol and final report) but it must be recognized that our re-analysis was also limited mainly related to the lack of individual participant data. This information was formally requested with no response received from the authors, which has prevented us from presenting results in more detail but also from discarding other potential problems such as data fabrication. Nonetheless, having in mind these limitations, we remain fully confident on the support that the existent data confer to our results.

Conclusions

In contrast to the original published article by Sánchez and colleagues, our analysis of Study PRGF (originally coded as BTI-01-EC/07/ART) found no statistically significant differences between plasma rich in growth factors and hyaluronic acid in adults with knee osteoarthritis on any of the prespecified outcomes, included the primary efficacy variable. Serious or unexpected adverse events were rare and equally distributed between both interventions. Notwithstanding, further research should focus on finding out the real rate of persistent harms and the particular profile of adverse events linked to each treatment. Health professionals, especially in this case orthopaedic surgeons, but also researchers and decision-makers should be aware of the potential weaknesses in a priori high-quality research. It is highly convenient that all systematic reviews including the present clinical trial update their results in the light of this new evidence. In the same way, any other clinical trial or review based to some extent on the findings of this study is also called to re-assess its conclusions. Also, sharing the imperative demand by many other research teams, health authorities are strongly encouraged to make compulsory free access to protocols and raw data supporting subsequent publications.

As Le Noury and colleagues rightly stated in their pioneering report [4], ‘additional outcome variables outside those in the protocol cannot be legitimately declared once the study is underway except as exploratory variables [we would add that much less when the study has ended]’. ‘The a priori protocol and blinding are the bedrock of a randomised controlled trial [we would add that unfortunately, sometimes the bedrock turns into a dangerous sand foundation]’. ‘The primary mandate of the RIAT enterprise is to reaffirm essential practices in randomised controlled trials [we would add that we hope to have contributed to this goal at least to a small extent]’.

Availability of data and materials

All data for which the RIAT authors are directly responsible are included in this published article and its supplementary information files. This RIAT project has used third-party data to generate part of the results presented in the study, which cannot be made openly available. In agreement with the Trials’ Availability of data policy, this subject has been explicitly stated across the manuscript and all relevant documents have been provided to Trials for purposes of peer review. Readers interested in verifying our analysis are strongly encouraged to approach the corresponding author of the original publication (doi: 10.1016/j.arthro.2012.05.011) in order to obtain the referred underlying data.

Abbreviations

AE:

Adverse event

BMI:

Body mass index

CI:

Confidence interval

g:

Grams

HA:

Hyaluronic acid

ITT:

Intention-to-treat

NICE:

National Institute for Health and Care Excellence

NSAID:

Non-steroidal anti-inflammatory drugs

OARSI:

Osteoarthritis Research Society International

PP:

Per protocol

PRGF:

Plasma rich in growth factors

PRP:

Platelet-rich plasma

RIAT:

Restoring invisible and abandoned trials

SD:

Standard deviation

VAS:

Visual Analogue Scale

WOMAC:

Western Ontario and McMaster Universities Osteoarthritis Index

y:

Years

References

  1. Doshi P, Dickersin K, Healy D, Vedula S, Jefferson T. Restoring invisible and abandoned trials: a call for people to publish the findings. BMJ. 2013:346. https://doi.org/10.1136/bmj.f2865.

  2. Erviti J, Saiz LC, Garjón J. The reliability of clinical trials. The risky way towards drug deregulation. Med Clin (Barc). 2016;147(12):554–7.

    Google Scholar 

  3. Doshi P, Shamseer L, Jones M, Jefferson T. Restoring biomedical literature with RIAT. BMJ. 2018:361. https://doi.org/10.1136/bmj.k1742.

  4. Le NJ, Nardo JM, Healy D, Jureidini J, Raven M, Tufanaru C, et al. Restoring Study 329: efficacy and harms of paroxetine and imipramine in treatment of major depression in adolescence. BMJ. 2015:351. https://doi.org/10.1136/bmj.h4320.

  5. Ebrahim S, Sohani ZN, Montoya L, Agarwal A, Thorlund K, Mills E, et al. Reanalyses of randomized clinical trial data. JAMA. 2014;312(10):1024–32.

    Article  CAS  Google Scholar 

  6. Sánchez M, Fiz N, Azofra J, Usabiaga J, Aduriz E, Garcia A, et al. A randomized clinical trial evaluating plasma rich in growth factors (PRGF-Endoret) versus hyaluronic acid in the short-term treatment of symptomatic knee osteoarthritis. Arthroscopy. 2012;28(8):1070–8.

    Article  Google Scholar 

  7. Saiz LC, Erviti J, Leache L. Call to action: RIAT restoration of a misreported clinical trial on Plasma Rich in Growth Factors [Rapid response]. BMJ. 2019. https://www.bmj.com/content/346/bmj.f2865/rr-11.

  8. Consellería de Sanidade, Xunta de Galicia, España; Organización Panamericana de la Salud (OPS-OMS); Universidad CES C. Epidat: programa para análisis epidemiológico de datos. Versión 4.2; 2016. Available from: http://www.sergas.es/Saude-publica/EPIDAT

    Google Scholar 

  9. Evans S. When and how can endpoints be changed after initiation of a randomized clinical trial? PLoS Clin Trials. 2007;2(4):1–3.

    Article  Google Scholar 

  10. Vaquerizo V, Plasencia MÁ, Arribas I, Seijas R, Padilla S, Orive G, et al. Comparison of intra-articular injections of plasma rich in growth factors (PRGF-Endoret) versus durolane hyaluronic acid in the treatment of patients with symptomatic osteoarthritis: a randomized controlled trial. Arthrosc - J Arthrosc Relat Surg. 2013;29(10):1635–43. https://doi.org/10.1016/j.arthro.2013.07.264.

    Article  Google Scholar 

  11. Vaquerizo V, Padilla S, Aguirre JJ, Begoña L, Orive G, Anitua E. Two cycles of plasma rich in growth factors (PRGF-Endoret) intra-articular injections improve stiffness and activities of daily living but not pain compared to one cycle on patients with symptomatic knee osteoarthritis. Knee Surg Sport Traumatol Arthrosc. 2018;26(9):2615–21.

    Article  Google Scholar 

  12. Say F, Gürler D, Yener K, Bülbül M, Malkoc M. Platelet-rich plasma injection is more effective than hyaluronic acid in the treatment of knee osteoarthritis. Acta Chir Orthop Traumatol Cechoslov. 2013;80:278–83.

    CAS  Google Scholar 

  13. Filardo G, Kon E, Pereira Ruiz MT, Vaccaro F, Guitaldi R, Di Martino A, et al. Platelet-rich plasma intra-articular injections for cartilage degeneration and osteoarthritis: single- versus double-spinning approach. Knee Surg Sport Traumatol Arthrosc. 2012;20(10):2082–91.

    Article  Google Scholar 

  14. Anitua E, Sánchez M, Aguirre J, Prado R, Padilla S, Orive G. Efficacy and safety of plasma rich in growth factors intra-articular infiltrations in the treatment of knee osteoarthritis. Arthrosc J Arthrosc Relat Surg. 2014;30(8):1006–17. https://doi.org/10.1016/j.arthro.2014.05.021.

    Article  Google Scholar 

  15. National Institute for Health and Care Excellence. Platelet-rich plasma injections for knee osteoarthritis. Interventional procedures guidance. IPG637. 2019. Available from: https://www.nice.org.uk/guidance/ipg637

  16. Huang Y, Liu X, Xu X, Liu J. Intra-articular injections of platelet-rich plasma, hyaluronic acid or corticosteroids for knee osteoarthritis: a prospective randomized controlled study. Orthopäde. 2019;48(3):239–47.

    Article  Google Scholar 

  17. Lin KY, Yang CC, Hsu CJ, Yeh ML, Renn JH. Intra-articular injection of platelet-rich plasma is superior to hyaluronic acid or saline solution in the treatment of mild to moderate knee osteoarthritis: a randomized, double-blind, triple-parallel, placebo-controlled clinical trial. Arthrosc - J Arthrosc Relat Surg. 2019;35(1):106–17. https://doi.org/10.1016/j.arthro.2018.06.035.

    Article  Google Scholar 

  18. National Institute for Health and Care Excellence. Osteoarthritis: care and management in adults. CG177. 2014;(February):1–505. https://www.ncbi.nlm.nih.gov/books/NBK248069/.

  19. Saiz LC, Erviti J, Garjón J. When authors lie, readers cry and editors sigh. BMJ Evidence-Based Med. 2018; [cited 2018 Apr 12]; Available from: http://ebm.bmj.com/lookup/doi/10.1136/bmjebm-2018-110917.

  20. Saiz LC, Erviti J, Leache L, Gutiérrez-Valencia M. Misreporting of a plasma-rich-in-growth-factors trial on knee osteoarthritis. Arthrosc - J Arthrosc Relat Surg. 2020;36(3):622–3. https://doi.org/10.1016/j.arthro.2020.01.004.

    Article  Google Scholar 

  21. Sánchez M, Fiz N, Azofra J, Usabiaga J, Recalde EA, García Gutierrez A, et al. Response to Saiz et al., “Misreporting of a Plasma Rich in Growth Factors Trial on Knee Osteoarthritis”. Arthrosc - J Arthrosc Relat Surg. 2020;36(3):623–5. https://doi.org/10.1016/j.arthro.2020.01.003.

    Article  Google Scholar 

  22. Dougados M, LeClaire P, Van der Heijde D, Bloch DA, Bellamy N, Altman RD. Response criteria for clinical trials on osteoarthritis of the knee and hip: a report of the Osteoarthritis Research Society International Standing Committee for Clinical Trials response criteria initiative. Osteoarthr Cartil. 2000;8(6):395–403.

    Article  CAS  Google Scholar 

  23. Pham T, van der Heijde D, Altman RD, Anderson JJ, Bellamy N, Hochberg M, et al. OMERACT-OARSI initiative: Osteoarthritis research society international set of responder criteria for osteoarthritis clinical trials revisited. Osteoarthr Cartil. 2004;12(5):389–99.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the RIAT Support Center (https://restoringtrials.org/) for the methodological guidance and support.

Funding

No specific funding has been received for this work.

Author information

Authors and Affiliations

Authors

Contributions

Conception of the work, acquisition of data and database creation: LCS. Database quality assessment and content review: JE, LL and MGV. Data analysis and interpretation: all authors. Drafting the work and revising it critically for important intellectual content, final approval of the version to be published: all authors. All authors agree to be accountable for all aspects of the work. LCS is the guarantor.

Corresponding author

Correspondence to Luis Carlos Saiz.

Ethics declarations

Ethics approval and consent to participate

The original version of this restored trial was approved by the Ethics Committee of the Basque Country, Spain, on 19 December 2007 (BTI-01-EC/07/ART).

Consent for publication

According to the original publication of this restored trial, all patients provided written consent before entry into the study.

Competing interests

The RIAT authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

RIAT_database_PRGF. Restored baseline data and results.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saiz, L.C., Erviti, J., Leache, L. et al. Restoring Study PRGF: a randomized clinical trial on plasma rich in growth factors for knee osteoarthritis. Trials 24, 37 (2023). https://doi.org/10.1186/s13063-022-07049-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-022-07049-3

Keywords