Skip to main content
Download PDF

Registry-based randomised controlled trials: conduct, advantages and challenges—a systematic review

Trials volume 25, Article number: 375 (2024) Cite this article

Abstract

Background

Registry-based randomised controlled trials (rRCTs) have been described as pragmatic studies utilising patient data embedded in large-scale registries to facilitate key clinical trial procedures including recruitment, randomisation and the collection of outcome data. Whilst the practice of utilising registries to support the conduct of randomised trials is increasing, the use of the registries within rRCTs is inconsistent. The purpose of this systematic review is to explore the conduct of rRCTs using a patient registry to facilitate trial recruitment and the collection of outcome data, and to discuss the advantages and challenges of rRCTs.

Methods

A systematic search of the literature was conducted using five databases from inception to June 2020: PubMed, Embase (through Ovid), CINAHL, Scopus and the Cochrane Controlled Register of Trials (CENTRAL). The search strategy comprised of MESH terms and key words related to rRCTs. Study selection was performed independently by two reviewers. A risk of bias for each study was completed. A narrative synthesis was conducted.

Results

A total 47,862 titles were screened and 24 rRCTs were included. Eleven rRCTs (45.8%) used more than one registry to facilitate trial conduct. Six rRCTs (25%) randomised participants via a specific randomisation module embedded within a registry. Recruitment ranged between 209 to 106,000 participants. Advantages of rRCTs are recruitment efficiency, shorter trial times, cost effectiveness, outcome data completeness, smaller carbon footprint, lower participant burden and the ability to conduct multiple trials from the same registry. Challenges are data collection/management, quality assurance issues and the timing of informed consent.

Conclusions

Optimising the design of rRCTs is dependent on the capabilities of the registry. New registries should be designed and existing registries reviewed to enable the conduct of rRCTs. At all times, data management and quality assurance of all registry data should be given key consideration. We suggest the inclusion of the term ‘registry-based’ in the title of all rRCT manuscripts and a clear simple breakdown of the registry-based conduct of the trial in the abstract to facilitate indexing in the major databases.

Peer Review reports

Background

Randomised controlled trials (RCT) remain the gold standard within clinical research for testing the efficacy of new treatments and improving clinical care [1]. However, RCTs are a complex and costly undertaking, often limited by the difficulty in identifying participants, in efficiently randomising them and in maximising their follow-up [2]. The last decade has seen the development of a variation to the traditional RCT design, in the form of registry-based randomised controlled trials (rRCTs) [3,4,5]. rRCTs are described as trials with a high level of pragmatism utilising patient data embedded in large-scale registries to facilitate a range of clinical trial procedures including, recruitment, randomisation and collection of outcome data [6, 7]. The advantages of rRCTs are potentially substantial and include cost-effectiveness, trial efficiency, a simplified approach to participant enrolment and high participant follow-up rates [6, 8].

Variations to the traditional RCT design have been explored and include ‘Randomised Database Studies’ [9] (the use of both observational methods (routine clinical practice) and experimental methods in addition to the application of randomisation to the data systematically collected in clinical practice), ‘Point of Care Trials’ [10] (an operational approach to conducting clinical trials that integrates clinical research and routine care delivery making trial more accessible to broader and more diverse populations) and ‘Trials within Cohorts’ (TwiCs) [11] (a single cohort infrastructure which enables participants to be identified and outcomes obtained for multiple trials). Registry-based RCTs combine the strengths of these trial methodologies, e.g. access to larger more diverse groups of trial participants, collection of data needed for the trial as part of routine clinical practice; however, the application of registries within rRCTs is yet to be standardised. Mathes et al. [12] examined the features of rRCTs and concluded that there was a need for a checklist to ensure comprehensive reporting for rRCTs. The 2021 published CONSORT extension for the reporting of randomised controlled trials conducted using cohorts and routinely collected data (CONSORT-ROUTINE) has provided this much needed clarity for the reporting of RCTs using a registry [13]. A later study by Karanatsios et al. [14] cited a need to establish universally accepted criteria for the classification of rRCTs. This arises because the application of registries within rRCTs remains inconsistent. For some, the registry is used for just one purpose, perhaps identifying an outcome [15] or the identification of potential participants [16]. For others, the registry has multiple uses and facilitates a combination of trial processes including, participant recruitment, outcome data collection, and in some cases randomisation [3, 17, 18]. A possible definition for rRCTs has been described by Li et al., whereby the registry is used as a platform for participant recruitment and data collection including the acquisition of outcome/endpoint data [7].

Though there is considerable variation on what constitutes a registry [19], for the purposes of our review, we are including trials utilising a patient registry defined as ‘an organized system that uses observational study methods to collect data (clinical and other) to evaluate specified outcomes for a population defined by a particular disease, condition, or exposure, and that serves one or more predetermined scientific, clinical, or policy purposes’ [20]. The purpose of this review is to explore the conduct of rRCTs using a patient registry to facilitate trial recruitment and the collection of outcome data and to discuss the advantages and challenges. This will assist those considering conducting rRCTs embedded within a patient registry to design and implement trials that are efficient, cost-effective, considerate of the environment and useful.

Methods

Search strategy

An electronic search of the literature was conducted using the following databases from inception to June 2020: PubMed, Embase (through Ovid), CINAHL, Scopus and the Cochrane Controlled Register of Trials (CENTRAL). A combination of the following MESH terms and key words were used: randomised OR randomized OR randomised controlled trial OR randomized controlled trial (MESH) OR RCT OR ‘randomized clinical trial’ OR pragmatic trial OR randomized database trial OR randomized registry trial OR ‘database study’ AND Registry (MESH) OR ‘registry based’ OR registry based OR register based OR ‘registry trial’ OR rRCT OR register. Search terms were adapted for each database, with English language articles included and no other filters applied. A list of the search strategies for each database is provided in Supplementary file 1. The reference lists of included studies were searched by backward reference and forward citation searching.

Inclusion and exclusion criteria

Inclusion:

  • rRCTs utilising a patient registry to facilitate recruitment of participants and at least one outcome measure.

  • rRCTs including randomisation at individual or cluster level.

Exclusion:

  • Non-randomised or quasi randomised trials.

  • rRCT with a published protocol paper but no associated trial paper.

Study screening and selection

Trials were exported from EndNote X7 to Rayyan QCRI software [21] for title and abstract screening. All titles were reviewed for eligibility by NOS. In the case where uncertainty arose regarding the relevance of a title, abstract screening was conducted independently by two reviewers (NOS and FS). Both NOS and FS then independently screened the full texts of studies considered to be eligible for inclusion. Disagreement was met through consensus with a third reviewer (JE) as required.

Data extraction and management

Data were extracted on the following: trial title, author and year, disease under investigation, total enrolled, registry name, registry information, role of registry within trial and overall risk of bias. Data extraction was completed by NOS and a double extraction of 10% of the total sample results was completed by EM Trial authors were contacted where additional information or clarification was required.

Assessment for risk of bias

Two reviewers (NOS and EM) independently assessed the risk of bias for each included rRCT using the Cochrane Collaboration’s tool for assessing risk of bias [22]. The risk of bias tool covers six domains of bias: selection bias, performance bias, detection bias, attrition bias, reporting bias and other bias. Following the guidelines for the use of the risk of bias tool, a judgement is made on each domain for each trial. In any case of disagreement, consensus was reached with a third reviewer (FS). Justifications for all risk of bias judgements are also presented.

Data synthesis

An analysis of the data was conducted based on the Guidance on the Conduct of Narrative Synthesis in Systematic Reviews [23]. Narrative synthesis is a method used in systematic reviews to combine findings from various studies, primarily utilising words and text to summarise and interpret the results. We summarised the general characteristics of each trial and all registry-linked trial activities including recruitment, outcome measurements, randomisation, data collection, quality assurance, cost-effectiveness, study interventions and informed consent.

This systematic review adheres to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) standardised reporting guidelines to ensure the standardised conduct and reporting of the research [24]. A PRISMA checklist is provided in supplementary file 2.

Results

Study selection

A total of 130,562 studies were identified and exported to Rayyan QCRI [21]. A search for duplicate studies in EndNote X7 removed 42,876 studies and a second duplicate search in Rayyan QCRI resulted in the removal of an additional 39,824 studies. A total of 47,862 titles were screened for relevance and 193 titles remained for abstract review. Of these, 129 texts underwent full review. An additional ten trials were located from hand searching references. After full text review, a total of 24 trials met the inclusion criteria and were included in the narrative synthesis. The search selection process is detailed in the PRISMA flow diagram (Fig. 1).

Fig. 1
figure 1

 PRISMA flow diagram of the screening process

Full size image

Overview of rRCTs

The characteristics of the rRCTs and their registry-linked activities are presented in Table 1. Publications ranged from 1996 to 2020. The largest number of rRCTs took place in the USA (n = 9) followed by the Nordic countries (n = 7), Australia (n = 2) and the UK (n = 2). The remaining rRCTs (n = 4) were multiregional. Interventions consisted of drug treatments (n = 3) [25,26,27], surgical procedures (n = 2) [8, 28], non-surgical procedures (n = 1) [29], disease management (n = 3) [30,31,32], immunisation reminder/recall notices (n = 7) [33,34,35,36,37,38,39], screening for cancer programmes (n = 6) [40,41,42,43,44,45], methods to improve research participation (n = 1) [46] and smoking cessation (n = 1) [47]. For five rRCTs (20.8%), the interventions were delivered in a hospital-based setting [8, 25, 27, 28, 48]. Most trials were randomised at the level of the individual participant (n = 22) and two (8.3%) were cluster randomised [27, 32]. Recruitment ranged from 209 [30] to 106,000 [43] participants. Eleven rRCTs (45.8%) used more than one registry to facilitate trial procedures [8, 25,26,27,28,29, 40, 42,43,44,45].

Table 1 rRCT characteristics
Full size table

Registry-linked recruitment

Nine rRCTs (37.5%) near accomplished or surpassed their recruitment goals [8, 27, 28, 31, 32, 41, 42, 47, 48]. Recruitment with the goal of capturing the largest number of eligible participants available within a registry was present in eight trials (33.3%) [30, 33,34,35,36,37,38, 40]. Eighteen rRCTs (75%) used registries to identify potential participants for inclusion in a trial [27, 30,31,32,33,34,35,36,37,38,39,40,41,42, 44,45,46]. This included one multicentre rRCT using multiple registries to facilitate participant identification [27].

Registry-linked randomisation

Six rRCTs (25%) randomised participants via a specific randomisation module embedded within the registry [8, 25, 28, 29, 35, 47]. The remaining 18 used randomisation methods external to the registry. Thirteen rRCTs (54.2%) allocated the participants in a 1:1 ratio [8, 25, 27, 28, 31,32,33,34, 38,39,40, 46, 48], for six (25%) the randomisation ratios varied [30, 35, 37, 41, 42, 47] and the remaining five rRCTs (20.8%) did not specify the randomisation ratio [26, 36, 43,44,45].

Registry-linked outcomes

Twenty-three rRCTs (95.3%) utilised a registry to gather primary/main outcome data. Vaccination rates accounted for 29.2% (n = 7) of primary outcome measurements [33,34,35,36,37,38,39]. Mortality as a primary outcome was recorded for eight rRCTs (33.3%) [8, 25,26,27,28, 40, 42, 48]. Five rRCTs (20.8%) utilized more than one registry to facilitate the acquisition of primary/main outcome measurements [25, 27, 28, 40, 42]. Four rRCTs (25%) utilized the SWEDEHEART Registry in conjunction with pre-existing national healthcare registries to gather outcome/endpoint data [8, 25, 28, 48]. One trial did not include the specifics of linking to a registry; however, evidence from the paper suggests there was record linkage with a nationwide registry [44]. In terms of long-term outcomes, rRCTs gathered data at time points between 5 [26] and 15 years [40].

Registry-linked trial specific data collection

Seven rRCTs (29.2%) used a registry to facilitate trial specific data collection in addition to outcome data [8, 25, 27, 28, 30, 46, 48]. One rRCT requested permission to use data collected until the point of participant ‘opt out’, following intervention [27], and one rRCT continued to collect de-identified data from the registry for ‘non-consenters’ [46].

Quality assurance

Sixteen rRCTs (66.7%) provided commentary on the quality assurance of registry data [8, 25, 28, 31,32,33,34,35,36,37,38,39, 41, 44, 45, 48]. Four rRCTs included links to materials which detailed the monitoring of the registry data used in their trials [31, 32, 41, 44]. In two rRCTs (13.3%), investigators assessed the validity of the registry data by comparing the registry data with medical records [35, 39]. Three rRCTs included results of quality assessment evaluations of the registry [36, 38, 45]. The final three rRCTs emphasised the need for improved registry-based quality assurance, following completion of their trials [33, 34, 37]. However, it is not clear if these trials completed study-specific quality assurance checks of the registry data throughout the duration of the trials.

Registry-linked cost-effectiveness

Just three (12.5%) rRCTs conducted cost-effectiveness assessments [32, 33, 37]. Two trials examined the costs associated with generating reminder/recall notices for infants due/requiring a vaccine [33, 37] and one trial examined the costs associated with the enhancement of an existing UK-based diabetes register [32]. The enhancement of the diabetes registry was a significant initial cost: a total one-off cost of initiating the system across two register areas of UK£27,885 with an additional cost of running the system for the two registers of UK£11,170. The two reminder/recall cost-effectiveness assessments were focused on the effectiveness of these interventions to increase uptake of the vaccine (results showed it was age-dependant), rather than the cost-effectiveness of the use of the registry to conduct the trial.

Registry-linked interventions

For nine rRCTs (35.5%), a registry was used by researchers to facilitate either the development or delivery of trial interventions to participants [31, 33,34,35,36,37,38, 41, 47]. These were four (44.4%) immunisation reminder/recall trials whereby a registry generated the reminder/recall interventions [33,34,35,36]; one (11.1%) additional immunisation reminder/recall trial where researchers determined the requirement for an additional immunisation reminder based on a participants immunisation status in the registry [38]; one (11.1%) cancer screening trial where the intervention group were contacted prior to receiving an intervention kit, and given the opportunity to either cancel the intervention or update their personal registry information, thus amending their eligibility in the trial [41]; one (11.1%) smoking cessation trial in which participants received an allocated intervention when they logged onto the registry [47]; and for two trials (22.2%), the precise details of how the registry facilitated the application of the intervention were not discussed [31, 37].

Informed consent

Of the 24 rRCTs, 7 (29.2%) sought informed consent prior to randomisation [8, 25, 26, 28, 30, 31, 48] and 2 (8.3%) completed randomisation before consent [46, 47]. For two trials (8.3%), the ethical approvals differed by jurisdiction, with some granting a waiver of consent and others requiring an opt out approach [27, 32]. Five trials (20.8%) randomised participants to screening or control groups without informed consent [40, 42,43,44,45]; however, three trials subsequently requested consent from the screening cohort [40, 42, 44]. It was not specified if informed consent was required or sought for the remaining two (8.3%) rRCTs [43, 45]. Six additional rRCTs (25%) randomised minors without acquiring parental consent [33, 34, 36,37,38,39]. Parents were subsequently contacted following randomisation in relation to their child’s vaccination status, but it is not stated if consent was then required. Two trials were granted waiver/exemption status [35, 41].

Risk of bias

Risk of bias assessments and the reasons for the judgements for the overall risk of bias result for the 24 rRCTs are available in supplementary file 3. Overall, the authors judged 5 trials (20.8%) to have a high risk of bias, 17 trials (70.8%) to have an unclear risk of bias and 2 trials (8.3%) to have a low risk of bias. The judgement for all high risk of bias trials was consistently due to performance bias (blinding of participants and personnel domain) and detection bias (blinding of outcome assessment domain). Additional to a high risk of both performance and detection bias, Young et al. [27] had a high-risk judgement for selection bias (allocation concealment domain).

Discussion

Our systematic review included 24 rRCTs that utilised a patient registry to facilitate both the participant recruitment process and the collection of outcome data. We found that the interpretation of a registry was diverse. This is reflected in the variation of how investigators used registries, and in their reporting (Table 1). We find the advantages of rRCTs are recruitment efficiency, shorter trial times, cost effectiveness, outcome data completeness, smaller carbon footprint, lower participant burden and ability to conduct multiple trials from the same registry. Challenges are data collection/management, quality assurance issues and the timing of informed consent.

A minority of trials (n = 4) utilised a registry to enable the majority of key trial processes; recruitment, randomisation, trial specific data collection and the collection of trial outcomes/end points [8, 25, 28, 48]. These trials surpassed their sample size requirements, had almost complete follow-up, reported minimal missing data and were performed at a relatively low cost. All were conducted in the SWEDEHEART registry [49]. SWEDEHEART has many advantages as it was designed to facilitate the conduct of clinical research and clinical trials. SWEDEHEART is continuously monitored for data quality and education and training for users of the registry is provided [50]. It is a good exemplar of quality assurance systems in rRCTs. However, validation of the population registries used to collect additional outcome data in conjunction with SWEDEHEART is not discussed and warrants further attention to comply with the SWEDEHEART quality assurance standards.

Many rRCTs surpassed their sample size requirements [8, 25, 27, 28, 40, 42, 47, 48]. Whilst it is widely documented that a considerable proportion of RCTs fail due to recruitment issues [51, 52], rRCTs do not have the same issue and allow for a more efficient recruitment process. One issue that has not been resolved is that of informed consent when conducting rRCTs and our results show this is variable, with some waiving consent, and others taking consent either before or after randomisation.

The collection of trial data can consume vast proportions of trial resources and significantly increase trial costs [53] as well as increase the carbon footprint [54]. Utilising a web-based approach to capture trial data within a registry can significantly reduce trial costs and minimise a trial’s carbon footprint [54] and preserve the environment for future generations.

There are interesting lessons to be learned from colleagues who have repeatedly and successfully conducted rRCTs. For example, Bohlin et al. [47] used the GynOp register in a near identical fashion to their Swedish colleagues in SWEDEHEART and reported similar efficiency results in terms of high recruitment rates, minimal missing data and low costs [47]. These rRCTs investigated wholly different conditions, but by applying almost identical registry-based methodology, successfully combined high recruitment with low cost. Whilst authors cite the low costs, a cost-effectiveness study off rRCTs compared to a traditional RCT is not included in the cost-effectiveness examples given in this study. There are initial set-up costs which are considerable, as per the example of the diabetes registry given in the section, " Registry-linked cost-effectiveness" [32]. We speculate that the suitability and cost-effectiveness of registries for conducting trials will vary, with the most suitable and cost-effective being those established with the intention to embed clinical trials. Trials from the GynOp and SWEDEHEART registries are prime examples of the potential of rRCTs, when using established registries for the majority, or all, key trial procedures. It is also possible for rRCTs to facilitate the development and delivery of a range of trial interventions [31, 33,34,35,36,37,38, 41, 47]. The diverse use of registries within trials is a clear strength of registry-based methodology.

The ability to complete randomisation blinded within a registry is unique and worth noting. Six rRCTs in our study had a randomisation module embedded within the registry [8, 25, 28, 35, 47, 48]. Randomisation is the only definitive technique to control for confounding factors within trial groups [6]. The benefits of having an embedded randomisation module within a registry include an automated, effective enrolment process with a minimally selected cohort of patients [6, 55]. We reviewed some protocols and note that the inclusion of an embedded randomisation module is becoming more frequent [17, 56,57,58]. It is particularly useful when randomisation is time sensitive.

Outcome data collection was the most common trial procedure facilitated by a registry. The collection of certain outcomes, e.g. mortality, can be gathered consistently across various types of registries [59]. The advantages of gathering trial outcome data via a registry include a significant reduction in trial costs [1, 60], minimisation of study visits facilitating a lower participant burden, the potential to capture almost all trial follow-up data which reduces staff burden [7] and a reduced carbon footprint for the trial. In one trial, long-term follow-up data was retrieved from a registry 15 years later [40]. The burden of obtaining long-term participant data within RCTs include both logistical and financial constraints [61]. Provided researchers are confident in the quality of the data they are collecting, the use of registries can be advocated for the collection of long-term outcome data.

Concerns have been raised about the quality and completeness of registry data [7, 62] and this remains a significant challenge for rRCTs. Trials support decisions through the data they collect. Even for traditional RCTs, the quality of the data is key to ensuring the trial supports better and more informed decisions and meets its aim. If we cannot trust the data, the trial has failed. Errors in the data collection process not only affect the safety of the patients in the trial through the introduction of bias but also affect the safety of future patients. rRCTs pose a unique challenge because in many cases, registries are not designed with trial conduct in mind. Thus, the trial can be limited to collecting the outcome data as presented in the registry, regardless of its completeness or suitability. Data may also be missing, or the data entry might occur long after the data collection; hence, it may not suit the trial timeline. Across registries, terminology may not be consistent. Key to advancing rRCT conduct will be standardising data collection across registries to follow international health data terminology standards and definitions, and improving data linkage. This will enhance analytical capabilities, making clinical trials more cost-effective and improving the comprehensiveness of post-market surveillance for devices and medicines. We found a large variation in the reporting of quality assurance of the registry data used in rRCTs. Only 16 discussed validation of registry data and 3 of those expressed the need for additional validation of registry data, following completion of their trials. We recommend that new trials that include data from registries implement rigorous quality assurance systems at the trial design stage.

For many trials (70.8%), the overall risk of bias judgement was unclear as there was insufficient information provided to state, with certainty, if a trial was at a high or low risk of bias. rRCTs replicate real life, given that participants are only told about an intervention when they are going to receive it and not if they are not to receive it. In this respect, they are considered pragmatic. However, it is also argued that rRCTs generate an artificial environment, given that they allow for longer follow-up periods than traditional RCTs which arguably affects the external validity [63]. The discussion on bias in rRCTs is limited in the literature. Whilst the completeness of the data in rRCTs can reduce attrition bias, the risk of residual bias when trying to understand causation is high. We suggest bias in rRCTs is under researched and should be considered by methodologists and statisticians and an appropriate guidance/manuscript document developed.

Another matter requiring discussion is the ethics on the timing and conditions of informed consent. We found this was variable between rRCTs and dependent on the ethical approval conditions. Some rRCTs opted for the ‘Zelen design’ approach [64], randomising participants prior to consent [40, 42, 44, 46, 47]. Others took oral consent, randomised the participants and then followed up with written consent. For many trials, it was not clear when consent was obtained [33, 34, 36,37,38,39, 43, 45]. In some circumstances, a waiver of consent was granted [27, 35, 41]. A review of the ethical issues of informed consent in rRCTs is warranted.

The nomenclature used to describe rRCTs is inconsistent and is a significant barrier to their use in the long-term. It creates difficulties for systematic reviews and meta-analyses, as we have found here. Many rRCTs did not integrate the term ‘registry-based’ in their title; however, some did incorporate the terminology within their protocol publication [8, 27, 28]. rRCTs can currently be divided into two groups: trials that are deeply embedded in registries and utilise the registry to facilitate most, if not all, key trial processes, e.g. recruitment, randomisation, outcome data collection; and trials that simply utilise a registry to facilitate one specific function, e.g. outcome data collection. However, where the use of a registry is limited to a singular function; it is questionable if these trials should be classified as rRCTs. Given the variability, there remains an urgent need for consensus on a definition for an rRCT. RCTs are intervention studies and are so-called because the investigator intervenes. In our view, investigators in rRCTs can only intervene in the allocation and the timing of the intervention. They do not have control over the outcome data (but can select the outcome based on the data available in the registry). This might be a useful start to thinking about defining rRCTs.

Strengths and limitations

This study is a comprehensive systematic review and includes a risk of bias assessment for each of the included trials. During the data extraction process, it was often necessary to expand our search to protocol papers or registry citations to comprehensively extract and understand the classification of registry use. We found that the reporting of how a registry was used was limited and variable from study to study. This also means that we have potentially missed some studies for inclusion in our review, but we have no means of identifying that. We chose to limit our inclusion to registry-based studies that included both recruitment of participants and outcome collection, as we are interested in furthering the literature on rRCTs of this nature, which we believe offer significant advantages to facilitating the conduct of trials as part of routine clinical care. We acknowledge that we have thus missed out on some studies that used a registry for recruitment only, or used a registry for outcome collection only, but these would not contribute to the purpose of our systematic review.

Conclusion

The results of this study highlight the fact that design of rRCTs is bespoke and dependent on the capabilities of the registry. Even within the rRCTs, we have also established the variability evident in many of the processes: ethics and consent, randomisation, data collection, outcome data and trial reporting. The advantages to rRCTs include recruitment efficiency and shorter trial times, cost-effectiveness, outcome data completeness, a smaller carbon footprint, lower participant burden and the ability to conduct multiple trials using the same registry. The challenges to rRCTs are data collection and management, limitation of outcome measures, quality assurance issues and the timing and ethics of informed consent.

The cornerstone of any functioning health care system is quality research. The quality of the data collection is key to ensuring the trial supports better and more informed decisions and meets its aim. If we cannot trust the data, the trial has failed. We welcome the CONSORT extension for the reporting of randomised controlled trials conducted using cohorts and routinely collected data [13]. This will be crucial to allow trialists to clearly think about the outcomes at the design phase. We suggest the inclusion of the term ‘registry-based’ in the trial title of all RCTs utilising a registry and the clear and simple breakdown of the registry-based conduct of the trial in the abstract to allow indexing in the major databases. The issue of bias in rRCTs is under researched and reported and discussion of this in the literature would be welcomed as a matter of priority. Researchers should endeavour to maximise the use of a registry where feasible; however, it is critical that the quality assurance of all registry data is given key consideration at the trial design stage.

Availability of data and materials

All data generated or analysed during this study are included in this published article [and its supplementary information files].

References

  1. Yndigegn T, Hofmann R, Jernberg T, Gale CP. Registry-based randomised clinical trial: efficient evaluation of generic pharmacotherapies in the contemporary era. Heart (British Cardiac Society). 2018;104(19):1562–7.

    PubMed  Google Scholar 

  2. Bergqvist D, Björck M, Säwe J, Troëng T. Randomized trials or population-based registries. Eur J Vasc Endovasc Surg. 2007;34(3):253–6.

    Article  CAS  PubMed  Google Scholar 

  3. Asberg S, Hijazi Z, Norrving B, Terent A, Ohagen P, Oldgren J. Timing of oral anticoagulant therapy in acute ischemic stroke with atrial fibrillation: study protocol for a registry-based randomised controlled trial. Trials. 2017;18(1):581.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Ragnarsson S, Janiec M, Modrau IS, Dreifaldt M, Ericsson A, Holmgren A, et al. No-touch saphenous vein grafts in coronary artery surgery (SWEDEGRAFT): rationale and design of a multicenter, prospective, registry-based randomised clinical trial. Am Heart J. 2020;224:17–24.

    Article  PubMed  Google Scholar 

  5. Frobert O, Lagerqvist B, Gudnason T, Thuesen L, Svensson R, Olivecrona GK, et al. Thrombus Aspiration in ST-Elevation myocardial infarction in Scandinavia (TASTE trial). A multicenter, prospective, randomised, controlled clinical registry trial based on the Swedish angiography and angioplasty registry (SCAAR) platform. Study design and rationale. Am Heart J. 2010;160(6):1042–8.

    Article  PubMed  Google Scholar 

  6. James S, Rao SV, Granger CB. Registry-based randomised clinical trials–a new clinical trial paradigm. Nat Rev Cardiol. 2015;12(5):312–6.

    Article  PubMed  Google Scholar 

  7. Li G, Sajobi TT, Menon BK, Korngut L, Lowerison M, James M, et al. Registry-based randomised controlled trials- what are the advantages, challenges, and areas for future research? J Clin Epidemiol. 2016;80:16–24.

    Article  PubMed  Google Scholar 

  8. Fröbert O, Lagerqvist B, Olivecrona GK, Omerovic E, Gudnason T, Maeng M, et al. Thrombus aspiration during ST-segment elevation myocardial infarction. N Engl J Med. 2013;369(17):1587–97.

    Article  PubMed  Google Scholar 

  9. Sacristán JA, Soto J, Galende I, Hylan TR. Randomized database studies: a new method to assess drugs’ effectiveness? J Clin Epidemiol. 1998;51(9):713–5.

    PubMed  Google Scholar 

  10. van Staa TP, Dyson L, McCann G, Padmanabhan S, Belatri R, Goldacre B, et al. The opportunities and challenges of pragmatic point-of-care randomised trials using routinely collected electronic records: evaluations of two exemplar trials. Health Technol Assess. 2014;18(43):1–146.

    PubMed  PubMed Central  Google Scholar 

  11. Bibby AC, Torgerson DJ, Leach S, Lewis-White H, Maskell NA. Commentary: considerations for using the “Trials within Cohorts” design in a clinical trial of an investigational medicinal product. Trials. 2018;19(1):18.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Mathes T, Buehn S, Prengel P, Pieper D. Registry-based randomised controlled trials merged the strength of randomised controlled trails and observational studies and give rise to more pragmatic trials. J Clin Epidemiol. 2018;93:120–7.

    Article  PubMed  Google Scholar 

  13. Kwakkenbos L, Imran M, McCall SJ, McCord KA, Fröbert O, Hemkens LG, et al. CONSORT extension for the reporting of randomised controlled trials conducted using cohorts and routinely collected data (CONSORT-ROUTINE): checklist with explanation and elaboration. BMJ. 2021;373:n857.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Karanatsios B, Prang KH, Verbunt E, Yeung JM, Kelaher M, Gibbs P. Defining key design elements of registry-based randomised controlled trials: a scoping review. Trials. 2020;21(1):552.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Christiansen EH, Jensen LO, Thayssen P, Tilsted HH, Krusell LR, Hansen KN, et al. Biolimus-eluting biodegradable polymer-coated stent versus durable polymer-coated sirolimus-eluting stent in unselected patients receiving percutaneous coronary intervention (SORT OUT V): a randomised non- inferiority trial. Lancet. 2013;381(9867):661–9.

    Article  CAS  PubMed  Google Scholar 

  16. Katapodi MC, Northouse LL, Schafenacker AM, Duquette D, Duffy SA, Ronis DL, et al. Using a state cancer registry to recruit young breast cancer survivors and high-risk relatives: protocol of a randomised trial testing the efficacy of a targeted versus a tailored intervention to increase breast cancer screening. BMC Cancer. 2013;13:97.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Sundh J, Bornefalk-Hermansson A, Ahmadi Z, Blomberg A, Janson C, Currow DC, et al. REgistry-based randomised controlled trial of treatment and Duration and mortality in long-term OXygen therapy (REDOX) study protocol. BMC Pulm Med. 2019;19(1):50.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Idahl A, Darelius A, Sundfeldt K, Pålsson M, Strandell A. Hysterectomy and opportunistic salpingectomy (HOPPSA): study protocol for a register-based randomised controlled trial. Trials. 2019;20(1):10.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Drolet BC, Johnson KB. Categorizing the world of registries. J Biomed Inform. 2008;41(6):1009–20.

    Article  PubMed  Google Scholar 

  20. Gliklich RE, Dreyer NA, Leavy MB. Registries for evaluating patient outcomes: a user’s guide. 2014.

  21. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic reviews. A product from the ESRC methods programme Version. 2006;1:b92.

    Google Scholar 

  24. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Erlinge D, Omerovic E, Frobert O, Linder R, Danielewicz M, Hamid M, et al. Bivalirudin versus heparin monotherapy in myocardial infarction. N Engl J Med. 2017;377(12):1132–42.

    Article  CAS  PubMed  Google Scholar 

  26. Trivedi DP, Doll R, Khaw KT. Effect of four monthly oral vitamin D3 (cholecalciferol) supplementation on fractures and mortality in men and women living in the community: randomised double blind controlled trial. BMJ. 2003;326(7387):469.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Young PJ, Bagshaw SM, Forbes AB, Nichol AD, Wright SE, Bailey M, et al. Effect of stress ulcer prophylaxis with proton pump inhibitors vs histamine-2 receptor blockers on in-hospital mortality among ICU patients receiving invasive mechanical ventilation: the PEPTIC randomized clinical trial. JAMA. 2020;323(7):616–26.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Götberg M, Christiansen EH, Gudmundsdottir IJ, Sandhall L, Danielewicz M, Jakobsen L, et al. Instantaneous wave-free ratio versus fractional flow reserve to guide PCI. N Engl J Med. 2017;376(19):1813–23.

    Article  PubMed  Google Scholar 

  29. Hofmann R, Svensson L, James SK. Oxygen therapy in suspected acute myocardial infarction. N Engl J Med. 2018;378(2):201–2.

    PubMed  Google Scholar 

  30. Navaneethan SD, Jolly SE, Schold JD, Arrigain S, Nakhoul G, Konig V, et al. Pragmatic randomized, controlled trial of patient navigators and enhanced personal health records in CKD. Clinical journal of the American Society of Nephrology : CJASN. 2017;12(9):1418–27.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Chamany S, Walker EA, Schechter CB, Gonzalez JS, Davis NJ, Ortega FM, et al. Telephone intervention to improve diabetes control: a randomized trial in the New York City A1c registry. Am J Prev Med. 2015;49(6):832–41.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Eccles MP, Whitty PM, Speed C, Steen IN, Vanoli A, Hawthorne GC, et al. A pragmatic cluster randomised controlled trial of a Diabetes REcall And Management system: the DREAM trial. Implement Sci. 2007;2:6.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Dombkowski KJ, Costello LE, Harrington LB, Dong S, Kolasa M, Clark SJ. Age-specific strategies for immunization reminders and recalls: a registry-based randomised trial. Am J Prev Med. 2014;47(1):1–8.

    Article  PubMed  Google Scholar 

  34. Dombkowski KJ, Harrington LB, Dong S, Clark SJ. Seasonal influenza vaccination reminders for children with high-risk conditions: a registry-based randomised trial. Am J Prev Med. 2012;42(1):71–5.

    Article  PubMed  Google Scholar 

  35. Irigoyen MM, Findley S, Wang D, Chen S, Chimkin F, Pena O, et al. Challenges and successes of immunization registry reminders at inner-city practices. Ambul Pediatr. 2006;6(2):100–4.

    Article  PubMed  Google Scholar 

  36. Kempe A, Daley MF, Barrow J, Allred N, Hester N, Beaty BL, et al. Implementation of universal influenza immunization recommendations for healthy young children: results of a randomised, controlled trial with registry-based recall. Pediatrics. 2005;115(1):146–54.

    Article  PubMed  Google Scholar 

  37. LeBaron CW, Starnes DM, Rask KJ. The impact of reminder-recall interventions on low vaccination coverage in an inner-city population. Arch Pediatr Adolesc Med. 2004;158(3):255–61.

    Article  PubMed  Google Scholar 

  38. Daley MF, Barrow J, Pearson K, Crane LA, Gao D, Stevenson JM, et al. Identification and recall of children with chronic medical conditions for influenza vaccination. Pediatrics. 2004;113(1 Pt 1):e26-33.

    Article  PubMed  Google Scholar 

  39. Daley MF, Steiner JF, Brayden RM, Xu S, Morrison S, Kempe A. Immunization registry-based recall for a new vaccine. Ambul Pediatr. 2002;2(6):438–43.

    Article  PubMed  Google Scholar 

  40. Holme Ø, Løberg M, Kalager M, Bretthauer M, Hernán MA, Aas E, et al. Long-term effectiveness of sigmoidoscopy screening on colorectal cancer incidence and mortality in women and men: a randomized trial. Ann Intern Med. 2018;168(11):775–82.

    Article  PubMed  Google Scholar 

  41. Sultana F, English DR, Simpson JA, Drennan KT, Mullins R, Brotherton JM, et al. Home-based HPV self-sampling improves participation by never-screened and under-screened women: results from a large randomised trial (iPap) in Australia. Int J Cancer. 2016;139(2):281–90.

    Article  CAS  PubMed  Google Scholar 

  42. Bretthauer M, Kaminski MF, Løberg M, Zauber AG, Regula J, Kuipers EJ, et al. Population-based colonoscopy screening for colorectal cancer: a randomized clinical trial. JAMA Intern Med. 2016;176(7):894–902.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Malila N, Oivanen T, Malminiemi O, Hakama M. Test, episode, and programme sensitivities of screening for colorectal cancer as a public health policy in Finland: experimental design. BMJ. 2008;337:a2261.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Auvinen A, Tammela T, Stenman UH, Uusi-Erkkilä I, Leinonen J, Schröder FH, et al. Screening for prostate cancer using serum prostate-specific antigen: a randomised, population-based pilot study in Finland. Br J Cancer. 1996;74(4):568–72.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Thiis-Evensen E, Hoff GS, Sauar J, Langmark F, Majak BM, Vatn MH. Population-based surveillance by colonoscopy: effect on the incidence of colorectal cancer. Telemark Polyp Study I. Scand J Gastroenterol. 1999;34(4):414–20.

    Article  CAS  PubMed  Google Scholar 

  46. Hall AE, Sanson-Fisher RW, Lynagh MC, Threlfall T, D’Este CA. Format and readability of an enhanced invitation letter did not affect participation rates in a cancer registry-based study: a randomised controlled trial. J Clin Epidemiol. 2013;66(1):85–94.

    Article  PubMed  Google Scholar 

  47. Bohlin KS, Löfgren M, Lindkvist H, Milsom I. Smoking cessation prior to gynecological surgery-a registry-based randomised trial. Acta Obstet Gynecol Scand. 2020;99(9):1230–7.

    Article  PubMed  Google Scholar 

  48. Hofmann R, James SK, Jernberg T, Lindahl B, Erlinge D, Witt N, et al. Oxygen therapy in suspected acute myocardial infarction. N Engl J Med. 2017;377(13):1240–9.

    Article  CAS  PubMed  Google Scholar 

  49. Jernberg T, Attebring MF, Hambraeus K, Ivert T, James S, Jeppsson A, et al. The Swedish Web-system for enhancement and development of evidence-based care in heart disease evaluated according to recommended therapies (SWEDEHEART). Heart. 2010;96(20):1617–21.

    Article  PubMed  Google Scholar 

  50. Hofmann R, James SK, Svensson L, Witt N, Frick M, Lindahl B, et al. Determination of the role of oxygen in suspected acute myocardial infarction trial. Am Heart J. 2014;167(3):322–8.

    Article  CAS  PubMed  Google Scholar 

  51. Walters SJ, Bonacho Dos Anjos Henriques-Cadby I, Bortolami O, Flight L, Hind D, Jacques RM, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme. BMJ Open. 2017;7(3):e015276.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Treweek S, Lockhart P, Pitkethly M, Cook JA, Kjeldstrøm M, Johansen M, et al. Methods to improve recruitment to randomised controlled trials: Cochrane systematic review and meta-analysis. BMJ Open. 2013;3(2).

  53. Crowley E, Treweek S, Banister K, Breeman S, Constable L, Cotton S, et al. Using systematic data categorisation to quantify the types of data collected in clinical trials: the DataCat project. Trials. 2020;21(1):535.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Adshead F, Al-Shahi Salman R, Aumonier S, Collins M, Hood K, McNamara C, et al. A strategy to reduce the carbon footprint of clinical trials. Lancet. 2021;398(10297):281–2.

    Article  CAS  PubMed  Google Scholar 

  55. James S, Fröbert O, Lagerqvist B. Cardiovascular registries: a novel platform for randomised clinical trials. Heart. 98. England2012. p. 1329–31.

  56. Idahl A, Darelius A, Sundfeldt K, Palsson M, Strandell A. Hysterectomy and opportunistic salpingectomy (HOPPSA): study protocol for a register-based randomised controlled trial. Trials. 2019;20(1):10.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Collins MG, Fahim MA, Pascoe EM, Dansie KB, Hawley CM, Clayton PA, et al. Study Protocol for Better Evidence for Selecting Transplant Fluids (BEST-Fluids): a pragmatic, registry-based, multi-center, double-blind, randomised controlled trial evaluating the effect of intravenous fluid therapy with Plasma-Lyte 148 versus 0.9% saline on delayed graft function in deceased donor kidney transplantation. Trials. 2020;21(1):428.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  58. Fröbert O, Götberg M, Angerås O, Jonasson L, Erlinge D, Engstrøm T, et al. Design and rationale for the Influenza vaccination After Myocardial Infarction (IAMI) trial. A registry-based randomised clinical trial. Am Heart J. 2017;189:94–102.

    Article  PubMed  Google Scholar 

  59. Gliklich RE, Leavy MB, Dreyer NA. Selecting and defining outcome measures for registries. Registries for Evaluating Patient Outcomes: A User’s Guide [Internet] 4th edition: Agency for Healthcare Research and Quality (US); 2020.

  60. Wachtell K, Lagerqvist B, Olivecrona GK, James SK, Fröbert O. Novel trial designs: lessons learned from thrombus aspiration during ST-Segment Elevation Myocardial Infarction in Scandinavia (TASTE) Trial. Curr Cardiol Rep. 2016;18(1):11.

    Article  PubMed  Google Scholar 

  61. Fitzpatrick T, Perrier L, Shakik S, Cairncross Z, Tricco AC, Lix L, et al. Assessment of long-term follow-up of randomized trial participants by linkage to routinely collected data: a scoping review and analysis. JAMA Netw Open. 2018;1(8):e186019.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Lauer MS, D’Agostino RB Sr. The randomised registry trial–the next disruptive technology in clinical research? N Engl J Med. 2013;369(17):1579–81.

    Article  CAS  PubMed  Google Scholar 

  63. Hemkens LG. How routinely collected data for randomized trials provide long-term randomized real-world evidence. JAMA Netw Open. 2018;1(8):e186014.

    Article  PubMed  Google Scholar 

  64. Torgerson DJ, Roland M. What is Zelen’s design? BMJ. 1998;316(7131):606.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We wish to acknowledge the support of the Health Research Board Trials Methodology Research Network (HRB TMRN) and Health Research Board Clinical Research Facility, University College Cork (HRB CRF-UCC).

Funding

This work was supported by the Health Research Board-Trials Methodology Research Network as part of the HRB-TMRN-2017–1 grant and by the Health Research Board Ireland CRFC-2021–005.

Author information

Authors and Affiliations

  1. Trials Research and Methodologies Unit, HRB Clinical Research Facility, University College Cork, 4th Floor Western Gateway Building, Western Road, Cork, Ireland

    Frances Shiely, Niamh O Shea & Ellen Murphy

  2. School of Public Health, University College Cork, 4th Floor Western Gateway Building, Western Road, Cork, Ireland

    Frances Shiely

  3. Health Research Board, Trials Methodology Research Network, University College Cork, Cork, Ireland

    Niamh O Shea & Ellen Murphy

  4. Department of Renal Medicine, Cork University Hospital, Cork, Ireland

    Joseph Eustace

Authors
  1. Frances Shiely
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Niamh O Shea
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ellen Murphy
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Joseph Eustace
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

NOS, FS and JE conceptualised the study. NOS drafted the study protocol, and FS and JE critically reviewed and approved. NOS conducted the search and conducted title screening. NOS and FS screened abstracts and full text for relevance. NOS and EM both conducted data extraction and risk of bias assessment for each included trial. NOS and FS drafted the manuscript. All authors contributed to data interpretation and FS and JE critically reviewed the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Frances Shiely.

Ethics declarations

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shiely, F., O Shea, N., Murphy, E. et al. Registry-based randomised controlled trials: conduct, advantages and challenges—a systematic review. Trials 25, 375 (2024). https://doi.org/10.1186/s13063-024-08209-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-024-08209-3

Keywords

Trials

ISSN: 1745-6215