- Study protocol
- Open Access
- Open Peer Review
Addressing challenges in tuberculosis adherence via performance-based payments for integrated case management: protocol for a cluster randomized controlled trial in Georgia
Trialsvolume 20, Article number: 536 (2019)
Tuberculosis is one of the greatest global health concerns and disease management is challenging particularly in low- and middle-income countries. Despite improvements in addressing this epidemic in Georgia, tuberculosis remains a significant public health concern due to sub-optimal patient management. Low remuneration for specialists, limited private-sector interest in provision of infectious disease care and incomplete integration in primary care are at the core of this problem.
This protocol sets out the methods of a two-arm cluster randomized control trial which aims to generate evidence on the effectiveness of a performance-based financing and integrated care intervention on tuberculosis loss to follow-up and treatment adherence.
The trial will be implemented in health facilities (clusters) under-performing in tuberculosis management. Eligible and consenting facilities will be randomly assigned to either intervention or control (standard care). Health providers within intervention sites will form a case management team and be trained in the delivery of integrated tuberculosis care; performance-related payments based on monthly records of patients adhering to treatment and quality of care assessments will be disbursed to health providers in these facilities.
The primary outcomes include loss to follow-up among adult pulmonary drug-sensitive and drug-resistant tuberculosis patients. Secondary outcomes are adherence to treatment among drug-sensitive and drug-resistant tuberculosis patients and treatment success among drug-sensitive tuberculosis patients. Data on socio-demographic characteristics, tuberculosis diagnosis and treatment regimen will also be collected. The required sample size to detect a 6% reduction in loss to follow-up among drug-sensitive tuberculosis patients and a 20% reduction in loss to follow-up among drug-resistant tuberculosis patients is 948 and 136 patients, respectively.
The trial contributes to a limited body of rigorous evidence and literature on the effectiveness of supply-side performance-based financing interventions on tuberculosis patient outcomes. Realist and health economic evaluations will be conducted in parallel with the trial, and associated composite findings will serve as a resource for the Georgian and wider regional Ministries of Health in relation to future tuberculosis and wider health policies.
The trial and complementing evaluations are part of Results4TB, a multidisciplinary collaboration engaging researchers and Georgian policy and practice stakeholders in the design and evaluation of a context-sensitive tuberculosis management intervention.
ISRCTN, ISRCTN14667607. Registered on 14 January 2019.
Tuberculosis (TB) is one of the greatest global public health challenges: in 2017 alone, 10 million people developed the disease, with over 1.5 million of these cases resulting in death . While technological and medical advances are increasingly assisting in disease detection  and treatment , TB management still presents substantial challenges, particularly in low- and middle-income countries (LMICs) . One of the targets of the Sustainable Development Goals for 2030 is to end the global TB epidemic. The 2014 World Health Organization (WHO) “End TB Strategy” calls for a 90% reduction in TB deaths and an 80% reduction in TB incidence over 2015–2030 . Countries must progress quickly to prevent, detect and treat TB if these targets are to be achieved.
Countries in Eastern Europe and Central Asia face particularly high burdens of TB, including multidrug-resistant TB (MDR-TB) . Increased drug resistance, low rates of case detection and treatment adherence, as well as system-level issues such as funding gaps and limited integration of TB services across provider types (public and private, secondary and primary care, and patient communities), all pose critical challenges for TB management . Contextually sensitive approaches are urgently needed to address such challenges and improve TB prevention, detection and treatment.
The current study focuses on Georgia, a country challenged by a particularly high TB burden. Latest estimates record TB incidence at 86 (range 72–101) per 100,000 persons, the largest proportion of which (80%) is made up of patients with pulmonary TB . The majority of patients with TB is comprised of patients with drug-susceptible TB (DS-TB; approximately 88.1%) ; in 2016, the estimated prevalence of rifampicin-resistant MDR-TB (MDR-RR-TB) was 11% among new patients with TB and 30% among previously treated patients .
In line with global averages, overall treatment success was estimated at 84% for both new and relapsed TB (2015 estimate). However, the rate fluctuates widely across regions of Georgia and reporting health facilities: for DS-TB, treatment success ranges from 46 to 100% (2015 estimates) ; and for MDR-RR-TB, estimates from 2015 place treatment success at 56% .
In both cases, low treatment success is attributed to weaknesses in patient management , which result in poor patient adherence and patients being lost to follow-up (LFU) (approximately 30%) . At the core of this problem is limited provider motivation to provide tuberculosis services given the infectious nature of the disease and low remuneration received by specialists. The latter additionally presents problems for retaining and attracting staff towards tuberculosis service delivery. Reducing the LFU rate is not only essential to ensure improved patient outcomes, but also to prevent the spread of MDR-TB. Promising interventions in this regard include integrated care management and performance-based financing .
TB care in Georgia
An extensive overview of the current systems of care for TB management in Georgia is available online ; we summarize most salient points as follows. TB services in Georgia are part of general health care services, which underwent significant reorganization after a recent privatization. The provision of health care is now based on a public–private mix, where the government finances public programmes and health services (e.g. for TB or diabetes) delivered by private providers. At present, the government supports universal free access to TB care, although the financing of TB service provision depends in part on funding from the Global Fund (GF).
At the outpatient level, TB services are provided at TB units by TB doctors and TB nurses. There are currently 68 TB units in the country: 58 semi-urban (located in district centres) and 10 urban TB units. Abkhazia and South Ossetia are out of control territories and therefore the state health programmes are not provided to the population residing in these territories.
Semi-urban units were recently integrated into district and regional level Primary Health Care (PHC) centres, most of which are private. Only a few TB units remain as separate public institutions, mainly in the capital and main cities of the country (10 urban centres). The latter units serve a greater number of patients in total compared to the accumulated number of patients receiving services in private outpatient units.
Outpatient treatment is provided by TB units located in urban and semi-urban areas and follows the direct observation therapy (DOT) strategy. TB units are staffed by TB doctors and DOT nurses. There is no difference in service provision at TB units integrated into PHC (mostly private facilities in semi-urban areas) and in TB units administratively not integrated into PHC, which are in most cases public TB facilities in urban areas. In rural areas, DOT is provided by a general primary care nurse under the supervision of the TB doctor.
Integrated care management, whereby diverse and multidisciplinary service providers collaborate to offer patient-centred services, is an increasingly popular policy for complex disease management. This is likely to be of particular value for TB, where management at the primary care level is based on a variation of the traditional “cascade of care” approach, whereby a TB specialist works together with general practitioners, managing the condition in a coordinated and bidirectional manner . In such set-ups, specialists retain responsibility for clinical management and treatment oversight, while primary care providers perform additional supportive functions. The latter can range from improving patient follow-up at the PHC level (as in Norway  and Canada ) to direct case management by general practitioners (as in Romania , Turkey [15, 16] and India ).
Due to various social determinants underlying TB onset and the complex needs of patients, successful TB management requires the input of multiple disciplines. Several countries, including the United Kingdom and Norway, have achieved relatively successful TB management via multidisciplinary teams (MDTs) which provide comprehensive and patient-centred care . MDTs usually consist of professionals with a mix of skills to meet the needs of patients with TB, especially those with more complex MDR-TB who require additional psycho-emotional and clinical support .
Each country still has its challenges in fighting TB, yet international evidence shows that well-designed and integrated models of primary care engagement can improve treatment access to TB treatment, increase case notification and improve treatment adherence and success . However, successful service integration around TB control is predicated on wider health system factors and performance, including availability and specialized training of human resources, managerial competence and interest as relates to TB service oversight as well as financial viability of service delivery.
Performance-based financing (or results-based financing) schemes are interventions where a cash payment or non-monetary transfer is made conditional upon attainment and verification of predefined service outputs or quality . While prevalent internationally, a 2012 Cochrane review on performance-based financing (PBF) schemes across low- and middle-income countries suggested that evidence on the effectiveness of PBF on health service delivery was weak . Some positive effects on outputs had been shown in some settings, but the number and quality of evaluations on the topic was poor and PBF is a highly heterogeneous intervention, and highly context and implementation dependent . This suggests clear potential for the proposed clinical trial to add to the research and evidence base on this topic.
A more recent review of the effectiveness of supply-side PBF interventions on TB service delivery across low-, middle- and high-income countries reports similar findings . Current research suggests that PBF schemes may impact positively on case detection, service utilization as well as treatment success. Regarding the latter, research from Europe (Czech Republic and Romania) suggests that cure rates may improve by over 20% in settings applying PBF ; indeed, patients treated in centres operating under PBF schemes are found to be at increased odds of treatment success. However, despite promising results, the studies appraised are highly heterogeneous and the evidence base is mixed. Similar to Witter et al.’s  study, RCT evidence is sparse and available studies suggest that intervention success is highly dependent upon the scheme design, operationalization and fit to context. Careful calibration of financial incentives to national and regional contexts is one of the factors affecting PBF scheme success .
Two further issues are of relevance to PBF operationalization, particularly as linked to integrated care management :
Schemes encouraging care coordination show promise; however, clear links between payments and desired functions must be drawn. Evidence from Taiwan suggests that establishing multidisciplinary teams and assigning overall coordination responsibilities to one professional cadre may improve TB management. However, care must be taken to specify and communicate how rewards are linked to specific coordination (or other PBF) functions so as to ensure prompt translation into clinical practice.
PBF schemes and incentives must fit social and professional norms. Evidence from China suggests that, if perceived as compromising “professional dignity” and social norms, financial incentives may be sabotaged by health care professionals.
Results4TB is a multidisciplinary research project aiming to engage local Georgian stakeholders in an evidence-based intervention co-design process prior to rigorous intervention evaluation via randomized trial (this protocol) and health economic and realist evaluation . Driven by policy interests, researchers conducted rapid evidence reviews of performance-based financing interventions and additionally convened two workshops with health care professionals active in TB care to explore issues affecting TB service delivery and the cascade of care. Workshops confirmed that weak remuneration and limited provider motivation were issues to contend with in the Georgian contexts; however, further issues contributing to high loss to follow-up rates were raised, including the lack of communication between providers and a lack of service integration. Via repeat contact with policy-makers, and drawing on previous work by the research team on integrated care, a comprehensive performance-based financing intervention promoting integrated TB service delivery was developed and will be evaluated by the research team .
This protocol describes the methods of a two-arm cluster randomized control trial that seeks to establish the effectiveness of the aforementioned intervention against standard care. The trial is conducted in parallel with a realist and health economic evaluation, and thus offers a unique opportunity to study how and why implementation of care integration and performance-based financing is operationalized in Georgia while simultaneously studying the cost-effectiveness of such an intervention.
This trial aims to determine the effect of an integrated care and performance-based financing intervention on loss to follow-up and patient adherence to treatment among adult patients with pulmonary drug-susceptible and drug-resistant TB in Georgia.
The primary objective of the trial is to compare loss to follow-up among both drug-susceptible and drug-resistant pulmonary TB patients between intervention and control arms. Secondary objectives include comparison of adherence to treatment among patients with pulmonary DS-TB and patients with pulmonary DR-TB in the two trial arms measured at the end of each completed treatment month for a patient. Additional secondary objectives include comparison of treatment success rates among patients with pulmonary DS-TB in the two trial arms.
This is a pragmatic, cluster randomized controlled, superiority trial with two parallel groups, a fixed number of clusters of unequal size and a primary outcome of loss to follow-up among drug-sensitive and drug-resistant TB outpatients. A clustered design—featuring health facilities as clusters—was chosen as facilities represent the ideal frame to disburse performance-related payments to TB providers. Randomization will be constrained and stratified according to the facility operation type (i.e. integrated vs. specialized care management) and clusters will be allocated to intervention and control arms on a 1:1 ratio. Via constrained randomization we will assure no substantive baseline imbalance exists among clusters in relation to patient load (values from 2016 and 2017), treatment-related loss to follow-up and success among drug-susceptible patients (values from 2016), and the number of human resources (doctors and nurses) and their average salary.
This study will be carried out in private and public health facilities in Georgia meeting the following cluster (health facility) eligibility criteria. A full list of eligible facilities is presented in Appendix 1.
To be eligible for the trial, health facilities must comply with all the following criteria at randomization:
Facilities must include a TB unit (TB unit at a specialized TB care facility, or TB unit integrated into primary health care).
Facilities must have registered at least 20 patients with pulmonary DS-TB as treated in the baseline year used for sampling purposes (2016).
Facilities must have a pulmonary DS-TB treatment success rate of 82% or less in the baseline year.
Facilities must have at least one TB doctor and one TB nurse available within the facility.
Managers of health care facility networks, managers of a single private health care facility providing general outpatient care or managers of specialized facilities must consent and agree to participate in the trial, including agreement to disburse performance-related payments as set out in the intervention.
Clusters will be excluded if they are taking part in any other clinical trials on treatment regimen, new drugs and adherence to treatment, and/or if outcome monitoring frameworks of the facility are assessed as weak (and therefore inflexible for intervention) by the National TB Directory.
We will not exclude clusters in the case of implementation of interventions that do not fall into the stated category (e.g. video observed therapy, concomitant chronic disease care, HIV care, acute disease care).
To be eligible for participation in the trial, patients must be:
Aged 18 years or over
A new or previously treated patient diagnosed bacteriologically or clinically with pulmonary TB (PTB); diagnosis must have been established by a direct sputum smear microscopy, culture or Gene Xpert MTB/RIF (bacteriologically confirmed case), or X-ray, histological or morphological changes (clinically diagnosed case)
Assigned to outpatient TB treatment not more than 1 month prior to enrolment in the study; this restriction (not more than 1 month of treatment) does not refer to patients whose most recent treatment outcome was a failure and who were assigned to a new treatment regimen
Assigned to outpatient TB treatment at an outpatient facility or at home (through DOT or video observed therapy (VOT)) according to the national TB treatment guidelines.
Patients will be excluded if:
Diagnosis is extrapulmonary TB
TB outpatient treatment was started more than 1 month prior to enrolment in the study
Patients with DS-TB have undergone more than 2 months of hospitalization or patients with DR-TB have undergone more than 6 months of hospitalization
Patients are known at the start of treatment to require treatment longer than is recommended by the Georgian TB Management Guidelines for the appropriate type of TB (Appendix 2)
Patients are custody patients
Patients are involved in other clinical studies related to TB treatment
Patients are leaving the area within the next 6 months.
All facility managers and health care providers offering TB treatment in eligible facilities are eligible to take part in this trial.
The trial is restricted to two arms: intervention and control. In the intervention arm, an integrated care and performance-based financing intervention will be rolled out and implemented by the Ministry of Labour, Health and Social Affairs (MoLHSA) of Georgia and the Social Service Agency across a random group of public and private health care facilities. Patients presenting at the said health facilities will be offered the option to enrol in this study. The control group will comprise health facilities (i.e. clusters) not implementing the intervention and managing TB as per standard treatment protocols and processes.
Explanation for choice of comparators
While until now no facility or individual-level provider performance incentive schemes have been implemented for primary or secondary care services in Georgia (including TB and other services), there is now considerable interest in performance-based financing schemes to strengthen the quality of services generally, and TB care specifically. The intervention under study has been designed in collaboration with Georgian policy and practice actors , and as such directly reflects current policy and practice priorities and interests. Given the limited information on likely intervention effectiveness, standard care was chosen as the control.
The intervention package includes results-based financing of health care providers and delivery of integrated care at the primary care (outpatient level) with the aim to reduce loss to follow-up among pulmonary DS-TB and DR-TB patients and to improve TB treatment success in patients with pulmonary DS-TB. The intervention aims to create a better relationship between a patient with TB and providers by adopting a patient-centred care approach. The intervention theory of change views this as a first step in promoting patient engagement in the decision-making process, thus resulting in improved trust and improved management of co-morbidities and side effects of TB medication, which in turn contribute to better adherence to treatment. Performance-based payments are made towards the TB case management team based on quarterly reports summarizing monthly adherence to treatment among pulmonary TB patients. The bonus payments to a TB unit considers the number of patients with TB; cascading of payment to team members is based on their estimated contribution towards the care process. Payments to team members have additionally been calibrated against basic salaries to ensure the relative magnitudes of bonus payments are appropriate.
Two intervention models are proposed considering the current set-up of TB services at the outpatient level in Georgia:
Intervention model 1 for TB units administratively integrated into primary care facilities
This intervention model applies principally to health facilities located in semi-urban areas of Georgia. TB patients which present for care in these intervention facilities will receive treatment from an integrated, multidisciplinary team; the care team consists of a TB doctor, a TB nurse (or a rural nurse for rural patients) and a family doctor (or a rural doctor for rural patients); the facility manager is an additional member of the wider TB service management team.
For these facilities, roles and responsibilities of health care providers involved in TB case management have been revised (within the scope of existing staff competencies) to ensure that roles align with principles of integrated care management (see Additional file 1). Staff in the newly established multidisciplinary team will additionally receive training on principles of integrated care, and on managing the side effects of TB treatment in particular. The latter is targeted at family and TB doctors.
New tools (a treatment plan for TB patients, instruments for adherence monitoring, facility manager guideline on intervention implementation) complement the revision in roles and responsibilities and associated trainings. Bonuses to facilities and staff therein are paid on a quarterly basis based on monthly adherence reports and quarterly structured quality of care assessments (see Additional file 1).
Intervention model 2 for TB units NOT administratively integrated into primary care facilities
This intervention model will be adopted by facilities which operate specialized TB services; these facilities are typically free-standing hospitals and treatment units in urban areas. In the current model of care for these facilities, TB doctors and TB nurses are principally involved in care provision; the facility manager is an additional member of the wider TB service management team.
Similar to intervention model 1, the TB doctor and TB nurse team are expected to deliver integrated person-centred care. Training on the management of side effects of TB medications will be provided for TB doctors and new tools supporting the intervention (a case management plan, instruments for monitoring, a facility managers’ guideline on implementing the intervention) will be introduced. Bonuses to facilities and staff therein are paid on a quarterly basis based on monthly adherence reports (see Additional file 1).
In both models, the facility manager plays a vital role in the delivery of the intervention package. The manager will be responsible for enabling the work of the team (such as contracting, creating job descriptions, supervision on the bonus distribution among the team, etc.) and ensuring a supportive environment for providing patient-centred care. The total bonus payment for the facility includes the manager’s and the institution’s share (the latter potentially covering some additional costs linked to the intervention, such as communications). For further details on the intervention, see Additional file 1.
Facilities assigned to the control arm will continue to provide outpatient care as per standard national TB management guidelines, and treatment follows DOT strategies. For patients with DS-TB, flexible DOT is practised. Patients should visit DOT sites three times per week, in certain cases twice per week, and take their drugs for the next day(s) with them. Patients with DR-TB should present at DOT sites six times per week (Monday–Saturday). VOT is practised in a small number of the patients with DR-TB, although this is likely to expand.
Outpatient treatment is provided by TB units located in urban and semi-urban areas and staffed by TB doctors and DOT nurses. DOT in urban areas is provided by DOT nurses under the supervision of TB doctors. In practice, in large urban areas, TB nurses and patients with DS-TB carry out a modified DOT regimen: the nurse and the patient agree to meet outside the TB unit three times per week. At this point, the nurse delivers the medicines to the patient, but no observation of treatment is done.
In rural areas, primary care nurses are assigned to DOT implementation (for both patients with DR-TB and those with DS-TB). They undertake DOT under the supervision of the TB doctor working at the TB unit at district level but in the same geographic location.
Sixteen units are eligible for participation in the trial. Clusters will be randomly assigned to either the control or experimental group with a 1:1 allocation ratio as per a computer-generated randomization schedule. Units will be stratified according to the type of intervention to be implemented (i.e. stratification into specialized vs. integrated units). Within each stratum, constrained randomization techniques will be used to allocate a set number of units to the intervention and control arms: three specialized and five integrated units will act as intervention sites; and three specialized and five integrated units will act as control sites. In total, eight units will be allocated to the intervention arm and eight to the control arm, respectively. Constrained randomization will be used to generate the allocation schedule and will be carried out by the research team. The technique verifies that no baseline imbalances exist with regards to the following variables: DS-TB and DR-TB cohort sizes in 2016 and 2017, loss to follow-up and success rates in 2016; and TB unit ownership type and number of doctors and nurses and their salaries. Randomization will only take place after all TB units give agreement to participate in the study.
Mitigation strategies and actions have been noted in case of any changes affecting facility clusters during the study period. If TB units in the control group merge during the study, the statistical analysis will account for clustering as appropriate. If a control unit and an intervention unit merge during the study, the intervention will continue for the merged unit; the principal analysis will not include these data, but extended analyses will be run including data as appropriate for time periods pre merger. If the number of all TB patients decreases below 10 during a quarter, extended statistical analyses will also account for this trend. Should a national/regional-level change occur in the salary paid out to health care providers (a 25% increase or more), recalculation of the bonus amount will be considered by the intervention manager in the MoLHSA.
Strategies for improving facility adherence to intervention are foreseen within the intervention itself. The MoLHSA will support the research team to develop operational guidelines for facility managers that will provide guidance on the administration of the intervention, roles of the staff members, reporting requirements and so forth. Training will also be provided to the health personnel and facility managers, along with practical activities where different possible scenarios of intervention implementation will be examined. In addition to this, supervision site visits will be delivered by the MoLHSA representatives, where providers will be supported with tips and advice in intervention sites.
Participating units and those administering the intervention will not be blinded. Employees of the participating units (TB doctors, nurses, family doctors) in the intervention arm will be trained in the intervention and they will be receiving bonuses. Employees of the participating units in the control arm will not receive the training and bonuses, but they will be aware of the intervention in the intervention arm. While the intervention will not be promoted among patients, they might know of the presence or the absence of the intervention in the TB unit where they are treated. Once collated, data will undergo a de-identification process, whereby patient and cluster identifiers are removed. Statistical analysts will have access only to this de-identified dataset; for dissemination of findings, the data will be matched to original clusters and intervention/non-intervention sites.
The primary outcome is loss to follow-up among adult drug-sensitive tuberculosis patients. Loss to follow-up is defined as the difference between the two intervention arms in the proportion of patients who did not start treatment after diagnosis or whose treatment was interrupted for 2 consecutive months or more. The outcome will be assessed based on patient data collected every treatment month.
Secondary outcomes include the following:
Loss to follow-up among drug-resistant tuberculosis patients (similarly defined as for drug-sensitive patients) at each month of a treatment
Adherence to treatment among drug-sensitive tuberculosis patients for every month of treatment. The research team discussed the adherence definition during a meeting with a representative from the National Center for Tuberculosis and Lung Diseases (NCTLD), and consensus was achieved at the end of this meeting. The definition draws on local regulations and relevant evidence in this area . The definition of adherence to DOT for patients with pulmonary DS-TB is as follows:
From the start of the treatment to treatment completion, not more than 1 missing day per month if the patient visits a facility 8–12 times during a month to fulfil DOT (DOT is performed 2 or 3 days per week; every other day, the patient receives drugs at home)
From the start of the treatment to treatment completion, no single missing day per month if the patient visits a facility four times during a month to fulfil DOT (some patients visit a facility only once a week for DOT and take drugs for home-taking)
Adherence to treatment among drug-resistant tuberculosis patients. Adherence to DOT for patients with pulmonary DR-TB is defined as not more than 3 missing days per month (DOT is performed 26 days per month—6 days a week except Sunday) from the start of the treatment
Treatment success among drug-sensitive tuberculosis patients. Treatment success is defined as per the WHO . The treatment success rate will be calculated as the difference in the proportion of patients classed as successfully treated between trial arms at 6, 12 and 24 months.
Additional outcomes that we will examine in ancillary studies include the following:
Case detection at a primary health care centre (family doctor level) (via realist evaluation)
Horizontal coordination between PHC and specialized TB services (via realist evaluation)
Costs associated with the management of side effects caused by TB treatment, and of comorbidities (via health economic evaluation)
Outcomes of managing co-morbidities measured by hospitalization rates due to any severe co-morbid conditions (like diabetes, cerebrovascular conditions, etc)
We developed a checklist describing health facility enrolment and allocation, intervention training, rollout, patient enrolment and assessments according to the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guideline (see Fig. 1 and Additional file 2).
Materials and analysis
Assuming 15% attrition, we estimated that data for 948 pulmonary DS-TB patients and 136 pulmonary DR-TB patients must be included in the trial to detect a 6% reduction in loss to follow-up among DS-TB patients and a 20% reduction in loss to follow-up among DR-TB patients. Sample size calculations assume that all eligible clusters will consent to participate in the trial; calculations were informed by historical data (DS-TB data and DR-TB data from 2016) specific to the 16 eligible clusters. Calculations proceeded in line with recommendations for sample estimation for cluster randomized control trials including a fixed number of clusters of unequal size . We calculated the sample size corresponding to 80% power and 5% significance, accounting for an intra-cluster correlation coefficient of 1% and an assumed coefficient of variation in cluster sizes of 20% (based on average coefficients of variation in actual cluster sizes according to 2016 data).
The study population will consist of all patients with newly registered or previously treated pulmonary TB at eligible and consenting TB units between May 2019 and November 2020 with DS and DR pulmonary TB. All of the eligible patients in the TB units who offer informed consent to participate in the study will be enrolled. A screening log will be kept to identify patients who do and who do not meet the inclusion criteria. A screening tool (Additional file 3) will be used for the assessment of the eligibility and the reasons for non-eligibility will be notified. TB doctors will be responsible for obtaining informed consent from patients to participate in the study. Patients will reach the endpoint when they complete the treatment, die or are lost to follow-up. The recruitment will be stopped by the study coordinators 18 months after the beginning of the trial only—this is to ensure that the minimum sample size is achieved and as much data as possible are collected; the last cohort of DS-TB patients can thus finalize treatment while still within the study period.
We will collect general patient-level data (demographic, socio-economic), outcome data (primary, secondary outcomes) and other TB-related data (diagnosis, referrals) from participating intervention and control facilities. The cohort of patients will be followed and respective data collected in different time periods. See Additional file 4 for the data collection tools, timing, data collection techniques, data sources and responsible persons for data collection.
Various data sources will be used to collect information on the cohort of patients enrolled in the trial:
Facility-level data—number of TB patients treated by the facility
Primary data (individual patient data): TB doctors will be trained in how to conduct patient recruitment and additional ethical procedures. The training will be provided by the researchers for all TB doctors working in the intervention and control sites during the preparatory stage of the study (1 month prior to the trial initiation). Upon enrolment, TB doctors will be responsible for collecting patient socio-demographic data. Data on TB diagnosis, DOT treatment regimen, adherence to treatment and referrals will be collected by a research assistant; the research assistant will be responsible for data extraction through document review (TB registries, patient records). As it is unlikely that facilities will have timely access to data on TB outcomes (treatment success in particular), secondary data will also be consulted
Secondary data (cohort data): routine data sources (national TB database from the NCTLD, TB registration journals and forms, and patient records maintained by the TB units) will be used to extract data on the aggregate patient cohorts’ outcomes and other variables including hospitalization of patients and referrals. Secondary data will be compared to primary data to evaluate completeness and accuracy of primary data on adherence; secondary data will be used to estimate DS-TB treatment success. A database manager, an employee of the NCTLD who has access to the national TB database under his routine responsibilities, will be contracted under the study and will be responsible for data extraction from the national TB database.
Data management and confidentiality
The study results will never present any identified information, all paper-based data with personal identifiers will be stored in a secure separate place and all electronic databases will be encrypted and stored in a password secured computer and on the back-up server. Initial and refreshment trainings will be provided to key study staff on data confidentiality and security. Data security will be monitored by the project manager on a regular basis.
All study data will be stored at Curatio International Foundation (CIF). All electronic and paper-based data will be kept securely, password-protected and locked, with limited access only for authorized persons. All data will be kept on secure drives and backed up daily to minimize loss of data in the long term. All study materials including project administrative documents will be stored and then archived in a locked place.
A metafile for quantitative databases will be created and stored in the same file as the databases. The metafile will include information such as sample ID, instrument settings, list of variables and operator ID. Only authorized persons will have access to these metafiles.
In accordance with the CIF data management policy, all data will be stored at the CIF office in a secure place for an additional 5 years after the project closure. Paper documents will be destroyed through shredding. Electronic data will be de-identified and securely stored on the CIF server.
A Data Monitoring Committee (DMC) will be established. The DMC is independent of the study organizers. Members of the DMC will be representatives from the NCTLD, NCDC and Health Research Union (HRU). The DMC will meet at least once a year, or more often as appropriate. During the period of recruitment to the study, interim analyses will be supplied, in strict confidence, to the DMC, together with any other analyses that the committee may request. The research funder (MRC-UK) may audit the trial in order to reassure itself of the reliability of the data gathered and the ethical conduct. Audit(s) will be carried out by individual(s) entirely independent of the trial and the MRC will define the level of audit required.
A detailed analysis plan will be developed prior to completion of data collection and locking of the trial database. The analysis plan will include details on the populations to be included in each analysis, general principles for analysis (on level of confidence, p values, adjustment for multiple testing, handling of missing data), the analytic approach (anticipated to be intention to treat) as well as analyses for primary and secondary outcomes (adjusted, unadjusted and wider sensitivity and subgroup analyses).
Briefly, we anticipate conducting analyses based on intention-to-treat principles using all complete case data available. Analyses will be conducted at both facility and individual participant levels; for the latter we will allow for clustering of individuals into facilities. Unadjusted analyses will examine differences in primary and secondary outcomes among study groups. However, we will examine baseline imbalance across study groups, and in adjusted analyses account for these in addition to facility weighting (by inverse variance), study strata and/or covariates used in the randomization procedures.
We will examine data missingness; if the missing data rate is more than 5%, we will attempt multiple imputation. Subgroup analyses will be conducted for primary and secondary outcomes, and will consider the facility location (urban vs. semi-urban), the private (including providers with multiple facilities vs. single) or public health care provider and the patient comorbidity subgroup (e.g. patients with HIV or diabetes, among others).
While randomized control trials (RCTs) are the gold standard for evaluating intervention effectiveness, we acknowledge that effectiveness estimates sourced from trial analyses may not reflect the full impact of the intervention on the TB population in Georgia; that is, despite adopting a pragmatic design, the trial is restricted to evaluating effectiveness among incident cases only and excludes patients presenting with the most severe forms of tuberculosis (MDR-TB or those hospitalized for substantive periods). Effectiveness estimates gleaned may thus not apply to the entire patient population affected by the intervention. To address this, a second impact evaluation study is planned using a controlled interrupted time-series design. The study will focus on the same outcomes as for the trial, but adopt a wider perspective and consider outcomes for all patients with pulmonary TB treated in the units of interest. Similar to the trial, data will be sourced from the TB reporting system; we will include quarterly outcome estimates from the period 2017–2020 and the first quarter of 2021 (17 data points), and explore the impact of the intervention on outcomes of interest via segmented regressions. We hypothesize that the intervention would lead to a lagged change in TB outcomes and likely affect both the trend level and gradient over time.
A pre-test of the intervention has been conducted in two TB units between January and April 2019. The purpose of the pre-test was to test instruments/tools and to field-test the intervention. This will also to help fine-tune monitoring processes. Patients with TB satisfying the inclusion criteria were enrolled in the pre-test and followed up for 3 months. Patients recruited during this period will not contribute to the trial outcomes. The intervention will continue in the pre-test TB units without interruption.
Please see Additional file 4.
A steering committee will oversee trial management and implementation; a Data Management Committee will oversee all issues relating to data collection, quality and monitoring. Details of these committees are available in Additional file 5.
The current protocol has been reviewed by the steering committee of the trial as well as trial funders and the ethics boards of the institutions involved.
There are no harms anticipated for either patients or providers from taking part in the study; post-trial care procedures are not relevant. It is not anticipated that interviewing patients about their socio-economic status will cause any distress except for minimal emotional discomfort. No financial or other types of incentives will be provided as a reward for the study participation (beyond the intervention support itself).
Any modifications to the protocol which may impact on the conduct of the study or potential benefit of the patient or may affect patient safety, including changes of study objectives, study design, patient population, sample sizes, study procedures or significant administrative aspects, will require a formal amendment to the protocol. Such an amendment will be agreed upon by CIF and Queen Margaret University (QMU) and approved by the Bioethics Committee at the National Centre for Disease Control of Georgia and the QMU institutional review boards, prior to implementation, and notified to the health authorities in accordance with local regulations. Administrative changes of the protocol are minor corrections and/or clarifications that have no effect on the way the study is to be conducted. These administrative changes will be agreed upon by CIF and QMU and will be documented in a memorandum. The Bioethics Committee at the National Centre for Disease Control of Georgia will be notified of administrative changes at the discretion of CIF.
Dissemination of trial results
Trial investigators will communicate results to international and national academic and policy audiences internationally via conferences and preparation of published papers, to national-level policy-makers in Georgia via policy briefs and stakeholder meetings, and to lay audiences via lay summary materials (e.g. posters, videos) to be published on the trial website. The scientific integrity of the study requires that results of the trial are adequately shared. Primary outcome and other study papers, abstracts and presentation will be developed based on the trial results. Each product must be shared with and approved by the Coordinating Center before dissemination.
There are no restrictions on preparation of publications arising from this trial. All study investigators will be eligible for authorship, depending on contributions to the trial, its analysis and manuscript preparation. The study team will have exclusive use of the data for 3 years after the project ends. This embargo period is requested to allow time for additional analyses and further publication of research findings.
Protocol date and version: 16 May 2019, version 2
Recruitment start: 24 May 2019
Recruitment end: 24 November 2020
WHO Trials dataset items: see Additional file 6
Availability of data and materials
Data sharing is not applicable to this article as it is a protocol for a future trial. The final trial dataset will be accessible to the MoLHSA, Georgia and investigators at CIF and QMU. Findings of analyses conducted will be made available to the wider research project group, including researchers at LSHTM and ITM. The data will be suitable for sharing with some restrictions. The metafile describing datasets will be shared on our website along with a project description. The data manager of the study will have permission to make decisions on data sharing with new users. This will depend on what type of data needs to be shared CIF will ensure that all new users sign the Data Sharing Agreement in which the specific purpose of data usage will be stated.
Curatio International Foundation
Data Monitoring Committee
Direct observation of treatment
The Global Fund
Human immunodeficiency virus
Health Research Union
Loss to follow-up
Low- and middle-income country
Multidrug-resistant rifampicin-resistant tuberculosis
Ministry of Labour, Health and Social Affairs
National Center for Disease Control and Public Health
National Center for Tuberculosis and Lung Diseases
Primary health care
Queen Margaret University
Designing and evaluating provider results-based financing for tuberculosis care in Georgia: understanding costs, mechanisms of effect and impact
Tuberculosis and resistance to rifampicin
Video observed therapy
World Health Organization
- Xpert MTB:
Automated diagnostic test to detect presence of mycobacterium
World Health Organization (WHO). Global tuberculosis report 2018: World Health Organization (WHO); 2018. Available from: https://www.who.int/tb/publications/global_report/en/. Cited 12 Dec 2018
Dorman SE, Schumacher SG, Alland D, Nabeta P, Armstrong DT, King B, et al. Xpert MTB/RIF Ultra for detection of Mycobacterium tuberculosis and rifampicin resistance: a prospective multicentre diagnostic accuracy study. Lancet Infect Dis. 2018;18(1):76–84.
Nunn AJ, Phillips PPJ, Meredith SK, Chiang C-Y, Conradie F, Dalai D, et al. A trial of a shorter regimen for rifampin-resistant tuberculosis. N Engl J Med. 2019;380(13):1201–13. https://doi.org/10.1056/NEJMoa1811867.
Azim NH, Subki A, Yusof ZNB. The End TB Strategy. Geneva: World Health Organization; 2015.
World Health Organization. Georgia tuberculosis profile. World Health Organization—Country Profiles. Geneva: World Health Organisation; 2016. p. 1.
NCTLD Georgia. Tuberculosis in Georgia, country report. 2017. (Unpublished).
University Research Co. LLC URC. USAID Georgia Tuberculosis Prevention Project. Georgia: University Research Co., LLC Tbilisi; 2016.
Sulaberidze L, Chikovani I, Gotsadze G. Barriers and facilitators to adherence to treatment among drug-resistant TB patients in Georgia: looking through health systems lens. Tbilisi; 2017. Available from: https://www.scribd.com/document/340692756/Factors-Associated-Adherence-to-TB-Treatment-in-Georgia-Report-Eng#from_embed. Cited 6 June 2019
Nebot A, Sulaberidze L, Zoidze A, Marchal B. Informing policy, assessing its effects and understanding how it works for improved tuberculosis management in Georgia. In: International Conference for Realist Research, Evaluation and Synthesis. Brisbane; 2017. Available from: http://curatiofoundation.org/conference-paper-realist-evaluation-informing-policy-assessing-effects-understanding-works-improved-tuberculosis-management-georgia/. Cited 6 June 2019.
Curatio International Foundation. Tuberculosis system overview in Georgia. 2017. http://results4tb.curatiofoundation.org/wp-content/uploads/2018/07/TB-System-Overview_2017.pdf. Cited 6 June 2019.
Curatio International Foundation. Integrating tuberculosis services in primary health care: evidence summary. Tbilisi: Curatio International Foundation; 2017.
ECDC, WHO. Report of Joint ECDC/WHO Regional Office for Europe: tuberculosis country visit Norway. Oslo: ECDC/WHO Regional Office for Europe; 2011;
Amaratunga KR, Alvarez GG. Primary care pearls to help eliminate tuberculosis in Canada. Can Comm Dis Rep. 2016;42(3):63–7.
Acs V, Simona IE. The role of the general practitioner in the prevention of tuberculosis. Acta Medica Marisiensis. 2012;58(6):485–90.
Aydemir Y. Knowledge level of family physicians about tuberculosis and their attitudes and views regarding their willingness to work at a tuberculosis dispensary. Turk Toraks Derg. 2015;16(4):166–71.
Yasin Y, Karabey S. Disconnecting the DOTS: misconceptions about the therapeutic paradigm of tuberculosis patients at family healthcare centers in Istanbul. J Public Health (Bangkok). 2016;24(2):141–6.
Salve S, Sheikh K, Porter JD. Private practitioners’ perspectives on their involvement with the tuberculosis control programme in a southern Indian state. Int J Heal Policy Manag. 2016;5(11):631–42.
World Health Organization. Performance-based financing as an instrument to introduce strategic purchasing to move towards universal health coverage. Geneva: World Health Organisation; 2019.
Witter S, Fretheim A, Kessy FL, Lindahl AK. Paying for performance to improve the delivery of health interventions in low- and middle-income countries. Cochrane Database Syst Rev. 2012;2(2):CD007899.
Witter S, Diaconu KD. Performance based financing for tuberculosis care: are provider incentives the answer? Evidence summary. Edinburgh: Queen Margaret University; 2017.
Beith BA, Eichler R, Weil D. CGD Working Paper # 122 April 2007. Performance-based incentives for health: a way to improve tuberculosis detection and treatment completion? Washington D.C.: Center for Global Development; p. 2007.
Curatio International Foundation. Results4TB. Tbilisi: Curatio International Foundation; 2019.
Valencia S, León M, Losada I, Sequera VG, Fernández Quevedo M, García-Basteiro AL. How do we measure adherence to anti-tuberculosis treatment? Expert Rev Anti-Infect Ther. 2017;15(2):157–65 Available from: https://www.tandfonline.com/doi/full/10.1080/14787210.2017.1264270. Cited 6 June 2019.
World Health Organization. Definitions and reporting framework for tuberculosis. Criminology. 2014;15:386.
Hemming K, Girling AJ, Sitch AJ, Marsh J, Lilford RJ. Sample size calculations for cluster randomised controlled trials with a fixed number of clusters. BMC Med Res Methodol. 2011;11(1):102.
World Health Organization. Definitions and reporting framework for tuberculosis—2013 revision (updated December 2014). Geneva: WHO; 2013. (updated 2014)
The authors gratefully acknowledge the assistance of collaborators at the Institute for Tropical Medicine Antwerp (Prof. Bruno Marchal and Dr Ibukun Aberijinde) and London School of Hygiene and Tropical Medicine (Prof. Anna Vassal).
The research is funded through the Joint Health Systems Research Initiative of the Department of International Development, the Economic and Social Research Council, the Medical Research Council and the Wellcome Trust (March 2017–February 2021). The MRC-UK has neither had, nor will have, any involvement in trial design, data collection, management, analysis, interpretation or write-up of reports/publications arising from this trial or ancillary studies. The MRC can be contacted at: Caroline.Harris@mrc.ukri.org.
The Global Fund to fight HIV/AIDS, TB and malaria will support the performance-based financing scheme for 10 intervention sites during the 24-month trial (May 2019–May 2021) through the Tuberculosis Grant.
The training component of the intervention package will be financed by Curatio International Foundation through the Joint Health Systems Research Initiative of the DFID, ESRC, MRC and WT.
Ethics approval and consent to participate
Ethical approvals for this research have been secured from the National Center for Disease Control and Public Health of Georgia (IRB # 2018–01) and Queen Margaret University, Edinburgh, UK (IRB # REP0172). All managers of health care facility networks or managers of stand-alone facilities involved in the trial will sign a consent form. Informed consent will be obtained from patients as they enrol into the study (see Additional file 2).
Consent for publication
All trial participants will provide consent for their data to be used in publication in aggregate anonymized format; no individual data will be presented.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Description of intervention models. (DOCX 175 kb)
SPIRIT 2013 Checklist: Recommended items to address in a clinical trial protocol and related documents (DOC 120 kb)
Ethics forms and patient screening tool. (DOCX 43 kb)
Project timeline, data collection matrix and tools. (DOCX 33 kb)
Steering committee and data management team. (DOCX 14 kb)
Trial registration in World Health Organization Trial Dataset. (DOCX 25 kb)