Feasibility and diagnostic accuracy of Telephone Administration of an adapted wound heaLing QuestiONnaire for assessment for surgical site infection following abdominal surgery in low and middle-income countries (TALON): protocol for a study within a trial (SWAT)
Trials volume 22, Article number: 471 (2021)
Surgical site infection is the most common complication of abdominal surgery, with a global impact on patients and health systems. There are no tools to identify wound infection that are validated for use in the global setting. The overall aim of the study described in this protocol is to evaluate the feasibility and validity of a remote, digital pathway for wound assessment after hospital discharge for patients in low- and middle-income countries (LMICs).
A multi-centre, international, mixed-methods study within a trial, conducted in two stages (TALON-1 and TALON-2). TALON-1 will adapt and translate a universal reporter outcome measurement tool (Bluebelle Wound Healing Questionnaire, WHQ) for use in global surgical research (SWAT store registration: 126) that can be delivered over the telephone. TALON-2 will evaluate a remote wound assessment pathway (including trial retention) and validate the diagnostic accuracy of this adapted WHQ through a prospective cohort study embedded within two global surgery trials. Embedded community engagement and involvement activities will be used to optimise delivery and ensure culturally attuned conduct. TALON-1 and TALON-2 are designed and will be reported in accordance with best practice guidelines for adaptation and validation of outcome measures, and diagnostic test accuracy studies.
Methods to identify surgical site infection after surgery for patients after hospital discharge have the potential to improve patient safety, trial retention, and research efficiency. TALON represents a large, pragmatic, international study co-designed and delivered with LMIC researchers and patients to address an important research gap in global surgery trial methodology.
Importance of surgical site infection research
Surgical site infection (SSI) is a global issue. It is the most common healthcare-associated infection in low- and middle-income countries (LMICs) [1, 2] and carries a huge burden to patients, doctors, and health systems around the world [3,4,5]. Reported rates vary, but SSI is particularly prevalent in abdominal and colorectal surgery; as many as one in three patients get an SSI when the operation involves the large bowel . It was highlighted as the key research priority to improve surgical care worldwide in an international prioritisation process  and is the focus of several ongoing global randomised trials [8,9,10,11].
Challenges to assessment of wound infection across settings
The current ‘gold standard’ for diagnosis of SSI in randomised trials is in-person review according to the Centre for Disease Control Criteria at 30 days after surgery by a trained assessor . Hospitals in LMICs treat a high burden of surgical disease  and have a high number of eligible patients for recruitment to pragmatic clinical trials. However, in-person assessment is labour and time intensive and requires patients to take additional time-off work and incur costs of travel. This poses particular difficulty in LMICs where patients may live further from a specialist hospital and may already be at risk of financial catastrophe as a result of their index procedure [13, 14]. The SARS-CoV-2 pandemic poses an additional risk where patients are returning to hospital in the perioperative setting [15, 16]. Other methods for assessing SSI are important.
Over 80% of the global population has access to a mobile telephone, opening an opportunity for remote and digital wound assessment pathways [17, 18]. Non-standardised telephone follow-up may risk reducing the validity of outcome assessment. For example, whilst 43% of patients in a prospective cohort study underwent telephone-based assessment, this group had a significantly lower risk-adjusted odds ratio of SSI than those who underwent in-person follow-up . Quality assured methods for remote wound evaluation are urgently required, both to deliver high-quality research and for surveillance after hospital discharge.
Potential solutions for remote surgical site assessment
The Bluebelle Wound Healing Questionnaire (WHQ) has been developed and validated in the UK (English language) to assess post-discharge infections following abdominal surgery (HTA: 12/200/04) and is attractive for use in randomised trials. The WHQ was designed to be either completed by a healthcare professional or self-reported by patients  and as such has been described as a ‘universal-reporter’ outcome measure (UROM) . In a UK validation study, the WHQ demonstrated good reliability and excellent discrimination [21,22,23]. The WHQ was completed both in-person and over the telephone by a healthcare professional trained in wound assessment (e.g. nurse, junior doctor), demonstrating feasibility of telephone delivery. However, no external validation has been performed in LMICs where health literacy, language and cultural contexts, and digital infrastructure differ substantially. If the WHQ can be administered remotely (e.g. over the telephone) with satisfactory diagnostic accuracy, this would reduce resource usage, making surgical research more effective and more sustainable. Other digital adjuncts to surgical site evaluation such as video assessment may further enhance accuracy .
Justification of study design
Studies within a trial (SWATs) have gained significant attention from trial methodologists and funders over the past 3 years and are now the focus of a Trial Methodology Research Partnership working group (Trial Forge)  and National Institute for Health Research (NIHR) funding stream. SWATs exploit the delivery network and infrastructure of major randomised trials to efficiently answer methodological research questions. Ongoing large international trials in global surgery provide a unique opportunity to improve the quality and efficiency of global wound infection research .
The overall aim of this study protocol is to evaluate the feasibility and validity of a remote, digital pathway for wound assessment after hospital discharge for patients in low-resource settings.
Feasibility and diagnostic accuracy of Telephone Administration of an adapted wound heaLing QuestiONnaire for assessment for surgical site infection following abdominal surgery in low and middle-income countries (TALON) is a prospective, multi-centre, international, non-randomised study embedded within a randomised trial, conducted in two phases (TALON-1 and TALON-2). TALON-1 will adapt and translate an outcome measure for use in global surgical research. TALON-2 will validate this adapted outcome measure through a prospective cohort study embedded within two host trials in global surgery.
FALCON is a stratified, pragmatic, multi-centre, 2 × 2 factorial trial testing two measures (skin preparation and antimicrobial sutures) to reduce superficial or deep skin infection following abdominal surgery in seven low- and middle-income countries (NCT03700749) . ChEETAh is a cluster randomised trial evaluating whether the practice of using separate sterile gloves and instruments to close wounds at the end of surgery compared to current routine hospital practice can reduce surgical site infection at 30 days after abdominal surgery .
Reporting and registration
This protocol is reported with reference to recommendations from the Global Health Network for qualitative research in LMICs and Consolidated criteria for reporting qualitative research (COREQ) framework [27, 28], recommendations for best practices in a mixed-methods adaptation of outcome measures , and STARD guidelines for diagnostic test accuracy studies . The protocols for the two host trials are reported elsewhere [8, 26]. This SWAT protocol has been pre-registered on the MRC Hubs for Trial Methodology Research Study Within a Trial database  (Queen’s University Belfast) (SWAT ID:126).
Ethics and approvals
The TALON-1 and TALON-2 studies have been approved as an amendment to the host trial protocols by the University of Birmingham Research Ethics Committee (ERN_18-0230_A and ERN_19-0719). The additional risks and ethical implications within TALON-2 were considered very low by the Birmingham Clinical Trials Unit internal review board and international ethics committee. Ethical approval for TALON has been obtained from national, regional, and/or hospital-level ethics committees for selected centres in all participating countries, in accordance with local protocols.
To assess patient acceptability, cross-cultural and cross-language equivalence, and content validity of the Wound Healing Questionnaire (WHQ) across LMICs
To assess the scaling and psychometric properties of the WHQ when used across different patient populations and subgroups
To adapt the WHQ for use in global surgical research by triangulating qualitative and quantitative data
TALON-1 will use mixed qualitative and quantitative research methods to explore the cross-cultural and cross-language equivalence of the WHQ across settings, and the acceptability of telephone-based follow-up. Iterative adaptation to the questionnaire will be made, where required, to create an adapted patient-reported outcome measure suitable for use in global trials. The original WHQ prior to adaptation is presented in Additional file 1. Scaling and measurement functioning of the WHQ will be evaluated within a pilot cohort study. Interview data will be triangulated with data about the psychometric properties of the WHQ using Rasch Unidimensional Measurement Modelling.
Language and local acceptability
All TALON study researchers are fluent in the English language. In some countries, English is a primary or prevalent secondary language amongst the populations that will be recruited to FALCON. In these countries, the feasibility of single-language administration of the questionnaire has been tested at sites within the FALCON trial. Where translation of the WHQ is required, this will be performed using the Mapi process for standard linguistic validation to verify conceptual equivalence across languages and cultures [31,32,33].
In brief, this involves recruitment and briefing of an in-country consultant to oversee the process in the target country; forward translation by two independent translators native in both the target and source language; production of a reconciled language version with discussion between the translators where warranted; review of the forward translation by the consultant; backward translation into the source language by an independent translator fluent in the target and source language; comparison of the backward translation and original, analysis of discrepancies, and reconciliation with decisions reported and explained; review of the backward translation by the consultant; pilot testing; and finally clinician review.
As the WHQ will be translated into multiple languages, an international harmonisation meeting with the consultants overseeing each language translation will be held after all translations are completed in order to ensure conceptual equivalence in all versions.
Whilst cognitive debriefing with patients is the recommended methodology for cross-language adaptation of an outcome measure [33, 34], modification will be required to progress the study during the SARS-CoV-2 pandemic. As such, adaptation will start with expert review and structured interviews with site researchers. Structured interviews will be conducted with two to three research staff that are participating in the FALCON trial (research nurses, or doctors involved in follow-up) in each participating country in order to ensure cross-cultural relevance of concepts and construct validity of the questionnaire. First, unrefined data from each interview will be reviewed. Second, structured item-by-item summaries will be generated for each interview according to a pre-defined template from the Social Research Association. Third, themes related to comprehension, response mapping, retrieval, and judgement will be extracted with flexibility to include emerging findings. Finally, themes will be categorised for each item to compare and contrast these across interviews. Where required, iterative adaptation will be made until a point of saturation according to accepted best practice principles for adaptation of instruments [29, 33, 35].
Further iterative adaptation will be performed using cognitive interviews undertaken face-to-face with patients if this is safe and practicable. Otherwise, adaptation will use data from site researchers only, with this limitation noted in study outputs. Interview data will be used to explore content, conceptual and cross-cultural equivalence of the global WHQ in greater depth . Data will be collected up to the point of saturation; we anticipate approximately 6 to 8 patients per country will be sufficient. Adult patients (> 18 years) that have undergone intra-abdominal surgery of any urgency and through any operative approach will be recruited from surgical assessment areas, inpatient wards, and outpatient clinic settings. Informed consent for inclusion will be taken and recorded within a dedicated Informed Consent Form. A specific Patient Information Sheet for TALON-1 will be provided. Purposive sampling will include patients from each included country, those who have and have not suffered an SSI, urban and rural hospital settings, and high school level of education and lower education level. The results of cognitive debriefing will be reviewed to assure cultural relevance and equivalence. Comparison of patients’ interpretation of the translation and the original version will be highlighted to amend discrepancies.
Psychometric testing and scaling
Pilot administration of the WHQ will be performed in adult patients undergoing abdominal surgery and recruited to the host trials, over the telephone by a non-surgeon clinician; this can be a research nurse, non-surgeon physician, or other delegated members of the site research team. Non-surgeon physicians will be trained to deliver the WHQ by a member of the study management group. Monitoring of the first 10 patients followed up over that telephone at each site will be performed for quality assurance. Content, construct validity, and unidimensionality of the WHQ will be tested using Rasch analysis . The Rasch unidimensional measurement model will examine the psychometric properties of the WHQ, identify anomalies in the data, and evaluate the extent to which the WHQ items are measuring wound infection [37, 38]. Differential item functioning will be tested for equivalence by country, language, age (young age (18–29)/middle age (30–59)/older age (> 60 years)), and sex (male/female) groups. A target of at least 100 patients per language and per country will be set for data included in the Rasch analysis .
Data sources will be triangulated using data (i.e. between countries) and methodological (i.e. between qualitative interviews and psychometric analysis of quantitative pilot data) triangulation to support the final adaptation of the WHQ across each included language [29, 40,41,42,43]. This will be followed by proofreading, before completion of a final report and publication of the adapted WHQ.
Community engagement and involvement
Community engagement and involvement with patients and members of the public from LMICs will be engaged in all phases of the design and delivery of TALON-1. The interview topic guide will be co-designed with input from a representative global surgery patient forum. Practicable methods for conducting interviews, and patient compensation for the time in participation will be determined with the support of local community leaders. The Guidance for Reporting Involvement of Patients and the Public (GRIPP-2) short form will be used to track and report the impact of community engagement and involvement (CEI) within this study .
Ethical considerations and data handling
All participant data for TALON-1 will be fully anonymised and unlinked and stored securely within a password-protected NVivo V12 data management system.
TALON-1 will therefore produce a globally adapted Wound Healing Questionnaire, suitable for use in global surgery research, including the TALON-2 validation study.
TALON-2 will be a cohort study within the FALCON and ChEETAh trials to test the feasibility and accuracy of telephone administration of the adapted WHQ in the diagnosis of surgical site infection.
To evaluate the diagnostic accuracy of telephone administration of the WHQ in detection of abdominal surgical site infection across LMICs
To assess the feasibility of delivery of the telephone WHQ by a non-surgeon researcher within the FALCON trial
To assess the feasibility of live wound videography (or wound photography) as a diagnostic adjunct for telephone-based wound follow-up
Centres for TALON-2 will be chosen based upon (1) the proportion of recruited patients that are likely to return for routine in-person 30-day follow-up and (2) the site’s ability to have an independent non-surgeon researcher perform telephone follow-up for TALON-2 that will not perform in-person, 30-day follow-up. Sites will be selected from across seven low- and middle-income countries (Fig. 1).
Consecutive adult patients (greater than 18 years) recruited to the FALCON or ChEETAh study that are likely to return for routine in-person follow-up at around 30 days postoperatively are eligible. Consent for an additional telephone follow-up call within the TALON-2 study will be taken at the same time as trial consent, using a targeted Informed Consent Form and Patient Information Sheet. Community representatives will co-produce these resources to ensure culturally appropriate language and delivery.
Telephone-based administration of the WHQ will be compared to the ‘gold standard’ (reference test) of in-person assessment at 30 days after surgery by a trained clinician in accordance with the US Centre for Disease Control criteria (Additional file 2). The WHQ will be delivered integrated into the trial pathway for included patients (Fig. 2). The telephone-based WHQ will be performed at 28–30 days (i.e. in the 72 h prior to in-person follow-up) by a non-surgeon researcher, according to a telephone script. Patients will be asked to provide between one and three telephone contact numbers, either personal or belonging to a family member or community worker. The non-surgeon researcher directing completion of the WHQ should be blinded to the outcome of the in-person wound assessment within the FALCON trial. In the event that the patient is unable to be contacted by telephone at 27–30 postoperative days (before in-person follow-up), the WHQ can be performed after the in-person follow-up appointment, where possible. This should be completed by a non-surgeon researcher that is independent of the assessment for the FALCON primary outcome, to ensure independent measures are taken. The process and pathway for telephone follow-up will be co-designed by patient and public partners to optimise successful and culturally sensitive delivery.
After sufficient data has been collected for the primary validation analysis, an extension to the study intervention will be implemented. Patients will undergo remote telemedical (photo or video) review to track their recovery from surgery and will be invited by the assessor to provide ‘live’ visualisation of the wound to check wound healing (Additional file 3). This will be performed using a locally available video platform as an adjunct to completion of the WHQ in remote wound assessment. No recording or storage of the video data will be undertaken.
Telephone follow-up pathway
Descriptive data to explore variation in telephone follow-up implementation and procedures between patient groups, centres, and countries will be collected including the number of attempts required to connect, the type of phone used (including whether the phone has a camera or video capability), the phone’s owner, and the language of delivery.
Primary outcome measure
Proportion of surgical site infections that are correctly identified by the telephone WHQ (in comparison to in-person review), summarised using measures of diagnostic test accuracy
Secondary outcome measures
The secondary outcome measures will test the feasibility of telephone and video follow-up and specifically the benefit to trial retention of remote methods (i.e. maintenance of a patient with trial follow-up to the end of the study, in this case 30 days after surgery).
Retention benefit: ratio of the proportion of recruited patients returning a telephone WHQ to the proportion of recruited patients completing in-person follow-up
Telephone contact rate: proportion of patients successfully contacted by the telephone
Return rate: the proportion of telephone WHQ returned, and reasons not completed
Data completion rate: proportion of missing data within each form
Video contact rate: proportion of patients successfully contacted for a live video wound assessment
As TALON-2 is a validation study for a diagnostic criterion, no formal sample size calculation is required. A range of sample sizes and their impact on the 95% confidence interval (CI) around estimates of sensitivity 0.92 and specificity 0.95 based on a prevalence of 0.21 using the binomial exact formula are presented in Table 1. Sample sizes are adjusted to allow for 15% loss to follow-up from the host trials, and 15% of patients who do not achieve both telephone WHQ completion and 30-day in-person follow-up within TALON-2. Sampling from Hub and Spoke centres across several LMICs will give a representative sample of urban and rural settings.
Community engagement and involvement
We will work with patient and public partners to co-produce the question schedule, introductory and closing text, and patient facing materials. Using recommendations from focus group discussions with community representative and local research leaders, we will create a toolkit to optimise telephone follow-up in low-resource settings which can be applied across the TALON delivery network.
Statistical analysis will be undertaken using R Project for Statistical Computing (V3.6.1). The outcome against which the WHQ prediction model will be validated is 30-day in-person wound assessment according to the CDC criteria (binary outcome: SSI/no SSI). Blinded 30-day outcome data for patients included in TALON will be made available by the FALCON Trial Management Group for the purpose of this analysis. Cross-tabulations of the reference CDC diagnosis (‘no SSI’ or ‘SSI’) and a binary variable of the self-assessment WHQ total score (created by a cut-off score; for instance, a WHQ total score of less than or equal to a specified value) will be compared.
Criterion validity will be examined against the reference (face-to-face SSI assessment) to evaluate the performance of WHQ in discriminating between individuals with and those without SSI. Sensitivity and 1-specificity values of the WHQ for different cut-off scores will be used to plot a receiver operating characteristic (ROC) curve. From derivation data in the UK, WHQ cut points of 6 to 8 were found to provide optimal sensitivity and specificity . We will calibrate the tool with a range of cut points from 5 to 9 in order to explore differences in calibration across included countries. The overall ability of the WHQ to discriminate between individuals with and those without SSI will be measured by the area under the ROC curve (AUC), with uncertainty presented using 95% confidence intervals. Diagnostic test accuracy will be presented as sensitivity, specificity, and positive and negative predictive value.
The overall rate of missing data is anticipated to be low. The patients that did and did not receive a 30-day in-person assessment (reference standard) will be compared to assess for partial or differential verification bias. A sensitivity analysis will be performed with missing data imputed using multiple imputation by chained equations to explore the impact of missing data. A full statistical analysis plan has been published online at: https://globalsurg.org/resources/phd-research-projects/talon/.
Ethics and governance
For TALON-2, all patient identifiable data (including telephone numbers) will be held at host trial sites on an encrypted, password-protected spreadsheet and only used for the purpose of telephone follow-up within the host trial and TALON studies. Data for TALON-2 will be collected on the existing, secure REDCap system created for the host trials.
Live, real-time ‘video’ wound assessment within the TALON-2 study will be conducted in countries/environments where this is already used as part of routine clinical follow-up pathways, learning from experiences during the COVID-19 pandemic. This will use a locally available video platform, and the costs of data usage will be borne by the clinical research team and not by the participant themselves. No recording of video data will be made or stored. Video wound assessment will be entirely voluntary at the discretion of the participant, and the wound assessor will encourage the patient to perform the wound assessment in a private and secure environment at home or in the community. Only the wound assessor (and trained clinical translator where required) will be present for the video assessment and the patient will be encouraged; this mirrors current clinical practice and standards for an in-person wound assessment. A standard operating procedure and online training materials will be provided as an adjunct to site initiation training to standardise as much of this assessment as possible. The patient will be free to terminate the video at their own discretion at any time.
All publications arising from TALON will be attributed to the NIHR Global Health Research Unit on Global Surgery [6, 45, 46]. All contributors will be listed as collaborating authors in accordance with the National Research Collaborative recommendations . Data sharing will be made available upon successful completion of a Data Sharing Agreement and approval from the TALON Study Management Group.
Lay summaries of all research outputs will be co-produced with CEI partners and translated into relevant languages before dissemination. Other scientific engagement methods such as online webinars, visual and video abstracts, national journal editorial submissions, and policy reports will be implemented with LMIC partners across participating countries.
TALON is a large international collaborative cohort study which will evaluate a telephone follow-up pathway for surgical site assessment following abdominal surgery across seven low- and middle-income countries. This will allow researchers to better understand both the feasibility and validity of remote follow-up for SSI across diverse settings. Remote follow-up methods are an attractive target for improving trial retention; this study is designed to compare the within-participant attrition rates between in-person and telephone follow-up in-depth. Through adaptation and translation of an existing patient-reported outcome measure, TALON will provide a package of tools for surgical researchers across cultural and language contexts. Finally, TALON will adopt a novel and efficient study within a trial (SWAT) design, which provides an attractive future model for methodological research in global surgery.
Methods of post-discharge follow-up which do not require face-to-face review have grown rapidly in interest over the past 5 years [48, 49]. Exponential advances in global access to telecommunications and mobile devices have been bolstered by a global momentum towards telemedical delivery of postoperative care during the SARS-COV-2 pandemic [50,51,52]. The World Bank estimates that over 80% of the population of sub-Saharan Africa now have access to a mobile telephone, and this continues to increase year-on-year . Remote follow-up has several advantages to patients in LMICs and research studies. Firstly, patients can avoid significant additional costs of transport and time out of work associated with return to hospital . Secondly, telemedicine may reach patients who are unable to return to the hospital for reasons of costs, access, or logistics, improving trial retention [6, 24, 54, 55]. Thirdly, it can protect scarce time for busy LMIC clinicians and improve trial efficiency . However, rapid implementation of unvalidated digital follow-up methods into randomised trials (or indeed clinical practice) may risk harm to patients through missed infection, overtreatment, and/or introducing research bias . Existing evidence is available only from small, low-quality studies at high risk of bias and/or without adopting a diagnostic accuracy frame of evaluation [54, 57,58,59,60]. This large, pragmatic study aims to fill this knowledge gap by exploring the feasibility and accuracy of a novel remote follow-up pathway.
SSI is the most common complication of surgery, and the third most common healthcare-associated infection worldwide [1, 2]. The global burden of morbidity as a result of surgical infection has dramatic and wide-reaching effects on patients, providers, and health systems in LMICs [14, 61, 62]. SSI has therefore been recognised as the highest global priority in surgical research and is therefore a natural target for the TALON study [7, 63]. Future work will be required to standard processes for outcome assessment across other common and severe postoperative complications . TALON provides a proof-of-concept for international SWATs which can now be used to explore other prioritised methodological challenges in global surgery trials.
The TALON study has been designed as a deep collaboration between global surgery clinicians, researchers, methodologists, and community and patient partners. This focus will be essential to assuring appropriate, culturally attuned, and therefore successful delivery of the study [65, 66]. Understanding of community engagement and involvement in global health research is still evolving ; learning from this study will hope to inform future research from our group and provide case studies to support other global health researchers.
There are limitations to the proposed study design. Firstly, due to limitations with travel around the SARS-CoV-2 pandemic, the ability to conduct cognitive interviewing during the adaptation and translation process may be limited. From site researchers and CEI representatives, it was highlighted that video-based interviews with patients in low-resource settings may prove challenging both logistically, and to the richness of the data, and risk of accentuating power imbalances between the researcher and patients. We have modified the proposed methodology to include pragmatic, structured interviews with site researchers; however, further iterative adaptation following face-to-face patient interviews may be required in the future . A mixed-methods approach, including Rasch analysis of pilot cohort data, will further enhance the adaptation and scaling process . Secondly, the Wound Healing Questionnaire has not previously been validated for use across low-resource settings, as such the optimal score calibration is yet to be determined. Whilst a pre-defined range of cut points will be adopted, this combines the calibration and validation phases into a single analysis; this was a pragmatic decision to manage a complex project across global trials in a manageable timeframe. Thirdly, we have not pre-defined thresholds for sensitivity and specificity for that would be acceptable for clinical practice or trial adoption in this protocol. Consensus work is required to define minimally acceptable criteria for diagnostic accuracy during future development and implementation of the WHQ . Fourthly, the WHQ can be administered any time during the 72 h preceding in-person assessment. Whilst there is a theoretical risk that patients could suffer a new SSI event 28 to 30 days after surgery that has not previously manifested, this is clinically improbable and is not supported by existing data [6, 70]. Another risk is that completion of telephone follow-up immediately prior to in-person follow-up may have a deleterious effect on in-person follow-up rates, overestimating the retention benefit. We have designed the TALON case report form and patient information to stress the need for both in-person and telephone follow-up, and can compare rates of attrition to the overall host trial population. Finally, the exploratory use of video follow-up in this study is not the central focus of this work. Whilst this will provide the first available data on video-based follow-up of surgical wounds in LMICs, contributing significantly to understanding of this area, further work is likely to be required to standardise protocols for ‘live’ video assessment and explore its reliability in depth.
At the time of submission (12 February 2021), adaptation and translation of the WHQ in TALON-1 has been completed. The FALCON trial has completed recruitment, and data from 1400 patients for the pilot cohort study in TALON-1 has been obtained for use in the Rasch analysis. Data for the TALON-2 validation study has been obtained for 350 patients to date; recruitment to the ChEETAh trial and TALON-2 validation study is ongoing.
Availability of data and materials
Upon completion of the TALON-1 and TALON-2 studies, data will be made available to other investigators upon request. This will be dependent upon the completion of a Data Sharing Agreement.
Study within a trial
Wound Healing Questionnaire
Universal reporter outcome measure
Feasibility and diagnostic accuracy of Telephone Administration of an adapted patient-reported wound heaLing QuestiONnaire for assessment of surgical site infection following abdominal surgery in low and middle-income countries
Pragmatic multi-centre factorial randomised controlled trial testing measures to reduce surgical site infection in low- and middle-income countries
Cluster randomised trial of sterile glove and instrument change at the time of wound closure to reduce surgical site infection. A trial in low- and middle-income countries
Surgical site (wound) infection
Allegranzi B, Bagheri Nejad S, Combescure C, Graafmans W, Attar H, Donaldson L, et al. Burden of endemic health-care-associated infection in developing countries: systematic review and meta-analysis. Lancet. 2011;377(9761):228–41. https://doi.org/10.1016/S0140-6736(10)61458-4.
Horan TC, Andrus M, Dudeck MA. CDC/NHSN surveillance definition of health care-associated infection and criteria for specific types of infections in the acute care setting. Am J Infect Control. 2008;36(5):309–32. https://doi.org/10.1016/j.ajic.2008.03.002.
Leaper DJ, van Goor H, Reilly J, Petrosillo N, Geiss HK, Torres AJ, et al. Surgical site infection - a European perspective of incidence and economic burden. Int Wound J. 2004;1(4):247–73. https://doi.org/10.1111/j.1742-4801.2004.00067.x.
Leaper DJ, Edmiston CE Jr, Holy CE. Meta-analysis of the potential economic impact following introduction of absorbable antimicrobial sutures. Br J Surg. 2017;104(2):e134–e44. https://doi.org/10.1002/bjs.10443.
Kirkland KB, Briggs JP, Trivette SL, Wilkinson WE, Sexton DJ. The impact of surgical-site infections in the 1990s: attributable mortality, excess length of hospitalization, and extra costs. Infect Control Hosp Epidemiol. 1999;20(11):725–30. https://doi.org/10.1086/501572.
GlobalSurg Collaborative. Surgical site infection after gastrointestinal surgery in high-income, middle-income, and low-income countries: a prospective, international, multicentre cohort study. Lancet Infect Dis. 2018;18(5):516-25. https://doi.org/10.1016/S1473-3099(18)30101-4.
Surgery NNIfHRGHRUoG. Prioritizing research for patients requiring surgery in low- and middle-income countries. Br J Surg. 2019;106(2):e113–e20. https://doi.org/10.1002/bjs.11037.
NIHR Global Health Research Unit on Global Surgery. Pragmatic multicentre factorial randomized controlled trial testing measures to reduce surgical site infection in low- and middle-income countries: study protocol of the FALCON trial. Colorectal Dis. 2021;23(1):298-306. https://doi.org/10.1111/codi.15354.
Forrester JA, Starr N, Negussie T, Schaps D, Adem M, Alemu S, Amenu D, Gebeyehu N, Habteyohannes T, Jiru F, Tesfaye A, Wayessa E, Chen R, Trickey A, Bitew S, Bekele A, Weiser TG. Clean Cut (adaptive, multimodal surgical infection prevention programme) for low-resource settings: a prospective quality improvement study. Br J Surg. 2020. https://doi.org/10.1002/bjs.11997.
NIHR-Global-Health-Research-Unit-on-Global-Surgery. Cheetah - sterile glove and clean instrument change at the time of wound closure to reduce surgical site infection (Cheetah) ClinicalTrials.gov. 2019. Available from: https://clinicaltrials.gov/ct2/show/NCT03980652.
NIHR-Global-Health-Research-Unit-on-Global-Surgery. Perioperative respiratory care and outcomes for patients undergoing high risk abdominal surgery (PENGUIN) (NCT04256798) ClinicalTrials.gov. 2020. Available from: https://clinicaltrials.gov/ct2/show/NCT04256798.
Meara JG, Hagander L, Leather AJM. Surgery and global health: a Lancet Commission. Lancet. 2014;383(9911):12–3. https://doi.org/10.1016/S0140-6736(13)62345-4.
Shrime MG, Dare AJ, Alkire BC, O'Neill K, Meara JG. Catastrophic expenditure to pay for surgery worldwide: a modelling study. Lancet Glob Health. 2015;3(Suppl 2):S38–44. https://doi.org/10.1016/S2214-109X(15)70085-9.
Verguet S, Alkire BC, Bickler SW, Lauer JA, Uribe-Leitz T, Molina G, et al. Timing and cost of scaling up surgical services in low-income and middle-income countries from 2012 to 2030: a modelling study. Lancet Glob Health. 2015;3(Suppl 2):S28–37. https://doi.org/10.1016/S2214-109X(15)70086-0.
COVIDSurg Collaborative. Mortality and pulmonary complications in patients undergoing surgery with perioperative SARS-CoV-2 infection: an international cohort study. Lancet. 2020;396(10243):27-38. https://doi.org/10.1016/S0140-6736(20)31182-X.
Glasbey JC, Nepogodiev D, Simoes JFF, Omar O, Li E, Venn ML, Pgdme, Abou Chaar MK, Capizzi V, Chaudhry D, Desai A, Edwards JG, Evans JP, Fiore M, Videria JF, Ford SJ, Ganly I, Griffiths EA, Gujjuri RR, Kolias AG, Kaafarani HMA, Minaya-Bravo A, McKay SC, Mohan HM, Roberts KJ, San Miguel-Méndez C, Pockney P, Shaw R, Smart NJ, Stewart GD, Sundar Mrcog S, Vidya R, Bhangu AA; COVIDSurg Collaborative. Elective Cancer Surgery in COVID-19-Free Surgical Pathways During the SARS-CoV-2 Pandemic: An International, Multicenter, Comparative Cohort Study. J Clin Oncol. 2021;39(1):66-78. https://doi.org/10.1200/JCO.20.01933.
Nguhuni B, De Nardo P, Gentilotti E, Chaula Z, Damian C, Mencarini P, et al. Reliability and validity of using telephone calls for post-discharge surveillance of surgical site infection following caesarean section at a tertiary hospital in Tanzania. Antimicrob Resist Infect Control. 2017;6(1):43. https://doi.org/10.1186/s13756-017-0205-0.
Arie S. Can mobile phones transform healthcare in low and middle income countries? Bmj. 2015;350(apr22 20):h1975. https://doi.org/10.1136/bmj.h1975.
Reeves BC, Andronis L, Blazeby JM, Blencowe NS, Calvert M, Coast J, et al. A mixed-methods feasibility and external pilot study to inform a large pragmatic randomised controlled trial of the effects of surgical wound dressing strategies on surgical site infections (Bluebelle Phase B): study protocol for a randomised controlled trial. Trials. 2017;18(1):401. https://doi.org/10.1186/s13063-017-2102-5.
Macefield R, Brookes S, Blazeby J, Avery K. Development of a ‘universal-reporter’ outcome measure (UROM) for patient and healthcare professional completion: a mixed methods study demonstrating a novel concept for optimal questionnaire design. BMJ Open. 2019;9(8):e029741. https://doi.org/10.1136/bmjopen-2019-029741.
Macefield RC, Reeves BC, Milne TK, Nicholson A, Blencowe NS, Calvert M, et al. Development of a single, practical measure of surgical site infection (SSI) for patient report or observer completion. J Infect Prev. 2017;18(4):170–9. https://doi.org/10.1177/1757177416689724.
Bluebelle-Study-Group. Validation of the Bluebelle Wound Healing Questionnaire for assessment of surgical-site infection in closed primary wounds after hospital discharge. Br J Surg. 2019;106(3):226–35. https://doi.org/10.1002/bjs.11008.
Elliott D, Bluebelle-Study-Group. Developing outcome measures assessing wound management and patient experience: a mixed methods study. BMJ Open. 2017;7(11):e016155.
Totty JP, Harwood AE, Wallace T, Smith GE, Chetter IC. Use of photograph-based telemedicine in postoperative wound assessment to diagnose or exclude surgical site infection. J Wound Care. 2018;27(3):128–35. https://doi.org/10.12968/jowc.2018.27.3.128.
Treweek S, Bevan S, Bower P, Campbell M, Christie J, Clarke M, et al. Trial Forge guidance 1: what is a study within a trial (SWAT)? Trials. 2018;19:139 England.
NIHR-Global-Health-Research-Unit-on-Global-Surgery. Cheetah - sterile glove and clean instrument change at the time of wound closure to reduce surgical site infection (Cheetah) (NCT03980652) ClinicalTrials.gov. 2019. Available from: https://clinicaltrials.gov/ct2/show/NCT03980652.
Reynolds J, Naiga S, Taaka L, Chandler C. Quality assurance of qualitative research: a suggested approach for assessing and strengthening qualitative research within global health trials The Global Health Network. 2019. Available from: https://globalhealthtrials.tghn.org/articles/quality-assurance-qualitative-research-suggested-approach-assessing-and-strengthening-qualitative-research-within-global-health/.
Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57. https://doi.org/10.1093/intqhc/mzm042.
Gaglio B, Henton M, Barbeau A, Evans E, Hickam D, Newhouse R, et al. Methodological standards for qualitative and mixed methods patient centered outcomes research. Bmj. 2020;371:m4435.
Cohen JF, Korevaar DA, Altman DG, Bruns DE, Gatsonis CA, Hooft L, et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open. 2016;6(11):e012799. https://doi.org/10.1136/bmjopen-2016-012799.
Hagell P, Hedin PJ, Meads DM, Nyberg L, McKenna SP. Effects of method of translation of patient-reported health outcome questionnaires: a randomized study of the translation of the Rheumatoid Arthritis Quality of Life (RAQoL) Instrument for Sweden. Value Health. 2010;13(4):424–30. https://doi.org/10.1111/j.1524-4733.2009.00677.x.
Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186–91. https://doi.org/10.1097/00007632-200012150-00014.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health. 2005;8(2):94–104. https://doi.org/10.1111/j.1524-4733.2005.04054.x.
Baena I, Padilla J. Cognitive interviewing in mixed research. Cognitive interviewing methodology. London: Wiley; 2014. p. 133–52.
Swaine-Verdier A, Doward LC, Hagell P, Thorsen H, McKenna SP. Adapting quality of life instruments. Value Health. 2004;7(Suppl 1):S27–30. https://doi.org/10.1111/j.1524-4733.2004.7s107.x.
Tennant A, Penta M, Tesio L, Grimby G, Thonnard JL, Slade A, et al. Assessing and adjusting for cross-cultural validity of impairment and activity limitation scales through differential item functioning within the framework of the Rasch model: the PRO-ESOR project. Med Care. 2004;42(1 Suppl):I37–48. https://doi.org/10.1097/01.mlr.0000103529.63132.77.
Andrich D. Rating scales and Rasch measurement. Expert Rev Pharmacoecon Outcomes Res. 2011;11(5):571–85. https://doi.org/10.1586/erp.11.59.
Tennant A, Conaghan PG. The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis Rheum. 2007;57(8):1358–62. https://doi.org/10.1002/art.23108.
Linacre M. Sample size and item calibration(or Person measure) stability: Rasch measurement transaction; rasch.org. 1994. Available from: https://www.rasch.org/rmt/rmt74m.htm.
Reeve BB, Willis G, Shariff-Marco SN, Breen N, Williams DR, Gee GC, et al. Comparing cognitive interviewing and psychometric methods to evaluate a racial/ethnic discrimination scale. Field Methods. 2011;23(4):397–419. https://doi.org/10.1177/1525822X11416564.
Benítez I, Padilla J. Analysis of nonequivalent assessments across different linguistic groups using a mixed methods approach: understanding the causes of differential item functioning by cognitive interviewing. J Mixed Methods Res. 2014;8(1):52–68. https://doi.org/10.1177/1558689813488245.
Latcheva R. Cognitive interviewing and factor-analytic techniques: a mixed method approach to validity of survey items measuring national identity. Qual Quant. 2011;45(6):1175–99. https://doi.org/10.1007/s11135-009-9285-0.
Noble H, Heale R. Triangulation in research, with examples. Evid Based Nurs. 2019;22:67–8 England.
Staniszewska S, Brett J, Simera I, Seers K, Mockford C, Goodlad S, et al. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. Bmj. 2017;358:j3453.
GlobalSurg Collaborative and National Institute for Health Research Global Health Research Unit on Global Surgery. Global variation in postoperative mortality and complications after cancer surgery: a multicentre, prospective cohort study in 82 countries. Lancet. 2021;397(10272):387-397. https://doi.org/10.1016/S0140-6736(21)00001-5.
GlobalSurg-Collaborative. Mortality of emergency abdominal surgery in high-, middle- and low-income countries. Br J Surg 2016;103(8):971-988, DOI: https://doi.org/10.1002/bjs.10151.
National Research Collaborative & Association of Surgeons in Training Collaborative Consensus Group. Recognising contributions to work in research collaboratives: Guidelines for standardising reporting of authorship in collaborative research. Int J Surg. 2018;52:355-60. https://doi.org/10.1016/j.ijsu.2017.12.019.
Sellars H, Ramsay G, Sunny A, Gunner CK, Oliphant R, Watson AJM. Video consultation for new colorectal patients. Color Dis. 2020;22(9):1015–21. https://doi.org/10.1111/codi.15239.
The Lancet Gastroenterology H. The potential of telemedicine in digestive diseases. Lancet Gastroenterol Hepatol. 2019;4(3):185.
Dorsey ER, Topol EJ. Telemedicine 2020 and the next decade. Lancet. 2020;395(10227):859. https://doi.org/10.1016/S0140-6736(20)30424-4.
Elhadi M, Elhadi A, Bouhuwaish A, Bin Alshiteewi F, Elmabrouk A, Alsuyihili A, et al. Telemedicine awareness, knowledge, attitude, and skills of health care workers in a low-resource country during the COVID-19 pandemic: cross-sectional study. J Med Internet Res. 2021;23(2):e20812. https://doi.org/10.2196/20812.
Moreau P, Ismael S, Masadeh H, Katib EA, Viaud L, Nordon C, et al. 3D technology and telemedicine in humanitarian settings. Lancet Digit Health. 2020;2(3):e108–e10. https://doi.org/10.1016/S2589-7500(20)30020-0.
Augestad KM, Sneve AM, Lindsetmo RO. Telemedicine in postoperative follow-up of STOMa PAtients: a randomized clinical trial (the STOMPA trial). Br J Surg. 2020;107(5):509–18. https://doi.org/10.1002/bjs.11491.
Raza A, Raza I, Drake TM, Sadar AB, Adil M, Baluch F, et al. The efficiency, accuracy and acceptability of smartphone-delivered data collection in a low-resource setting - a prospective study. Int J Surg. 2017;44:252–4. https://doi.org/10.1016/j.ijsu.2017.06.081.
Adepoju P. Africa turns to telemedicine to close mental health gap. Lancet Digit Health. 2020;2:e571–e2.
Woodfield J, Deo P, Davidson A, Chen TY, van Rij A. Patient reporting of complications after surgery: what impact does documenting postoperative problems from the perspective of the patient using telephone interview and postal questionnaires have on the identification of complications after surgery? BMJ Open. 2019;9(7):e028561. https://doi.org/10.1136/bmjopen-2018-028561.
Sandberg CEJ, Knight SR, Qureshi AU, Pathak S. Using telemedicine to diagnose surgical site infections in low- and middle-income countries: systematic review. JMIR Mhealth Uhealth. 2019;7(8):e13309. https://doi.org/10.2196/13309.
Starr N, Gebeyehu N, Tesfaye A, Forrester JA, Bekele A, Bitew S, et al. Value and feasibility of telephone follow-up in Ethiopian surgical patients. Surg Infect. 2020;21(6):533–9. https://doi.org/10.1089/sur.2020.054.
Sonderman KA, Nkurunziza T, Kateera F, Gruendl M, Koch R, Gaju E, et al. Using mobile health technology and community health workers to identify and refer caesarean-related surgical site infections in rural Rwanda: a randomised controlled trial protocol. BMJ Open. 2018;8(5):e022214. https://doi.org/10.1136/bmjopen-2018-022214.
Bastawrous A, Armstrong MJ. Mobile health use in low- and high-income countries: an overview of the peer-reviewed literature. J R Soc Med. 2013;106(4):130-42. https://doi.org/10.1177/0141076812472620.
Shrime M, Dare A, Alkire B, Meara J. Catastrophic expenditure to pay for surgery: a global estimate. Lancet Glob Health. 2016;3:38–44.
Meara JG, Leather AJ, Hagander L, Alkire BC, Alonso N, Ameh EA, et al. Global Surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Lancet. 2015;386(9993):569–624. https://doi.org/10.1016/S0140-6736(15)60160-X.
National Institute for Health Research Global Research Health Unit on Global Surgery. Delphi prioritization and development of global surgery guidelines for the prevention of surgical-site infection. Br J Surg. 2020;107(8):970-7. https://doi.org/10.1002/bjs.11530.
Calvert M, Kyte D, Price G, Valderas JM, Hjollund NH. Maximising the impact of patient reported outcome assessment for patients and society. Bmj. 2019;364:k5267.
Crocker JC, Ricci-Cabello I, Parker A, Hirst JA, Chant A, Petit-Zeman S, et al. Impact of patient and public involvement on enrolment and retention in clinical trials: systematic review and meta-analysis. Bmj. 2018;363:k4738.
Kearney A, Williamson P, Young B, Bagley H, Gamble C, Denegri S, et al. Priorities for methodological research on patient and public involvement in clinical trials: a modified Delphi process. Health Expect. 2017;20(6):1401–10. https://doi.org/10.1111/hex.12583.
Cook N, Siddiqi N, Twiddy M, Kenyon R. Patient and public involvement in health research in low and middle-income countries: a systematic review. BMJ Open. 2019;9(5):e026514. https://doi.org/10.1136/bmjopen-2018-026514.
Hobart JC, Cano SJ, Zajicek JP, Thompson AJ. Rating scales as outcome measures for clinical trials in neurology: problems, solutions, and recommendations. Lancet Neurol. 2007;6(12):1094–105. https://doi.org/10.1016/S1474-4422(07)70290-9.
Korevaar DA, Gopalakrishna G, Cohen JF, Bossuyt PM. Targeted test evaluation: a framework for designing diagnostic accuracy studies with clear study hypotheses. Diagn Progn Res. 2019;3(1):22. https://doi.org/10.1186/s41512-019-0069-2.
Reeves N, Cuff S, Boyce K, Harries R, Roberts C, Harrison W, et al. Diagnosis of colorectal and emergency surgical site infections in the era of enhanced recovery: an all-Wales prospective study. Color Dis. 2021;23(5):1239–47. https://doi.org/10.1111/codi.15569.
Collaborating authors (PubMed citable):
James Glasbey (UK), Victoria Adeyeye (Nigeria), Adesoji Ademuyiwa (Nigeria), Alisha Bhatt (India), Bruce Biccard (South Africa), Jane Blazeby (UK), Peter Brocklehurst (UK), Sohini Chakrabortee (UK), Jean De La Croix Allen Ingabire (Rwanda), Francis Moïse Dossou (Benin), Irani Durán (Mexico), Rohini Dutta (India), Dhruv Ghosh (India), Frank Gyamfi (Ghana), Parvez Haque (India), Pollyanna Hardy (UK), Gabriella Hyman (South Africa), Ritu Jain (India), Oluwaseun Ladipo-Ajayi (Nigeria), Ismail Lawani (Benin), Souliath Lawani (Benin), Mwayi Kachapila (UK), Karolin Kroese (UK), Rachel Lillywhite (UK), Rhiannon Macefield (UK), Laura Magill (UK), Janet Martin (Canada), Jonathan Mathers (UK), Punam Mistry (UK), Rohin Mittal (India), Mark Monahan (UK), Rachel Moore (South Africa), Dion Morton (UK), Faustin Ntirenganya (Rwanda), Emmanuel Ofori (Ghana), Rupert Pearse (UK), Alberto Peón (Mexico), Thomas Pinkney (UK), Antonio Ramos de la Medina (Mexico), Tubasiime Ronald (Rwanda), David Roman (Mexico), Anita Slade (UK), Stephen Tabiri (Ghana), Donna Smith (UK), Aneel Bhangu (UK).
TALON is funded through a doctoral research fellowship from the NIHR Academy (NIHR300175). The FALCON trial is funded by a National Institute for Health Research (NIHR) Global Health Research Unit Grant (NIHR 16.136.79). The funder and sponsor had no role in the study design or writing of this report. The funder has approved the submission of this report for publication. The views expressed are those of the authors and not necessarily those of the National Health Service, the NIHR, or the UK Department of Health and Social Care.
Ethics approval and consent to participate
The protocol amendment to include TALON-1 and TALON-2 in two host trials was obtained from the University of Birmingham International Ethics Committee: (1) Pragmatic multi-centre factorial randomised controlled trial testing measures to reduce surgical site infection in low- and middle-income countries (FALCON): Protocol amendment v1_0_substudies_v1_0. Reference: ERN_18-0230A; (2) ClustEr randomisEd Trial of sterile glove And instrument change at the time of wound closure to reduce surgical site infection (ChEETAh) v2.0_09.07.2019; Substudies v1.0_10.06.2020. Reference: ERN_19-0719. All individual participating countries have obtained local or national ethical approval for TALON-1 and TALON-2 in accordance with local requirements (available upon request). Written (or fingerprint) informed consent to participate will be obtained from all participants.
Consent for publication
No individual patient data is included in this report. Written (or fingerprint) consent was required for participant inclusion in the TALON-1 and TALON-2 studies. Consent form is available upon request.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Index test: Original Wound Healing Questionnaire first developed by Macefield et al. (J Infect Prev, 2017).
Reference standard: diagnostic criteria for surgical site infection used in FALCON and ChEETAh trials.
Extension for live video assessment of surgical wound.
About this article
Cite this article
NIHR Global Health Research Unit on Global Surgery. Feasibility and diagnostic accuracy of Telephone Administration of an adapted wound heaLing QuestiONnaire for assessment for surgical site infection following abdominal surgery in low and middle-income countries (TALON): protocol for a study within a trial (SWAT). Trials 22, 471 (2021). https://doi.org/10.1186/s13063-021-05398-z