- Open Access
Outcome reporting in randomised controlled trials and meta-analyses of appendicitis treatments in children: a systematic review
Trials volume 16, Article number: 275 (2015)
Acute appendicitis is the most common surgical emergency in children. Despite this, there is no core outcome set (COS) described for randomised controlled trials (RCTs) in children with appendicitis and hence no consensus regarding outcome selection, definition and reporting. We aimed to identify outcomes currently reported in studies of paediatric appendicitis.
Using a defined, sensitive search strategy, we identified RCTs and systematic reviews (SRs) of treatment interventions in children with appendicitis. Included studies were all in English and investigated the effect of one or more treatment interventions in children with acute appendicitis or undergoing appendicectomy for presumed acute appendicitis. Studies were reviewed and data extracted by two reviewers. Primary (if defined) and all other outcomes were recorded and assigned to the core areas ‘Death’, ‘Pathophysiological Manifestations’, ‘Life Impact’, ‘Resource Use’ and ‘Adverse Events’, using OMERACT Filter 2.0.
A total of 63 studies met the inclusion criteria reporting outcomes from 51 RCTs and nine SRs. Only 25 RCTs and four SRs defined a primary outcome. A total of 115 unique and different outcomes were identified. RCTs reported a median of nine outcomes each (range 1 to 14). The most frequently reported outcomes were wound infection (43 RCTs, nine SRs), intra-peritoneal abscess (41 RCTs, seven SRs) and length of stay (35 RCTs, six SRs) yet all three were reported in just 25 RCTs and five SRs. Common outcomes had multiple different definitions or were frequently not defined. Although outcomes were reported within all core areas, just one RCT and no SR reported outcomes for all core areas. Outcomes assigned to the ‘Death’ and ‘Life Impact’ core areas were reported least frequently (in six and 15 RCTs respectively).
There is a wide heterogeneity in the selection and definition of outcomes in paediatric appendicitis, and little overlap in outcomes used across studies. A paucity of studies report patient relevant outcomes within the ‘Life Impact’ core area. These factors preclude meaningful evidence synthesis, and pose challenges to designing prospective clinical trials and cohort studies. The development of a COS for paediatric appendicitis is warranted.
Acute appendicitis is the most common surgical emergency in children . The lifetime risk of developing appendicitis is 7-8 % with a peak incidence in the early teenage years. Traditionally, appendicectomy has been the gold standard treatment for acute appendicitis. This requires an inpatient stay, a surgical operation requiring general anaesthesia, and exposure to potential complications not only of the disease but also surgery. Whilst the majority of children recover from acute appendicitis, the disease carries a mortality of 0.08-0.31 per 1,000 cases in children .
In recent years, there has been growing interest in alternatives to appendicectomy. In particular, non-operative treatment of appendicitis, with antibiotics alone, has been proposed as a potential treatment. A small number of randomised controlled trials (RCTs) in adults [3–5] and, more recently, children [6, 7] suggest that antibiotic treatment may be a valid alternative to appendicectomy. However there is currently insufficient data to justify its widespread use. Prior to performing further efficacy studies of the treatment of appendicitis in children, it is imperative to identify the most relevant outcome measures for inclusion in the design of comparative studies. This is of particular importance when evaluating a novel treatment approach since the outcomes of importance may differ from those commonly reported with traditional therapies.
Core outcome sets (COS) have been proposed as a means of standardizing outcome selection, measurement and reporting in healthcare research and in clinical trials in particular [8, 9]. The development of a COS and its adoption by researchers is intended to help avoid inconsistencies in outcome selection, measurement and reporting that may otherwise exist. The lack of a COS may result in (i) important outcomes being overlooked or omitted in study design, (ii) inconsistent definitions or measurement techniques being used across studies and, (iii) omission of important outcomes from reports (reporting bias) . Selecting outcomes that are important to a range of stakeholders is important if research is to be meaningful and relevant. If trials do not adopt an established COS they risk selecting suboptimal outcomes and are unlikely to contribute usable information . The use of outcomes within a COS should also improve evidence synthesis across multiple studies (for example, meta-analysis) by removing inconsistencies in outcome selection, definition and reporting.
A review of the relevant literature and electronic resources failed to identify a COS for children with appendicitis. As the first stage of a process to develop a COS, we designed a study to determine which outcomes are currently reported in RCTs and systematic reviews (SRs) investigating treatment interventions in children (≤18 years) with acute appendicitis.
This review was performed in accordance with the PRISMA guidelines for systematic reviews (see Additional file 1 for compliance details)  and according to a defined protocol (provided as Additional file 2).
Study selection criteria
Studies from the existing literature were selected in order to address our specific research question using the following criteria.
Types of studies
We included systematic reviews of RCTs with or without meta-analysis, and randomised controlled trials.
Types of intervention
Any medical or surgical intervention intended as treatment, or as a component of the treatment, of patients ≤18 years of age (that is, children, infants or babies) with acute appendicitis was included. For the purposes of this review, we did not apply a specific definition of acute appendicitis, for example, one based on diagnostic imaging or pathology findings, because not all participants of individual studies had diagnostic imaging or pathology on a surgical specimen. This is consistent with contemporary surgical practice. Rather, we included studies on the basis that the population being reported had a diagnosis of acute appendicitis, regardless of how it was defined in the individual study.
Types of participants
Participants were children aged ≤18 years with acute appendicitis.
Studies in which the purpose of the intervention was for symptom control rather than treatment of disease including analgesic interventions and interventions to treat nausea and vomiting, studies comparing one or more diagnostic techniques, RCTs that reported a population that included any patient over 18 years of age without a subgroup analysis containing only children ≤18 years, studies that included any patient with a diagnosis other than acute appendicitis, studies reported in abstract form only such as conference proceedings, and any study that was not written in English were all excluded. Interim reports of a study for which the final report was included were excluded as were prior versions of SRs for which the review had been more recently updated and was included.
Searches were conducted by an academic health information specialist (CN) in April 2014 in the following databases: MEDLINE (1946 - 22 April 22 2014 and including the “In-process & Other Non-Indexed” segment), Embase (1947 to 2014 Week 16) and Cochrane Central Register of Controlled Trials - CCRCT (1991 - 22 April 2014). Database specific subject headings were selected for the concepts of appendicitis, children and randomised controlled trial study design. Database subject headings were exploded, when applicable, to include narrower terms. Free text word searches were generated for all of the concepts using the database ‘Used For’ terms. In all databases, adjacency operators and truncation symbols were used in text word searches when appropriate to capture variations in phrasing and expression of terms. All synonymous terms were combined first using the Boolean “OR.” The three distinct concepts related to intervention, population, and study design were combined with the Boolean “AND” in MEDLINE and Embase. In CCRCT, only the concepts of appendicitis and children were searched and combined with “AND.” No language or date restrictions were applied. A detailed search strategy for MEDLINE is described in Appendix 1. We limited our search to the three electronic databases and did not search other sources with the exception of searching the reference lists of SRs for RCTs that were not identified by our literature search.
Two reviewers (NJH and MZK) independently assessed the titles and abstracts of all identified citations. Full-text articles were retrieved if either reviewer considered the citation potentially relevant with a low threshold for retrieval. Full texts of selected studies were then critically reviewed to assess eligibility. Reasons for exclusion of studies were recorded. The bibliographies of studies included for full-text review were also evaluated for additional relevant references. The final set of studies which was included in the systematic review was determined by consensus (between NH and MZK) with any disagreements resolved by a third reviewer (SE).
Data were extracted independently and in duplicate by two reviewers (NJH and MZK) who then reviewed the extracted data together to ensure accuracy. Disagreements were resolved by a third reviewer (SE) when necessary. The following data were extracted from each study: study design (RCT or SR), year of study, region of origin, sample size, use of a primary outcome, all outcomes reported, and provision of a definition of each outcome. An outcome was included as reported whether it was included in the methods section, results section, or both. A study was deemed to use a primary outcome if the words ‘primary outcome’ were stated in the report, if data for a particular outcome were used to generate a sample size for a study, or if the stated aim of a study was to investigate the effect of an intervention on a single specific outcome or single defined composite outcome.
Assessment of the similarity of outcomes
We anticipated diversity in the terminology used to report outcomes and therefore grouped similar outcomes. We identified outcomes that seemed similar or of a similar theme despite differing definitions used across studies and assigned an appropriate term to them. For instance, the outcomes ‘fever on post-operative day 3’, ‘duration of post-operative fever’ and ‘episodes of fever’ were all included in the term ‘post-operative fever’. We defined an additional outcome term of ‘other single outcome’ when an outcome was reported by a single study that could not naturally be mapped to any other outcome term.
Where a composite outcome was used we considered each individual component of the composite individually and included each in analysis but excluded the composite outcome from analysis. For example the outcome ‘surgical site infection’ was excluded unless its components of ‘wound infection’ and ‘intra-abdominal abscess’ were not reported separately.
Assignment of outcome terms to core areas
Each individual outcome term was assigned to one of five core areas identified from the OMERACT Filter 2.0 . The OMERACT Filter 2.0 is a framework developed to ensure that a full breadth of outcomes is reported by RCTs during the development of a COS. The OMERACT Filter 2.0 includes the four core areas of ‘Death’, ‘Pathophysiological Manifestations’, ‘Life Impact’, and ‘Resource Use’. It further recommends that ‘Adverse Events’ are reported across all core areas. For the purposes of this review, we included ‘Adverse Events’ as a fifth core area. Terms were mapped to core areas independently by two reviewers (NJH and MZK), and discrepancies were resolved by a third reviewer (SE) as necessary. We then determined the number of studies that provided an outcome within each core area and the number of core areas covered by each individual study in this review.
The total number of studies identified and included and the number of different outcomes identified in both RCTs and SRs were counted and reported separately to avoid double counting of outcomes. Although some of the RCTs do contribute to some of the SRs, our descriptive reporting means that this does not impact our findings. The number of outcome terms, variations in definition for each outcome term and number of terms reported by each study are reported and illustrated graphically. Finally, we identified the number of outcome terms assigned to each core area and the number of core areas covered by each included study. All these data are reported descriptively with appropriate summary measures for non-parametric data. Since we did not capture quantitative outcome data from individual studies, rather which outcomes were selected and reported, it is inappropriate to assess heterogeneity between studies formally using an I2 statistic or similar.
Identification and description of included studies.
A flow diagram detailing article selection is shown in Fig. 1. Our search yielded a total of 1,728 articles (620 from Medline, 633 from EMBASE, and 475 from CCRCT). Screening of 929 non-duplicate titles and abstracts identified 201 citations to undergo full text review. One study  was excluded as it reported interim results of a trial that was subsequently reported in full and included in this review . Early versions of two SRs were excluded [15–18] as they were prior versions of subsequently updated (and included) SRs [19, 20].
A total of 63 articles met the specified inclusion criteria and were included in this review. Nine of these were SRs, with or without meta-analysis, including two Cochrane reviews [19, 20]. The remaining 54 published articles reported outcomes from 51 RCTs, as three of the RCTs provided data for two articles each. Myers et al.  reported cost-related outcomes of the trial for which clinical outcomes were separately reported by Blakely et al. . Schurman et al.  reported patient and parent quality of life outcomes of the trial for which clinical outcomes were reported by St Peter et al. . Gasior et al.  reported cosmetic outcomes of the trial for which the clinical outcomes were reported by St Peter et al. . For the purposes of analysis, the data arising from these three supplementary articles were amalgamated with the clinical outcomes. We therefore present outcomes reported in 51 RCTs and 9 SRs.
The characteristics of included studies are found in Table 1. Years of publication were between 1973 and 2013 for RCTs and between 2005 and 2013 for SRs. The median total sample size for each RCT was 100 children (range 25 to 1083). The region of origin for the RCTs included North America (n = 18), Europe (n = 22), Asia (n = 8), Africa (n = 1), Australasia (n = 2) and Central America (n = 1). The interventions investigated in each study fell into two broad categories: (A) investigation of antibiotic type, route of administration, or duration; (B) investigation of a type of surgical intervention, including type and timing of wound closure, use of a peritoneal drain, type of peritoneal access (for example, open, laparoscopic, single incision laparoscopic), timing of appendicectomy, and type of insufflation gas during laparoscopic appendectomy. A total of 28 RCTs fell into category A and 23 into category B. Two systematic reviews were related to antibiotic use (category A) and seven to type of surgical intervention (category B).
Description of outcomes in RCTs
A total of 115 different unique outcomes were identified in the 51 RCTs. One hundred and six of these outcomes were mapped to the 38 terms shown in Fig. 2, and 12 outcomes were mapped to the additional term ‘other single outcome’. Each RCT reported a median of nine “unmapped” outcomes (range 1-14). The most frequently reported outcome was wound infection, which was reported in 43 RCTs (84.3 %) and was the primary outcome or a component of a composite primary outcome in nine RCTs (17.6 %). Figure 3a shows the distribution of primary and secondary outcome terms across individual RCTs. A primary outcome was identified in 26 RCTs (50.9 %). In addition to a wide range in number of outcomes reported in each study, there was great heterogeneity in terms reported across studies. For example only 25 of the 51 (49 %) RCTs reported all of the three most frequently reported terms (wound infection, abscess formation and length of stay). Definitions are shown in Table 2 for outcomes identified in RCTs for which there may be variability dependent on the definition. We identified multiple definitions used for many outcomes, apparently leading to different occurrence frequencies of “similar outcomes” across studies. For wound infection, the most frequently reported outcome, there were a total of 11 different definitions identified in 43 RCTs, 31 of which reported no definition. Finally, work was undertaken to ascertain whether any substantial changes occurred in the reported outcomes over the period of publication covered by this study (1973-2013), but none was found.
Description of outcomes in systematic reviews
A total of 31 different outcomes were identified in the nine SRs and were mapped to the same terms shown in Fig. 2. The most frequently reported outcome in SRs was also wound infection, which was reported in all SRs. The distribution of primary and secondary outcome terms across individual SRs is shown in Fig. 3b. A primary outcome was identified in four SRs, including a composite primary outcome in two. Definitions of outcomes used in SRs are shown in Table 3. Outcomes were generally poorly defined in SRs, which often replicated the definition used in individual studies contributing to the review.
Assignment of outcome terms to core areas
Thirty-seven of the 38 outcome terms were assigned to core areas defined by OMERACT Filter 2.0; the outcome term ‘other single outcome’ could not be mapped due to its definition and inherent heterogeneity. The assignment of outcome terms to core areas is shown in Fig. 2. The core area populated most heavily was ‘Adverse Events’ (n = 13 outcome terms), followed by ‘Life Impact’ (n = 10 outcome terms). With the exception of the core area ‘Death’, the core area of ‘Pathophysiological Manifestations’ was populated least (n = 5 outcome terms).
All RCTs and SRs reported at least one outcome assigned to the ‘Adverse Event’ core area. The median number of core areas to which outcome terms were assigned in both RCTs and SRs was three. Two RCTs reported outcomes assigned to just one core area, and only one RCT  reported outcomes assigned to all five core areas (Fig. 4a). For SRs, two studies reported outcomes in just one core area, whereas no SR reported outcomes in all five core areas (Fig. 4b). With the exception of death (reported in 6 RCTs and no SRs) the core area ‘Life Impact’ was reported least frequently (15 RCTs and 3 SRs).
We have analysed outcome reporting from a large number of RCTs and SRs relating to the treatment of acute appendicitis in children. The principal findings of our review are 1) a wide heterogeneity of outcomes reported between individual studies, 2) the lack of a standardised definition for commonly reported outcomes (including absence of any definition), 3) little overlap in outcomes used across studies, and 4) a relative paucity of studies reporting patient relevant outcomes within the ‘Life Impact’ core area. These findings have implications for the validity of comparisons made between individual RCTs, not only within meta-analyses, but also for the practising surgeon when making a best practice judgement based on best available evidence. Our findings also suggest that patient or parent involvement in defining appropriate outcomes for this condition has been limited. The majority of outcomes are highly clinically focused, suggesting that they have been proposed by and considered important to, clinicians. A similar phenomenon was identified by a recent review of studies reporting COS development . Overall, our study provides justification for the development of a COS for acute appendicitis in children. It also highlights the need for such an outcome set to use standardised definitions of included outcomes and for the involvement of multiple key stakeholder groups, particularly patients and parents, in both identifying candidate outcomes and within any consensus process leading to definition of a COS. In line with the principles of COS development, such a COS for paediatric appendicitis has the capacity to improve the quality of outcome selection and reporting carrying clear benefits for researchers, clinicians and patients.
This study suggests that the outcomes judged to be of greatest relevance to clinicians and researchers are wound infection and intra-abdominal abscess formation. At least one of these outcomes was reported in 94 % of RCTs and all SRs. Despite this, only a minority of each type of study used a standardised definition for either outcome. A wide variety of definitions were also used for other frequently reported outcomes. The issue of a lack of definition of commonly reported outcomes is not unique to paediatric appendicitis. Previous studies of other health conditions have highlighted variability in definitions [28–30] including one study that identified 56 separate definitions for the same outcome across a review of 97 studies . The lack of definition and variation in definitions across a single outcome severely hampers attempts to compare results between studies. A precise and standardised definition of any outcome measure is one of the key principles underlying selection of an outcome within a COS.
A large number of studies (nearly half of all RCTs and over half of SRs) did not define a primary outcome. It is therefore not possible to determine which outcome researchers considered most important to measure for these studies. Further consequences of the lack of primary outcome are the possibility of reporting bias since it is not known whether only statistically significant outcomes are reported and that these studies may have lacked sufficient power to determine effect of treatment intervention.
We identified further methodological inconsistencies that may also act as a source of bias within RCTs. For instance, a number of RCTs stated that an outcome would be measured in the methods section but it was then never actually reported. Whilst we do not believe this type of inconsistency has impacted our results because we specifically included outcomes mentioned in either ‘methods’ or ‘results’ section of each report, this observation clearly reflect reporting bias within individual studies. Other methodological issues encountered within RCTs included randomization techniques that may be subject to lack of concealment. Whilst some reviews of outcome reporting have included an assessment of the methodological quality of RCTs to identify potential sources of bias , we did not complete a full methodological assessment for each study included in our review. We do not believe that other biases that may exist within RCTs have influenced the primary objective of our study, namely to identify outcomes reported by existing RCTs and SRs. The exception to this is reporting bias for which we used a specific strategy to identify outcomes that were planned to be reported as well as those that actually were. As a result we feel the chances that we have missed important outcomes are minimal.
In recent years, the COMET (Core Outcome Measures in Effectiveness Trials) initiative  has strongly supported the development of core outcome sets to standardise outcome definitions and measurement for studies that assess the efficacy of a treatment. The expectation is that a trial investigating treatment of a condition should always measure and report (as a minimum) each outcome within a COS where one exists for that condition. Further guidance from groups such as OMERACT [12, 33] has supported the importance of reporting a wide breadth of outcomes across a number of core areas to ensure that each COS is relevant for multiple stakeholder groups and in particular the patient. Whilst all five core areas were fulfilled with outcomes in our review, outcomes which may be of greater relevance to patients or parents, or provide an assessment of outcome from a patient or parental perspective in the ‘Life Impact’ core area were rarely reported. For example, only three of the 23 RCTs relating to type of surgical intervention reported any marker of cosmesis as an outcome [26, 34, 35], and only one RCT used a validated patient or parental quality of life assessment tool . Based on our experience in this review, the OMERACT filter 2.0 likely acts as a useful framework for researchers to ensure that all core areas are fulfilled when developing a COS and designing a RCT.
However, the OMERACT Filter 2.0 may have some limitations. It was developed primarily for designing trials within the field of rheumatology  and has subsequently been proposed as an appropriate framework for other fields . Hence there may be specialty-specific or age-group specific factors that affect the suitability of the filter for other fields. In assigning outcome terms to OMERACT core areas, we encountered several examples where an outcome term could potentially be assigned to more than one core area. For example, hospital length of stay could be considered in the context of (ongoing) ‘Pathophysiological Manifestations’, or within ‘Resource Use’ or ‘Life Impact’. We did not identify any outcome terms that could not be readily assigned to any of the OMERACT core areas but would urge those developing core outcome sets to be critical in their assignment of outcomes to ensure that all core areas are genuinely covered in any COS.
In addition to proposing core areas, the OMERACT framework goes further, identifying essential characteristics of outcome measures within a COS which should be ‘truthful’, ‘discriminative’ and ‘feasible’ . The lack of definitions of outcomes we have identified would clearly not pass these criteria. It is essential that this is addressed in the development of a COS. Whilst it is possible that the reason important core areas such as ‘Life Impact’ have been relatively ignored in existing studies is because of a lack of reliable and valid measures, we suspect this it is not the case and that a focus on clinician relevant outcomes is a more likely explanation.
The principal strengths of this systematic review are the extensive literature searches in multiple bibliographical databases over a long time period. We captured a wide range of outcomes with a variety of definitions. Whilst a limitation of our methodology to include only RCTs and SRs means that it is possible that other outcomes reported in other types of study have been missed, we are confident that our methodology has enabled us to capture outcomes that researchers and clinicians consider important. The main weakness of our study is that our search for outcomes has been limited to those reported in the existing literature. We are unable to comment on outcomes that may not have been reported in the existing literature or are important to other stakeholder groups, in particular patient and parents, but also other health professionals such as nurses and family doctors. The importance of engaging patients and parents in research and in particular in defining outcomes of importance is being increasingly recognized. Only by ensuring that patients and parents are involved in determining which outcomes should be measured can we be confident that treatment interventions are investigated in a way that is relevant to the target population. This aspect will be key in developing a COS. Outcomes may also not have been reported in RCTs and SRs due to selective reporting bias, a relatively common phenomenon . While our systematic review highlighted the heterogeneity of outcome reporting, outcome reporting bias has a more detrimental effect on quantitative meta-analyses to establish benefit (or harm) of an intervention, which was not the objective of our current study.
Although acute appendicitis is the most common abdominal surgical emergency in children, and is one of the few areas in paediatric surgery that has been the subject of multiple RCTs, there is no COS for the condition. Existing outcomes are heavily biased towards clinician and researcher areas of interest rather than patient/parent relevant factors and do not use standardised definitions. This study supports our commitment to develop a COS for acute appendicitis in children to ensure that outcomes measured in future studies of existing and novel therapies are relevant to multiple stakeholder groups and that studies can be compared, combined and contrasted meaningfully. We now intend to complete a consensus process amongst these stakeholder groups to develop a COS for acute appendicitis in children consistent with the principles of the OMERACT framework and for use in future trials of treatment interventions.
There is a wide heterogeneity in the selection and definition of outcomes in RCTs and SRs of paediatric appendicitis with little overlap in outcomes used across studies. A paucity of studies report patient relevant outcomes within the ‘Life Impact’ core area. These factors impair meaningful evidence synthesis, and pose challenges to those designing prospective clinical trials and cohort studies. The commitment to develop a COS for paediatric appendicitis is justified.
Core Outcome Measures in Effectiveness Trials
core outcome set
outcome measures in rheumatology clinical trials
patient reported outcome measure
randomised controlled trial
white cell count
St Peter SD, Tsao K, Spilde TL, Holcomb III GW, Sharp SW, Murphy JP, et al. Single daily dosing ceftriaxone and metronidazole versus standard triple antibiotic regimen for perforated appendicitis in children: a prospective randomized trial. J Pediatr Surg. 2008;43:981–5.
Blomqvist PG, Andersson RE, Granath F, Lambe MP, Ekbom AR. Mortality after appendectomy in Sweden, 1987–1996. Ann Surg. 2001;233:455–60.
Styrud J, Eriksson S, Nilsson I, Ahlberg G, Haapaniemi S, Neovius G, et al. Appendectomy versus antibiotic treatment in acute appendicitis. a prospective multicenter randomized controlled trial. World J Surg. 2006;30:1033–7.
Hansson J, Korner U, Khorram-Manesh A, Solberg A, Lundholm K. Randomized clinical trial of antibiotic therapy versus appendicectomy as primary treatment of acute appendicitis in unselected patients. Br J Surg. 2009;96:473–81.
Vons C, Barry C, Maitre S, Pautrat K, Leconte M, Costaglioli B, et al. Amoxicillin plus clavulanic acid versus appendicectomy for treatment of acute uncomplicated appendicitis: an open-label, non-inferiority, randomised controlled trial. Lancet. 2011;377:1573–9.
Svensson JF, Patkova B, Almstrom M, Naji H, Hall NJ, Eaton S, et al. Nonoperative treatment with antibiotics versus surgery for acute nonperforated appendicitis in children: a pilot randomized controlled trial. Ann Surg. 2014;261:67–71.
Minneci PC, Sulkowski JP, Nacion KM, Mahida JB, Cooper JN, Moss RL, et al. Feasibility of a nonoperative management strategy for uncomplicated acute appendicitis in children. J Am Coll Surg. 2014;219:272–9.
Sinha IP, Altman DG, Beresford MW, Boers M, Clarke M, Craig J, et al. Standard 5: selection, measurement, and reporting of outcomes in clinical trials in children. Pediatrics. 2012;129 Suppl 3:S146–52.
Williamson P, Altman D, Blazeby J, Clarke M, Gargon E. Driving up the quality and relevance of research through the use of agreed core outcomes. J Health Serv Res Policy. 2012;17:1–2.
Gargon E, Gurung B, Medley N, Altman DG, Blazeby JM, Clarke M, et al. Choosing important health outcomes for comparative effectiveness research: a systematic review. PLoS One. 2014;9:e99111.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.
Boers M, Kirwan JR, Gossec L, Conaghan PG, D'Agostino MA, Bingham III CO, et al. How to choose core outcome measurement sets for clinical trials: OMERACT 11 approves filter 2.0. J Rheumatol. 2014;41:1025–30.
Foster MC, Kapila L, Morris DL, Slack RC. A randomized comparative study of sulbactam plus ampicillin vs metronidazole plus cefotaxime in children. REV INFECT DIS. 1986;8 Suppl 5:S634–8.
Foster MC, Morris DL, Legan C, Kapila L, Slack RCB. Perioperative prophylaxis with sulbactam and ampicillin compared with metronidazole and cefotaxime in the prevention of wound infection in children undergoing appendectomy. J Pediatr Surg. 1987;22:869–72.
Sauerland S, Lefering R, Neugebauer EA. Laparoscopic versus open surgery for suspected appendicitis. Cochrane Database Syst Rev. 2004;4:CD001546.
Andersen BR, Kallehave FL, Andersen HK. Antibiotics versus placebo for prevention of postoperative infection after appendicectomy. Cochrane Database Syst Rev. 2001;2:CD001439.
Andersen BR, Kallehave FL, Andersen HK. Antibiotics versus placebo for prevention of postoperative infection after appendicectomy. Cochrane Database Syst Rev. 2003;2:CD001439.
Sauerland S, Lefering R, Neugebauer EA. Laparoscopic versus open surgery for suspected appendicitis. Cochrane Database Syst Rev. 2002;1:CD001546.
Andersen BR, Kallehave FL, Andersen HK. Antibiotics versus placebo for prevention of postoperative infection after appendicectomy. Cochrane Database Syst Rev. 2005;3:CD001439.
Sauerland S, Jaschinski T, Neugebauer EA. Laparoscopic versus open surgery for suspected appendicitis. Cochrane Database Syst Rev. 2010;10:CD001546.
Myers AL, Williams RF, Giles K, Waters TM, Eubanks III JW, Hixson SD, et al. Hospital cost analysis of a prospective, randomized trial of early vs interval appendectomy for perforated appendicitis in children. J Am Coll Surg. 2012;214:427–34.
Blakely ML, Williams R, Dassinger MS, Eubanks III JW, Fischer P, Huang EY, et al. Early vs interval appendectomy for children with perforated appendicitis. Arch Surg. 2011;146:660–5.
Schurman JV, Cushing CC, Garey CL, Laituri CA, St. Peter SD. Quality of life assessment between laparoscopic appendectomy at presentation and interval appendectomy for perforated appendicitis with abscess: Analysis of a prospective randomized trial. J Pediatr Surg. 2011;46:1121–4.
St Peter SD, Aguayo P, Fraser JD, Keckler SJ, Sharp SW, Leys CM, et al. Initial laparoscopic appendectomy versus initial nonoperative management and interval appendectomy for perforated appendicitis with abscess: a prospective, randomized trial. J Pediatr Surg. 2010;45:236–40.
Gasior AC, Knott EM, Holcomb III GW, Ostlie DJ, Peter SD. S. Patient and parental scar assessment after single incision versus standard 3-port laparoscopic appendectomy: Long-term follow-up from a prospective randomized trial. J Pediatr Surg. 2014;49:120–2.
St Peter SD, Adibe OO, Juang D, Sharp SW, Garey CL, Laituri CA, et al. Single incision versus standard 3-port laparoscopic appendectomy: a prospective randomized trial. Ann Surg. 2011;254:586–90.
Lejus C, Delile L, Plattner V, Baron M, Guillou S, Heloury Y, et al. Randomized, single-blinded trial of laparoscopic versus open appendectomy in children: Effects on postoperative analgesia. Anesthesiology. 1996;84:801–6.
Blencowe NS, Strong S, McNair AG, Brookes ST, Crosby T, Griffin SM, et al. Reporting of short-term clinical outcomes after esophagectomy: a systematic review. Ann Surg. 2012;255:658–66.
Bhangu A, Singh P, Pinkney T, Blazeby JM. Hernia: A detailed analysis of outcome reporting from randomised controlled trials and meta-analyses of inguinal hernia repair. Hernia. 2015;19:65–75.
Johnston BC, Shamseer L, da Costa BR, Tsuyuki RT, Vohra S. Measurement issues in trials of pediatric acute diarrheal diseases: a systematic review. Pediatrics. 2010;126:e222–31.
Bruce J, Krukowski ZH, Al-Khairy G, Russell EM, Park KG. Systematic review of the definition and measurement of anastomotic leak after gastrointestinal surgery. Br J Surg. 2001;88:1157–68.
Gargon E, Williamson PR, Altman DG, Blazeby JM, Clarke M. The COMET Initiative database: progress and activities from 2011 to 2013. Trials. 2014;15:279.
Boers M, Kirwan JR, Wells G, Beaton D, Gossec L, D'Agostino MA, et al. Developing core outcome measurement sets for clinical trials: OMERACT filter 2.0. J Clin Epidemiol. 2014;67:745–53.
Malik AH, Wani RA, Saima BD, Wani MY. Small lateral access-an alternative approach to appendicitis in paediatric patients: A randomised controlled trial. Int J Surg. 2007;5:234–8.
Romero P, Frongia G, Wingerter S, Holland-Cunz S. Prospective, randomized, controlled trial comparing a tissue adhesive (Dermabond) with adhesive strips (Steri-Strips) for the closure of laparoscopic trocar wounds in children. Eur J Pediatr Surg. 2011;21:159–62.
Saini P, Loke YK, Gamble C, Altman DG, Williamson PR, Kirkham JJ. Selective reporting bias of harm outcomes within studies: findings from a cohort of systematic reviews. BMJ. 2014;349:g6501.
Haller J, Shaker IJ, Donahoo JS. Peritoneal drainage versus non drainage for generalized peritonitis from ruptured appendicitis in children: A prospective study. Ann Surg. 1973;177:595–600.
Bates T, Down RH, Houghton MC, Lloyd GJ. Topical ampicillin in the prevention of wound infection after appendicectomy. Br J Surg. 1974;61:489–92.
Fowler R. A controlled trial of intraperitoneal cephaloridine administration in peritonitis. J Pediatr Surg. 1975;P10:43–50.
Sherman JO, Luck SR, Borger JA. Irrigation of the peritoneal cavity for appendicitis in children: a double blind study. J Pediatr Surg. 1976;11:371–4.
Giacomantonio M, Bortolussi R, Gillis DA. Should prophylactic antibiotics be given perioperatively in acute appendicitis without perforation? Can J Surg. 1982;25:555–6.
Hutchinson GH, Patel BG, Doig CM. A double-blind controlled trial of metronidazole suppositories in children undergoing appendicectomy. Curr Med Res Opin. 1983;8:441–5.
King DR, Browne AF, Birken GA. Antibiotic management of complicated appendicitis. J Pediatr Surg. 1983;18:945–50.
Gutierrez C, Vila J, Garcia-Sala C, Velazques J, Otero M, Santos M, et al. Study of appendicitis in children treated with four different antibiotic regimens. J Pediatr Surg. 1987;22:865–8.
Thomson SR, Carle G, Reid TM, Davidson AI, Miller SS. Antibiotic prophylaxis in non-perforated appendicitis of childhood: tetracycline lavage compared with peroperative intravenous cefuroxime and metronidazole. J Hosp Infect. 1987;9:158–61.
McAllister TA, Fyfe AHB, Young DG, Raine PAM. Cefotaxime lavage in children undergoing appendicectomy. Drugs. 1988;35 Suppl 2:127–32.
Schmitt M, Bondonny JM, Delmas P, Galifer RB, Revillon Y, Robert M, et al. Antibiotic therapy of perforated appendicitis in children: a comparison of amoxycillin/clavulanate with a combination of benzylpenicillin, netilmicin and metronidazole. J Antimicrob Chemother. 1989;24(Suppl B):157–63.
Kooi GH, Pit S. Ceftazidime/metronidazole versus netilmicin/metronidazole in the treatment of perforated appendicitis in children. Clin Ther. 1990;12:54–60.
Meller JL, Reyes HM, Loeff DS, Federer L, Hall JR. One-drug versus two-drug antibiotic therapy in pediatric perforated appendicitis: A prospective randomized study. Surgery (USA). 1991;110:764–8.
Pokorny WJ, Kaplan SL, Mason EOJ. A preliminary report of ticarcillin and clavulanate versus triple antibiotic therapy in children with ruptured appendicitis. Surg Gynecol Obstet. 1991;172(Suppl):54–6.
Schropp KP, Kaplan S, Golladay ES, King DR, Pokorny W, Mollitt DL, et al. A randomized clinical trial of ampicillin, gentamicin and clindamycin versus cefotaxime and clindamycin in children with ruptured appendicitis. Surg Gynecol Obstet. 1991;172:351–6.
Kizilcan F, Tanyel FC, Buyukpamukcu N, Hicsonmez A. The necessity of prophylactic antibiotics in uncomplicated appendicitis during childhood. J Pediatr Surg. 1992;27:586–8.
Tsang TM, Tam PK, Saing H. Delayed primary wound closure using skin tapes for advanced appendicitis in children. A prospective, controlled study. Arch Surg. 1992;127:451–3.
Uhari M, Seppanen J, Heikkinen E. Imipenem-cilastatin vs. tobramycin and metronidazole for appendicitis-related infections. Pediatr Infect Dis J. 1992;11:445–50.
Banani SA, Amirghofran AA. The role and value of oral metronidazole in acute appendicitis. Pediatr Surg Int. 1995;10:101–4.
Soderquist-Elinder C, Hirsch K, Bergdahl S, Rutqvist J, Frenckner B. Prophylactic antibiotics in uncomplicated appendicitis during childhood–a prospective randomised study. Eur J Pediatr Surg. 1995;5:282–5.
Toki A, Ogura K, Horimi T, Tokuoka H, Todani T, Watanabe Y, et al. Peritoneal lavage versus drainage for perforated appendicitis in children. Surg Today. 1995;25:207–10.
Ciftci AO, Tanyel FC, Buyukpamukcu N, Hicsonmez A. Comparative trial of four antibiotic combinations for perforated appendicitis in children. Eur J Surg. 1997;163:591–6.
Banani SA, Talei A. Can oral metronidazole substitute parenteral drug therapy in acute appendicitis? A new policy in the management of simple or complicated appendicitis with localized peritonitis: a randomized controlled clinical trial. Am Surg. 1999;65:411–6.
Gorecki WJ, Grochowski JA. Are antibiotics necessary in nonperforated appendicitis in children? A double blind randomized controlled trial. Med Sci Monit. 2001;7:289–92.
Lavonius MI, Liesjarvi S, Ovaska J, Pajulo O, Ristkari S, Alanen M. Laparoscopic versus open appendectomy in children: a prospective randomised study. Eur J Pediatr Surg. 2001;11:235–8.
Lintula H, Kokki H, Vanamo K. Single-blind randomized clinical trial of laparoscopic versus open appendicectomy in children. Br J Surg. 2001;88:510–4.
Rice HE, Brown RL, Gollin G, Caty MG, Gilbert J, Skinner MA, et al. Results of a pilot trial comparing prolonged intravenous antibiotics with sequential intravenous/oral antibiotics for children with perforated appendicitis. Arch Surg. 2001;136:1391–5.
Shalaby R, Arnos A, Desoky A, Samaha AH. Laparoscopic appendectomy in children: evaluation of different techniques. Surg Laparosc Endosc Percutan Tech. 2001;11:22–7.
Lintula H, Kokki H, Vanamo K, Antila P, Eskelinen M. Laparoscopy in children with complicated appendicitis. J Pediatr Surg. 2002;37:1317–20.
Little DC, Custer MD, May BH, Blalock SE, Cooney DR. Laparoscopic appendectomy: An unnecessary and expensive procedure in children? J Pediatr Surg. 2002;37:310–7.
Tander B, Pektas O, Bulut M. The utility of peritoneal drains in children with uncomplicated perforated appendicitis. Pediatr Surg Int. 2003;19:548–50.
Lintula H, Kokki H, Vanamo K, Valtonen H, Mattila M, Eskelinen M. The costs and effects of laparoscopic appendectomy in children. Arch Pediatr Adolesc Med. 2004;158:34–7.
Oka T, Kurkchubasche AG, Bussey JG, Wesselhoeft CWJ, Tracy TFJ, Luks FI. Open and laparoscopic appendectomy are equally safe and acceptable in children. Surg Endosc. 2004;18:242–5.
Snelling CM, Poenaru D, Drover JW. Minimum postoperative antibiotic duration in advanced appendicitis in children: a review. Pediatr Surg Int. 2004;20:838–45.
Henry MCW, Moss RL. Primary versus delayed wound closure in complicated appendicitis: an international systematic review and meta-analysis. Pediatr Surg Int. 2005;21:625–30.
Schneider A, Sack U, Rothe K, Bennek J. Peritoneal taurolidine lavage in children with localised peritonitis due to appendicitis. Pediatr Surg Int. 2005;21:445–8.
Aziz O, Athanasiou T, Tekkis PP, Purkayastha S, Haddow J, Malinovski V, et al. Laparoscopic versus open appendectomy in children: a meta-analysis. Ann Surg. 2006;243:17–27.
Padankatti LR, Pramod RK, Gupta A, Ramachandran P. Laparoscopic versus open appendicectomy for complicated appendicitis: A prospective study. J Indian Assoc Pediatr Surg. 2008;13:104–6.
Fraser JD, Aguayo P, Leys CM, Keckler SJ, Newland JG, Sharp SW, et al. A complete course of intravenous antibiotics vs a combination of intravenous and oral antibiotics for perforated appendicitis in children: a prospective, randomized trial. J Pediatr Surg. 2010;45:1198–202.
Pauniaho SL, Lahdes-Vasama T, Helminen MT, Iber T, Makela E, Pajulo O. Non-absorbable interrupted versus absorbable continuous skin closure in pediatric appendectomies. Scand J Surg. 2010;99:142–6.
Saha N, Saha DK, Rahman MA, Islam MK, Aziz MA. Comparison of post operative morbidity between laparoscopic and open appendectomy in children. Mymensingh Med J. 2010;19:348–52.
Perez V, Saenz D, Madriz J, Harhay M, Feoli J, Castro M, et al. A double-blind study of the efficacy and safety of multiple daily doses of amikacin versus one daily dose for children with perforated appendicitis in Costa Rica. Int J Infect Dis. 2011;15:e569–75.
Esposito C, Calvo AI, Castagnetti M, Alicchio F, Suarez C, Giurin I, et al. Open versus laparoscopic appendectomy in the pediatric population: a literature review and analysis of complications. J Laparoendosc Adv Surg Tech A. 2012;22:834–9.
Markar SR, Blackburn S, Cobb R, Karthikesalingam A, Evans J, Kinross J, et al. Laparoscopic versus open appendectomy for complicated and uncomplicated appendicitis in children. J Gastrointest Surg. 2012;16:1993–2004.
St Peter SD, Adibe OO, Iqbal CW, Fike FB, Sharp SW, Juang D, et al. Irrigation versus suction alone during laparoscopic appendectomy for perforated appendicitis: a prospective randomized trial. Ann Surg. 2012;256:581–5.
Yu TC, Hamill JK, Liley A, Hill AG. Warm, humidified carbon dioxide gas insufflation for laparoscopic appendicectomy in children: a double-blinded randomized controlled trial. Ann Surg. 2013;257:44–53.
Dalgic N, Karadag CA, Bayraktar B, Sancar M, Kara O, Pelit S, et al. Ertapenem versus standard triple antibiotic therapy for the treatment of perforated appendicitis in pediatric patients: a prospective randomized trial. Eur J Pediatr Surg. 2014;24:410–8.
Li P, Chen ZH, Li QG, Qiao T, Tian YY, Wang DR. Safety and efficacy of single-incision laparoscopic surgery for appendectomies: a meta-analysis. World J Gastroenterol. 2013;19:4072–82.
Nataraja RM, Loukogeorgakis SP, Sherwood WJ, Clarke SA, Haddad MJ. The incidence of intraabdominal abscess formation following laparoscopic appendicectomy in children: a systematic review and meta-analysis. J Laparoendosc Adv Surg Tech A. 2013;23:795–802.
Perez EA, Piper H, Burkhalter LS, Fischer AC. Single-incision laparoscopic surgery in children: a randomized control trial of acute appendicitis. Surg Endosc. 2013;27:1367–71.
No funding was received for this study. SE is supported by Great Ormond Street Hospital Children’s Charity.
The authors declare that they have no competing interests.
NJH and AP conceived the study; NJH, MZK, WWYC and MO designed the study; CN designed and performed the literature searches; NJH, MZK and SE performed the systematic review; NJH and MZK analysed the data; NJH and MZK drafted the manuscript; SE, WWYC, AP and MO critically appraised the manuscript; all authors have read and approved the final manuscript.
Search strategy for MEDLINE
Database: Ovid MEDLINE(R) 1946 to Present with Daily Update, Ovid MEDLINE(R) In-Process & Other Non-Indexed Citations <April 21, 2014>
(appendix or appendicitis or appendicectom* or appendectom* or "vermiform process*" or "processus vermiformis").mp. (31995)
exp Randomized Controlled Trials as Topic/ (93075)
exp randomized controlled trial/ (371186)
meta-analysis as topic/ (13675)
cross-over studies/ or double-blind method/ or random allocation/ or single-blind method/ (232109)
(random* or rct*).mp. (891252)
(pragmatic adj2 trial*).mp. (735)
("meta-analys*" or metaanalys*).mp. (82887)
"systematic review*".mp. (52825)
(medline or embase or lilacs or wos or "web of science" or scopus or cochrane).ti,ab. (72530)
((doubl* or singl* or tripl*) adj2 (blind* or mask*)).mp. (178525)
((cross-over or crossover) adj2 (design* or stud*or trial*)).mp. (53183)
5 and 18 (1365)
limit 19 to "all child (0 to 18 years)" (555)
(infan* or newborn* or new-born* or neonat* or baby or babies or child* or youth or kid or kids or toddler* or boy* or girl* or adolescen* or teen* or juvenile* or p?ediatric*).mp. (3381275)
19 and 21 (620)
20 or 22 (620)
About this article
Cite this article
Hall, N.J., Kapadia, M.Z., Eaton, S. et al. Outcome reporting in randomised controlled trials and meta-analyses of appendicitis treatments in children: a systematic review. Trials 16, 275 (2015). https://doi.org/10.1186/s13063-015-0783-1
- outcome measures
- core outcome set
- patient-reported outcome measures
- systematic review