Skip to main content

Assessing the quality of reports about randomized controlled trials of scalp acupuncture treatment for vascular dementia

Abstract

Background

This study aimed to evaluate the quality of reports about randomized controlled trials (RCTs) of scalp acupuncture (SA) for the treatment of vascular dementia (VD).

Method

A systematic search of reports published through to December 2015 was performed in eight databases. The quality of RCTs that used SA as an intervention for VD was evaluated based on the 2010 Consolidated Standards for Reporting of Trials (CONSORT) and 2010 Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA) guidelines. Thirteen items from the CONSORT guideline were scored to give an overall quality score (OQS, range 0–13), and a combined key methodological index score (MIS) (range 0–5) of five key methodological items was measured. The OQS of 17 items from the STRICTA guideline (range 0–17) was also measured.

Results

In total, 26 reports were evaluated. The median OQS based on the CONSORT guideline was 8 (minimum 5, maximum 11), and “trial design,” “sample size,” “ancillary analyses,” and “harms” had a positive rate of less than 10%. The median MIS was 2 (minimum 0, maximum 5), with “allocation concealment and implementation,” “blinding,” and “intent-to-treat analysis” having a positive rate of less than 15%. The median OQS based on the STRICTA guideline was 12 (minimum 8, maximum 14), with “extent to which treatment was varied (1c),” “number of needle insertions per subject per session (2a),” and “setting and context of treatment (4b)” having a positive rate of less than 10%.

Conclusions

The overall quality of reports on RCTs of SA treatment for VD was moderate to low. The quality of methodological items was markedly lower than that of other items. The CONSORT and STRICTA guidelines should be used more frequently to standardize the quality of RCT reports of SA treatment for VD.

Peer Review reports

Background

Vascular dementia is the second most common cause of dementia after that caused by Alzheimer’s disease [13]. It is thought to result from cognitive impairment caused by changes resulting from cerebrovascular disorders [4] and from various outcomes of ischemic and hemorrhagic encephalopathy that induce mental and physical disabilities [5].

According to a report from the World Health Organization (WHO), there were currently estimated to be 35.6 million people with dementia worldwide in 2012, which will double by 2030 and more than triple by 2050 [6]. Dementia is a challenge to patients, caregivers, and healthcare providers [7] and carries a heavy financial burden, with the annual cost of care per patient ranging from 17,000 to 55,200 US$ for serve dementia [8].

Scalp acupuncture therapy stimulates the lesion area on the scalp to produce therapeutic effects. Although this treatment modality has been performed for more than 1000 years, the treatment has advanced in recent years [9], and the WHO published the Standard International Acupuncture Nomenclature in 1991 [10]. The efficacy of scalp acupuncture for vascular dementia has been confirmed by numerous empirical clinical studies [1113]. However, a more reliable scientific method should be developed to validate the effectiveness of scalp acupuncture for vascular dementia.

Some researchers have implemented randomized controlled trials (RCTs) as a means to validate the therapeutic effects and efficacy of acupuncture, and this study design is considered optimal to assess the effectiveness of an intervention [14]. However, despite the effective design of an RCT, inappropriate study methods can affect the reliability and validity of outcomes [15]. Thus, research methodology is a critical factor that determines overall study quality [16]. Hence, there is an urgent need to assess the quality of RCTs based on systematic quality control and assessment for all stages of clinical trials, from planning and execution to analysis [17].

The Consolidated Standards of Reporting Trials (CONSORT) guideline, which was developed in 2001 and updated in 2010, was intended to assist in the assessment and interpretation of parallel-group RCTs so that users could identify biased outcomes and ultimately improve RCT reporting [18]. The Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA) guideline was designed in 2001 and revised in 2010 to assist in the reporting of clinical studies on acupuncture [19]. The combination of these guidelines helps researchers to assess the completeness and transparency of RCTs [20].

The aim of this study was to evaluate the quality of reports on domestic and foreign RCTs in which scalp acupuncture was used for the treatment of vascular dementia, based on the CONSORT and STRICTA guidelines, in order to provide preliminary data from clinical trials on scalp acupuncture for vascular dementia.

Methods

Collection of the RCTs

We searched for all reports about RCTs in which scalp acupuncture was used for the treatment of vascular dementia that were published before the end of December 2015 in eight databases (PubMed, EMbase, Cochrane Library, China National Knowledge Infrastructure, National Institute of Informatics Scholarly and Academic Information Navigator, National Digital Science Library, Korean Traditional Knowledge Portal, and Korean Studies Information Service System). The search terms were “vascular dementia, dementia,” and “scalp acupuncture.”

Literature selection/exclusion criteria

Types of studies

RCTs in which a control group of patients with vascular dementia who received a placebo, sham treatment, or conventional treatment was compared with an experimental group treated with scalp acupuncture were included. Non-randomized, cross-over RCTs, case reports, and case-control studies were excluded.

Types of participants

The subjects of RCTs were patients who were diagnosed with vascular dementia based on the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, the U.S. National Institute of Neurological Disease and Stroke and the Association Internationale pour La Recherche et l'Enseignement en Neurosciences, or definitively via computed tomography or magnetic resonance imaging, regardless of age, sex, and other demographic factors.

Types of intervention groups

The types of scalp acupuncture interventions included were body electro-acupuncture and body acupuncture, accompanied by drug therapy using Western or Chinese medicine or physical therapy such as exercise and rehabilitation.

Assessment of the quality of the reports

This study assessed the quality of the reports based on the 25-item CONSORT 2010 guideline and the 6-item STRICTA 2010 guideline. Each item on the checklists detailed in these reports was answered with a “yes” or “no.” Two raters independently performed the assessments with reference to the explanation provided by the CONSORT guideline and STRICTA guideline. Their assessments were compared, and any discrepancies were determined by consensus with the third author [21, 22].

Rating of overall reporting quality

Each of 13 items included in the CONSORT guideline was scored to compute an overall quality score (OQS) (range 0–13) (Table 1) [2325]. The discussion section items of the CONSORT guideline were excluded, due to the difficulty of objectively evaluating them [2628]. Each of 17 items in the STRICTA guideline was also scored (range 0–17) (Table 2). For scoring of the quality of items, 1 point was given if the information for each item was stated in the study, and 0 points if the information was not stated or was unclear [19, 29].

Table 1 Rating of overall quality using items from the CONSORT guideline (n = 26)
Table 2 Rating of overall quality using items from the STRICTA guideline (n = 26)

Rating of key methodological items

In the CONSORT guideline, the key items pertaining to methodology (i.e., “randomization,” “allocation concealment,” “blinding,” “baseline characteristics,” and “intention-to-treat (ITT) analysis”) were assessed separately as they were related to potential factors of bias [3032]. A combined key methodological index score (MIS) (range 0–5) of these five key methodological items was measured (Table 3). For each of the studies, 1 point was given when the reports had information on each item, and 0 points were given if the information was not stated or was unclear.

Table 3 Quality of key methodological items (n = 26)

Data extraction and analysis

Two raters independently performed the assessments with reference to a discussion about the definitions of each item and the instructions provided in the CONSORT and STRICTA guidelines. Their assessments of the reports were compared, and any discrepancies were resolved by consensus with the third author.

Cohen’s к-statistic was quantified to assess the inter-rater agreement. We defined agreement of 0.20 as “poor,” that greater than 0.20 but less than 0.40 as “low,” that greater than 0.40 but less than 0.60 as “moderate,” that greater than 0.60 but less than 0.80 as “substantial,” that greater than 0.80 as “good,” and agreement of 1 as “perfect” [23]. Items upon which there was any disagreement were specifically examined to reach an agreement. Cohen’s к-statistic analysis was performed using SAS software, version 9.3 (SAS Institute, Inc., Cary, NC, USA).

In order to evaluate the overall quality of reported RCTs and relevant factors, OQS was used as a dependent variable modeled using linear regression. Only variables with p ≤ 0.10 on univariate analysis were included in the multivariate regression model to identify significant variables (p ≤ 0.05). To analyze the factors related to methodological quality, the MIS was used as an outcome variable in regression analysis. Linear and ordinal regression analysis was performed using SPSS software version 20.0 (SPSS, Chicago, IL, USA).

Results

The RCT selection process for this study is depicted in Fig. 1. After identification, screening, and determining the eligibility of the reports, a total of 26 relevant RCTs were included in the final analysis.

Fig. 1
figure 1

Flowchart of the article selection process. RCT randomized controlled trial

Features of the included RCTs

A number of RCTs on scalp acupuncture for vascular dementia were reported in the last 10 years. Most of these studies were reported in the last 8 years, with one in 2006 (3.8%), one in 2007 (3.8%), four in 2008 (15.4%), three in 2009 (11.5%), one in 2010 (3.8%), two in 2011 (7.7%), five in 2012 (19.2%), seven in 2013 (26.9%), two in 2014 (7.7%), and none in 2015 (0%) (Fig. 2).

Fig. 2
figure 2

Number of publications

Twenty-two reports were written in Chinese (84.6%) and four reports were in English (15.4%), but all of the 26 reports were published in China by Chinese researchers. With regard to the types of interventions in the control group, among the 26 RCTs evaluated, Western medicine was used in 20 studies (76.9%), body electro-acupuncture was used in three studies (11.5%), and body acupuncture was used in one study (3.8%), with a sample size ranging from 40 to 241 subjects. Twelve studies were conducted with external funding (46.2%).

Quality of the reports

Rating of overall quality

Table 1 shows the ratings of overall quality based on the CONSORT guideline. The median OQS of the 26 RCTs was 8 (minimum 5, maximum 11). The items that were relatively more neglected in the reports were “trial design,” “sample size,” “ancillary analyses,” and “harms,” showing less than 10% of a positive rate. The two raters reached a substantial (items 2, 6, 7, 12, 13, 14, 17, and 19), perfect agreement (items 1, 3, 4, 5, and 18) for all items with the exception of “outcomes and estimation” (Table 1).

Table 2 shows the ratings of overall quality based on the STRICTA guideline. The median OQS of the 26 RCTs was 12 (minimum 8, maximum 14). Items that were relatively neglected by RCTs were “extent to which treatment was varied (1c),” “number of needle insertions per subject per session (2a),” and “setting and context of treatment (4b),” with less than 10% of a positive rate. The two raters reached substantial (items 2c, 3a, 4a, 4b, 5, and 6a), good, or perfect agreement (items 1a, 1b, 1c, 2a, 2b, 2d, 2f, 2 g, 3b, and 6b) for all items with the exception of “needle stimulation (2e)” (Table 2).

Rating of key methodological items

The median MIS value for the five items (items 8, 9, 10, 11, 15, and 16) was 2 (minimum 0, maximum 5). Particularly, “allocation concealment and implementation,” “blinding,” and “intent-to-treat analysis” had less than 15% of a positive rate (Table 3). The two raters reached substantial (items 8 and 16), good (items 9, 10, and 15), or perfect agreement (item 11) for all items (Table 3).

Exploratory analysis: factors associated with better quality of the reports

In a single-factor analysis of variance, all the factors related to the CONSORT and STRICTA guidelines were found to have no mutual association. Ordinal regression analysis showed that the variables to enhance the quality of the methodology were not associated with the MIS (p > 0.05).

Discussion

In this study, a comprehensive and systematic search of domestic and foreign RCTs on scalp acupuncture for the treatment of vascular dementia was performed, and the quality of these reports was assessed based on the CONSORT and STRICTA guidelines. These two guidelines are useful tools that were developed to identify gaps in the reporting of RCTs and have been widely used to assess the quality of reports on acupuncture studies [20].

Based on the CONSORT guideline, the median OQS of the 26 RCTs was 8, which was greater than 50% of the total score, and that of the STRICTA items was 12, which was greater than 70% of the total score. However, the “trial design,” “sample size,” “ancillary analyses,” and “harms” items of the CONSORT guideline and the “extent to which treatment was varied (1c),” “number of needle insertions per subject per session (2a),” and “setting and context of treatment (4b)” items of the STRICTA guideline were inappropriately addressed or neglected in most of the reports. This finding is in line with the results of other quality assessment studies [20, 25, 29, 30].

It is important for researchers to clearly state the design of clinical trial studies (randomized, parallel, double-blind, placebo-controlled, sham-controlled, etc.), including the details of the randomization, as indicated in the “trial designs” item of the CONSORT guideline. Even in cases of a parallel randomization ratio such as 8:8 for two groups, it is important to clearly provide the allocation ratio to improve the quality of reporting. The importance of trial design is especially highlighted among non-universal clinical trials with large sample sizes or complex analyses [31].

Sample size calculation is required to maintain a balance between the statistical considerations and the differences in therapeutic effects for intervention groups. A clinically significant difference between the intervention group and the control group generates reliable outcomes if the sample size is sufficiently large [20]. However, it may be difficult to achieve the planned sample size because recruiting qualified subjects within a limited time period is challenging [33, 34]. RCTs with a small sample size are often prone to biases or are insufficient in measuring the therapeutic advantages [26]. Therefore, researchers should pay more attention to sample size measurements by consulting with professional clinical statisticians in order to identify highly reliable and significant differences between control and intervention groups.

With regard to the “ancillary analyses” item, performing multiple analyses of the same data may introduce biases that lead to exaggeration in the interpretation of the study results [35], and reporting of analytical outcomes that were not prespecified in the research protocol leads to selective reporting bias for subgroup analyses [36]. Therefore, authors should report the results of prespecified analyses for high reliability, and clearly state the reason for and purpose of conducting subgroup analyses.

A randomized trial is the optimal design to generate efficacy and safety data, but it is difficult to detect rarely occurring “harms” through such a design. Many RCTs have provided inappropriate reports of abnormal responses [37] or low-quality reports of abnormal responses [38]. Furthermore, very few studies mention severe abnormal responses or subjects who dropped out because of abnormal responses [39]. Information about the risk and the benefits of an intervention is required to help the participants of clinical trials make reasonable and balanced decisions. The occurrence and characteristics of abnormal responses affect the acceptance and usefulness of a particular intervention [20].

The “extent to which treatment was varied (1c)” item had a 3% of a positive rate in this study, which is similar to the results of a previous study [22]. Variations between treatments in each clinical trial should be minimized by using a standardized protocol, and researchers should describe the degree of personalized treatment to both the patient and practitioner [40]. The “number of needle insertions per subject per session (2a)” item had an 8% positive rate in this study. Researchers should strictly report the total number of needles used and as many other related details as possible [40]. The “setting and context of treatment (4b)” item is an additional important component to report [41]. As changes in medical practice or context of treatment of the patients affect the outcome of experiments [29], researchers must report information that is provided to the patients about the interventions for treatment and control groups [20].

The median MIS, which represents the quality of methodological reports of the CONSORT guideline, was markedly low at 2, and the majority of studies had insufficient or missing information on “allocation concealment and implementation,” “blinding,” and “intent-to-treat analysis.” These key methodological items play an important role in preventing selection bias, performance/detection bias, and attribution bias [42]. An inappropriate study design could lead to exaggeration of the clinical outcome [23, 24, 43, 44], which has been reported in a few other quality assessment studies [45, 46]. In reports of RCTs of Chinese medicine, the quality of the reporting of the methodology is poor, warranting the use of CONSORT guidelines. We recommend that clinical researchers should be professionally trained with regard to the design and reporting of RCTs, and that the studies should be stringently peer-reviewed to improve the overall quality of research articles for their submission and publication in international journals.

Although we have comprehensively and systematically assessed 26 RCTs, there are a few limitations in our study. First, it was difficult to search for studies published in languages other than English and Chinese, such as those published in Japanese or other Asian languages. Nevertheless, most of the studies on scalp acupuncture treatment are published in Chinese or English. Second, only articles published between 2006 and 2015 were included in this study, which may be associated with the increased incidence of geriatric diseases caused by an upsurge of the elderly population in the last 10 years.

Conclusions

This study confirmed the quality of reporting of RCTs on scalp acupuncture for the treatment of vascular dementia. The CONSORT and STRICTA guidelines should be more widely used to enhance the quality of the reporting of RCTs in the future. The present study findings suggest that more reliable research on scalp acupuncture for the treatment of vascular dementia, including larger sample sizes, is warranted in the future.

Abbreviations

CONSORT:

Consolidated Standards of Reporting Trials

ITT analysis:

Intention-to-treat analysis

MIS:

Methodological index score

OQS:

Overall quality score

RCT:

Randomized controlled trial

STRICTA:

Standards for Reporting Interventions in Controlled Trials of Acupuncture

WHO:

World Health Organization

References

  1. Murray ME, Knopman DS, Dickson DW. Vascular dementia: clinical, neuroradiologic and neuropathologic aspects. Panminerva Med. 2007;49:197–207.

    CAS  PubMed  Google Scholar 

  2. Román GC. Facts, myths, and controversies in vascular dementia. J Neurol Sci. 2004;226:49–52.

    Article  PubMed  Google Scholar 

  3. Battistin L, Cagnin A. Vascular cognitive disorder. A biological and clinical overview. Neurochem Res. 2010;35:1933–8.

    Article  CAS  PubMed  Google Scholar 

  4. Olsson Y, Brun A, Englund E. Fundamental pathological lesions in vascular dementia. Acta Neurol Scand Suppl. 1996;168:31–8.

    Article  CAS  PubMed  Google Scholar 

  5. Korczyn AD, Vakhapova V, Grinberg LT. Vascular dementia. J Neurol Sci. 2012;322:2–10.

    Article  PubMed  PubMed Central  Google Scholar 

  6. World Health Organization and Alzheimer's Disease International. Dementia: a public health priority. Geneva; 2012:112. ISBN: 978 92 4 156445 8. http://www.who.int/mental_health/publications/dementia_report_2012/en/.

  7. Sahathevan R, Brodtmann A, Donnan GA. Dementia, stroke, and vascular risk factors; a review. Int J Stroke. 2012;7:61–73.

    Article  PubMed  Google Scholar 

  8. Quentin W, Riedel-Heller SG, Luppa M, Rudolph A, König HH. Cost-of-illness studies of dementia: a systematic review focusing on stage dependency of costs. Acta Psychiatr Scand. 2010;121:243–59.

    Article  CAS  PubMed  Google Scholar 

  9. Liu Z, Guan L, Wang Y, Xie CL, Lin XM, Zheng GQ. History and mechanism for treatment of intracerebral hemorrhage with scalp acupuncture. Evid Based Complement Alternat Med. 2012;2012:895032.

    PubMed  PubMed Central  Google Scholar 

  10. WHO Scientific Group on International Acupuncture Nomenclature. A proposed standard international acupuncture nomenclature: report of a WHO scientific group. Geneva: World Health Organization; 1991.

    Google Scholar 

  11. Wang Y, Shen J, Wang XM, Fu DL, Chen CY, Lu LY, et al. Scalp acupuncture for acute ischemic stroke: a meta-analysis of randomized controlled trials. Evid Based Complement Alternat Med. 2012;2012:480950.

    PubMed  PubMed Central  Google Scholar 

  12. Lee GE, Yang HD, Heo EJ, Jeon WK, Lyu YS, Kang HW. The current state of clinical studies on scalp acupuncture-treatment for dementia-by search for China literature published from 2001 to 2011 in CAJ (China Academic Journals). J Orient Neuropsychiatry. 2012;23:13–32.

    Article  CAS  Google Scholar 

  13. Peng W, Zhao H, Liu Z, Liu B. Systematic assessment of electroacupuncture treatment for vascular dementia. Chin Acupunct Moxibustion. 2004;24(5):297–301.

    Google Scholar 

  14. Son C. Overview for pattern and results of moxibustion-derived clinical trials. Korean J Acupunct. 2009;26:41–9.

    Google Scholar 

  15. Jang MK, Yoon EH, Jung CY, Kim EJ, Lee SD, Hwang MS, et al. Review of randomized controlled trials on pharmacopuncture treatment for musculoskeletal diseases. J Korean Acupunct Moxibust Soc. 2009;26(3):149–63.

    Google Scholar 

  16. Kim YY, Yoo JH, Lee SK, Lee SW. Quality assessment of randomized controlled trials using herbal remedies in Korea. J Physiol Pathol Korean Med. 2011;25:927–33.

    Google Scholar 

  17. Park JE, Kang KW, Choi SM. Assessing methodological quality of acupuncture clinical trials of Korea. J Korean Acupunct Moxibust Soc. 2007;24:127–35.

    Google Scholar 

  18. Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Zhong Xi Yi Jie He Xue Bao. 2010;8:604–12.

    Article  PubMed  Google Scholar 

  19. MacPherson H, Altman DG, Hammerschlag R, Youping L, Taixiang W, White A, et al. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. PLoS Med. 2010;7:e1000261.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Zhuang L, He J, Zhuang X, Lu L. Quality of reporting on randomized controlled trials of acupuncture for stroke rehabilitation. BMC Complement Altern Med. 2014;14:151.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Chen ZW, Chen YC, Zeng JC, Wang Y, Ye T, Zhou QC, Du XJ, Su WT, Ding ZS. Quality of randomized controlled trials reporting in the treatment of melasma conducted in china. Trials. 2015;16:156.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Bo C, Xue Z, Yi G, Zelin C, Yang B, Zixu W, Yajun W. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on diabetic peripheral neuropathy. PLoS One. 2012;7:e38461.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Lai R, Chu R, Fraumeni M, Thabane L. Quality of randomized controlled trials reporting in the primary treatment of brain tumors. J Clin Oncol. 2006;24:1136–44.

    Article  PubMed  Google Scholar 

  24. Toulmonde M, Bellera C, Mathoulin-Pelissier S, Debled M, Bui B, Italiano A. Quality of randomized controlled trials reporting in the treatment of sarcomas. J Clin Oncol. 2011;29(9):1204–9.

    Article  PubMed  Google Scholar 

  25. Rios LP, Odueyungbo A, Moitri MO, Rahman MO, Thabane L. Quality of reporting of randomized controlled trials in general endocrinology literature. J Clin Endocrinol Metab. 2008;93(10):3810–6.

    Article  CAS  PubMed  Google Scholar 

  26. Gao J, Deng G, Hu Y, Huang Y, Lu L, Huang D, et al. Quality of reporting on randomized controlled trials on recurrent spontaneous abortion in China. Trials. 2015;16:172.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Lu X, Hongcai S, Jiaying W, Jing H, Jun X. Assessing the quality of reports about randomized controlled trials of acupuncture treatment on mild cognitive impairment. PLoS One. 2011;6:e16922.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Baer H. The emergence of integrative medicine in Australia: the growing interest of biomedicine and nursing in complementary medicine in a southern developed society. Med Anthropol Q. 2008;22(1):52–66.

    Article  PubMed  Google Scholar 

  30. Hollis S, Campbell F. What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ. 1999;319:670–4.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Gluud LL, Thorlund K, Gluud C, Woods L, Harris R, Sterne JA. Correction: reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2008;149:219.

    Article  PubMed  Google Scholar 

  32. Montori VM, Bhandari M, Devereaux PJ, Manns BJ, Ghali WA, Guyatt GH. In the dark: the reporting of blinding status in randomized controlled trials. J Clin Epidemiol. 2002;55:787–90.

    Article  PubMed  Google Scholar 

  33. McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Chen X, Zhai X, Wang X, Su J, Li M. Methodological reporting quality of randomized controlled trials in three spine journals from 2010 to 2012. Eur Spine J. 2014;23:1606–11.

    Article  PubMed  Google Scholar 

  35. Tukey JW. Some thoughts on clinical trials, especially problems of multiplicity. Science. 1977;198:679–84.

    Article  CAS  PubMed  Google Scholar 

  36. Hahn S, Williamson PR, Hutton JL, Garner P, Flynn EV. Assessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies. Stat Med. 2000;19:3325–36.

    Article  CAS  PubMed  Google Scholar 

  37. Ioannidis JP, Lau J. Completeness of safety reporting in randomized trials: an evaluation of Q medical areas. JAMA. 2001;285:437–43.

    Article  CAS  PubMed  Google Scholar 

  38. Scharf O, Colevas AD. Adverse event reporting in publications compared with sponsor database for cancer clinical trials. J Clin Oncol. 2006;24:3933–8.

    Article  PubMed  Google Scholar 

  39. Pitrou I, Boutron I, Ahmad N, Ravaud P. Reporting of safety results in published reports of randomized controlled trials. Arch Intern Med. 2009;169:1756–61.

    Article  PubMed  Google Scholar 

  40. Lee HS, Cha SJ, Park HJ, Seo JC, Park JB, Lee HJ. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. Korean J Acupunct. 2010;27:1–23.

    Google Scholar 

  41. Di Blasi Z, Kleijnen J. Context effects. Powerful therapies or methodological bias? Eval Health Prof. 2003;26:166–79.

    Article  PubMed  Google Scholar 

  42. Chen B, Liu J, Zhang C, Li M. A retrospective survey of reporting quality on randomized controlled trials of metformin for polycystic ovary syndrome. Trials. 2014;15:128.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Lu L, Luo G, Xiao F. A retrospective survey of the quality of reports and their correlates among randomized controlled trials of immunotherapy for Guillain-Barre syndrome. Immunotherapy. 2013;5:829–36.

    Article  CAS  PubMed  Google Scholar 

  44. Lu L, Liao M, Zeng J, He J. Quality of reporting and its correlates among randomized controlled trials on acupuncture for cancer pain: application of the CONSORT 2010 Statement and STRICTA. Expert Rev Anticancer Ther. 2013;13:489–98.

    Article  CAS  PubMed  Google Scholar 

  45. Asher GN, Motsinger-Reif AA, Jonas DE, Viera AJ. Quality of reporting on randomised controlled trials of auriculotherapy for pain. Acupunct Med. 2011;29:122–6.

    Article  PubMed  Google Scholar 

  46. Hammerschlag R, Milley R, Colbert A, Weih J, Yohalem-Ilsley B, Mist S, et al. Randomized controlled trials of acupuncture (1997-2007): an assessment of reporting quality with a CONSORT- and STRICTA-based instrument. Evid Based Complement Alternat Med. 2011;2011:183910. doi:10.1155/2011/183910.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to express sincere thanks to our colleagues, staff of College of Korean Medicine Dong-Shin University, and DongShin University Gwangju Oriental Hospital, and Chonnam National University Medical School and Hospital for their support.

Funding

This study was supported by the Convergence of Conventional Medicine and Traditional Korean Medicine R&D program funded by the Ministry of Health and Welfare through the Korea Health Industry Development Institute (KHIDI) (HI14C0862).

Authors’ contributions

KJH, CJB, SJC, CMR, NCS, and HJY conceived and designed the experiments. YYN, CMR, and SMY performed the experiments. YYN and SMY analyzed the data. PJH and PGC contributed reagents/materials/analysis tools. YYN and KJH wrote the paper. KJH and SJC resolved disagreements and bias. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Not applicable.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jae-Hong Kim.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

You, YN., Cho, MR., Park, JH. et al. Assessing the quality of reports about randomized controlled trials of scalp acupuncture treatment for vascular dementia. Trials 18, 205 (2017). https://doi.org/10.1186/s13063-017-1945-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-017-1945-0

Keywords