- Open Access
Efficacy of electro-acupuncture and manual acupuncture versus sham acupuncture for knee osteoarthritis: statistical analysis plan for a randomized controlled trial
Trials volume 20, Article number: 394 (2019)
Acupuncture is widely used for knee osteoarthritis (KOA), despite contradictory evidence. This study is designed to determine the efficacy of electro-acupuncture and manual acupuncture versus sham acupuncture for KOA.
This is a multi-center three-arm randomized controlled trial. It will enroll 480 participants with KOA in China. Participants will be randomly assigned 1:1:1 to receive 24 sessions of electro-acupuncture, manual acupuncture, or sham acupuncture over 8 weeks. The primary outcome is the response rate, which is the proportion of patients who achieve the minimal clinically important improvement in pain and function at 8 weeks. The primary outcome will be analyzed using the Z-test with the intention-to-treat set. Secondary outcomes include pain, function, global patient assessment, and quality of life. Full details of the statistical analysis plan for the primary and secondary outcomes will be described in this article. The statistical analysis plan was written and submitted without knowledge of the study data.
The data will be analyzed according to this pre-specified statistical analysis plan to avoid data-driven analysis and to enhance the transparency of the trial. The aim of the trial is to provide high-quality evidence on the efficacy of acupuncture for KOA.
Clinicaltrials.gov, NCT03366363. Registered on 20 November 2017.
Knee osteoarthritis (KOA) is one of the leading causes of chronic pain and disability in older adults , with symptomatic KOA affecting 8.1% of Chinese people  and 1.6–14.9% of Europeans according to age class . The socioeconomic burden of KOA is large, amounting to between 1.0% and 2.5% of the gross domestic product in developed countries .
Since no disease-modifying treatment is available, the current management of KOA is symptomatic , often with non-steroid anti-inflammatory drugs. However, these have a limited effect [6, 7]. Although total knee replacement is an effective treatment for symptomatic end-stage disease, approximately 15% of patients have continuing pain and mobility problems after surgery and the lifespan of prostheses is limited .
Acupuncture is increasingly used in clinical practice , although evidence of its efficacy is contradictory [10, 11]. Acupuncture has a dose–effect relationship . However, the dose of acupuncture administered in several previous trials was far from adequate . The frequency of acupuncture is one of the key factors of a dose . A review suggested that the frequency of acupuncture is usually three to five sessions per week in China, whereas it is mostly one session per week in Europe and America . Based on our previous pilot trial , high-dose acupuncture (24 sessions in 8 weeks) may be an effective option for KOA. Electro-acupuncture (EA) combines manual acupuncture (MA) with an electric stimulus . Both EA and MA are frequently used in clinical practice. Therefore, the current trial is designed to evaluate the effect of EA and MA, compared with sham acupuncture (SA), in patients with KOA.
The protocol of the trial has been published previously  and provides more detail on the trial rationale, eligibility criteria, and interventions. This article aims to report in detail the statistical analysis plan to reduce the risks of reporting bias and enhance the transparency of the trial. The statistical analysis plan was approved on 30 October 2017 (version 1.0) and drafted without knowledge of any of the results.
This three-arm randomized sham-controlled trial has been approved by the ethics committees at each of the nine participating hospitals. Eligible KOA participants, diagnosed according to the American College of Rheumatology criteria , are randomly assigned (1:1:1) to receive 24 sessions of EA, MA, or SA over 8 weeks. The block randomization, with block sizes of 6 and 9, is stratified by study center and is performed via a web-based randomization system. Superficial insertion at non-acupoints with no electric current will be used for the SA group, which is one of the most commonly used approaches for administering sham treatments in acupuncture trials. The nature of acupuncture means that acupuncturists are not blinded to treatment allocation; however, patients, outcome assessors, and statisticians will remain masked. Informed consent will be obtained from each participant before randomization. The trial has been registered with ClinicalTrials.gov (NCT03366363).
The objective of the current study is to determine if EA or MA improve clinical outcomes at 8 weeks in patients with KOA. The following two null hypotheses will be tested:
H1: There is no difference in the patients’ response rate between the EA group and the SA group.
H2: There is no difference in the patients’ response rate between the MA group and the SA group.
The primary outcome is the response rate , which is the proportion of patients who achieve the minimal clinically important improvement in pain and function at 8 weeks post-randomization. The average pain over the previous week will be assessed using an 11-point numerical rating scale (NRS)  with scores ranging from 0 to 10. The minimal clinically important improvement in pain is defined as 2 points in the NRS [11, 22]. The average function over the previous week is measured using the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) function subscale  with scores ranging from 0 to 68. The minimal clinically important improvement in function is defined as 6 points in the WOMAC function subscale [11, 22]. The criteria for a participant to be a responder are presented in Fig. 1. The response rate is also measured at weeks 4, 16, and 26 after randomization.
The secondary outcomes are:
Numerical rating scale : an 11-point patient-reported outcome measure (PROM) with scores ranging from 0 (no pain) to 10 (worst pain)
WOMAC  pain subscale: a 5-item PROM with total scores ranging from 0 to 20; higher scores indicate worse pain
WOMAC  function subscale: a 17-item PROM with total scores ranging from 0 to 68; lower scores indicate better physical function
WOMAC  stiffness subscale: a 2-item PROM with total scores ranging from 0 to 8; higher scores indicate more stiffness
Patient global assessment : a 5-point Likert scale
12-item Short Form Health Survey (SF-12)  physical dimension: total scores range from 0 to 100; lower scores indicate a worse quality of life
SF-12  mental dimension: total scores range from 0 to 100; higher scores indicate a better quality of life
For the patient global assessment, participants are asked how their knee symptoms were during the past week. Answers can include “extremely improved,” “slightly improved,” “not changed,” “slightly aggravated,” and “extremely aggravated.”
The NRS, WOMAC, patient global assessment, and SF-12 are measured at 4, 8, 16, and 26 weeks after randomization. The blinding assessment is measured at 4 and 8 weeks after randomization. The credibility and expectancy of participants are measured 5 min after the first acupuncture session . The use of rescue medicine is also recorded throughout the trial.
Adverse events are recorded throughout the trial. Based on the potential relationship between acupuncture and adverse events, adverse events are categorized as related to the treatment or not.
Based on the results of our previous trial , the response rates for the EA, MA, and SA groups were assumed to be 70%, 60%, and 40%, respectively. With a two-sided significance level of 2.5% and power of 80%, 128 participants in each group will be required to detect a difference as small as 20% between each acupuncture group and the control group. The two-sided significance level of 2.5% is a Bonferroni-adjusted alpha level as per the two predefined primary comparisons: EA vs. SA and MA vs. SA. With an estimated loss-to-follow-up rate of 20%, 480 participants will be recruited in total.
Statistical analysis population
A modified full analysis set, a per-protocol set, and a safety set will be used in this trial. The modified full analysis set will consist of all randomized participants who have at least one post-baseline measurement according to the modified intention-to-treat principle. The modified full analysis set will be the primary analysis set, and all analyses will be conducted for this population if not otherwise stated. Analyses of the modified full analysis set will provide an estimate of the effects of EA and MA.
The per-protocol set will include those who complete the treatment and follow-up on time according to the protocol without major violations. Major violations of the protocol will be judged during the blinded audit of the data. They include but are not limited to not meeting the inclusion criteria, meeting the exclusion criteria, receiving other treatments that might affect the symptoms of KOA during the trial, and completing <20 sessions of acupuncture. The per-protocol set will be the secondary analysis set and will be used for the sensitivity analyses.
All those who are randomized and have received at least one session of acupuncture will be defined as the safety set, which is used for the safety analyses.
General analysis principles
All data will be summarized by treatment group. Numbers (percentages) will be used to describe categorical data. Either means (standard deviations) or medians (interquartile ranges) will be used for quantitative data depending on whether the variables are normally distributed. If not otherwise stated, the significance level will be set at 0.05. The Bonferroni method will be used to adjust the significance level for multiple comparisons for the primary outcome. The conclusions will be based on the analysis of the primary outcome, and all secondary outcomes will be analyzed to support the primary analysis. All analyses will be carried out using SAS 9.3 (Cary, NC).
The numbers of participants screened, excluded, randomly assigned to each group, interviewed at each follow-up, and analyzed will be summarized using a flow diagram recommended by CONSORT  (Fig. 2). Reasons for the losses to follow-up and withdrawals will also be listed by treatment arm.
The demographic characteristics and clinical outcomes at baseline are those presented in Table 1. Missing data for baseline characteristics will not be imputed. Differences among the treatment groups at baseline will not be statistically tested.
Analysis of the primary outcome
In the analysis of the primary outcome, the response rates of the three groups at 8 weeks will be calculated and the Z-test for comparisons of proportions will be used with the full analysis set. Any missing data at 8 weeks will be imputed using the baseline value. There will be two comparisons. The first comparison is that between the EA group and the SA group. The second is that between the MA group and the SA group. The significance level will be adjusted at 0.025 for multiple comparisons using the Bonferroni method.
Analysis of secondary outcomes
For the NRS score, comparisons among the three groups will be assessed by a mixed-effect model with repeated measurement (MMRM) analysis using the NRS score at all follow-up time points as the dependent variable, treatment as the main factor, and the baseline value as a covariate. We set the model as
yij = α + ui + β1timeij + β2treati + εij
where α is the overall average and ui is an unknown random effect represented as a subject-specified effect. β1 and β2 are unknown fixed effects represented as time and treatment effects, respectively. The covariance matrix G is unstructured, and ui~N(0, G). The random error εij~N(0, Ri). The MMRM for secondary outcomes will be handled by PROC MIXED (SAS). The estimators of unknown parameters will be calculated using an expectation maximalization algorithm, which we expect will converge for the 480 participants in three groups and a single random intercept. If non-convergence does happen, we will consider correcting the initial value, changing the random effect, or using another analysis method like generalized estimating equations. Also, we will test the estimators or models based on a likelihood test and Bayesian information criterion methods.
The modified MMRM also has the center effect and time × treatment effect and it will be used in the sensitivity analysis. The modified MMRM is as follows:
where α, ui, β1, β2, and εij are defined as above. β3 and β4 are unknown fixed effects.
The same approach will be used to analyze the pain, function, and stiffness WOMAC subscales, and SF-12. If normality is violated in the continuous variables, a transformation will be performed before the comparison. A chi-square test will be used for the patient global assessment. These outcomes are shown in Table 2.
Based on the potential relationship between acupuncture and adverse events, adverse events are categorized as treatment-related or not. Acupuncture-related adverse events will be summarized by group and compared using a chi-square test (or Fisher’s exact test).
A kappa analysis will be used to determine whether participants correctly guessed their group assignment at a higher rate than would be expected by chance.
Another three schemes to deal with any missing data for the primary outcome will be carried out to examine the robustness of the conclusion. First, any data missing at 8 weeks will be imputed using the last observation carried forward approach. Second, we will directly remove any missing data. Third, any data missing at 8 weeks will be imputed using multiple imputation . By assuming the data missing are random, the missing data will be imputed using the Monte Carlo Markov chain method for multiple imputation with Proc MI (SAS). The initial seed will be set at 1000 and five datasets will be imputed. Any data missing for the primary outcome will be imputed by the observation value of age, gender, body mass index, Kellgren–Lawrence grade, and duration of disease. A subgroup analysis based on Kellgren–Lawrence grade will be performed.
Discussion and trial status
The trial will provide high-quality evidence of the efficacy of EA and MA for KOA. This paper provides details of the planned statistical analyses for the current trial and will help to reduce the risks of outcome reporting bias and data-driven results . This paper has been prepared in accordance with the published guidelines for the content of statistical analysis plans . As of October 2018, 480 patients from nine centers had been randomized. The final date of follow-up is April 7, 2019. This analysis plan was written prior to completion of the trial data collection phase.
Availability of data and materials
No original data are currently available relating to the detailed statistical analysis plan. The datasets used during the current study will be available from the corresponding author on reasonable request.
One-way analysis of variance
Mixed-effect model with repeated measurement
Numerical rating scale
Patient-reported outcome measure
12-item Short Form Health Survey
Western Ontario and McMaster Universities Osteoarthritis Index
Glyn-Jones S, Palmer AJ, Agricola R, Price AJ, Vincent TL, Weinans H, et al. Osteoarthritis. Lancet. 2015;386:376–87.
Tang X, Wang S, Zhan S, et al. The Prevalence of Symptomatic Knee Osteoarthritis in China: Results From the China Health and Retirement Longitudinal Study. Arthritis Rheumatol. 2016;68:648–53.
Guillemin F, Rat AC, Mazieres B, et al. Prevalence of symptomatic hip and knee osteoarthritis: a two-phase population-based survey. Osteoarthr Cartil. 2011;19:1314–22.
Hiligsmann M, Cooper C, Arden N, Boers M, Branco JC, Luisa Brandi M, et al. Health economics in the field of osteoarthritis: an expert's consensus paper from the European Society for Clinical and Economic Aspects of Osteoporosis and Osteoarthritis (ESCEO). Semin Arthritis Rheum. 2013;43:303–13.
Mahler E, Minten MJ, Leseman-Hoogenboom MM, Poortmans P, Leer J, Boks SS, et al. Effectiveness of low-dose radiation therapy on symptoms in patients with knee osteoarthritis: a randomised, double-blinded, sham-controlled trial. Ann Rheum Dis. 2019;78:83–90.
da Costa BR, Reichenbach S, Keller N, Nartey L, Wandel S, Jüni P, et al. Effectiveness of non-steroidal anti-inflammatory drugs for the treatment of pain in knee and hip osteoarthritis: a network meta-analysis. Lancet. 2017;390:e21–21e33.
McAlindon TE, Bannuru RR, Sullivan MC, et al. OARSI guidelines for the non-surgical management of knee osteoarthritis. Osteoarthr Cartil. 2014;22:363–88.
Jones CA, Beaupre LA, Johnston DW, Suarez-Almazor ME. Total joint arthroplasties: current concepts of patient outcomes after surgery. Rheum Dis Clin N Am. 2007;33:71–86.
Su D, Li L. Trends in the use of complementary and alternative medicine in the United States: 2002-2007. J Health Care Poor Underserved. 2011;22:296–310.
Vickers AJ, Cronin AM, Maschino AC, et al. Acupuncture for chronic pain: individual patient data meta-analysis. Arch Intern Med. 2012;172:1444–53.
Hinman RS, McCrory P, Pirotta M, et al. Acupuncture for chronic knee pain: a randomized clinical trial. JAMA. 2014;312:1313–22.
White A, Cummings M, Barlas P, et al. Defining an adequate dose of acupuncture using a neurophysiological approach--a narrative review of the literature. Acupunct Med. 2008;26:111–20.
Zhang Q, Yue J, Lu Y. Acupuncture treatment for chronic knee pain: study by Hinman et al underestimates acupuncture efficacy. Acupunct Med. 2015;33:170.
Armour M, Smith CA. Treating primary dysmenorrhoea with acupuncture: a narrative review of the relationship between acupuncture 'dose' and menstrual pain outcomes. Acupunct Med. 2016;34:416–24.
He W, Zhu B, Yu X, Liu B, Xu N, Jing X. Compairison between western and Chinese acupuncture and its enlightenment. Zhongguo Zhen Jiu. 2015;35:105–8.
Lin LL, Li YT, Tu JF, Yang JW, Sun N, Zhang S, et al. Effectiveness and feasibility of acupuncture for knee osteoarthritis: a pilot randomized controlled trial. Clin Rehabil. 2018;32:1666–75.
Noordergraaf A, Silage D. Electroacupuncture. IEEE Trans Biomed Eng. 1973;20:364–6.
Tu JF, Yang JW, Lin LL, Wang TQ, Du YZ, Liu ZS, et al. Efficacy of electro-acupuncture and manual acupuncture versus sham acupuncture for knee osteoarthritis: study protocol for a randomised controlled trial. Trials. 2019;20:79.
Hochberg MC, Altman RD, Brandt KD, et al. Guidelines for the medical management of osteoarthritis. Part II. Osteoarthritis of the knee. American College of Rheumatology. Arthritis Rheum. 1995;38:1541–6.
Forestier R, Desfour H, Tessier JM, et al. Spa therapy in the treatment of knee osteoarthritis: a large randomised multicentre trial. Ann Rheum Dis. 2010;69:660–5.
Hawker GA, Mian S, Kendzerska T, et al. Measures of adult pain: Visual Analog Scale for Pain (VAS Pain), Numeric Rating Scale for Pain (NRS Pain), McGill Pain Questionnaire (MPQ), Short-Form McGill Pain Questionnaire (SF-MPQ), Chronic Pain Grade Scale (CPGS), Short Form-36 Bodily Pain Scale (SF-36 BPS), and Measure of Intermittent and Constant Osteoarthritis Pain (ICOAP). Arthritis Care Res (Hoboken). 2011;63(Suppl 11):S240–52.
Tubach F, Ravaud P, Baron G, et al. Evaluation of clinically relevant changes in patient reported outcomes in knee and hip osteoarthritis: the minimal clinically important improvement. Ann Rheum Dis. 2005;64:29–33.
Bellamy N, Buchanan WW, Goldsmith CH, et al. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988;15:1833–40.
Berman BM, Lao L, Langenberg P, et al. Effectiveness of acupuncture as adjunctive therapy in osteoarthritis of the knee: a randomized, controlled trial. Ann Intern Med. 2004;141:901–10.
Ware J, Kosinski M, Keller SD. A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34:220–33.
Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry. 2000;31:73–86.
Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Ann Intern Med. 2010;152:726–32.
Li P, Stuart EA, Allison DB. Multiple Imputation: A Flexible Tool for Handling Missing Data. JAMA. 2015;314:1966–7.
Finfer S, Bellomo R. Why publish statistical analysis plans. Crit Care Resusc. 2009;11:5–6.
Gamble C, Krishan A, Stocken D, Lewis S, Juszczak E, Doré C, et al. Guidelines for the Content of Statistical Analysis Plans in Clinical Trials. JAMA. 2017;318:2337–43.
The trial is funded by the Beijing Municipal Science & Technology Commission (D171100003217003) and the Special Funding for Clinical Medicine Development of the Beijing Municipal Hospitals Administration (XMLX201607). The funders have no role in study design, data collection, analysis and interpretation, decision to publish, or preparation of the manuscript.
Ethics approval and consent to participate
Ethics approval was granted by the research ethics committee of Beijing Hospital of Traditional Chinese Medicine Affiliated to Capital Medical University (2017BL-077-01) and at each participating site. Written informed consent will be obtained from each participant prior to enrolment in the study.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Tu, JF., Yang, JW., Wang, LQ. et al. Efficacy of electro-acupuncture and manual acupuncture versus sham acupuncture for knee osteoarthritis: statistical analysis plan for a randomized controlled trial. Trials 20, 394 (2019). https://doi.org/10.1186/s13063-019-3513-2
- Knee osteoarthritis
- Statistical analysis plan