1
|
Liu T, Jiang L, Li S, Cheng S, Zhuang R, Xiong Z, Sun C, Liu B, Zhang H, Yan S. The blinding status and characteristics in acupuncture clinical trials: a systematic reviews and meta-analysis. Syst Rev 2024; 13:302. [PMID: 39643890 PMCID: PMC11624600 DOI: 10.1186/s13643-024-02692-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/18/2024] [Accepted: 10/21/2024] [Indexed: 12/09/2024] Open
Abstract
BACKGROUND Sham acupuncture is a widely accepted control in acupuncture clinical trials. Given the nature of acupuncture, it is warranted to assess the blinding of sham-controlled trials. Despite the sham acupuncture design having been widely used, the overall blinding of sham acupuncture and the characteristics of blinding assessment in acupuncture trials are unclear. This research aims to assess the blinding status of acupuncture clinical trials and explore the blinding assessment characteristics in acupuncture trials. METHODS This meta-analysis included all the acupuncture clinical trials published in English that performed blinding assessments and reported the results. We searched PubMed, Embase, and Web of Science for randomized controlled trials (RCTs) from inception to April 2024. The primary outcome is Bang's Blinding Index (Bang's BI) and 95% credibility interval (CrI) was pooled using a Bayesian hierarchical model. The study adheres to the PRISMA guidelines. RESULTS Sixty-four eligible studies published from 1999 to 2024 were included. The mean of Bang's BI was - 0.24 (95% CrI - 0.34 to - 0.14, tau2 = 0.13) for the sham acupuncture group and 0.41 (95% CrI 0.32 to 0.49, tau2 = 0.10) for the verum acupuncture group. The characteristics of blinding showed that 62.50% of the trials had a Bang's BI greater than 0 in the verum group and less than 0 in the sham group; in 28.15% of the trials, the Bang's BI was greater than 0 in the verum group and greater than 0 in the sham group. Subgroup analysis revealed that area, number of research centers, treatment sessions, acupoints number, and evaluation timepoint can influence blinding results. CONCLUSION Overall blinding status in current acupuncture clinical trials shows a majority correctly guessing for the verum group and opposite guessing for the sham group. However, in some acupuncture trials, the blinding of sham acupuncture might be compromised. Factors such as the Asian population, penetrating sham needling, and querying participants about their group assignment during the study increase the risk of unblinding and warrant careful consideration in sham acupuncture control design. Furthermore, researchers should closely monitor the blinding status of sham acupuncture and transparently report details of blinding assessments. SYSTEMATIC REVIEW REGISTRATION PROSPERO CRD42023403595.
Collapse
Affiliation(s)
- Tinglan Liu
- School of Acupuncture-Moxibustion and Tuina, Beijing University of Chinese Medicine, Beijing, China
| | - Lijiao Jiang
- The Fourth Clinical Medical College, Guangzhou University of Chinese Medicine, Guangdong, China
| | - Shuangjing Li
- School of Acupuncture-Moxibustion and Tuina, Beijing University of Chinese Medicine, Beijing, China
| | - Shuyang Cheng
- School of Mathematical Sciences, Capital Normal University, Beijing, China
| | - Rong Zhuang
- School of Acupuncture-Moxibustion and Tuina, Beijing University of Chinese Medicine, Beijing, China
| | - Zhiyi Xiong
- School of Acupuncture-Moxibustion and Tuina, Beijing University of Chinese Medicine, Beijing, China
| | - Chongyang Sun
- School of Acupuncture-Moxibustion and Tuina, Beijing University of Chinese Medicine, Beijing, China
| | - Baoyan Liu
- Institute of Basic Research in Clinical Medicine, China, Academy of Chinese Medical Sciences, Beijing, China
| | - Haoran Zhang
- College of Preschool Education, Beijing Youth Politics College, Beijing, China.
| | - Shiyan Yan
- School of Acupuncture-Moxibustion and Tuina, Beijing University of Chinese Medicine, Beijing, China.
- International Acupuncture and Moxibustion Innovation Institute, Beijing University of Chinese Medicine, Beijing, China.
| |
Collapse
|
2
|
Acupuncture Versus Sham Acupuncture: A Meta-Analysis on Evidence for Longer-term Effects of Acupuncture in Musculoskeletal Disorders. Clin J Pain 2021; 36:533-549. [PMID: 32028381 DOI: 10.1097/ajp.0000000000000812] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
EDITORIAL NOTE The original Letter to the Editor prepared by Jones et al was based on the initial electronic version then contained several important procedural errors that resulted in erroneous conclusions as noted by Jones et al in their original Letter. Subsequently, the authors of the Letter to the Editor were notified of the corrections and they then prepared the revised Letter to the Editor published here. Jones et al did note a remaining error in Table 5 of their corrected manuscript. Based on Jones et al's observation, Lenoir et al were notified of an error on Table 5 and have addressed this in the current version of their paper published in this issue. We appreciate the input of the authors of the letter and the positive response of the author(s) of this article. Dennis C. Turk, PhD Editor-in-Chief OBJECTIVE:: Acupuncture is a common modality in the therapy of musculoskeletal disorders. The evidence for acupuncture has been examined frequently, but a clear synthesis of previous research is currently lacking. This meta-analysis aimed to summarize the evidence for nonimmediate effects of acupuncture on pain, functionality, and quality of life in patients with musculoskeletal disorders, when compared with sham acupuncture. METHODS Search results from PubMed and Web of Science were brought together. All screening procedures were executed twice by 2 independent researchers. The pooled standardized mean difference (SMD) with its confidence interval (CI) was estimated at follow-up at <1 month, 1 to 3 months, 3 to 6 months, and >6 months. RESULTS For pain, the SMD equalled respectively -0.47 (CI -0.76 to -0.19), -0.27 (CI -0.44 to -0.11), -0.32 (CI -0.51 to -0.13) and -0.12 (CI -0.36 to 0.11) for <1 month, 1 to 3 months, 3 to 6 months, and >6 months follow-up. For functionality, the pooled SMD equalled -0.43 (CI -0.76 to -0.10), -0.41 (CI -0.76 to -0.05), 0.07 (CI -0.22 to 0.36), and -0.13 (-0.46 to 0.19). In the area of QOL, pooled SMD of respectively 0.20 (CI 0.04 to 0.35), 0.19 (CI -0.01 to 0.39), 0.02 (CI -0.09 to 0.14) and -0.04 (CI -0.25 to 0.16) were obtained. DISCUSSION A significant difference in therapy effect, favoring acupuncture, was found for pain at <1 month, 1 to 3 months, and 3 to 6 months, as well as on quality of life at <1 month, and on functionality at <1 month and 1 to 3 months.
Collapse
|
3
|
Chen YJ, Shimizu Bassi G, Yang YQ. Classic Chinese Acupuncture versus Different Types of Control Groups for the Treatment of Chronic Pain: Review of Randomized Controlled Trials (2000-2018). EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE : ECAM 2019; 2019:6283912. [PMID: 31885655 PMCID: PMC6914898 DOI: 10.1155/2019/6283912] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/11/2019] [Accepted: 11/04/2019] [Indexed: 12/20/2022]
Abstract
OBJECTIVE To review the effectiveness of classic Chinese acupuncture in the treatment of chronic pain by comparing treatment groups with different types of control groups in accordance with the newly published guidelines for systematic reviews. METHODS We searched EMBASE, PubMed, and the Cochrane Central Register of Controlled Trials databases from 2000 to 2018. We included randomized controlled trials that included acupuncture as the sole treatment or as an adjunctive treatment for chronic pain. The outcome was pain intensity measured by the visual analogue scale (VAS), Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) pain subscale, 11-point numeric rating scale (NRS), and other tools. Two researchers conducted the study selection, data extraction, and quality assessment processes independently. Disagreements were solved by discussion and reanalysis of the data. The quality of all included studies was evaluated using the CBNG (the Cochrane Back and Neck Group) and the STRICTA (Standards for Reporting Interventions in Controlled Trials of Acupuncture) checklists. RESULTS Sixty-one studies were fully analyzed and ranked based on the newest STRICTA and CBNG standards. We found good evidence that receiving acupuncture is better than not receiving treatment or being placed on a waiting list and reasonable evidence that it is better than conventional or usual care. Limited evidence was found regarding placebo treatments that involve the expectation of needling (real or fake). CONCLUSION Sham acupuncture may not be appropriate as a control intervention for assessing the effectiveness of acupuncture. Acupuncture effectiveness in controlling chronic pain is still limited due to the low quality of the studies published.
Collapse
Affiliation(s)
- Yan-Jiao Chen
- Shanghai Research Institute of Acupuncture & Meridian, Shanghai University of Traditional Chinese Medicine, 650 South Wanping Road, Shanghai 200030, China
| | - Gabriel Shimizu Bassi
- Shanghai Research Institute of Acupuncture & Meridian, Shanghai University of Traditional Chinese Medicine, 650 South Wanping Road, Shanghai 200030, China
| | - Yong-Qing Yang
- Shanghai Research Institute of Acupuncture & Meridian, Shanghai University of Traditional Chinese Medicine, 650 South Wanping Road, Shanghai 200030, China
| |
Collapse
|
4
|
Takakura N, Takayama M, Nasu M, Nishiwaki M, Kawase A, Yajima H. Patient blinding with blunt tip placebo acupuncture needles: comparison between 1 mm and 2 mm skin press. JOURNAL OF INTEGRATIVE MEDICINE 2018; 16:164-171. [PMID: 29753429 DOI: 10.1016/j.joim.2018.01.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2017] [Accepted: 12/05/2017] [Indexed: 01/18/2023]
Abstract
OBJECTIVE To investigate the influence of the depth of skin press in blunt tip placebo acupuncture needles on patient blinding and its relationship to needle diameter. METHODS Forty healthy volunteers were enrolled as subjects for patient blinding. Four acupuncturists applied the following needles randomly at three points in each forearm: 0.18 mm and 0.25 mm diameter penetrating needles inserted to a depth of 5 mm, and 0.18 mm and 0.25 mm diameter skin-touch needles depressing the skin at the acupoint to a depth of 1 mm and 2 mm from the skin surface. The subjects reported their guesses at the nature of needles they received, and rated needle pain and de qi. A blinding index was calculated to define the success of blinding for subjects. RESULTS The blinding status of subjects for 1 mm press needles of 0.18 mm diameter was "random guess", but "unblinded" for 1 mm press needles of 0.25 mm diameter. For 2 mm press needles of both diameters, the blinding status was "opposite guess" and the blinding status for penetrating needles of both diameters was "unblinded." The percentages of "felt pain" with 2 mm press needles of both diameters were similar to that with penetrating needles, but those were not similar for 1 mm press needles. The frequency of de qi occurrence with 2 mm press needles of 0.18 mm diameter was similar to that of penetrating needles of both diameters. CONCLUSION Placebo needles of 2 mm press made more subjects guess that the needles penetrated the skin than 1 mm press needles. The use of small diameter needles increased patient blinding.
Collapse
Affiliation(s)
- Nobuari Takakura
- Department of Acupuncture and Moxibustion, Faculty of Health Sciences, Tokyo Ariake University of Medical and Health Sciences, Tokyo 135-0063, Japan; Department of Physiology, Showa University School of Medicine, Tokyo 142-8555, Japan; Japan School of Acupuncture, Moxibustion and Physiotherapy, Tokyo 150-0031, Japan.
| | - Miho Takayama
- Department of Acupuncture and Moxibustion, Faculty of Health Sciences, Tokyo Ariake University of Medical and Health Sciences, Tokyo 135-0063, Japan; Department of Physiology, Showa University School of Medicine, Tokyo 142-8555, Japan; Japan School of Acupuncture, Moxibustion and Physiotherapy, Tokyo 150-0031, Japan
| | - Morihiro Nasu
- Department of Acupuncture and Moxibustion, Faculty of Health Sciences, Tokyo Ariake University of Medical and Health Sciences, Tokyo 135-0063, Japan
| | - Masako Nishiwaki
- Department of Acupuncture and Moxibustion, Faculty of Health Sciences, Tokyo Ariake University of Medical and Health Sciences, Tokyo 135-0063, Japan
| | - Akiko Kawase
- Japan School of Acupuncture, Moxibustion and Physiotherapy, Tokyo 150-0031, Japan
| | - Hiroyoshi Yajima
- Department of Acupuncture and Moxibustion, Faculty of Health Sciences, Tokyo Ariake University of Medical and Health Sciences, Tokyo 135-0063, Japan; Department of Physiology, Showa University School of Medicine, Tokyo 142-8555, Japan; Japan School of Acupuncture, Moxibustion and Physiotherapy, Tokyo 150-0031, Japan
| |
Collapse
|
5
|
Yuan QL, Wang P, Liu L, Sun F, Cai YS, Wu WT, Ye ML, Ma JT, Xu BB, Zhang YG. Acupuncture for musculoskeletal pain: A meta-analysis and meta-regression of sham-controlled randomized clinical trials. Sci Rep 2016; 6:30675. [PMID: 27471137 PMCID: PMC4965798 DOI: 10.1038/srep30675] [Citation(s) in RCA: 111] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2016] [Accepted: 07/07/2016] [Indexed: 12/30/2022] Open
Abstract
The aims of this systematic review were to study the analgesic effect of real acupuncture and to explore whether sham acupuncture (SA) type is related to the estimated effect of real acupuncture for musculoskeletal pain. Five databases were searched. The outcome was pain or disability immediately (≤1 week) following an intervention. Standardized mean differences (SMDs) with 95% confidence intervals were calculated. Meta-regression was used to explore possible sources of heterogeneity. Sixty-three studies (6382 individuals) were included. Eight condition types were included. The pooled effect size was moderate for pain relief (59 trials, 4980 individuals, SMD -0.61, 95% CI -0.76 to -0.47; P < 0.001) and large for disability improvement (31 trials, 4876 individuals, -0.77, -1.05 to -0.49; P < 0.001). In a univariate meta-regression model, sham needle location and/or depth could explain most or all heterogeneities for some conditions (e.g., shoulder pain, low back pain, osteoarthritis, myofascial pain, and fibromyalgia); however, the interactions between subgroups via these covariates were not significant (P < 0.05). Our review provided low-quality evidence that real acupuncture has a moderate effect (approximate 12-point reduction on the 100-mm visual analogue scale) on musculoskeletal pain. SA type did not appear to be related to the estimated effect of real acupuncture.
Collapse
Affiliation(s)
- Qi-ling Yuan
- Department of Orthopaedics of the First Affiliated Hospital, Medical School, Xi’an Jiaotong University, Xi’an 710061, Shaanxi, China
| | - Peng Wang
- Xi’an 521 Hospital, Xi’an 710065, Shaanxi, China
| | - Liang Liu
- Department of Orthopaedics of the First Affiliated Hospital, Medical School, Xi’an Jiaotong University, Xi’an 710061, Shaanxi, China
| | - Fu Sun
- Department of Orthopaedics of the First Affiliated Hospital, Medical School, Xi’an Jiaotong University, Xi’an 710061, Shaanxi, China
- Department of Orthopaedics of the First Affiliated Hospital of Xi’an Medical College, Xi’an 710077, Shaanxi, China
| | - Yong-song Cai
- Department of Orthopaedics of the First Affiliated Hospital, Medical School, Xi’an Jiaotong University, Xi’an 710061, Shaanxi, China
| | - Wen-tao Wu
- Department of Orthopaedics of the First Affiliated Hospital, Medical School, Xi’an Jiaotong University, Xi’an 710061, Shaanxi, China
| | - Mao-lin Ye
- Henan Province Hospital of TCM, Henan University of TCM, Zhengzhou 450008, Henan, China
| | - Jiang-tao Ma
- Henan Province Hospital of TCM, Henan University of TCM, Zhengzhou 450008, Henan, China
| | - Bang-bang Xu
- Henan Province Hospital of TCM, Henan University of TCM, Zhengzhou 450008, Henan, China
| | - Yin-gang Zhang
- Department of Orthopaedics of the First Affiliated Hospital, Medical School, Xi’an Jiaotong University, Xi’an 710061, Shaanxi, China
- Henan Province Hospital of TCM, Henan University of TCM, Zhengzhou 450008, Henan, China
| |
Collapse
|
6
|
Effectiveness of Acupuncture Therapies to Manage Musculoskeletal Disorders of the Extremities: A Systematic Review. J Orthop Sports Phys Ther 2016; 46:409-29. [PMID: 27117725 DOI: 10.2519/jospt.2016.6270] [Citation(s) in RCA: 38] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Study Design Systematic review. Background Little is known about the effectiveness of acupuncture therapies for musculoskeletal disorders. Objective To assess the effectiveness and safety of acupuncture therapies for musculoskeletal disorders of the extremities. Methods We searched MEDLINE, Embase, CINAHL, PsycINFO, and Cochrane Central Register of Controlled Trials from 1990 to 2015 for randomized controlled trials, cohort studies, and case-control studies. Eligible studies were appraised with Scottish Intercollegiate Guidelines Network criteria. A best-evidence synthesis was performed to synthesize results from included studies with a low risk of bias. A sensitivity analysis was conducted to determine the impact of excluding studies with a high risk of bias. Results The search revealed 5180 articles; 15 were included (10 with a low risk of bias, 5 with a high risk of bias). The studies with a low risk of bias suggested that (1) traditional needle acupuncture was superior to oral steroids (1 RCT, n = 77) and may be superior to vitamin B1/B6 supplements (1 RCT, n = 64) for carpal tunnel syndrome (CTS), and was superior to exercise for Achilles tendinopathy (1 RCT, n = 64). Traditional needle acupuncture did not provide important benefit over placebo for upper extremity pain (1 RCT, n = 128), or no intervention for patellofemoral pain (1 RCT, n = 75), and was inconclusive for shoulder pain (2 RCTs, n = 849), suggesting no important benefit; (2) electroacupuncture may be superior to placebo for shoulder injuries (1 RCT, n = 130) and may not be superior to night splinting for persistent CTS (1 RCT, n = 78); and (3) dry needling may be superior to placebo for plantar fasciitis (1 RCT, n = 84). Sensitivity analysis suggests that including studies with a high risk of bias might have impacted the evidence synthesis in support of managing shoulder pain with traditional needle acupuncture, and that would suggest traditional needle acupuncture may be effective for lateral epicondylitis and piriformis syndrome. Conclusion Evidence for the effectiveness of acupuncture for musculoskeletal disorders of the extremities was inconsistent. Traditional needle acupuncture may be beneficial for CTS and Achilles tendinopathy, but not for nonspecific upper extremity pain and patellofemoral syndrome. Electroacupuncture may be effective for shoulder injuries and may show similar effectiveness to that of night wrist splinting for CTS. The effectiveness of dry needling for plantar fasciitis is equivocal. Level of Evidence Therapy, 1a-. J Orthop Sports Phys Ther 2016;46(6):409-429. Epub 26 Apr 2016. doi:10.2519/jospt.2016.6270.
Collapse
|
7
|
Is sham acupuncture as effective as traditional Chinese acupuncture? It's too early to say. Chin J Integr Med 2016; 22:483-9. [PMID: 27081001 DOI: 10.1007/s11655-016-2458-5] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2015] [Indexed: 10/22/2022]
Abstract
Many clinical trials and experimental studies claim that sham acupuncture is as effective as traditional Chinese acupuncture. However, these studies have no standard sham acupuncture control and many other factors can affect the clinical effect. These factors include needle retention time, treatment frequency, and the total number of treatments needed for satisfactory results, and all can change the clinical effect. The majority of existing acupuncture treatment studies do not consider these factors and lack standard dosage criteria. Therefore, it is still too early to conclude that sham acupuncture is as effective as traditional Chinese acupuncture. This article investigates the factors that influence the curative effect of acupuncture as to help set a standard for acupuncture studies in the future.
Collapse
|
8
|
Zhang CS, Tan HY, Zhang GS, Zhang AL, Xue CC, Xie YM. Placebo Devices as Effective Control Methods in Acupuncture Clinical Trials: A Systematic Review. PLoS One 2015; 10:e0140825. [PMID: 26536619 PMCID: PMC4633221 DOI: 10.1371/journal.pone.0140825] [Citation(s) in RCA: 64] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2015] [Accepted: 09/29/2015] [Indexed: 12/27/2022] Open
Abstract
While the use of acupuncture has been recognised by the World Health Organisation, its efficacy for many of the common clinical conditions is still undergoing validation through randomised controlled trials (RCTs). A credible placebo control for such RCTs to enable meaningful evaluation of its efficacy is to be established. While several non-penetrating acupuncture placebo devices, namely the Streitberger, the Park and the Takakura Devices, have been developed and used in RCTs, their suitability as inert placebo controls needs to be rigorously determined. This article systematically reviews these devices as placebo interventions. Electronic searches were conducted on four English and two Chinese databases from their inceptions to July 2014; hand searches of relevant references were also conducted. RCTs, in English or Chinese language, comparing acupuncture with one of the aforementioned devices as the control intervention on human participants with any clinical condition and evaluating clinically related outcomes were included. Thirty-six studies were included for qualitative analysis while 14 were in the meta-analysis. The meta-analysis does not support the notion of either the Streitberger or the Park Device being inert control interventions while none of the studies involving the Takakura Device was included in the meta-analysis. Sixteen studies reported the occurrence of adverse events, with no significant difference between verum and placebo acupuncture. Author-reported blinding credibility showed that participant blinding was successful in most cases; however, when blinding index was calculated, only one study, which utilised the Park Device, seemed to have an ideal blinding scenario. Although the blinding index could not be calculated for the Takakura Device, it was the only device reported to enable practitioner blinding. There are limitations with each of the placebo devices and more rigorous studies are needed to further evaluate their effects and blinding credibility.
Collapse
Affiliation(s)
- Claire Shuiqing Zhang
- Traditional and Complementary Medicine Research Program, RMIT Health Innovations Research Institute, School of Health Sciences, RMIT University, Bundoora, Victoria, Australia
| | - Hsiewe Ying Tan
- Traditional and Complementary Medicine Research Program, RMIT Health Innovations Research Institute, School of Health Sciences, RMIT University, Bundoora, Victoria, Australia
| | - George Shengxi Zhang
- Traditional and Complementary Medicine Research Program, RMIT Health Innovations Research Institute, School of Health Sciences, RMIT University, Bundoora, Victoria, Australia
| | - Anthony Lin Zhang
- Traditional and Complementary Medicine Research Program, RMIT Health Innovations Research Institute, School of Health Sciences, RMIT University, Bundoora, Victoria, Australia
| | - Charlie Changli Xue
- Traditional and Complementary Medicine Research Program, RMIT Health Innovations Research Institute, School of Health Sciences, RMIT University, Bundoora, Victoria, Australia
| | - Yi Min Xie
- Centre for Innovative Structures and Materials, School of Civil, Environmental and Chemical Engineering, RMIT University, Melbourne, Victoria, Australia
| |
Collapse
|
9
|
Affiliation(s)
- Paul J. Rosch
- Departments of Medicine and Psychiatry, New York College of Medicine, The American Institute of Stress, Hastings-on-Hudson, NY
| |
Collapse
|
10
|
Abstract
Over the past two decades there has been a growing acceptance of 'integrative oncology', also known as complementary and alternative medicine (CAM), in cancer care and research at academic medical centres and medical schools. Proponents of integrative oncology argue that it is based in science and provides the 'best of both worlds' by combining science-based treatments and 'holistic' medicine. However, a close examination of the methodologies indicates that, from a standpoint of basic science, the vast majority of 'integrative' treatments are supported by little, if any, scientific evidence. What are the consequences of this integration? Is there any harm? Are there any potential benefits?
Collapse
|
11
|
Acupuncture and clomiphene citrate for live birth in polycystic ovary syndrome: study design of a randomized controlled trial. EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE 2013; 2013:527303. [PMID: 24023577 PMCID: PMC3762180 DOI: 10.1155/2013/527303] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 02/09/2013] [Revised: 05/29/2013] [Accepted: 07/01/2013] [Indexed: 12/31/2022]
Abstract
Acupuncture is an alternative therapy to induce ovulation in women with polycystic ovary syndrome (PCOS), but there is no study reporting the live birth rate following ovulation induction by acupuncture or its potential as an adjuvant treatment to clomiphene citrate (CC). We assess the efficacy of acupuncture with or without CC in achieving live births among 1000 PCOS women in Mainland China. This paper reports the methodology of an ongoing multicenter randomized controlled trial. The randomization scheme is coordinated through the central mechanism and stratified by the participating sites. Participants will be randomized into one of the four treatment arms: (A) true acupuncture and CC, (B) control acupuncture and CC, (C) true acupuncture and placebo CC, and (D) control acupuncture and placebo CC. To ensure the quality and integrity of the trial we have developed a unique multinational team of investigators and Data and Safety Monitoring Board. Up to the end of April 2013, 326 subjects were recruited. In conclusion, the success of this trial will allow us to evaluate the additional benefit of acupuncture beyond the first line medicine for fertility treatment in PCOS women in an unbiased manner.
Collapse
|
12
|
Blinding measured: a systematic review of randomized controlled trials of acupuncture. EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE 2013; 2013:708251. [PMID: 23533515 PMCID: PMC3603669 DOI: 10.1155/2013/708251] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/17/2012] [Revised: 01/06/2013] [Accepted: 01/06/2013] [Indexed: 12/02/2022]
Abstract
Background. There is no agreement among researchers on viable controls for acupuncture treatment, and the assessment of the effectiveness of blinding and its interpretation is rare. Purpose. To systematically assess the effectiveness of blinding (EOB) in reported acupuncture trials; to explore results of RCTs using a quantitative measure of EOB. Data Sources. A systematic review of published sham RCTs that assessed blinding. Study Selection. Five hundred and ninety studies were reviewed, and 54 studies (4783 subjects) were included. Data Extraction. The number of patients who guessed their treatment identity was extracted from each study. Variables with possible influence on blinding were identified. Data Synthesis. The blinding index was calculated for each study. Based on blinding indexes, studies were congregated into one of the nine blinding scenarios. Individual study characteristics were explored for potential association with EOB. Limitations. There is a possibility of publication or reporting bias. Conclusions. The most common scenario was that the subjects believed they received verum acupuncture regardless of the actual treatment received, and overall the subject blinding in the acupuncture studies was satisfactory, with 61% of study participants maintaining ideal blinding. Objectively calculated blinding data may offer meaningful and systematic ways to further interpret the findings of RCTs.
Collapse
|
13
|
The effectiveness of acupuncture in the treatment of Gulf War Illness. Contemp Clin Trials 2012; 33:557-62. [PMID: 22349455 DOI: 10.1016/j.cct.2012.02.006] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2011] [Revised: 02/01/2012] [Accepted: 02/06/2012] [Indexed: 11/20/2022]
Abstract
INTRODUCTION It can be challenging to study complex and novel health states within the parameters of a RCT. This report describes the use of an unblinded Phase II Clinical Trial design to investigate the effectiveness of acupuncture in the treatment of Gulf War Illness (GWI). GWI is a complex illness found among veterans of the first Gulf War, and is characterized by multiple symptoms, including fatigue, sleep and mood disturbances, cognitive dysfunction, and musculoskeletal pain. No published trials of acupuncture for the treatment of GWI exist. This trial is designed to both answer questions of the effectiveness of acupuncture for our entire sample, as well as subgroups with of individual presentations of GWI. MATERIALS AND METHODS Our primary outcome is quality of life as measured by the SF-36. In an effort to better understand this complex disease and its treatment, our multi-level measurement plan examines psychosocial variables, fatigue, sleep quality, pain, and biomarkers of inflammation and immune status. All of the measurement instruments used in this trial show good validity and reliability. RESULTS This study is ongoing and clinical results are not available. We have achieved good feasibility of our recruitment, treatment, and data collection procedures. CONCLUSIONS Low constraint RCT designs are an appropriate choice when investigating conditions in which the causes and mechanisms of disease are poorly understood. This naturalistic RCT includes individualized protocols, a clinically supported length and dose of treatment, a wait list control arm, and the ethical benefit that all subjects receive treatment during the study.
Collapse
|
14
|
Thompson ME, Jenkins J, Smucker A, Smithwick S, Groopman D, Pastore LM. Acupuncturist perceptions of serving as a clinical trial practitioner. Complement Ther Med 2012; 20:183-9. [PMID: 22579429 DOI: 10.1016/j.ctim.2012.01.002] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2011] [Revised: 12/19/2011] [Accepted: 01/11/2012] [Indexed: 10/14/2022] Open
Abstract
OBJECTIVE This article describes the experience of four acupuncturists in terms of what it meant for them to be a practitioner in a recently completed sham-controlled acupuncture randomized control trial (RCT) with a standardized protocol. DESIGN At the completion of the RCT for women with ovarian dysfunction, study acupuncturists (2 male MD/acupuncturists and 2 female professional acupuncturists) were queried about their perceptions of participating in the RCT using both written responses to 5 open-ended questions and a focus group interview. Data was analyzed to categorize responses and identify themes. SETTING Virginia, USA. RESULTS The acupuncturists' experience of participating in a RCT was generally very positive, including: usual practitioner/participant relationships, collegial sharing, and increased patient volume and diversity. There was angst expressed about the unknown RCT results. While there were concerns about standardizing the acupuncture session ("dilutes the power of acupuncture therapeutics"), the acupuncturists' were supportive of the pre-established protocol. The acupuncturists overall did not have concerns with a sham intervention arm because the sham recipients did not know their treatment arm and felt as satisfied with study participation as the true acupuncture recipients. CONCLUSIONS Despite initial misgivings about both a standardized protocol and a sham arm, all practitioners discovered positive aspects of being a study acupuncturist. The analysis highlights the need for communication before, during and after a clinical trial between the study investigators and the intervention practitioners. As stake holders in the perception of CAM therapies with the public and with conventional medicine practitioners, it would benefit future research on CAM to similarly assess experiences of being a CAM study practitioner in order to enhance provider recruitment and reduce provider drop-out.
Collapse
Affiliation(s)
- M E Thompson
- School of Nursing, University of Virginia, Charlottesville, VA, USA
| | | | | | | | | | | |
Collapse
|
15
|
Ernst E, Snyder J, Dunlop RA. National Center for Complementary and Alternative Medicine-funded randomised controlled trials of acupuncture: a systematic review. ACTA ACUST UNITED AC 2011. [DOI: 10.1111/j.2042-7166.2011.01112.x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
|
16
|
Meng X, Xu S, Lao L. Clinical acupuncture research in the West. Front Med 2011; 5:134-40. [DOI: 10.1007/s11684-011-0135-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2011] [Accepted: 04/11/2011] [Indexed: 11/29/2022]
|
17
|
Tan CW, Sheehan P, Santos D. Discrimination accuracy between real and sham needles using the Park sham device in the upper and lower limbs. Acupunct Med 2011; 29:208-14. [PMID: 21652672 DOI: 10.1136/aim.2010.003210] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
OBJECTIVE To evaluate the blinding effectiveness of the Park sham acupuncture device using participants' ability to discriminate between the real and sham acupuncture needles in the (1) upper limb (TE points) compared with pure guessing and (2) lower limb (BL points) compared with pure guessing. METHODS 20 healthy acupuncture-naïve university students and staff were recruited through convenience sampling. Participants made Yes-No judgements on whether the real or sham needle was administered to four TE acupoints on the dominant upper limb, and four acupoints along the BL meridian on the dominant lower limb. The proportion of correct judgements, P(C), for each participant was calculated to indicate the discrimination accuracy of participants in distinguishing between the real and sham needles. Separate P(C) were computed for the upper limb acupoints and lower limb acupoints. The data were also pooled to calculate a P(C) for a combination of both body regions. RESULTS The participants' discrimination accuracy between the real and sham needles was not statistically significant from P(C)=0.5 (chance level) for the lower limb alone and combined body regions' acupoint comparisons (lower limb: t(19)=0.00, unadjusted p=1.00; combined: t(19)=1.75, unadjusted p=0.10). However, the participants' discrimination accuracy was statistically significant from P(C)=0.5 for the upper limb acupoints alone comparison (t(19)=2.36, unadjusted p=0.03). CONCLUSIONS This study showed that the Park sham device is more likely to blind participants in differentiating between the real and sham needles in the lower limb (BL meridian) acupoints than in the upper limb (TE meridian). However, the participants' ability to differentiate between the needle types for the upper limb acupoints was significantly different from chance levels.
Collapse
Affiliation(s)
- Chee-Wee Tan
- Queen Margaret University Edinburgh, Queen Margaret University Drive, Edinburgh EH21 6UU, UK.
| | | | | |
Collapse
|
18
|
Whale CA, MacLaran SJA, Whale CI, Barnett M. Pilot study to assess the credibility of acupuncture in acute exacerbations of chronic obstructive pulmonary disease. Acupunct Med 2011; 27:13-5. [PMID: 19369188 DOI: 10.1136/aim.2008.000232] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
BACKGROUND Exacerbation of chronic obstructive pulmonary disease (COPD) is a common reason for hospital admission, and adjunctive non-pharmacological treatments would be welcomed. A pilot study was undertaken to assess the feasibility of conducting a study of acupuncture during an acute exacerbation of COPD. We also examined the credibility of a sham device in this setting and assessed the effect of acupuncture on breathlessness and anxiety. METHODS A prospective, randomised, patient- and assessor-blinded, sham controlled study was conducted on three consecutive days in a district general hospital. Credibility of both acupuncture and the Park sham device were assessed using the Borkovec and Nau questionnaire. Dyspnoea was measured on the modified Borg score and a 10 cm visual analogue scale, while anxiety was measured on a 10 cm visual analogue scale. RESULTS 11 patients were recruited and nine completed the study. There were no adverse events with either intervention. Acupuncture was well tolerated and credibility scores were similar before and after real and sham acupuncture. Symptoms improved after both treatments, with no significant difference between groups. CONCLUSION In this pilot study acupuncture was well tolerated by subjects experiencing an acute exacerbation of COPD. Acupuncture treatment and the Park sham device were both credible. Although recruitment was slow, a further trial with a larger sample size is feasible and recommended.
Collapse
Affiliation(s)
- Claudia A Whale
- John Eastwood Hospice, Mansfield Road, Sutton-in-Ashfield, Nottinghamshire NG174HJ.
| | | | | | | |
Collapse
|
19
|
Enblom A, Lekander M, Hammar M, Johnsson A, Onelöv E, Ingvar M, Steineck G, Börjeson S. Getting the grip on nonspecific treatment effects: emesis in patients randomized to acupuncture or sham compared to patients receiving standard care. PLoS One 2011; 6:e14766. [PMID: 21448267 PMCID: PMC3063156 DOI: 10.1371/journal.pone.0014766] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2009] [Accepted: 12/14/2010] [Indexed: 01/08/2023] Open
Abstract
Background It is not known whether or not delivering acupuncture triggers mechanisms
cited as placebo and if acupuncture or sham reduces radiotherapy-induced
emesis more than standard care. Methodology/Principal Findings Cancer patients receiving radiotherapy over abdominal/pelvic regions were
randomized to verum (penetrating) acupuncture (n = 109;
99 provided data) in the alleged antiemetic acupuncture point PC6 or sham
acupuncture (n = 106; 101 provided data) performed with
a telescopic non-penetrating needle at a sham point 2–3 times/week
during the whole radiotherapy period. The acupuncture cohort was compared to
a reference cohort receiving standard care (n = 62; 62
provided data). The occurrence of emesis in each group was compared after a
mean dose of 27 Gray. Nausea and vomiting were experienced during the
preceding week by 37 and 8% in the verum acupuncture group, 38 and
7% in the sham acupuncture group and 63 and 15% in the
standard care group, respectively. The lower occurrence of nausea in the
acupuncture cohort (verum and sham) compared to patients receiving standard
care (37% versus 63%, relative risk (RR) 0.6, 95 %
confidence interval (CI) 0.5–0.8) was also true after adjustment for
potential confounding factors for nausea (RR 0.8, CI 0.6 to 0.9). Nausea
intensity was lower in the acupuncture cohort (78% no nausea,
13% a little, 8% moderate, 1% much) compared to the
standard care cohort (52% no nausea, 32% a little, 15%
moderate, 2% much) (p = 0.002). The acupuncture
cohort expected antiemetic effects from their treatment (95%).
Patients who expected nausea had increased risk for nausea compared to
patients who expected low risk for nausea (RR 1.6; Cl 1.2–2.4). Conclusions/Significance Patients treated with verum or sham acupuncture experienced less nausea and
vomiting compared to patients receiving standard care, possibly through a
general care effect or due to the high level of patient expectancy. Trial Registration ClinicalTrials.gov NCT00621660
Collapse
Affiliation(s)
- Anna Enblom
- Division of Nursing Science, Department of Medical and Health Sciences, Linköping University, Linköping, Sweden.
| | | | | | | | | | | | | | | |
Collapse
|
20
|
Shuai P, Zhou XH, Lao L, Li X. Issues of design and statistical analysis in controlled clinical acupuncture trials: an analysis of English-language reports from Western journals. Stat Med 2011; 31:606-18. [PMID: 21341295 DOI: 10.1002/sim.4034] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2010] [Accepted: 06/25/2010] [Indexed: 12/17/2022]
Abstract
OBJECTIVE To investigate major methods of design and statistical analysis in controlled clinical acupuncture trials published in the West during the past six years (2003-2009) and, based on this analysis, to provide recommendations that address methodological issues and challenges in clinical acupuncture research. METHOD PubMed was searched for acupuncture RCTs published in Western journals in English between 2003 and 2009. The keyword used was acupuncture. RESULTS One hundred and eight qualified reports of acupuncture trials that included more than 30 symptoms/conditions were identified, analyzed, and grouped into efficacy (explanatory), effectiveness (pragmatically beneficial), and other (unspecified) studies. All were randomized controlled clinical trials (RCTs). In spite of significant improvement in the quality of acupuncture RCTs in the last 30 years, these reports show that some methodological issues and shortcomings in design and analysis remain. Moreover, the quality of the efficacy studies was not superior to that of the other types of studies. Research design and reporting problems include unclear patient criteria and inadequate practitioner eligibility, inadequate randomization, and blinding, deficiencies in the selection of controls, and improper outcome measurements. The problems in statistical analysis included insufficient sample sizes and power calculations, inadequate handling of missing data and multiple comparisons, and inefficient methods for dealing with repeated measure and cluster data, baseline value adjustment, and confounding issues. CONCLUSION Despite recent advancements in acupuncture research, acupuncture RCTs can be improved, and more rigorous research methods should be carefully considered.
Collapse
Affiliation(s)
- Ping Shuai
- Department of Health Statistics, West China School of Public Health, Sichuan University, Chengdu, People's Republic of China
| | | | | | | |
Collapse
|
21
|
Goldman RH, Stason WB, Park SK, Kim R, Mudgal S, Davis RB, Legedza AT, Kaptchuk TJ. Low-dose amitriptyline for treatment of persistent arm pain due to repetitive use. Pain 2010; 149:117-123. [PMID: 20172654 PMCID: PMC2908294 DOI: 10.1016/j.pain.2010.01.016] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2008] [Revised: 01/13/2010] [Accepted: 01/22/2010] [Indexed: 12/29/2022]
Abstract
Amitriptyline is sometimes used to treat arm pain related to repetitive use, but rigorous evidence of its benefit is lacking. This randomized controlled trial investigated whether amitriptyline provided greater pain relief or improved arm function than a placebo pill in adults with arm pain associated with repetitive use that had persisted for at least 3 months. Participants (N=118) were randomly assigned to receive 25mg of amitriptyline or a placebo pill for 6 weeks. The primary outcome was intensity of pain (10-point numerical rating scale) and secondary outcomes were arm symptoms, arm function, grip strength, mood, and sleep. Assessments were done at baseline, 3 and 6 weeks of treatment, and 1 month after the treatment ended. Changes in arm pain were not statistically significant. However, the amitriptyline group improved more than the placebo group in arm function (p=0.023) and sense of well being (p=0.034). In a longitudinal analysis, the amitriptyline group's arm function score improved 0.45 points per week faster than placebo after adjusting for subject characteristics (p=0.015). At the treatment's midpoint, the amitriptyline group reported more "troublesome side-effects" than the placebo group (52.5% vs. 27.1%, p=0.005), but this difference decreased by the end of the treatment (30.5% vs. 22.0%, p=0.30). The most frequent side effect was drowsiness. In conclusion, this study found that low-dose amitriptyline did not significantly decrease arm pain among these participants but did significantly improve arm function and well being. Future research is needed to explore the effects of higher doses and longer duration of treatment.
Collapse
Affiliation(s)
- Rose H. Goldman
- Cambridge Health Alliance, Cambridge
- Harvard Medical School, Boston
- Harvard School of Public Health, Boston
| | | | - Sung Kyun Park
- University of Michigan School of Public Health, Ann Arbor
| | | | | | - Roger B. Davis
- Harvard School of Public Health, Boston
- Osher Research Center, Harvard Medical School, Boston
- Beth Israel Deaconess Medical Center, Boston
| | - Anna T.R. Legedza
- Osher Research Center, Harvard Medical School, Boston
- Beth Israel Deaconess Medical Center, Boston
| | - Ted J. Kaptchuk
- Osher Research Center, Harvard Medical School, Boston
- Beth Israel Deaconess Medical Center, Boston
| |
Collapse
|
22
|
Abstract
OBJECTIVES To review the quality of adverse event reporting for published randomized controlled trials (RCTs) focusing on acupuncture for pain reduction. With the release of the Consolidated Standards of Reporting Trials (CONSORT) in 2001, the quality of published RCTs has improved. To improve reporting on adverse events, CONSORT expanded the section on harms (adverse events) in 2004. This paper evaluates whether the updated harms guidelines have been implemented in RCTs evaluating acupuncture for pain relief. METHODS Systematic searches were conducted using the following databases: MEDLINE, Allied & Complementary Medicine, Cumulative Index to Nursing & Allied Health Literature, and All EBM Reviews. Each database was searched from 2005 through 2008, corresponding to the availability of the updated harms guideline. RESULTS Ten studies met the inclusion criteria of this review. Six of the 10 studies mentioned or discussed adverse events. Four of the 6 studies did not detail how adverse events were collected. Only 2 studies discussed how adverse events were assessed. DISCUSSION On the basis of our findings, acupuncture clinical trials for pain reduction have yet to comprehensively meet CONSORT's guidelines for adverse event reporting. Acupuncture is commonly used by patients experiencing pain and although typically viewed as a benign and minimally invasive therapy, serious adverse events have been reported in the literature. To effectively and comprehensively document and understand these events, routine reporting according to CONSORT's harms guidelines should become the norm. Both science and patients are served by accurately evaluating the safety of acupuncture for patient populations experiencing pain.
Collapse
|
23
|
Tan CW, Christie L, St-Georges V, Telford N. Discrimination of real and sham acupuncture needles using the park sham device: a preliminary study. Arch Phys Med Rehabil 2010; 90:2141-5. [PMID: 19969182 DOI: 10.1016/j.apmr.2009.08.142] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2009] [Revised: 08/18/2009] [Accepted: 08/18/2009] [Indexed: 10/20/2022]
Abstract
UNLABELLED Tan C-W, Christie L, St-Georges V, Telford N. Discrimination of real and sham acupuncture needles using the Park sham device: a preliminary study. OBJECTIVE To evaluate the blinding effectiveness of the Park sham acupuncture device using participants' ability to discriminate between the real and sham acupuncture needles. DESIGN The design was a yes-no experiment. Judgments were made on whether the real or sham acupuncture needle was administered. SETTING University laboratory. PARTICIPANTS Healthy, acupuncture-naive university students and staff (N=20; median age, 22y; range, 18-48y) recruited through convenience sampling. INTERVENTIONS Participants made yes-no judgments on whether the real or sham needle was administered to 8 acupoints (4 traditional and 4 nontraditional) along the Pericardium meridian (Pericardium 3 to Pericardium 6) on the dominant forearm. MAIN OUTCOME MEASURES The accuracy index, d', of participants' ability to discriminate between the real and sham needles (discriminability) was computed for the traditional alone, the nontraditional alone, and a combination of both types of acupoints. RESULTS The participants' d' between the real and sham needles was not statistically significant from d' equal to 0 for the combined traditional and nontraditional acupoints comparison and the nontraditional acupoints alone comparison (combined, t(19)=1.20, P=.25; nontraditional, t(19)=.16, P=.87). However, the participants' d' was statistically significant from d' equal to 0 for the traditional acupoints comparison (t(19)=2.096, P=.049). CONCLUSIONS The Park sham acupuncture device appears to be effective in blinding participants to real acupuncture intervention when it is applied to the nontraditional acupoints and when traditional and nontraditional acupoints are combined on the forearm along the pericardium meridian. However, the sham device does not appear to blind participants effectively when traditional acupoints alone are used for the same context.
Collapse
Affiliation(s)
- Chee-Wee Tan
- School of Health Sciences, Queen Margaret University Edinburgh, Edinburgh, United Kingdom.
| | | | | | | |
Collapse
|
24
|
Sham or True Acupuncture. Clin J Pain 2009; 25:260; author reply 260. [DOI: 10.1097/ajp.0b013e318182c8ce] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|