Do the CONSORT and STRICTA Checklists Improve the Reporting Quality of Acupuncture and Moxibustion Randomized Controlled Trials Published in Chinese Journals? A Systematic Review and Analysis of Trends

Abstract

Background

We investigated whether there had been an improvement in the quality of reporting for randomised controlled trials of acupuncture and moxibustion published in Chinese journals. We compared the compliance rate for the quality of reporting following the publication of both the STRICTA and CONSORT recommendations in China.

Methods

Four Chinese databases were searched for RCTs of acupuncture from January 1978 through to December 2012. The CONSORT and STRICTA checklists were used to assess the quality of reporting. Data were collected using a standardised form. All included RCTs were divided into three distinct time periods based on the time that CONSORT and STRICTA were introduced in China, respectively. Pearson's χ2 test and/or Fisher's exact test were used to assess differences in reporting among three groups.

Principal Findings

A total of 1978 RCTs were identified. Although the percentage of all the items has increased over time with the introduction of CONSORT and STRICTA in China, the actual compliance in several important methodological components, including sample size calculation (0% vs. 0% vs. 1.2%, for pre-CONSORT and pre-STRICTA, post-CONSORT but pre-STRICTA, and post-CONSORT and post-STRICTA, respectively), randomisation sequence generation (1.4% vs. 15% vs. 26.3%) and implementation (0% vs. 0% vs. 1.3%), allocation concealment (0% vs. 1.4% vs. 4.9%), and blinding (0% vs. 5.7% vs. 9.1%), remains low. Moreover, no RCTs have reported the setting and context of treatment and no descriptions of the participating acupuncturists have been provided thus far.

Conclusions

Overall, the quality of the reporting of RCTs of acupuncture and moxibustion published in Chinese journals has improved since CONSORT and STRICTA were introduced in China, though the actual compliance rate of some important items were still low as of 2012. In the future, Chinese journals should enhance the adoption of the CONSORT and STRICTA statement to improve the reporting quality of the RCTs of acupuncture and moxibustion and to ensure the truth and reliability of the conclusions.

About the Authors:

Bin Ma

* E-mail: [email protected]

Affiliations Evidence-Based Medicine Center, Institute of Traditional Chinese and Western Medicine, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China, Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, Gansu, China

Zhi-min Chen

Affiliation: Evidence-Based Medicine Center, Institute of Traditional Chinese and Western Medicine, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

Jia-ke Xu

Affiliation: Evidence-Based Medicine Center, Institute of Traditional Chinese and Western Medicine, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

Ya-nan Wang

Affiliation: Evidence-Based Medicine Center, Institute of Traditional Chinese and Western Medicine, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

Kuang-yang Chen

Affiliation: Evidence-Based Medicine Center, Institute of Traditional Chinese and Western Medicine, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

Fa-yong Ke

Affiliation: Evidence-Based Medicine Center, Institute of Traditional Chinese and Western Medicine, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

Jun-qiang Niu

Affiliation: Traditional Chinese Medicine Ache Department, the First Hospital of Lanzhou University, Lanzhou, Gansu, China

Li Li

Affiliation: Interventional Latrology Department, the First Hospital of Lanzhou University, Lanzhou, Gansu, China

Cheng-ben Huang

Affiliation: Evidence-Based Medicine Center, Institute of Traditional Chinese and Western Medicine, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

Jian-xun Zheng

Affiliation: Evidence-Based Medicine Center, Institute of Traditional Chinese and Western Medicine, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

Jia-hui Yang

Affiliation: Evidence-Based Medicine Center, Institute of Traditional Chinese and Western Medicine, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

Qian-ge Zhu

Affiliation: Evidence-Based Medicine Center, Institute of Traditional Chinese and Western Medicine, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

Ya-ping Wang

Affiliation: Evidence-Based Medicine Center, Institute of Traditional Chinese and Western Medicine, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

Introduction

Randomized controlled trials (RCTs) have been regarded as the “gold standard” for assessing the effectiveness of most interventions in the field of medicine all over the world [1,2].

In China, randomized controlled trials (RCTs) have become increasingly popular and have been published in large numbers, particularly over the past two decades. However, only adequate reporting of RCTs can improve transparency and aid in the interpretation and replication of studies.

It is well known that acupuncture & moxibustion are one of the most famous Chinese Traditional Medicine therapies. Evidence-based perspectives are increasingly being applied to traditional medicine, including acupuncture & moxibustion; thus, a wide variety of condition-focused studies have evaluated the reporting quality of acupuncture RCTs on the basis of the Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA) or Consolidated Standards of Reporting Trials (CONSORT) statements [3,4,5,6]. STRICTA guidelines expand on CONSORT item 5 (i.e., intervention) for use in acupuncture trial studies. Currently, STRICTA has been designed to improve the standards for reporting interventions in acupuncture clinical trials. A study performed by Gen et al. investigated the reporting quality of acupuncture RCTs [7]; however, it was only based on some RCTs that were only published in one Chinese journal, Chinese Acupuncture and Moxibustion and did not describe the characteristics of acupuncture RCTs. Furthermore, there have been no studies describing the degree of adherence to acupuncture RCTs or the extent to which adherence to the CONSORT or STRICTA checklists will improve the reporting quality of acupuncture intervention RCTs published in Chinese journals since the CONSORT and STRICTA statements were introduced in China in 1997 and 2003, respectively [8,9]. As far as we know, our previous study was the only one that has been designed to determine the overall quality of RCT reporting published in Chinese pediatrics journals and to examine if there is any improvement over time in China [10].

Thus, we used a similar method as was used in our previous study to describe the characteristics and to assess the effect of the introduction of the CONSORT and STRICTA statement guidelines on the reporting of acupuncture trials. In addition, we aimed to investigate how the studies were reported in the literature and whether the reporting had improved over time in China.

Methods

Study selection criteria

All of the RCTs that assessed the efficacy of acupuncture and/or moxibustion that were published in Chinese journals were included. Reports were included only if they involved human subjects. Acupuncture or moxibustion interventions were either administered alone or in combination with conventional Western medicine or herbal medicine. There were no limitations in techniques or styles of acupuncture and moxibustion treatments.

Database search (S1 File)

We performed a database search of RCTs written in Chinese using the following search terms, “randomized controlled trials”, “RCTs”, “acupuncture”, “electroacupuncture”, “acupuncture manipulation” and “moxibustion”, among others (see S1 File for the complete list of terms used). Four Chinese databases (Chinese Biomedicine Literature Database (CBM), Chinese Scientific Journal Full-text Database (CSJD), Chinese Journal Full-text Database (CJFD), and Wanfang Database) were searched from Jan. 1978 to Dec. 2012. We also examined the reference lists of the retrieved articles and reviews.

Screening and training of assessors

Two researchers independently screened the titles and abstracts of the identified studies. One reviewer subsequently screened the full text articles of potentially included studies (Jia-ke Xu), while a second reviewer (Bin Ma) independently screened a 20% random sample that was selected from all of the articles that were located by the initial searches. The inter-rater reliability was calculated (Kappa = 0.69), and disagreements between the two researchers were discussed and resolved by the entire team.

Data extraction

Data were extracted independently by at least two reviewers (Jun-qiang Niu, Li Li, Cheng-ben Huang or Kuang-yang Chen) in accordance with the pre-prepared data extraction forms. Two researchers (Zhi-min Chen and Bin Ma) compiled a table to list general and important information for the final included trials, such as different interventions, including acupuncture and moxibustion, total citation counts, first author role, hospital level, condition focused on in the RCTs, number of authors, research centers involved, placebo use, treatment intention, ethics review and informed consent reporting [11], conflict of interest declaration [12], clinical trial registry [13], and sample size. In addition, the extracted variables included reporting characteristics as well as items from the CONSORT and STRICTA checklists. The conditions examined were classified using the International Classification of Diseases (ICD-10). The total citation counts from every included RCT published in Chinese journals were calculated by the Chinese Science Citation Database which is similar to the Science Citation Index.

Assessor training

To ensure interpretation consistency, the two assessors (YFK and MZC) underwent training on each item of the CONSORT and STRICTA in detail by a qualified trainer who had undergone training in the Chinese Cochrane Center. A 10% random sample was independently interpreted by both assessors. Next, the inter-rater reliability was calculated (Kappa = 0.70), and disagreements were resolved by joint discussion with a third assessor (BM).

Data analysis

We investigate the potential changes in the reporting quality between three distinct time periods. We aimed to establish a baseline for reporting quality and to track changes over time after the publication of CONSORT and STRICTA. CONSORT and STRICTA were first introduced in China in 1997 and 2003, respectively, and all of the trials were subsequently grouped in three publication periods, i.e., before 1996 (pre-CONSORT), 1997–2003 (post-CONSORT and pre-STRICTA) and 2004–2012 (post-STRICTA), according to when the reporting was assessed. Each item of CONSORT and STRICTA was assessed as “yes” if it was described in the paper or “no” if it was not (S2 File).

Dichotomous data were summarized with descriptive statistical analyses (frequency, median, interquartile range (IQR)). Pearson's χ2 tests were used when sample sizes were more than 40 and expected counts were more than five, and Fisher's exact tests were used when sample sizes were less than 40 or expected counts were more than zero but less than one to assess reporting differences among the three groups. P values less than 0.05 were considered to be significant. Analyses were performed using Excel (version Microsoft Excel 2003; http://office.microsoft.com/zh-cn/) and SPSS (version 18.0; http://www.spss.com).

Results

Sample selection and flow (Fig 1)

The searches initially identified 19,678 potentially relevant records. The process used to select potentially relevant studies for inclusion in our study is shown in Fig 1. Of the 19,678 references, 8604 were duplications. An additional 8,709 references were excluded, 1615 of which were letters or editorials, 3633 were not clinical trials, and 2831 were summary or narrative reviews. Then, an additional 1,017 articles were excluded, 609 of which were non-acupuncture RCTs and 408 described incorrect randomization methods. The remaining 1978 RCTs were included in our study; one hundred forty-four RCTs were published before 1996, 353 RCTs were published from 1997 to 2003, and 1481 RCTs were published from 2004 to 2012 (S3 File). The first RCTs using acupuncture or moxibustion intervention were published in 1987 [14] and 1989 [15] in China, respectively.

[Figure omitted. See PDF.]

Fig 1. Flow chart of the articles identified, included and excluded. RCTs, Randomisation Controlled Trials.

https://doi.org/10.1371/journal.pone.0147244.g001

Summary of the RCTs (Table 1)

A summary of RCTs is presented in Table 1. The number of RCTs using acupuncture and moxibustion intervention has rapidly increased over the years in China; one hundred forty-four RCTs were published before 1996. Of these RCTs, the intervention in 122 RCTs focus on acupuncture and 22 RCTs focus on moxibustion. Furthermore, 353 RCTs were published from 1997 to 2003; in 312 of those RCTs, the intervention was acupuncture, and in the remaining 41 RCTs, the intervention was moxibustion. In addition, 1481 RCTs were published from 2004 to 2012; in 1301 of those RCTs, the intervention was acupuncture, and in the remaining 180 RCTs, the intervention was moxibustion. Nearly one- fourth of the RCTs (24.4%) published between 2004 and 2012 have not been cited by any author in the same research field; however, this proportion was less than the other two periods, and significant differences were also found in the other two periods (time 3 vs time 1, P = 0.024; time 3 vs time 2, P = 0.025). Only 14.2% of the studies published between 2004 and 2012 had been cited more than 10 times, and no significant differences were found in the other two periods.

[Figure omitted. See PDF.]

Table 1. Summary of Acupuncture and Moxibustion RCTs Published in Chinese Journals.

https://doi.org/10.1371/journal.pone.0147244.t001

There is an increasing number of clinicians who play an important role in clinical trial research in China. Specifically, after 2003, 68.8% of articles had clinicians as primary authors. There were significant differences among the three groups (time 3 vs time 1, P<0.001; time 3 vs time 2, P = 0.005; time 2 vs time 1, P = 0.016). The most common conditions examined were the same in three different periods, including diseases of the musculoskeletal system and connective tissue (21.2%), diseases of the circulatory system (21.1%) and diseases of the genitourinary system (14.4%).

Study description of the RCT characteristics (Table 2)

Changes in the percentage of each RCT characteristic in studies published before and after the implementation of CONSORT and STRICTA are presented in Table 2. The RCTs included a median of three authors (IQR: 2.0–4.0) and a median of 80 for sample size (IQR: 60–120). These two values did not improve over different publication years, and there was no significant difference in these values. Only 39.2% of the RCTs published between 2004 and 2012 were from multi-centers in China, although this proportion was improved compared to the other two periods, and a significant difference was found between the RCTs published in 1996 or earlier (time 3 vs time 1, P = 0.017).

[Figure omitted. See PDF.]

Table 2. Descriptive Characteristics of Acupuncture and Moxibustion RCTs Published in Chinese Journals.

https://doi.org/10.1371/journal.pone.0147244.t002

In addition, although the authors of the RCTs published after 2004 paid more attention to informed consent and ethical review compared with the other two periods and a significant difference was also found in each of the other two periods (time 3 vs time 1, P<0.001; time 3 vs time 2, P<0.001 for informed consent; time 3 vs time 1, P = 0.014; time 3 vs time 2, P = 0.012 for ethical review), this proportion remained very low (21.8% versus 0.9%). Likewise, the same situation was found in studies that used placebos (1.5%) and in treatment intention (0.9%). None of the authors of the included RCTs declared any conflicts of interest up to 2012.

Characteristics and variation in CONSORT reporting over time (Table 3)

The differences in the percentage of individual items that were reported in studies published before and after the implementation of CONSORT are presented in Table 3. However, none of the acupuncture or moxibustion RCTs published up to 2012 in Chinese journals reported certain items, including methods (3b “Trial design”, 6b“Outcome”, 7b“Sample size”), results (14b“Recruitment”, 19“Harms”) or other information (23“Registration”, 24“Protocol”). Although the percentage of the inclusion of other items has increased over the past years, the actual compliance remains low.

[Figure omitted. See PDF.]

Table 3. CONSORT Assessment of the Reporting Characteristics of Acupuncture and Moxibustion RCTs Published in Chinese Journals.

https://doi.org/10.1371/journal.pone.0147244.t003

Most RCTs published between 2004 and 2012 were compliant with the following checklist items: title, abstract (1b) and methods (4a); significant differences were found among the three groups (P = 0.001). More than half of the RCTs published between 2004 and 2012 were compliant with the following checklist items: title, abstract (1a), methods (4b“Participants”), randomization (12a“Statistical methods”), results (17a“Outcome estimation”) and discussion (22“Interpretation”); significant differences were also found among the three groups (P = 0.000). Less than half of the RCTs published between 2004 and 2012 were compliant with the following checklist items: introduction (2a“Background”, 2b“Objective”), methods (3a“Trial design”, 6a“Outcome”), randomization (8a“Sequence generation”, 12a“Statistical methods”, 12b“Statistical methods”), results (13a“Participant flow”, 13b“Participant flow”, 15“Baseline data”, 16“Number analyzed”), discussion (21“Generalisability”) and other information (25“Funding”); however, the percentage of the above items was increased compared to the other two periods. A significant difference was also found either with RCTs published in 1996 or earlier (P = 0.000) or between 1997 and 2003 (P = 0.001). Few RCTs published between 2004 and 2012 were compliant with the following checklist items: methods (7a“Sample size”), randomization (8b“Sequence generation”, 9“Allocation concealment”, 10“Implementation”, 11a“Blinding”, 11b“Blinding”), results (14a“Recruitment”, 17b“Outcoms and estimation”, 18“Ancillary analyses”) and discussion (20“Limitations”); however, the percentage of the above items was increased compared to the other two periods. Significant differences were also found either with RCTs published in 1996 or earlier (P = 0.000) or between 1997 and 2003 (P = 0.021), with the exception of items 14a and 20.

Characteristics and variation in STRICTA reporting over time (Table 4)

Differences in the percentage of individual items reported in studies published before and after the implementation of STRICTA are presented in Table 4. Overall, the percentage of items on the checklist increased over time. However, up to 2012, none of the acupuncture or moxibustion RCTs published in Chinese journals reported components of the treatment (4b).

[Figure omitted. See PDF.]

Table 4. STRICTA Assessment of the Reporting Characteristics of Acupuncture and Moxibustion RCTs Published in Chinese Journals.

https://doi.org/10.1371/journal.pone.0147244.t004

Most RCTs that were published in the three time periods were compliant with the following checklist items, details of needling (2b, 2e, 2f) and treatment regimen (3a, 3b); however, no significant differences were found among the three groups. More than half of the RCTs published between 2004 and 2012 were compliant with the details of needling (2c, 2d, 2 g) checklist item, and significant differences were also found either with the RCTs published in 1996 or earlier (P = 0.001) or between 1997 and 2003 (P = 0.018). Less than half of the RCTs published between 2004 and 2012 were compliant with the following checklist items: acupuncture rationale (1a, 1c) and other components of treatment (4a); a significant difference was only found with the RCTs published in 1996 or earlier in item 4a (P = 0.031). Few of the RCTs (i.e., ≤10%) published between 2004 and 2012 were compliant with the following checklist items: acupuncture rationale (1b), details of needling (2a), practitioner background (5), and control or comparator interventions (6a, 6b); significant differences were also found either with the RCTs published in 1996 or earlier (P = 0.029) or between 1997 and 2003 (P = 0.033) with the exception of item 6b.

Discussion

Our study identified 1978 acupuncture and moxibustion intervention RCTs published in Chinese medical journals. This is the first review to examine compliance and to track changes of reporting quality of acupuncture and moxibustion intervention RCTs over time after the publication of the CONSORT and STRICTA in China.

Many of the earlier researchers/acupuncturists in China focused on an appropriate choice of acupuncture and moxibustion and paid more attention to its specific effects. This may be a result of the social perception of acupuncture and moxibustion, which is completely different in China than in other countries. Because these acupuncture techniques were invented by Chinese medical practitioners and have been used in the medical field for more than 2000 years in China, Chinese clinical researchers may be more interested in the types of acupuncture and moxibustion techniques used in clinical practice. With the introduction and influence of the conception of evidence-based medicine in China, a growing number of Chinese researchers have begun to focus on the evaluation of acupuncture and moxibustion efficacy, its potential role in health care, and the quality of these RCTs. Overall, though the actual compliance rate of items related to the methodology and registration information remain low up to 2012, our survey demonstrated that the reporting quality of acupuncture and moxibustion intervention RCTs that were published in Chinese journals has improved over time since the introduction of CONSORT and STRICTA in China in 1997 and 2003, respectively.

Many deficits in reporting were evident in these RCTs, and we identified areas of particular concern. Our survey revealed that the total citation counts in 71.3% of the included RCTs were lower than five and the total citation counts of nearly one-third (24.4%) of the studies were zero. In addition, the reporting of ethical issues was inadequate, with less than 1% of the included RCTs reporting ethical committee approval up to 2012, even though it is a legal requirement in China [16]. The above findings in this study were similar with our previous study [10] that focused on the reporting all of the RCTs published in Chinese pediatrics journals. Compared with the RCTs published prior to 2003, more trials published between 2004 and 2012 have described that participants attended of “their own free will” and provided details about informed consent procedures, although the actual percentage remained low (21.8%). However, this level was lower than Tsukayama et al.’s reviews [17] focusing on the Japanese literature. Similarly, sham acupuncture was used in very few RCTs (1.3%), and the proportion of these procedures in three different periods had not improved over time (P>0.05). Moreover, no RCTs reported conflicts of interest up to 2012. This may be a result of a lack of compulsory policies in Chinese journals, in which the authors must report conflicts of interest.

Our survey also found some disappointing results. For example, only 17 (1.2%) RCTs published between 2004 and 2012 reported how the sample size was determined or described the procedure of the sample estimate, which may be challenging for most of the RCTs published in Chinese journals. Although the International Committee of Medical Journal Editors (ICMJE) requires all clinical trials to be registered in an effort to increase transparency and accountability [18,19], no acupuncture or moxibustion RCTs published in Chinese journals have registered or reported a registration number up to 2012. This may be because of a lack of compulsory policies in China, because the Chinese periodicals association only recommends priority for published clinical trials that have been registered [20]. All of these observations were also made in our previously published study on pediatric journal articles [10]. In addition, more serious challenges were found in the randomization description; up to 2012, many trials did not report detailed information on the method used to generate the random allocation sequence, allocation concealment mechanism or implementation. Although the compliance rate of items related to randomization increased over time and significant differences were also found, the actual percentage was still very low. These findings that the low percentage of items related to randomization appeared to be similar to Dr. Mao’s study [21]. Similarly, most trials still did not provide detailed information about the blinding of either participants or investigators. Participants who are aware of their treatment may behave differently or have particular expectations [22], thus affecting the results. Further, blinding may affect the measurement of subjective outcomes. However, a systematic review found that for subjective outcomes, trials that used inadequate or unclear allocation concealment yielded 31% larger estimates of the effect compared to those that used adequate concealment, and the trials that were not blinded yielded 25% larger estimates [23].

In addition, the actual percentage of most of the STRICTA items remained very low over time in China. Six items detailing needling (except item 2a) and the compliance rate were good in the three different periods. However, as for the other items, the actual percentage was still very low after STRICTA was introduced in China in 2003. For example, the percentage of the items, such as the reason for treatment, number of needle insertions per subject per session, and description of participating acupuncturists, as still very low (<1%) after 2003. This was mainly because some researchers in the field of acupuncture did not understand the reporting guidelines and the periodical editorial department did not require the authors to report acupuncture intervention RCTs according to STRICTA items in China [21]. Furthermore, a study found that some acupuncture trials reported that the STRICTA items originally included in the submitted manuscripts were removed during the editorial process [24]. Moreover, a study by Li XQ et al. assessed the endorsement of the CONSORT statement by high-impact medical journals in China by reviewing the instructions for authors and showed that only 6 (6/195, 3.08%) and 14 (14/200, 7.00%) medical journals in China mentioned “CONSORT” or “ICMJE” in their instructions for authors, respectively, and all of these journals used ambiguous language on what was expected of the authors [25]. Of course, because of the time-lag effect, not all of the authors or medical journals could comply with these reporting guidelines from the beginning of their study. Thus, we strongly recommend the use of the CONSORT and STRICTA statements by authors. We also recommend that editors of Chinese medical journals recognize and promote the use of the CONSORT and STRICTA statements in their publications.

In summary, though our study found that the reporting situation of acupuncture RCTs published in Chinese journals was unsatisfactory, from the data in the tables, we are encouraged to observe that the reporting percentages of each item in the STRICTA and CONSORT statements have improved from before.

There are also some limitations to our study. We focused our assessment on examining compliance and tracking changes of reporting quality of acupuncture RCTs over time after the publication of CONSORT and STRICTA statements in China. Thus, we cannot make inferences regarding the relationship between CONSORT adherence and trial quality or the validity of the trial results. We only selected acupuncture and moxibustion RCTs published in Chinese journals indexed in the Chinese Science Citation Database; thus, our findings may not represent the reporting quality of RCTs published in foreign journals. We assessed the quality of the current RCTs as judged by the authors' description in articles; we did not attempt to contact the authors to verify the detailed method, and thus, the quality of the RCTs included in our study may be exaggerated. In addition, only 20% random sample were screened by a second reviewer though inter-rater reliability was 0.69 and only 10% random sample was independently interpreted by both assessors in our review; thus, both them may impact the reliability of the ratings of the total sample.

Overall, the quality of reporting acupuncture and moxibustion RCTs published in Chinese journals has improved since CONSORT and STRICTA statements were introduced in China in 1997 and 2003, respectively. However, up to 2012, current RCTs, as judged by their publication, have not comprehensively reported the information recommended in the CONSORT and STRICTA statements and are often not adequate to enable readers to assess trial validity. In the future, Chinese journals should enhance the adoption of the CONSORT and STRICTA statements to improve the reporting quality of acupuncture and moxibustion RCTs and to ensure the truth and reliability of the conclusions.

Supporting Information

[Figure omitted. See PDF.]

S1 File. Search strategy of the four Chinese databases.

https://doi.org/10.1371/journal.pone.0147244.s001

(DOC)

S2 File. Definitions of reporting items of CONSORT & STRICTA checklist.

https://doi.org/10.1371/journal.pone.0147244.s002

(DOC)

S3 File. Included 1978 RCTs of acupuncture & moxibustion published in Chinese journals.

https://doi.org/10.1371/journal.pone.0147244.s003

(DOC)

S4 File. Raw extraction table.

https://doi.org/10.1371/journal.pone.0147244.s004

(XLS)

Acknowledgments

The Project is Supported by National Natural Science Foundation of China (Grant No. 81303147) and the Fundamental Research Funds for the Central Universities (Number:lzujbky-2014-138).

We thank Ms. Ji-ye Peng (The library of Lanzhou University) for providing assistance with the formulation of search strategy.

Author Contributions

Conceived and designed the experiments: BM ZMC. Performed the experiments: BM ZMC JKX YNW KYC FYK JQN LL CBH JXZ JHY QGZ YPW. Analyzed the data: BM ZMC JKX YNW KYC FYK. Contributed reagents/materials/analysis tools: ZMC FYK JQN LL YNW KYC CBH JXZ QGZ YPW JHY. Wrote the paper: BM ZMC JKX YNW KYC FYK.

Citation: Ma B, Chen Z-m, Xu J-k, Wang Y-n, Chen K-y, Ke F-y, et al. (2016) Do the CONSORT and STRICTA Checklists Improve the Reporting Quality of Acupuncture and Moxibustion Randomized Controlled Trials Published in Chinese Journals? A Systematic Review and Analysis of Trends. PLoS ONE 11(1): e0147244. https://doi.org/10.1371/journal.pone.0147244

References

1. Byar DP, Simon RM, Friedewald WT, Schlesselman JJ, DeMets DL, Ellenberg JH, et al. Randomized clinical trials. Perspectives on some recent ideas. N Engl J Med. 1976; 295:74–80. pmid:775331

2. Sacks HS, Chalmers TC, Smith H Jr. Randomized versus historical controls for clinical trials. Am J Med. 1982;72:233–240. pmid:7058834

3. Lu Xiao, Hongcai Shang, Jiaying Wang, Jing H, Jun X. Assessing the Quality of Reports about Randomized Controlled Trials of Acupuncture Treatment on Mild Cognitive Impairment. PLoS One. 2011; 6: e16922 pmid:21364920

4. Huan Zhu, Zing Xie, Xi Wu, Qinhang Chen, Rong Fan. Use of CONSORT and STRICTA to Assess the Quality of Randomized Controlled Trials of Acupuncture Treatment of Functional Dyspepsia. Shanghai Acupuncture Journal.2008; 27:42–45

5. Elorriaga Claraco A, Hanna SE, Fargas-Babjak A. Reporting of clinical details in randomized controlled trials of acupuncture for the treatment of migraine/headaches and nausea/vomiting. Altern Complement Med. 2003;9:151–159

6. Liu XM, Zhang MM, Du L. Quality of methodology and reporting of randomized controlled trials of acupuncture for obesity. Zhongguo Yi Xue Ke Xue Yuan Xue Bao.2004; 26:192–194 pmid:15171560

7. Geng LL, Lin RS, Sun XY, Wu L, Zhong MM. Critical appraisal of randomized clinical trials in Chinese Acupuncture and Moxibustion from 2000 to 2006. Zhongguo Zhen Jiu. 2008;28:439–443 pmid:18630544

8. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA (Chinese Edition) 1997;16:189–91.

9. Liu XM, Zhang MM, Liu HL. Improving the quality of the report of acupuncture controlled trial by using CONSORT and STRICTA. Chinese Acupuncture & Moxibustion. 2003;12: 699–701

10. Ma Bin, Ke Fa-yong, Chen Zhi-min, Qi Guo-qing, Li Hai-min, Liu Wen-jie, et al. Does the reporting of randomized clinical trials published in Chinese pediatrics journals improve after the CONSORT Statement is adopted? Contemporary Clinical Trials. 2012;33:889–894 pmid:22765929

11. Yank V, Rennie D. Reporting of informed consent and ethics committee approval in clinical trials. JAMA.2002;287: 2835–2838 pmid:12038927

12. Perlis RH, Perlis CS, Wu Y, Hwang C, Joseph M, Nierenberg AA. Industry Sponsorship and Financial Conflict of Interest in the Reporting of Clinical Trials in Psychiatry. Am J Psychiatry.2005; 162:1957–1960 pmid:16199844

13. International Clinical Trials Registry Platform. May 23, 2013. Available: http://www.who.int/ictrp/en/

14. Yi-sheng Qian. Clinical observation of electroacupuncture plus infrared therapy waist pain. Shanghai Journl of acupuncture and moxibustion. 1987; 3:27–28

15. Cheng-gu Ye, Yi Jiang. Clinical observation of Moxibustion in treating herpes zoster. Zhen Jiu Za Zhi.1989;4:41.

16. Chinese State Food and Drug Administration. May 23, 2013. Regulation no.13. Available: http://www.sda.gov.cn/WS01/CL0053/24493.html

17. Tsukayama Hiroshi, Yamashita Hitoshi. Systematic review of clinical trials on acupuncture in the Japanese literature. Clinical Acupuncture and Oriental Medicine. 2002; 3:105–113

18. De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, et al. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. N Engl J Med. 2004;351:1250–1251 pmid:15356289

19. Whittington CJ, Kendall T, Fonagy P, Cottrell D, Cotgrove A, Boddington E. Selective serotonin reuptake inhibitors in childhood depression: systematic review of published versus unpublished data. Lancet. 2004;363:1341–1345 pmid:15110490

20. Joint statement of establishing Chinese clinical trial registration and publishing system (ChenDu statement). May 23, 2013. Available:http://www.chictr.org/(S(3xiyoifgwsylwj45rwoypv3r))/Site/Search.aspx?lang=CN

21. Bing Mao, Gang Wang, Xiao-dong Cheng. Quality Assessment of the Reporting of Randomized Controlled Trials Published in the Chinese Journal of Integrated Traditional and Westem Medicine with the Revised CONSORT Statement. Chin J Evid-based Med.2006; 6:297–303.

22. Prescott RJ, Counsell CE, Gillespie WJ, Grant AM, Russell IT, Kiauka S, et al. Factors that limit the quality, number and progress of randomized controlled trials. Health Technol Assess.1999; 3:1–143

23. Wood L, Egger M, Gluud LL, Schulz KF, Jüni P, Altman DG,et al. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ.2008;336:601–605 pmid:18316340

24. Prady SL, Macpherson H. Assessing the Utility of the Standards for Reporting Trials of Acupuncture (STRICTA): A Survey of Authors. J Altern Complement Med.2007;13: 939–944 pmid:18047440

25. Li Xiao-qian, Tao Kun-ming, Zhou Qing-hui, Moher David, Chen Hong-yun, Wang FZ, et al. Endorsement of the CONSORT Statement by High-Impact Medical Journals in China: A Survey of Instructions for Authors and Published Papers. PLoS ONE.2012;7: e30683. pmid:22348017