Objective To survey and analyze the quality assessment of the included studies in the Overviews of reviews (Overviews), so as to provide methodology references for Overviews authors. Methods A computerized search was performed for collecting Overviews in The Cochrane Library (Issue 1, 2010), PubMed, EMBASE, and CBM, and the search time ended by December, 2009. Then the relevant data, such as assessment standard etc, were extracted, and the staple standards were analyzed. Results A total of 43 typical Overviews were included. Thirty-two (74.4%) of them assessed the methodology quality of the included systematic reviews with different standards, including OQAQ (34.9%/15), AMSTAR (9.1%/3), Checklist from DARE (4.6%/2), Assendelft scale (4.6%/2), Effective Public Health Practice Project standards (2.3%/1), self-formulated standards (14.0%/ 6), syntaxic standards (2.3%/1), and other standards (4.6%/2). Ten Overviews (23.6%) assessed the quality of evidence, including eight (18.6%) applied the GRADE system. Only 7 studies (16.3%) assessed the quality of evidence and applied the GRADE system as well. Conclusion The quality assessment in Overviews includes the assessment of both methodological quality and evidence quality. But most Overviews do not assess comprehensively. The methodological quality standards applied in current Overviews are numerous and no standard is acknowledged. Yet, the OQAQ and AMSTAR are applied widely and recommended because they are comprehensive and easy to be conducted. It suggests that Overviews authors should choose appropriate methodological quality assessment standards according to concrete conditions. The GRADE system is much more comprehensive and systematic than other systems, so it is recommended that Overviews authors should apply GRADE to assess the quality of evidence in their studies in order to make the study results more comprehensive and easier for clinical application.
ObjectiveTo re-evaluate the systematic review and meta-analysis (SR/MAs) of the efficacy of robot-assisted pedicle screw placement. MethodsThe CNKI, VIP, WanFang Data, SinoMed, PubMed, Embase, Cochrane Library, and Web of Science databases were electronically searched to collect SR/MAs of robot-assisted pedicle screw placement from inception to April 28, 2023. Two reviewers independently screened literature, extracted data and then assessed the quality of reports, methodological quality, risk of bias, and the strength of evidence quality by using PRISMA, AMSTAR-Ⅱ, ROBIS, and GRADE tool. ResultsA total of 20 SR/MAs were included. The results of the included studies showed that robot-assisted pedicle screw placement was more accurate and had a lower number of complications compared with freehand pedicle screw placement. The quality of reports, methodology, and evidence for pedicle screw placement efficiency in all SR/MAs were low or extremely low, with a high risk of bias. The main reasons included high heterogeneity of included studies, unclear research methods and selection criteria, and missing key reporting processes. ConclusionRobot-assisted pedicle screw placement may have better clinical efficiency than traditional freehand pedicle screw placement. But the quality of relational SR/MAs is low.
ObjectiveTo overview the systematic reviews of the efficacy of cancer patient decision aids (PDAs) for treatment decision-making. MethodsThe PubMed, Web of Science, Cochrane Library, Embase, CINAHL, JBI, CNKI, VIP, CBM and WanFang Data databases were electronically searched to collect the systematic reviews relevant to the objective from inception to September 2023. Literature screening, data extraction, methodological quality assessment of the included literature, and summary and grading of the evidence were carried out independently by two researchers, and duplication of original studies in the included systematic evaluations was investigated using the corrected covered area (CCA). ResultsA total of 17 systematic reviews were included, of which 13 (76.47%) were low- or very low-quality studies. A total of 64 pieces of evidence were included, of which only 26 (40.62%) were of moderate quality, and the original studies included in the included literature had a low degree of overlap (CCA=0.05). The results of meta-analysis showed that PDAs could increase decision-related knowledge, reduce decision conflict and regret in cancer patients' treatment decision (P<0.05). However, there was no significant difference in decision satisfaction, anxiety or depression (P>0.05). ConclusionPDAs can improve cancer patients' knowledge related to treatment decision, reduce decision conflicts and regrets, and have no significant negative effects on decision preparation, satisfaction, anxiety, and depression. However, the existing systematic reviews are of low quality and limited to a few cancer types.
ObjectiveTo summarize and evaluate the quality of methodology, report and evidence of the systematic reviews and meta-analyses (SRs/MAs) of acupuncture and moxibustion interventions for Parkinson's disease. MethodsEight databases including CNKI, WanFang Data, VIP, CBM, PubMed, EMbase, Cochrane Library and Web of Science were searched from inception to May 1, 2023. The quality of methodology, report and evidence involved in these studies were evaluated by AMSTAR 2, PRISMA and GRADE tool. ResultsA total of 28 SRs/MAs were included, and the findings of included studies showed that acupuncture and moxibustion had a clinical advantage for Parkinson's disease. The methodological quality of all studies was extremely low. Thirteen reports were relatively complete, 14 reports had certain flaws, and 1 report had relatively serious flaws. And of the 126 reports for seven outcomes, 1 was graded as high, 12 as moderate, 57 as low, and 56 as critically low. ConclusionThe current evidence shows that acupuncture and moxibustion have a certain clinical effect for Parkinson's disease, but the methodological quality and evidence quality of related SRs/MAs are low, and the standardization still needs to be improved. The efficacy of acupuncture and moxibustion in Parkinson's disease still needs to be verified by high-quality clinical studies in the future.
ObjectiveTo overview the systematic reviews on the timing of different surgical interventions for severe multidrug-resistant pulmonary tuberculosis patients.MethodsPubMed, EMbase, The Cochrane Library, CBM, WanFang Data and CNKI databases were searched for systematic reviews about the timing of different surgical interventions for severe multidrug-resistant pulmonary tuberculosis patients from inception to December, 2018. Two reviewers independently screened literature, extracted data, evaluated the reporting and methodological qualities using the PRISMA checklist and the AMSTAR tool. After re-extraction of individual RCT data from included systematic reviews, meta-analysis was performed by Stata10.0 software.ResultsA total of 11 systematic reviews were included. The average methodological quality score was 8.13 in AMSTAR , the reporting quality score was from 19.5 to 25 in PRISMA. Re-performed meta-analysis showed that, the total success rate of operation was 93.3% (95%CI 92.9 to 93.8), the failure rate was 3.7% (95%CI 3.3 to 4.0), the mortality rate was 2.0% (95%CI 1.8 to 2.2), and the loss rate was 1.0% (95%CI 0.8 to 1.2). The cure rates of different surgical methods were all over 80%, among which single lobectomy (98.47%) and compound lobectomy (98.94%) had the higher cure rates than others. For the time of different surgical interventions, cure rate could be improved obviously in patients receiving surgery treatment after 1 months (OR=1.58, 95%CI 1.29 to 1.94, P=0.000 12), 1-8months (OR=1.66, 95%CI 1.30 to 2.12, P=0.000 05) and 9-24 months (OR=1.48, 95%CI 1.15 to 1.90, P=0.002) of anti-tuberculosis therapy compared with 0 month.There were significant differences between two groups.ConclusionCurrent evidence shows that operation is an effective way for severe multidrug-resistant pulmonary tuberculosis. Operative opportunity should be selected after 1-24 months of anti-tuberculosis drug treatment when the operation time depending on whether the tuberculosis has turned negative or not. Operative mode should be decided by the location and the scope of the lesion, which ensures the maximum excision of lesions and retention of lung function.
ObjectivesTo conduct an overview of systematic reviews (SRs) on Tuina from 2013 to 2017, and to explore recent research improvements on Tuina.MethodsPubMed, Web of Science, The Cochrane Library, SpringerLink e-book database, CNKI, VIP, WanFang Data and CBM databases were searched to collect SRs including randomized controlled clinical trials on Tuina from January 1st, 2013 to December 31st, 2017. Two reviewers independently screened literature, extracted data, and used AMSTAR 2 tool and PRISMA statement to assess methodology quality and reporting quality of included studies, respectively. The R 3.4.3 software was used to analyze data.ResultsA total of 8 SRs studies were included in the overview. The studied diseases involved radiculopathy cervical spondylotic, myelopathy cervical spondylotic, constipation, child anorexia, child diarrhea and external humeral epicondylitis. The results of above SRs showed that massage might be superior to other interventions in clinical efficacy, curative effects or total effective rate. However, due to the low quality of included studies of SRs, further evidence from high-quality clinical studies is required to verify above conclusions. For the results of AMSTAR 2 assessment, all 8 SRs were rated as very low quality. The quantity of items accomplished for each SR ranged from 7 to 13, 2 SRs had low methodological quality (percentage of accomplishment or partial accomplishment <50.0%) and 6 SRs with high methodological quality (percentage of accomplishment or partial accomplishment ≥50.0%). All 8 SRs did not report item 2 "Whether to declare research methods", item 10 "Whether reports have included funding sources for each study" and item 11 "Whether reports used the correct statistical method". The results of PRISMA assessment showed that all SR had good quality of reporting. The accomplished items number of each SR ranged from 22 to 26. However, there were defects in item 5(0), item 16(25.0%) and item 23(25.0%). All SRs did not report item 5 "Whether to declare research program".ConclusionsThis study finds that Tuina has supportive evidence-based medical evidence for treating anorexia, cervical spondylosis and other diseases, however, the SRs of Tuina are yet needed to be improved in terms of standardized degree. Therefore, establishing a reporting consolidated standard for evidence-based medicine on Tuina in order to improve the quality of clinical studies so as to provide clinicians with high-quality evidence is the focus of our further research.
ObjectiveTo retrieve and summarize the clinical studies on traditional Chinese medicine for heart failure prevention and treatment and to observe the distribution of evidence in the field of heart failure by using the method of evidence map.MethodsPubMed, Web of Science, EMbase, CNKI, WanFang Data and VIP databases were searched from January 2000 to January 2020. Clinical studies, systematic reviews, guidelines, and clinical pathways related to traditional Chinese medicine for heart failure prevention and treatment were included, and the distribution characteristics of evidence were analyzed by using charts and text descriptions.ResultsA total of 8 580 papers were included, including 8 398 clinical studies (6 821 randomized controlled trials, 1 109 non-randomized controlled trials and 468 observational studies), 160 systematic reviews, and 22 guidelines, expert consensus and pathway studies. The number of clinical studies domestically and abroad showed an overall growth trend. The sample size was concentrated in 60- 100 cases. Coronary atherosclerotic heart disease was the most common comorbidity of heart failure. AMSTAR scores of systematic reviews were primarily 4 to 8. The results of high-quality randomized controlled trials and systematic reviews showed that traditional Chinese medicine combined with conventional Western medicine in the treatment of heart failure had certain advantages in improving heart function, quality of life and prognosis.ConclusionsHigh-quality clinical studies show that traditional Chinese medicine has certain advantages in the efficacy and safety of heart failure prevention and treatment; however, few studies have high methodological quality. In the future, multi-center, large sample size, and high methodological quality clinical studies are needed to further explore the efficacy and safety of traditional Chinese medicine therapy in the field of heart failure.
Objectives To overview the systematic reviews/meta-analyses of safety of femoral nerve block (FNB) used as a postoperative analgesic technique in patients undergoing total knee arthroplasty (TKA). Methods We searched databases including The Cochrane Library, PubMed, EMbase, CNKI, WanFang Data, and VIP from inception to July, 2016. Two reviewers independently screened literature, extracted data and used AMSTAR to evaluate the methodological quality of the included studies. The major indexes used to evaluate the safety of FNB were the incidence rates of symptoms including nausea, vomiting, sedation, retention of urine, dizziness, pruritus, hypotension, falls, nenous thromboembolism and deep infection. Results A total of 12 systematic reviews/meta-analyses were included.They assessed the safety of FNB compared with local infiltration analgesia (LIA), periarticular multimodal drug injection (PMDI), epidural analgesia (EA), patient-controlled intravenous analgesia of opioids (PCA) and adductor canal block (ACB), respectively. The methodological quality of included studies were medium, with the scores between 3 to 10. The results of overview indicated that: FNB had lower incidence rates of nausea and vomiting compared with EA and PCA, but had higher than ACB. FNB had lower incidence rates of sedation and retention of urine compared with EA and PCA. FNB had lower incidence rates of dizziness compared with EA and PCA, and lower incidence rate of hypotension compared with EA. Conclusion Current evidence suggests that FNB is safer than EA and PCA. Due to the limited quantity and quality of the included studies, the above conclusions are needed to be verified by more high-quality studies.
ObjectiveTo systematically summarize and evaluate the existing evidence of Qishen Yiqi dropping pill (QSYQ) in the treatment of chronic heart failure (CHF), and to evaluate its quality. MethodsThe PubMed, Cochrane Library, EMbase, Web of Science, CNKI, CBM, WanFang Data databases were electronically searched to collect systematic reviews/meta-analyses(SRs/MAs) related to objectives from inception to December 31, 2022. Two researchers independently screened the literature and extracted data, and assessed the methodological quality, risk of bias, reporting quality, and quality of evidence of included SRs/MAs by using Assessment of Multiple Systematic Reviews 2 (AMSTAR-2), the Risk of Bias in Systematic(ROBIS) scale, the list of Preferred Reporting Items for Systematic Reviews and Meta-Analysis(PRISMA), and the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) system. ResultsThis overview included 17 SRs/MAs. The methodological quality, reporting quality, risk of bias, and quality of evidence for outcome measures of SRs/MAs were all unsatisfactory. All SRs/MAs were of low quality according to the results of the AMSTAR-2 assessment. And only a small number of SRs/MAs were assessed as low risk of bias based on the results of the ROBIS assessment. The evaluation results of the PRISMA checklist showed that the report quality of the 24 studies included was relatively complete. According to the GRADE system evaluation results, 94% of the 84 outcome indicators were low-quality and very low-quality evidence. Limitations were the main factors leading to their degradation, followed by publication bias, inconsistency, imprecision and indirectness. ConclusionAt present, QSYQ has good clinical efficacy in the treatment of CHF, but the standardization and scientificity of clinical research and secondary research reports are insufficient, resulting in low quality of clinical recommendations evidence. In the future, it is necessary to further standardize and improve the quality of clinical and secondary research.
ObjectiveTo assess the methodological quality of systematic reviews of Tai Chi for preventing falls in the elderly and the quality of evidence for outcome indicators.MethodsPubMed, Web of Science, The Cochrane Library, EMbase, CNKI, WanFang Data, CBM and VIP databases were electronically retrieved. According to the inclusion criteria and exclusion criteria, the final articles were selected and the relevant literature information was extracted by reading the abstract and the full text. The methodological quality of the included systematic reviews was evaluated using AMSTAR 2 tool, and the quality of the outcome indicators of the included systematic reviews was further graded according to the GRADE system.ResultsA total of 11 systematic reviews/meta-analyses were included. The AMSTAR 2 evaluation showed that 10 studies were in critically-low methodological quality, and 1 study was in low methodological quality. The GRADE evaluation results showed that among the 36 outcome indicators included, there were 10 intermediate quality indicators, 20 low-level quality indicators and 6 extremely low-level quality indicators. Among the indicators of intermediate quality, single-leg stand test (MD = 5.33, 95%CI 3.35 to 7.32, P< 0.01; WMD = 1.76, 95%CI −7.00 to 10.52, P< 0.01), time up and go test (MD = 1.04, 95%CI 0.67 to 1.41, P< 0.01), the berg balance scale (MD = 2.18, 95%CI 0.93 to 3.43, P< 0.01), number of falls (RR = 0.82, 95%CI 0.73 to 0.92), P< 0.01), the incidence of 2-falls (OR = 0.69, 95%CI 0.49 to 0.97, P< 0.01) and the incidence of 3-falls (OR = 0.39, 95%CI 0.21 to 0.73, P< 0.01). The results of the above indicators were statistically significant, indicating that Tai Chi was better than control group.ConclusionsAt present, the methodological quality of relevant systematic reviews of Tai Chi for preventing falls in the elderly was relatively low and the quality of the evidence was not good, so it can’t be proved that Tai Chi can effectively prevent falls in the elderly, which needs to be further studied at a high level.