Comparative diagnostic test accuracy study, a type of diagnostic accuracy test, aims to compare accuracy of two or more index tests in a study. The application of GRADE in comparative test accuracy differs from single test accuracy, mainly including the selection of appropriate comparative study designs, additional criteria for judging risk of bias, and the consequences of using comparative measures of test accuracy. The study focuses on basic principles and methods of GRADE approach in systematic reviews of comparative test accuracy to promote the understanding and application of the method by domestic scholars.
The QUADAS-2, QUIPS, and PROBAST tools are not specific for prognostic accuracy studies and the use of these tools to assess the risk of bias in prognostic accuracy studies is prone to bias. Therefore, QUAPAS, a risk of bias assessment tool for prognostic accuracy studies, has recently been developed. The tool combines QUADAS-2, QUIPS, and PROBAST, and consists of 5 domains, 18 signaling questions, 5 risk of bias questions, and 4 applicability questions. This paper will introduce the content and usage of QUAPAS to provide inspiration and references for domestic researchers.
Objective To evaluate the accuracy of soluble triggering receptor expressed on myeloid cells-1 ( sTREM-1) as a diagnostic index for ventilator-associated pneumonia ( VAP) . Methods We searched the PubMed, EMBase, Cochrane Library,Wanfang Database, CNKI and VIP for clinical trials which assessed the diagnosis accuracy of sTREM-1 for VAP. The methodological quality of each study was assessed by the quality assessment for studies of diagnostic accuracy ( QUADAS) tool. The Meta-disc software was used to conduct merger analyses on sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, and diagnostic odds ratio. The heterogeneity test was performed and summary receiver operating characteristic ( SROC) curve was completed. Results 8 studies were included ( 180 VAP patients and 224 non-VAP patients) . The value of merger sensitivity, specificity, and diagnostic odds ratio were 0. 80, 0. 74, and 13. 89, respectively. The area under of SROC curve was 0. 857, with Q point at 0. 788. Conclusion sTREM-1 showed moderate accuracy for VAP diagnosis in adult mechanically ventilated patients, which should be combined with other diagnostic markers to further improve the sensitivity and specificity.
Receiving the amount of true positives, false positives, false negatives and true negatives is necessary when conducting meta-analysis of diagnostic tests. Advanced methods of data extraction are required if these data could not be directly obtained from a literature. We introduced three methods and discussed the theories. An example was then given to illustrate how to apply the methods.
ObjectiveTo systematically review the diagnostic value of optical coherence tomography angiography (OCTA) for primary open-angle glaucoma (POAG). MethodsThe CNKI, WanFang Data, VIP, CBM, PubMed, Embase, Web of Science, and Cochrane Library databases were electronically searched to collect diagnostic test on OCTA for POAG from inception to February 2024. Two reviewers independently screened literature, extracted data and assessed the risk of bias of the included studies. Meta-analysis was then performed by using Stata 15.0 software. ResultsA total of 12 diagnostic tests involving 993 subjects were included. Meta-analysis results showed that the sensitivity/specificity of OCTA for diagnosing peripapillary vessel density, retinal vessel density, and optic nerve fiber changes in patients with POAG were 0.77/0.92, 0.56/0.92, and 0.85/0.91, respectively, and the AUC of the SROC curve was 0.94, 0.92 and 0.95, respectively. ConclusionOCTA has high diagnostic accuracy for POAG. Due to the limited quality and quantity of the included studies, more high quality studies are needed to verify the above conclusion.
The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) has been widely accepted in the assessment of diagnostic accuracy and quality. However, it is not suitable for assessing risk of bias in studies comparing diagnostic accuracy. The current common practice in systematic reviews is to derive comparative accuracy from non-comparative diagnostic accuracy studies, which is inherently biased. The QUADAS group developed the QUADAS-Compare (QUADAS-C) tool for assessing the risk of bias in comparative diagnostic accuracy studies. It was officially launched in October 2021. QUADAS-C retains the same 4-domain structure as QUADAS-2: patient selection, index test, reference standard, and flow and timing. It also includes an additional 14 signaling questions and 4 risk of bias questions. This allows researchers to identify high-quality research evidence and avoid bias in research design and conduct. This article interpreted the basic situation, evaluation items, evaluation standards, and usage methods and procedures associated with QUADAS-C to provide references for domestic users.
ObjectiveTo compare the investigation results of compliance and accuracy of hand hygiene in medical staff achieved by Hospital Infection Management Department and Department Infection Management Teams, and analyze the reasons for differences of the results and take measures to improve the investigation ability of hand hygiene in hospitals. MethodsWe statistically analyzed the results of compliance and accuracy of hand hygiene from January to December 2013 investigated by the infection management department and 25 infection management teams. Both the hospital and departments used "WHO Standard Observation Form". Single-blind method was used to observe the implementation of hand hygiene in medical staff. ResultsThe hospital infection management department investigation showed that hand hygiene compliance and accuracy were 64.97% and 87.78%, respectively, while the investigation by infection management teams showed that hand hygiene compliance and accuracy were 90.54% and 93.37%, respectively. The differences between the investigation results of two-level organizations were statistically significant (χ2=286.2, P<0.001; χ2=532.6, P<0.001). ConclusionWe should take measures to enforce the training of hand hygiene implementation and the observation method, and improve the guidance and assessment, promote investigators' working responsibility and observation ability, so that the survey data can accurately reflect the actual situation to urge medical staff to form good hand hygiene habits.
The mada package is a type of package that is especially used for implementing meta-analysis of diagnostic accuracy tests. This package is developed on basis of classical statistical theories and it can be used to calculate all relevant effect size of diagnostic accuracy tests; however, it does not provide pooled values of sensitivity and specificity. This article uses an example to introduce the whole functions of mada package in implementing meta-analysis of diagnostic accuracy tests, including data preparation, calculation implementation, result summary, and plots drawing.
Machine learning-based diagnostic tests have certain differences of measurement indicators with traditional diagnostic tests. In this paper, we elaborate the definitions, calculation methods and statistical inferences of common measurement indicators of machine learning-based diagnosis models in detail. We hope that this paper will be helpful for clinical researchers to better evaluate machine learning diagnostic models.
ObjectiveTo study the method of rapid and accurate measurement of body temperature in dense population during the coronavirus disease 2019 pandemic.MethodsFrom January 27th to February 8th, 2020, subjects were respectively measured with two kinds of non-contact infrared thermometers (blue thermometer and red one) to measure the temperature of forehead, neck, and inner side of forearm under the conditions of 4–6℃ (n=152), 7–10℃ (n=103), and 11–25℃ (n=209), while the temperature of axillary was measured with mercury thermometer under the same conditions. Taking the mercury thermometer temperature as the gold standard, the measurement results with non-contact infrared thermometers were compared.ResultsAt 7–10℃, there was no statistical difference among the forehead temperatures measured by the two non-contact infrared thermometers and the axillary temperature (P>0.05); there was no difference among the temperature measured by blue thermometer on forehead, neck, and inner side of forearm (P>0.05); no difference was found between the temperature measured by the red thermometer on forehead and inner side of forearm (P>0.05), while there was statistical difference between the temperatures measured by the red thermometer on forehead and neck (P<0.05). Under the environment of 11−25℃, there was no statistical difference among the forehead temperatures measured by the two infrared thermometers and the axillary temperature (P>0.05); the difference between the temperatures of forehead and inner side of forearm measured by the blue thermometer was statistically significant (P<0.05), while no difference appeared between the forehead and neck temperatures measured by the blue thermometer (P>0.05); there was no statistical difference among the temperatures of three body regions mentioned above measured by the red thermometer (P>0.05). According to the manual, the allowable fluctuation range of the blue thermometer was 0.3℃, and that of the red one was 0.2℃. The mean differences in measured values between different measured sites of the two products were within the allowable fluctuation range. Therefore, the differences had no clinical significance in the environment of 7–25℃. Under the environment of 4–6℃, the detection rate of blue thermometer was 2.2% and that of the red one was 19.1%.ConclusionsThere is no clinical difference between the temperature measured by mercury thermometer and the temperature measured by temperature guns at 7–10 or 11–25℃, so temperature guns can be widely used. In order to maintain the maximum distance between the measuring and the measured persons and reduce the infection risk, it is recommended to choose the inner forearm for temperature measurement. Under the environment of ambient temperature 4–6℃, the detection rate of non-contact electronic temperature gun is low, requiring taking thermal measures for the instrument.