Objective To verify the reliability and validity of a self-developed satisfaction evaluation questionnaire for outpatient department employees in public hospitals, and to provide suitable tools for conducting such surveys. Methods Two anonymous surveys were conducted on all employees of the Outpatient Department of West China Hospital of Sichuan University in July 2019 and November 2021, respectively. Questionnaire items were screened using methods such as item distribution, coefficient of variation, and decision value, and the reliability and validity of the questionnaire were evaluated using Spearman-Brown coefficient and Cronbach’s α coefficient, exploratory factor analysis, and confirmatory factor analysis. Results The final questionnaire retained 14 items, which could be divided into two dimensions: work conditions and interpersonal environment, and the overall fit index of structural equation model were as follows: χ2/ν=6.957, the standardized root mean square residual was 0.061, the root mean square error of approximation was 0.147, the goodness-of-fit index was 0.796, the adjusted goodness-of-fit index was 0.719, the normed fit index was 0.849, the relative fit index was 0.819, the incremental fit index was 0.868, the Tucker-Lewis Index was 0.841, and the comparative fit index was 0.867. The combined reliability of the two factors in the questionnaire was 0.94 and 0.91, respectively. The average variance extraction was 0.67 and 0.76, respectively, and the square root of the average variance extraction was 0.82 and 0.87, respectively, both of which were greater than the correlation coefficient of 0.71 between the two factors. The Spearman-Brown coefficient of the final questionnaire was 0.913, and the Cronbach’s α coefficients for the overall and two dimensions were 0.953, 0.937, and 0.910, respectively. Conclusion The reliability and validity of the satisfaction evaluation questionnaire for outpatient department employees in public hospitals are good and the questionnaire can be applied to practical surveys.
ObjectiveBy establishing a set of evaluation system for thoracoscopic clinical function and applicability, to evaluate and compare the advantages and disadvantages of different brands of thoracoscopes, and to provide some suggestions for the innovation and upgrade of thoracoscopes, especially for the domestic thoracoscopes.MethodsThe project coordination team initially formulated the evaluation index system for the clinical function and applicability of thoracoscope by querying literature and brainstorming. The Delphi expert consultation method was used to distribute questionnaires to the selected experts. Experts provided scores which were based on the importance of each indicator, and clarified the basis of their judgment and the familiarity with the evaluation indicators. After two rounds of screening by Delphi method, a thoracoscopic clinical function and applicability satisfactory questionnaire was formed. The appropriate sample for pre-investigation was selected, and the reliability and validity were tested. The index composition was adjusted based on the results of the test to form a final evaluation scale.ResultsThe project coordination team initially formulated 24 thoracoscope-related evaluation indicators. After two rounds of experts consultation, the item "brightness adjustment" was deleted without any additional entries. The positive coefficients of the experts in the first round and the second round were 100.0% and 80.0%, respectively. The two rounds of authoritative coefficients were 0.86 and 0.90, and the coordination coefficients were 0.272 (P<0.001) and 0.523 (P<0.001), respectively. A total of 140 questionnaires were issued in this pre-investigation. The recovery rate was 100.0% and the effective rate was 90.0%. The Cronbach's α value of the scale was 0.936, and the Spearman-Brown split-half reliability coefficient was 0.972. The factor analysis finally extracted 3 common factors. The total variance of the cumulative interpretation was 70.9%. The three common factors were named "operation related", "image related" and "device related".ConclusionThe evaluation index system developed in this study has good reliability and validity, and can be used as a tool to evaluate the clinical function and applicability of thoracoscopes.
ObjectiveTo evaluate the reliability,validity and feasibility of a patient-reported outcomes (PRO) scale in the subjects with respiratory failure. Methods364 patients with chronic respiratory failure and 97 healthy subjects were face-to-face interviewed by well-trained investigators,and the data of respiratory failure -PRO instrument were collected. The psychometric performance such as reliability,validity,responsiveness and clinical feasibility in the respiratory failure -PRO instrument was evaluated. ResultsThe Cronbach's alpha coefficient of the respiratory failure -PRO instrument and each dimension were greater than 0.7. Factor analysis showed that the instrument had good construct validity. The scores of each of the facets and total scores between the patients and the healthy subjects were different. The recovery rate and the efficient rate of the questionnaire were more than 95%,and the time required to complete a questionnaire was within 15 minutes,indicating that the scale had a high clinical feasibility. ConclusionThe respiratory failure -PRO instrument has good reliability,validity,responsiveness and clinical feasibility.
ObjectiveTo translate the King’s Brief Interstitial Lung Disease (K-BILD) to Chinese, so as to provide an well reliability and validity assessment instrument for health status of patients with interstitial lung disease.MethodsBrislin’s transition model, six expert’s panel and pre-survey were used for initial Chinese version of K-BILD. Items analysis, exploratory factor analysis (EFA), confirmatory factor analysis (CFA), internal consistency reliability and test-retest reliability were used for validity and reliability test with 122 respondents.ResultsTen-item Chinese version of K-BILD were proved to have great psychometric qualities, two factors were extracted by EFA, which could explain 63.35% of the total variance. Furthermore, the CFA demonstrates the fit indices of two-factors mode: χ2/df=0.797, RMSEA=0.000, NFI=0.848, IFI=1.048, CFI=1.000, TLI=1.071. Cronbach’s α and Guttman Split-half were 0.893 and 0.861, respectively. Besides, the test-retest reliability of the scale was 0.805.ConclusionThe Chinese version of K-BILD scale has good validity and reliability, which is applicable for health status assessment in patient with interstitial lung disease.
ObjectiveTo investigate the reliability and validity of Short-Form 36 Health Survey Scale (SF-36) for evaluating quality of life (QOL) of thoracic surgery patients in a specific regional medical center,and improve care and nursing plan for these patients. MethodsNinety-five patients who were admitted in Department of Thoracic Surgery of West China Hospital from March to May 2012 were enrolled in this study. Ninety-four patients finished a valid questionnaire study including 68 male and 26 female patients with their average age of 62.0±13.0 years. Preoperative diagnosis was squamous cell lung cancer in 8 patients,lung adenocarcinoma in 6 patients,small cell lung cancer in 1 patient,esophageal cancer in 12 patients and undefined lung mass in 67 patients. Postoperative diagnosis was squamous cell lung cancer in 39 patients, lung adenocarcinoma in 28 patients,small cell lung cancer in 8 patients,esophageal cancer in 12 patients,pulmonary tuberculosis in 3 patients and inflammatory pseudo-tumor in 4 patients. Chinese edition of SF-36 was used to evaluate patients' QOL. Cronbach's coefficients (α) and split-half reliability were used to assess its reliability. Its validity was assessed through factor analysis. ResultsCronbach's coefficients (α) of SF-36 were as followed:Physical Functioning (PF) 0.721,Role-Physical (RP) 0.859,General Health (GH) 0.721,Vitality (VT) 0.899,Social Functioning (SF) 0.852,Role-Emotional (RE) 0.872,and Mental Health (MH) 0.598. Split-half reliability of each part was PF 0.725,RP 0.784,GH 0.758,VT 0.749,SF 0.745,RE 0.740,and MH 0.426. Nine principal components were extracted by factor analysis and generally reflected the 8 dimensions of SF-36,which was correspondent to the SF-36 structure. ConclusionSF-36 scale can be used to measure QOL of thoracic surgery patients with good reliability and validity.
ObjectiveTo formulate the Chinese version of Fear of Progression Questionnaire-Short Form/Caregiver Version (FoP-Q-SF/C) and examine the reliability and validity of the scale.MethodsA questionnaire survey of FoP-Q-SF/C was conducted among the caregivers of melanoma out-patients in West China Hospital of Sichuan University from June 2019 to March 2020. Convenient sampling method was adopted. The validity and reliability of the scale were analyzed.ResultsA total of 247 caregivers of melanoma out-patients were investigated by the FoP-Q-SF/C, and 101 valid questionnaires were finally collected. The Cronbach’s α of the FoP-Q-SF/C scale was 0.919, and the Guttman Split-Half coefficient was 0.906. Using exploratory factor analysis to extract 3 common factors, the cumulative explainable total variation was 73.964%. The model fit was as follows: chi-square/degree of freedom was 1.950, standardized root mean square residual was 0.067, goodness of fit index was 0.859, incremental fit index was 0.939, comparative fit index was 0.938, Tucker-Lewis index or non-normed fit index was 0.918, and the root-mean-square error of approximation was 0.097.ConclusionsThe FoP-Q-SF/C scale formulated in this study is divided into three dimensions, which has good reliability and validity, meanwhile, it is relatively simple and can be used to clinically screen melanoma caregivers’ FoP-Q-SF/C levels. However, the application of this scale in other diseases still needs further testing.
ObjectiveTo develop a patient satisfaction evaluation scale for day surgery and test its reliability and validity, so as to provide a scientific and effective tool for day surgery patient satisfaction assessment.MethodsThe literature review method was used to form an entry pool, and the initial version of the scale was formed in conjunction with the expert review method. And then a preliminary survey was conducted to obtain the tentative version of the scale. Finally, 290 day surgery patients discharged between June 15th and July 15th, 2019 were selected to accomplish a survey to check the reliability and validity of the scale.ResultsFinally, a day surgery patient satisfaction evaluation scale was formed, containing 3 stages (pre-hospital, hospitalization, and postdischarge follow-up), 3 dimensions (medical staff evaluation, medical service evaluation, and environment and process evaluation), and 40 items. After the formal survey, the overall Cronbach’s α coefficient of the scale was 0.980, the Spearman-Brown coefficient was 0.933, the Guttman’s half-coefficient was 0.932, and the content validity was 0.87-1.00.ConclusionThe day surgery patient satisfaction evaluation scale was proven good reliability and validity, which can be used as a measurement tool for day surgery patients and applied to clinical practice.
Objective To primarily test the reliability and validity of the Kashin-Beck Disease (KBD) affected big joints function assessing system for adult Tibetans in Rangtang County. Method From June to July 2009, 142 KBD patients were investigated with the function assessing system in Rangtang County of Ngawa. Cronbach’s α coefficient was calculated to estimate internal consistency reliability. Pearson’s r for the correlation of the items with the total score of the scale was computed to test the internal validity. Principal component factor analysis with varimax rotation analysis was conducted to explore construct validity. Result Both the response and complete rates of the scale were 100%. The time for completing the scale was 7.8±3.4 minutes. Cronbach’s α was 0.857, which revealed satisfactory internal consistency reliability. Pearson correlation analysis revealed significant correlation between the scores of each item and the total score of the scale (Plt;0.05). Pearson’s r value of each item was more than 0.4, only except the items of “sitting with legs crossed” and “standing at attention”. The principal factor analysis extracted three latent factors explaining 68.1% of the variation together. The latent factors weights of the items were over 0.4 except the items of “standing at attention”, "taking food” and “wiping after defecation”. Conclusion The reliability and validity of KBD affected big joints function assessing system for adult Tibetans in Rangtang County was good in this primary test, the function assessing system has to be widely applied and further assessed among Tibetans suffered with KBD, in order to provide a standard evaluation criterion in KBD integrate control.
ObjectiveTo evaluate the reliability and validity of Guideline Implementation Success Assessment Tool (A-GIST). MethodsWith the guideline for the prevention and treatment of type 2 diabetes mellitus in China (2020 edition) as the target guideline, health care providers and patients from different hospitals across the country were investigated by questionnaire using A-GIST. Spearman-Brown coefficient and Cronbach's α coefficient were used to evaluate the split-half reliability and internal consistency reliability, while the structural validity, convergent validity and discriminant validity were investigated by confirmatory factor analysis based on structural equation. ResultsThe internal consistency reliability and split half reliability coefficients of the whole tool and each dimension ranged from 0.650 to 0.986. The scale-level content validity index (S-CVI/Ave) of content validity was 0.846. Confirmatory factor analysis showed that, the χ2/df of two sections of the tool were 8.695 and 6.123, respectively. The root mean square residual (RMR), the standard root mean square residual (SRMR) and the root mean square error of approximation (RMSEA) were under or almost under the threshold. Besides, the goodness-of-fit index (GFI) of them were 0.901 and 0.822, the adjusted goodness-of-fit index (AGFI) were 0.836 and 0.787, and the parsimonious normed fit index (PNFI) were 0.545 and 0.788, respectively. ConclusionGuideline Implementation Success Assessment Tool (A-GIST) was proved to be valid and reliable, and it shows that it is necessary to optimize the items under the dimensions of maintenance and evaluation of diagnosis and treatment effect in the future.