Magnetic resonance imaging(MRI) can obtain multi-modal images with different contrast, which provides rich information for clinical diagnosis. However, some contrast images are not scanned or the quality of the acquired images cannot meet the diagnostic requirements due to the difficulty of patient's cooperation or the limitation of scanning conditions. Image synthesis techniques have become a method to compensate for such image deficiencies. In recent years, deep learning has been widely used in the field of MRI synthesis. In this paper, a synthesis network based on multi-modal fusion is proposed, which firstly uses a feature encoder to encode the features of multiple unimodal images separately, and then fuses the features of different modal images through a feature fusion module, and finally generates the target modal image. The similarity measure between the target image and the predicted image in the network is improved by introducing a dynamic weighted combined loss function based on the spatial domain and K-space domain. After experimental validation and quantitative comparison, the multi-modal fusion deep learning network proposed in this paper can effectively synthesize high-quality MRI fluid-attenuated inversion recovery (FLAIR) images. In summary, the method proposed in this paper can reduce MRI scanning time of the patient, as well as solve the clinical problem of missing FLAIR images or image quality that is difficult to meet diagnostic requirements.
The electroencephalogram (EEG) signal is a general reflection of the neurophysiological activity of the brain, which has the advantages of being safe, efficient, real-time and dynamic. With the development and advancement of machine learning research, automatic diagnosis of Alzheimer’s diseases based on deep learning is becoming a research hotspot. Started from feedforward neural networks, this paper compared and analysed the structural properties of neural network models such as recurrent neural networks, convolutional neural networks and deep belief networks and their performance in the diagnosis of Alzheimer’s disease. It also discussed the possible challenges and research trends of this research in the future, expecting to provide a valuable reference for the clinical application of neural networks in the EEG diagnosis of Alzheimer’s disease.
Objective To develop a deep learning system for CT images to assist in the diagnosis of thoracolumbar fractures and analyze the feasibility of its clinical application. Methods Collected from West China Hospital of Sichuan University from January 2019 to March 2020, a total of 1256 CT images of thoracolumbar fractures were annotated with a unified standard through the Imaging LabelImg system. All CT images were classified according to the AO Spine thoracolumbar spine injury classification. The deep learning system in diagnosing ABC fracture types was optimized using 1039 CT images for training and validation, of which 1004 were used as the training set and 35 as the validation set; the rest 217 CT images were used as the test set to compare the deep learning system with the clinician’s diagnosis. The deep learning system in subtyping A was optimized using 581 CT images for training and validation, of which 556 were used as the training set and 25 as the validation set; the rest 104 CT images were used as the test set to compare the deep learning system with the clinician’s diagnosis. Results The accuracy and Kappa coefficient of the deep learning system in diagnosing ABC fracture types were 89.4% and 0.849 (P<0.001), respectively. The accuracy and Kappa coefficient of subtyping A were 87.5% and 0.817 (P<0.001), respectively. Conclusions The classification accuracy of the deep learning system for thoracolumbar fractures is high. This approach can be used to assist in the intelligent diagnosis of CT images of thoracolumbar fractures and improve the current manual and complex diagnostic process.
Identification of molecular subtypes of malignant tumors plays a vital role in individualized diagnosis, personalized treatment, and prognosis prediction of cancer patients. The continuous improvement of comprehensive tumor genomics database and the ongoing breakthroughs in deep learning technology have driven further advancements in computer-aided tumor classification. Although the existing classification methods based on gene expression omnibus database take the complexity of cancer molecular classification into account, they ignore the internal correlation and synergism of genes. To solve this problem, we propose a multi-layer graph convolutional network model for breast cancer subtype classification combined with hierarchical attention network. This model constructs the graph embedding datasets of patients’ genes, and develops a new end-to-end multi-classification model, which can effectively recognize molecular subtypes of breast cancer. A large number of test data prove the good performance of this new model in the classification of breast cancer subtypes. Compared to the original graph convolutional neural networks and two mainstream graph neural network classification algorithms, the new model has remarkable advantages. The accuracy, weight-F1-score, weight-recall, and weight-precision of our model in seven-category classification has reached 0.851 7, 0.823 5, 0.851 7 and 0.793 6 respectively. In the four-category classification, the results are 0.928 5, 0.894 9, 0.928 5 and 0.865 0 respectively. In addition, compared with the latest breast cancer subtype classification algorithms, the method proposed in this paper also achieved the highest classification accuracy. In summary, the model proposed in this paper may serve as an auxiliary diagnostic technology, providing a reliable option for precise classification of breast cancer subtypes in the future and laying the theoretical foundation for computer-aided tumor classification.
Heart failure is a disease that seriously threatens human health and has become a global public health problem. Diagnostic and prognostic analysis of heart failure based on medical imaging and clinical data can reveal the progression of heart failure and reduce the risk of death of patients, which has important research value. The traditional analysis methods based on statistics and machine learning have some problems, such as insufficient model capability, poor accuracy due to prior dependence, and poor model adaptability. In recent years, with the development of artificial intelligence technology, deep learning has been gradually applied to clinical data analysis in the field of heart failure, showing a new perspective. This paper reviews the main progress, application methods and major achievements of deep learning in heart failure diagnosis, heart failure mortality and heart failure readmission, summarizes the existing problems and presents the prospects of related research to promote the clinical application of deep learning in heart failure clinical research.
The widespread application of low-dose computed tomography (LDCT) has significantly increased the detection of pulmonary small nodules, while accurate prediction of their growth patterns is crucial to avoid overdiagnosis or underdiagnosis. This article reviews recent research advances in predicting pulmonary nodule growth based on CT imaging, with a focus on summarizing key factors influencing nodule growth, such as baseline morphological parameters, dynamic indicators, and clinical characteristics, traditional prediction models (exponential and Gompertzian models), and the applications and limitations of radiomics-based and deep learning models. Although existing studies have achieved certain progress in predicting nodule growth, challenges such as small sample sizes and lack of external validation persist. Future research should prioritize the development of personalized and visualized prediction models integrated with larger-scale datasets to enhance predictive accuracy and clinical applicability.
In recent years, deep learning has provided a new method for cancer prognosis analysis. The literatures related to the application of deep learning in the prognosis of cancer are summarized and their advantages and disadvantages are analyzed, which can be provided for in-depth research. Based on this, this paper systematically reviewed the latest research progress of deep learning in the construction of cancer prognosis model, and made an analysis on the strengths and weaknesses of relevant methods. Firstly, the construction idea and performance evaluation index of deep learning cancer prognosis model were clarified. Secondly, the basic network structure was introduced, and the data type, data amount, and specific network structures and their merits and demerits were discussed. Then, the mainstream method of establishing deep learning cancer prognosis model was verified and the experimental results were analyzed. Finally, the challenges and future research directions in this field were summarized and expected. Compared with the previous models, the deep learning cancer prognosis model can better improve the prognosis prediction ability of cancer patients. In the future, we should continue to explore the research of deep learning in cancer recurrence rate, cancer treatment program and drug efficacy evaluation, and fully explore the application value and potential of deep learning in cancer prognosis model, so as to establish an efficient and accurate cancer prognosis model and realize the goal of precision medicine.
ObjectiveTo build a small-sample ultra-widefield fundus images (UWFI) multi-disease classification artificial intelligence model, and initially explore the ability of artificial intelligence to classify UWFI multi-disease tasks. MethodsA retrospective study. From 2016 to 2021, 1 608 images from 1 123 patients who attended the Eye Center of the Renmin Hospital of Wuhan University and underwent UWFI examination were used for UWFI multi-disease classification artificial intelligence model construction. Among them, 320, 330, 319, 268, and 371 images were used for diabetic retinopathy (DR), retinal vein occlusion (RVO), pathological myopia (PM), retinal detachment (RD), and normal fundus images, respectively. 135 images from 106 patients at the Tianjin Medical University Eye Hospital were used as the external test set. EfficientNet-B7 was selected as the backbone network for classification analysis of the included UWFI images. The performance of the UWFI multi-task classification model was assessed using the receiver operating characteristic curve, area under the curve (AUC), sensitivity, specificity, and accuracy. All data were expressed using numerical values and 95% confidence intervals (CI). The datasets were trained on the network models ResNet50 and ResNet101 and tested on an external test set to compare and observe the performance of EfficientNet with the 2 models mentioned above. ResultsThe overall classification accuracy of the UWFI multi-disease classification artificial intelligence model on the internal and external test sets was 92.57% (95%CI 91.13%-92.92%) and 88.89% (95%CI 88.11%-90.02%), respectively. These were 96.62% and 92.59% for normal fundus, 95.95% and 95.56% for DR, 96.62% and 98.52% for RVO, 98.65% and 97.04% for PM, and 97.30% and 94.07% for RD, respectively. The mean AUC on the internal and external test sets was 0.993 and 0.983, respectively, with 0.994 and 0.939 for normal fundus, 0.999 and 0.995 for DR, 0.985 and 1.000 for RVO, 0.991 and 0.993 for PM and 0.995 and 0.990 for RD, respectively. EfficientNet performed better than the ResNet50 and ResNet101 models on both the internal and external test sets. ConclusionThe preliminary UWFI multi-disease classification artificial intelligence model using small samples constructed in this study is able to achieve a high accuracy rate, and the model may have some value in assisting clinical screening and diagnosis.
Objective To identify the heart sounds of aortic stenosis by deep learning model based on DenseNet121 architecture, and to explore its application potential in clinical screening aortic stenosis. Methods We prospectively collected heart sounds and clinical data of patients with aortic stenosis in Tianjin Chest Hospital, from June 2021 to February 2022. The collected heart sound data were used to train, verify and test a deep learning model. We evaluated the performance of the model by drawing receiver operating characteristic curve and precision-recall curve. Results A total of 100 patients including 11 asymptomatic patients were included. There were 50 aortic stenosis patients with 30 males and 20 females at an average age of 68.18±10.63 years in an aortic stenosis group (stenosis group). And 50 patients without aortic valve disease were in a negative group, including 26 males and 24 females at an average age of 45.98±12.51 years. The model had an excellent ability to distinguish heart sound data collected from patients with aortic stenosis in clinical settings: accuracy at 91.67%, sensitivity at 90.00%, specificity at 92.50%, and area under receiver operating characteristic curve was 0.917. Conclusion The model of heart sound diagnosis of aortic stenosis based on deep learning has excellent application prospects in clinical screening, which can provide a new idea for the early identification of patients with aortic stenosis.