The medical literature contains a wealth of valuable medical knowledge. At present, the research on extraction of entity relationship in medical literature has made great progress, but with the exponential increase in the number of medical literature, the annotation of medical text has become a big problem. In order to solve the problem of manual annotation time such as consuming and heavy workload, a remote monitoring annotation method is proposed, but this method will introduce a lot of noise. In this paper, a novel neural network structure based on convolutional neural network is proposed, which can solve a large number of noise problems. The model can use the multi-window convolutional neural network to automatically extract sentence features. After the sentence vectors are obtained, the sentences that are effective to the real relationship are selected through the attention mechanism. In particular, an entity type (ET) embedding method is proposed for relationship classification by adding entity type characteristics. The attention mechanism at sentence level is proposed for relation extraction in allusion to the unavoidable labeling errors in training texts. We conducted an experiment using 968 medical references on diabetes, and the results showed that compared with the baseline model, the present model achieved good results in the medical literature, and F1-score reached 93.15%. Finally, the extracted 11 types of relationships were stored as triples, and these triples were used to create a medical map of complex relationships with 33 347 nodes and 43 686 relationship edges. Experimental results show that the algorithm used in this paper is superior to the optimal reference system for relationship extraction.
Focus on the inconsistency of the shape, location and size of brain glioma, a dual-channel 3-dimensional (3D) densely connected network is proposed to automatically segment brain glioma tumor on magnetic resonance images. Our method is based on a 3D convolutional neural network frame, and two convolution kernel sizes are adopted in each channel to extract multi-scale features in different scales of receptive fields. Then we construct two densely connected blocks in each pathway for feature learning and transmission. Finally, the concatenation of two pathway features was sent to classification layer to classify central region voxels to segment brain tumor automatically. We train and test our model on open brain tumor segmentation challenge dataset, and we also compared our results with other models. Experimental results show that our algorithm can segment different tumor lesions more accurately. It has important application value in the clinical diagnosis and treatment of brain tumor diseases.
In order to realize the quantitative assessment of muscle strength in hand function rehabilitation and then formulate scientific and effective rehabilitation training strategies, this paper constructs a multi-scale convolutional neural network (MSCNN) - convolutional block attention module (CBAM) - bidirectional long short-term memory network (BiLSTM) muscle strength prediction model to fully explore the spatial and temporal features of the data and simultaneously suppress useless features, and finally achieve the improvement of the accuracy of the muscle strength prediction model. To verify the effectiveness of the model proposed in this paper, the model in this paper is compared with traditional models such as support vector machine (SVM), random forest (RF), convolutional neural network (CNN), CNN - squeeze excitation network (SENet), MSCNN-CBAM and MSCNN-BiLSTM, and the effect of muscle strength prediction by each model is investigated when the hand force application changes from 40% of the maximum voluntary contraction force (MVC) to 60% of the MVC. The research results show that as the hand force application increases, the effect of the muscle strength prediction model becomes worse. Then the ablation experiment is used to analyze the influence degree of each module on the muscle strength prediction result, and it is found that the CBAM module plays a key role in the model. Therefore, by using the model in this article, the accuracy of muscle strength prediction can be effectively improved, and the characteristics and laws of hand muscle activities can be deeply understood, providing assistance for further exploring the mechanism of hand functions.
Alzheimer’s Disease (AD) is a progressive neurodegenerative disorder. Due to the subtlety of symptoms in the early stages of AD, rapid and accurate clinical diagnosis is challenging, leading to a high rate of misdiagnosis. Current research on early diagnosis of AD has not sufficiently focused on tracking the progression of the disease over an extended period in subjects. To address this issue, this paper proposes an ensemble model for assisting early diagnosis of AD that combines structural magnetic resonance imaging (sMRI) data from two time points with clinical information. The model employs a three-dimensional convolutional neural network (3DCNN) and twin neural network modules to extract features from the sMRI data of subjects at two time points, while a multi-layer perceptron (MLP) is used to model the clinical information of the subjects. The objective is to extract AD-related features from the multi-modal data of the subjects as much as possible, thereby enhancing the diagnostic performance of the ensemble model. Experimental results show that based on this model, the classification accuracy rate is 89% for differentiating AD patients from normal controls (NC), 88% for differentiating mild cognitive impairment converting to AD (MCIc) from NC, and 69% for distinguishing non-converting mild cognitive impairment (MCInc) from MCIc, confirming the effectiveness and efficiency of the proposed method for early diagnosis of AD, as well as its potential to play a supportive role in the clinical diagnosis of early Alzheimer's disease.
A method was proposed to detect pulmonary nodules in low-dose computed tomography (CT) images by two-dimensional convolutional neural network under the condition of fine image preprocessing. Firstly, CT image preprocessing was carried out by image clipping, normalization and other algorithms. Then the positive samples were expanded to balance the number of positive and negative samples in convolutional neural network. Finally, the model with the best performance was obtained by training two-dimensional convolutional neural network and constantly optimizing network parameters. The model was evaluated in Lung Nodule Analysis 2016(LUNA16) dataset by means of five-fold cross validation, and each group's average model experiment results were obtained with the final accuracy of 92.3%, sensitivity of 92.1% and specificity of 92.6%.Compared with other existing automatic detection and classification methods for pulmonary nodules, all indexes were improved. Subsequently, the model perturbation experiment was carried out on this basis. The experimental results showed that the model is stable and has certain anti-interference ability, which could effectively identify pulmonary nodules and provide auxiliary diagnostic advice for early screening of lung cancer.
Cardiac auscultation is the basic way for primary diagnosis and screening of congenital heart disease(CHD). A new classification algorithm of CHD based on convolution neural network was proposed for analysis and classification of CHD heart sounds in this work. The algorithm was based on the clinically collected diagnosed CHD heart sound signal. Firstly the heart sound signal preprocessing algorithm was used to extract and organize the Mel Cepstral Coefficient (MFSC) of the heart sound signal in the one-dimensional time domain and turn it into a two-dimensional feature sample. Secondly, 1 000 feature samples were used to train and optimize the convolutional neural network, and the training results with the accuracy of 0.896 and the loss value of 0.25 were obtained by using the Adam optimizer. Finally, 200 samples were tested with convolution neural network, and the results showed that the accuracy was up to 0.895, the sensitivity was 0.910, and the specificity was 0.880. Compared with other algorithms, the proposed algorithm has improved accuracy and specificity. It proves that the proposed method effectively improves the robustness and accuracy of heart sound classification and is expected to be applied to machine-assisted auscultation.
Coronavirus disease 2019 (COVID-19) has spread rapidly around the world. In order to diagnose COVID-19 more quickly, in this paper, a depthwise separable DenseNet was proposed. The paper constructed a deep learning model with 2 905 chest X-ray images as experimental dataset. In order to enhance the contrast, the contrast limited adaptive histogram equalization (CLAHE) algorithm was used to preprocess the X-ray image before network training, then the images were put into the training network and the parameters of the network were adjusted to the optimal. Meanwhile, Leaky ReLU was selected as the activation function. VGG16, ResNet18, ResNet34, DenseNet121 and SDenseNet models were used to compare with the model proposed in this paper. Compared with ResNet34, the proposed classification model of pneumonia had improved 2.0%, 2.3% and 1.5% in accuracy, sensitivity and specificity respectively. Compared with the SDenseNet network without depthwise separable convolution, number of parameters of the proposed model was reduced by 43.9%, but the classification effect did not decrease. It can be found that the proposed DWSDenseNet has a good classification effect on the COVID-19 chest X-ray images dataset. Under the condition of ensuring the accuracy as much as possible, the depthwise separable convolution can effectively reduce number of parameters of the model.
Sleep apnea (SA) detection method based on traditional machine learning needs a lot of efforts in feature engineering and classifier design. We constructed a one-dimensional convolutional neural network (CNN) model, which consists in four convolution layers, four pooling layers, two full connection layers and one classification layer. The automatic feature extraction and classification were realized by the structure of the proposed CNN model. The model was verified by the whole night single-channel sleep electrocardiogram (ECG) signals of 70 subjects from the Apnea-ECG dataset. Our results showed that the accuracy of per-segment SA detection was ranged from 80.1% to 88.0%, using the input signals of single-channel ECG signal, RR interval (RRI) sequence, R peak sequence and RRI sequence + R peak sequence respectively. These results indicated that the proposed CNN model was effective and can automatically extract and classify features from the original single-channel ECG signal or its derived signal RRI and R peak sequence. When the input signals were RRI sequence + R peak sequence, the CNN model achieved the best performance. The accuracy, sensitivity and specificity of per-segment SA detection were 88.0%, 85.1% and 89.9%, respectively. And the accuracy of per-recording SA diagnosis was 100%. These findings indicated that the proposed method can effectively improve the accuracy and robustness of SA detection and outperform the methods reported in recent years. The proposed CNN model can be applied to portable screening diagnosis equipment for SA with remote server.
The application of minimally invasive surgical tool detection and tracking technology based on deep learning in minimally invasive surgery is currently a research hotspot. This paper firstly expounds the relevant technical content of the minimally invasive surgery tool detection and tracking, which mainly introduces the advantages based on deep learning algorithm. Then, this paper summarizes the algorithm for detection and tracking surgical tools based on fully supervised deep neural network and the emerging algorithm for detection and tracking surgical tools based on weakly supervised deep neural network. Several typical algorithm frameworks and their flow charts based on deep convolutional and recurrent neural networks are summarized emphatically, so as to enable researchers in relevant fields to understand the current research progress more systematically and provide reference for minimally invasive surgeons to select navigation technology. In the end, this paper provides a general direction for the further research of minimally invasive surgical tool detection and tracking technology based on deep learning.
This paper performs a comprehensive study on the computer-aided detection for the medical diagnosis with deep learning. Based on the region convolution neural network and the prior knowledge of target, this algorithm uses the region proposal network, the region of interest pooling strategy, introduces the multi-task loss function: classification loss, bounding box localization loss and object rotation loss, and optimizes it by end-to-end. For medical image it locates the target automatically, and provides the localization result for the next stage task of segmentation. For the detection of left ventricular in echocardiography, proposed additional landmarks such as mitral annulus, endocardial pad and apical position, were used to estimate the left ventricular posture effectively. In order to verify the robustness and effectiveness of the algorithm, the experimental data of ultrasonic and nuclear magnetic resonance images are selected. Experimental results show that the algorithm is fast, accurate and effective.