In order to realize the quantitative assessment of muscle strength in hand function rehabilitation and then formulate scientific and effective rehabilitation training strategies, this paper constructs a multi-scale convolutional neural network (MSCNN) - convolutional block attention module (CBAM) - bidirectional long short-term memory network (BiLSTM) muscle strength prediction model to fully explore the spatial and temporal features of the data and simultaneously suppress useless features, and finally achieve the improvement of the accuracy of the muscle strength prediction model. To verify the effectiveness of the model proposed in this paper, the model in this paper is compared with traditional models such as support vector machine (SVM), random forest (RF), convolutional neural network (CNN), CNN - squeeze excitation network (SENet), MSCNN-CBAM and MSCNN-BiLSTM, and the effect of muscle strength prediction by each model is investigated when the hand force application changes from 40% of the maximum voluntary contraction force (MVC) to 60% of the MVC. The research results show that as the hand force application increases, the effect of the muscle strength prediction model becomes worse. Then the ablation experiment is used to analyze the influence degree of each module on the muscle strength prediction result, and it is found that the CBAM module plays a key role in the model. Therefore, by using the model in this article, the accuracy of muscle strength prediction can be effectively improved, and the characteristics and laws of hand muscle activities can be deeply understood, providing assistance for further exploring the mechanism of hand functions.
With the wide application of deep learning technology in disease diagnosis, especially the outstanding performance of convolutional neural network (CNN) in computer vision and image processing, more and more studies have proposed to use this algorithm to achieve the classification of Alzheimer’s disease (AD), mild cognitive impairment (MCI) and normal cognition (CN). This article systematically reviews the application progress of several classic convolutional neural network models in brain image analysis and diagnosis at different stages of Alzheimer’s disease, and discusses the existing problems and gives the possible development directions in order to provide some references.
The convolutional neural network (CNN) could be used on computer-aided diagnosis of lung tumor with positron emission tomography (PET)/computed tomography (CT), which can provide accurate quantitative analysis to compensate for visual inertia and defects in gray-scale sensitivity, and help doctors diagnose accurately. Firstly, parameter migration method is used to build three CNNs (CT-CNN, PET-CNN, and PET/CT-CNN) for lung tumor recognition in CT, PET, and PET/CT image, respectively. Then, we aimed at CT-CNN to obtain the appropriate model parameters for CNN training through analysis the influence of model parameters such as epochs, batchsize and image scale on recognition rate and training time. Finally, three single CNNs are used to construct ensemble CNN, and then lung tumor PET/CT recognition was completed through relative majority vote method and the performance between ensemble CNN and single CNN was compared. The experiment results show that the ensemble CNN is better than single CNN on computer-aided diagnosis of lung tumor.
The medical literature contains a wealth of valuable medical knowledge. At present, the research on extraction of entity relationship in medical literature has made great progress, but with the exponential increase in the number of medical literature, the annotation of medical text has become a big problem. In order to solve the problem of manual annotation time such as consuming and heavy workload, a remote monitoring annotation method is proposed, but this method will introduce a lot of noise. In this paper, a novel neural network structure based on convolutional neural network is proposed, which can solve a large number of noise problems. The model can use the multi-window convolutional neural network to automatically extract sentence features. After the sentence vectors are obtained, the sentences that are effective to the real relationship are selected through the attention mechanism. In particular, an entity type (ET) embedding method is proposed for relationship classification by adding entity type characteristics. The attention mechanism at sentence level is proposed for relation extraction in allusion to the unavoidable labeling errors in training texts. We conducted an experiment using 968 medical references on diabetes, and the results showed that compared with the baseline model, the present model achieved good results in the medical literature, and F1-score reached 93.15%. Finally, the extracted 11 types of relationships were stored as triples, and these triples were used to create a medical map of complex relationships with 33 347 nodes and 43 686 relationship edges. Experimental results show that the algorithm used in this paper is superior to the optimal reference system for relationship extraction.
Inferior myocardial infarction is an acute ischemic heart disease with high mortality, which is easy to induce life-threatening complications such as arrhythmia, heart failure and cardiogenic shock. Therefore, it is of great clinical value to carry out accurate and efficient early diagnosis of inferior myocardial infarction. Electrocardiogram is the most sensitive means for early diagnosis of inferior myocardial infarction. This paper proposes a method for detecting inferior myocardial infarction based on densely connected convolutional neural network. The method uses the original electrocardiogram (ECG) signals of serially connected Ⅱ, Ⅲ and aVF leads as the input of the model and extracts the robust features of the ECG signals by using the scale invariance of the convolutional layers. The characteristic transmission of ECG signals is enhanced by the dense connectivity between different layers, so that the network can automatically learn the effective features with strong robustness and high recognition, so as to achieve accurate detection of inferior myocardial infarction. The Physikalisch Technische Bundesanstalt diagnosis public ECG database was used for verification. The accuracy, sensitivity and specificity of the model reached 99.95%, 100% and 99.90%, respectively. The accuracy, sensitivity and specificity of the model are also over 99% even though the noise exists. Based on the results of this study, it is expected that the method can be introduced in the clinical environment to help doctors quickly diagnose inferior myocardial infarction in the future.
Attention deficit/hyperactivity disorder (ADHD) is a behavioral disorder syndrome found mainly in school-age population. At present, the diagnosis of ADHD mainly depends on the subjective methods, leading to the high rate of misdiagnosis and missed-diagnosis. To solve these problems, we proposed an algorithm for classifying ADHD objectively based on convolutional neural network. At first, preprocessing steps, including skull stripping, Gaussian kernel smoothing, et al., were applied to brain magnetic resonance imaging (MRI). Then, coarse segmentation was used for selecting the right caudate nucleus, left precuneus, and left superior frontal gyrus region. Finally, a 3 level convolutional neural network was used for classification. Experimental results showed that the proposed algorithm was capable of classifying ADHD and normal groups effectively, the classification accuracies obtained by the right caudate nucleus and the left precuneus brain regions were greater than the highest classification accuracy (62.52%) in the ADHD-200 competition, and among 3 brain regions in ADHD and the normal groups, the classification accuracy from the right caudate nucleus was the highest. It is well concluded that the method for classification of ADHD and normal groups proposed in this paper utilizing the coarse segmentation and deep learning is a useful method for the purpose. The classification accuracy of the proposed method is high, and the calculation is simple. And the method is able to extract the unobvious image features better, and can overcome the shortcomings of traditional methods of MRI brain area segmentation, which are time-consuming and highly complicate. The method provides an objective diagnosis approach for ADHD.
Early screening based on computed tomography (CT) pulmonary nodule detection is an important means to reduce lung cancer mortality, and in recent years three dimensional convolutional neural network (3D CNN) has achieved success and continuous development in the field of lung nodule detection. We proposed a pulmonary nodule detection algorithm by using 3D CNN based on a multi-scale attention mechanism. Aiming at the characteristics of different sizes and shapes of lung nodules, we designed a multi-scale feature extraction module to extract the corresponding features of different scales. Through the attention module, the correlation information between the features was mined from both spatial and channel perspectives to strengthen the features. The extracted features entered into a pyramid-similar fusion mechanism, so that the features would contain both deep semantic information and shallow location information, which is more conducive to target positioning and bounding box regression. On representative LUNA16 datasets, compared with other advanced methods, this method significantly improved the detection sensitivity, which can provide theoretical reference for clinical medicine.
Glaucoma is the leading cause of irreversible blindness, but its early symptoms are not obvious and are easily overlooked, so early screening for glaucoma is particularly important. The cup to disc ratio is an important indicator for clinical glaucoma screening, and accurate segmentation of the optic cup and disc is the key to calculating the cup to disc ratio. In this paper, a full convolutional neural network with residual multi-scale convolution module was proposed for the optic cup and disc segmentation. First, the fundus image was contrast enhanced and polar transformation was introduced. Subsequently, W-Net was used as the backbone network, which replaced the standard convolution unit with the residual multi-scale full convolution module, the input port was added to the image pyramid to construct the multi-scale input, and the side output layer was used as the early classifier to generate the local prediction output. Finally, a new multi-tag loss function was proposed to guide network segmentation. The mean intersection over union of the optic cup and disc segmentation in the REFUGE dataset was 0.904 0 and 0.955 3 respectively, and the overlapping error was 0.178 0 and 0.066 5 respectively. The results show that this method not only realizes the joint segmentation of cup and disc, but also improves the segmentation accuracy effectively, which could be helpful for the promotion of large-scale early glaucoma screening.
Otitis media is one of the common ear diseases, and its accurate diagnosis can prevent the deterioration of conductive hearing loss and avoid the overuse of antibiotics. At present, the diagnosis of otitis media mainly relies on the doctor's visual inspection based on the images fed back by the otoscope equipment. Due to the quality of otoscope equipment pictures and the doctor's diagnosis experience, this subjective examination has a relatively high rate of misdiagnosis. In response to this problem, this paper proposes the use of faster region convolutional neural networks to analyze clinically collected digital otoscope pictures. First, through image data enhancement and preprocessing, the number of samples in the clinical otoscope dataset was expanded. Then, according to the characteristics of the otoscope picture, the convolutional neural network was selected for feature extraction, and the feature pyramid network was added for multi-scale feature extraction to enhance the detection ability. Finally, a faster region convolutional neural network with anchor size optimization and hyperparameter adjustment was used for identification, and the effectiveness of the method was tested through a randomly selected test set. The results showed that the overall recognition accuracy of otoscope pictures in the test samples reached 91.43%. The above studies show that the proposed method effectively improves the accuracy of otoscope picture classification, and is expected to assist clinical diagnosis.
Atrial fibrillation (AF) is a common arrhythmia, which can lead to thrombosis and increase the risk of a stroke or even death. In order to meet the need for a low false-negative rate (FNR) of the screening test in clinical application, a convolutional neural network with a low false-negative rate (LFNR-CNN) was proposed. Regularization coefficients were added to the cross-entropy loss function which could make the cost of positive and negative samples different, and the penalty for false negatives could be increased during network training. The inter-patient clinical database of 21 077 patients (CD-21077) collected from the large general hospital was used to verify the effectiveness of the proposed method. For the convolutional neural network (CNN) with the same structure, the improved loss function could reduce the FNR from 2.22% to 0.97% compared with the traditional cross-entropy loss function. The selected regularization coefficient could increase the sensitivity (SE) from 97.78% to 98.35%, and the accuracy (ACC) was 96.62%, which was an increase from 96.49%. The proposed algorithm can reduce the FNR without losing ACC, and reduce the possibility of missed diagnosis to avoid missing the best treatment period. Meanwhile, it provides a universal loss function for the clinical auxiliary diagnosis of other diseases.