In the field of brain-computer interfaces (BCIs) based on functional near-infrared spectroscopy (fNIRS), traditional subject-specific decoding methods suffer from the limitations of long calibration time and low cross-subject generalizability, which restricts the promotion and application of BCI systems in daily life and clinic. To address the above dilemma, this study proposes a novel deep transfer learning approach that combines the revised inception-residual network (rIRN) model and the model-based transfer learning (TL) strategy, referred to as TL-rIRN. This study performed cross-subject recognition experiments on mental arithmetic (MA) and mental singing (MS) tasks to validate the effectiveness and superiority of the TL-rIRN approach. The results show that the TL-rIRN significantly shortens the calibration time, reduces the training time of the target model and the consumption of computational resources, and dramatically enhances the cross-subject decoding performance compared to subject-specific decoding methods and other deep transfer learning methods. To sum up, this study provides a basis for the selection of cross-subject, cross-task, and real-time decoding algorithms for fNIRS-BCI systems, which has potential applications in constructing a convenient and universal BCI system.
Speech imagery is an emerging brain-computer interface (BCI) paradigm with potential to provide effective communication for individuals with speech impairments. This study designed a Chinese speech imagery paradigm using three clinically relevant words—“Help me”, “Sit up” and “Turn over”—and collected electroencephalography (EEG) data from 15 healthy subjects. Based on the data, a Channel Attention Multi-Scale Convolutional Neural Network (CAM-Net) decoding algorithm was proposed, which combined multi-scale temporal convolutions with asymmetric spatial convolutions to extract multidimensional EEG features, and incorporated a channel attention mechanism along with a bidirectional long short-term memory network to perform channel weighting and capture temporal dependencies. Experimental results showed that CAM-Net achieved a classification accuracy of 48.54% in the three-class task, outperforming baseline models such as EEGNet and Deep ConvNet, and reached a highest accuracy of 64.17% in the binary classification between “Sit up” and “Turn over”. This work provides a promising approach for future Chinese speech imagery BCI research and applications.
Aiming at the problem of low recognition accuracy of motor imagery electroencephalogram signal due to individual differences of subjects, an individual adaptive feature representation method of motor imagery electroencephalogram signal is proposed in this paper. Firstly, based on the individual differences and signal characteristics in different frequency bands, an adaptive channel selection method based on expansive relevant features with label F (ReliefF) was proposed. By extracting five time-frequency domain observation features of each frequency band signal, ReliefF algorithm was employed to evaluate the effectiveness of the frequency band signal in each channel, and then the corresponding signal channel was selected for each frequency band. Secondly, a feature representation method of common space pattern (CSP) based on fast correlation-based filter (FCBF) was proposed (CSP-FCBF). The features of electroencephalogram signal were extracted by CSP, and the best feature sets were obtained by using FCBF to optimize the features, so as to realize the effective state representation of motor imagery electroencephalogram signal. Finally, support vector machine (SVM) was adopted as a classifier to realize identification. Experimental results show that the proposed method in this research can effectively represent the states of motor imagery electroencephalogram signal, with an average identification accuracy of (83.0±5.5)% for four types of states, which is 6.6% higher than the traditional CSP feature representation method. The research results obtained in the feature representation of motor imagery electroencephalogram signal lay the foundation for the realization of adaptive electroencephalogram signal decoding and its application.
Brain-computer interface (BCI) has high application value in the field of healthcare. However, in practical clinical applications, convenience and system performance should be considered in the use of BCI. Wearable BCIs are generally with high convenience, but their performance in real-life scenario needs to be evaluated. This study proposed a wearable steady-state visual evoked potential (SSVEP)-based BCI system equipped with a small-sized electroencephalogram (EEG) collector and a high-performance training-free decoding algorithm. Ten healthy subjects participated in the test of BCI system under simplified experimental preparation. The results showed that the average classification accuracy of this BCI was 94.10% for 40 targets, and there was no significant difference compared to the dataset collected under the laboratory condition. The system achieved a maximum information transfer rate (ITR) of 115.25 bit/min with 8-channel signal and 98.49 bit/min with 4-channel signal, indicating that the 4-channel solution can be used as an option for the few-channel BCI. Overall, this wearable SSVEP-BCI can achieve good performance in real-life scenario, which helps to promote BCI technology in clinical practice.
Brain-computer interface (BCI) is a revolutionizing technology that disrupts traditional human-computer interaction by establishing direct communication and control between the brain and computer, bypassing the peripheral nervous and muscular systems. With the rapid advancement of BCI technology, growing application demands, and an increasing need for specialized BCI professionals, a new academic major—BCI major—has gradually emerged. However, few studies to date have discussed the interdisciplinary nature and training framework of this emerging major. To address this gap, this paper first introduced the application demands of BCI, including the demand for BCI technology in both medical and non-medical fields. The paper also described the interdisciplinary nature of the BCI major and the urgent need for specialized professionals in this field. Subsequently, a training program of the BCI major was presented, with careful consideration of the multidisciplinary nature of BCI research and development, along with recommendations for curriculum structure and credit distribution. Additionally, the facing challenges of the construction of the BCI major were analyzed, and suggested strategies for addressing these challenges were offered. Finally, the future of the BCI major was envisioned. It is hoped that this paper will provide valuable reference for the development and construction of the BCI major.
Motor imagery (MI) is a mental process that can be recognized by electroencephalography (EEG) without actual movement. It has significant research value and application potential in the field of brain-computer interface (BCI) technology. To address the challenges posed by the non-stationary nature and low signal-to-noise ratio of MI-EEG signals, this study proposed a Riemannian spatial filtering and domain adaptation (RSFDA) method for improving the accuracy and efficiency of cross-session MI-BCI classification tasks. The approach addressed the issue of inconsistent data distribution between source and target domains through a multi-module collaborative framework, which enhanced the generalization capability of cross-session MI-EEG classification models. Comparative experiments were conducted on three public datasets to evaluate RSFDA against eight existing methods in terms of classification accuracy and computational efficiency. The experimental results demonstrated that RSFDA achieved an average classification accuracy of 79.37%, outperforming the state-of-the-art deep learning method Tensor-CSPNet (76.46%) by 2.91% (P < 0.01). Furthermore, the proposed method showed significantly lower computational costs, requiring only approximately 3 minutes of average training time compared to Tensor-CSPNet’s 25 minutes, representing a reduction of 22 minutes. These findings indicate that the RSFDA method demonstrates superior performance in cross-session MI-EEG classification tasks by effectively balancing accuracy and efficiency. However, its applicability in complex transfer learning scenarios remains to be further investigated.
Patients with amyotrophic lateral sclerosis ( ALS ) often have difficulty in expressing their intentions through language and behavior, which prevents them from communicating properly with the outside world and seriously affects their quality of life. The brain-computer interface (BCI) has received much attention as an aid for ALS patients to communicate with the outside world, but the heavy device causes inconvenience to patients in the application process. To improve the portability of the BCI system, this paper proposed a wearable P300-speller brain-computer interface system based on the augmented reality (MR-BCI). This system used Hololens2 augmented reality device to present the paradigm, an OpenBCI device to capture EEG signals, and Jetson Nano embedded computer to process the data. Meanwhile, to optimize the system’s performance for character recognition, this paper proposed a convolutional neural network classification method with low computational complexity applied to the embedded system for real-time classification. The results showed that compared with the P300-speller brain-computer interface system based on the computer screen (CS-BCI), MR-BCI induced an increase in the amplitude of the P300 component, an increase in accuracy of 1.7% and 1.4% in offline and online experiments, respectively, and an increase in the information transfer rate of 0.7 bit/min. The MR-BCI proposed in this paper achieves a wearable BCI system based on guaranteed system performance. It has a positive effect on the realization of the clinical application of BCI.
Neurofeedback (NF) technology based on electroencephalogram (EEG) data or functional magnetic resonance imaging (fMRI) has been widely studied and applied. In contrast, functional near infrared spectroscopy (fNIRS) has become a new technique in NF research in recent years. fNIRS is a neuroimaging technology based on hemodynamics, which has the advantages of low cost, good portability and high spatial resolution, and is more suitable for use in natural environments. At present, there is a lack of comprehensive review on fNIRS-NF technology (fNIRS-NF) in China. In order to provide a reference for the research of fNIRS-NF technology, this paper first describes the principle, key technologies and applications of fNIRS-NF, and focuses on the application of fNIRS-NF. Finally, the future development trend of fNIRS-NF is prospected and summarized. In conclusion, this paper summarizes fNIRS-NF technology and its application, and concludes that fNIRS-NF technology has potential practicability in neurological diseases and related fields. fNIRS can be used as a good method for NF training. This paper is expected to provide reference information for the development of fNIRS-NF technology.
This paper realized a portable brain-computer interface (BCI) system tailored for smart healthcare. Through the decoding of steady-state visual evoked potential (SSVEP), this system can rapidly and accurately identify the intentions of subjects, thereby meeting the practical demands of daily medical scenarios. Firstly, an SSVEP stimulation interface and an electroencephalogram (EEG) signal acquisition software were designed, which enable the system to execute multi-target and multi-task operations while also incorporating data visualization functionality. Secondly, the EEG signals recorded from the occipital region were decomposed into eight sub-frequency bands using filter bank canonical correlation analysis (FBCCA). Subsequently, the similarity between each sub-band signal and the reference signals was computed to achieve efficient SSVEP decoding. Finally, 15 subjects were recruited to participate in the online evaluation of the system. The experimental results indicated that in real-world scenarios, the system achieved an average accuracy of 85.19% in identifying the intentions of the subjects, and an information transfer rate (ITR) of 37.52 bit/min. This system was awarded third prize in the Visual BCI Innovation Application Development competition at the 2024 World Robot Contest, validating its effectiveness. In conclusion, this study has developed a portable, multifunctional SSVEP online decoding system, providing an effective approach for human-computer interaction in smart healthcare.
The electroencephalogram (EEG) signal is the key signal carrier of the brain-computer interface (BCI) system. The EEG data collected by the whole-brain electrode arrangement is conducive to obtaining higher information representation. Personalized electrode layout, while ensuring the accuracy of EEG signal decoding, can also shorten the calibration time of BCI and has become an important research direction. This paper reviews the EEG signal channel selection methods in recent years, conducts a comparative analysis of the combined effects of different channel selection methods and different classification algorithms, obtains the commonly used channel combinations in motor imagery, P300 and other paradigms in BCI, and explains the application scenarios of the channel selection method in different paradigms are discussed, in order to provide stronger support for a more accurate and portable BCI system.