Brain-computer interface (BCI) has great potential to replace lost upper limb function. Thus, there has been great interest in the development of BCI-controlled robotic arm. However, few studies have attempted to use noninvasive electroencephalography (EEG)-based BCI to achieve high-level control of a robotic arm. In this paper, a high-level control architecture combining augmented reality (AR) BCI and computer vision was designed to control a robotic arm for performing a pick and place task. A steady-state visual evoked potential (SSVEP)-based BCI paradigm was adopted to realize the BCI system. Microsoft's HoloLens was used to build an AR environment and served as the visual stimulator for eliciting SSVEPs. The proposed AR-BCI was used to select the objects that need to be operated by the robotic arm. The computer vision was responsible for providing the location, color and shape information of the objects. According to the outputs of the AR-BCI and computer vision, the robotic arm could autonomously pick the object and place it to specific location. Online results of 11 healthy subjects showed that the average classification accuracy of the proposed system was 91.41%. These results verified the feasibility of combing AR, BCI and computer vision to control a robotic arm, and are expected to provide new ideas for innovative robotic arm control approaches.
Error related negativity (ERN) is generated in frontal and central cortical regions when individuals perceive errors. Because ERN has low signal-to-noise ratio and large individual difference, it is difficult for single trial ERN recognition. In current study, the optimized electroencephalograph (EEG) channels were selected based on the brain topography of ERN activity and ERN offline recognition rate, and the optimized EEG time segments were selected based on the ERN offline recognition rate, then the low frequency time domain and high frequency time-frequency domain features were analyzed based on wavelet transform, after which the ERN single detection algorithm was proposed based on the above procedures. Finally, we achieved average recognition rate of 72.0% ± 9.6% in 10 subjects by using the sample points feature in 0~3.9 Hz and the power and variance features in 3.9~15.6 Hz from the EEG segments of 200~600 ms on the selected 6 channels. Our work has the potential to help the error command real-time correction technique in the application of online brain-computer interface system.
In the research of non-invasive brain-computer interface (BCI), independent component analysis (ICA) has been considered as a promising method of electroencephalogram (EEG) preprocessing and feature enhancement. However, there have been few investigations and implements about online ICA-BCI system up till now. This paper reports the investigation of the ICA-based motor imagery BCI (MIBCI) system, combining the characteristics of unsupervised learning of ICA and event-related desynchronization (ERD) related to motor imagery. We constructed a simple and practical method of ICA spatial filter calculation and discriminate criterion of three-type motor imageries in the study. To validate the online performance of proposed algorithms, an ICA-MIBCI experimental system was fully established based on NeuroScan EEG amplifier and VC++ platform. Four subjects participated in the experiment of MIBCI testing and two of them took part in the online experiment. The average classification accuracies of the three-type motor imageries reached 89.78% and 89.89% in the offline and online testing, respectively. The experimental results showed that the proposed algorithm produced high classification accuracy and required less time consumption, which would have a prospect of cross platform application.
Brain–computer interface (BCI) technology enable humans to interact with external devices by decoding their brain signals. Despite it has made some significant breakthroughs in recent years, there are still many obstacles in its applications and extensions. The current used BCI control signals are generally derived from the brain areas involved in primary sensory- or motor-related processing. However, these signals only reflect a limited range of limb movement intention. Therefore, additional sources of brain signals for controlling BCI systems need to be explored. Brain signals derived from the cognitive brain areas are more intuitive and effective. These signals can be used for expand the brain signal sources as a new approach. This paper reviewed the research status of cognitive BCI based on the single brain area and multiple hybrid brain areas, and summarized its applications in the rehabilitation medicine. It’s believed that cognitive BCI technologies would become a possible breakthrough for future BCI rehabilitation applications.
Individual differences of P300 potentials lead to that a large amount of training data must be collected to construct pattern recognition models in P300-based brain-computer interface system, which may cause subjects’ fatigue and degrade the system performance. TrAdaBoost is a method that transfers the knowledge from source area to target area, which improves learning effect in the target area. Our research purposed a TrAdaBoost-based linear discriminant analysis and a TrAdaBoost-based support vector machine to recognize the P300 potentials across multiple subjects. This method first trains two kinds of classifiers separately by using the data deriving from a small amount of data from same subject and a large amount of data from different subjects. Then it combines all the classifiers with different weights. Compared with traditional training methods that use only a small amount of data from same subject or mixed different subjects’ data to directly train, our algorithm improved the accuracies by 19.56% and 22.25% respectively, and improved the information transfer rate of 14.69 bits/min and 15.76 bits/min respectively. The results indicate that the TrAdaBoost-based method has the potential to enhance the generalization ability of brain-computer interface on the individual differences.
Using electroencephalogram (EEG) signal to control external devices has always been the research focus in the field of brain-computer interface (BCI). This is especially significant for those disabilities who have lost capacity of movements. In this paper, the P300-based BCI and the microcontroller-based wireless radio frequency (RF) technology are utilized to design a smart home control system, which can be used to control household appliances, lighting system, and security devices directly. Experiment results showed that the system was simple, reliable and easy to be populirised.
This paper aims to realize the decoding of single trial motor imagery electroencephalogram (EEG) signal by extracting and classifying the optimized features of EEG signal. In the classification and recognition of multi-channel EEG signals, there is often a lack of effective feature selection strategies in the selection of the data of each channel and the dimension of spatial filters. In view of this problem, a method combining sparse idea and greedy search (GS) was proposed to improve the feature extraction of common spatial pattern (CSP). The improved common spatial pattern could effectively overcome the problem of repeated selection of feature patterns in the feature vector space extracted by the traditional method, and make the extracted features have more obvious characteristic differences. Then the extracted features were classified by Fisher linear discriminant analysis (FLDA). The experimental results showed that the classification accuracy obtained by proposed method was 19% higher on average than that of traditional common spatial pattern. And high classification accuracy could be obtained by selecting feature set with small size. The research results obtained in the feature extraction of EEG signals lay the foundation for the realization of motor imagery EEG decoding.
The traditional paradigm of motor-imagery-based brain-computer interface (BCI) is abstract, which cannot effectively guide users to modulate brain activity, thus limiting the activation degree of the sensorimotor cortex. It was found that the motor imagery task of Chinese characters writing was better accepted by users and helped guide them to modulate their sensorimotor rhythms. However, different Chinese characters have different writing complexity (number of strokes), and the effect of motor imagery tasks of Chinese characters with different writing complexity on the performance of motor-imagery-based BCI is still unclear. In this paper, a total of 12 healthy subjects were recruited for studying the effects of motor imagery tasks of Chinese characters with two different writing complexity (5 and 10 strokes) on the performance of motor-imagery-based BCI. The experimental results showed that, compared with Chinese characters with 5 strokes, motor imagery task of Chinese characters writing with 10 strokes obtained stronger sensorimotor rhythm and better recognition performance (P < 0.05). This study indicated that, appropriately increasing the complexity of the motor imagery task of Chinese characters writing can obtain stronger motor imagery potential and improve the recognition accuracy of motor-imagery-based BCI, which provides a reference for the design of the motor-imagery-based BCI paradigm in the future.
The development and potential application of brain-computer interface (BCI) technology is closely related to the human brain, so that the ethical regulation of BCI has become an important issue attracting the consideration of society. Existing literatures have discussed the ethical norms of BCI technology from the perspectives of non-BCI developers and scientific ethics, while few discussions have been launched from the perspective of BCI developers. Therefore, there is a great need to study and discuss the ethical norms of BCI technology from the perspective of BCI developers. In this paper, we present the user-centered and non-harmful BCI technology ethics, and then discuss and look forward on them. This paper argues that human beings can cope with the ethical issues arising from BCI technology, and as BCI technology develops, its ethical norms will be improved continuously. It is expected that this paper can provide thoughts and references for the formulation of ethical norms related to BCI technology.
Brain-computer interface (BCI) provides a direct communicating and controlling approach between the brain and surrounding environment, which attracts a wide range of interest in the fields of brain science and artificial intelligence. It is a core to decode the electroencephalogram (EEG) feature in the BCI system. The decoding efficiency highly depends on the feature extraction and feature classification algorithms. In this paper, we first introduce the commonly-used EEG features in the BCI system. Then we introduce the basic classical algorithms and their advanced versions used in the BCI system. Finally, we present some new BCI algorithms proposed in recent years. We hope this paper can spark fresh thinking for the research and development of high-performance BCI system.