Multiclass Classification Based on Combined Motor Imageries

Cecilia Lindig-León (1, 2) , Sébastien Rimbert (1) , Laurent Bougrain (1)

1 NEUROSYS - Analysis and modeling of neural systems by a system neuroscience approach
2 UUlm - University of Ulm

Motor imagery (MI) allows the design of self-paced brain–computer interfaces (BCIs), which can potentially afford an intuitive and continuous interaction. However, the implementation of non-invasive MI-based BCIs with more than three commands is still a difficult task. First, the number of MIs for decoding different actions is limited by the constraint of maintaining an adequate spacing among the corresponding sources, since the electroencephalography (EEG) activity from near regions may add up. Second, EEG generates a rather noisy image of brain activity, which results in a poor classification performance. Here, we propose a solution to address the limitation of identifiable motor activities by using combined MIs (i.e., MIs involving 2 or more body parts at the same time). And we propose two new multilabel uses of the Common Spatial Pattern (CSP) algorithm to optimize the signal-to-noise ratio, namely MC2CMI and MC2SMI approaches. We recorded EEG signals from seven healthy subjects during an 8-class EEG experiment including the rest condition and all possible combinations using the left hand, right hand, and feet. The proposed multilabel approaches convert the original 8-class problem into a set of three binary problems to facilitate the use of the CSP algorithm. In the case of the MC2CMI method, each binary problem groups together in one class all the MIs engaging one of the three selected body parts, while the rest of MIs that do not engage the same body part are grouped together in the second class. In this way, for each binary problem, the CSP algorithm produces features to determine if the specific body part is engaged in the task or not. Finally, three sets of features are merged together to predict the user intention by applying an 8-class linear discriminant analysis. The MC2SMI method is quite similar, the only difference is that any of the combined MIs is considered during the training phase, which drastically accelerates the calibration time. For all subjects, both the MC2CMI and the MC2SMI approaches reached a higher accuracy than the classic pair-wise (PW) and one-vs.-all (OVA) methods. Our results show that, when brain activity is properly modulated, multilabel approaches represent a very interesting solution to increase the number of commands, and thus to provide a better interaction.

Mots clés: brain-computer interface (BCI); combined motor imageries; multilabel classification; common spatialpattern (CSP); electroencephalography (EEG)

Domaines: Neurosciences; Neurosciences [q-bio.NC]; Interface homme-machine [cs.HC]; Machine Learning [stat.ML]; Intelligence artificielle [cs.AI]

Cecilia Lindig-León, Sébastien Rimbert, Laurent Bougrain. Multiclass Classification Based on Combined Motor Imageries. Frontiers in Neuroscience, 2020, 14, ⟨10.3389/fnins.2020.559858⟩. ⟨hal-03013795⟩