Introduction
As an unconventional communication pathway, brain computer interface (BCI) enables us to communicate with a computer or with other external devices without any muscular stimulation. Although the primitive goal of developing BCI was to assist physically disabled people experiencing motor function abnormalities, recent technological advancements augment BCI in many other applications, including lie detection [], brain fingerprinting [], mood assessment [] and gaming []. Most of the proposed BCIs are subject-specific and require time-consuming, sometimes frustrating calibration sessions. Thus, inter-subject BCIs are desired; yet development of such BCIs come across challenges including the inherent variabilities in brain dynamics across subjects due to the diversity in individual brain growth []. Moreover, multichannel electroencephalogram (EEG) that captures the electrical activity of the brain, suffers from the effect of outliers due to excessive channels, causing, at the same time, high computational burden to the BCI system. However, developing an inter-subject BCI with subjects who share associative neural oscillations for particular cognitive task, seems more feasible. Previous studies addressed inter-subject association of neural dynamics during natural vision [] and natural music listening []. During motor imagery (MI)-based inter-subject BCI, it is important to measure sensorimotor synchronisation across subjects. MI is the kinesthetic imagination of a motor task, which shares equivalent sensorimotor oscillations corresponding to actual motor execution []. Movement-related cortical potential-based BCI without subject-specific training has been proposed in []. In [], an inter-subject BCI has been developed for modifying mental states that can be used for treating major depressive disorder. Rana et al. [] have developed a real-time toolbox for implementing inter- and intra-subject BCI using functional magnetic resonance imaging. An online inter-subject BCI with P300 speller paradigm has shown the deviation of inter-subject evoked potentials []. Learning from subspaces that have been estimated via common spatial pattern (CSP) applied on inter-subject/session data of similar characteristics, i.e. non-stationarities, can enhance the performance of BCI []. In these experiments, selecting suitable subjects is critical due to the fact that the brain dynamics significantly vary across subjects. However, these methods perform well, specifically in the context of small training trials available from the target subject []. Another study has proposed ensemble of classifiers, which can be used for single-trial classification without explicitly being trained []. In [], sparse common spatial pattern is proposed as a novel method for optimal channel selection technique within a constraint of optimal classification accuracy. In this Letter, a coherence analysis in time–frequency (T–F) space is proposed to select the set of EEG channels, who have relatively high normalised coherence power. The underlying hypothesis is that highly coherent and common inter-subject EEG channels can improve BCI performances, by reducing the effect of outliers from undesired channels. To achieve this, the wavelet coherence (WC) has been adopted as a means to measure coherence between two time series in T–F domain, since it has successfully being used as a tool of measuring couplings between brain regions using sensory-evoked potentials [] and to the associativity assessment of inter-personal brain activity [].
Methods
At first, the available multichannel EEG data (Section 2.1) were preprocessed using CSP []. Then, wavelet decomposition (up to the third level) was applied, using the Daubechies three-sample filter (db3). At each decomposition level, subband energy and subband entropy were used as features for the classification of the MI types, which was realised via a two-layer feed-forward neural network [] and used to classify MIs.
WC was estimated to discern if the coherent power reveals common inter-subject regions, where the sensorimotor oscillations from two subjects co-vary. Based on the WC power (WCP), some channels were selected assuming that those channels will enhance the T–F synchronisation of two subjects. Then, a novel inter-subject BCI framework was proposed with a view to validate whether selected channels can improve the classification performances. The motivation behind was to eliminate undesired channels which introduce outliers. On the contrary, selected channels enhance sensorimotor coherence; thus, the pairwise inter-subject BCI performances.
Dataset and experimental settings
The multichannel EEG raw signals used for the validation of the proposed hypothesis are those included in the dataset IVa from BCI Competition III (). One hundred and eighteen channels in total (extended 10/20 system) were employed to capture the multichannel EEG signals (Fig. ). During the recording session, the sampling rate was set at 1kHz, which was later downsampled to 100 Hz. While sitting on a comfortable chair with arms resting on armrests, subjects were asked to perform each one of the three MIs, i.e. left hand, right hand (RH) and right foot (RF); the publicly provided data, however, refer to two MI classes only, i.e. RH and RF. Single-trial EEG data were captured from five healthy individuals, by providing them class-specific visual cues before the kinesthetic imagination of the motor tasks. The data consist of 280 trials (140 trials for each MI class) for each subject and each trial has 3.5 s of EEG recordings for any of the two MIs. It should be noted that 2.5 s of data for each trial after 1 s of the corresponding visual cues were chosen for analysis.
[IMAGE OMITTED. SEE PDF]
The proposed BCI framework is studied in pairwise manner, i.e. signals from one subject are used to train and validate the algorithm whereas signals from another subject are used to test the algorithm. Thus, there are total of 560 trials for experimenting inter-subject BCI. The first 180 trials are used to train the classifier, whereas the consecutive 100 trials are used to validate it, so to avoid over-fitting. Finally, the rest 280 trials from another subject are used to test the classifier.
Common spatial pattern
In 2000, Ramoser et al. proposed CSP, as a spatial filtering method, for classifying two classes of single-trial MIs for the first instance []. Usually, CSP estimates projection of multichannel EEG signal, so that the difference between two classes is maximised. Suppose and represent the two MIs, i.e. RH and RF, respectively, which have been considered in this experiment. Then, CSP approximates a weight matrix W that can be used to filter simultaneously recorded multichannel data. Estimating W requires simultaneous diagonalisation of two covariance matrices for two classes as follows
Finally, the original EEG signals can be projected as
Wavelet coherence and channel selection
Suppose x(t) represents a time-domain signal, where . Then, the continuous wavelet transform is defined as []
is the cross wavelet transform (XWT) which finds the T–F regions where two signals co-vary, but have high power in contrast to WC. Suppose and are two time signals (where n = 1, 2, …, N), then the XWT is defined as
WC reveals associativity of two time-domain signals in T–F spaces. This similarity measure finds the T–F locations where the signals significantly co-vary, but does not necessarily have high power. The WC is defined as follows []
[IMAGE OMITTED. SEE PDF]
The single-trial EEG signals from two subjects have been considered as two sets. From each set, the trials are further categorised according to classes, i.e. RH or RF. Consider S1 and S2 as two individuals, each having total M trials and M/2 trials for each class. The WC has been applied to measure similarities of M/2 trials from S1 with M/2 trials from S2 one by one. The WCP is normalised to 1 and thus the average WCP ranges from 0 to 1. The accumulated WCP over trials are averaged and denoted as , given by
Finally, the estimated is used to rank the channels in descending order. Eight channels were selected for each class, accumulating to 16 channels for two classes. If any channel falls within the selection criteria for both classes, we have selected another channel with higher either for RH or RF, thus limiting the number of selected channels to 16. The selected channels are specified in Table .
Table 1 Selected associative inter-subject channels for different subject pairs along with corresponding WCPN
S1–S2 | Selected channels |
aa-al | RHC1(0.207) CCP3(0.203) P1(0.201) FFC8(0.201) FFC7(0.201) F7(0.200) FT10(0.200) Pz(0.200) PCP1(0.199) RFCCP8(0.210) C6(0.207) O1(0.204) T8(0.201) Oz(0.199) C1(0.199) FT10(0.199) PCP8(0.199) PO4(0.199) |
aa-av | RHP7(0.203) PPO7(0.202) P6(0.201) CP6(0.201) F6(0.201) Fz(0.201) PCP7(0.200) P9(0.200) RFCP3(0.203) FT8(0.201) FC2(0.201) CFC1(0.200) C6(0.200) OI2(0.200) FC4(0.200) CCP6(0.199) |
aa-aw | RHCFC3(0.195) FT10(0.194) CFC6(0.194) CCP5(0.193) CCP8(0.193) CCP1(0.192) C6(0.192) PCP1(0.191) RFCP4(0.210) C1(0.207) PCP1(0.207) PCP2(0.207) PCP4(0.207) CP6(0.207) FFC2(0.207) Fz(0.205) PCP3(0.205) |
aa-ay | RHI2(0.202) PO7(0.202) I1(0.201) P1(0.201) P9(0.201) PO2(0.200) P10(0.199) P2(0.199) PCP2(0.199) RFCP1(0.206) CPz(0.206) CCP2(0.204) Cz(0.203) T7(0.203) CCP1(0.202) P9(0.202) P1(0.202) PCP1(0.202) |
al-av | RHCz(0.196) CFC8(0.195) FC6(0.195) TP9(0.194) TP10(0.192) P10(0.192) PPO8(0.192) C4(0.192) RFPCP3(0.212) CP1(0.212) P3(0.211) O1(0.210) OI1(0.209) P1(0.208) P5(0.207) P3P4(0.207) |
al-aw | RHFC5(0.206) FFC5(0.205) PCP4(0.204) C5(0.203) CP2(0.203) PCP5(0.202) CP3(0.202) FC3(0.202) P4(0.201) RFP1(0.218) PCP3(0.215) CP3(0.213) CP2(0.212) PO3(0.212) P3(0.212) CP1(0.211) P5(0.209) PCP2(0.209) |
al-ay | RHOz(0.219) PO1(0.217) OPO1(0.215) PO2(0.214) PPO1(0.213) PO3(0.213) PPO2(0.212) OI2(0.212) RFO1(0.209) PPO6(0.206) PCP3(0.205) CP3(0.205) I1(0.205) PCP5(0.204) OI1(0.204) CP5(0.203) |
av-aw | RHP5(0.197) PCP7(0.197) CCP5(0.196) P9(0.195) CP1(0.195) FT7(0.195) PPO5(0.195) PCP5(0.194) P3(0.194) RFCCP5(0.209) C3(0.204) CFC6(0.204) C1(0.204) FC6(0.202) CP1(0.202) CCP3(0.201) FC3(0.201) CP3(0.200) |
av-ay | RHI2(0.198) OPO1(0.196) I1(0.196) FAF5(0.194) PPO8(0.194) FT8(0.193) FFC7(0.193) OI1(0.193) RFCCP8(0.205) T8(0.204) CP5(0.204) C6(0.202) FAF6(0.202) CFC6(0.202) CCP6(0.201) PCP8(0.201) |
aw-ay | RHPCP1(0.209) CCP3(0.207) PCP3(0.207) Pz(0.207) CP3(0.206) P1(0.206) CPz(0.206) P5(0.202) RFT7(0.213) CFC7(0.210) OPO1(0.206) CCP7(0.204) P7(0.203) Oz(0.203) FT9(0.203) FT7(0.202) |
Results and discussions
Table summarises the sets of mostly coherent channels for all subject pairs. The channels are reported according to values in descending order. Each set consists of sixteen different channels from different areas of the brain, where the inter-subject sensorimotor oscillations are mostly associative in T–F space. The common channels which fall within selection criteria for both RH and RF are indicated as bold. Fig. shows the selected channels (electrode montages) for subject pair al-aw, most of which lie around sensorimotor regions of the brain. Sensorimotor regions are highly responsive during MIs [] and share associative inter-subject information.
Table describes the classification accuracies achieved from inter-subject experiments. In Case I, available 118 channels are used to classify the MIs while only 16 channels, reported in Table , are used in Case II. Let's consider, and represent classification accuracies achieved from Case I and Case II, respectively. The trials from subject S1 are used to train and validate the classifier while the trials from S2 are used to test the classifier. indicates the increased classification performances of inter-subject BCI by using associative channels only. However, the maximum classification accuracy achieved for subject pair aw-al is . But, the classification accuracy for this subject pair in Case I is . Interestingly, evinces the potential applicability of the proposed channel selection method. Also, the classification performances are not symmetric, i.e. interchanging of training and testing trials significantly influences the performances. For example, and etc. The achieved classification accuracy is significantly lower than . Such asymmetric Acc occurs, due to the fact that data-driven spatial filtering methods are prone to be overfitted while estimating unreliable parameters []. Although there are significant observations in which , some do not necessarily show any promising performance in any of the case. The cases in which are italicised in Table .
Table 2 Classification accuracies (%): inter-subject BCI (The cases in which Acc (S1 → S2) Case I < Acc (S1 → S2) Case II are italicised.)
S1–S2 | Case I | Case II | S1–S2 | Case I | Case II |
aa-al | 60.71 | 76.79 | al-aa | 56.43 | 57.14 |
aa-av | 56.79 | 57.86 | av-aa | 53.57 | 61.07 |
aa-aw | 57.86 | 65.36 | aw-aa | 62.86 | 51.43 |
aa-ay | 58.21 | 51.43 | ay-aa | 50.36 | 49.64 |
al-av | 49.64 | 47.14 | av-al | 70.71 | 54.29 |
al-aw | 69.64 | 73.93 | aw-al | 56.79 | 81.79 |
al-ay | 63.57 | 76.79 | ay-al | 67.50 | 67.50 |
av-aw | 55.71 | 52.14 | aw-av | 53.57 | 50.36 |
av-ay | 62.14 | 57.50 | ay-av | 51.79 | 53.21 |
aw-ay | 63.21 | 53.57 | ay-aw | 52.50 | 64.29 |
mean | 59.75 | 61.25 | mean | 57.61 | 59.07 |
Many time variant psychophysiological factors including attention, memory load, spontaneous cognitive processes etc. [] and user's basic characteristics, such as lifestyle, gender, age etc. influence the individual brain dynamics over time [], thus affect BCI performance. This inherent fluctuation of individual brain dynamics causes inter-subject variability that poses difficulties while developing BCI without subject-specific calibration. In EEG-based BCI, undesired channels additionally degrade performances by producing outliers []. Fig. shows both highly associative and dissociative inter-subject sensorimotor oscillations and their corresponding WC. In this Letter, a novel T–F approach has been proposed to sort out associative sensorimotor inter-subject channels while most of the literatures have addressed the adaptation of machine learning algorithms for compensating variabilities []. Results show that selecting inter-subject coherent channels can significantly increase performances, thus implicating future development of efficient inter-subject BCI paradigm. An interesting aspect that arises from the proposed approach is the possibility to generalise it towards finding common spatial components (i.e. a subspace of the data) instead of selecting individual electrodes; yet, this is left as a future endeavour.
Conclusions
Inter-subject BCI, without time-consuming, sometimes frustrating calibration session, seems more convenient to users. Nevertheless, inherent instantaneous variability in EEG signals poses significant challenges. Outliers that have been generated within insignificant channels may be due to diversity in psychophysiological or other factors, limit the development of BCI in subject independent context. Interestingly, the only channels which share similar sensorimotor dynamics can be employed for improving BCI performance. This study delineates a novel method for selecting inter-subject associative channels based on WC and show how BCI performances can be improved in subject independent settings.
Acknowledgment
The authors thank the organisers of BCI Competition III for publicly availing the dataset.
Funding and declaration of interests
Conflict of interest: none declared.
Wang, H., Chang, W., Zhang, C.: ‘Functional brain network and multichannel analysis for the P300‐based brain computer interface system of lying detection’, Expert Syst. Appl., 2016, 53, pp. 117–128 (doi:
Farwell, L., Richardson, D., Richardson, G., et al.,: ‘Brain fingerprinting classification concealed information test detects US Navy military medical information with P300’, Front. Neurosci., 2014, 8, p. 410 (doi:
Ortiz Carreon, F., Gonzalez Serna, J., Montes Rendon, A., et al.,: ‘Induction of emotional states in people with disabilities through film clips using brain computer interfaces’, IEEE Latin Am. Trans., 2016, 14, (2), pp. 563–568 (doi:
van de Laar, B., Gurkok, H., Plass‐Oude Bos, D., et al.,: ‘Experiencing BCI control in a popular computer game’, IEEE Trans. Comput. Intell. AI Games, 2013, 5, (2), pp. 176–184 (doi:
Giedd, J., Rapoport, J.: ‘Structural MRI of pediatric brain development: what have we learned and where are we going?’, Neuron, 2010, 67, (5), pp. 728–734 (doi:
Hasson, U.: ‘Intersubject synchronization of cortical activity during natural vision’, Science, 2004, 303, (5664), pp. 1634–1640 (doi:
Abrams, D., Ryali, S., Chen, T., et al.,: ‘Inter‐subject synchronization of brain responses during natural music listening’, Eur. J. Neurosci., 2013, 37, (9), pp. 1458–1469 (doi:
Jeannerod, M.: ‘Mental imagery in the motor context’, Neuropsychologia, 1995, 33, (11), pp. 1419–1432 (doi:
Niazi, I., Jiang, N., Jochumsen, M., et al.,: ‘Detection of movement‐related cortical potentials based on subject‐independent training’, Med. Biol. Eng. Comput., 2013, 51, (5), pp. 507–512 (doi:
Ray, A., Sitaram, R., Rana, M., et al.,: ‘A subject‐independent pattern‐based brain‐computer interface’, Front. Behav. Neurosci., 2015, 9, p. 269 (doi:
Rana, M., Gupta, N., Dalboni Da Rocha, J., et al.,: ‘A toolbox for real‐time subject‐independent and subject‐dependent classification of brain states from fMRI signals’, Front. Neurosci., 2013, 7, p. 170 (doi:
Lu, S., Guan, C., Zhang, H.: ‘Unsupervised brain computer interface based on intersubject information and online adaptation’, IEEE Trans. Neural Syst. Rehabil. Eng., 2009, 17, (2), pp. 135–145 (doi:
Samek, W., Meinecke, F., Muller, K.: ‘Transferring subspaces between subjects in brain–computer interfacing’, IEEE Trans. Biomed. Eng., 2013, 60, (8), pp. 2289–2298 (doi:
Samek, W., Kawanabe, M., Muller, K.: ‘Divergence‐based framework for common spatial patterns algorithms’, IEEE Rev. Biomed. Eng., 2014, 7, pp. 50–72 (doi:
Lotte, F., Guan, C.: ‘Learning from other subjects helps reducing Brain‐Computer Interface calibration time’. 2010 IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Dallas, TX, 2010, pp. 614–617
Devlaminck, D., Wyns, B., Grosse‐Wentrup, M., et al.,: ‘Multisubject learning for common spatial patterns in motor‐imagery BCI’, Comput. Intell. Neurosci., 2011, 2011, pp. 1–9 (doi:
Fazli, S., Popescu, F., Danóczy, M., et al.,: ‘Subject‐independent mental state classification in single trials’, Neural Netw., 2009, 22, (9), pp. 1305–1312 (doi:
Arvaneh, M., Guan, C., Ang, K.K., et al.,: ‘Optimizing the channel selection and classification accuracy in EEG‐based BCI’, IEEE Trans. Biomed. Eng., 2011, 58, (6), pp. 1865–1873 (doi:
Klein, A., Sauer, T., Jedynak, A., et al.,: ‘Conventional and wavelet coherence applied to sensory–evoked electrical brain activity’, IEEE Trans. Biomed. Eng., 2006, 53, (2), pp. 266–272 (doi:
Cui, X., Bryant, D., Reiss, A.: ‘NIRS‐based hyperscanning reveals increased interpersonal coherence in superior frontal cortex during cooperation’, NeuroImage, 2012, 59, (3), pp. 2430–2437 (doi:
Ramoser, H., Muller‐Gerking, J., Pfurtscheller, G.: ‘Optimal spatial filtering of single trial EEG during imagined hand movement’, IEEE Trans. Rehabil. Eng., 2000, 8, (4), pp. 441–446 (doi:
Svozil, D., Kvasnicka, V., Pospichal, J.: ‘Introduction to multi‐layer feed‐forward neural networks’, Chemometr. Intell. Lab. Syst., 1997, 39, (1), pp. 43–62 (doi:
Addison, P.: ‘The illustrated wavelet transform handbook’ (Institute of Physics Publication, Bristol, UK, 2002)
Grinsted, A., Moore, J., Jevrejeva, S.: ‘Application of the cross wavelet transform and wavelet coherence to geophysical time series’, Nonlin. Processes Geophys., 2004, 11, (56), pp. 561–566 (doi:
Zich, C., Debener, S., Kranczioch, C., et al.,: ‘Real‐time EEG feedback during simultaneous EEG–fMRI identifies the cortical signature of motor imagery’, NeuroImage, 2015, 114, pp. 438–447 (doi:
Sannelli, C., Vidaurre, C., Müller, K., et al.,: ‘Ensembles of adaptive spatial filters increase BCI performance: an online evaluation’, J. Neural Eng., 2016, 13, (4), p. 046003 (doi:
GonÃğalves, S., de Munck, J., Pouwels, P., et al.,: ‘Correlating the alpha rhythm to BOLD using simultaneous EEG/fMRI: inter‐subject variability’, NeuroImage, 2006, 30, (1), pp. 203–213 (doi:
Ahn, M., Jun, S.: ‘Performance variation in motor imagery brain–computer interface: a brief review’, J. Neurosci. Methods, 2015, 243, pp. 103–110 (doi:
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2017. This work is published under http://creativecommons.org/licenses/by/3.0/ (the "License"). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
Electroencephalography (EEG) captures electrophysiological signatures of cortical events from the scalp with high‐dimensional electrode montages. Usually, excessive sources produce outliers and potentially affect the actual event related sources. Besides, EEG manifests inherent inter‐subject variability of the brain dynamics, at the resting state and/or under the performance of task(s), caused probably due to the instantaneous fluctuation of psychophysiological states. A wavelet coherence (WC) analysis for optimally selecting associative inter‐subject channels is proposed here and is being used to boost performances of motor imagery (MI)‐based inter‐subject brain computer interface (BCI). The underlying hypothesis is that optimally associative inter‐subject channels can reduce the effects of outliers and, thus, eliminate dissimilar cortical patterns. The proposed approach has been tested on the dataset IVa from BCI competition III, including EEG data acquired from five healthy subjects who were given visual cues to perform 280 trials of MI for the right hand and right foot. Experimental results have shown increased classification accuracy (81.79%) using the WC‐based selected 16 channels compared to the one (56.79%) achieved using all the available 118 channels. The associative channels lie mostly around the sensorimotor regions of the brain, reinforced by the previous literature, describing spatial brain dynamics during sensorimotor oscillations. Apparently, the proposed approach paves the way for optimised EEG channel selection that could boost further the efficiency and real‐time performance of BCI systems.
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details

1 Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
2 Biomedical Engineering Department, Khalifa University of Science, Technology and Research, Abu Dhabi, UAE
3 Department of Electrical and Computer Engineering, Khalifa University of Science, Technology and Research, Abu Dhabi, UAE