1
|
Karimi R, Mohammadi A, Asif A, Benali H. DF-SSmVEP: Dual Frequency Aggregated Steady-State Motion Visual Evoked Potential Design with Bifold Canonical Correlation Analysis. SENSORS (BASEL, SWITZERLAND) 2022; 22:2568. [PMID: 35408182 PMCID: PMC9003394 DOI: 10.3390/s22072568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/20/2022] [Revised: 03/19/2022] [Accepted: 03/23/2022] [Indexed: 06/14/2023]
Abstract
Recent advancements in Electroencephalographic (EEG) sensor technologies and signal processing algorithms have paved the way for further evolution of Brain Computer Interfaces (BCI) in several practical applications, ranging from rehabilitation systems to smart consumer technologies. When it comes to Signal Processing (SP) for BCI, there has been a surge of interest on Steady-State motion Visual Evoked Potentials (SSmVEP), where motion stimulation is used to address key issues associated with conventional light flashing/flickering. Such benefits, however, come with the price of being less accurate and having a lower Information Transfer Rate (ITR). From this perspective, this paper focuses on the design of a novel SSmVEP paradigm without using resources such as trial time, phase, and/or number of targets to enhance the ITR. The proposed design is based on the intuitively pleasing idea of integrating more than one motion within a single SSmVEP target stimuli, simultaneously. To elicit SSmVEP, we designed a novel and innovative dual frequency aggregated modulation paradigm, called the Dual Frequency Aggregated Steady-State motion Visual Evoked Potential (DF-SSmVEP), by concurrently integrating "Radial Zoom" and "Rotation" motions in a single target without increasing the trial length. Compared to conventional SSmVEPs, the proposed DF-SSmVEP framework consists of two motion modes integrated and shown simultaneously each modulated by a specific target frequency. The paper also develops a specific unsupervised classification model, referred to as the Bifold Canonical Correlation Analysis (BCCA), based on two motion frequencies per target. The corresponding covariance coefficients are used as extra features improving the classification accuracy. The proposed DF-SSmVEP is evaluated based on a real EEG dataset and the results corroborate its superiority. The proposed DF-SSmVEP outperforms its counterparts and achieved an average ITR of 30.7 ± 1.97 and an average accuracy of 92.5 ± 2.04, while the Radial Zoom and Rotation result in average ITRs of 18.35 ± 1 and 20.52 ± 2.5, and average accuracies of 68.12 ± 3.5 and 77.5 ± 3.5, respectively.
Collapse
Affiliation(s)
- Raika Karimi
- Department of Electrical and Computer Engineering, Concordia University, 1455 De Maisonneuve Blvd. W. EV-009.187, Montreal, QC H3G 1M8, Canada; (R.K.); (H.B.)
| | - Arash Mohammadi
- Department of Electrical and Computer Engineering, Concordia University, 1455 De Maisonneuve Blvd. W. EV-009.187, Montreal, QC H3G 1M8, Canada; (R.K.); (H.B.)
- Concordia Institute for Information System Engineering, Concordia University, 1455 De Maisonneuve Blvd. W. EV-009.187, Montreal, QC H3G 1M8, Canada
| | - Amir Asif
- Department of Electrical Engineering and Computer Science, York University, Toronto, ON M3J 1P3, Canada;
| | - Habib Benali
- Department of Electrical and Computer Engineering, Concordia University, 1455 De Maisonneuve Blvd. W. EV-009.187, Montreal, QC H3G 1M8, Canada; (R.K.); (H.B.)
| |
Collapse
|
2
|
Kaseler RL, Leerskov K, Andreasen Struijk LNS, Dremstrup K, Jochumsen M. Designing a brain computer interface for control of an assistive robotic manipulator using steady state visually evoked potentials. IEEE Int Conf Rehabil Robot 2019; 2019:1067-1072. [PMID: 31374771 DOI: 10.1109/icorr.2019.8779376] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
An assistive robotic manipulator (ARM) can provide independence and improve the quality of life for patients suffering from tetraplegia. However, to properly control such device to a satisfactory level without any motor functions requires a very high performing brain-computer interface (BCI). Steady-state visual evoked potentials (SSVEP) based BCI are among the best performing. Thus, this study investigates the design of a system for a full workspace control of a 7 degrees of freedom ARM. A SSVEP signal is elicited by observing a visual stimulus flickering at a specific frequency and phase. This study investigates the best combination of unique frequencies and phases to provide a 16-target BCI by testing three different systems off line. Furthermore, a fourth system is developed to investigate the impact of the stimulating monitor refresh rate. Experiments conducted on two subjects suggest that a 16-target BCI created by four unique frequencies and 16-unique phases provide the best performance. Subject 1 reaches a maximum estimated ITR of 235 bits/min while subject 2 reaches 140 bits/min. The findings suggest that the optimal SSVEP stimuli to generate 16 targets are a low number of frequencies and a high number of unique phases. Moreover, the findings do not suggest any need for considering the monitor refresh rate if stimuli are modulated using a sinusoidal signal sampled at the refresh rate.
Collapse
|
3
|
Huang X, Xu J, Wang Z. A Novel Instantaneous Phase Detection Approach and Its Application in SSVEP-Based Brain-Computer Interfaces. SENSORS 2018; 18:s18124334. [PMID: 30544612 PMCID: PMC6308765 DOI: 10.3390/s18124334] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/17/2018] [Revised: 11/29/2018] [Accepted: 12/03/2018] [Indexed: 11/16/2022]
Abstract
This paper proposes a novel phase estimator based on fully-traversed Discrete Fourier Transform (DFT) which takes all possible truncated DFT spectra into account such that it possesses two merits of `direct phase extraction' (namely accurate instantaneous phase information can be extracted without any correction) and suppressing spectral leakage. This paper also proves that the proposed phase estimator complies with the 2-parameter joint estimation model rather than the conventional 3-parameter joint model. Numerical results verify the above two merits and demonstrate that the proposed estimator can extract phase information from noisy multi-tone signals. Finally, real data analysis shows that fully-traversed DFT can achieve a better classification on the phase of steady-state visual evoked potential (SSVEP) brain-computer interface (BCI) than the conventional DFT estimator does. Besides, the proposed phase estimator imposes no restrictions on the relationship between the sampling rates and the stimulus frequencies, thus it is capable of wider applications in phase-coded SSVEP BCIs, when compared with the existing estimators.
Collapse
Affiliation(s)
- Xiangdong Huang
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China.
| | - Jingwen Xu
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China.
| | - Zheng Wang
- College of Intelligence and Computing, Tianjin University, Tianjin 300072, China.
| |
Collapse
|
4
|
An EEG Experimental Study Evaluating the Performance of Texas Instruments ADS1299. SENSORS 2018; 18:s18113721. [PMID: 30388836 PMCID: PMC6263632 DOI: 10.3390/s18113721] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/09/2018] [Revised: 10/26/2018] [Accepted: 10/30/2018] [Indexed: 11/17/2022]
Abstract
Texas Instruments ADS1299 is an attractive choice for low cost electroencephalography (EEG) devices owing to its low power consumption and low input referred noise. To date, there have been no rigorous evaluations of its performance. In this EEG experimental study we evaluated the performance of the ADS1299 against a high quality laboratory-based system. Two self-paced lower limb motor tasks were performed by 22 healthy participants. Recorded power across delta, theta, alpha, and beta EEG bands, the power ratio across the motor tasks, pre-movement noise, and signal-to-noise ratio were obtained for evaluation. The amplitude and time of the negative peak in the movement-related cortical potentials (MRCPs) extracted from the EEG data were also obtained. Using linear mixed models, no statistically significant differences (p > 0.05) were found in any of these measures across the two systems. These findings were further supported by evaluation of cosine similarity, waveform differences, and topographic maps. There were statistically significant differences in MRCPs across the motor tasks in both systems. We conclude that the performance of the ADS1299 in combination with wet Ag/AgCl electrodes is analogous to that of a laboratory-based system in a low frequency (<40 Hz) EEG recording.
Collapse
|
5
|
Zhang X, Xu G, Zhang X, Wu Q. A Light Spot Humanoid Motion Paradigm Modulated by the Change of Brightness to Recognize the Stride Motion Frequency. Front Hum Neurosci 2018; 12:377. [PMID: 30374295 PMCID: PMC6196316 DOI: 10.3389/fnhum.2018.00377] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2018] [Accepted: 09/03/2018] [Indexed: 11/30/2022] Open
Abstract
The steady-state visual evoked potential (SSVEP)-based brain–computer interface (BCI) usually has the advantages of high information transfer rate (ITR) and no need for training. However, low frequencies, such as the human stride motion frequency, cannot easily induce SSVEP. To solve this problem, a light spot humanoid motion paradigm modulated by the change of brightness was designed in this study. The characteristics of the brain response to the motion paradigm modulated by the change of brightness were analyzed for the first time. The results showed that the designed paradigm could induce not only the high flicker frequency but also the modulation frequencies between the change of brightness and the motion in the primary visual cortex. Thus, the stride motion frequency can be recognized through the modulation frequencies by using the designed paradigm. Also, in an online experiment, this paradigm was employed to control a lower limb robot to achieve same frequency stimulation, which meant that the visual stimulation frequency was the same as the motion frequency of the robot. Also, canonical correlation analysis (CCA) was used to distinguish three different stride motion frequencies. The average accuracies of the classification in three walking speeds using the designed paradigm with the same and different high frequencies reached 87 and 95% respectively. Furthermore, the angles of the knee joint of the robot were obtained to demonstrate the feasibility of the electroencephalograph (EEG)-driven robot with same stimulation.
Collapse
Affiliation(s)
- Xin Zhang
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China
| | - Guanghua Xu
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China.,State Key Laboratory for Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an, China
| | - Xun Zhang
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China
| | - Qingqiang Wu
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China
| |
Collapse
|
6
|
Keihani A, Shirzhiyan Z, Farahi M, Shamsi E, Mahnam A, Makkiabadi B, Haidari MR, Jafari AH. Use of Sine Shaped High-Frequency Rhythmic Visual Stimuli Patterns for SSVEP Response Analysis and Fatigue Rate Evaluation in Normal Subjects. Front Hum Neurosci 2018; 12:201. [PMID: 29892219 PMCID: PMC5985331 DOI: 10.3389/fnhum.2018.00201] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2017] [Accepted: 04/30/2018] [Indexed: 11/13/2022] Open
Abstract
Background: Recent EEG-SSVEP signal based BCI studies have used high frequency square pulse visual stimuli to reduce subjective fatigue. However, the effect of total harmonic distortion (THD) has not been considered. Compared to CRT and LCD monitors, LED screen displays high-frequency wave with better refresh rate. In this study, we present high frequency sine wave simple and rhythmic patterns with low THD rate by LED to analyze SSVEP responses and evaluate subjective fatigue in normal subjects. Materials and Methods: We used patterns of 3-sequence high-frequency sine waves (25, 30, and 35 Hz) to design our visual stimuli. Nine stimuli patterns, 3 simple (repetition of each of above 3 frequencies e.g., P25-25-25) and 6 rhythmic (all of the frequencies in 6 different sequences e.g., P25-30-35) were chosen. A hardware setup with low THD rate (<0.1%) was designed to present these patterns on LED. Twenty two normal subjects (aged 23-30 (25 ± 2.1) yrs) were enrolled. Visual analog scale (VAS) was used for subjective fatigue evaluation after presentation of each stimulus pattern. PSD, CCA, and LASSO methods were employed to analyze SSVEP responses. The data including SSVEP features and fatigue rate for different visual stimuli patterns were statistically evaluated. Results: All 9 visual stimuli patterns elicited SSVEP responses. Overall, obtained accuracy rates were 88.35% for PSD and > 90% for CCA and LASSO (for TWs > 1 s). High frequency rhythmic patterns group with low THD rate showed higher accuracy rate (99.24%) than simple patterns group (98.48%). Repeated measure ANOVA showed significant difference between rhythmic pattern features (P < 0.0005). Overall, there was no significant difference between the VAS of rhythmic [3.85 ± 2.13] compared to the simple patterns group [3.96 ± 2.21], (P = 0.63). Rhythmic group had lower within group VAS variation (min = P25-30-35 [2.90 ± 2.45], max = P35-25-30 [4.81 ± 2.65]) as well as least individual pattern VAS (P25-30-35). Discussion and Conclusion: Overall, rhythmic and simple pattern groups had higher and similar accuracy rates. Rhythmic stimuli patterns showed insignificantly lower fatigue rate than simple patterns. We conclude that both rhythmic and simple visual high frequency sine wave stimuli require further research for human subject SSVEP-BCI studies.
Collapse
Affiliation(s)
- Ahmadreza Keihani
- Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.,Research Center for Biomedical Technologies and Robotics, Tehran University of Medical Sciences, Tehran, Iran
| | - Zahra Shirzhiyan
- Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.,Research Center for Biomedical Technologies and Robotics, Tehran University of Medical Sciences, Tehran, Iran
| | - Morteza Farahi
- Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.,Research Center for Biomedical Technologies and Robotics, Tehran University of Medical Sciences, Tehran, Iran
| | - Elham Shamsi
- Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.,Research Center for Biomedical Technologies and Robotics, Tehran University of Medical Sciences, Tehran, Iran
| | - Amin Mahnam
- Department of Biomedical Engineering, Faculty of Engineering, University of Isfahan, Isfahan, Iran
| | - Bahador Makkiabadi
- Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.,Research Center for Biomedical Technologies and Robotics, Tehran University of Medical Sciences, Tehran, Iran
| | - Mohsen R Haidari
- Section of Neuroscience, Department of Neurology, Faculty of Medicine, Baqiyatallah University of Medical Sciences, Tehran, Iran
| | - Amir H Jafari
- Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.,Research Center for Biomedical Technologies and Robotics, Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|