1
|
Chandralekha M, Jayadurga NP, Chen TM, Sathiyanarayanan M, Saleem K, Orgun MA. A synergistic approach for enhanced eye blink detection using wavelet analysis, autoencoding and Crow-Search optimized k-NN algorithm. Sci Rep 2025; 15:11949. [PMID: 40199999 PMCID: PMC11978900 DOI: 10.1038/s41598-025-95119-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2024] [Accepted: 03/19/2025] [Indexed: 04/10/2025] Open
Abstract
This research endeavor introduces a state-of-the-art, assimilated approach for eye blink detection from Electroencephalography signals. It combines the prominent strategies of wavelet analysis, autoencoding, and a Crow-Search-optimized k-Nearest Neighbors to enhance the performance of eye blink detection from EEG signals. This procedure is initiated by escalating the robustness of EEG data through jittering, which integrates noise into the dataset. Consequently, the wavelet transform is highly demanded during feature extraction in identifying the essential time-frequency components of the signals. These features are further distilled using an autoencoder to provide a dense, yet informative representation. Prior to introducing these features into the machine learning system, they were adjusted. Evidently, the hyperparameters of the k-Nearest Neighbors model have been fine-tuned using Crow Search Algorithm, inspired by the hunting characteristics of crows. This optimization method actively samples the search space to balance exploration and exploitation to identify the optimal configuration for the model. The k-NN model that has been optimized using the proposed method demonstrates significantly higher performance in the eye blink detection process in comparison to the deep learning models when equipped with decorous feature extraction and fine tuning. The effectiveness of the developed system has been ascertained according to the assessment indices such as accuracy, classification reports, and confusion matrix. Thus, the present work offers an optimal method of detecting the eye blink from the EEG signals assisting in the development of further EEG applications including user interfaces, fatigue level identification, and neurological disorders analysis through the enhancement of signal processing and optimization methods. It becomes evident after a detailed evaluation that conventional machine learning algorithms if implemented with correct feature extraction and fine-tuning surpass the deep learning approaches including the frameworks composed of Convolutional Neural Network and Principal Component Analysis and empirical mode decomposition by approximately 96% across all datasets. This proves the advantage of optimized traditional Machine Learning models over the Deep Learning models in realistic EEG-based eye blink detection.
Collapse
Affiliation(s)
- M Chandralekha
- Department of Computer Science and Engineering, Amrita School of Computing, Amrita Vishwa Vidyapeetham, Chennai, India
| | - N Priyadharshini Jayadurga
- Department of Computer Science and Engineering, Amrita School of Computing, Amrita Vishwa Vidyapeetham, Chennai, India.
| | - Thomas M Chen
- School of Science & Technology, City, University of London, London, UK
| | - Mithileysh Sathiyanarayanan
- School of Science & Technology, City, University of London, London, UK
- Research & Innovation, MIT Square, London, UK
| | - Kasif Saleem
- Department of Computer Sciences and Engineering, College of Applied Studies and Community Service, King Saud University, Riyadh, Saudi Arabia
| | - Mehmet A Orgun
- Department of Computing, Macquarie University, North Ryde, NSW, 2109, Australia
| |
Collapse
|
2
|
Zeng C, Wang H. Capacitance-Based Untethered Fatigue Driving Recognition Under Various Light Conditions. SENSORS (BASEL, SWITZERLAND) 2024; 24:7633. [PMID: 39686168 DOI: 10.3390/s24237633] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2024] [Revised: 11/16/2024] [Accepted: 11/26/2024] [Indexed: 12/18/2024]
Abstract
This study proposes a capacitance-based fatigue driving recognition method. The proposed method encompasses four principal phases: signal acquisition, pre-processing, blink detection, and fatigue driving recognition. A measurement circuit based on the FDC2214 is designed for the purpose of signal acquisition. The acquired signal is initially subjected to pre-processing, whereby noise waves are filtered out. Subsequently, the blink detection algorithm is employed to recognize the characteristics of human blinks. The characteristics of human blink include eye closing time, eye opening time, and idle time. Lastly, the BP neural network is employed to calculate the fatigue driving scale in the fatigue driving recognition stage. Experiments under various working and light conditions are conducted to verify the effectiveness of the proposed method. The results show that high fatigue driving recognition accuracy (92%) can be obtained by the proposed method under various light conditions.
Collapse
Affiliation(s)
- Cheng Zeng
- School of Advanced Manufacturing, Nanchang University, Nanchang 330031, China
| | - Haipeng Wang
- School of Intelligent Manufacturing, Jiangsu College of Engineering and Technology, Nantong 226006, China
| |
Collapse
|
3
|
Shi W, Li Y, Cai N, Chen R, Cao W, Li J. Removal of Ocular and Muscular Artifacts From Multi-Channel EEG Using Improved Spatial-Frequency Filtering. IEEE J Biomed Health Inform 2024; 28:3466-3477. [PMID: 38502613 DOI: 10.1109/jbhi.2024.3378980] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/21/2024]
Abstract
Over recent decades, electroencephalogram (EEG) has become an essential tool in the field of clinical analysis and neurological disease research. However, EEG recordings are notably vulnerable to artifacts during acquisition, especially in clinical settings, which can significantly impede the accurate interpretation of neuronal activity. Blind source separation is currently the most popular method for EEG denoising, but most of the sources it separates often contain both artifacts and brain activity, which may lead to substantial information loss if handled improperly. In this paper, we introduce a dual-threshold denoising method combining spatial filtering with frequency-domain filtering to automatically eliminate electrooculogram (EOG) and electromyogram (EMG) artifacts from multi-channel EEG. The proposed method employs a fusion of second-order blind identification (SOBI) and canonical correlation analysis (CCA) to enhance source separation quality, followed by adaptive threshold to localize the artifact sources, and strict fixed threshold to remove strong artifact sources. Stationary wavelet transform (SWT) is utilized to decompose the weak artifact sources, with subsequent adjustment of wavelet coefficients in respective frequency bands tailored to the distinct characteristics of each artifact. The results of synthetic and real datasets show that our proposed method maximally retains the time-domain and frequency-domain information in the EEG during denoising. Compared with existing techniques, the proposed method achieves better denoising performance, which establishes a reliable foundation for subsequent clinical analyses.
Collapse
|
4
|
Zhang R, Rong R, Gan JQ, Xu Y, Wang H, Wang X. Reliable and fast automatic artifact rejection of Long-Term EEG recordings based on Isolation Forest. Med Biol Eng Comput 2024; 62:521-535. [PMID: 37943419 DOI: 10.1007/s11517-023-02961-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2023] [Accepted: 10/28/2023] [Indexed: 11/10/2023]
Abstract
Long-term electroencephalogram (Long-Term EEG) has the capacity to monitor over a long period, making it a valuable tool in medical institutions. However, due to the large volume of patient data, selecting clean data segments from raw Long-Term EEG for further analysis is an extremely time-consuming and labor-intensive task. Furthermore, the various actions of patients during recording make it difficult to use algorithms to denoise part of the EEG data, and thus lead to the rejection of these data. Therefore, tools for the quick rejection of heavily corrupted epochs in Long-Term EEG records are highly beneficial. In this paper, a new reliable and fast automatic artifact rejection method for Long-Term EEG based on Isolation Forest (IF) is proposed. Specifically, the IF algorithm is repetitively applied to detect outliers in the EEG data, and the boundary of inliers is promptly adjusted by using a statistical indicator to make the algorithm proceed in an iterative manner. The iteration is terminated when the distance metric between clean epochs and artifact-corrupted epochs remains unchanged. Six statistical indicators (i.e., min, max, median, mean, kurtosis, and skewness) are evaluated by setting them as centroid to adjust the boundary during iteration, and the proposed method is compared with several state-of-the-art methods on a retrospectively collected dataset. The experimental results indicate that utilizing the min value of data as the centroid yields the most optimal performance, and the proposed method is highly efficacious and reliable in the automatic artifact rejection of Long-Term EEG, as it significantly improves the overall data quality. Furthermore, the proposed method surpasses compared methods on most data segments with poor data quality, demonstrating its superior capacity to enhance the data quality of the heavily corrupted data. Besides, owing to the linear time complexity of IF, the proposed method is much faster than other methods, thus providing an advantage when dealing with extensive datasets.
Collapse
Affiliation(s)
- Runkai Zhang
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, 210096, Jiangsu, People's Republic of China
| | - Rong Rong
- Department of Neurology, Nanjing Drum Tower Hospital, Nanjing, 210008, Jiangsu, People's Republic of China
| | - John Q Gan
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, CO4 3SQ, UK
| | - Yun Xu
- Department of Neurology, Nanjing Drum Tower Hospital, Nanjing, 210008, Jiangsu, People's Republic of China
| | - Haixian Wang
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, 210096, Jiangsu, People's Republic of China.
| | - Xiaoyun Wang
- Department of Neurology, Nanjing Drum Tower Hospital, Nanjing, 210008, Jiangsu, People's Republic of China.
| |
Collapse
|
5
|
Jiang T, Zheng R, Feng Y, Hu D, Gao F, Cao J. Interictal EEG Based Prediction of ACTH Efficacy in Infantile Epileptic Spasms. COMMUNICATIONS IN COMPUTER AND INFORMATION SCIENCE 2024:45-56. [DOI: 10.1007/978-981-99-8018-5_4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2025]
|
6
|
Karas K, Pozzi L, Pedrocchi A, Braghin F, Roveda L. Brain-computer interface for robot control with eye artifacts for assistive applications. Sci Rep 2023; 13:17512. [PMID: 37845318 PMCID: PMC10579221 DOI: 10.1038/s41598-023-44645-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Accepted: 10/11/2023] [Indexed: 10/18/2023] Open
Abstract
Human-robot interaction is a rapidly developing field and robots have been taking more active roles in our daily lives. Patient care is one of the fields in which robots are becoming more present, especially for people with disabilities. People with neurodegenerative disorders might not consciously or voluntarily produce movements other than those involving the eyes or eyelids. In this context, Brain-Computer Interface (BCI) systems present an alternative way to communicate or interact with the external world. In order to improve the lives of people with disabilities, this paper presents a novel BCI to control an assistive robot with user's eye artifacts. In this study, eye artifacts that contaminate the electroencephalogram (EEG) signals are considered a valuable source of information thanks to their high signal-to-noise ratio and intentional generation. The proposed methodology detects eye artifacts from EEG signals through characteristic shapes that occur during the events. The lateral movements are distinguished by their ordered peak and valley formation and the opposite phase of the signals measured at F7 and F8 channels. This work, as far as the authors' knowledge, is the first method that used this behavior to detect lateral eye movements. For the blinks detection, a double-thresholding method is proposed by the authors to catch both weak blinks as well as regular ones, differentiating itself from the other algorithms in the literature that normally use only one threshold. Real-time detected events with their virtual time stamps are fed into a second algorithm, to further distinguish between double and quadruple blinks from single blinks occurrence frequency. After testing the algorithm offline and in realtime, the algorithm is implemented on the device. The created BCI was used to control an assistive robot through a graphical user interface. The validation experiments including 5 participants prove that the developed BCI is able to control the robot.
Collapse
Affiliation(s)
- Kaan Karas
- Politecnico di Milano, Department of Mechanical Engineering, via La Masa 1, 20156, Milano, Italy
| | - Luca Pozzi
- Politecnico di Milano, Department of Mechanical Engineering, via La Masa 1, 20156, Milano, Italy
| | - Alessandra Pedrocchi
- Politecnico di Milano, Department of Electronics, Information and Bioengineering, NearLab, Via Giuseppe Colombo, 40, 20133, Milan, Italy
| | - Francesco Braghin
- Politecnico di Milano, Department of Mechanical Engineering, via La Masa 1, 20156, Milano, Italy
| | - Loris Roveda
- Istituto Dalle Molle di studi sull'Intelligenza Artificiale (IDSIA), Scuola Universitaria Professionale della Svizzera Italiana (SUPSI), Università della Svizzera italiana (USI), via la Santa 1, 6962, Lugano, Switzerland.
| |
Collapse
|
7
|
Wang M, Cui X, Wang T, Jiang T, Gao F, Cao J. Eye blink artifact detection based on multi-dimensional EEG feature fusion and optimization. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
|
8
|
Yuan S, Liu X, Shang J, Liu JX, Wang J, Zhou W. Automatic Seizure Detection Using Logarithmic Euclidean-Gaussian Mixture Models (LE-GMMs) and Improved Deep Forest Learning. IEEE J Biomed Health Inform 2023; 27:1386-1396. [PMID: 37015448 DOI: 10.1109/jbhi.2022.3230793] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Automatic seizure detection could facilitate early detection, improve treatment planning, and reduce medical workload. This study describes a novel Logarithmic Euclidean-Gaussian Mixture Models (LE-GMMs) and an improved Deep Forest learning algorithm for epileptic seizure detection. The LE-GMMs could map the Riemannian manifold structure of Gaussian models to linear Euclidean space, which fully exploits the ability of GMMs to distinguish non-seizure and seizure EEG signals. The Multi-Pooling and error Screening Forest (MPSForest) learning method based on Deep Forest uses multi-pooling and out-of-bagging (OOB) error screening to reduce memory load and random tree construction. Firstly, variational modal decomposition (VMD) is applied to decompose electroencephalogram (EEG) signals into five layers, and the first three layers are chosen to construct EEG time-frequency distribution. Then Gaussian Mixture Models are estimated, and the LE-GMMs are constructed to extract valid EEG features. These features are input into the MPSForest model to classify seizure and non-seizure samples. After that, the outputs are subjected to post-processing to get the final seizure detection results, including moving average filtering and the adaptive collar technique. The proposed method achieves average sensitivity of 98.22% and specificity of 98.99% on the UPenn and Mayo Clinic dataset, and for the long-term Freiburg EEG dataset with 21 patients, the sensitivity of 98.47% and specificity of 98.57% are yielded respectively with the false detection rate of 0.24/h. The experimental results show that this proposed method has excellent accuracy in distinguishing non-seizure and seizure EEG signals and holds great potential for clinical research and diagnostics.
Collapse
|
9
|
Zheng R, Cao J, Feng Y, Zhao X, Jiang T, Gao F. Seizure Prediction Analysis of Infantile Spasms. IEEE Trans Neural Syst Rehabil Eng 2023; 31:366-376. [PMID: 36395132 DOI: 10.1109/tnsre.2022.3223056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Infantile spasms (IS) is a typical childhood epileptic disorder with generalized seizures. The sudden, frequent and complex characteristics of infantile spasms are the main causes of sudden death, severe comorbidities and other adverse consequences. Effective prediction is highly critical to infantile spasms subjects, but few related studies have been done in the past. To address this, this study proposes a seizure prediction framework for infantile spasms by combining the statistical analysis and deep learning model. The analysis is conducted on dividing the continuous scalp electroencephalograms (sEEG) into 5 phases: Interictal, Preictal, Seizure Prediction Horizon (SPH), Seizure, and Postictal. The brain network of Phase-Locking Value (PLV) of 5 typical brain rhythms is constructed, and the mechanism of epileptic changes is analyzed by statistical methods. It is found that 1) the connections between the prefrontal, occipital, and central regions show a large variability at each stage of seizure transition, and 2) 4 sub-bands of brain rhythms ( θ , α , β , γ ) are predominant. Group and individual variabilities are validated by using the Resnet18 deep model on data from 25 patients with infantile spasms, where the consistent results to statistical analyses can be observed. The optimized model achieves an average of 79.78 % , 94.46% , 75.46% accuracy, specificity, and recall rate, respectively. The method accomplishes the analysis of the synergy between infantile spasms mechanism, model, data and algorithm, providing a guideline to build an intelligent and systematic model for comprehensive IS seizure prediction.
Collapse
|
10
|
Cao J, Feng Y, Zheng R, Cui X, Zhao W, Jiang T, Gao F. Two-Stream Attention 3-D Deep Network-Based Childhood Epilepsy Syndrome Classification. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT 2023; 72:1-12. [DOI: 10.1109/tim.2022.3220287] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2025]
Affiliation(s)
- Jiuwen Cao
- Machine Learning and I-Health International Cooperation Base of Zhejiang Province, Artificial Intelligence Institute, Hangzhou Dianzi University, Zhejiang, China
| | - Yuanmeng Feng
- Machine Learning and I-Health International Cooperation Base of Zhejiang Province, Artificial Intelligence Institute, Hangzhou Dianzi University, Zhejiang, China
| | - Runze Zheng
- Machine Learning and I-Health International Cooperation Base of Zhejiang Province, Artificial Intelligence Institute, Hangzhou Dianzi University, Zhejiang, China
| | - Xiaonan Cui
- Machine Learning and I-Health International Cooperation Base of Zhejiang Province, Artificial Intelligence Institute, Hangzhou Dianzi University, Zhejiang, China
| | - Weijie Zhao
- Machine Learning and I-Health International Cooperation Base of Zhejiang Province, Artificial Intelligence Institute, Hangzhou Dianzi University, Zhejiang, China
| | - Tiejia Jiang
- Department of Neurology, The Children’s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health, Hangzhou, China
| | - Feng Gao
- Machine Learning and I-Health International Cooperation Base of Zhejiang Province, Artificial Intelligence Institute, Hangzhou Dianzi University, Zhejiang, China
| |
Collapse
|
11
|
Zhang Y, Liu D, Zhang P, Li T, Li Z, Gao F. Combining robust level extraction and unsupervised adaptive classification for high-accuracy fNIRS-BCI: An evidence on single-trial differentiation between mentally arithmetic- and singing-tasks. Front Neurosci 2022; 16:938518. [PMID: 36300170 PMCID: PMC9589108 DOI: 10.3389/fnins.2022.938518] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2022] [Accepted: 09/12/2022] [Indexed: 11/18/2022] Open
Abstract
Functional near-infrared spectroscopy (fNIRS) is a safe and non-invasive optical imaging technique that is being increasingly used in brain-computer interfaces (BCIs) to recognize mental tasks. Unlike electroencephalography (EEG) which directly measures neural activation, fNIRS signals reflect neurovascular-coupling inducing hemodynamic response that can be slow in time and varying in the pattern. The established classifiers extend the EEG-ones by mostly employing the feature based supervised models such as the support vector machine (SVM) and linear discriminant analysis (LDA), and fail to timely characterize the level-sensitive hemodynamic pattern. A dedicated classifier is desired for intentional activity recognition of fNIRS-BCI, including the adaptive acquisition of response relevant features and accurate discrimination of implied ideas. To this end, we herein propose a specifically-designed joint adaptive classification method that combines a Kalman filtering (KF) for robust level extraction and an adaptive Gaussian mixture model (a-GMM) for enhanced pattern recognition. The simulative investigations and paradigm experiments have shown that the proposed KF/a-GMM classification method can effectively track the random variations of task-evoked brain activation patterns, and improve the accuracy of single-trial classification task of mental arithmetic vs. mental singing, as compared to the conventional methods, e.g., those that employ combinations of the band-pass filtering (BPF) based feature extractors (mean, slope, and variance, etc.) and the classical recognizers (GMM, SVM, and LDA). The proposed approach paves a promising way for developing the real-time fNIRS-BCI technique.
Collapse
Affiliation(s)
- Yao Zhang
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Dongyuan Liu
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Pengrui Zhang
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Tieni Li
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Zhiyong Li
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Feng Gao
- College of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin University, Tianjin, China
- *Correspondence: Feng Gao
| |
Collapse
|
12
|
Medhi K, Hoque N, Dutta SK, Hussain MI. An efficient EEG signal classification technique for Brain–Computer Interface using hybrid Deep Learning. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.104005] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
13
|
Feng Y, Zheng R, Cui X, Wang T, Jiang T, Gao F, Cao J. 3D residual-attention-deep-network-based childhood epilepsy syndrome classification. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.108856] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
|
14
|
Zheng R, Feng Y, Wang T, Cao J, Wu D, Jiang T, Gao F. Scalp EEG functional connection and brain network in infants with West syndrome. Neural Netw 2022; 153:76-86. [PMID: 35714423 DOI: 10.1016/j.neunet.2022.05.029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Revised: 05/21/2022] [Accepted: 05/31/2022] [Indexed: 10/18/2022]
|
15
|
Dewi C, Chen RC, Jiang X, Yu H. Adjusting eye aspect ratio for strong eye blink detection based on facial landmarks. PeerJ Comput Sci 2022; 8:e943. [PMID: 35494836 PMCID: PMC9044337 DOI: 10.7717/peerj-cs.943] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Accepted: 03/15/2022] [Indexed: 06/14/2023]
Abstract
Blink detection is an important technique in a variety of settings, including facial movement analysis and signal processing. However, automatic blink detection is very challenging because of the blink rate. This research work proposed a real-time method for detecting eye blinks in a video series. Automatic facial landmarks detectors are trained on a real-world dataset and demonstrate exceptional resilience to a wide range of environmental factors, including lighting conditions, face emotions, and head position. For each video frame, the proposed method calculates the facial landmark locations and extracts the vertical distance between the eyelids using the facial landmark positions. Our results show that the recognizable landmarks are sufficiently accurate to determine the degree of eye-opening and closing consistently. The proposed algorithm estimates the facial landmark positions, extracts a single scalar quantity by using Modified Eye Aspect Ratio (Modified EAR) and characterizing the eye closeness in each frame. Finally, blinks are detected by the Modified EAR threshold value and detecting eye blinks as a pattern of EAR values in a short temporal window. According to the results from a typical data set, it is seen that the suggested approach is more efficient than the state-of-the-art technique.
Collapse
Affiliation(s)
- Christine Dewi
- Department of Information Management, Chaoyang University of Technology, Taichung, Taiwan, Taiwan
- Department of Information Technology, Satya Wacana Christian University, Salatiga, Central Java, Indonesia
| | - Rung-Ching Chen
- Department of Information Management, Chaoyang University of Technology, Taichung, Taiwan, Taiwan
| | - Xiaoyi Jiang
- Department of Mathematics and Computer Science, University of Münster, Münster, Germany
| | - Hui Yu
- School of Creative Technologies, University of Portsmouth, Portsmouth, United Kingdom
| |
Collapse
|
16
|
Wang M, Wang J, Cui X, Wang T, Jiang T, Gao F, Cao J. Multi-dimensional Feature Optimization based Eye Blink Detection under Epileptiform Discharges. IEEE Trans Neural Syst Rehabil Eng 2022; 30:905-914. [PMID: 35363618 DOI: 10.1109/tnsre.2022.3164126] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
OBJECTIVES Eye blink artifact detection in scalp electroencephalogram (EEG) of epilepsy patients is challenging due to its similar waveforms to epileptiform discharges. Developing an accurate detection method is urgent and critical. METHODS In this paper, we proposed a novel multi-dimensional feature optimization based eye blink artifact detection algorithm for EEGs containing rich epileptiform discharges. An unsupervised clustering algorithm based on smoothed nonlinear energy operator (SNEO) and variational mode extraction (VME) is proposed to detect epileptiform discharges in the frontal leads. Then, multi-dimensional time/frequency EEG features extracted from forehead electrodes (FP1 and FP2 channels) combining with the improved VME (IVME) threshold are derived for EEG representation. A variance filtering method is further applied for discriminative feature selection and a machine learning model is finally learned to perform detection. RESULTS Experiments on EEGs of 16 subjects from the Children's Hospital of Zhejiang University School of Medicine (CHZU) show that our method achieves the highest average sensitivity, specificity and accuracy of 95.04, 89.52, and 93.01, respectively. That outperforms 5 recent and state-of-the-art (SOTA) eye blink detection algorithms. SIGNIFICANCE The proposed method is robust in eye blink artifact detection for EEGs containing high-frequency epileptiform discharges. It is also effective in dealing with individual differences in EEGs, which is usually ignored in conventional methods.
Collapse
|
17
|
Cui X, Hu D, Lin P, Cao J, Lai X, Wang T, Jiang T, Gao F. Deep feature fusion based childhood epilepsy syndrome classification from electroencephalogram. Neural Netw 2022; 150:313-325. [DOI: 10.1016/j.neunet.2022.03.014] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Revised: 01/11/2022] [Accepted: 03/07/2022] [Indexed: 12/01/2022]
|
18
|
Yang Q, Hu D, Wang T, Cao J, Dong F, Gao W, Jiang T, Gao F. Childhood epilepsy syndromes classification based on fused features of electroencephalogram and electrocardiogram. COGNITIVE COMPUTATION AND SYSTEMS 2022. [DOI: 10.1049/ccs2.12035] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Affiliation(s)
- Qianlan Yang
- Machine Learning and I‐health International Cooperation Base of Zhejiang Province Hangzhou Dianzi University Hangzhou China
| | - Dinghan Hu
- Machine Learning and I‐health International Cooperation Base of Zhejiang Province Hangzhou Dianzi University Hangzhou China
- Artificial Intelligence Institute Hangzhou Dianzi University Hangzhou China
| | - Tianlei Wang
- Machine Learning and I‐health International Cooperation Base of Zhejiang Province Hangzhou Dianzi University Hangzhou China
- Artificial Intelligence Institute Hangzhou Dianzi University Hangzhou China
| | - Jiuwen Cao
- Machine Learning and I‐health International Cooperation Base of Zhejiang Province Hangzhou Dianzi University Hangzhou China
- Artificial Intelligence Institute Hangzhou Dianzi University Hangzhou China
| | - Fang Dong
- School of Information and Electrical Engineering Zhejiang University City College Hangzhou China
| | - Weidong Gao
- School of Science and Engineering The Chinese University of Hong Kong Shenzhen China
| | - Tiejia Jiang
- Zhejiang University School of Medicine Children's Hospital Hangzhou China
| | - Feng Gao
- Zhejiang University School of Medicine Children's Hospital Hangzhou China
| |
Collapse
|
19
|
Xu Z, Wang T, Cao J, Bao Z, Jiang T, Gao F. BECT Spike Detection Based on Novel EEG Sequence Features and LSTM Algorithms. IEEE Trans Neural Syst Rehabil Eng 2021; 29:1734-1743. [PMID: 34428145 DOI: 10.1109/tnsre.2021.3107142] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The benign epilepsy with spinous waves in the central temporal region (BECT) is the one of the most common epileptic syndromes in children, that seriously threaten the nervous system development of children. The most obvious feature of BECT is the existence of a large number of electroencephalogram (EEG) spikes in the Rolandic area during the interictal period, that is an important basis to assist neurologists in BECT diagnosis. With this regard, the paper proposes a novel BECT spike detection algorithm based on time domain EEG sequence features and the long short-term memory (LSTM) neural network. Three time domain sequence features, that can obviously characterize the spikes of BECT, are extracted for EEG representation. The synthetic minority oversampling technique (SMOTE) is applied to address the spike imbalance issue in EEGs, and the bi-directional LSTM (BiLSTM) is trained for spike detection. The algorithm is evaluated using the EEG data of 15 BECT patients recorded from the Children's Hospital, Zhejiang University School of Medicine (CHZU). The experiment shows that the proposed algorithm can obtained an average of 88.54% F1 score, 92.04% sensitivity, and 85.75% precision, that generally outperforms several state-of-the-art spike detection methods.
Collapse
|
20
|
Wang J, Cao J, Hu D, Jiang T, Gao F. Eye Blink Artifact Detection With Novel Optimized Multi-Dimensional Electroencephalogram Features. IEEE Trans Neural Syst Rehabil Eng 2021; 29:1494-1503. [PMID: 34310312 DOI: 10.1109/tnsre.2021.3099232] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Accurate eye blink artifact detection is essential for electroencephalogram (EEG) analysis and auxiliary analysis of nervous system diseases, especially in the presence of the frontal epileptiform discharges. In this paper, we develop a novel eye blink artifact detection algorithm based on optimally selected multi-dimensional EEG features. Specific efforts have been paid to filtering the frontal epileptiform discharges, where an unsupervised learning exploiting the EEG signal physiological characteristics and smooth nonlinear energy operator (SNEO) based on the K-means clustering has been firstly proposed. Multiple statistical EEG features derived from the frontal electrodes and other electrodes are then extracted to characterize eye blink artifacts. Discriminative feature selection scheme based on the variance filtering and Relief algorithms has been respectively studied, and the average correlation coefficient (ACC) is applied for feature optimization evaluation. The eye blink artifact detection is finally achieved based on the support vector machine (SVM) trained on the optimized EEG features. The effectiveness of the proposed algorithm is demonstrated by experiments carried out on the EEG database of 11 subjects recorded from the Children's Hospital, Zhejiang University School of Medicine (CHZU). Comparisons to several state-of-the-art (SOTA) eye blink artifact detection methods are also presented.
Collapse
|
21
|
Ranjan R, Chandra Sahana B, Kumar Bhandari A. Ocular artifact elimination from electroencephalography signals: A systematic review. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.06.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
|
22
|
Cao J, Hu D, Wang Y, Wang J, Lei B. Epileptic Classification with Deep Transfer Learning based Feature Fusion Algorithm. IEEE Trans Cogn Dev Syst 2021. [DOI: 10.1109/tcds.2021.3064228] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|