1
|
Wu D, Deng L, Lu Q, Liu S. A multidimensional adaptive transformer network for fatigue detection. Cogn Neurodyn 2025; 19:43. [PMID: 39991017 PMCID: PMC11842677 DOI: 10.1007/s11571-025-10224-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2024] [Revised: 12/22/2024] [Accepted: 01/15/2025] [Indexed: 02/25/2025] Open
Abstract
Variations in information processing patterns induced by operational directives under varying fatigue conditions within the cerebral cortex can be identified and analyzed through electroencephalogram (EEG) signals. The inherent complexity of EEG signals poses significant challenges in the effective detection of driver fatigue across diverse task scenarios. Recent advancements in deep learning, particularly the Transformer architecture, have shown substantial benefits in the retrieval and integration of multi-dimensional information. Nevertheless, the majority of current research primarily focuses on the application of Transformers for temporal information extraction, often overlooking other dimensions of EEG data. In response to this gap, the present study introduces a Multidimensional Adaptive Transformer Recognition Network specifically tailored for the identification of driving fatigue states. This network features a multidimensional Transformer architecture for feature extraction that adaptively assigns weights to various information dimensions, thereby facilitating feature compression and the effective extraction of structural information. This methodology ultimately enhances the model's accuracy and generalization capabilities. The experimental results indicate that the proposed methodology outperforms existing research methods when utilized with the SEED-VIG and SFDE datasets. Additionally, the analysis of multidimensional and frequency band features highlights the ability of the proposed network framework to elucidate differences in various multidimensional features during the identification of fatigue states.
Collapse
Affiliation(s)
- Dingming Wu
- MOE Key Lab for Neuroinformation, The Clinical Hospital of Chengdu Brain Science Institute, University of Electronic Science and Technology of China, Chengdu, China
| | - Liu Deng
- School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225 China
| | - Quanping Lu
- School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225 China
| | - Shihong Liu
- School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225 China
| |
Collapse
|
2
|
Kim H, Kim H, Lee YJ, Yi H, Kwon Y, Huang Y, Trotti LM, Kim YS, Yeo WH. Continuous real-time detection and management of comprehensive mental states using wireless soft multifunctional bioelectronics. Biosens Bioelectron 2025; 279:117387. [PMID: 40120293 DOI: 10.1016/j.bios.2025.117387] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2024] [Revised: 03/13/2025] [Accepted: 03/15/2025] [Indexed: 03/25/2025]
Abstract
Quantitatively measuring human mental states that profoundly affect cognition, behavior, and recovery would revolutionize personalized digital healthcare. Detecting fatigue, stress, and sleep is particularly important due to their interdependence: persistent fatigue can induce cognitive stress, while chronic stress impairs sleep quality, creating a harmful feedback loop. Here, we introduce a wireless, soft, multifunctional bioelectronic system offering the continuous real-time detection and management of comprehensive mental states. The all-in-one wearable device, mounted on the forehead, measures clinical-grade brain and cardiorespiratory signals. This membrane biopatch is imperceptible, flexible, and reusable, providing ultimate user comfort while detecting high-fidelity electroencephalogram, electrooculogram, pulse rate, and blood oxygen saturation. A set of in vivo studies with human subjects demonstrates that the soft device has great skin-conformal contact and minimized motion artifacts, capturing clinical-quality data with different activities, even during sleep. The developed signal processing methods and deep-learning algorithms offer automated, real-time classification of driving drowsiness, stress conditions, and sleep quality. The bioelectronics platforms in this study have the potential to revolutionize digital healthcare, particularly personalized medicine and at-home health monitoring.
Collapse
Affiliation(s)
- Hodam Kim
- Division of Biomedical Engineering, College of Software and Digital Healthcare Convergence, Yonsei University, Wonju 26493, Republic of Korea; BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; Wearable Intelligent Systems and Healthcare Center, Institute for Matter and Systems, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Hojoong Kim
- Wearable Intelligent Systems and Healthcare Center, Institute for Matter and Systems, Georgia Institute of Technology, Atlanta, GA 30332, USA; George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Yoon Jae Lee
- Wearable Intelligent Systems and Healthcare Center, Institute for Matter and Systems, Georgia Institute of Technology, Atlanta, GA 30332, USA; School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Hoon Yi
- Wearable Intelligent Systems and Healthcare Center, Institute for Matter and Systems, Georgia Institute of Technology, Atlanta, GA 30332, USA; George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Youngjin Kwon
- Wearable Intelligent Systems and Healthcare Center, Institute for Matter and Systems, Georgia Institute of Technology, Atlanta, GA 30332, USA; George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Yunuo Huang
- Wearable Intelligent Systems and Healthcare Center, Institute for Matter and Systems, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Lynn Marie Trotti
- Emory Sleep Center and Department of Neurology, Emory University School of Medicine, Atlanta, GA 30329, USA
| | - Yun Soung Kim
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Woon-Hong Yeo
- Wearable Intelligent Systems and Healthcare Center, Institute for Matter and Systems, Georgia Institute of Technology, Atlanta, GA 30332, USA; George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA; Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University School of Medicine, Atlanta, GA 30332, USA; Parker H. Petit Institute for Bioengineering and Biosciences, Georgia Institute of Technology, Atlanta, GA 30332, USA.
| |
Collapse
|
3
|
Peng D, Cai J, Zheng L, Li M, Nie L, Li Z. A Novel Neural Network Model Based on Real Mountain Road Data for Driver Fatigue Detection. Biomimetics (Basel) 2025; 10:104. [PMID: 39997127 PMCID: PMC11853368 DOI: 10.3390/biomimetics10020104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2024] [Revised: 01/26/2025] [Accepted: 02/07/2025] [Indexed: 02/26/2025] Open
Abstract
Mountainous roads are severely affected by environmental factors such as insufficient lighting and shadows from tree branches, which complicates the detection of drivers' facial features and the determination of fatigue states. An improved method for recognizing driver fatigue states on mountainous roads using the YOLOv5 neural network is proposed. Initially, modules from Deformable Convolutional Networks (DCNs) are integrated into the feature extraction stage of the YOLOv5 framework to improve the model's flexibility in recognizing facial characteristics and handling postural changes. Subsequently, a Triplet Attention (TA) mechanism is embedded within the YOLOv5 network to bolster image noise suppression and improve the network's robustness in recognition. Finally, the Wing loss function is introduced into the YOLOv5 model to heighten the sensitivity to micro-features and enhance the network's capability to capture details. Experimental results demonstrate that the modified YOLOv5 neural network achieves an average accuracy rate of 85% in recognizing driver fatigue states.
Collapse
Affiliation(s)
| | | | | | | | | | - Zuojin Li
- School of Electronic and Electrical Engineering, Chongqing University of Science and Technology, Chongqing 401331, China; (D.P.); (J.C.); (L.Z.); (M.L.); (L.N.)
| |
Collapse
|
4
|
Saevskiy A, Suntsova N, Kosenko P, Alam MN, Kostin A. Open-Source Algorithm for Automated Vigilance State Classification Using Single-Channel Electroencephalogram in Rodents. SENSORS (BASEL, SWITZERLAND) 2025; 25:921. [PMID: 39943560 PMCID: PMC11820057 DOI: 10.3390/s25030921] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/28/2024] [Revised: 01/31/2025] [Accepted: 02/01/2025] [Indexed: 02/16/2025]
Abstract
Accurate identification of sleep stages is essential for understanding sleep physiology and its role in neurological and behavioral research. Manual scoring of polysomnographic data, while reliable, is time-intensive and prone to variability. This study presents a novel Python-based algorithm for automated vigilance state scoring using single-channel electroencephalogram (EEG) recordings from rats and mice. The algorithm employs artifact processing, multi-band frequency analysis, and Gaussian mixture model (GMM)-based clustering to classify wakefulness, non-rapid, and rapid eye movement sleep (NREM and REM sleep, respectively). Combining narrow and broad frequency bands across the delta, theta, and sigma ranges, it uses a majority voting system to enhance accuracy, with tailored preprocessing and voting criteria improving REM detection. Validation on datasets from 10 rats and 10 mice under standard conditions showed sleep-wake state detection accuracies of 92% and 93%, respectively, closely matching manual scoring and comparable to existing methods. REM sleep detection accuracies of 89% (mice) and 91% (rats) align with previously reported (85-90%). Processing a full day of EEG data within several minutes, the algorithm is advantageous for large-scale and longitudinal studies. Its open-source design, flexibility, and scalability make it a robust, efficient tool for automated rodent sleep scoring, advancing research in standard experimental conditions, including aging and sleep deprivation.
Collapse
Affiliation(s)
- Anton Saevskiy
- Scientific Research and Technology Center for Neurotechnology, Southern Federal University, 344006 Rostov-on-Don, Russia; (A.S.); (P.K.)
| | - Natalia Suntsova
- Research Service (151A3), Veterans Affairs Greater Los Angeles Healthcare System, Sepulveda, Los Angeles, CA 91343, USA;
- Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, CA 90095, USA
| | - Peter Kosenko
- Scientific Research and Technology Center for Neurotechnology, Southern Federal University, 344006 Rostov-on-Don, Russia; (A.S.); (P.K.)
| | - Md Noor Alam
- Research Service (151A3), Veterans Affairs Greater Los Angeles Healthcare System, Sepulveda, Los Angeles, CA 91343, USA;
- Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, CA 90095, USA
| | - Andrey Kostin
- Research Service (151A3), Veterans Affairs Greater Los Angeles Healthcare System, Sepulveda, Los Angeles, CA 91343, USA;
| |
Collapse
|
5
|
Jiao Y, He X. Recognizing drivers' sleep onset by detecting slow eye movement using a parallel multimodal one-dimensional convolutional neural network. Comput Methods Biomech Biomed Engin 2025:1-15. [PMID: 39877998 DOI: 10.1080/10255842.2025.2456996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Revised: 11/11/2024] [Accepted: 01/14/2025] [Indexed: 01/31/2025]
Abstract
Slow eye movements (SEMs) are a reliable physiological marker of drivers' sleep onset, often accompanied by EEG alpha wave attenuation. A parallel multimodal 1D convolutional neural network (PM-1D-CNN) model is proposed to classify SEMs. The model uses two parallel 1D-CNN blocks to extract features from EOG and EEG signals, which are then fused and fed into fully connected layers for classification. Results show that the PM-1D-CNN outperforms the SGL-1D-CNN and Bimodal-LSTM networks in both subject-to-subject and cross-subject evaluations, confirming its effectiveness in detecting sleep onset.
Collapse
Affiliation(s)
- Yingying Jiao
- School of Computer Science and Artificial Intelligence, Aliyun School of Big Data, Changzhou University, Changzhou, P.R. China
| | - Xiujin He
- School of Computer Science and Artificial Intelligence, Aliyun School of Big Data, Changzhou University, Changzhou, P.R. China
| |
Collapse
|
6
|
陈 衍, 张 喆, 王 帆, 丁 鹏, 赵 磊, 伏 云. [An emerging discipline: brain-computer interfaces medicine]. SHENG WU YI XUE GONG CHENG XUE ZA ZHI = JOURNAL OF BIOMEDICAL ENGINEERING = SHENGWU YIXUE GONGCHENGXUE ZAZHI 2024; 41:641-649. [PMID: 39218588 PMCID: PMC11366471 DOI: 10.7507/1001-5515.202310028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 02/24/2024] [Indexed: 09/04/2024]
Abstract
With the development of brain-computer interface (BCI) technology and its translational application in clinical medicine, BCI medicine has emerged, ushering in profound changes to the practice of medicine, while also bringing forth a series of ethical issues related to BCI medicine. BCI medicine is progressively emerging as a new disciplinary focus, yet to date, there has been limited literature discussing it. Therefore, this paper focuses on BCI medicine, firstly providing an overview of the main potential medical applications of BCI technology. It then defines the discipline, outlines its objectives, methodologies, potential efficacy, and associated translational medical research. Additionally, it discusses the ethics associated with BCI medicine, and introduces the standardized operational procedures for BCI medical applications and the methods for evaluating the efficacy of BCI medical applications. Finally, it anticipates the challenges and future directions of BCI medicine. In the future, BCI medicine may become a new academic discipline or major in higher education. In summary, this article is hoped to provide thoughts and references for the development of the discipline of BCI medicine.
Collapse
Affiliation(s)
- 衍肖 陈
- 昆明理工大学 信息工程与自动化学院(昆明 650500)Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P. R. China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P. R. China
| | - 喆 张
- 昆明理工大学 信息工程与自动化学院(昆明 650500)Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P. R. China
| | - 帆 王
- 昆明理工大学 信息工程与自动化学院(昆明 650500)Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P. R. China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P. R. China
| | - 鹏 丁
- 昆明理工大学 信息工程与自动化学院(昆明 650500)Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P. R. China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P. R. China
| | - 磊 赵
- 昆明理工大学 信息工程与自动化学院(昆明 650500)Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P. R. China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P. R. China
| | - 云发 伏
- 昆明理工大学 信息工程与自动化学院(昆明 650500)Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, P. R. China
- 昆明理工大学 脑认知与脑机智能融合创新团队(昆明 650500)Brain Cognition and Brain-computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming 650500, P. R. China
| |
Collapse
|
7
|
Kaveh R, Schwendeman C, Pu L, Arias AC, Muller R. Wireless ear EEG to monitor drowsiness. Nat Commun 2024; 15:6520. [PMID: 39095399 PMCID: PMC11297174 DOI: 10.1038/s41467-024-48682-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2023] [Accepted: 05/09/2024] [Indexed: 08/04/2024] Open
Abstract
Neural wearables can enable life-saving drowsiness and health monitoring for pilots and drivers. While existing in-cabin sensors may provide alerts, wearables can enable monitoring across more environments. Current neural wearables are promising but most require wet-electrodes and bulky electronics. This work showcases in-ear, dry-electrode earpieces used to monitor drowsiness with compact hardware. The employed system integrates additive-manufacturing for dry, user-generic earpieces, existing wireless electronics, and offline classification algorithms. Thirty-five hours of electrophysiological data were recorded across nine subjects performing drowsiness-inducing tasks. Three classifier models were trained with user-specific, leave-one-trial-out, and leave-one-user-out splits. The support-vector-machine classifier achieved an accuracy of 93.2% while evaluating users it has seen before and 93.3% when evaluating a never-before-seen user. These results demonstrate wireless, dry, user-generic earpieces used to classify drowsiness with comparable accuracies to existing state-of-the-art, wet electrode in-ear and scalp systems. Further, this work illustrates the feasibility of population-trained classification in future electrophysiological applications.
Collapse
Affiliation(s)
- Ryan Kaveh
- University of California Berkeley, Berkeley, CA, 94708, USA.
| | | | - Leslie Pu
- University of California Berkeley, Berkeley, CA, 94708, USA
| | - Ana C Arias
- University of California Berkeley, Berkeley, CA, 94708, USA
| | - Rikky Muller
- University of California Berkeley, Berkeley, CA, 94708, USA.
| |
Collapse
|
8
|
Park S, Kim M, Nam H, Kwon J, Im CH. In-Car Environment Control Using an SSVEP-Based Brain-Computer Interface with Visual Stimuli Presented on Head-Up Display: Performance Comparison with a Button-Press Interface. SENSORS (BASEL, SWITZERLAND) 2024; 24:545. [PMID: 38257638 PMCID: PMC10819861 DOI: 10.3390/s24020545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/16/2023] [Revised: 01/04/2024] [Accepted: 01/12/2024] [Indexed: 01/24/2024]
Abstract
Controlling the in-car environment, including temperature and ventilation, is necessary for a comfortable driving experience. However, it often distracts the driver's attention, potentially causing critical car accidents. In the present study, we implemented an in-car environment control system utilizing a brain-computer interface (BCI) based on steady-state visual evoked potential (SSVEP). In the experiment, four visual stimuli were displayed on a laboratory-made head-up display (HUD). This allowed the participants to control the in-car environment by simply staring at a target visual stimulus, i.e., without pressing a button or averting their eyes from the front. The driving performances in two realistic driving tests-obstacle avoidance and car-following tests-were then compared between the manual control condition and SSVEP-BCI control condition using a driving simulator. In the obstacle avoidance driving test, where participants needed to stop the car when obstacles suddenly appeared, the participants showed significantly shorter response time (1.42 ± 0.26 s) in the SSVEP-BCI control condition than in the manual control condition (1.79 ± 0.27 s). No-response rate, defined as the ratio of obstacles that the participants did not react to, was also significantly lower in the SSVEP-BCI control condition (4.6 ± 14.7%) than in the manual control condition (20.5 ± 25.2%). In the car-following driving test, where the participants were instructed to follow a preceding car that runs at a sinusoidally changing speed, the participants showed significantly lower speed difference with the preceding car in the SSVEP-BCI control condition (15.65 ± 7.04 km/h) than in the manual control condition (19.54 ± 11.51 km/h). The in-car environment control system using SSVEP-based BCI showed a possibility that might contribute to safer driving by keeping the driver's focus on the front and thereby enhancing the overall driving performance.
Collapse
Affiliation(s)
- Seonghun Park
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Republic of Korea; (S.P.); (J.K.)
| | - Minsu Kim
- Department of Artificial Intelligence, Hanyang University, Seoul 04763, Republic of Korea; (M.K.); (H.N.)
| | - Hyerin Nam
- Department of Artificial Intelligence, Hanyang University, Seoul 04763, Republic of Korea; (M.K.); (H.N.)
| | - Jinuk Kwon
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Republic of Korea; (S.P.); (J.K.)
| | - Chang-Hwan Im
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Republic of Korea; (S.P.); (J.K.)
- Department of Artificial Intelligence, Hanyang University, Seoul 04763, Republic of Korea; (M.K.); (H.N.)
- Department of Biomedical Engineering, Hanyang University, Seoul 04763, Republic of Korea
| |
Collapse
|
9
|
Kong L, Xie K, Niu K, He J, Zhang W. Remote Photoplethysmography and Motion Tracking Convolutional Neural Network with Bidirectional Long Short-Term Memory: Non-Invasive Fatigue Detection Method Based on Multi-Modal Fusion. SENSORS (BASEL, SWITZERLAND) 2024; 24:455. [PMID: 38257546 PMCID: PMC11154312 DOI: 10.3390/s24020455] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/17/2023] [Revised: 01/04/2024] [Accepted: 01/08/2024] [Indexed: 01/24/2024]
Abstract
Existing vision-based fatigue detection methods commonly utilize RGB cameras to extract facial and physiological features for monitoring driver fatigue. These features often include single indicators such as eyelid movement, yawning frequency, and heart rate. However, the accuracy of RGB cameras can be affected by factors like varying lighting conditions and motion. To address these challenges, we propose a non-invasive method for multi-modal fusion fatigue detection called RPPMT-CNN-BiLSTM. This method incorporates a feature extraction enhancement module based on the improved Pan-Tompkins algorithm and 1D-MTCNN. This enhances the accuracy of heart rate signal extraction and eyelid features. Furthermore, we use one-dimensional neural networks to construct two models based on heart rate and PERCLOS values, forming a fatigue detection model. To enhance the robustness and accuracy of fatigue detection, the trained model data results are input into the BiLSTM network. This generates a time-fitting relationship between the data extracted from the CNN, allowing for effective dynamic modeling and achieving multi-modal fusion fatigue detection. Numerous experiments validate the effectiveness of the proposed method, achieving an accuracy of 98.2% on the self-made MDAD (Multi-Modal Driver Alertness Dataset). This underscores the feasibility of the algorithm. In comparison with traditional methods, our approach demonstrates higher accuracy and positively contributes to maintaining traffic safety, thereby advancing the field of smart transportation.
Collapse
Affiliation(s)
- Lingjian Kong
- School of Electronic Information and Electrical Engineering, Yangtze University, Jingzhou 434023, China; (L.K.); (K.N.)
| | - Kai Xie
- School of Electronic Information and Electrical Engineering, Yangtze University, Jingzhou 434023, China; (L.K.); (K.N.)
| | - Kaixuan Niu
- School of Electronic Information and Electrical Engineering, Yangtze University, Jingzhou 434023, China; (L.K.); (K.N.)
| | - Jianbiao He
- School of Computer Science, Central South University, Changsha 410083, China;
| | - Wei Zhang
- School of Electronic Information, Central South University, Changsha 410083, China;
| |
Collapse
|
10
|
Yang X, Huang K, Yang D, Zhao W, Zhou X. Biomedical Big Data Technologies, Applications, and Challenges for Precision Medicine: A Review. GLOBAL CHALLENGES (HOBOKEN, NJ) 2024; 8:2300163. [PMID: 38223896 PMCID: PMC10784210 DOI: 10.1002/gch2.202300163] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/02/2023] [Revised: 09/20/2023] [Indexed: 01/16/2024]
Abstract
The explosive growth of biomedical Big Data presents both significant opportunities and challenges in the realm of knowledge discovery and translational applications within precision medicine. Efficient management, analysis, and interpretation of big data can pave the way for groundbreaking advancements in precision medicine. However, the unprecedented strides in the automated collection of large-scale molecular and clinical data have also introduced formidable challenges in terms of data analysis and interpretation, necessitating the development of novel computational approaches. Some potential challenges include the curse of dimensionality, data heterogeneity, missing data, class imbalance, and scalability issues. This overview article focuses on the recent progress and breakthroughs in the application of big data within precision medicine. Key aspects are summarized, including content, data sources, technologies, tools, challenges, and existing gaps. Nine fields-Datawarehouse and data management, electronic medical record, biomedical imaging informatics, Artificial intelligence-aided surgical design and surgery optimization, omics data, health monitoring data, knowledge graph, public health informatics, and security and privacy-are discussed.
Collapse
Affiliation(s)
- Xue Yang
- Department of Pancreatic Surgery and West China Biomedical Big Data CenterWest China HospitalSichuan UniversityChengdu610041China
| | - Kexin Huang
- Department of Pancreatic Surgery and West China Biomedical Big Data CenterWest China HospitalSichuan UniversityChengdu610041China
| | - Dewei Yang
- College of Advanced Manufacturing EngineeringChongqing University of Posts and TelecommunicationsChongqingChongqing400000China
| | - Weiling Zhao
- Center for Systems MedicineSchool of Biomedical InformaticsUTHealth at HoustonHoustonTX77030USA
| | - Xiaobo Zhou
- Center for Systems MedicineSchool of Biomedical InformaticsUTHealth at HoustonHoustonTX77030USA
| |
Collapse
|
11
|
Saleem AA, Siddiqui HUR, Raza MA, Rustam F, Dudley S, Ashraf I. A systematic review of physiological signals based driver drowsiness detection systems. Cogn Neurodyn 2023; 17:1229-1259. [PMID: 37786662 PMCID: PMC10542071 DOI: 10.1007/s11571-022-09898-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Revised: 08/11/2022] [Accepted: 09/14/2022] [Indexed: 11/03/2022] Open
Abstract
Driving a vehicle is a complex, multidimensional, and potentially risky activity demanding full mobilization and utilization of physiological and cognitive abilities. Drowsiness, often caused by stress, fatigue, and illness declines cognitive capabilities that affect drivers' capability and cause many accidents. Drowsiness-related road accidents are associated with trauma, physical injuries, and fatalities, and often accompany economic loss. Drowsy-related crashes are most common in young people and night shift workers. Real-time and accurate driver drowsiness detection is necessary to bring down the drowsy driving accident rate. Many researchers endeavored for systems to detect drowsiness using different features related to vehicles, and drivers' behavior, as well as, physiological measures. Keeping in view the rising trend in the use of physiological measures, this study presents a comprehensive and systematic review of the recent techniques to detect driver drowsiness using physiological signals. Different sensors augmented with machine learning are utilized which subsequently yield better results. These techniques are analyzed with respect to several aspects such as data collection sensor, environment consideration like controlled or dynamic, experimental set up like real traffic or driving simulators, etc. Similarly, by investigating the type of sensors involved in experiments, this study discusses the advantages and disadvantages of existing studies and points out the research gaps. Perceptions and conceptions are made to provide future research directions for drowsiness detection techniques based on physiological signals.
Collapse
Affiliation(s)
- Adil Ali Saleem
- Faculty of Computer Science and Information Technology, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan, 64200 Pakistan
| | - Hafeez Ur Rehman Siddiqui
- Faculty of Computer Science and Information Technology, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan, 64200 Pakistan
| | - Muhammad Amjad Raza
- Faculty of Computer Science and Information Technology, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan, 64200 Pakistan
| | - Furqan Rustam
- School of Computer Science, University College Dublin, Dublin, D04 V1W8 Ireland
| | - Sandra Dudley
- School of Engineering, London South Bank University, London, SE1 0AA UK
| | - Imran Ashraf
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan, 38541 South Korea
| |
Collapse
|
12
|
Zhou Z, Fang Z, Wang J, Chen J, Li H, Han L, Zhang Z. Driver vigilance detection based on deep learning with fused thermal image information for public transportation. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE 2023; 124:106604. [DOI: 10.1016/j.engappai.2023.106604] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
|
13
|
End-to-end fatigue driving EEG signal detection model based on improved temporal-graph convolution network. Comput Biol Med 2023; 152:106431. [PMID: 36543007 DOI: 10.1016/j.compbiomed.2022.106431] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Revised: 11/30/2022] [Accepted: 12/13/2022] [Indexed: 12/23/2022]
Abstract
Fatigue driving is one of the leading causes of traffic accidents, so fatigue driving detection technology plays a crucial role in road safety. The physiological information-based fatigue detection methods have the advantage of objectivity and accuracy. Among many physiological signals, EEG signals are considered to be the most direct and promising ones. Most traditional methods are challenging to train and do not meet real-time requirements. To this end, we propose an end-to-end temporal and graph convolution-based (MATCN-GT) fatigue driving detection algorithm. The MATCN-GT model consists of a multi-scale attentional temporal convolutional neural network block (MATCN block) and a graph convolutional-Transformer block (GT block). Among them, the MATCN block extracts features directly from the original EEG signal without a priori information, and the GT block processes the features of EEG signals between different electrodes. In addition, we design a multi-scale attention module to ensure that valuable information on electrode correlations will not be lost. We add a Transformer module to the graph convolutional network, which can better capture the dependencies between long-distance electrodes. We conduct experiments on the public dataset SEED-VIG, and the accuracy of the MATCN-GT model reached 93.67%, outperforming existing algorithms. Furthermore, compared with the traditional graph convolutional neural network, the GT block has improved the accuracy rate by 3.25%. The accuracy of the MATCN block on different subjects is higher than the existing feature extraction methods.
Collapse
|
14
|
Jiang S, Chen W, Ren Z, Zhu H. EEG-based analysis for pilots' at-risk cognitive competency identification using RF-CNN algorithm. Front Neurosci 2023; 17:1172103. [PMID: 37152589 PMCID: PMC10160375 DOI: 10.3389/fnins.2023.1172103] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Accepted: 04/03/2023] [Indexed: 05/09/2023] Open
Abstract
Cognitive competency is an essential complement to the existing ship pilot screening system that should be focused on. Situation awareness (SA), as the cognitive foundation of unsafe behaviors, is susceptible to influencing piloting performance. To address this issue, this paper develops an identification model based on random forest- convolutional neural network (RF-CNN) method for detecting at-risk cognitive competency (i.e., low SA level) using wearable EEG signal acquisition technology. In the poor visibility scene, the pilots' SA levels were correlated with EEG frequency metrics in frontal (F) and central (C) regions, including α/β (p = 0.071 < 0.1 in F and p = 0.042 < 0.05 in C), θ/(α + θ) (p = 0.048 < 0.05 in F and p = 0.026 < 0.05 in C) and (α + θ)/β (p = 0.046 < 0.05 in F and p = 0.012 < 0.05 in C), and then a total of 12 correlation features were obtained based on a 5 s sliding time window. Using the RF algorithm developed by principal component analysis (PCA) for further feature combination, these salient combinations are used as input sets to obtain the CNN algorithm with optimal parameters for identification. The comparative results of the proposed RF-CNN (accuracy is 84.8%) against individual RF (accuracy is 78.1%) and CNN (accuracy is 81.6%) methods demonstrate that the RF-CNN with feature optimization provides the best identification of at-risk cognitive competency (accuracy increases 6.7%). Overall, the results of this paper provide key technical support for the development of an adaptive evaluation system of pilots' cognitive competency based on intelligent technology, and lay the foundation and framework for monitoring the cognitive process and competency of ship piloting operation in China.
Collapse
Affiliation(s)
- Shaoqi Jiang
- College of Information Engineering, Jinhua Polytechnic, Jinhua, Zhejiang, China
- College of Environment and Engineering, Shanghai Maritime University, Shanghai, China
- *Correspondence: Shaoqi Jiang,
| | - Weijiong Chen
- College of Environment and Engineering, Shanghai Maritime University, Shanghai, China
- College of Merchant Marine, Shanghai Maritime University, Shanghai, China
| | - Zhenzhen Ren
- College of Merchant Marine, Shanghai Maritime University, Shanghai, China
| | - He Zhu
- College of Information Engineering, Jinhua Polytechnic, Jinhua, Zhejiang, China
| |
Collapse
|
15
|
Anders C, Arnrich B. Wearable electroencephalography and multi-modal mental state classification: A systematic literature review. Comput Biol Med 2022; 150:106088. [PMID: 36137314 DOI: 10.1016/j.compbiomed.2022.106088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 08/10/2022] [Accepted: 09/03/2022] [Indexed: 11/19/2022]
Abstract
BACKGROUND Wearable multi-modal time-series classification applications outperform their best uni-modal counterparts and hold great promise. A modality that directly measures electrical correlates from the brain is electroencephalography. Due to varying noise sources, different key brain regions, key frequency bands, and signal characteristics like non-stationarity, techniques for data pre-processing and classification algorithms are task-dependent. METHOD Here, a systematic literature review on mental state classification for wearable electroencephalography is presented. Four search terms in different combinations were used for an in-title search. The search was executed on the 29th of June 2022, across Google Scholar, PubMed, IEEEXplore, and ScienceDirect. 76 most relevant publications were set into context as the current state-of-the-art in mental state time-series classification. RESULTS Pre-processing techniques, features, and time-series classification models were analyzed. Across publications, a window length of one second was mainly chosen for classification and spectral features were utilized the most. The achieved performance per time-series classification model is analyzed, finding linear discriminant analysis, decision trees, and k-nearest neighbors models outperform support-vector machines by a factor of up to 1.5. A historical analysis depicts future trends while under-reported aspects relevant to practical applications are discussed. CONCLUSIONS Five main conclusions are given, covering utilization of available area for electrode placement on the head, most often or scarcely utilized features and time-series classification model architectures, baseline reporting practices, as well as explainability and interpretability of Deep Learning. The importance of a 'test battery' assessing the influence of data pre-processing and multi-modality on time-series classification performance is emphasized.
Collapse
Affiliation(s)
- Christoph Anders
- Hasso Plattner Institute, University of Potsdam, Potsdam, 14482, Brandenburg, Germany.
| | - Bert Arnrich
- Hasso Plattner Institute, University of Potsdam, Potsdam, 14482, Brandenburg, Germany.
| |
Collapse
|
16
|
Cousens GA, Fotis MM, Bradshaw CM, Ramirez-Alvarado YM, McKittrick CR. Characterization of Retronasal Airflow Patterns during Intraoral Fluid Discrimination Using a Low-Cost, Open-Source Biosensing Platform. SENSORS (BASEL, SWITZERLAND) 2022; 22:6817. [PMID: 36146175 PMCID: PMC9505993 DOI: 10.3390/s22186817] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Revised: 08/26/2022] [Accepted: 08/26/2022] [Indexed: 06/16/2023]
Abstract
Nasal airflow plays a critical role in olfactory processes, and both retronasal and orthonasal olfaction involve sensorimotor processes that facilitate the delivery of volatiles to the olfactory epithelium during odor sampling. Although methods are readily available for monitoring nasal airflow characteristics in laboratory and clinical settings, our understanding of odor sampling behavior would be enhanced by the development of inexpensive wearable technologies. Thus, we developed a method of monitoring nasal air pressure using a lightweight, open-source brain-computer interface (BCI) system and used the system to characterize patterns of retronasal airflow in human participants performing an oral fluid discrimination task. Participants exhibited relatively sustained low-rate retronasal airflow during sampling punctuated by higher-rate pulses often associated with deglutition. Although characteristics of post-deglutitive pulses did not differ across fluid conditions, the cumulative duration, probability, and estimated volume of retronasal airflow were greater during discrimination of perceptually similar solutions. These findings demonstrate the utility of a consumer-grade BCI system in assessing human olfactory behavior. They suggest further that sensorimotor processes regulate retronasal airflow to optimize the delivery of volatiles to the olfactory epithelium and that discrimination of perceptually similar oral fluids may be accomplished by varying the duration of optimal airflow rate.
Collapse
Affiliation(s)
- Graham A. Cousens
- Department of Psychology, Drew University, 36 Madison Avenue, Madison, NJ 07940, USA
- Neuroscience Program, Drew University, 36 Madison Avenue, Madison, NJ 07940, USA
| | | | | | | | - Christina R. McKittrick
- Neuroscience Program, Drew University, 36 Madison Avenue, Madison, NJ 07940, USA
- Department of Biology, Drew University, 36 Madison Avenue, Madison, NJ 07940, USA
| |
Collapse
|
17
|
Chen J, Li H, Han L, Wu J, Azam A, Zhang Z. Driver vigilance detection for high-speed rail using fusion of multiple physiological signals and deep learning. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.108982] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
18
|
Classifying Driving Fatigue by Using EEG Signals. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:1885677. [PMID: 35371255 PMCID: PMC8970926 DOI: 10.1155/2022/1885677] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Revised: 02/09/2022] [Accepted: 02/17/2022] [Indexed: 11/29/2022]
Abstract
Fatigue driving is one of the main reasons for the occurrence of traffic accidents. Brain-computer interface, as a human-computer interaction method based on EEG signals, can communicate with the outside world and move freely through brain signals without relying on the peripheral neuromuscular system. In this paper, a simulation driving platform composed of driving simulation equipment and driving simulation software is used to simulate the real driving process. The EEG signals of the subjects are collected through simulated driving, and the EEG of five subjects is selected as the training sample, and the remaining one is the subject. As a test sample, perform feature extraction and classification experiments, select any set of normal signals and fatigue signals recorded in the driving fatigue experiment for data analysis, and then study the classification of driver fatigue levels. Experiments have proved that the PSO-H-ELM algorithm has only about 4% advantage compared with the average accuracy of the KNN algorithm and the SVM algorithm. The gap is not as big as expected, but as a new algorithm, it is applied to the detection of fatigue EEG. The two traditional algorithms are indeed more suitable. It shows that the driver fatigue level can be judged by detecting EEG, which will provide a basis for the development of on-board, real-time driving fatigue alarm devices. It will lay the foundation for traffic management departments to intervene in driving fatigue reasonably and provide a reliable basis for minimizing traffic accidents.
Collapse
|
19
|
Arefnezhad S, Hamet J, Eichberger A, Frühwirth M, Ischebeck A, Koglbauer IV, Moser M, Yousefi A. Driver drowsiness estimation using EEG signals with a dynamical encoder-decoder modeling framework. Sci Rep 2022; 12:2650. [PMID: 35173189 PMCID: PMC8850607 DOI: 10.1038/s41598-022-05810-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Accepted: 01/14/2022] [Indexed: 01/22/2023] Open
Abstract
Drowsiness is a leading cause of accidents on the road as it negatively affects the driver’s ability to safely operate a vehicle. Neural activity recorded by EEG electrodes is a widely used physiological correlate of driver drowsiness. This paper presents a novel dynamical modeling solution to estimate the instantaneous level of the driver drowsiness using EEG signals, where the PERcentage of eyelid CLOSure (PERCLOS) is employed as the ground truth of driver drowsiness. Applying our proposed modeling framework, we find neural features present in EEG data that encode PERCLOS. In the decoding phase, we use a Bayesian filtering solution to estimate the PERCLOS level over time. A data set that comprises 18 driving tests, conducted by 13 drivers, has been used to investigate the performance of the proposed framework. The modeling performance in estimation of PERCLOS provides robust and repeatable results in tests with manual and automated driving modes by an average RMSE of 0.117 (at a PERCLOS range of 0 to 1) and average High Probability Density percentage of 62.5%. We further hypothesized that there are biomarkers that encode the PERCLOS across different driving tests and participants. Using this solution, we identified possible biomarkers such as Theta and Delta powers. Results show that about 73% and 66% of the Theta and Delta powers which are selected as biomarkers are increasing as PERCLOS grows during the driving test. We argue that the proposed method is a robust and reliable solution to estimate drowsiness in real-time which opens the door in utilizing EEG-based measures in driver drowsiness detection systems.
Collapse
Affiliation(s)
- Sadegh Arefnezhad
- Institute of Automotive Engineering, Graz University of Technology, 8010, Graz, Austria.
| | - James Hamet
- Neurable Company, Boston, MA, 02108, USA.,Vistim Labs Company, Salt Lake City, UT, 84103, USA
| | - Arno Eichberger
- Institute of Automotive Engineering, Graz University of Technology, 8010, Graz, Austria
| | | | - Anja Ischebeck
- Institute of Psychology, University of Graz, 8010, Graz, Austria
| | - Ioana Victoria Koglbauer
- Institute of Engineering and Business Informatics, Graz University of Technology, Graz, 8010, Austria
| | - Maximilian Moser
- Human Research Institute, Weiz, 8160, Austria.,Chair of Department of Physiology, Medical University of Graz, 8036, Graz, Austria
| | - Ali Yousefi
- Neurable Company, Boston, MA, 02108, USA.,Department of Computer Science Worcester Polytechnic Institute, 100 Institute Road, MA, 01609, Worcester, USA
| |
Collapse
|
20
|
Driver Monitoring of Automated Vehicles by Classification of Driver Drowsiness Using a Deep Convolutional Neural Network Trained by Scalograms of ECG Signals. ENERGIES 2022. [DOI: 10.3390/en15020480] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
Driver drowsiness is one of the leading causes of traffic accidents. This paper proposes a new method for classifying driver drowsiness using deep convolution neural networks trained by wavelet scalogram images of electrocardiogram (ECG) signals. Three different classes were defined for drowsiness based on video observation of driving tests performed in a simulator for manual and automated modes. The Bayesian optimization method is employed to optimize the hyperparameters of the designed neural networks, such as the learning rate and the number of neurons in every layer. To assess the results of the deep network method, heart rate variability (HRV) data is derived from the ECG signals, some features are extracted from this data, and finally, random forest and k-nearest neighbors (KNN) classifiers are used as two traditional methods to classify the drowsiness levels. Results show that the trained deep network achieves balanced accuracies of about 77% and 79% in the manual and automated modes, respectively. However, the best obtained balanced accuracies using traditional methods are about 62% and 64%. We conclude that designed deep networks working with wavelet scalogram images of ECG signals significantly outperform KNN and random forest classifiers which are trained on HRV-based features.
Collapse
|
21
|
Minea M, Dumitrescu CM, Costea IM. Advanced e-Call Support Based on Non-Intrusive Driver Condition Monitoring for Connected and Autonomous Vehicles. SENSORS (BASEL, SWITZERLAND) 2021; 21:8272. [PMID: 34960361 PMCID: PMC8707471 DOI: 10.3390/s21248272] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Revised: 12/06/2021] [Accepted: 12/08/2021] [Indexed: 11/30/2022]
Abstract
BACKGROUND The growth of the number of vehicles in traffic has led to an exponential increase in the number of road accidents with many negative consequences, such as loss of lives and pollution. METHODS This article focuses on using a new technology in automotive electronics by equipping a semi-autonomous vehicle with a complex sensor structure that is able to provide centralized information regarding the physiological signals (Electro encephalogram-EEG, electrocardiogram-ECG) of the driver/passengers and their location along with indoor temperature changes, employing the Internet of Things (IoT) technology. Thus, transforming the vehicle into a mobile sensor connected to the internet will help highlight and create a new perspective on the cognitive and physiological conditions of passengers, which is useful for specific applications, such as health management and a more effective intervention in case of road accidents. These sensor structures mounted in vehicles will allow for a higher detection rate of potential dangers in real time. The approach uses detection, recording, and transmission of relevant health information in the event of an incident as support for e-Call or other emergency services, including telemedicine. RESULTS The novelty of the research is based on the design of specialized non-invasive sensors for the acquisition of EEG and ECG signals installed in the headrest and backrest of car seats, on the algorithms used for data analysis and fusion, but also on the implementation of an IoT temperature measurement system in several points that simultaneously uses sensors based on MEMS technology. The solution can also be integrated with an e-Call system for telemedicine emergency assistance. CONCLUSION The research presents both positive and negative results of field experiments, with possible further developments. In this context, the solution has been developed based on state-of-the-art technical devices, methods, and technologies for monitoring vital functions of the driver/passengers (degree of fatigue, cognitive state, heart rate, blood pressure). The purpose is to reduce the risk of accidents for semi-autonomous vehicles and to also monitor the condition of passengers in the case of autonomous vehicles for providing first aid in a timely manner. Reported abnormal values of vital parameters (critical situations) will allow interveneing in a timely manner, saving the patient's life, with the support of the e-Call system.
Collapse
Affiliation(s)
- Marius Minea
- Department Telematics and Electronics for Transports, University “Politehnica” of Bucharest, 060042 Bucharest, Romania;
| | - Cătălin Marian Dumitrescu
- Department Telematics and Electronics for Transports, University “Politehnica” of Bucharest, 060042 Bucharest, Romania;
| | | |
Collapse
|
22
|
Pose Estimation of Driver’s Head Panning Based on Interpolation and Motion Vectors under a Boosting Framework. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app112411600] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Over the last decade, a driver’s distraction has gained popularity due to its increased significance and high impact on road accidents. Various factors, such as mood disorder, anxiety, nervousness, illness, loud music, and driver’s head rotation, contribute significantly to causing a distraction. Many solutions have been proposed to address this problem; however, various aspects of it are still unresolved. The study proposes novel geometric and spatial scale-invariant features under a boosting framework for detecting a driver’s distraction due to the driver’s head panning. These features are calculated using facial landmark detection algorithms, including the Active Shape Model (ASM) and Boosted Regression with Markov Networks (BoRMaN). The proposed approach is compared with six existing state-of-the-art approaches using four benchmark datasets, including DrivFace dataset, Boston University (BU) dataset, FT-UMT dataset, and Pointing’04 dataset. The proposed approach outperforms the existing approaches achieving an accuracy of 94.43%, 92.08%, 96.63%, and 83.25% on standard datasets.
Collapse
|