1
|
Yeh PY, Sun CK, Sue YR. Predicting the Risk of Driving Under the Influence of Alcohol Using EEG-Based Machine Learning. Comput Biol Med 2025; 184:109405. [PMID: 39531921 DOI: 10.1016/j.compbiomed.2024.109405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2024] [Revised: 10/02/2024] [Accepted: 11/08/2024] [Indexed: 11/16/2024]
Abstract
Driving under the influence of alcohol (DUIA) is closely associated with alcohol use disorder (AUD). Our previous study on machine learning (ML) algorithms revealed a very high accuracy of decision trees with neuropsychological features in predicting the risk of DUIA despite limited data availability. Thus, this study aimed at comparing six well-known ML algorithms based on electroencephalographic (EEG) signals to differentiate adults with AUD and DUIA (AUD-DD) from those with AUD without DUIA (AUD-NDD) and controls. Fifteen AUD-DD and 10 AUD-NDD participants were recruited from a single tertiary referral center. Fourteen social drinkers without DUIA served as controls. Their EEG signals related to driving conditions were gathered using a VR headset with eight electrodes (F3, F4, Fz, C3, C4, Cz, P3, and P4). Based on the labeled features of EEG asymmetry and theta/beta ratio (TBR), comparisons between different algorithms were conducted. Fz and Cz electrodes exhibited differences in TBR across the three groups (all p < 0.02), while there were no significant differences between AUD-DD individuals and social drinkers. In contrast, asymmetries of between-group differences were not observed (all p > 0.09). K-nearest neighbors (KNN) with TBR showed the highest accuracy (83 %) in distinguishing AUD-DD individuals from controls, while logistic regression (LR), support vector machines (SVM), and naive Bayes (NB) with EEG asymmetric features demonstrated high accuracy in identifying DUIA (all 80 %) in AUD adults. LR, SVM, and NB with asymmetry may be employed in predicting DUIA among AUD adults, while KNN with TBR may be used for identifying DUIA in the general population.
Collapse
Affiliation(s)
- Pin-Yang Yeh
- Department of Psychology, College of Medical and Health Science, Asia University, Taichung, Taiwan; Clinical Psychology Center, Asia University Hospital, Taichung, Taiwan
| | - Cheuk-Kwan Sun
- Department of Emergency Medicine, E-Da Dachang Hospital, I-Shou University, Kaohsiung City, Taiwan; School of Medicine for International Students, College of Medicine, I-Shou University, Kaohsiung, Taiwan.
| | - Yu-Ru Sue
- Clinical Psychology Center, Asia University Hospital, Taichung, Taiwan
| |
Collapse
|
2
|
Stringfellow JS, Liran O, Lin MH, Baker TE. Recording Neural Reward Signals in a Naturalistic Operant Task Using Mobile-EEG and Augmented Reality. eNeuro 2024; 11:ENEURO.0372-23.2024. [PMID: 39013585 PMCID: PMC11315430 DOI: 10.1523/eneuro.0372-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2023] [Revised: 05/10/2024] [Accepted: 05/28/2024] [Indexed: 07/18/2024] Open
Abstract
The electrophysiological response to rewards recorded during laboratory tasks has been well documented, yet little is known about the neural response patterns in a more naturalistic setting. Here, we combined a mobile-EEG system with an augmented reality headset to record event-related brain potentials (ERPs) while participants engaged in a naturalistic operant task to find rewards. Twenty-five participants were asked to navigate toward a west or east goal location marked by floating orbs, and once participants reached the goal location, the orb would then signify a reward (5 cents) or no-reward (0 cents) outcome. Following the outcome, participants returned to a start location marked by floating purple rings, and once standing in the middle, a 3 s counter signaled the next trial, for a total of 200 trials. Consistent with previous research, reward feedback evoked the reward positivity, an ERP component believed to index the sensitivity of the anterior cingulate cortex to reward prediction error signals. The reward positivity peaked ∼230 ms with a maximal at channel FCz (M = -0.695 μV, ±0.23) and was significantly different than zero (p < 0.01). Participants took ∼3.38 s to reach the goal location and exhibited a general lose-shift (68.3% ±3.5) response strategy and posterror slowing. Overall, these novel findings provide support for the idea that combining mobile-EEG with augmented reality technology is a feasible solution to enhance the ecological validity of human electrophysiological studies of goal-directed behavior and a step toward a new era of human cognitive neuroscience research that blurs the line between laboratory and reality.
Collapse
Affiliation(s)
- Jaleesa S Stringfellow
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, New Jersey 07102
| | - Omer Liran
- Department of Psychiatry & Behavioral Neurosciences, Cedars-Sinai Virtual Medicine, Los Angeles, California 90048
| | - Mei-Heng Lin
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, New Jersey 07102
| | - Travis E Baker
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, New Jersey 07102
| |
Collapse
|
3
|
Kisker J, Johnsdorf M, Sagehorn M, Schöne B, Gruber T. Induced oscillatory brain responses under virtual reality conditions in the context of repetition priming. Exp Brain Res 2024; 242:525-541. [PMID: 38200371 PMCID: PMC10894769 DOI: 10.1007/s00221-023-06766-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Accepted: 12/12/2023] [Indexed: 01/12/2024]
Abstract
In the human electroencephalogram (EEG), induced oscillatory responses in various frequency bands are regarded as valuable indices to examine the neural mechanisms underlying human memory. While the advent of virtual reality (VR) drives the investigation of mnemonic processing under more lifelike settings, the joint application of VR and EEG methods is still in its infancy (e.g., due to technical limitations impeding the signal acquisition). The objective of the present EEG study was twofold. First, we examined whether the investigation of induced oscillations under VR conditions yields equivalent results compared to standard paradigms. Second, we aimed at obtaining further insights into basic memory-related brain mechanisms in VR. To these ends, we relied on a standard implicit memory design, namely repetition priming, for which the to-be-expected effects are well-documented for conventional studies. Congruently, we replicated a suppression of the evoked potential after stimulus onset. Regarding the induced responses, we observed a modulation of induced alphaband in response to a repeated stimulus. Importantly, our results revealed a repetition-related suppression of the high-frequency induced gammaband response (>30 Hz), indicating the sharpening of a cortical object representation fostering behavioral priming effects. Noteworthy, the analysis of the induced gammaband responses required a number of measures to minimize the influence of external and internal sources of artefacts (i.e., the electrical shielding of the technical equipment and the control for miniature eye movements). In conclusion, joint VR-EEG studies with a particular focus on induced oscillatory responses offer a promising advanced understanding of mnemonic processing under lifelike conditions.
Collapse
Affiliation(s)
- Joanna Kisker
- Institute of Psychology, Osnabrück University, Osnabrück, Germany.
| | - Marike Johnsdorf
- Institute of Psychology, Osnabrück University, Osnabrück, Germany
| | - Merle Sagehorn
- Institute of Psychology, Osnabrück University, Osnabrück, Germany
| | - Benjamin Schöne
- Institute of Psychology, Osnabrück University, Osnabrück, Germany
- Department of Psychology, Norwegian University of Science and Technology, Trondheim, Norway
| | - Thomas Gruber
- Institute of Psychology, Osnabrück University, Osnabrück, Germany
| |
Collapse
|
4
|
Vallet W, van Wassenhove V. Can cognitive neuroscience solve the lab-dilemma by going wild? Neurosci Biobehav Rev 2023; 155:105463. [PMID: 37967734 DOI: 10.1016/j.neubiorev.2023.105463] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 10/18/2023] [Accepted: 11/08/2023] [Indexed: 11/17/2023]
Abstract
Reproducibility, measurability, and refutability are the foundation of the scientific method applied to empirical work. In the study of animal and human behavior, experimental protocols conducted in the lab are the most reliable means by which scientists can operationalize behaviors using controlled and parameterized setups. However, whether observations in the lab fully generalize in the real world remain legitimately disputed. The notion of "experimental design" was originally intended to ensure the generalizability of experimental findings to real-world situations. Experiments in the wild are more frequently explored and significant technological advances have been made allowing mobile neuroimaging. Yet some methodological limitations remain when testing scientific hypotheses in ecological conditions. Herein, we discuss the limitations of inferential processes derive from empirical observations in the wild. The multi-causal property of an ecological situation often lacks controls, and this major concern may prevent the replication and the reliability of behavioral observations. We discuss the epistemological and historical grounds of the induction process for behavioral and cognitive neurosciences and provide some possible heuristics for In situ experimental designs compatible with psychophysics in the wild.
Collapse
Affiliation(s)
- William Vallet
- CEA DRF/Joliot, NeuroSpin, INSERM, Cognitive Neuroimaging Unit, Université Paris Saclay, 91191 Gif-sur-Yvette, France; INSERM U1028, CNRS UMR 5292, PSYR2 Team, Centre de recherche en Neurosciences de Lyon (CRNL), Université Lyon 1, 69000 Lyon, France.
| | - Virginie van Wassenhove
- CEA DRF/Joliot, NeuroSpin, INSERM, Cognitive Neuroimaging Unit, Université Paris Saclay, 91191 Gif-sur-Yvette, France
| |
Collapse
|
5
|
Lange L, Kisker J, Osinsky R. Midfrontal mechanisms of performance monitoring continuously adapt to incoming information during outcome anticipation. NEUROIMAGE. REPORTS 2023; 3:100182. [PMID: 40567382 PMCID: PMC12172925 DOI: 10.1016/j.ynirp.2023.100182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Revised: 05/22/2023] [Accepted: 08/28/2023] [Indexed: 06/28/2025]
Abstract
Performance monitoring is essential for successful action execution and previous studies have suggested that frontomedial theta (FMT) activity in scalp-recorded EEG reflects need for control signaling in response to negative outcomes. However, these studies have overlooked the fact that anticipating the most probable outcome is often possible. To optimize action execution, it is necessary for the time-critical performance monitoring system to utilize continuously updated information to adjust actions in time. This study used a combination of mobile EEG and virtual reality to investigate how the performance monitoring system adapts to continuously updated information during brief phases of outcome evaluation that follow action execution. In two virtual shooting tasks, participants were either able to observe the projectile and hence anticipate the outcome or not. We found that FMT power increased in response to missing shots in both tasks, but this effect was suppressed when participants were able to anticipate the outcome. Specifically, the suppression was linearly related to the duration of the anticipatory phase. Our results suggest that the performance monitoring system dynamically integrates incoming information to evaluate the most likely outcome of an action as quickly as possible. This dynamic mode of performance monitoring provides significant advantages over idly waiting for an action outcome before getting engaged. Early and adaptive performance monitoring not only helps prevent negative outcomes but also improves overall performance. Our findings highlight the crucial role of dynamic integration of incoming information in the performance monitoring system, providing insights for real-time decision-making and action control.
Collapse
Affiliation(s)
- Leon Lange
- Differential Psychology & Personality Research, Institute of Psychology, Osnabrück University, Germany
| | - Joanna Kisker
- Experimental Psychology I, Institute of Psychology, Osnabrück University, Germany
| | - Roman Osinsky
- Differential Psychology & Personality Research, Institute of Psychology, Osnabrück University, Germany
| |
Collapse
|
6
|
Margraf L, Krause D, Weigelt M. Frontal theta reveals further information about neural valence-dependent processing of augmented feedback in extensive motor practice-A secondary analysis. Eur J Neurosci 2023; 57:1297-1316. [PMID: 36878863 DOI: 10.1111/ejn.15951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 02/16/2023] [Accepted: 02/22/2023] [Indexed: 03/08/2023]
Abstract
Supplementing an earlier analysis of event-related potentials in extensive motor learning (Margraf et al., 2022a, 2022b), frontal theta-band activity (4-8 Hz) was scrutinized. Thirty-seven participants learned a sequential arm movement with 192 trials in each of five practice sessions. Feedback, based on a performance adaptive bandwidth, was given after every trial. Electroencephalogram (EEG) was recorded in the first and last practice sessions. The degree of motor automatization was tested under dual-task conditions in a pre-test-post-test design. Quantitative error information was transported in both feedback conditions (positive and negative). Frontal theta activity was discussed as a general signal that cognitive control is needed and, therefore, was expected to be higher after negative feedback. Extensive motor practice promotes automatization, and therefore, decreased frontal theta activity was expected in the later practice. Further, it was expected that frontal theta was predictive for subsequent behavioural adaptations and the amount of motor automatization. As the results show, induced frontal theta power was higher after negative feedback and decreased after five sessions of practice. Moreover, induced theta activity was predictive for error correction and, therefore, an indicator of whether the recruited cognitive resources successfully induced behavioural adaptations. It remains to be solved why these effects, which fit well with the theoretical assumptions, were only revealed by the induced part of frontal theta activity. Further, the amount of theta activity during practice was not predictive for the degree of motor automatization. It seems that there might be a dissociation between attentional resources associated with feedback processing and attentional resources associated with motor control.
Collapse
Affiliation(s)
- Linda Margraf
- Psychology and Movement Science, Department of Sport and Health, Paderborn University, Paderborn, Germany
| | - Daniel Krause
- Psychology and Movement Science, Department of Sport and Health, Paderborn University, Paderborn, Germany
| | - Matthias Weigelt
- Psychology and Movement Science, Department of Sport and Health, Paderborn University, Paderborn, Germany
| |
Collapse
|
7
|
Schöne B, Kisker J, Lange L, Gruber T, Sylvester S, Osinsky R. The reality of virtual reality. Front Psychol 2023; 14:1093014. [PMID: 36874824 PMCID: PMC9975753 DOI: 10.3389/fpsyg.2023.1093014] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Accepted: 01/06/2023] [Indexed: 02/17/2023] Open
Abstract
Virtual reality (VR) has become a popular tool for investigating human behavior and brain functions. Nevertheless, it is unclear whether VR constitutes an actual form of reality or is more like an advanced simulation. Determining the nature of VR has been mostly achieved by self-reported presence measurements, defined as the feeling of being submerged in the experience. However, subjective measurements might be prone to bias and, most importantly, do not allow for a comparison with real-life experiences. Here, we show that real-life and VR height exposures using 3D-360° videos are mostly indistinguishable on a psychophysiological level (EEG and HRV), while both differ from a conventional 2D laboratory setting. Using a fire truck, three groups of participants experienced a real-life (N = 25), a virtual (N = 24), or a 2D laboratory (N = 25) height exposure. Behavioral and psychophysiological results suggest that identical exogenous and endogenous cognitive as well as emotional mechanisms are deployed to process the real-life and virtual experience. Specifically, alpha- and theta-band oscillations in line with heart rate variability, indexing vigilance, and anxiety were barely indistinguishable between those two conditions, while they differed significantly from the laboratory setup. Sensory processing, as reflected by beta-band oscillations, exhibits a different pattern for all conditions, indicating further room for improving VR on a haptic level. In conclusion, the study shows that contemporary photorealistic VR setups are technologically capable of mimicking reality, thus paving the way for the investigation of real-world cognitive and emotional processes under controlled laboratory conditions. For a video summary, see https://youtu.be/fPIrIajpfiA.
Collapse
Affiliation(s)
- Benjamin Schöne
- Experimental Psychology I, Institute of Psychology, Osnabrück University, Osnabrück, Germany
| | - Joanna Kisker
- Experimental Psychology I, Institute of Psychology, Osnabrück University, Osnabrück, Germany
| | - Leon Lange
- Differential Psychology and Personality Research, Institute of Psychology, Osnabrück University, Osnabrück, Germany
| | - Thomas Gruber
- Experimental Psychology I, Institute of Psychology, Osnabrück University, Osnabrück, Germany
| | - Sophia Sylvester
- Semantic Information Systems Research Group, Institute of Computer Science, Osnabrück University, Osnabrück, Germany
| | - Roman Osinsky
- Differential Psychology and Personality Research, Institute of Psychology, Osnabrück University, Osnabrück, Germany
| |
Collapse
|
8
|
Attention Classification Based on Biosignals during Standard Cognitive Tasks for Occupational Domains. COMPUTERS 2022. [DOI: 10.3390/computers11040049] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Occupational disorders considerably impact workers’ quality of life and organizational productivity, and even affect mortality worldwide. Such health issues are related to mental health and ergonomics risk factors. In particular, mental health may be affected by cognitive strain caused by unexpected interruptions and other attention compromising factors. Risk factors assessment associated with cognitive strain in office environments, namely related to attention states, still suffers from the lack of scientifically validated tools. In this work, we aim to develop a series of classification models that can classify attention during pre-defined cognitive tasks based on the acquisition of biosignals to create a ground truth of attention. Biosignals, such as electrocardiography, electroencephalography, and functional near-infrared spectroscopy, were acquired from eight subjects during standard cognitive tasks inducing attention. Individually tuned machine learning models trained with those biosignals allowed us to successfully detect attention on the individual level, with results in the range of 70–80%. The electroencephalogram and electrocardiogram were revealed to be the most appropriate sensors in this context, and the combination of multiple sensors demonstrated the importance of using multiple sources. These models prove to be relevant for the development of attention identification tools by providing ground truth to determine which human–computer interaction variables have strong associations with attention.
Collapse
|
9
|
De Sanctis P, Solis-Escalante T, Seeber M, Wagner J, Ferris DP, Gramann K. Time to move: Brain dynamics underlying natural action and cognition. Eur J Neurosci 2021; 54:8075-8080. [PMID: 34904290 PMCID: PMC10454984 DOI: 10.1111/ejn.15562] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2021] [Revised: 12/08/2021] [Accepted: 12/08/2021] [Indexed: 12/14/2022]
Abstract
Advances in Mobile Brain/Body Imaging (MoBI) technology allows for real-time measurements of human brain dynamics during every day, natural, real-life situations. This special issue Time to Move brings together a collection of experimental papers, targeted reviews and opinion articles that lay out the latest MoBI findings. A wide range of topics across different fields are covered including art, athletics, virtual reality, and mobility. What unites these diverse topics is the common goal to enhance and restore human abilities by reaching a better understanding on how cognition is implemented by the brain-body relationship. The breadth and novelty of paradigms and findings reported here positions MoBI as a new frontier in the field of human cognitive neuroscience.
Collapse
Affiliation(s)
- Pierfilippo De Sanctis
- The Cognitive Neurophysiology Laboratory, Department of Pediatrics, Albert Einstein College of Medicine, New York City, New York, USA
- Department of Neurology, Division of Cognitive & Motor Aging, Albert Einstein College of Medicine, New York City, New York, USA
| | - Teodoro Solis-Escalante
- Department of Rehabilitation, Donders Institute for Brain, Cognition and Behavior, Radboud University Medical Center, Nijmegen, Netherlands
| | - Martin Seeber
- Functional Brain Mapping Laboratory, Department of Fundamental Neurosciences, Campus Biotech, University of Geneva, Geneva, Switzerland
| | - Johanna Wagner
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, California, USA
| | - Daniel P Ferris
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, Florida, USA
| | - Klaus Gramann
- Department of Psychology and Ergonomics, Biological Psychology and Neuroergonomics, Institute of Psychology and Ergonomics, Berlin Institute of Technology, Berlin, Germany
| |
Collapse
|