1
|
Sun S, Cao R, Rutishauser U, Yu R, Wang S. A uniform human multimodal dataset for emotion perception and judgment. Sci Data 2023; 10:773. [PMID: 37935738 PMCID: PMC10630434 DOI: 10.1038/s41597-023-02693-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Accepted: 10/26/2023] [Indexed: 11/09/2023] Open
Abstract
Face perception is a fundamental aspect of human social interaction, yet most research on this topic has focused on single modalities and specific aspects of face perception. Here, we present a comprehensive multimodal dataset for examining facial emotion perception and judgment. This dataset includes EEG data from 97 unique neurotypical participants across 8 experiments, fMRI data from 19 neurotypical participants, single-neuron data from 16 neurosurgical patients (22 sessions), eye tracking data from 24 neurotypical participants, behavioral and eye tracking data from 18 participants with ASD and 15 matched controls, and behavioral data from 3 rare patients with focal bilateral amygdala lesions. Notably, participants from all modalities performed the same task. Overall, this multimodal dataset provides a comprehensive exploration of facial emotion perception, emphasizing the importance of integrating multiple modalities to gain a holistic understanding of this complex cognitive process. This dataset serves as a key missing link between human neuroimaging and neurophysiology literature, and facilitates the study of neuropsychiatric populations.
Collapse
Affiliation(s)
- Sai Sun
- Frontier Research Institute for Interdisciplinary Sciences, Tohoku University, Sendai, 980-8578, Japan.
- Research Institute of Electrical Communication, Tohoku University, Sendai, 980-8577, Japan.
| | - Runnan Cao
- Department of Radiology, Washington University in St. Louis, St. Louis, MO, 63110, USA
| | - Ueli Rutishauser
- Departments of Neurosurgery and Neurology, Cedars-Sinai Medical Center, Los Angeles, 90048, California, USA
| | - Rongjun Yu
- Department of Management, Marketing, and Information Systems, Hong Kong Baptist University, Hong Kong, China
| | - Shuo Wang
- Department of Radiology, Washington University in St. Louis, St. Louis, MO, 63110, USA.
| |
Collapse
|
2
|
Bod RB, Rokai J, Meszéna D, Fiáth R, Ulbert I, Márton G. From End to End: Gaining, Sorting, and Employing High-Density Neural Single Unit Recordings. Front Neuroinform 2022; 16:851024. [PMID: 35769832 PMCID: PMC9236662 DOI: 10.3389/fninf.2022.851024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Accepted: 05/06/2022] [Indexed: 11/15/2022] Open
Abstract
The meaning behind neural single unit activity has constantly been a challenge, so it will persist in the foreseeable future. As one of the most sourced strategies, detecting neural activity in high-resolution neural sensor recordings and then attributing them to their corresponding source neurons correctly, namely the process of spike sorting, has been prevailing so far. Support from ever-improving recording techniques and sophisticated algorithms for extracting worthwhile information and abundance in clustering procedures turned spike sorting into an indispensable tool in electrophysiological analysis. This review attempts to illustrate that in all stages of spike sorting algorithms, the past 5 years innovations' brought about concepts, results, and questions worth sharing with even the non-expert user community. By thoroughly inspecting latest innovations in the field of neural sensors, recording procedures, and various spike sorting strategies, a skeletonization of relevant knowledge lays here, with an initiative to get one step closer to the original objective: deciphering and building in the sense of neural transcript.
Collapse
Affiliation(s)
- Réka Barbara Bod
- Laboratory of Experimental Neurophysiology, Department of Physiology, Faculty of Medicine, George Emil Palade University of Medicine, Pharmacy, Science and Technology of Târgu Mureş, Târgu Mureş, Romania
| | - János Rokai
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- School of PhD Studies, Semmelweis University, Budapest, Hungary
| | - Domokos Meszéna
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| | - Richárd Fiáth
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| | - István Ulbert
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| | - Gergely Márton
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| |
Collapse
|
3
|
Boran E, Stieglitz L, Sarnthein J. Epileptic High-Frequency Oscillations in Intracranial EEG Are Not Confounded by Cognitive Tasks. Front Hum Neurosci 2021; 15:613125. [PMID: 33746723 PMCID: PMC7971186 DOI: 10.3389/fnhum.2021.613125] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Accepted: 01/27/2021] [Indexed: 11/13/2022] Open
Abstract
Rationale: High-frequency oscillations (HFOs) in intracranial EEG (iEEG) are used to delineate the epileptogenic zone during presurgical diagnostic assessment in patients with epilepsy. HFOs are historically divided into ripples (80-250 Hz), fast ripples (FR, >250 Hz), and their co-occurrence (FRandR). In a previous study, we had validated the rate of FRandRs during deep sleep to predict seizure outcome. Here, we ask whether epileptic FRandRs might be confounded by physiological FRandRs that are unrelated to epilepsy. Methods: We recorded iEEG in the medial temporal lobe MTL (hippocampus, entorhinal cortex, and amygdala) in 17 patients while they performed cognitive tasks. The three cognitive tasks addressed verbal working memory, visual working memory, and emotional processing. In our previous studies, these tasks activated the MTL. We re-analyzed the data of these studies with the automated detector that focuses on the co-occurrence of ripples and FRs (FRandR). Results: For each task, we identified those channels in which the HFO rate was modulated during the task condition compared to the control condition. However, the number of these channels did not exceed the chance level. Interestingly, even during wakefulness, the HFO rate was higher for channels within the seizure onset zone (SOZ) than for channels outside the SOZ. Conclusion: Our prospective definition of an epileptic HFO, the FRandR, is not confounded by physiological HFOs that might be elicited by our cognitive tasks. This is reassuring for the clinical use of FRandR as a biomarker of the EZ.
Collapse
Affiliation(s)
- Ece Boran
- Klinik für Neurochirurgie, Universitäts Spital und Universität Zürich, Zurich, Switzerland
| | - Lennart Stieglitz
- Klinik für Neurochirurgie, Universitäts Spital und Universität Zürich, Zurich, Switzerland
| | - Johannes Sarnthein
- Klinik für Neurochirurgie, Universitäts Spital und Universität Zürich, Zurich, Switzerland
- Neuroscience Center Zurich, University of Zurich and ETH Zurich, Zurich, Switzerland
| |
Collapse
|