1
|
Yan W, Liu X, Shan B, Zhang X, Pu Y. Research on the Emotions Based on Brain -Computer Technology: A Bibliometric Analysis and Research Agenda. Front Psychol 2021; 12:771591. [PMID: 34790157 PMCID: PMC8591067 DOI: 10.3389/fpsyg.2021.771591] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2021] [Accepted: 10/07/2021] [Indexed: 11/13/2022] Open
Abstract
This study conducts a scientific analysis of 249 literature on the application of brain-computer technology in emotion research. We find that existing researches mainly focus on engineering, computer science, neurosciences neurology and psychology. PR China, United States, and Germany have the largest number of publications. Authors can be divided into four groups: real-time functional magnetic resonance imaging (rtfMRI) research group, brain-computer interface (BCI) impact factors analysis group, brain-computer music interfacing (BCMI) group, and user status research group. Clustering results can be divided into five categories, including external stimulus and event-related potential (ERP), electroencephalography (EEG), and information collection, support vector machine (SVM) and information processing, deep learning and emotion recognition, neurofeedback, and self-regulation. Based on prior researches, this study points out that individual differences, privacy risk, the extended study of BCI application scenarios and others deserve further research.
Collapse
Affiliation(s)
- Wei Yan
- School of Management, Jilin University, Changchun, China
| | - Xiaoju Liu
- School of Management, Jilin University, Changchun, China
| | - Biaoan Shan
- School of Management, Jilin University, Changchun, China
| | | | - Yi Pu
- School of Management, Jilin University, Changchun, China
| |
Collapse
|
2
|
Tamuli D, Kaur M, Jaryal AK, Srivastava AK, Senthil Kumaran S, Deepak KK. Structural atrophy of central autonomic network correlates with the functional attributes of autonomic nervous system in spinocerebellar ataxia patients. J Clin Neurosci 2021; 93:274-281. [PMID: 34353716 DOI: 10.1016/j.jocn.2021.07.031] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2021] [Revised: 07/19/2021] [Accepted: 07/20/2021] [Indexed: 11/29/2022]
Abstract
OBJECTIVE Spinocerebellar ataxia (SCA) is a neurodegenerative disorder in which, autonomic dysfunction is a common manifestation. Brain area atrophy also involves the areas comprising central autonomic network (CAN) in SCA. Structural atrophy of CAN and autonomic dysfunction should go hand in hand. But this important relationship has not been studied to date. Therefore, using SCA as a disease model, the present study has been designed to explore the plausible correlations between the brain areas of CAN and clinical autonomic function modalities in SCA patients. MATERIALS AND METHODS 3D T1-weighted scans were acquired on 3T MRI, analyzed by FreeSurfer software in genetically confirmed forty-nine SCA patients (SCA1 = 18, SCA2 = 25 and SCA3 = 6). Heart rate variability (HRV), blood pressure variability (BPV), baroreflex sensitivity (BRS), and autonomic reactivity tests were used for evaluation of autonomic nervous system. Additionally, autonomic dysfunction scoring was done using composite autonomic severity score (CASS). RESULTS On correlation analysis, the study showed the association of atrophic cortical and subcortical brain areas (predominantly prefrontal cortex, bilateral middle temporal, left cuneus, left lingual and left caudate) with altered clinical autonomic function parameters in SCA patients. These areas were primarily comprised of sympathetic and parasympathetic brain areas of CAN. One of the key brain areas of CAN - left cuneus was found to be associated with both HRV (r = 0.295, p = 0.040) and BRS (r = 0.326, p = 0.022). CONCLUSION A characteristic pattern of association between particular brain areas of CAN and clinical autonomic function parameters was observed in SCA patients.
Collapse
Affiliation(s)
| | - Manpreet Kaur
- Department of Physiology, VMMC & Safdarjung Hospital, New Delhi, India
| | - Ashok K Jaryal
- Department of Physiology, All India Institute of Medical Sciences, India
| | | | | | - Kishore K Deepak
- Department of Physiology, All India Institute of Medical Sciences, India.
| |
Collapse
|
3
|
Cinel C, Valeriani D, Poli R. Neurotechnologies for Human Cognitive Augmentation: Current State of the Art and Future Prospects. Front Hum Neurosci 2019; 13:13. [PMID: 30766483 PMCID: PMC6365771 DOI: 10.3389/fnhum.2019.00013] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2018] [Accepted: 01/10/2019] [Indexed: 01/10/2023] Open
Abstract
Recent advances in neuroscience have paved the way to innovative applications that cognitively augment and enhance humans in a variety of contexts. This paper aims at providing a snapshot of the current state of the art and a motivated forecast of the most likely developments in the next two decades. Firstly, we survey the main neuroscience technologies for both observing and influencing brain activity, which are necessary ingredients for human cognitive augmentation. We also compare and contrast such technologies, as their individual characteristics (e.g., spatio-temporal resolution, invasiveness, portability, energy requirements, and cost) influence their current and future role in human cognitive augmentation. Secondly, we chart the state of the art on neurotechnologies for human cognitive augmentation, keeping an eye both on the applications that already exist and those that are emerging or are likely to emerge in the next two decades. Particularly, we consider applications in the areas of communication, cognitive enhancement, memory, attention monitoring/enhancement, situation awareness and complex problem solving, and we look at what fraction of the population might benefit from such technologies and at the demands they impose in terms of user training. Thirdly, we briefly review the ethical issues associated with current neuroscience technologies. These are important because they may differentially influence both present and future research on (and adoption of) neurotechnologies for human cognitive augmentation: an inferior technology with no significant ethical issues may thrive while a superior technology causing widespread ethical concerns may end up being outlawed. Finally, based on the lessons learned in our analysis, using past trends and considering other related forecasts, we attempt to forecast the most likely future developments of neuroscience technology for human cognitive augmentation and provide informed recommendations for promising future research and exploitation avenues.
Collapse
Affiliation(s)
- Caterina Cinel
- Brain Computer Interfaces and Neural Engineering Laboratory, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
| | - Davide Valeriani
- Brain Computer Interfaces and Neural Engineering Laboratory, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
- Department of Otolaryngology, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, United States
| | - Riccardo Poli
- Brain Computer Interfaces and Neural Engineering Laboratory, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
| |
Collapse
|
4
|
Onishi A, Takano K, Kawase T, Ora H, Kansaku K. Affective Stimuli for an Auditory P300 Brain-Computer Interface. Front Neurosci 2017; 11:522. [PMID: 28983235 PMCID: PMC5613193 DOI: 10.3389/fnins.2017.00522] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2016] [Accepted: 09/05/2017] [Indexed: 12/04/2022] Open
Abstract
Gaze-independent brain computer interfaces (BCIs) are a potential communication tool for persons with paralysis. This study applies affective auditory stimuli to investigate their effects using a P300 BCI. Fifteen able-bodied participants operated the P300 BCI, with positive and negative affective sounds (PA: a meowing cat sound, NA: a screaming cat sound). Permuted stimuli of the positive and negative affective sounds (permuted-PA, permuted-NA) were also used for comparison. Electroencephalography data was collected, and offline classification accuracies were compared. We used a visual analog scale (VAS) to measure positive and negative affective feelings in the participants. The mean classification accuracies were 84.7% for PA and 67.3% for permuted-PA, while the VAS scores were 58.5 for PA and −12.1 for permuted-PA. The positive affective stimulus showed significantly higher accuracy and VAS scores than the negative affective stimulus. In contrast, mean classification accuracies were 77.3% for NA and 76.0% for permuted-NA, while the VAS scores were −50.0 for NA and −39.2 for permuted NA, which are not significantly different. We determined that a positive affective stimulus with accompanying positive affective feelings significantly improved BCI accuracy. Additionally, an ALS patient achieved 90% online classification accuracy. These results suggest that affective stimuli may be useful for preparing a practical auditory BCI system for patients with disabilities.
Collapse
Affiliation(s)
- Akinari Onishi
- Systems Neuroscience Section, Department of Rehabilitation for Brain Function, Research Institute of National Rehabilitation Center for Persons with DisabilitiesTokorozawa, Japan.,Center for Frontier Medical Engineering, Chiba UniversityInage, Japan
| | - Kouji Takano
- Systems Neuroscience Section, Department of Rehabilitation for Brain Function, Research Institute of National Rehabilitation Center for Persons with DisabilitiesTokorozawa, Japan
| | - Toshihiro Kawase
- Systems Neuroscience Section, Department of Rehabilitation for Brain Function, Research Institute of National Rehabilitation Center for Persons with DisabilitiesTokorozawa, Japan.,Biointerfaces Unit, Institute of Innovative Research, Tokyo Institute of TechnologyYokohama, Japan
| | - Hiroki Ora
- Systems Neuroscience Section, Department of Rehabilitation for Brain Function, Research Institute of National Rehabilitation Center for Persons with DisabilitiesTokorozawa, Japan.,Brain Science Inspired Life Support Research Center, The University of Electro-CommunicationsChofu, Japan
| | - Kenji Kansaku
- Systems Neuroscience Section, Department of Rehabilitation for Brain Function, Research Institute of National Rehabilitation Center for Persons with DisabilitiesTokorozawa, Japan.,Brain Science Inspired Life Support Research Center, The University of Electro-CommunicationsChofu, Japan
| |
Collapse
|
5
|
Roberts RP, Wiebels K, Sumner RL, van Mulukom V, Grady CL, Schacter DL, Addis DR. An fMRI investigation of the relationship between future imagination and cognitive flexibility. Neuropsychologia 2016; 95:156-172. [PMID: 27908591 DOI: 10.1016/j.neuropsychologia.2016.11.019] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2016] [Revised: 11/24/2016] [Accepted: 11/27/2016] [Indexed: 10/20/2022]
Abstract
While future imagination is largely considered to be a cognitive process grounded in default mode network activity, studies have shown that future imagination recruits regions in both default mode and frontoparietal control networks. In addition, it has recently been shown that the ability to imagine the future is associated with cognitive flexibility, and that tasks requiring cognitive flexibility result in increased coupling of the default mode network with frontoparietal control and salience networks. In the current study, we investigated the neural correlates underlying the association between cognitive flexibility and future imagination in two ways. First, we experimentally varied the degree of cognitive flexibility required during future imagination by manipulating the disparateness of episodic details contributing to imagined events. To this end, participants generated episodic details (persons, locations, objects) within three social spheres; during fMRI scanning they were presented with sets of three episodic details all taken from the same social sphere (Congruent condition) or different social spheres (Incongruent condition) and required to imagine a future event involving the three details. We predicted that, relative to the Congruent condition, future simulation in the Incongruent condition would be associated with increased activity in regions of the default mode, frontoparietal and salience networks. Second, we hypothesized that individual differences in cognitive flexibility, as measured by performance on the Alternate Uses Task, would correspond to individual differences in the brain regions recruited during future imagination. A task partial least squares (PLS) analysis showed that the Incongruent condition resulted in an increase in activity in regions in salience networks (e.g. the insula) but, contrary to our prediction, reduced activity in many regions of the default mode network (including the hippocampus). A subsequent functional connectivity (within-subject seed PLS) analysis showed that the insula exhibited increased coupling with default mode regions during the Incongruent condition. Finally, a behavioral PLS analysis showed that individual differences in cognitive flexibility were associated with differences in activity in a number of regions from frontoparietal, salience and default-mode networks during both future imagination conditions, further highlighting that the cognitive flexibility underlying future imagination is grounded in the complex interaction of regions in these networks.
Collapse
Affiliation(s)
- R P Roberts
- School of Psychology and Centre for Brain Research, The University of Auckland, Auckland, New Zealand.
| | - K Wiebels
- School of Psychology and Centre for Brain Research, The University of Auckland, Auckland, New Zealand
| | - R L Sumner
- School of Psychology and Centre for Brain Research, The University of Auckland, Auckland, New Zealand
| | - V van Mulukom
- School of Psychology and Centre for Brain Research, The University of Auckland, Auckland, New Zealand; Centre for Research in Psychology, Behaviour and Achievement, Coventry University, Coventry, UK
| | - C L Grady
- Rotman Research Institute at Baycrest Hospital and Departments of Psychiatry and Psychology, University of Toronto, Toronto, Canada
| | - D L Schacter
- Department of Psychology and Center for Brain Science, Harvard University, Cambridge, MA, USA
| | - D R Addis
- School of Psychology and Centre for Brain Research, The University of Auckland, Auckland, New Zealand; Brain Research New Zealand, New Zealand
| |
Collapse
|
6
|
Biological Computation Indexes of Brain Oscillations in Unattended Facial Expression Processing Based on Event-Related Synchronization/Desynchronization. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2016; 2016:8958750. [PMID: 27471545 PMCID: PMC4947680 DOI: 10.1155/2016/8958750] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2016] [Revised: 05/19/2016] [Accepted: 05/25/2016] [Indexed: 11/28/2022]
Abstract
Estimation of human emotions from Electroencephalogram (EEG) signals plays a vital role in affective Brain Computer Interface (BCI). The present study investigated the different event-related synchronization (ERS) and event-related desynchronization (ERD) of typical brain oscillations in processing Facial Expressions under nonattentional condition. The results show that the lower-frequency bands are mainly used to update Facial Expressions and distinguish the deviant stimuli from the standard ones, whereas the higher-frequency bands are relevant to automatically processing different Facial Expressions. Accordingly, we set up the relations between each brain oscillation and processing unattended Facial Expressions by the measures of ERD and ERS. This research first reveals the contributions of each frequency band for comprehension of Facial Expressions in preattentive stage. It also evidences that participants have emotional experience under nonattentional condition. Therefore, the user's emotional state under nonattentional condition can be recognized in real time by the ERD/ERS computation indexes of different frequency bands of brain oscillations, which can be used in affective BCI to provide the user with more natural and friendly ways.
Collapse
|
7
|
Pasqualotto E, Matuz T, Federici S, Ruf CA, Bartl M, Olivetti Belardinelli M, Birbaumer N, Halder S. Usability and Workload of Access Technology for People With Severe Motor Impairment. Neurorehabil Neural Repair 2015; 29:950-7. [PMID: 25753951 DOI: 10.1177/1545968315575611] [Citation(s) in RCA: 46] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Background. Eye trackers are widely used among people with amyotrophic lateral sclerosis, and their benefits to quality of life have been previously shown. On the contrary, Brain-computer interfaces (BCIs) are still quite a novel technology, which also serves as an access technology for people with severe motor impairment. Objective. To compare a visual P300-based BCI and an eye tracker in terms of information transfer rate (ITR), usability, and cognitive workload in users with motor impairments. Methods. Each participant performed 3 spelling tasks, over 4 total sessions, using an Internet browser, which was controlled by a spelling interface that was suitable for use with either the BCI or the eye tracker. At the end of each session, participants evaluated usability and cognitive workload of the system. Results. ITR and System Usability Scale (SUS) score were higher for the eye tracker (Wilcoxon signed-rank test: ITR T = 9, P = .016; SUS T = 12.50, P = .035). Cognitive workload was higher for the BCI ( T = 4; P = .003). Conclusions. Although BCIs could be potentially useful for people with severe physical disabilities, we showed that the usability of BCIs based on the visual P300 remains inferior to eye tracking. We suggest that future research on visual BCIs should use eye tracking–based control as a comparison to evaluate performance or focus on nonvisual paradigms for persons who have lost gaze control.
Collapse
Affiliation(s)
| | | | - Stefano Federici
- University of Perugia, Perugia, Italy
- Sapienza Università di Roma, Rome, Italy
| | | | | | | | - Niels Birbaumer
- Eberhard Karls Universität, Tübingen, Germany
- Istituto di Ricovero e Cura a Carattere Scientifico (IRCCS), Venezia Lido, Italy
| | - Sebastian Halder
- Universität Würzburg, Würzburg, Germany
- National Rehabilitation Center for Persons with Disabilities, Tokorozawa, Japan
| |
Collapse
|
8
|
Naseer N, Hong KS. fNIRS-based brain-computer interfaces: a review. Front Hum Neurosci 2015; 9:3. [PMID: 25674060 PMCID: PMC4309034 DOI: 10.3389/fnhum.2015.00003] [Citation(s) in RCA: 325] [Impact Index Per Article: 36.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2014] [Accepted: 01/02/2015] [Indexed: 11/23/2022] Open
Abstract
A brain-computer interface (BCI) is a communication system that allows the use of brain activity to control computers or other external devices. It can, by bypassing the peripheral nervous system, provide a means of communication for people suffering from severe motor disabilities or in a persistent vegetative state. In this paper, brain-signal generation tasks, noise removal methods, feature extraction/selection schemes, and classification techniques for fNIRS-based BCI are reviewed. The most common brain areas for fNIRS BCI are the primary motor cortex and the prefrontal cortex. In relation to the motor cortex, motor imagery tasks were preferred to motor execution tasks since possible proprioceptive feedback could be avoided. In relation to the prefrontal cortex, fNIRS showed a significant advantage due to no hair in detecting the cognitive tasks like mental arithmetic, music imagery, emotion induction, etc. In removing physiological noise in fNIRS data, band-pass filtering was mostly used. However, more advanced techniques like adaptive filtering, independent component analysis (ICA), multi optodes arrangement, etc. are being pursued to overcome the problem that a band-pass filter cannot be used when both brain and physiological signals occur within a close band. In extracting features related to the desired brain signal, the mean, variance, peak value, slope, skewness, and kurtosis of the noised-removed hemodynamic response were used. For classification, the linear discriminant analysis method provided simple but good performance among others: support vector machine (SVM), hidden Markov model (HMM), artificial neural network, etc. fNIRS will be more widely used to monitor the occurrence of neuro-plasticity after neuro-rehabilitation and neuro-stimulation. Technical breakthroughs in the future are expected via bundled-type probes, hybrid EEG-fNIRS BCI, and through the detection of initial dips.
Collapse
Affiliation(s)
- Noman Naseer
- Department of Cogno-Mechatronics Engineering, Pusan National UniversityBusan, Republic of Korea
| | - Keum-Shik Hong
- Department of Cogno-Mechatronics Engineering, Pusan National UniversityBusan, Republic of Korea
- School of Mechanical Engineering, Pusan National UniversityBusan, Republic of Korea
| |
Collapse
|