1
|
Nakamura D, Kaji S, Kanai R, Hayashi R. Unsupervised method for representation transfer from one brain to another. Front Neuroinform 2024; 18:1470845. [PMID: 39669979 PMCID: PMC11634869 DOI: 10.3389/fninf.2024.1470845] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2024] [Accepted: 11/04/2024] [Indexed: 12/14/2024] Open
Abstract
Although the anatomical arrangement of brain regions and the functional structures within them are similar across individuals, the representation of neural information, such as recorded brain activity, varies among individuals owing to various factors. Therefore, appropriate conversion and translation of brain information is essential when decoding neural information using a model trained using another person's data or to achieving brain-to-brain communication. We propose a brain representation transfer method that involves transforming a data representation obtained from one person's brain into that obtained from another person's brain, without relying on corresponding label information between the transferred datasets. We defined the requirements to enable such brain representation transfer and developed an algorithm that distills the assumption of common similarity structure across the brain datasets into a rotational and reflectional transformation across low-dimensional hyperspheres using encoders for non-linear dimensional reduction. We first validated our proposed method using data from artificial neural networks as substitute neural activity and examining various experimental factors. We then evaluated the applicability of our method to real brain activity using functional magnetic resonance imaging response data acquired from human participants. The results of these validation experiments showed that our method successfully performed representation transfer and achieved transformations in some cases that were similar to those obtained when using corresponding label information. Additionally, we reconstructed images from individuals' data without training personalized decoders by performing brain representation transfer. The results suggest that our unsupervised transfer method is useful for the reapplication of existing models personalized to specific participants and datasets to decode brain information from other individuals. Our findings also serve as a proof of concept for the methodology, enabling the exchange of the latent properties of neural information representing individuals' sensations.
Collapse
Affiliation(s)
- Daiki Nakamura
- Human Informatics and Interaction Research Institute, National Institute of Advanced Industrial Science and Technology, Ibaraki, Japan
| | - Shizuo Kaji
- Institute of Mathematics for Industry, Kyushu University, Fukuoka, Japan
| | | | - Ryusuke Hayashi
- Human Informatics and Interaction Research Institute, National Institute of Advanced Industrial Science and Technology, Ibaraki, Japan
| |
Collapse
|
2
|
Vakilipour P, Fekrvand S. Brain-to-brain interface technology: A brief history, current state, and future goals. Int J Dev Neurosci 2024; 84:351-367. [PMID: 38711277 DOI: 10.1002/jdn.10334] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Revised: 04/05/2024] [Accepted: 04/18/2024] [Indexed: 05/08/2024] Open
Abstract
A brain-to-brain interface (BBI), defined as a combination of neuroimaging and neurostimulation methods to extract and deliver information between brains directly without the need for the peripheral nervous system, is a budding communication technique. A BBI system is made up of two parts known as the brain-computer interface part, which reads a sender's brain activity and digitalizes it, and the computer-brain interface part, which writes the delivered brain activity to a receiving brain. As with other technologies, BBI systems have gone through an evolutionary process since they first appeared. The BBI systems have been employed for numerous purposes, including rehabilitation for post-stroke patients, communicating with patients suffering from amyotrophic lateral sclerosis, locked-in syndrome and speech problems following stroke. Also, it has been proposed that a BBI system could play an important role on future battlefields. This technology was not only employed for communicating between two human brains but also for making a direct communication path among different species through which motor or sensory commands could be sent and received. However, the application of BBI systems has provoked significant challenges to human rights principles due to their ability to access and manipulate human brain information. In this study, we aimed to review the brain-computer interface and computer-brain interface technologies as components of BBI systems, the development of BBI systems, applications of this technology, arising ethical issues and expectations for future use.
Collapse
Affiliation(s)
- Pouya Vakilipour
- Student Research Committee, Tabriz University of Medical Sciences, Tabriz, Iran
- Universal Scientific Education and Research Network (USERN), Tehran, Iran
| | - Saba Fekrvand
- Universal Scientific Education and Research Network (USERN), Tehran, Iran
- Brain and Spinal Cord Injury Research Center, Neuroscience Institute, Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
3
|
Ghazizadeh E, Naseri Z, Deigner HP, Rahimi H, Altintas Z. Approaches of wearable and implantable biosensor towards of developing in precision medicine. Front Med (Lausanne) 2024; 11:1390634. [PMID: 39091290 PMCID: PMC11293309 DOI: 10.3389/fmed.2024.1390634] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Accepted: 04/30/2024] [Indexed: 08/04/2024] Open
Abstract
In the relentless pursuit of precision medicine, the intersection of cutting-edge technology and healthcare has given rise to a transformative era. At the forefront of this revolution stands the burgeoning field of wearable and implantable biosensors, promising a paradigm shift in how we monitor, analyze, and tailor medical interventions. As these miniature marvels seamlessly integrate with the human body, they weave a tapestry of real-time health data, offering unprecedented insights into individual physiological landscapes. This log embarks on a journey into the realm of wearable and implantable biosensors, where the convergence of biology and technology heralds a new dawn in personalized healthcare. Here, we explore the intricate web of innovations, challenges, and the immense potential these bioelectronics sentinels hold in sculpting the future of precision medicine.
Collapse
Affiliation(s)
- Elham Ghazizadeh
- Department of Bioinspired Materials and Biosensor Technologies, Faculty of Engineering, Institute of Materials Science, Kiel University, Kiel, Germany
- Department of Medical Biotechnology, School of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Zahra Naseri
- Department of Medical Biotechnology, School of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Hans-Peter Deigner
- Institute of Precision Medicine, Furtwangen University, Villingen-Schwenningen, Germany
- Fraunhofer Institute IZI (Leipzig), Rostock, Germany
- Faculty of Science, Eberhard-Karls-University Tuebingen, Tuebingen, Germany
| | - Hossein Rahimi
- Department of Medicine, University of Pittsburgh, Pittsburgh, PA, United States
| | - Zeynep Altintas
- Department of Bioinspired Materials and Biosensor Technologies, Faculty of Engineering, Institute of Materials Science, Kiel University, Kiel, Germany
| |
Collapse
|
4
|
Shi Y, Li Y, Koike Y. Sparse Logistic Regression-Based EEG Channel Optimization Algorithm for Improved Universality across Participants. Bioengineering (Basel) 2023; 10:664. [PMID: 37370595 DOI: 10.3390/bioengineering10060664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Revised: 05/25/2023] [Accepted: 05/26/2023] [Indexed: 06/29/2023] Open
Abstract
Electroencephalogram (EEG) channel optimization can reduce redundant information and improve EEG decoding accuracy by selecting the most informative channels. This article aims to investigate the universality regarding EEG channel optimization in terms of how well the selected EEG channels can be generalized to different participants. In particular, this study proposes a sparse logistic regression (SLR)-based EEG channel optimization algorithm using a non-zero model parameter ranking method. The proposed channel optimization algorithm was evaluated in both individual analysis and group analysis using the raw EEG data, compared with the conventional channel selection method based on the correlation coefficients (CCS). The experimental results demonstrate that the SLR-based EEG channel optimization algorithm not only filters out most redundant channels (filters 75-96.9% of channels) with a 1.65-5.1% increase in decoding accuracy, but it can also achieve a satisfactory level of decoding accuracy in the group analysis by employing only a few (2-15) common EEG electrodes, even for different participants. The proposed channel optimization algorithm can realize better universality for EEG decoding, which can reduce the burden of EEG data acquisition and enhance the real-world application of EEG-based brain-computer interface (BCI).
Collapse
Affiliation(s)
- Yuxi Shi
- School of Engineering, Tokyo Institute of Technology, Yokohama 226-8503, Japan
| | - Yuanhao Li
- School of Engineering, Tokyo Institute of Technology, Yokohama 226-8503, Japan
| | - Yasuharu Koike
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama 226-8503, Japan
| |
Collapse
|
5
|
Pais-Vieira C, Allahdad MK, Perrotta A, Peres AS, Kunicki C, Aguiar M, Oliveira M, Pais-Vieira M. Neurophysiological correlates of tactile width discrimination in humans. Front Hum Neurosci 2023; 17:1155102. [PMID: 37250697 PMCID: PMC10213448 DOI: 10.3389/fnhum.2023.1155102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 04/25/2023] [Indexed: 05/31/2023] Open
Abstract
Introduction Tactile information processing requires the integration of sensory, motor, and cognitive information. Width discrimination has been extensively studied in rodents, but not in humans. Methods Here, we describe Electroencephalography (EEG) signals in humans performing a tactile width discrimination task. The first goal of this study was to describe changes in neural activity occurring during the discrimination and the response periods. The second goal was to relate specific changes in neural activity to the performance in the task. Results Comparison of changes in power between two different periods of the task, corresponding to the discrimination of the tactile stimulus and the motor response, revealed the engagement of an asymmetrical network associated with fronto-temporo-parieto-occipital electrodes and across multiple frequency bands. Analysis of ratios of higher [Ratio 1: (0.5-20 Hz)/(0.5-45 Hz)] or lower frequencies [Ratio 2: (0.5-4.5 Hz)/(0.5-9 Hz)], during the discrimination period revealed that activity recorded from frontal-parietal electrodes was correlated to tactile width discrimination performance between-subjects, independently of task difficulty. Meanwhile, the dynamics in parieto-occipital electrodes were correlated to the changes in performance within-subjects (i.e., between the first and the second blocks) independently of task difficulty. In addition, analysis of information transfer, using Granger causality, further demonstrated that improvements in performance between blocks were characterized by an overall reduction in information transfer to the ipsilateral parietal electrode (P4) and an increase in information transfer to the contralateral parietal electrode (P3). Discussion The main finding of this study is that fronto-parietal electrodes encoded between-subjects' performances while parieto-occipital electrodes encoded within-subjects' performances, supporting the notion that tactile width discrimination processing is associated with a complex asymmetrical network involving fronto-parieto-occipital electrodes.
Collapse
Affiliation(s)
- Carla Pais-Vieira
- Centro de Investigação Interdisciplinar em Saúde (CIIS), Instituto de Ciências da Saúde (ICS), Universidade Católica Portuguesa, Porto, Portugal
| | - Mehrab K. Allahdad
- Centro de Investigação Interdisciplinar em Saúde (CIIS), Instituto de Ciências da Saúde (ICS), Universidade Católica Portuguesa, Porto, Portugal
| | - André Perrotta
- Centre for Informatics and Systems of the University of Coimbra (CISUC), Coimbra, Portugal
| | - André S. Peres
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
- CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
| | - Carolina Kunicki
- Vasco da Gama Research Center (CIVG), Vasco da Gama University School (EUVG), Coimbra, Portugal
- Center for Neuroscience and Cell Biology (CNC), Center for Innovative Biomedicine and Biotechnology (CIBB), University of Coimbra, Coimbra, Portugal
| | - Mafalda Aguiar
- Department of Medical Sciences, iBiMED-Institute of Biomedicine, Universidade de Aveiro, Aveiro, Portugal
| | - Manuel Oliveira
- Department of Medical Sciences, iBiMED-Institute of Biomedicine, Universidade de Aveiro, Aveiro, Portugal
| | - Miguel Pais-Vieira
- Department of Medical Sciences, iBiMED-Institute of Biomedicine, Universidade de Aveiro, Aveiro, Portugal
| |
Collapse
|
6
|
Yadav H, Maini S. Electroencephalogram based brain-computer interface: Applications, challenges, and opportunities. MULTIMEDIA TOOLS AND APPLICATIONS 2023:1-45. [PMID: 37362726 PMCID: PMC10157593 DOI: 10.1007/s11042-023-15653-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Revised: 07/17/2022] [Accepted: 04/22/2023] [Indexed: 06/28/2023]
Abstract
Brain-Computer Interfaces (BCI) is an exciting and emerging research area for researchers and scientists. It is a suitable combination of software and hardware to operate any device mentally. This review emphasizes the significant stages in the BCI domain, current problems, and state-of-the-art findings. This article also covers how current results can contribute to new knowledge about BCI, an overview of BCI from its early developments to recent advancements, BCI applications, challenges, and future directions. The authors pointed to unresolved issues and expressed how BCI is valuable for analyzing the human brain. Humans' dependence on machines has led humankind into a new future where BCI can play an essential role in improving this modern world.
Collapse
Affiliation(s)
- Hitesh Yadav
- Department of Electrical and Instrumentation Engineering, Sant Longowal Institute of Engineering & Technology, Longowal, Punjab India
| | - Surita Maini
- Department of Electrical and Instrumentation Engineering, Sant Longowal Institute of Engineering & Technology, Longowal, Punjab India
| |
Collapse
|
7
|
Lyreskog DM, Zohny H, Savulescu J, Singh I. Merging Minds: The Conceptual and Ethical Impacts of Emerging Technologies for Collective Minds. NEUROETHICS-NETH 2023; 16:12. [PMID: 37009261 PMCID: PMC10050050 DOI: 10.1007/s12152-023-09516-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Accepted: 02/26/2023] [Indexed: 03/30/2023]
Abstract
AbstractA growing number of technologies are currently being developed to improve and distribute thinking and decision-making. Rapid progress in brain-to-brain interfacing and swarming technologies promises to transform how we think about collective and collaborative cognitive tasks across domains, ranging from research to entertainment, and from therapeutics to military applications. As these tools continue to improve, we are prompted to monitor how they may affect our society on a broader level, but also how they may reshape our fundamental understanding of agency, responsibility, and other key concepts of our moral landscape.In this paper we take a closer look at this class of technologies – Technologies for Collective Minds – to see not only how their implementation may react with commonly held moral values, but also how they challenge our underlying concepts of what constitutes collective or individual agency. We argue that prominent contemporary frameworks for understanding collective agency and responsibility are insufficient in terms of accurately describing the relationships enabled by Technologies for Collective Minds, and that they therefore risk obstructing ethical analysis of the implementation of these technologies in society. We propose a more multidimensional approach to better understand this set of technologies, and to facilitate future research on the ethics of Technologies for Collective Minds.
Collapse
Affiliation(s)
- David M. Lyreskog
- Department of Psychiatry, Warneford Hospital, University of Oxford, Warneford Ln, Oxford, OX3 7JX UK
- Oxford Uehiro Centre for Practical Ethics, University of Oxford, Oxford, UK
- Wellcome Centre for Ethics and Humanities, University of Oxford, Oxford, UK
| | - Hazem Zohny
- Department of Psychiatry, Warneford Hospital, University of Oxford, Warneford Ln, Oxford, OX3 7JX UK
- Oxford Uehiro Centre for Practical Ethics, University of Oxford, Oxford, UK
- Wellcome Centre for Ethics and Humanities, University of Oxford, Oxford, UK
| | - Julian Savulescu
- Oxford Uehiro Centre for Practical Ethics, University of Oxford, Oxford, UK
- Wellcome Centre for Ethics and Humanities, University of Oxford, Oxford, UK
- Centre for Biomedical Ethics, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
- Murdoch Children’s Research Institute, Melbourne, Australia
- University of Melbourne, Melbourne, Australia
| | - Ilina Singh
- Department of Psychiatry, Warneford Hospital, University of Oxford, Warneford Ln, Oxford, OX3 7JX UK
- Wellcome Centre for Ethics and Humanities, University of Oxford, Oxford, UK
| |
Collapse
|
8
|
Oliveira Silva JW, Lima RA, Morya E, Brasil FL, Gonçalves LMG. Improved Behavioral Box and Sensing Techniques for Analysis of Tactile Discrimination Tasks in Rodents. SENSORS (BASEL, SWITZERLAND) 2022; 23:288. [PMID: 36616886 PMCID: PMC9824713 DOI: 10.3390/s23010288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 12/13/2022] [Accepted: 12/22/2022] [Indexed: 06/17/2023]
Abstract
Neuroscience behavioral studies stand out among the research works in this area. In these studies, normally, rodents are put inside closed platforms known as behavioral boxes in order to perform tasks and have their behaviors observed by way of sensors and annotations by hand. In this work, we aim to improve this research process by developing new techniques based upon the full automation of the behavioral box processes for more easily acquiring data. We come up with a new structural design using cutting-edge technology, with enhanced spaces and better materials. We use components that can be easily purchased (or built) and developed new techniques for control and data acquisition. Our new platform allows for more precise control of the opening of the discrimination bars, which was not satisfactorily done with previous platforms. This makes possible the design of more complex decision-making experiments using camera and sensor systems, allowing a better assessment of rodent performance in the discrimination task. All the necessary materials and development documents are made available in a collaborative multi-user platform allowing work replication. With this, the present study provides a low-cost tool with ease of development and construction that can be used by laboratories that work with this type of research.
Collapse
Affiliation(s)
- José Wanderson Oliveira Silva
- Graduate Program in Computer and Electrical Engineering, Universidade Federal do Rio Grande do Norte, Natal 59078-970, Brazil
| | - Renan Araújo Lima
- Graduate Program in Computer and Electrical Engineering, Universidade Federal do Rio Grande do Norte, Natal 59078-970, Brazil
| | - Edgard Morya
- Instituto Santos Dumont, Macaíba 59280-000, Brazil
| | | | - Luiz Marcos Garcia Gonçalves
- Graduate Program in Computer and Electrical Engineering, Universidade Federal do Rio Grande do Norte, Natal 59078-970, Brazil
| |
Collapse
|
9
|
Latheef S. Brain to Brain Interfaces (BBIs) in future military operations; blurring the boundaries of individual responsibility. New Bioeth 2022:10.1007/s40592-022-00171-7. [PMID: 36550229 DOI: 10.1007/s40592-022-00171-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Developments in neurotechnology took a leap forward with the demonstration of the first Brain to Brain Interface (BBI). BBIs enable direct communication between two brains via a Brain Computer Interface (BCI) and bypasses the peripheral nervous system. This discovery promises new possibilities for future battlefield technology. As battlefield technology evolves, it is more likely to place greater demands on future soldiers. Future soldiers are more likely to process large amounts of data derived from an extensive networks of humans and machines. This raises several ethical and philosophical concerns. This paper will look at BBI technology in current stages of research, future BBI applications in the military and how the potential use of BBIs in military operations challenges the way we understand the concept of responsibility. In this paper, I propose that an individual connected to a BBI ought not to be held fully responsible for her actions. The justification for this proposition is based on three key points such as an individual connected to a BBI does not have the ability to act freely, has a diminished sense of self-agency and may not be able to demonstrate authenticity of the thoughts and memories generated when connected to the interface.
Collapse
Affiliation(s)
- Sahar Latheef
- College of Asia and the Pacific, Australian National University, Canberra, ACT, Australia.
| |
Collapse
|
10
|
Petrosyan A, Voskoboinikov A, Sukhinin D, Makarova A, Skalnaya A, Arkhipova N, Sinkin M, Ossadtchi A. Speech decoding from a small set of spatially segregated minimally invasive intracranial EEG electrodes with a compact and interpretable neural network. J Neural Eng 2022; 19. [PMID: 36356309 DOI: 10.1088/1741-2552/aca1e1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Accepted: 11/10/2022] [Indexed: 11/12/2022]
Abstract
Objective. Speech decoding, one of the most intriguing brain-computer interface applications, opens up plentiful opportunities from rehabilitation of patients to direct and seamless communication between human species. Typical solutions rely on invasive recordings with a large number of distributed electrodes implanted through craniotomy. Here we explored the possibility of creating speech prosthesis in a minimally invasive setting with a small number of spatially segregated intracranial electrodes.Approach. We collected one hour of data (from two sessions) in two patients implanted with invasive electrodes. We then used only the contacts that pertained to a single stereotactic electroencephalographic (sEEG) shaft or an electrocorticographic (ECoG) stripe to decode neural activity into 26 words and one silence class. We employed a compact convolutional network-based architecture whose spatial and temporal filter weights allow for a physiologically plausible interpretation.Mainresults. We achieved on average 55% accuracy using only six channels of data recorded with a single minimally invasive sEEG electrode in the first patient and 70% accuracy using only eight channels of data recorded for a single ECoG strip in the second patient in classifying 26+1 overtly pronounced words. Our compact architecture did not require the use of pre-engineered features, learned fast and resulted in a stable, interpretable and physiologically meaningful decision rule successfully operating over a contiguous dataset collected during a different time interval than that used for training. Spatial characteristics of the pivotal neuronal populations corroborate with active and passive speech mapping results and exhibit the inverse space-frequency relationship characteristic of neural activity. Compared to other architectures our compact solution performed on par or better than those recently featured in neural speech decoding literature.Significance. We showcase the possibility of building a speech prosthesis with a small number of electrodes and based on a compact feature engineering free decoder derived from a small amount of training data.
Collapse
Affiliation(s)
- Artur Petrosyan
- Center for Bioelectric Interfaces, Higher School of Economics, Moscow, Russia
| | | | - Dmitrii Sukhinin
- Center for Bioelectric Interfaces, Higher School of Economics, Moscow, Russia
| | - Anna Makarova
- Center for Bioelectric Interfaces, Higher School of Economics, Moscow, Russia
| | | | | | - Mikhail Sinkin
- Moscow State University of Medicine and Dentistry, Scientific Research Institute of First Aid to them. N.V. Sklifosovsky, Moscow, Russia
| | - Alexei Ossadtchi
- Center for Bioelectric Interfaces, Higher School of Economics, Moscow, Russia.,Artificial Intelligence Research Institute, AIRI, Moscow, Russia
| |
Collapse
|
11
|
Jangwan NS, Ashraf GM, Ram V, Singh V, Alghamdi BS, Abuzenadah AM, Singh MF. Brain augmentation and neuroscience technologies: current applications, challenges, ethics and future prospects. Front Syst Neurosci 2022; 16:1000495. [PMID: 36211589 PMCID: PMC9538357 DOI: 10.3389/fnsys.2022.1000495] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 08/31/2022] [Indexed: 12/02/2022] Open
Abstract
Ever since the dawn of antiquity, people have strived to improve their cognitive abilities. From the advent of the wheel to the development of artificial intelligence, technology has had a profound leverage on civilization. Cognitive enhancement or augmentation of brain functions has become a trending topic both in academic and public debates in improving physical and mental abilities. The last years have seen a plethora of suggestions for boosting cognitive functions and biochemical, physical, and behavioral strategies are being explored in the field of cognitive enhancement. Despite expansion of behavioral and biochemical approaches, various physical strategies are known to boost mental abilities in diseased and healthy individuals. Clinical applications of neuroscience technologies offer alternatives to pharmaceutical approaches and devices for diseases that have been fatal, so far. Importantly, the distinctive aspect of these technologies, which shapes their existing and anticipated participation in brain augmentations, is used to compare and contrast them. As a preview of the next two decades of progress in brain augmentation, this article presents a plausible estimation of the many neuroscience technologies, their virtues, demerits, and applications. The review also focuses on the ethical implications and challenges linked to modern neuroscientific technology. There are times when it looks as if ethics discussions are more concerned with the hypothetical than with the factual. We conclude by providing recommendations for potential future studies and development areas, taking into account future advancements in neuroscience innovation for brain enhancement, analyzing historical patterns, considering neuroethics and looking at other related forecasts.
Collapse
Affiliation(s)
- Nitish Singh Jangwan
- Department of Pharmacology, School of Pharmaceutical Sciences and Technology, Sardar Bhagwan Singh University, Balawala, India
| | - Ghulam Md Ashraf
- Pre-Clinical Research Unit, King Fahd Medical Research Center, King Abdulaziz University, Jeddah, Saudi Arabia
- Department of Medical Laboratory Sciences, Faculty of Applied Medical Sciences, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Veerma Ram
- Department of Pharmacology, School of Pharmaceutical Sciences and Technology, Sardar Bhagwan Singh University, Balawala, India
| | - Vinod Singh
- Prabha Harji Lal College of Pharmacy and Paraclinical Sciences, University of Jammu, Jammu, India
| | - Badrah S. Alghamdi
- Pre-Clinical Research Unit, King Fahd Medical Research Center, King Abdulaziz University, Jeddah, Saudi Arabia
- Department of Physiology, Neuroscience Unit, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Adel Mohammad Abuzenadah
- Faculty of Applied Medical Sciences, King Abdulaziz University, Jeddah, Saudi Arabia
- King Fahd Medical Research Center, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Mamta F. Singh
- Department of Pharmacology, School of Pharmaceutical Sciences and Technology, Sardar Bhagwan Singh University, Balawala, India
| |
Collapse
|
12
|
Pandarinath C, Bensmaia SJ. The science and engineering behind sensitized brain-controlled bionic hands. Physiol Rev 2022; 102:551-604. [PMID: 34541898 PMCID: PMC8742729 DOI: 10.1152/physrev.00034.2020] [Citation(s) in RCA: 44] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Revised: 09/07/2021] [Accepted: 09/13/2021] [Indexed: 12/13/2022] Open
Abstract
Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration.
Collapse
Affiliation(s)
- Chethan Pandarinath
- Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, Georgia
- Department of Neurosurgery, Emory University, Atlanta, Georgia
| | - Sliman J Bensmaia
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, Illinois
- Committee on Computational Neuroscience, University of Chicago, Chicago, Illinois
- Grossman Institute for Neuroscience, Quantitative Biology, and Human Behavior, University of Chicago, Chicago, Illinois
| |
Collapse
|
13
|
|
14
|
Qazi R, Parker KE, Kim CY, Rill R, Norris MR, Chung J, Bilbily J, Kim JR, Walicki MC, Gereau GB, Lim H, Xiong Y, Lee JR, Tapia MA, Kravitz AV, Will MJ, Ha S, McCall JG, Jeong JW. Scalable and modular wireless-network infrastructure for large-scale behavioural neuroscience. Nat Biomed Eng 2021; 6:771-786. [PMID: 34824397 PMCID: PMC10180496 DOI: 10.1038/s41551-021-00814-w] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2020] [Accepted: 09/17/2021] [Indexed: 11/09/2022]
Abstract
The use of rodents to acquire understanding of the function of neural circuits and of the physiological, genetic and developmental underpinnings of behaviour has been constrained by limitations in the scalability, automation and high-throughput operation of implanted wireless neural devices. Here we report scalable and modular hardware and software infrastructure for setting up and operating remotely programmable miniaturized wireless networks leveraging Bluetooth Low Energy for the study of the long-term behaviour of large groups of rodents. The integrated system allows for automated, scheduled and real-time experimentation via the simultaneous and independent use of multiple neural devices and equipment within and across laboratories. By measuring the locomotion, feeding, arousal and social behaviours of groups of mice or rats, we show that the system allows for bidirectional data transfer from readily available hardware, and that it can be used with programmable pharmacological or optogenetic stimulation. Scalable and modular wireless-network infrastructure should facilitate the remote operation of fully automated large-scale and long-term closed-loop experiments for the study of neural circuits and animal behaviour.
Collapse
Affiliation(s)
- Raza Qazi
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea.,Department of Electrical, Computer and Energy Engineering, University of Colorado, Boulder, CO, USA
| | - Kyle E Parker
- Department of Anesthesiology, Washington University in St. Louis, St. Louis, MO, USA.,Department of Pharmaceutical and Administrative Sciences, University of Health Sciences and Pharmacy in St. Louis, St. Louis, MO, USA.,Center for Clinical Pharmacology, University of Health Sciences and Pharmacy in St. Louis and Washington University School of Medicine, St. Louis, MO, USA.,Washington University Pain Center, Washington University in St. Louis, St. Louis, MO, USA
| | - Choong Yeon Kim
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Ruediger Rill
- Department of Computer Science, University of Colorado Boulder, Boulder, CO, USA
| | - Makenzie R Norris
- Department of Anesthesiology, Washington University in St. Louis, St. Louis, MO, USA.,Department of Pharmaceutical and Administrative Sciences, University of Health Sciences and Pharmacy in St. Louis, St. Louis, MO, USA.,Center for Clinical Pharmacology, University of Health Sciences and Pharmacy in St. Louis and Washington University School of Medicine, St. Louis, MO, USA.,Washington University Pain Center, Washington University in St. Louis, St. Louis, MO, USA.,Division of Biology and Biomedical Sciences, Washington University School of Medicine, St. Louis, MO, USA
| | - Jaeyoon Chung
- Department of Computer Science, University of Colorado Boulder, Boulder, CO, USA
| | - John Bilbily
- Department of Anesthesiology, Washington University in St. Louis, St. Louis, MO, USA.,Department of Pharmaceutical and Administrative Sciences, University of Health Sciences and Pharmacy in St. Louis, St. Louis, MO, USA.,Center for Clinical Pharmacology, University of Health Sciences and Pharmacy in St. Louis and Washington University School of Medicine, St. Louis, MO, USA.,Washington University Pain Center, Washington University in St. Louis, St. Louis, MO, USA.,Department of Psychiatry, Washington University in St. Louis, St. Louis, MO, USA
| | - Jenny R Kim
- Department of Anesthesiology, Washington University in St. Louis, St. Louis, MO, USA.,Department of Pharmaceutical and Administrative Sciences, University of Health Sciences and Pharmacy in St. Louis, St. Louis, MO, USA.,Center for Clinical Pharmacology, University of Health Sciences and Pharmacy in St. Louis and Washington University School of Medicine, St. Louis, MO, USA.,Washington University Pain Center, Washington University in St. Louis, St. Louis, MO, USA
| | - Marie C Walicki
- Department of Anesthesiology, Washington University in St. Louis, St. Louis, MO, USA.,Department of Pharmaceutical and Administrative Sciences, University of Health Sciences and Pharmacy in St. Louis, St. Louis, MO, USA.,Center for Clinical Pharmacology, University of Health Sciences and Pharmacy in St. Louis and Washington University School of Medicine, St. Louis, MO, USA.,Washington University Pain Center, Washington University in St. Louis, St. Louis, MO, USA
| | - Graydon B Gereau
- Department of Anesthesiology, Washington University in St. Louis, St. Louis, MO, USA.,Department of Pharmaceutical and Administrative Sciences, University of Health Sciences and Pharmacy in St. Louis, St. Louis, MO, USA.,Center for Clinical Pharmacology, University of Health Sciences and Pharmacy in St. Louis and Washington University School of Medicine, St. Louis, MO, USA.,Washington University Pain Center, Washington University in St. Louis, St. Louis, MO, USA
| | - Hyoyoung Lim
- Department of Computer Science, University of Colorado Boulder, Boulder, CO, USA
| | - Yanyu Xiong
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA
| | - Jenna R Lee
- Interdisciplinary Neuroscience Program, University of Missouri, Columbia, MO, USA
| | - Melissa A Tapia
- Department of Psychological Sciences, University of Missouri, Columbia, MO, USA
| | - Alexxai V Kravitz
- Department of Psychiatry, Washington University in St. Louis, St. Louis, MO, USA
| | - Matthew J Will
- Department of Psychological Sciences, University of Missouri, Columbia, MO, USA
| | - Sangtae Ha
- Department of Computer Science, University of Colorado Boulder, Boulder, CO, USA.
| | - Jordan G McCall
- Department of Anesthesiology, Washington University in St. Louis, St. Louis, MO, USA. .,Department of Pharmaceutical and Administrative Sciences, University of Health Sciences and Pharmacy in St. Louis, St. Louis, MO, USA. .,Center for Clinical Pharmacology, University of Health Sciences and Pharmacy in St. Louis and Washington University School of Medicine, St. Louis, MO, USA. .,Washington University Pain Center, Washington University in St. Louis, St. Louis, MO, USA. .,Division of Biology and Biomedical Sciences, Washington University School of Medicine, St. Louis, MO, USA.
| | - Jae-Woong Jeong
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea.
| |
Collapse
|
15
|
Listening to speech with a guinea pig-to-human brain-to-brain interface. Sci Rep 2021; 11:12231. [PMID: 34112826 PMCID: PMC8192924 DOI: 10.1038/s41598-021-90823-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2020] [Accepted: 05/12/2021] [Indexed: 11/30/2022] Open
Abstract
Nicolelis wrote in his 2003 review on brain-machine interfaces (BMIs) that the design of a successful BMI relies on general physiological principles describing how neuronal signals are encoded. Our study explored whether neural information exchanged between brains of different species is possible, similar to the information exchange between computers. We show for the first time that single words processed by the guinea pig auditory system are intelligible to humans who receive the processed information via a cochlear implant. We recorded the neural response patterns to single-spoken words with multi-channel electrodes from the guinea inferior colliculus. The recordings served as a blueprint for trains of biphasic, charge-balanced electrical pulses, which a cochlear implant delivered to the cochlear implant user’s ear. Study participants completed a four-word forced-choice test and identified the correct word in 34.8% of trials. The participants' recognition, defined by the ability to choose the same word twice, whether right or wrong, was 53.6%. For all sessions, the participants received no training and no feedback. The results show that lexical information can be transmitted from an animal to a human auditory system. In the discussion, we will contemplate how learning from the animals might help developing novel coding strategies.
Collapse
|
16
|
Rabadán AT. Neurochips: Considerations from a neurosurgeon's standpoint. Surg Neurol Int 2021; 12:173. [PMID: 34084601 PMCID: PMC8168797 DOI: 10.25259/sni_591_2020] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2020] [Accepted: 03/26/2021] [Indexed: 11/04/2022] Open
Abstract
A neurochip comprises a small device based on the brain-machine interfaces that emulate the functioning synapses. Its implant in the human body allows the interaction of the brain with a computer. Although the data-processing speed is still slower than that of the human brain, they are being developed. There is no ethical conflict as long as it is used for neural rehabilitation or to supply impaired or missing neurological functions. However, other applications emerge as controversial. To the best of our knowledge, there have no been publications about the neurosurgical role in the application of this neurotechnological advance. Deliberation on neurochips is primarily limited to a small circle of scholars such as neurotechnological engineers, artists, philosophers, and bioethicists. Why do we address neurosurgeons? They will be directly involved as they could be required to perform invasive procedures. Future neurosurgeons will have to be a different type of neurosurgeon. They will be part of interdisciplinary teams interacting with computer engineers, neurobiologist, and ethicists. Although a neurosurgeon is not expected to be an expert in all areas, they have to be familiar with them; they have to be prepared to determine indications, contraindications and risks of the procedures, participating in the decision-making processes, and even collaborating in the design of devices to preserve anatomic structures. Social, economic, and legal aspects are also inherent to the neurosurgical activity; therefore, these aspects should also be considered.
Collapse
Affiliation(s)
- Alejandra T Rabadán
- Division of Neurosurgery, Institute of Medical Research Dr Alfredo Lanari, University of Buenos Aires and Academic Council on Ethics in Medicine, Buenos Aires, Argentina
| |
Collapse
|
17
|
Nam CS, Traylor Z, Chen M, Jiang X, Feng W, Chhatbar PY. Direct Communication Between Brains: A Systematic PRISMA Review of Brain-To-Brain Interface. Front Neurorobot 2021; 15:656943. [PMID: 34025383 PMCID: PMC8138057 DOI: 10.3389/fnbot.2021.656943] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Accepted: 03/22/2021] [Indexed: 12/28/2022] Open
Abstract
This paper aims to review the current state of brain-to-brain interface (B2BI) technology and its potential. B2BIs function via a brain-computer interface (BCI) to read a sender's brain activity and a computer-brain interface (CBI) to write a pattern to a receiving brain, transmitting information. We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) to systematically review current literature related to B2BI, resulting in 15 relevant publications. Experimental papers primarily used transcranial magnetic stimulation (tMS) for the CBI portion of their B2BI. Most targeted the visual cortex to produce phosphenes. In terms of study design, 73.3% (11) are unidirectional and 86.7% (13) use only a 1:1 collaboration model (subject to subject). Limitations are apparent, as the CBI method varied greatly between studies indicating no agreed upon neurostimulatory method for transmitting information. Furthermore, only 12.4% (2) studies are more complicated than a 1:1 model and few researchers studied direct bidirectional B2BI. These studies show B2BI can offer advances in human communication and collaboration, but more design and experiments are needed to prove potential. B2BIs may allow rehabilitation therapists to pass information mentally, activating a patient's brain to aid in stroke recovery and adding more complex bidirectionality may allow for increased behavioral synchronization between users. The field is very young, but applications of B2BI technology to neuroergonomics and human factors engineering clearly warrant more research.
Collapse
Affiliation(s)
- Chang S. Nam
- Edward P. Fitts Department of Industrial & Systems Engineering, North Carolina State University, Raleigh, NC, United States
| | - Zachary Traylor
- Edward P. Fitts Department of Industrial & Systems Engineering, North Carolina State University, Raleigh, NC, United States
| | - Mengyue Chen
- Department of Electrical & Computer Engineering, North Carolina State University, Raleigh, NC, United States
| | - Xiaoning Jiang
- Department of Electrical & Computer Engineering, North Carolina State University, Raleigh, NC, United States
| | - Wuwei Feng
- Department of Neurology, Duke University, Durham, NC, United States
| | | |
Collapse
|
18
|
Schmitz S. TechnoBrainBodies-in-Cultures: An Intersectional Case. FRONTIERS IN SOCIOLOGY 2021; 6:651486. [PMID: 33987221 PMCID: PMC8112819 DOI: 10.3389/fsoc.2021.651486] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/09/2021] [Accepted: 02/23/2021] [Indexed: 06/12/2023]
Abstract
The cyborgization of brainbodies with computer hardware and software today ranges in scope from the realization of Brain-Computer Interfaces (BCIs) to visions of mind upload to silicon, the latter being targeted toward a transhuman future. Refining posthumanist concepts to formulate a posthumanities perspective, and contrasting those approaches with transhumanist trajectories, I explore the intersectional dimension of realizations and visions of neuro-technological developments, which I name TechnoBrainBodies-in-Cultures. In an intersectional analysis, I investigate the embedding and legitimation of transhumanist visions brought about by neuroscientific research and neuro-technological development based on a concept of modern neurobiological determinism. The conjoined trajectories of BCI research and development and transhumanist visions perpetuate the inscription of intersectional norms, with the concomitant danger of producing discriminatory effects. This culminates in normative capacity being seen as a conflation of the abled, successful, white masculinized techno-brain with competition. My deeper analysis, however, also enables displacements within recent BCI research and development to be characterized: from ''thought-translation" to affective conditioning and from controllability to obstinacy within the BCI, going so far as to open the closed loop. These realizations challenge notions about the BCI's actor status and agency and foster questions about shifts in the corresponding subject-object relations. Based on these analyses, I look at the effects of neuro-technological and transhumanist governmentality on the question of whose lives are to be improved and whose lives should be excluded from these developments. Within the framework of political feminist materialisms, I combine the concept of posthumanities with my concept of TechnoBrainBodies-in-Cultures to envision and discuss a material-discursive strategy, encompassing dimensions of affect, sociality, resistance, compassion, cultural diversity, ethnic diversity, multiple sexes/sexualities, aging, dis/abilities-in short, all of this "intersectional stuff"-as well as obstinate techno-brain agencies and contumacies foreseen in these cyborgian futures.
Collapse
|
19
|
Shea TB. An Overview of Studies Demonstrating that ex vivo Neuronal Networks Display Multiple Complex Behaviors: Emergent Properties of Nearest-Neighbor Interactions of Excitatory and Inhibitory Neurons. Open Neurol J 2021. [DOI: 10.2174/1874205x02115010003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The responsiveness of the human nervous system ranges from the basic sensory interpretation and motor regulation to so-called higher-order functions such as emotion and consciousness. Aspects of higher-order functions are displayed by other mammals and birds. In efforts to understand how neuronal interaction can generate such a diverse functionality, murine embryonic cortical neurons were cultured on Petri dishes containing multi-electrode arrays that allowed recording and stimulation of neuronal activity. Despite the lack of major architectural features that govern nervous system development in situ, this overview of multiple studies demonstrated that these 2-dimensional ex vivo neuronal networks nevertheless recapitulate multiple key aspects of nervous system development and activity in situ, including density-dependent, the spontaneous establishment of a functional network that displayed complex signaling patterns, and responsiveness to environmental stimulation including generation of appropriate motor output and long-term potentiation. These findings underscore that the basic interplay of excitatory and inhibitory neuronal activity underlies all aspects of nervous system functionality. This reductionist system may be useful for further examination of neuronal function under developmental, homeostatic, and neurodegenerative conditions.
Collapse
|
20
|
Brain-to-brain communication: the possible role of brain electromagnetic fields (As a Potential Hypothesis). Heliyon 2021; 7:e06363. [PMID: 33732922 PMCID: PMC7937662 DOI: 10.1016/j.heliyon.2021.e06363] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2020] [Revised: 12/29/2020] [Accepted: 02/22/2021] [Indexed: 11/23/2022] Open
Abstract
Up now, the communication between brains of different humans or animals has been confirmed and confined by the sensory medium and motor facilities of body. Recently, direct brain-to-brain communication (DBBC) outside the conventional five senses has been verified between animals and humans. Nevertheless, no empirical studies or serious discussion have been performed to elucidate the mechanism behind this process. The validation of DBBC has been documented via recording similar pattern of action potentials occurring in the brain cortex of two animals. With regard to action potentials in brain neurons, the magnetic field resulting from the action potentials created in neurons is one of the tools where the brain of one animal can affect the brain of another. It has been shown that different animals, even humans, have the power to understand the magnetic field. Cryptochrome, which exists in the retina and in different regions of the brain, has been confirmed to be able to perceive magnetic fields and convert magnetic fields to action potentials. Recently, iron particles (Fe3O4) believed to be functioning as magnets have been found in various parts of the brain, and are postulated as magnetic field receptors. Newly developed supersensitive magnetic sensors made of iron magnets that can sense the brain's magnetic field have suggested the idea that these Fe3O4 particles or magnets may be capable of perceiving the brain's extremely weak magnetic field. The present study suggests that it is possible the extremely week magnetic field in one animal's brain to transmit vital and accurate information to another animal's brain.
Collapse
|
21
|
Saha S, Mamun KA, Ahmed K, Mostafa R, Naik GR, Darvishi S, Khandoker AH, Baumert M. Progress in Brain Computer Interface: Challenges and Opportunities. Front Syst Neurosci 2021; 15:578875. [PMID: 33716680 PMCID: PMC7947348 DOI: 10.3389/fnsys.2021.578875] [Citation(s) in RCA: 122] [Impact Index Per Article: 30.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Accepted: 01/06/2021] [Indexed: 12/13/2022] Open
Abstract
Brain computer interfaces (BCI) provide a direct communication link between the brain and a computer or other external devices. They offer an extended degree of freedom either by strengthening or by substituting human peripheral working capacity and have potential applications in various fields such as rehabilitation, affective computing, robotics, gaming, and neuroscience. Significant research efforts on a global scale have delivered common platforms for technology standardization and help tackle highly complex and non-linear brain dynamics and related feature extraction and classification challenges. Time-variant psycho-neurophysiological fluctuations and their impact on brain signals impose another challenge for BCI researchers to transform the technology from laboratory experiments to plug-and-play daily life. This review summarizes state-of-the-art progress in the BCI field over the last decades and highlights critical challenges.
Collapse
Affiliation(s)
- Simanto Saha
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Khondaker A. Mamun
- Advanced Intelligent Multidisciplinary Systems (AIMS) Lab, Department of Computer Science and Engineering, United International University, Dhaka, Bangladesh
| | - Khawza Ahmed
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Raqibul Mostafa
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Ganesh R. Naik
- Adelaide Institute for Sleep Health, College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia
| | - Sam Darvishi
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
| | - Ahsan H. Khandoker
- Healthcare Engineering Innovation Center, Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - Mathias Baumert
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
| |
Collapse
|
22
|
Xu Y, Ma Y, Yu Y, Chen S, Chang Y, Chen X, Xu G. Self-powered, ultra-high detectivity and high-speed near-infrared photodetectors from stacked-layered MoSe 2/Si heterojunction. NANOTECHNOLOGY 2021; 32:075201. [PMID: 33113523 DOI: 10.1088/1361-6528/abc57d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Photodetectors based on high-performance, two-dimensional (2D) layered transition metal dichalcogenides (TMDCs) are limited by the synthesis of larger-area 2D TMDCs with high quality and optimized device structure. Herein, we report, for the first time, a uniform and stacked-layered MoSe2 film of high quality was deposited onto Si substrate by using the pulsed laser deposition technique, and then in situ constructed layered MoSe2/Si 2D-3D vertical heterojunction. The resultant heterojunction showed a wide near-infrared response up to 1550 nm, with both ultra-high detectivity up to 1.4 × 1014 Jones and a response speed approaching 120 ns at zero bias, which are much better than most previous 2D TMDC-based photodetectors and are comparable to that of commercial Si photodiodes. The high performance of the layered MoSe2/Si heterojunction can be attributed to be the high-quality stacked-layered MoSe2 film, the excellent rectifying behavior of the device and the n-n heterojunction structure. Moreover, the defect-enhanced near-infrared response was determined to be Se vacancies from the density functional theory (DFT) simulations. These results suggest great potential of the layered MoSe2/Si 2D-3D heterojunctions in the field of communication light detection. More importantly, the in situ grown heterojunctions are expected to boost the development of other 2D TMDCs heterojunction-based optoelectronic devices.
Collapse
Affiliation(s)
- Yan Xu
- School of Electrical Science and Applied Physics, Micro Electromechanical System Research Center of Engineering and Technology of Anhui Province, Hefei University of Technology, Hefei, Anhui, 230009, People's Republic of China
- Intelligent Interconnected Systems Laboratory of Anhui Province (Hefei University of Technology), Anhui, 230009, People's Republic of China
| | - Yuanming Ma
- School of Electrical Science and Applied Physics, Micro Electromechanical System Research Center of Engineering and Technology of Anhui Province, Hefei University of Technology, Hefei, Anhui, 230009, People's Republic of China
| | - Yongqiang Yu
- School of Electrical Science and Applied Physics, Micro Electromechanical System Research Center of Engineering and Technology of Anhui Province, Hefei University of Technology, Hefei, Anhui, 230009, People's Republic of China
- Intelligent Interconnected Systems Laboratory of Anhui Province (Hefei University of Technology), Anhui, 230009, People's Republic of China
| | - Shirong Chen
- School of Electrical Science and Applied Physics, Micro Electromechanical System Research Center of Engineering and Technology of Anhui Province, Hefei University of Technology, Hefei, Anhui, 230009, People's Republic of China
| | - Yajing Chang
- State Key Laboratory of Pulsed Power Laser Technology, National University of Defense Technology, Hefei, Anhui, 230037, People's Republic of China
| | - Xing Chen
- School of Electrical Science and Applied Physics, Micro Electromechanical System Research Center of Engineering and Technology of Anhui Province, Hefei University of Technology, Hefei, Anhui, 230009, People's Republic of China
| | - Gaobin Xu
- School of Electrical Science and Applied Physics, Micro Electromechanical System Research Center of Engineering and Technology of Anhui Province, Hefei University of Technology, Hefei, Anhui, 230009, People's Republic of China
| |
Collapse
|
23
|
Petrosyan A, Sinkin M, Lebedev MA, Ossadtchi A. Decoding and interpreting cortical signals with a compact convolutional neural network. J Neural Eng 2021; 18. [PMID: 33524962 DOI: 10.1088/1741-2552/abe20e] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Accepted: 02/01/2021] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Brain-computer interfaces (BCIs) decode information from neural activity and send it to external devices. The use of Deep Learning approaches for decoding allows for automatic feature engineering within the specific decoding task. Physiologically plausible interpretation of the network parameters ensures the robustness of the learned decision rules and opens the exciting opportunity for automatic knowledge discovery. APPROACH We describe a compact convolutional network-based architecture for adaptive decoding of electrocorticographic (ECoG) data into finger kinematics. We also propose a novel theoretically justified approach to interpreting the spatial and temporal weights in the architectures that combine adaptation in both space and time. The obtained spatial and frequency patterns characterizing the neuronal populations pivotal to the specific decoding task can then be interpreted by fitting appropriate spatial and dynamical models. MAIN RESULTS We first tested our solution using realistic Monte-Carlo simulations. Then, when applied to the ECoG data from Berlin BCI competition IV dataset, our architecture performed comparably to the competition winners without requiring explicit feature engineering. Using the proposed approach to the network weights interpretation we could unravel the spatial and the spectral patterns of the neuronal processes underlying the successful decoding of finger kinematics from an ECoG dataset. Finally we have also applied the entire pipeline to the analysis of a 32-channel EEG motor-imagery dataset and observed physiologically plausible patterns specific to the task. SIGNIFICANCE We described a compact and interpretable CNN architecture derived from the basic principles and encompassing the knowledge in the field of neural electrophysiology. For the first time in the context of such multibranch architectures with factorized spatial and temporal processing we presented theoretically justified weights interpretation rules. We verified our recipes using simulations and real data and demonstrated that the proposed solution offers a good decoder and a tool for investigating motor control neural mechanisms.
Collapse
Affiliation(s)
- Artur Petrosyan
- Center for Bioelectric Interfaces, Higher School of Economics, Krivokolennyi per., 3, Moscow, Russia, 10100, RUSSIAN FEDERATION
| | - Mikhail Sinkin
- A I Yevdokimov Moscow State University of Medicine and Dentistry of the Ministry of Healthcare of the Russian Federation Faculty of Dentistry, Delegatskaya St., 20, p. 1, Moskva, Moskva, 127473, RUSSIAN FEDERATION
| | - M A Lebedev
- Neurobiology, Duke University, Hudson Hall 136, Durham, NC 27708-0281, USA, Durham, 27517, UNITED STATES
| | - Alexei Ossadtchi
- Center for Bioelectric Interfaces, Higher School of Economics, Krivokolennyi per., 3, Moscow, Russia, 101000, RUSSIAN FEDERATION
| |
Collapse
|
24
|
O'Brien JT, Nelson C. Assessing the Risks Posed by the Convergence of Artificial Intelligence and Biotechnology. Health Secur 2020; 18:219-227. [PMID: 32559154 PMCID: PMC7310294 DOI: 10.1089/hs.2019.0122] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2019] [Revised: 03/04/2020] [Accepted: 04/29/2020] [Indexed: 12/22/2022] Open
Abstract
Rapid developments are currently taking place in the fields of artificial intelligence (AI) and biotechnology, and applications arising from the convergence of these 2 fields are likely to offer immense opportunities that could greatly benefit human health and biosecurity. The combination of AI and biotechnology could potentially lead to breakthroughs in precision medicine, improved biosurveillance, and discovery of novel medical countermeasures as well as facilitate a more effective public health emergency response. However, as is the case with many preceding transformative technologies, new opportunities often present new risks in parallel. Understanding the current and emerging risks at the intersection of AI and biotechnology is crucial for health security specialists and unlikely to be achieved by examining either field in isolation. Uncertainties multiply as technologies merge, showcasing the need to identify robust assessment frameworks that could adequately analyze the risk landscape emerging at the convergence of these 2 domains.This paper explores the criteria needed to assess risks associated with Artificial intelligence and biotechnology and evaluates 3 previously published risk assessment frameworks. After highlighting their strengths and limitations and applying to relevant Artificial intelligence and biotechnology examples, the authors suggest a hybrid framework with recommendations for future approaches to risk assessment for convergent technologies.
Collapse
Affiliation(s)
- John T. O'Brien
- John T. O'Brien, MS, is a Research Associate, Bipartisan Commission on Biodefense, Washington, DC
| | - Cassidy Nelson
- Cassidy Nelson, MBBS, MPH, is a Research Scholar, Future of Humanity Institute, University of Oxford, Oxford, UK
| |
Collapse
|
25
|
Aguiar LA, de Vasconcelos NAP, Tunes GC, Fontenele AJ, de Albuquerque Nogueira R, Reyes MB, Carelli PV. Low-cost open hardware system for behavioural experiments simultaneously with electrophysiological recordings. HARDWAREX 2020; 8:e00132. [PMID: 35498270 PMCID: PMC9041193 DOI: 10.1016/j.ohx.2020.e00132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
A major frontier in neuroscience is to find neural correlates of perception, learning, decision making, and a variety of other types of behavior. In the last decades, modern devices allow simultaneous recordings of different operant responses and the electrical activity of large neuronal populations. However, the commercially available instruments for studying operant conditioning are expensive, and the design of low-cost chambers has emerged as an appealing alternative to resource-limited laboratories engaged in animal behavior. In this article, we provide a full description of a platform that records the operant behavior and synchronizes it with the electrophysiological activity. The programming of this platform is open source, flexible, and adaptable to a wide range of operant conditioning tasks. We also show results of operant conditioning experiments with freely moving rats with simultaneous electrophysiological recordings.
Collapse
Affiliation(s)
- Leandro A.A. Aguiar
- Departamento de Morfologia e Fisiologia Animal, Universidade Federal Rural de Pernambuco, Recife, PE 52171-900, Brazil
- Physics Department, Federal University of Pernambuco, Recife, PE 50670-901, Brazil
- Departamenteo de Ciências Fundamentais e Sociais, Universidade Federal da Paraíba, Areia, PB, Brazil
| | - Nivaldo A P de Vasconcelos
- Physics Department, Federal University of Pernambuco, Recife, PE 50670-901, Brazil
- Department of Biomedical Engineering, Federal University of Pernambuco, Recife, PE 50670-901, Brazil
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga 4710-057, Portugal
- ICVS/3B’s – PT Government Associate Laboratory, Braga/Guimarães 4806-909, Portugal
| | - Gabriela Chiuffa Tunes
- Center for Mathematics, Computing and Cognition, Universidade Federal do ABC, Santo André, SP 09210-580, Brazil
| | - Antonio J. Fontenele
- Physics Department, Federal University of Pernambuco, Recife, PE 50670-901, Brazil
| | | | - Marcelo Bussotti Reyes
- Center for Mathematics, Computing and Cognition, Universidade Federal do ABC, Santo André, SP 09210-580, Brazil
| | - Pedro V. Carelli
- Physics Department, Federal University of Pernambuco, Recife, PE 50670-901, Brazil
| |
Collapse
|
26
|
Yang L, Li M, Yang L, Wang H, Wan H, Shang Z. Functional connectivity changes in the intra- and inter-brain during the construction of the multi-brain network of pigeons. Brain Res Bull 2020; 161:147-157. [DOI: 10.1016/j.brainresbull.2020.04.015] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2020] [Revised: 04/15/2020] [Accepted: 04/20/2020] [Indexed: 02/07/2023]
|
27
|
Yang SH, Wang HL, Lo YC, Lai HY, Chen KY, Lan YH, Kao CC, Chou C, Lin SH, Huang JW, Wang CF, Kuo CH, Chen YY. Inhibition of Long-Term Variability in Decoding Forelimb Trajectory Using Evolutionary Neural Networks With Error-Correction Learning. Front Comput Neurosci 2020; 14:22. [PMID: 32296323 PMCID: PMC7136463 DOI: 10.3389/fncom.2020.00022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2019] [Accepted: 03/04/2020] [Indexed: 11/13/2022] Open
Abstract
Objective: In brain machine interfaces (BMIs), the functional mapping between neural activities and kinematic parameters varied over time owing to changes in neural recording conditions. The variability in neural recording conditions might result in unstable long-term decoding performance. Relevant studies trained decoders with several days of training data to make them inherently robust to changes in neural recording conditions. However, these decoders might not be robust to changes in neural recording conditions when only a few days of training data are available. In time-series prediction and feedback control system, an error feedback was commonly adopted to reduce the effects of model uncertainty. This motivated us to introduce an error feedback to a neural decoder for dealing with the variability in neural recording conditions. Approach: We proposed an evolutionary constructive and pruning neural network with error feedback (ECPNN-EF) as a neural decoder. The ECPNN-EF with partially connected topology decoded the instantaneous firing rates of each sorted unit into forelimb movement of a rat. Furthermore, an error feedback was adopted as an additional input to provide kinematic information and thus compensate for changes in functional mapping. The proposed neural decoder was trained on data collected from a water reward-related lever-pressing task for a rat. The first 2 days of data were used to train the decoder, and the subsequent 10 days of data were used to test the decoder. Main Results: The ECPNN-EF under different settings was evaluated to better understand the impact of the error feedback and partially connected topology. The experimental results demonstrated that the ECPNN-EF achieved significantly higher daily decoding performance with smaller daily variability when using the error feedback and partially connected topology. Significance: These results suggested that the ECPNN-EF with partially connected topology could cope with both within- and across-day changes in neural recording conditions. The error feedback in the ECPNN-EF compensated for decreases in decoding performance when neural recording conditions changed. This mechanism made the ECPNN-EF robust against changes in functional mappings and thus improved the long-term decoding stability when only a few days of training data were available.
Collapse
Affiliation(s)
- Shih-Hung Yang
- Department of Mechanical Engineering, National Cheng Kung University, Tainan, Taiwan
| | - Han-Lin Wang
- Department of Biomedical Engineering, National Yang Ming University, Taipei, Taiwan
| | - Yu-Chun Lo
- The Ph.D. Program for Neural Regenerative Medicine, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
| | - Hsin-Yi Lai
- Key Laboratory of Medical Neurobiology of Zhejiang Province, Department of Neurology of the Second Affiliated Hospital, Interdisciplinary Institute of Neuroscience and Technology, Zhejiang University School of Medicine, Hangzhou, China
- Key Laboratory of Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou, China
| | - Kuan-Yu Chen
- Department of Biomedical Engineering, National Yang Ming University, Taipei, Taiwan
| | - Yu-Hao Lan
- Department of Biomedical Engineering, National Yang Ming University, Taipei, Taiwan
| | - Ching-Chia Kao
- Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan
| | - Chin Chou
- Department of Regulatory & Quality Sciences, University of Southern California, Los Angeles, CA, United States
| | - Sheng-Huang Lin
- Buddhist Tzu Chi Medical Foundation, Department of Neurology, Hualien Tzu Chi Hospital, Hualien, Taiwan
- Department of Neurology, School of Medicine, Tzu Chi University, Hualien, Taiwan
| | - Jyun-We Huang
- Department of Mechanical Engineering, National Cheng Kung University, Tainan, Taiwan
| | - Ching-Fu Wang
- Department of Biomedical Engineering, National Yang Ming University, Taipei, Taiwan
| | - Chao-Hung Kuo
- Department of Biomedical Engineering, National Yang Ming University, Taipei, Taiwan
- Department of Neurosurgery, Neurological Institute, Taipei Veterans General Hospital, Taipei, Taiwan
- Department of Neurological Surgery, University of Washington, Seattle, WA, United States
| | - You-Yin Chen
- Department of Biomedical Engineering, National Yang Ming University, Taipei, Taiwan
- The Ph.D. Program for Neural Regenerative Medicine, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
| |
Collapse
|
28
|
Lu L, Wang R, Luo M. An optical brain-to-brain interface supports rapid information transmission for precise locomotion control. SCIENCE CHINA-LIFE SCIENCES 2020; 63:875-885. [PMID: 32266609 DOI: 10.1007/s11427-020-1675-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/16/2020] [Accepted: 03/05/2020] [Indexed: 10/24/2022]
Abstract
Brain-to-brain interfaces (BtBIs) hold exciting potentials for direct communication between individual brains. However, technical challenges often limit their performance in rapid information transfer. Here, we demonstrate an optical brain-to-brain interface that transmits information regarding locomotor speed from one mouse to another and allows precise, real-time control of locomotion across animals with high information transfer rate. We found that the activity of the genetically identified neuromedin B (NMB) neurons within the nucleus incertus (NI) precisely predicts and critically controls locomotor speed. By optically recording Ca2+ signals from the NI of a "Master" mouse and converting them to patterned optogenetic stimulations of the NI of an "Avatar" mouse, the BtBI directed the Avatar mice to closely mimic the locomotion of their Masters with information transfer rate about two orders of magnitude higher than previous BtBIs. These results thus provide proof-of-concept that optical BtBIs can rapidly transmit neural information and control dynamic behaviors across individuals.
Collapse
Affiliation(s)
- Lihui Lu
- School of Life Sciences, Tsinghua University, Beijing, 100084, China.,Tsinghua-Peking Center for Life Sciences, Tsinghua University, Beijing, 100084, China.,National Institute of Biological Sciences (NIBS), Beijing, 102206, China
| | - Ruiyu Wang
- National Institute of Biological Sciences (NIBS), Beijing, 102206, China.,School of Life Sciences, Peking University, Beijing, 100871, China.,Peking University-Tsinghua University-NIBS Joint Graduate Program, Beijing, 102206, China
| | - Minmin Luo
- Tsinghua-Peking Center for Life Sciences, Tsinghua University, Beijing, 100084, China. .,National Institute of Biological Sciences (NIBS), Beijing, 102206, China. .,Peking University-Tsinghua University-NIBS Joint Graduate Program, Beijing, 102206, China. .,Chinese Institute for Brain Research, Beijing, 102206, China. .,Tsinghua Institute of Multidisciplinary Biomedical Research (TIMBR), Beijing, 102206, China.
| |
Collapse
|
29
|
Nazari S, Amiri M, Faez K, Van Hulle MM. Information Transmitted From Bioinspired Neuron-Astrocyte Network Improves Cortical Spiking Network's Pattern Recognition Performance. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2020; 31:464-474. [PMID: 30990195 DOI: 10.1109/tnnls.2019.2905003] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
We trained two spiking neural networks (SNNs), the cortical spiking network (CSN) and the cortical neuron-astrocyte network (CNAN), using a spike-based unsupervised method, on the MNIST and alpha-digit data sets and achieve an accuracy of 96.1% and 77.35%, respectively. We then connected CNAN to CSN by preserving maximum synchronization between them thanks to the concept of prolate spheroidal wave functions (PSWF). As a result, CSN receives additional information from CNAN without retraining. The important outcome is that CSN reaches 70.57% correct classification rate on capital letters without being trained on them. The overall contribution of transfer is 87.47%. We observed that for CSN the classifying neurons that relate to digits 0-9 of the alpha-digit data set are completely supported by the ones that relate to digits 0-9 of the MNIST data set. This means that CSN recognizes the similarity between the digits of the MNIST and alpha-digit data sets and classifies each digit of both data sets in the same class.
Collapse
|
30
|
A Brain to Spine Interface for Transferring Artificial Sensory Information. Sci Rep 2020; 10:900. [PMID: 31964948 PMCID: PMC6972753 DOI: 10.1038/s41598-020-57617-3] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2019] [Accepted: 01/03/2020] [Indexed: 12/13/2022] Open
Abstract
Lack of sensory feedback is a major obstacle in the rapid absorption of prosthetic devices by the brain. While electrical stimulation of cortical and subcortical structures provides unique means to deliver sensory information to higher brain structures, these approaches require highly invasive surgery and are dependent on accurate targeting of brain structures. Here, we propose a semi-invasive method, Dorsal Column Stimulation (DCS) as a tool for transferring sensory information to the brain. Using this new approach, we show that rats can learn to discriminate artificial sensations generated by DCS and that DCS-induced learning results in corticostriatal plasticity. We also demonstrate a proof of concept brain-to-spine interface (BTSI), whereby tactile and artificial sensory information are decoded from the brain of an “encoder” rat, transformed into DCS pulses, and delivered to the spinal cord of a second “decoder” rat while the latter performs an analog-to-digital conversion during a sensory discrimination task. These results suggest that DCS can be used as an effective sensory channel to transmit prosthetic information to the brain or between brains, and could be developed as a novel platform for delivering tactile and proprioceptive feedback in clinical applications of brain-machine interfaces.
Collapse
|
31
|
Levin M. The Computational Boundary of a "Self": Developmental Bioelectricity Drives Multicellularity and Scale-Free Cognition. Front Psychol 2019; 10:2688. [PMID: 31920779 PMCID: PMC6923654 DOI: 10.3389/fpsyg.2019.02688] [Citation(s) in RCA: 104] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2019] [Accepted: 11/14/2019] [Indexed: 12/12/2022] Open
Abstract
All epistemic agents physically consist of parts that must somehow comprise an integrated cognitive self. Biological individuals consist of subunits (organs, cells, and molecular networks) that are themselves complex and competent in their own native contexts. How do coherent biological Individuals result from the activity of smaller sub-agents? To understand the evolution and function of metazoan creatures' bodies and minds, it is essential to conceptually explore the origin of multicellularity and the scaling of the basal cognition of individual cells into a coherent larger organism. In this article, I synthesize ideas in cognitive science, evolutionary biology, and developmental physiology toward a hypothesis about the origin of Individuality: "Scale-Free Cognition." I propose a fundamental definition of an Individual based on the ability to pursue goals at an appropriate level of scale and organization and suggest a formalism for defining and comparing the cognitive capacities of highly diverse types of agents. Any Self is demarcated by a computational surface - the spatio-temporal boundary of events that it can measure, model, and try to affect. This surface sets a functional boundary - a cognitive "light cone" which defines the scale and limits of its cognition. I hypothesize that higher level goal-directed activity and agency, resulting in larger cognitive boundaries, evolve from the primal homeostatic drive of living things to reduce stress - the difference between current conditions and life-optimal conditions. The mechanisms of developmental bioelectricity - the ability of all cells to form electrical networks that process information - suggest a plausible set of gradual evolutionary steps that naturally lead from physiological homeostasis in single cells to memory, prediction, and ultimately complex cognitive agents, via scale-up of the basic drive of infotaxis. Recent data on the molecular mechanisms of pre-neural bioelectricity suggest a model of how increasingly sophisticated cognitive functions emerge smoothly from cell-cell communication used to guide embryogenesis and regeneration. This set of hypotheses provides a novel perspective on numerous phenomena, such as cancer, and makes several unique, testable predictions for interdisciplinary research that have implications not only for evolutionary developmental biology but also for biomedicine and perhaps artificial intelligence and exobiology.
Collapse
Affiliation(s)
- Michael Levin
- Allen Discovery Center at Tufts University, Medford, MA, United States
- Wyss Institute for Biologically Inspired Engineering, Harvard University, Boston, MA, United States
| |
Collapse
|
32
|
Volkova K, Lebedev MA, Kaplan A, Ossadtchi A. Decoding Movement From Electrocorticographic Activity: A Review. Front Neuroinform 2019; 13:74. [PMID: 31849632 PMCID: PMC6901702 DOI: 10.3389/fninf.2019.00074] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Accepted: 11/14/2019] [Indexed: 01/08/2023] Open
Abstract
Electrocorticography (ECoG) holds promise to provide efficient neuroprosthetic solutions for people suffering from neurological disabilities. This recording technique combines adequate temporal and spatial resolution with the lower risks of medical complications compared to the other invasive methods. ECoG is routinely used in clinical practice for preoperative cortical mapping in epileptic patients. During the last two decades, research utilizing ECoG has considerably grown, including the paradigms where behaviorally relevant information is extracted from ECoG activity with decoding algorithms of different complexity. Several research groups have advanced toward the development of assistive devices driven by brain-computer interfaces (BCIs) that decode motor commands from multichannel ECoG recordings. Here we review the evolution of this field and its recent tendencies, and discuss the potential areas for future development.
Collapse
Affiliation(s)
- Ksenia Volkova
- Center for Bioelectric Interfaces, Higher School of Economics, National Research University, Moscow, Russia
| | - Mikhail A. Lebedev
- Center for Bioelectric Interfaces, Higher School of Economics, National Research University, Moscow, Russia
| | - Alexander Kaplan
- Center for Bioelectric Interfaces, Higher School of Economics, National Research University, Moscow, Russia
- Center for Biotechnology Development, National Research Lobachevsky State University of Nizhny Novgorod, Nizhny Novgorod, Russia
- Laboratory for Neurophysiology and Neuro-Computer Interfaces, Faculty of Biology, Lomonosov Moscow State University, Moscow, Russia
| | - Alexei Ossadtchi
- Center for Bioelectric Interfaces, Higher School of Economics, National Research University, Moscow, Russia
| |
Collapse
|
33
|
Bakeman U, Eilam H, Schild CM, Grinstein D, Eshed Y, Laster M, Fride E, Anavi-Goffer S. Detection of Impending Aggressive Outbursts in Patients with Psychiatric Disorders: Violence Clues from Dogs. Sci Rep 2019; 9:17228. [PMID: 31754122 PMCID: PMC6872740 DOI: 10.1038/s41598-019-52940-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2019] [Accepted: 10/24/2019] [Indexed: 01/23/2023] Open
Abstract
Aggression in psychiatric wards is a continuing matter of concern for both patients and medical staff. Here we have tested the hypothesis that the frequency of such incidents can be reduced with a new strategy of using trained alert dogs that warn of impending violent outbursts. Dogs were positioned among patients in psychiatric wards. Analyses show that the dogs warned of impending aggressive outbursts, responding to signals from a specific patient out of a group of unfamiliar psychotic patients. Their alerts were not a response to stress as canine cortisol levels were not significantly changed. Visual glance was the preferred method used by young dogs to respond to patient. Until a similar electronic technology is developed, trained alert dogs can help caregivers to protect both the patient and those around them from injuries that may otherwise result from aggressive outbursts in psychiatric patients.
Collapse
Affiliation(s)
- Uriel Bakeman
- Mind Print Ltd., 7/3 Yair Stern St., Herzeliya, 46421, Israel
| | | | - Clara Moray Schild
- Forensic Psychiatry Inpatient Unit, Abarbanel Mental Health Center, Bat Yam, 59100, Israel
| | | | - Yuval Eshed
- Yoad Eshed Ltd., Bet-Yehoshua, 40591, Israel
| | - Morris Laster
- Mind Print Ltd., 7/3 Yair Stern St., Herzeliya, 46421, Israel
| | | | - Sharon Anavi-Goffer
- Institute of Medical Sciences, University of Aberdeen, Aberdeen, AB25 2ZD, UK.
| |
Collapse
|
34
|
Zhang J, Xu K, Zhang S, Wang Y, Zheng N, Pan G, Chen W, Wu Z, Zheng X. Brain-Machine Interface-Based Rat-Robot Behavior Control. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2019; 1101:123-147. [PMID: 31729674 DOI: 10.1007/978-981-13-2050-7_5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Brain-machine interface (BMI) provides a bidirectional pathway between the brain and external facilities. The machine-to-brain pathway makes it possible to send artificial information back into the biological brain, interfering neural activities and generating sensations. The idea of the BMI-assisted bio-robotic animal system is accomplished by stimulations on specific sites of the nervous system. With the technology of BMI, animals' locomotion behavior can be precisely controlled as robots, which made the animal turning into bio-robot. In this chapter, we reviewed our lab works focused on rat-robot navigation. The principles of rat-robot system have been briefly described first, including the target brain sites chosen for locomotion control and the design of remote control system. Some methodological advances made by optogenetic technologies for better modulation control have then been introduced. Besides, we also introduced our implementation of "mind-controlled" rat navigation system. Moreover, we have presented our efforts made on combining biological intelligence with artificial intelligence, with developments of automatic control and training system assisted with images or voices inputs. We concluded this chapter by discussing further developments to acquire environmental information as well as promising applications with write-in BMIs.
Collapse
Affiliation(s)
- Jiacheng Zhang
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, People's Republic of China.,Department of Biomedical Engineering, Key Laboratory of Ministry of Education Ministry, Zhejiang University, Hangzhou, People's Republic of China.,Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, People's Republic of China
| | - Kedi Xu
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, People's Republic of China. .,Department of Biomedical Engineering, Key Laboratory of Ministry of Education Ministry, Zhejiang University, Hangzhou, People's Republic of China. .,Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, People's Republic of China.
| | - Shaomin Zhang
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, People's Republic of China.,Department of Biomedical Engineering, Key Laboratory of Ministry of Education Ministry, Zhejiang University, Hangzhou, People's Republic of China.,Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, People's Republic of China
| | - Yueming Wang
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, People's Republic of China.,College of Computer Science and Technology, Zhejiang University, Hangzhou, People's Republic of China
| | - Nenggan Zheng
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, People's Republic of China.,College of Computer Science and Technology, Zhejiang University, Hangzhou, People's Republic of China
| | - Gang Pan
- College of Computer Science and Technology, Zhejiang University, Hangzhou, People's Republic of China
| | - Weidong Chen
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, People's Republic of China.,Department of Biomedical Engineering, Key Laboratory of Ministry of Education Ministry, Zhejiang University, Hangzhou, People's Republic of China.,College of Computer Science and Technology, Zhejiang University, Hangzhou, People's Republic of China
| | - Zhaohui Wu
- College of Computer Science and Technology, Zhejiang University, Hangzhou, People's Republic of China
| | - Xiaoxiang Zheng
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, People's Republic of China.,Department of Biomedical Engineering, Key Laboratory of Ministry of Education Ministry, Zhejiang University, Hangzhou, People's Republic of China.,Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, People's Republic of China
| |
Collapse
|
35
|
Teunisse W, Youssef S, Schmidt M. Human enhancement through the lens of experimental and speculative neurotechnologies. HUMAN BEHAVIOR AND EMERGING TECHNOLOGIES 2019; 1:361-372. [PMID: 31894206 PMCID: PMC6919332 DOI: 10.1002/hbe2.179] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2019] [Revised: 09/04/2019] [Accepted: 09/05/2019] [Indexed: 12/11/2022]
Abstract
Human enhancement deals with improving on and overcoming limitations of the human body and mind. Pharmaceutical compounds that alter consciousness and cognitive performance have been used and discussed for a long time. The prospect of neurotechnological applications such as brain-steered devices or using invasive and noninvasive electromagnetic stimulations of the human brain, however, has received less attention-especially outside of therapeutic practices-and remains relatively unexplored. Reflection and debates about neurotechnology for human enhancement are limited and remain predominantly with neurotech engineers, science-fiction enthusiasts and a small circle of academics in the field of neuroethics. It is well known, and described as the Collingridge dilemma, that at an early stage of development, changes can easily be enacted, but the need for changes can hardly be foreseen. Once the technology is entrenched, opportunities and risks start to materialize, and the need to adapt and change is clearly visible. However, carrying out these changes at such a late stage, in turn, becomes very difficult, tremendously expensive, and sometimes practically impossible. In this manuscript, we compile and categorize an overview of existing experimental and speculative applications of neurotechnologies, with the aim to find out, if these real or diegetic prototypes could be used to better understand the paths these applications are forging. In particular, we will investigate what kind of tools, motivations, and normative goals underpin experimental implementations by neurohackers, speculative designers and artists.
Collapse
|
36
|
Towards neural co-processors for the brain: combining decoding and encoding in brain-computer interfaces. Curr Opin Neurobiol 2019; 55:142-151. [PMID: 30954862 DOI: 10.1016/j.conb.2019.03.008] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2018] [Revised: 03/13/2019] [Accepted: 03/14/2019] [Indexed: 12/18/2022]
Abstract
The field of brain-computer interfaces is poised to advance from the traditional goal of controlling prosthetic devices using brain signals to combining neural decoding and encoding within a single neuroprosthetic device. Such a device acts as a 'co-processor' for the brain, with applications ranging from inducing Hebbian plasticity for rehabilitation after brain injury to reanimating paralyzed limbs and enhancing memory. We review recent progress in simultaneous decoding and encoding for closed-loop control and plasticity induction. To address the challenge of multi-channel decoding and encoding, we introduce a unifying framework for developing brain co-processors based on artificial neural networks and deep learning. These 'neural co-processors' can be used to jointly optimize cost functions with the nervous system to achieve desired behaviors ranging from targeted neuro-rehabilitation to augmentation of brain function.
Collapse
|
37
|
Martins NRB, Angelica A, Chakravarthy K, Svidinenko Y, Boehm FJ, Opris I, Lebedev MA, Swan M, Garan SA, Rosenfeld JV, Hogg T, Freitas RA. Human Brain/Cloud Interface. Front Neurosci 2019; 13:112. [PMID: 30983948 PMCID: PMC6450227 DOI: 10.3389/fnins.2019.00112] [Citation(s) in RCA: 38] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2018] [Accepted: 01/30/2019] [Indexed: 12/25/2022] Open
Abstract
The Internet comprises a decentralized global system that serves humanity's collective effort to generate, process, and store data, most of which is handled by the rapidly expanding cloud. A stable, secure, real-time system may allow for interfacing the cloud with the human brain. One promising strategy for enabling such a system, denoted here as a "human brain/cloud interface" ("B/CI"), would be based on technologies referred to here as "neuralnanorobotics." Future neuralnanorobotics technologies are anticipated to facilitate accurate diagnoses and eventual cures for the ∼400 conditions that affect the human brain. Neuralnanorobotics may also enable a B/CI with controlled connectivity between neural activity and external data storage and processing, via the direct monitoring of the brain's ∼86 × 109 neurons and ∼2 × 1014 synapses. Subsequent to navigating the human vasculature, three species of neuralnanorobots (endoneurobots, gliabots, and synaptobots) could traverse the blood-brain barrier (BBB), enter the brain parenchyma, ingress into individual human brain cells, and autoposition themselves at the axon initial segments of neurons (endoneurobots), within glial cells (gliabots), and in intimate proximity to synapses (synaptobots). They would then wirelessly transmit up to ∼6 × 1016 bits per second of synaptically processed and encoded human-brain electrical information via auxiliary nanorobotic fiber optics (30 cm3) with the capacity to handle up to 1018 bits/sec and provide rapid data transfer to a cloud based supercomputer for real-time brain-state monitoring and data extraction. A neuralnanorobotically enabled human B/CI might serve as a personalized conduit, allowing persons to obtain direct, instantaneous access to virtually any facet of cumulative human knowledge. Other anticipated applications include myriad opportunities to improve education, intelligence, entertainment, traveling, and other interactive experiences. A specialized application might be the capacity to engage in fully immersive experiential/sensory experiences, including what is referred to here as "transparent shadowing" (TS). Through TS, individuals might experience episodic segments of the lives of other willing participants (locally or remote) to, hopefully, encourage and inspire improved understanding and tolerance among all members of the human family.
Collapse
Affiliation(s)
- Nuno R. B. Martins
- Lawrence Berkeley National Laboratory, Berkeley, CA, United States
- Center for Research and Education on Aging (CREA), University of California, Berkeley and LBNL, Berkeley, CA, United States
| | | | - Krishnan Chakravarthy
- UC San Diego Health Science, San Diego, CA, United States
- VA San Diego Healthcare System, San Diego, CA, United States
| | | | | | - Ioan Opris
- Miami Project to Cure Paralysis, University of Miami, Miami, FL, United States
- Department of Biomedical Engineering, University of Miami, Coral Gables, FL, United States
| | - Mikhail A. Lebedev
- Center for Neuroengineering, Duke University, Durham, NC, United States
- Center for Bioelectric Interfaces of the Institute for Cognitive Neuroscience of the National Research University Higher School of Economics, Moscow, Russia
- Department of Information and Internet Technologies of Digital Health Institute, I.M. Sechenov First Moscow State Medical University, Moscow, Russia
| | - Melanie Swan
- Department of Philosophy, Purdue University, West Lafayette, IN, United States
| | - Steven A. Garan
- Lawrence Berkeley National Laboratory, Berkeley, CA, United States
- Center for Research and Education on Aging (CREA), University of California, Berkeley and LBNL, Berkeley, CA, United States
| | - Jeffrey V. Rosenfeld
- Monash Institute of Medical Engineering, Monash University, Clayton, VIC, Australia
- Department of Neurosurgery, Alfred Hospital, Melbourne, VIC, Australia
- Department of Surgery, Monash University, Clayton, VIC, Australia
- Department of Surgery, F. Edward Hébert School of Medicine, Uniformed Services University of the Health Sciences, Bethesda, MD, United States
| | - Tad Hogg
- Institute for Molecular Manufacturing, Palo Alto, CA, United States
| | | |
Collapse
|
38
|
Zhang S, Yuan S, Huang L, Zheng X, Wu Z, Xu K, Pan G. Human Mind Control of Rat Cyborg's Continuous Locomotion with Wireless Brain-to-Brain Interface. Sci Rep 2019; 9:1321. [PMID: 30718518 PMCID: PMC6361987 DOI: 10.1038/s41598-018-36885-0] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2018] [Accepted: 11/16/2018] [Indexed: 11/09/2022] Open
Abstract
Brain-machine interfaces (BMIs) provide a promising information channel between the biological brain and external devices and are applied in building brain-to-device control. Prior studies have explored the feasibility of establishing a brain-brain interface (BBI) across various brains via the combination of BMIs. However, using BBI to realize the efficient multidegree control of a living creature, such as a rat, to complete a navigation task in a complex environment has yet to be shown. In this study, we developed a BBI from the human brain to a rat implanted with microelectrodes (i.e., rat cyborg), which integrated electroencephalogram-based motor imagery and brain stimulation to realize human mind control of the rat’s continuous locomotion. Control instructions were transferred from continuous motor imagery decoding results with the proposed control models and were wirelessly sent to the rat cyborg through brain micro-electrical stimulation. The results showed that rat cyborgs could be smoothly and successfully navigated by the human mind to complete a navigation task in a complex maze. Our experiments indicated that the cooperation through transmitting multidimensional information between two brains by computer-assisted BBI is promising.
Collapse
Affiliation(s)
- Shaomin Zhang
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, China.,Department of Biomedical Engineering, Key Laboratory of Biomedical Engineering of Education Ministry, Zhejiang University, Hangzhou, China.,Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, China
| | - Sheng Yuan
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, China.,Department of Biomedical Engineering, Key Laboratory of Biomedical Engineering of Education Ministry, Zhejiang University, Hangzhou, China.,Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, China
| | - Lipeng Huang
- Department of Computer Science, Zhejiang University, Hangzhou, China
| | - Xiaoxiang Zheng
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, China.,Department of Biomedical Engineering, Key Laboratory of Biomedical Engineering of Education Ministry, Zhejiang University, Hangzhou, China.,Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, China
| | - Zhaohui Wu
- Department of Computer Science, Zhejiang University, Hangzhou, China
| | - Kedi Xu
- Qiushi Academy for Advanced Studies (QAAS), Zhejiang University, Hangzhou, China. .,Department of Biomedical Engineering, Key Laboratory of Biomedical Engineering of Education Ministry, Zhejiang University, Hangzhou, China. .,Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, China.
| | - Gang Pan
- Department of Computer Science, Zhejiang University, Hangzhou, China.
| |
Collapse
|
39
|
Cinel C, Valeriani D, Poli R. Neurotechnologies for Human Cognitive Augmentation: Current State of the Art and Future Prospects. Front Hum Neurosci 2019; 13:13. [PMID: 30766483 PMCID: PMC6365771 DOI: 10.3389/fnhum.2019.00013] [Citation(s) in RCA: 51] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2018] [Accepted: 01/10/2019] [Indexed: 01/10/2023] Open
Abstract
Recent advances in neuroscience have paved the way to innovative applications that cognitively augment and enhance humans in a variety of contexts. This paper aims at providing a snapshot of the current state of the art and a motivated forecast of the most likely developments in the next two decades. Firstly, we survey the main neuroscience technologies for both observing and influencing brain activity, which are necessary ingredients for human cognitive augmentation. We also compare and contrast such technologies, as their individual characteristics (e.g., spatio-temporal resolution, invasiveness, portability, energy requirements, and cost) influence their current and future role in human cognitive augmentation. Secondly, we chart the state of the art on neurotechnologies for human cognitive augmentation, keeping an eye both on the applications that already exist and those that are emerging or are likely to emerge in the next two decades. Particularly, we consider applications in the areas of communication, cognitive enhancement, memory, attention monitoring/enhancement, situation awareness and complex problem solving, and we look at what fraction of the population might benefit from such technologies and at the demands they impose in terms of user training. Thirdly, we briefly review the ethical issues associated with current neuroscience technologies. These are important because they may differentially influence both present and future research on (and adoption of) neurotechnologies for human cognitive augmentation: an inferior technology with no significant ethical issues may thrive while a superior technology causing widespread ethical concerns may end up being outlawed. Finally, based on the lessons learned in our analysis, using past trends and considering other related forecasts, we attempt to forecast the most likely future developments of neuroscience technology for human cognitive augmentation and provide informed recommendations for promising future research and exploitation avenues.
Collapse
Affiliation(s)
- Caterina Cinel
- Brain Computer Interfaces and Neural Engineering Laboratory, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
| | - Davide Valeriani
- Brain Computer Interfaces and Neural Engineering Laboratory, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
- Department of Otolaryngology, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, United States
| | - Riccardo Poli
- Brain Computer Interfaces and Neural Engineering Laboratory, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
| |
Collapse
|
40
|
Jin Y, Chen J, Zhang S, Chen W, Zheng X. Invasive Brain Machine Interface System. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2019; 1101:67-89. [PMID: 31729672 DOI: 10.1007/978-981-13-2050-7_3] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Because of high spatial-temporal resolution of neural signals obtained by invasive recording, the invasive brain-machine interfaces (BMI) have achieved great progress in the past two decades. With success in animal research, BMI technology is transferring to clinical trials for helping paralyzed people to restore their lost motor functions. This chapter gives a brief review of BMI development from animal experiments to human clinical studies in the following aspects: (1) BMIs based on rodent animals; (2) BMI based on non-human primates; and (3) pilot BMIs studies in clinical trials. In the end, the chapter concludes with a summary of potential opportunities and future challenges in BMI technology.
Collapse
Affiliation(s)
- Yile Jin
- Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou, China.,Department of Biomedical Engineering, Zhejiang University, Hangzhou, China
| | - Junjun Chen
- Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou, China.,Department of Biomedical Engineering, Zhejiang University, Hangzhou, China
| | - Shaomin Zhang
- Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou, China. .,Department of Biomedical Engineering, Zhejiang University, Hangzhou, China.
| | - Weidong Chen
- Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou, China.,College of Computer Science, Zhejiang University, Hangzhou, China
| | - Xiaoxiang Zheng
- Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou, China.,Department of Biomedical Engineering, Zhejiang University, Hangzhou, China
| |
Collapse
|
41
|
A wireless and artefact-free 128-channel neuromodulation device for closed-loop stimulation and recording in non-human primates. Nat Biomed Eng 2018; 3:15-26. [PMID: 30932068 DOI: 10.1038/s41551-018-0323-x] [Citation(s) in RCA: 103] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2017] [Accepted: 10/30/2018] [Indexed: 11/08/2022]
Abstract
Closed-loop neuromodulation systems aim to treat a variety of neurological conditions by delivering and adjusting therapeutic electrical stimulation in response to a patient's neural state, recorded in real time. Existing systems are limited by low channel counts, lack of algorithmic flexibility, and the distortion of recorded signals by large and persistent stimulation artefacts. Here, we describe an artefact-free wireless neuromodulation device that enables research applications requiring high-throughput data streaming, low-latency biosignal processing, and simultaneous sensing and stimulation. The device is a miniaturized neural interface capable of closed-loop recording and stimulation on 128 channels, with on-board processing to fully cancel stimulation artefacts. In addition, it can detect neural biomarkers and automatically adjust stimulation parameters in closed-loop mode. In a behaving non-human primate, the device enabled long-term recordings of local field potentials and the real-time cancellation of stimulation artefacts, as well as closed-loop stimulation to disrupt movement preparatory activity during a delayed-reach task. The neuromodulation device may help advance neuroscientific discovery and preclinical investigations of stimulation-based therapeutic interventions.
Collapse
|
42
|
Maksimenko VA, Hramov AE, Frolov NS, Lüttjohann A, Nedaivozov VO, Grubov VV, Runnova AE, Makarov VV, Kurths J, Pisarchik AN. Increasing Human Performance by Sharing Cognitive Load Using Brain-to-Brain Interface. Front Neurosci 2018; 12:949. [PMID: 30631262 PMCID: PMC6315120 DOI: 10.3389/fnins.2018.00949] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2018] [Accepted: 11/29/2018] [Indexed: 11/13/2022] Open
Abstract
Brain-computer interfaces (BCIs) attract a lot of attention because of their ability to improve the brain's efficiency in performing complex tasks using a computer. Furthermore, BCIs can increase human's performance not only due to human-machine interactions, but also thanks to an optimal distribution of cognitive load among all members of a group working on a common task, i.e., due to human-human interaction. The latter is of particular importance when sustained attention and alertness are required. In every day practice, this is a common occurrence, for example, among office workers, pilots of a military or a civil aircraft, power plant operators, etc. Their routinely work includes continuous monitoring of instrument readings and implies a heavy cognitive load due to processing large amounts of visual information. In this paper, we propose a brain-to-brain interface (BBI) which estimates brain states of every participant and distributes a cognitive load among all members of the group accomplishing together a common task. The BBI allows sharing the whole workload between all participants depending on their current cognitive performance estimated from their electrical brain activity. We show that the team efficiency can be increased due to redistribution of the work between participants so that the most difficult workload falls on the operator who exhibits maximum performance. Finally, we demonstrate that the human-to-human interaction is more efficient in the presence of a certain delay determined by brain rhythms. The obtained results are promising for the development of a new generation of communication systems based on neurophysiological brain activity of interacting people. Such BBIs will distribute a common task between all group members according to their individual physical conditions.
Collapse
Affiliation(s)
- Vladimir A Maksimenko
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Alexander E Hramov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Nikita S Frolov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | | | - Vladimir O Nedaivozov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Vadim V Grubov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Anastasia E Runnova
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Vladimir V Makarov
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia
| | - Jürgen Kurths
- Potsdam Institute for Climate Impact Research, Potsdam, Germany.,Department of Physics, Humboldt University, Berlin, Germany.,Institute for Complex Systems and Mathematical Biology, University of Aberdeen, Aberdeen, United Kingdom
| | - Alexander N Pisarchik
- REC "Artificial Intelligence Systems and Neurotechnology", Yuri Gagarin State Technical University of Saratov, Saratov, Russia.,Center for Biomedical Technology, Technical University of Madrid, Madrid, Spain
| |
Collapse
|
43
|
Lebedev MA, Ossadtchi A. Commentary: Injecting Instructions into Premotor Cortex. Front Cell Neurosci 2018; 12:65. [PMID: 29637931 PMCID: PMC5880917 DOI: 10.3389/fncel.2018.00065] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2017] [Accepted: 02/23/2018] [Indexed: 11/13/2022] Open
Affiliation(s)
- Mikhail A Lebedev
- Department of Neurobiology, Duke University, Durham, NC, United States.,Center for Bioelectric Interfaces, National Research University Higher School of Economics, Moscow, Russia
| | - Alexei Ossadtchi
- Center for Bioelectric Interfaces, National Research University Higher School of Economics, Moscow, Russia
| |
Collapse
|
44
|
Andreoli L, Simplício H, Morya E. Egg Model Training Protocol for Stereotaxic Neurosurgery and Microelectrode Implantation. World Neurosurg 2018; 111:243-250. [DOI: 10.1016/j.wneu.2017.12.099] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2017] [Revised: 12/12/2017] [Accepted: 12/14/2017] [Indexed: 10/18/2022]
|
45
|
Pattnaik PK, Sarraf J. Brain Computer Interface issues on hand movement. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES 2018. [DOI: 10.1016/j.jksuci.2016.09.006] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
46
|
Optimization of Stimulation Parameters for Targeted Activation of Multiple Neurons Using Closed-Loop Search Methods. Processes (Basel) 2017; 5. [PMID: 34367934 PMCID: PMC8340624 DOI: 10.3390/pr5040081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Differential activation of neuronal populations can improve the efficacy of clinical devices such as sensory or cortical prostheses. Improving stimulus specificity will facilitate targeted neuronal activation to convey biologically realistic percepts. In order to deliver more complex stimuli to a neuronal population, stimulus optimization techniques must be developed that will enable a single electrode to activate subpopulations of neurons. However, determining the stimulus needed to evoke targeted neuronal activity is challenging. To find the most selective waveform for a particular population, we apply an optimization-based search routine, Powell's conjugate direction method, to systematically search the stimulus waveform space. This routine utilizes a 1-D sigmoid activation model and a 2-D strength-duration curve to measure neuronal activation throughout the stimulus waveform space. We implement our search routine in both an experimental study and a simulation study to characterize potential stimulus-evoked populations and the associated selective stimulus waveform spaces. We found that for a population of five neurons, seven distinct sub-populations could be activated. The stimulus waveform space and evoked neuronal activation curves vary with each new combination of neuronal culture and electrode array, resulting in a unique selectivity space. The method presented here can be used to efficiently uncover the selectivity space, focusing experiments in regions with the desired activation pattern.
Collapse
|
47
|
Mashat MEM, Li G, Zhang D. Human-to-human closed-loop control based on brain-to-brain interface and muscle-to-muscle interface. Sci Rep 2017; 7:11001. [PMID: 28887545 PMCID: PMC5591235 DOI: 10.1038/s41598-017-10957-z] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2017] [Accepted: 08/17/2017] [Indexed: 11/08/2022] Open
Abstract
Novel communication techniques have always been fascinating for humankind. This pilot study presents an approach to human interaction by combining direct brain-to-brain interface (BBI) and muscle-to-muscle interface (MMI) in a closed-loop pattern. In this system, artificial paths (data flows) functionally connect natural paths (nerves). The intention from one subject (sender) is recognized using electroencephalography (EEG) based brain-computer interface (BCI), which is sent out to trigger transcranial magnetic stimulation (TMS) on the other subject (receiver) and induce hand motion; meanwhile TMS results in a significant change on the motor evoked potentials (MEP) recorded by electromyography (EMG) of the receiver's arm, which triggers functional electrical stimulation (FES) applied to the sender's arm and generates hand motion. Human-controlled loop and automatic control loop experiments were performed with 6 pairs of healthy subjects to evaluate the performance of the introduced mechanism. The results indicated that response accuracy during human-controlled experiments was 85% which demonstrates the feasibility of the proposed method. During the automatic control test, two subjects could accomplish repetitive and reciprocal hand motion control up to 85 times consecutively.
Collapse
Affiliation(s)
- M Ebrahim M Mashat
- Institute of Robotics, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Guangye Li
- Institute of Robotics, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Dingguo Zhang
- Institute of Robotics, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China.
| |
Collapse
|
48
|
Lee W, Kim S, Kim B, Lee C, Chung YA, Kim L, Yoo SS. Non-invasive transmission of sensorimotor information in humans using an EEG/focused ultrasound brain-to-brain interface. PLoS One 2017; 12:e0178476. [PMID: 28598972 PMCID: PMC5466306 DOI: 10.1371/journal.pone.0178476] [Citation(s) in RCA: 36] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2016] [Accepted: 05/13/2017] [Indexed: 02/03/2023] Open
Abstract
We present non-invasive means that detect unilateral hand motor brain activity from one individual and subsequently stimulate the somatosensory area of another individual, thus, enabling the remote hemispheric link between each brain hemisphere in humans. Healthy participants were paired as a sender and a receiver. A sender performed a motor imagery task of either right or left hand, and associated changes in the electroencephalogram (EEG) mu rhythm (8-10 Hz) originating from either hemisphere were programmed to move a computer cursor to a target that appeared in either left or right of the computer screen. When the cursor reaches its target, the outcome was transmitted to another computer over the internet, and actuated the focused ultrasound (FUS) devices that selectively and non-invasively stimulated either the right or left hand somatosensory area of the receiver. Small FUS transducers effectively allowed for the independent administration of stimulatory ultrasonic waves to somatosensory areas. The stimulation elicited unilateral tactile sensation of the hand from the receiver, thus establishing the hemispheric brain-to-brain interface (BBI). Although there was a degree of variability in task accuracy, six pairs of volunteers performed the BBI task in high accuracy, transferring approximately eight commands per minute. Linkage between the hemispheric brain activities among individuals suggests the possibility for expansion of the information bandwidth in the context of BBI.
Collapse
Affiliation(s)
- Wonhye Lee
- Incheon St. Mary's Hospital, The Catholic University of Korea, Incheon, Korea.,Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States of America
| | - Suji Kim
- Center for Bionics, Korea Institute of Science and Technology, Seoul, Korea
| | - Byeongnam Kim
- Center for Bionics, Korea Institute of Science and Technology, Seoul, Korea
| | - Chungki Lee
- Center for Bionics, Korea Institute of Science and Technology, Seoul, Korea
| | - Yong An Chung
- Incheon St. Mary's Hospital, The Catholic University of Korea, Incheon, Korea
| | - Laehyun Kim
- Center for Bionics, Korea Institute of Science and Technology, Seoul, Korea
| | - Seung-Schik Yoo
- Incheon St. Mary's Hospital, The Catholic University of Korea, Incheon, Korea.,Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States of America.,Center for Bionics, Korea Institute of Science and Technology, Seoul, Korea
| |
Collapse
|
49
|
Koo B, Koh CS, Park HY, Lee HG, Chang JW, Choi S, Shin HC. Manipulation of Rat Movement via Nigrostriatal Stimulation Controlled by Human Visually Evoked Potentials. Sci Rep 2017; 7:2340. [PMID: 28539609 PMCID: PMC5443769 DOI: 10.1038/s41598-017-02521-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2016] [Accepted: 04/12/2017] [Indexed: 02/07/2023] Open
Abstract
Here, we report that the development of a brain-to-brain interface (BBI) system that enables a human user to manipulate rat movement without any previous training. In our model, the remotely-guided rats (known as ratbots) successfully navigated a T-maze via contralateral turning behaviour induced by electrical stimulation of the nigrostriatal (NS) pathway by a brain- computer interface (BCI) based on the human controller's steady-state visually evoked potentials (SSVEPs). The system allowed human participants to manipulate rat movement with an average success rate of 82.2% and at an average rat speed of approximately 1.9 m/min. The ratbots had no directional preference, showing average success rates of 81.1% and 83.3% for the left- and right-turning task, respectively. This is the first study to demonstrate the use of NS stimulation for developing a highly stable ratbot that does not require previous training, and is the first instance of a training-free BBI for rat navigation. The results of this study will facilitate the development of borderless communication between human and untrained animals, which could not only improve the understanding of animals in humans, but also allow untrained animals to more effectively provide humans with information obtained with their superior perception.
Collapse
Affiliation(s)
- Bonkon Koo
- School of Interdisciplinary Bioscience and Bioengineering, POSTECH, Pohang, Korea
| | - Chin Su Koh
- Department of Neurosurgery, Yonsei University College of Medicine, Seoul, South Korea
| | - Hae-Yong Park
- Department of Physiology, College of Medicine, Hallym University, Chuncheon, Korea
| | - Hwan-Gon Lee
- Department of Physical Education, Hallym University, Chuncheon, Korea
| | - Jin Woo Chang
- Department of Neurosurgery, Yonsei University College of Medicine, Seoul, South Korea
| | - Seungjin Choi
- Department of Computer Science and Engineering, POSTECH, Pohang, Korea
| | - Hyung-Cheul Shin
- Department of Physiology, College of Medicine, Hallym University, Chuncheon, Korea.
| |
Collapse
|
50
|
Lebedev MA, Nicolelis MAL. Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation. Physiol Rev 2017; 97:767-837. [PMID: 28275048 DOI: 10.1152/physrev.00027.2016] [Citation(s) in RCA: 269] [Impact Index Per Article: 33.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023] Open
Abstract
Brain-machine interfaces (BMIs) combine methods, approaches, and concepts derived from neurophysiology, computer science, and engineering in an effort to establish real-time bidirectional links between living brains and artificial actuators. Although theoretical propositions and some proof of concept experiments on directly linking the brains with machines date back to the early 1960s, BMI research only took off in earnest at the end of the 1990s, when this approach became intimately linked to new neurophysiological methods for sampling large-scale brain activity. The classic goals of BMIs are 1) to unveil and utilize principles of operation and plastic properties of the distributed and dynamic circuits of the brain and 2) to create new therapies to restore mobility and sensations to severely disabled patients. Over the past decade, a wide range of BMI applications have emerged, which considerably expanded these original goals. BMI studies have shown neural control over the movements of robotic and virtual actuators that enact both upper and lower limb functions. Furthermore, BMIs have also incorporated ways to deliver sensory feedback, generated from external actuators, back to the brain. BMI research has been at the forefront of many neurophysiological discoveries, including the demonstration that, through continuous use, artificial tools can be assimilated by the primate brain's body schema. Work on BMIs has also led to the introduction of novel neurorehabilitation strategies. As a result of these efforts, long-term continuous BMI use has been recently implicated with the induction of partial neurological recovery in spinal cord injury patients.
Collapse
|