1
|
Fang H, Yang Y. Designing and Validating a Robust Adaptive Neuromodulation Algorithm for Closed-Loop Control of Brain States. J Neural Eng 2022; 19. [PMID: 35576912 DOI: 10.1088/1741-2552/ac7005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 05/16/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Neuromodulation systems that use closed-loop brain stimulation to control brain states can provide new therapies for brain disorders. To date, closed-loop brain stimulation has largely used linear time-invariant controllers. However, nonlinear time-varying brain network dynamics and external disturbances can appear during real-time stimulation, collectively leading to real-time model uncertainty. Real-time model uncertainty can degrade the performance or even cause instability of time-invariant controllers. Three problems need to be resolved to enable accurate and stable control under model uncertainty. First, an adaptive controller is needed to track the model uncertainty. Second, the adaptive controller additionally needs to be robust to noise and disturbances. Third, theoretical analyses of stability and robustness are needed as prerequisites for stable operation of the controller in practical applications. APPROACH We develop a robust adaptive neuromodulation algorithm that solves the above three problems. First, we develop a state-space brain network model that explicitly includes nonlinear terms of real-time model uncertainty and design an adaptive controller to track and cancel the model uncertainty. Second, to improve the robustness of the adaptive controller, we design two linear filters to increase steady-state control accuracy and reduce sensitivity to high-frequency noise and disturbances. Third, we conduct theoretical analyses to prove the stability of the neuromodulation algorithm and establish a trade-off between stability and robustness, which we further use to optimize the algorithm design. Finally, we validate the algorithm using comprehensive Monte Carlo simulations that span a broad range of model nonlinearity, uncertainty, and complexity. MAIN RESULTS The robust adaptive neuromodulation algorithm accurately tracks various types of target brain state trajectories, enables stable and robust control, and significantly outperforms state-of-the-art neuromodulation algorithms. SIGNIFICANCE Our algorithm has implications for future designs of precise, stable, and robust closed-loop brain stimulation systems to treat brain disorders and facilitate brain functions.
Collapse
Affiliation(s)
- Hao Fang
- University of Central Florida, Research 1 Room 334, 313/316, University of Central Florida, 4353 Scorpius St., Orlando, Florida, 32816-2368, UNITED STATES
| | - Yuxiao Yang
- Department of Electrical and Computer Engineering, University of Central Florida, 4353 Scorpius St., Orlando, Florida, 32816-2368, UNITED STATES
| |
Collapse
|
2
|
George R, Chiappalone M, Giugliano M, Levi T, Vassanelli S, Partzsch J, Mayr C. Plasticity and Adaptation in Neuromorphic Biohybrid Systems. iScience 2020; 23:101589. [PMID: 33083749 PMCID: PMC7554028 DOI: 10.1016/j.isci.2020.101589] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
Neuromorphic systems take inspiration from the principles of biological information processing to form hardware platforms that enable the large-scale implementation of neural networks. The recent years have seen both advances in the theoretical aspects of spiking neural networks for their use in classification and control tasks and a progress in electrophysiological methods that is pushing the frontiers of intelligent neural interfacing and signal processing technologies. At the forefront of these new technologies, artificial and biological neural networks are tightly coupled, offering a novel "biohybrid" experimental framework for engineers and neurophysiologists. Indeed, biohybrid systems can constitute a new class of neuroprostheses opening important perspectives in the treatment of neurological disorders. Moreover, the use of biologically plausible learning rules allows forming an overall fault-tolerant system of co-developing subsystems. To identify opportunities and challenges in neuromorphic biohybrid systems, we discuss the field from the perspectives of neurobiology, computational neuroscience, and neuromorphic engineering.
Collapse
Affiliation(s)
- Richard George
- Department of Electrical Engineering and Information Technology, Technical University of Dresden, Dresden, Germany
| | | | - Michele Giugliano
- Neuroscience Area, International School of Advanced Studies, Trieste, Italy
| | - Timothée Levi
- Laboratoire de l’Intégration du Matéeriau au Systéme, University of Bordeaux, Bordeaux, France
- LIMMS/CNRS, Institute of Industrial Science, The University of Tokyo, Tokyo, Japan
| | - Stefano Vassanelli
- Department of Biomedical Sciences and Padova Neuroscience Center, University of Padova, Padova, Italy
| | - Johannes Partzsch
- Department of Electrical Engineering and Information Technology, Technical University of Dresden, Dresden, Germany
| | - Christian Mayr
- Department of Electrical Engineering and Information Technology, Technical University of Dresden, Dresden, Germany
| |
Collapse
|
3
|
Bronte-Stewart HM, Petrucci MN, O’Day JJ, Afzal MF, Parker JE, Kehnemouyi YM, Wilkins KB, Orthlieb GC, Hoffman SL. Perspective: Evolution of Control Variables and Policies for Closed-Loop Deep Brain Stimulation for Parkinson's Disease Using Bidirectional Deep-Brain-Computer Interfaces. Front Hum Neurosci 2020; 14:353. [PMID: 33061899 PMCID: PMC7489234 DOI: 10.3389/fnhum.2020.00353] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Accepted: 08/05/2020] [Indexed: 11/21/2022] Open
Abstract
A deep brain stimulation system capable of closed-loop neuromodulation is a type of bidirectional deep brain-computer interface (dBCI), in which neural signals are recorded, decoded, and then used as the input commands for neuromodulation at the same site in the brain. The challenge in assuring successful implementation of bidirectional dBCIs in Parkinson's disease (PD) is to discover and decode stable, robust and reliable neural inputs that can be tracked during stimulation, and to optimize neurostimulation patterns and parameters (control policies) for motor behaviors at the brain interface, which are customized to the individual. In this perspective, we will outline the work done in our lab regarding the evolution of the discovery of neural and behavioral control variables relevant to PD, the development of a novel personalized dual-threshold control policy relevant to the individual's therapeutic window and the application of these to investigations of closed-loop STN DBS driven by neural or kinematic inputs, using the first generation of bidirectional dBCIs.
Collapse
Affiliation(s)
- Helen M. Bronte-Stewart
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, United States
- Department of Neurosurgery, Stanford University School of Medicine, Stanford, CA, United States
| | - Matthew N. Petrucci
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, United States
| | - Johanna J. O’Day
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, United States
- Department of Bioengineering, Stanford University, Stanford, CA, United States
| | - Muhammad Furqan Afzal
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, United States
- Graduate School of Biomedical Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Jordan E. Parker
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, United States
| | - Yasmine M. Kehnemouyi
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, United States
| | - Kevin B. Wilkins
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, United States
| | - Gerrit C. Orthlieb
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, United States
| | - Shannon L. Hoffman
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, United States
| |
Collapse
|
4
|
Zeng H, Wang Y, Wu C, Song A, Liu J, Ji P, Xu B, Zhu L, Li H, Wen P. Closed-Loop Hybrid Gaze Brain-Machine Interface Based Robotic Arm Control with Augmented Reality Feedback. Front Neurorobot 2017; 11:60. [PMID: 29163123 PMCID: PMC5671634 DOI: 10.3389/fnbot.2017.00060] [Citation(s) in RCA: 37] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2017] [Accepted: 10/18/2017] [Indexed: 01/25/2023] Open
Abstract
Brain-machine interface (BMI) can be used to control the robotic arm to assist paralysis people for performing activities of daily living. However, it is still a complex task for the BMI users to control the process of objects grasping and lifting with the robotic arm. It is hard to achieve high efficiency and accuracy even after extensive trainings. One important reason is lacking of sufficient feedback information for the user to perform the closed-loop control. In this study, we proposed a method of augmented reality (AR) guiding assistance to provide the enhanced visual feedback to the user for a closed-loop control with a hybrid Gaze-BMI, which combines the electroencephalography (EEG) signals based BMI and the eye tracking for an intuitive and effective control of the robotic arm. Experiments for the objects manipulation tasks while avoiding the obstacle in the workspace are designed to evaluate the performance of our method for controlling the robotic arm. According to the experimental results obtained from eight subjects, the advantages of the proposed closed-loop system (with AR feedback) over the open-loop system (with visual inspection only) have been verified. The number of trigger commands used for controlling the robotic arm to grasp and lift the objects with AR feedback has reduced significantly and the height gaps of the gripper in the lifting process have decreased more than 50% compared to those trials with normal visual inspection only. The results reveal that the hybrid Gaze-BMI user can benefit from the information provided by the AR interface, improving the efficiency and reducing the cognitive load during the grasping and lifting processes.
Collapse
Affiliation(s)
- Hong Zeng
- School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Yanxin Wang
- School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Changcheng Wu
- College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Aiguo Song
- School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Jia Liu
- Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology, Nanjing University of Information Sciences and Technology, Nanjing, China
| | - Peng Ji
- School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Baoguo Xu
- School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Lifeng Zhu
- School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Huijun Li
- School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Pengcheng Wen
- AVIC Aeronautics Computing Technique Research Institute, Xi'an, China
| |
Collapse
|
5
|
Chiolerio A, Chiappalone M, Ariano P, Bocchini S. Coupling Resistive Switching Devices with Neurons: State of the Art and Perspectives. Front Neurosci 2017; 11:70. [PMID: 28261048 PMCID: PMC5309244 DOI: 10.3389/fnins.2017.00070] [Citation(s) in RCA: 42] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2016] [Accepted: 01/31/2017] [Indexed: 11/13/2022] Open
Abstract
Here we provide the state-of-the-art of bioelectronic interfacing between biological neuronal systems and artificial components, focusing the attention on the potentiality offered by intrinsically neuromorphic synthetic devices based on Resistive Switching (RS). Neuromorphic engineering is outside the scopes of this Perspective. Instead, our focus is on those materials and devices featuring genuine physical effects that could be sought as non-linearity, plasticity, excitation, and extinction which could be directly and more naturally coupled with living biological systems. In view of important applications, such as prosthetics and future life augmentation, a cybernetic parallelism is traced, between biological and artificial systems. We will discuss how such intrinsic features could reduce the complexity of conditioning networks for a more natural direct connection between biological and synthetic worlds. Putting together living systems with RS devices could represent a feasible though innovative perspective for the future of bionics.
Collapse
Affiliation(s)
- Alessandro Chiolerio
- Center for Sustainable Future Technologies, Istituto Italiano di Tecnologia Torino, Italy
| | - Michela Chiappalone
- Neuroscience and Brain Technologies Department, Istituto Italiano di Tecnologia Genova, Italy
| | - Paolo Ariano
- Center for Sustainable Future Technologies, Istituto Italiano di Tecnologia Torino, Italy
| | - Sergio Bocchini
- Center for Sustainable Future Technologies, Istituto Italiano di Tecnologia Torino, Italy
| |
Collapse
|
6
|
Boi F, Semprini M, Vato A. A non-linear mapping algorithm shaping the control policy of a bidirectional brain machine interface. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2016; 2016:3052-3055. [PMID: 28268955 DOI: 10.1109/embc.2016.7591373] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Motor brain-machine interfaces (BMIs) transform neural activities recorded directly from the brain into motor commands to control the movements of an external object by establishing an interface between the central nervous system (CNS) and the device. Bidirectional BMIs are closed-loop systems that add a sensory channel to provide the brain with an artificial feedback signal produced by the interaction between the device and the external world. Taking inspiration from the functioning of the spinal cord in mammalians, in our previous works we designed and developed a bidirectional BMI that uses the neural signals recorded form rats' motor cortex to control the movement of an external object. We implemented a decoding interface based on the approximation of a predefined force field with a central attractor point. Now we consider a non-linear transformation that allows to design a decoder approximating force fields with arbitrary attractors. We describe here the non-linear mapping algorithm and preliminary results of its use with behaving rats.
Collapse
|
7
|
Panzeri S, Safaai H, De Feo V, Vato A. Implications of the Dependence of Neuronal Activity on Neural Network States for the Design of Brain-Machine Interfaces. Front Neurosci 2016; 10:165. [PMID: 27147955 PMCID: PMC4837323 DOI: 10.3389/fnins.2016.00165] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2016] [Accepted: 04/01/2016] [Indexed: 01/07/2023] Open
Abstract
Brain-machine interfaces (BMIs) can improve the quality of life of patients with sensory and motor disabilities by both decoding motor intentions expressed by neural activity, and by encoding artificially sensed information into patterns of neural activity elicited by causal interventions on the neural tissue. Yet, current BMIs can exchange relatively small amounts of information with the brain. This problem has proved difficult to overcome by simply increasing the number of recording or stimulating electrodes, because trial-to-trial variability of neural activity partly arises from intrinsic factors (collectively known as the network state) that include ongoing spontaneous activity and neuromodulation, and so is shared among neurons. Here we review recent progress in characterizing the state dependence of neural responses, and in particular of how neural responses depend on endogenous slow fluctuations of network excitability. We then elaborate on how this knowledge may be used to increase the amount of information that BMIs exchange with brain. Knowledge of network state can be used to fine-tune the stimulation pattern that should reliably elicit a target neural response used to encode information in the brain, and to discount part of the trial-by-trial variability of neural responses, so that they can be decoded more accurately.
Collapse
Affiliation(s)
- Stefano Panzeri
- Neural Computation Laboratory, Istituto Italiano di Tecnologia Rovereto, Italy
| | - Houman Safaai
- Neural Computation Laboratory, Istituto Italiano di Tecnologia Rovereto, Italy
| | - Vito De Feo
- Neural Computation Laboratory, Istituto Italiano di Tecnologia Rovereto, Italy
| | - Alessandro Vato
- Neural Computation Laboratory, Istituto Italiano di Tecnologia Rovereto, Italy
| |
Collapse
|
8
|
Boi F, Semprini M, Mussa Ivaldi FA, Panzeri S, Vato A. A bidirectional brain-machine interface connecting alert rodents to a dynamical system. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2016; 2015:51-4. [PMID: 26736198 DOI: 10.1109/embc.2015.7318298] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
We present a novel experimental framework that implements a bidirectional brain-machine interface inspired by the operation of the spinal cord in vertebrates that generates a control policy in the form of a force field. The proposed experimental set-up allows connecting the brain of freely moving rats to an external device. We tested this apparatus in a preliminary experiment with an alert rat that used the interface for acquiring a food reward. The goal of this approach to bidirectional interfaces is to explore the role of voluntary neural commands in controlling a dynamical system represented by a small cart moving on vertical plane and connected to a water/pellet dispenser.
Collapse
|
9
|
Tessadori J, Chiappalone M. Closed-loop neuro-robotic experiments to test computational properties of neuronal networks. J Vis Exp 2015. [PMID: 25867052 PMCID: PMC4401171 DOI: 10.3791/52341] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022] Open
Abstract
Information coding in the Central Nervous System (CNS) remains unexplored. There is mounting evidence that, even at a very low level, the representation of a given stimulus might be dependent on context and history. If this is actually the case, bi-directional interactions between the brain (or if need be a reduced model of it) and sensory-motor system can shed a light on how encoding and decoding of information is performed. Here an experimental system is introduced and described in which the activity of a neuronal element (i.e., a network of neurons extracted from embryonic mammalian hippocampi) is given context and used to control the movement of an artificial agent, while environmental information is fed back to the culture as a sequence of electrical stimuli. This architecture allows a quick selection of diverse encoding, decoding, and learning algorithms to test different hypotheses on the computational properties of neuronal networks.
Collapse
Affiliation(s)
- Jacopo Tessadori
- Neuroscience and Brain Technologies, Istituto Italiano di Tecnologia
| | | |
Collapse
|
10
|
Hu X, Wang Y, Zhao T, Gunduz A. Neural coding for effective rehabilitation. BIOMED RESEARCH INTERNATIONAL 2014; 2014:286505. [PMID: 25258708 PMCID: PMC4167232 DOI: 10.1155/2014/286505] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/11/2014] [Revised: 07/23/2014] [Accepted: 08/10/2014] [Indexed: 01/31/2023]
Abstract
Successful neurological rehabilitation depends on accurate diagnosis, effective treatment, and quantitative evaluation. Neural coding, a technology for interpretation of functional and structural information of the nervous system, has contributed to the advancements in neuroimaging, brain-machine interface (BMI), and design of training devices for rehabilitation purposes. In this review, we summarized the latest breakthroughs in neuroimaging from microscale to macroscale levels with potential diagnostic applications for rehabilitation. We also reviewed the achievements in electrocorticography (ECoG) coding with both animal models and human beings for BMI design, electromyography (EMG) interpretation for interaction with external robotic systems, and robot-assisted quantitative evaluation on the progress of rehabilitation programs. Future rehabilitation would be more home-based, automatic, and self-served by patients. Further investigations and breakthroughs are mainly needed in aspects of improving the computational efficiency in neuroimaging and multichannel ECoG by selection of localized neuroinformatics, validation of the effectiveness in BMI guided rehabilitation programs, and simplification of the system operation in training devices.
Collapse
Affiliation(s)
- Xiaoling Hu
- Interdisciplinary Division of Biomedical Engineering, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong
| | - Yiwen Wang
- Qiushi Academy for Advanced Studies, Zhejiang University, Zhejiang 310027, China
| | - Ting Zhao
- Howard Hughes Medical Institute, Janelia Farm Research Campus, Ashburn, VA 20147, USA
| | - Aysegul Gunduz
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| |
Collapse
|
11
|
Wander JD, Rao RPN. Brain-computer interfaces: a powerful tool for scientific inquiry. Curr Opin Neurobiol 2014; 25:70-5. [PMID: 24709603 PMCID: PMC3980496 DOI: 10.1016/j.conb.2013.11.013] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2013] [Revised: 11/25/2013] [Accepted: 11/28/2013] [Indexed: 10/25/2022]
Abstract
Brain-computer interfaces (BCIs) are devices that record from the nervous system, provide input directly to the nervous system, or do both. Sensory BCIs such as cochlear implants have already had notable clinical success and motor BCIs have shown great promise for helping patients with severe motor deficits. Clinical and engineering outcomes aside, BCIs can also be tremendously powerful tools for scientific inquiry into the workings of the nervous system. They allow researchers to inject and record information at various stages of the system, permitting investigation of the brain in vivo and facilitating the reverse engineering of brain function. Most notably, BCIs are emerging as a novel experimental tool for investigating the tremendous adaptive capacity of the nervous system.
Collapse
Affiliation(s)
- Jeremiah D Wander
- Center for Sensorimotor Neural Engineering and Department of Bioengineering, University of Washington, William H. Foege Building, Box 355061, 4000 15th Ave NE, Seattle, WA 98195, United States
| | - Rajesh P N Rao
- Center for Sensorimotor Neural Engineering and Department of Computer Science and Engineering, University of Washington, AC101 Paul G. Allen Center, Box 352350, 185 Stevens Way, Seattle, WA 98195, United States.
| |
Collapse
|
12
|
Vato A, Szymanski FD, Semprini M, Mussa-Ivaldi FA, Panzeri S. A bidirectional brain-machine interface algorithm that approximates arbitrary force-fields. PLoS One 2014; 9:e91677. [PMID: 24626393 PMCID: PMC3953591 DOI: 10.1371/journal.pone.0091677] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2013] [Accepted: 02/14/2014] [Indexed: 11/19/2022] Open
Abstract
We examine bidirectional brain-machine interfaces that control external devices in a closed loop by decoding motor cortical activity to command the device and by encoding the state of the device by delivering electrical stimuli to sensory areas. Although it is possible to design this artificial sensory-motor interaction while maintaining two independent channels of communication, here we propose a rule that closes the loop between flows of sensory and motor information in a way that approximates a desired dynamical policy expressed as a field of forces acting upon the controlled external device. We previously developed a first implementation of this approach based on linear decoding of neural activity recorded from the motor cortex into a set of forces (a force field) applied to a point mass, and on encoding of position of the point mass into patterns of electrical stimuli delivered to somatosensory areas. However, this previous algorithm had the limitation that it only worked in situations when the position-to-force map to be implemented is invertible. Here we overcome this limitation by developing a new non-linear form of the bidirectional interface that can approximate a virtually unlimited family of continuous fields. The new algorithm bases both the encoding of position information and the decoding of motor cortical activity on an explicit map between spike trains and the state space of the device computed with Multi-Dimensional-Scaling. We present a detailed computational analysis of the performance of the interface and a validation of its robustness by using synthetic neural responses in a simulated sensory-motor loop.
Collapse
Affiliation(s)
- Alessandro Vato
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Francois D. Szymanski
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Marianna Semprini
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Ferdinando A. Mussa-Ivaldi
- Department of Physiology, Northwestern University, Chicago, Illinois, United States of America
- Department of Biomedical Engineering, Northwestern University, Evanston, Illinois, United States of America
- Sensory Motor Performance Program, Rehabilitation Institute of Chicago, Chicago, Illinois, United States of America
| | - Stefano Panzeri
- Center for Neuroscience and Cognitive Systems @UniTn, Istituto Italiano di Tecnologia, Rovereto, Italy
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
| |
Collapse
|
13
|
Semprini M, Bennicelli L, Vato A. A parametric study of intracortical microstimulation in behaving rats for the development of artificial sensory channels. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2013; 2012:799-802. [PMID: 23366013 DOI: 10.1109/embc.2012.6346052] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
In the framework of developing new brain-machine interfaces, many valuable results have been obtained in understanding which features of neural activity can be used in controlling an external device. Somatosensory real-time feedback is crucial for motor planning and for executing "online" errors correction during the movement. In people with sensory motor disabilities cortical microstimulation can be used as sensory feedback to elicit an artificial sensation providing the brain with information about the external environment. Even if intracortical microstimulation (ICMS) is broadly used in several experiments, understanding the psychophysics of such artificial sensory channel is still an open issue. Here we present the results of a parametric study that aims to define which stimulation parameters are needed to create an artificial sensation. Behaving rats were trained to report by pressing a lever the presence of ICMS delivered through microwire electrodes chronically implanted in the barrel cortex. Psychometric curves obtained by varying pulse amplitude, pulse frequency and train duration, demonstrate that in freely moving animals the perception threshold of microstimulation increased with respect to previous studies with head-restrained rats.
Collapse
Affiliation(s)
- Marianna Semprini
- Robotics Brain and Cognitive Sciences Dept., Istituto Italiano di Tecnologia, Genoa, Italy.
| | | | | |
Collapse
|
14
|
Micoulaud-Franchi JA, Fond G, Dumas G. Cyborg psychiatry to ensure agency and autonomy in mental disorders. A proposal for neuromodulation therapeutics. Front Hum Neurosci 2013; 7:463. [PMID: 24046734 PMCID: PMC3763194 DOI: 10.3389/fnhum.2013.00463] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2013] [Accepted: 07/25/2013] [Indexed: 11/23/2022] Open
Abstract
Neuromodulation therapeutics—as repeated Transcranial Magnetic Stimulation (rTMS) and neurofeedback—are valuable tools for psychiatry. Nevertheless, they currently face some limitations: rTMS has confounding effects on neural activation patterns, and neurofeedback fails to change neural dynamics in some cases. Here we propose how coupling rTMS and neurofeedback can tackle both issues by adapting neural activations during rTMS and actively guiding individuals during neurofeedback. An algorithmic challenge then consists in designing the proper recording, processing, feedback, and control of unwanted effects. But this new neuromodulation technique also poses an ethical challenge: ensuring treatment occurs within a biopsychosocial model of medicine, while considering both the interaction between the patients and the psychiatrist, and the maintenance of individuals' autonomy. Our solution is the concept of Cyborg psychiatry, which embodies the technique and includes a self-engaged interaction between patients and the neuromodulation device.
Collapse
Affiliation(s)
- Jean-Arthur Micoulaud-Franchi
- Unité de Neurophysiologie, Psychophysiologie et Neurophénoménologie, Solaris, Pôle de Psychiatrie Universitaire, Hôpital Sainte-Marguerite Marseille, France ; Laboratoire de Neurosciences Cognitives, UMR CNRS 7291, 31 Aix-Marseille Université, Site St Charles Marseille, France
| | | | | |
Collapse
|
15
|
Shanechi MM, Williams ZM, Wornell GW, Hu RC, Powers M, Brown EN. A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design. PLoS One 2013; 8:e59049. [PMID: 23593130 PMCID: PMC3622681 DOI: 10.1371/journal.pone.0059049] [Citation(s) in RCA: 56] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2012] [Accepted: 02/11/2013] [Indexed: 11/25/2022] Open
Abstract
Real-time brain-machine interfaces (BMI) have focused on either estimating the continuous movement trajectory or target intent. However, natural movement often incorporates both. Additionally, BMIs can be modeled as a feedback control system in which the subject modulates the neural activity to move the prosthetic device towards a desired target while receiving real-time sensory feedback of the state of the movement. We develop a novel real-time BMI using an optimal feedback control design that jointly estimates the movement target and trajectory of monkeys in two stages. First, the target is decoded from neural spiking activity before movement initiation. Second, the trajectory is decoded by combining the decoded target with the peri-movement spiking activity using an optimal feedback control design. This design exploits a recursive Bayesian decoder that uses an optimal feedback control model of the sensorimotor system to take into account the intended target location and the sensory feedback in its trajectory estimation from spiking activity. The real-time BMI processes the spiking activity directly using point process modeling. We implement the BMI in experiments consisting of an instructed-delay center-out task in which monkeys are presented with a target location on the screen during a delay period and then have to move a cursor to it without touching the incorrect targets. We show that the two-stage BMI performs more accurately than either stage alone. Correct target prediction can compensate for inaccurate trajectory estimation and vice versa. The optimal feedback control design also results in trajectories that are smoother and have lower estimation error. The two-stage decoder also performs better than linear regression approaches in offline cross-validation analyses. Our results demonstrate the advantage of a BMI design that jointly estimates the target and trajectory of movement and more closely mimics the sensorimotor control system.
Collapse
Affiliation(s)
- Maryam M Shanechi
- School of Electrical and Computer Engineering, Cornell University, Ithaca, New York, United States of America.
| | | | | | | | | | | |
Collapse
|
16
|
Tessadori J, Bisio M, Martinoia S, Chiappalone M. Modular neuronal assemblies embodied in a closed-loop environment: toward future integration of brains and machines. Front Neural Circuits 2012; 6:99. [PMID: 23248586 PMCID: PMC3520178 DOI: 10.3389/fncir.2012.00099] [Citation(s) in RCA: 46] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2012] [Accepted: 11/18/2012] [Indexed: 11/13/2022] Open
Abstract
Behaviors, from simple to most complex, require a two-way interaction with the environment and the contribution of different brain areas depending on the orchestrated activation of neuronal assemblies. In this work we present a new hybrid neuro-robotic architecture based on a neural controller bi-directionally connected to a virtual robot implementing a Braitenberg vehicle aimed at avoiding obstacles. The robot is characterized by proximity sensors and wheels, allowing it to navigate into a circular arena with obstacles of different sizes. As neural controller, we used hippocampal cultures dissociated from embryonic rats and kept alive over Micro Electrode Arrays (MEAs) for 3-8 weeks. The developed software architecture guarantees a bi-directional exchange of information between the natural and the artificial part by means of simple linear coding/decoding schemes. We used two different kinds of experimental preparation: "random" and "modular" populations. In the second case, the confinement was assured by a polydimethylsiloxane (PDMS) mask placed over the surface of the MEA device, thus defining two populations interconnected via specific microchannels. The main results of our study are: (i) neuronal cultures can be successfully interfaced to an artificial agent; (ii) modular networks show a different dynamics with respect to random culture, both in terms of spontaneous and evoked electrophysiological patterns; (iii) the robot performs better if a reinforcement learning paradigm (i.e., a tetanic stimulation delivered to the network following each collision) is activated, regardless of the modularity of the culture; (iv) the robot controlled by the modular network further enhances its capabilities in avoiding obstacles during the short-term plasticity trial. The developed paradigm offers a new framework for studying, in simplified model systems, neuro-artificial bi-directional interfaces for the development of new strategies for brain-machine interaction.
Collapse
Affiliation(s)
- Jacopo Tessadori
- Department of Neuroscience and Brain Technologies, Istituto Italiano di Tecnologia Genova, Italy
| | | | | | | |
Collapse
|
17
|
Zullo L, Chiappalone M, Martinoia S, Benfenati F. A "spike-based" grammar underlies directional modification in network connectivity: effect on bursting activity and implications for bio-hybrids systems. PLoS One 2012; 7:e49299. [PMID: 23145147 PMCID: PMC3493547 DOI: 10.1371/journal.pone.0049299] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2012] [Accepted: 10/08/2012] [Indexed: 11/19/2022] Open
Abstract
Developed biological systems are endowed with the ability of interacting with the environment; they sense the external state and react to it by changing their own internal state. Many attempts have been made to build ‘hybrids’ with the ability of perceiving, modifying and reacting to external modifications. Investigation of the rules that govern network changes in a hybrid system may lead to finding effective methods for ‘programming’ the neural tissue toward a desired task. Here we show a new perspective in the use of cortical neuronal cultures from embryonic mouse as a working platform to study targeted synaptic modifications. Differently from the common timing-based methods applied in bio-hybrids robotics, here we evaluated the importance of endogenous spike timing in the information processing. We characterized the influence of a spike-patterned stimulus in determining changes in neuronal synchronization (connectivity strength and precision) of the evoked spiking and bursting activity in the network. We show that tailoring the stimulation pattern upon a neuronal spike timing induces the network to respond stronger and more precisely to the stimulation. Interestingly, the induced modifications are conveyed more consistently in the burst timing. This increase in strength and precision may be a key in the interaction of the network with the external world and may be used to induce directional changes in bio-hybrid systems.
Collapse
Affiliation(s)
- Letizia Zullo
- Department of Neuroscience and Brain Technologies, Istituto Italiano di Tecnologia, Genoa, Italy.
| | | | | | | |
Collapse
|
18
|
Szymanski FD, Semprini M, Mussa-Ivaldi FA, Fadiga L, Panzeri S, Vato A. Dynamic Brain-Machine Interface: a novel paradigm for bidirectional interaction between brains and dynamical systems. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2012; 2011:4592-5. [PMID: 22255360 DOI: 10.1109/iembs.2011.6091137] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Brain-Machine Interfaces (BMIs) are systems which mediate communication between brains and artificial devices. Their long term goal is to restore motor functions, and this ultimately demands the development of a new generation of bidirectional brain-machine interfaces establishing a two-way brain-world communication channel, by both decoding motor commands from neural activity and providing feedback to the brain by electrical stimulation. Taking inspiration from how the spinal cord of vertebrates mediates communication between the brain and the limbs, here we present a model of a bidirectional brain-machine interface that interacts with a dynamical system by generating a control policy in the form of a force field. In our model, bidirectional communication takes place via two elements: (a) a motor interface decoding activities recorded from a motor cortical area, and (b) a sensory interface encoding the state of the controlled device into electrical stimuli delivered to a somatosensory area. We propose a specific mathematical model of the sensory and motor interfaces guiding a point mass moving in a viscous medium, and we demonstrate its performance by testing it on realistically simulated neural responses.
Collapse
Affiliation(s)
- Francois D Szymanski
- Robotics Brain and Cognitive Sciences Dept, Istituto Italiano di Tecnologia, Genoa, Italy.
| | | | | | | | | | | |
Collapse
|
19
|
O’Doherty JE, Lebedev MA, Li Z, Nicolelis MA. Virtual active touch using randomly patterned intracortical microstimulation. IEEE Trans Neural Syst Rehabil Eng 2012; 20:85-93. [PMID: 22207642 PMCID: PMC3590844 DOI: 10.1109/tnsre.2011.2166807] [Citation(s) in RCA: 60] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Intracortical microstimulation (ICMS) has promise as a means for delivering somatosensory feedback in neuroprosthetic systems. Various tactile sensations could be encoded by temporal, spatial, or spatiotemporal patterns of ICMS. However, the applicability of temporal patterns of ICMS to artificial tactile sensation during active exploration is unknown, as is the minimum discriminable difference between temporally modulated ICMS patterns. We trained rhesus monkeys in an active exploration task in which they discriminated periodic pulse-trains of ICMS (200 Hz bursts at a 10 Hz secondary frequency) from pulse trains with the same average pulse rate, but distorted periodicity (200 Hz bursts at a variable instantaneous secondary frequency). The statistics of the aperiodic pulse trains were drawn from a gamma distribution with mean inter-burst intervals equal to those of the periodic pulse trains. The monkeys distinguished periodic pulse trains from aperiodic pulse trains with coefficients of variation 0.25 or greater. Reconstruction of movement kinematics, extracted from the activity of neuronal populations recorded in the sensorimotor cortex concurrent with the delivery of ICMS feedback, improved when the recording intervals affected by ICMS artifacts were removed from analysis. These results add to the growing evidence that temporally patterned ICMS can be used to simulate a tactile sense for neuroprosthetic devices.
Collapse
Affiliation(s)
- Joseph E. O’Doherty
- Department of Neurobiology and the Center for Neuroengineering, Duke University, Durham, NC 27710 USA
| | - Mikhail A. Lebedev
- Department of Neurobiology and the Center for Neuroengineering, Duke University, Durham, NC 27710 USA
| | - Zheng Li
- Department of Neurobiology and the Center for Neuroengineering, Duke University, Durham, NC 27710 USA
| | - Miguel A.L. Nicolelis
- Departments of Neurobiology, Biomedical Engineering, Psychology, and the Center for Neuroengineering, Duke University, Durham, NC 27710 USA
| |
Collapse
|