1
|
Silva AB, Littlejohn KT, Liu JR, Moses DA, Chang EF. The speech neuroprosthesis. Nat Rev Neurosci 2024:10.1038/s41583-024-00819-9. [PMID: 38745103 DOI: 10.1038/s41583-024-00819-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/12/2024] [Indexed: 05/16/2024]
Abstract
Loss of speech after paralysis is devastating, but circumventing motor-pathway injury by directly decoding speech from intact cortical activity has the potential to restore natural communication and self-expression. Recent discoveries have defined how key features of speech production are facilitated by the coordinated activity of vocal-tract articulatory and motor-planning cortical representations. In this Review, we highlight such progress and how it has led to successful speech decoding, first in individuals implanted with intracranial electrodes for clinical epilepsy monitoring and subsequently in individuals with paralysis as part of early feasibility clinical trials to restore speech. We discuss high-spatiotemporal-resolution neural interfaces and the adaptation of state-of-the-art speech computational algorithms that have driven rapid and substantial progress in decoding neural activity into text, audible speech, and facial movements. Although restoring natural speech is a long-term goal, speech neuroprostheses already have performance levels that surpass communication rates offered by current assistive-communication technology. Given this accelerated rate of progress in the field, we propose key evaluation metrics for speed and accuracy, among others, to help standardize across studies. We finish by highlighting several directions to more fully explore the multidimensional feature space of speech and language, which will continue to accelerate progress towards a clinically viable speech neuroprosthesis.
Collapse
Affiliation(s)
- Alexander B Silva
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA
| | - Kaylo T Littlejohn
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, Berkeley, CA, USA
| | - Jessie R Liu
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA
| | - David A Moses
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA
| | - Edward F Chang
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA.
- Weill Institute for Neuroscience, University of California, San Francisco, San Francisco, CA, USA.
| |
Collapse
|
2
|
Downey JE, Schone HR, Foldes ST, Greenspon C, Liu F, Verbaarschot C, Biro D, Satzer D, Moon CH, Coffman BA, Youssofzadeh V, Fields D, Hobbs TG, Okorokova E, Tyler-Kabara EC, Warnke PC, Gonzalez-Martinez J, Hatsopoulos NG, Bensmaia SJ, Boninger ML, Gaunt RA, Collinger JL. A roadmap for implanting microelectrode arrays to evoke tactile sensations through intracortical microstimulation. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.04.26.24306239. [PMID: 38712177 PMCID: PMC11071570 DOI: 10.1101/2024.04.26.24306239] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2024]
Abstract
Intracortical microstimulation (ICMS) is a method for restoring sensation to people with paralysis as part of a bidirectional brain-computer interface to restore upper limb function. Evoking tactile sensations of the hand through ICMS requires precise targeting of implanted electrodes. Here we describe the presurgical imaging procedures used to generate functional maps of the hand area of the somatosensory cortex and subsequent planning that guided the implantation of intracortical microelectrode arrays. In five participants with cervical spinal cord injury, across two study locations, this procedure successfully enabled ICMS-evoked sensations localized to at least the first four digits of the hand. The imaging and planning procedures developed through this clinical trial provide a roadmap for other brain-computer interface studies to ensure successful placement of stimulation electrodes.
Collapse
Affiliation(s)
- John E Downey
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL
| | - Hunter R Schone
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA
| | - Stephen T Foldes
- Department of Neurology, Barrow Neurological Institute, St. Joseph's Hospital and Medical Center, Phoenix, AZ
| | - Charles Greenspon
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL
| | - Fang Liu
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA
| | - Ceci Verbaarschot
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA
| | - Daniel Biro
- Department of Neurological Surgery, University of Chicago, Chicago, IL
| | - David Satzer
- Department of Neurological Surgery, University of Chicago, Chicago, IL
| | - Chan Hong Moon
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA
| | - Brian A Coffman
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA
| | | | - Daryl Fields
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA
- Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, PA
| | - Taylor G Hobbs
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA
| | - Elizaveta Okorokova
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL
| | | | - Peter C Warnke
- Department of Neurological Surgery, University of Chicago, Chicago, IL
| | | | - Nicholas G Hatsopoulos
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL
- Committee on Computation Neuroscience, University of Chicago, Chicago, IL
- Neuroscience Institute, University of Chicago, Chicago, IL
| | - Sliman J Bensmaia
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL
- Committee on Computation Neuroscience, University of Chicago, Chicago, IL
- Neuroscience Institute, University of Chicago, Chicago, IL
| | - Michael L Boninger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA
| | - Robert A Gaunt
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA
| | - Jennifer L Collinger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA
| |
Collapse
|
3
|
Zhou C, Tian Y, Li G, Ye Y, Gao L, Li J, Liu Z, Su H, Lu Y, Li M, Zhou Z, Wei X, Qin L, Tao TH, Sun L. Through-polymer, via technology-enabled, flexible, lightweight, and integrated devices for implantable neural probes. MICROSYSTEMS & NANOENGINEERING 2024; 10:54. [PMID: 38654844 PMCID: PMC11035623 DOI: 10.1038/s41378-024-00691-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Revised: 02/29/2024] [Accepted: 03/11/2024] [Indexed: 04/26/2024]
Abstract
In implantable electrophysiological recording systems, the headstage typically comprises neural probes that interface with brain tissue and integrated circuit chips for signal processing. While advancements in MEMS and CMOS technology have significantly improved these components, their interconnection still relies on conventional printed circuit boards and sophisticated adapters. This conventional approach adds considerable weight and volume to the package, especially for high channel count systems. To address this issue, we developed a through-polymer via (TPV) method inspired by the through-silicon via (TSV) technique in advanced three-dimensional packaging. This innovation enables the vertical integration of flexible probes, amplifier chips, and PCBs, realizing a flexible, lightweight, and integrated device (FLID). The total weight of the FLIDis only 25% that of its conventional counterparts relying on adapters, which significantly increased the activity levels of animals wearing the FLIDs to nearly match the levels of control animals without implants. Furthermore, by incorporating a platinum-iridium alloy as the top layer material for electrical contact, the FLID realizes exceptional electrical performance, enabling in vivo measurements of both local field potentials and individual neuron action potentials. These findings showcase the potential of FLIDs in scaling up implantable neural recording systems and mark a significant advancement in the field of neurotechnology.
Collapse
Grants
- This work was partially supported by the National Key R & D Program of China (Grant Nos. 2021ZD0201600, 2022YFF0706504, 2022ZD0209300, 2019YFA0905200, 2021YFC2501500, 2021YFF1200700, 2022ZD0212300), National Natural Science Foundation of China (Grant No. 61974154), Key Research Program of Frontier Sciences, CAS (Grant No. ZDBS-LY-JSC024), Shanghai Pilot Program for Basic Research-Chinese Academy of Science, Shanghai Branch (Grant No. JCYJ-SHFY-2022-01 and JCYJ-SHFY-2022-0xx), Shanghai Municipal Science and Technology Major Project (Grant No. 2021SHZDZX), CAS Pioneer Hundred Talents Program, Shanghai Pujiang Program (Grant Nos. 21PJ1415100, 19PJ1410900), the Science and Technology Commission Foundation of Shanghai (Nos. 21JM0010200 and 21142200300), Shanghai Rising-Star Program (Grant No. 22QA1410900), Shanghai Sailing Program (No. 22YF1454700), the Innovative Research Team of High-level Local Universities in Shanghai, the Jiangxi Province 03 Special Project and 5G Project (Grant No. 20212ABC03W07), Fund for Central Government in Guidance of Local Science and Technology Development (Grant No. 20201ZDE04013), Special Fund for Science and Technology Innovation Strategy of Guangdong Province (Grant Nos. 2021B0909060002, 2021B0909050004).
Collapse
Affiliation(s)
- Cunkai Zhou
- College of Electronics and Information Engineering, Shanghai University of Electric Power, Shanghai, China
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
| | - Ye Tian
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing, China
| | - Gen Li
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing, China
| | - Yifei Ye
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
| | - Lusha Gao
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
| | - Jiazhi Li
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
| | - Ziwei Liu
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
| | - Haoyang Su
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing, China
- State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
| | - Yunxiao Lu
- College of Electronics and Information Engineering, Shanghai University of Electric Power, Shanghai, China
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
| | - Meng Li
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing, China
- State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
| | - Zhitao Zhou
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing, China
- State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
| | - Xiaoling Wei
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing, China
- State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
| | - Lunming Qin
- College of Electronics and Information Engineering, Shanghai University of Electric Power, Shanghai, China
| | - Tiger H. Tao
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing, China
- State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, China
- School of Physical Science and Technology, ShanghaiTech University, Shanghai, China
- Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
- Neuroxess Co., Ltd. (Jiangxi), Nanchang, Jiangxi China
- Guangdong Institute of Intelligence Science and Technology, Hengqin, Zhuhai, Guangdong China
- Tianqiao and Chrissy Chen Institute for Translational Research, Shanghai, China
| | - Liuyang Sun
- College of Electronics and Information Engineering, Shanghai University of Electric Power, Shanghai, China
- 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
- School of Graduate Study, University of Chinese Academy of Sciences, Beijing, China
- State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China
| |
Collapse
|
4
|
Suematsu N, Vazquez AL, Kozai TDY. Activation and depression of neural and hemodynamic responses induced by the intracortical microstimulation and visual stimulation in the mouse visual cortex. J Neural Eng 2024; 21:026033. [PMID: 38537268 PMCID: PMC11002944 DOI: 10.1088/1741-2552/ad3853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 02/28/2024] [Accepted: 03/27/2024] [Indexed: 04/09/2024]
Abstract
Objective. Intracortical microstimulation (ICMS) can be an effective method for restoring sensory perception in contemporary brain-machine interfaces. However, the mechanisms underlying better control of neuronal responses remain poorly understood, as well as the relationship between neuronal activity and other concomitant phenomena occurring around the stimulation site.Approach. Different microstimulation frequencies were investigatedin vivoon Thy1-GCaMP6s mice using widefield and two-photon imaging to evaluate the evoked excitatory neural responses across multiple spatial scales as well as the induced hemodynamic responses. Specifically, we quantified stimulation-induced neuronal activation and depression in the mouse visual cortex and measured hemodynamic oxyhemoglobin and deoxyhemoglobin signals using mesoscopic-scale widefield imaging.Main results. Our calcium imaging findings revealed a preference for lower-frequency stimulation in driving stronger neuronal activation. A depressive response following the neural activation preferred a slightly higher frequency stimulation compared to the activation. Hemodynamic signals exhibited a comparable spatial spread to neural calcium signals. Oxyhemoglobin concentration around the stimulation site remained elevated during the post-activation (depression) period. Somatic and neuropil calcium responses measured by two-photon microscopy showed similar dependence on stimulation parameters, although the magnitudes measured in soma was greater than in neuropil. Furthermore, higher-frequency stimulation induced a more pronounced activation in soma compared to neuropil, while depression was predominantly induced in soma irrespective of stimulation frequencies.Significance. These results suggest that the mechanism underlying depression differs from activation, requiring ample oxygen supply, and affecting neurons. Our findings provide a novel understanding of evoked excitatory neuronal activity induced by ICMS and offer insights into neuro-devices that utilize both activation and depression phenomena to achieve desired neural responses.
Collapse
Affiliation(s)
- Naofumi Suematsu
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - Alberto L Vazquez
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
- Center for the Neural Basis of Cognition, University of Pittsburgh and Carnegie Mellon University, Pittsburgh, PA, United States of America
- Department of Radiology, University of Pittsburgh, Pittsburgh, PA, United States of America
- Center for Neuroscience, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - Takashi D Y Kozai
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
- Center for the Neural Basis of Cognition, University of Pittsburgh and Carnegie Mellon University, Pittsburgh, PA, United States of America
- Center for Neuroscience, University of Pittsburgh, Pittsburgh, PA, United States of America
- McGowan Institute for Regenerative Medicine, University of Pittsburgh, Pittsburgh, PA, United States of America
- NeuroTech Center, University of Pittsburgh Brain Institute, Pittsburgh, PA, United States of America
| |
Collapse
|
5
|
McNamara IN, Wellman SM, Li L, Eles JR, Savya S, Sohal HS, Angle MR, Kozai TDY. Electrode sharpness and insertion speed reduce tissue damage near high-density penetrating arrays. J Neural Eng 2024; 21:026030. [PMID: 38518365 DOI: 10.1088/1741-2552/ad36e1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Accepted: 03/22/2024] [Indexed: 03/24/2024]
Abstract
Objective. Over the past decade, neural electrodes have played a crucial role in bridging biological tissues with electronic and robotic devices. This study focuses on evaluating the optimal tip profile and insertion speed for effectively implanting Paradromics' high-density fine microwire arrays (FμA) prototypes into the primary visual cortex (V1) of mice and rats, addressing the challenges associated with the 'bed-of-nails' effect and tissue dimpling.Approach. Tissue response was assessed by investigating the impact of electrodes on the blood-brain barrier (BBB) and cellular damage, with a specific emphasis on tailored insertion strategies to minimize tissue disruption during electrode implantation.Main results.Electro-sharpened arrays demonstrated a marked reduction in cellular damage within 50μm of the electrode tip compared to blunt and angled arrays. Histological analysis revealed that slow insertion speeds led to greater BBB compromise than fast and pneumatic methods. Successful single-unit recordings validated the efficacy of the optimized electro-sharpened arrays in capturing neural activity.Significance.These findings underscore the critical role of tailored insertion strategies in minimizing tissue damage during electrode implantation, highlighting the suitability of electro-sharpened arrays for long-term implant applications. This research contributes to a deeper understanding of the complexities associated with high-channel-count microelectrode array implantation, emphasizing the importance of meticulous assessment and optimization of key parameters for effective integration and minimal tissue disruption. By elucidating the interplay between insertion parameters and tissue response, our study lays a strong foundation for the development of advanced implantable devices with a reduction in reactive gliosis and improved performance in neural recording applications.
Collapse
Affiliation(s)
- Ingrid N McNamara
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - Steven M Wellman
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - Lehong Li
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - James R Eles
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
| | - Sajishnu Savya
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
| | | | | | - Takashi D Y Kozai
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, United States of America
- Center of the Basis of Neural Cognition, Pittsburgh, PA, United States of America
- McGowan Institute of Regenerative Medicine, University of Pittsburgh, Pittsburgh, PA, United States of America
- NeuroTech Center, University of Pittsburgh Brain Institute, Pittsburgh, PA, United States of America
| |
Collapse
|
6
|
Takahashi T, Zhang H, Agetsuma M, Nabekura J, Otomo K, Okamura Y, Nemoto T. Large-scale cranial window for in vivo mouse brain imaging utilizing fluoropolymer nanosheet and light-curable resin. Commun Biol 2024; 7:232. [PMID: 38438546 PMCID: PMC10912766 DOI: 10.1038/s42003-024-05865-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2023] [Accepted: 01/26/2024] [Indexed: 03/06/2024] Open
Abstract
Two-photon microscopy enables in vivo imaging of neuronal activity in mammalian brains at high resolution. However, two-photon imaging tools for stable, long-term, and simultaneous study of multiple brain regions in same mice are lacking. Here, we propose a method to create large cranial windows covering such as the whole parietal cortex and cerebellum in mice using fluoropolymer nanosheets covered with light-curable resin (termed the 'Nanosheet Incorporated into light-curable REsin' or NIRE method). NIRE method can produce cranial windows conforming the curved cortical and cerebellar surfaces, without motion artifacts in awake mice, and maintain transparency for >5 months. In addition, we demonstrate that NIRE method can be used for in vivo two-photon imaging of neuronal ensembles, individual neurons and subcellular structures such as dendritic spines. The NIRE method can facilitate in vivo large-scale analysis of heretofore inaccessible neural processes, such as the neuroplastic changes associated with maturation, learning and neural pathogenesis.
Collapse
Affiliation(s)
- Taiga Takahashi
- Division of Biophotonics, National Institute for Physiological Sciences, National Institutes of Natural Sciences, Higashiyama 5-1, Myodaiji, Okazaki, Aichi, 444-8787, Japan
- Biophotonics Research Group, Exploratory Research Center on Life and Living Systems (ExCELLS), National Institutes of Natural Sciences, Higashiyama 5-1, Myodaiji, Okazaki, Aichi, 444-8787, Japan
- School of Life Science, The Graduate University for Advanced Studies (SOKENDAI), Higashiyama 5-1, Myodaiji, Okazaki, Aichi, 444-8787, Japan
- Department of Medical and Robotic Engineering Design, Faculty of Advanced Engineering, Tokyo University of Science, 6-3-1 Niijuku, Katsushika, Tokyo, 125-8585, Japan
| | - Hong Zhang
- Micro/Nano Technology Center, Tokai University, 4-1-1 Kitakaname, Hiratsuka, Kanagawa, 259-1292, Japan
- School of Chemical Engineering and Technology, Tianjin University, 135 Yaguan Road, Jinnan District, Tianjin, 300350, China
| | - Masakazu Agetsuma
- Division of Homeostatic Development, National Institute for Physiological Sciences, National Institutes of Natural Sciences, Okazaki, 444-8585, Japan
- Quantum Regenerative and Biomedical Engineering Team, Institute for Quantum Life Science, National Institutes for Quantum Science and Technology (QST), Anagawa 4-9-1, Chiba Inage-ku, Chiba, 263-8555, Japan
| | - Junichi Nabekura
- School of Life Science, The Graduate University for Advanced Studies (SOKENDAI), Higashiyama 5-1, Myodaiji, Okazaki, Aichi, 444-8787, Japan
- Division of Homeostatic Development, National Institute for Physiological Sciences, National Institutes of Natural Sciences, Okazaki, 444-8585, Japan
| | - Kohei Otomo
- Division of Biophotonics, National Institute for Physiological Sciences, National Institutes of Natural Sciences, Higashiyama 5-1, Myodaiji, Okazaki, Aichi, 444-8787, Japan
- Biophotonics Research Group, Exploratory Research Center on Life and Living Systems (ExCELLS), National Institutes of Natural Sciences, Higashiyama 5-1, Myodaiji, Okazaki, Aichi, 444-8787, Japan
- School of Life Science, The Graduate University for Advanced Studies (SOKENDAI), Higashiyama 5-1, Myodaiji, Okazaki, Aichi, 444-8787, Japan
- Department of Biochemistry and Systems Biomedicine, Graduate School of Medicine, Juntendo University, 2-1-1 Hongo, Bunkyo-ku, Tokyo, 113-8421, Japan
| | - Yosuke Okamura
- Micro/Nano Technology Center, Tokai University, 4-1-1 Kitakaname, Hiratsuka, Kanagawa, 259-1292, Japan
- Department of Applied Chemistry, School of Engineering, Tokai University, 4-1-1 Kitakaname, Hiratsuka, Kanagawa, 259-1292, Japan
- Course of Applied Science, Graduate School of Engineering, Tokai University, 4-1-1 Kitakaname, Hiratsuka, Kanagawa, 259-1292, Japan
| | - Tomomi Nemoto
- Division of Biophotonics, National Institute for Physiological Sciences, National Institutes of Natural Sciences, Higashiyama 5-1, Myodaiji, Okazaki, Aichi, 444-8787, Japan.
- Biophotonics Research Group, Exploratory Research Center on Life and Living Systems (ExCELLS), National Institutes of Natural Sciences, Higashiyama 5-1, Myodaiji, Okazaki, Aichi, 444-8787, Japan.
- School of Life Science, The Graduate University for Advanced Studies (SOKENDAI), Higashiyama 5-1, Myodaiji, Okazaki, Aichi, 444-8787, Japan.
| |
Collapse
|
7
|
Suematsu N, Vazquez AL, Kozai TD. Activation and depression of neural and hemodynamic responses induced by the intracortical microstimulation and visual stimulation in the mouse visual cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.01.573814. [PMID: 38260671 PMCID: PMC10802282 DOI: 10.1101/2024.01.01.573814] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
Objective . Intracortical microstimulation can be an effective method for restoring sensory perception in contemporary brain-machine interfaces. However, the mechanisms underlying better control of neuronal responses remain poorly understood, as well as the relationship between neuronal activity and other concomitant phenomena occurring around the stimulation site. Approach . Different microstimulation frequencies were investigated in vivo on Thy1-GCaMP6s mice using widefield and two-photon imaging to evaluate the evoked excitatory neural responses across multiple spatial scales as well as the induced hemodynamic responses. Specifically, we quantified stimulation-induced neuronal activation and depression in the mouse visual cortex and measured hemodynamic oxyhemoglobin and deoxyhemoglobin signals using mesoscopic-scale widefield imaging. Main results . Our calcium imaging findings revealed a preference for lower-frequency stimulation in driving stronger neuronal activation. A depressive response following the neural activation preferred a slightly higher frequency stimulation compared to the activation. Hemodynamic signals exhibited a comparable spatial spread to neural calcium signals. Oxyhemoglobin concentration around the stimulation site remained elevated during the post-activation (depression) period. Somatic and neuropil calcium responses measured by two-photon microscopy showed similar dependence on stimulation parameters, although the magnitudes measured in soma was greater than in neuropil. Furthermore, higher-frequency stimulation induced a more pronounced activation in soma compared to neuropil, while depression was predominantly induced in soma irrespective of stimulation frequencies. Significance . These results suggest that the mechanism underlying depression differs from activation, requiring ample oxygen supply, and affecting neurons. Our findings provide a novel understanding of evoked excitatory neuronal activity induced by intracortical microstimulation and offer insights into neuro-devices that utilize both activation and depression phenomena to achieve desired neural responses.
Collapse
|
8
|
Paulk AC, Salami P, Zelmann R, Cash SS. Electrode Development for Epilepsy Diagnosis and Treatment. Neurosurg Clin N Am 2024; 35:135-149. [PMID: 38000837 DOI: 10.1016/j.nec.2023.09.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2023]
Abstract
Recording neural activity has been a critical aspect in the diagnosis and treatment of patients with epilepsy. For those with intractable epilepsy, intracranial neural monitoring has been of substantial importance. Clinically, however, methods for recording neural information have remained essentially unchanged for decades. Over the last decade or so, rapid advances in electrode technology have begun to change this landscape. New systems allow for the observation of neural activity with high spatial resolution and, in some cases, at the level of the activity of individual neurons. These new tools have contributed greatly to our understanding of brain function and dysfunction. Here, the authors review the primary technologies currently in use in humans. The authors discuss other possible systems, some of the challenges which come along with these devices, and how they will become incorporated into the clinical workflow. Ultimately, the expectation is that these new, high-density, high-spatial-resolution recording systems will become a valuable part of the clinical arsenal used in the diagnosis and surgical management of epilepsy.
Collapse
Affiliation(s)
- Angelique C Paulk
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital and Harvard Medical School, 55 Fruit Street, Boston, MA 02114, USA.
| | - Pariya Salami
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital and Harvard Medical School, 55 Fruit Street, Boston, MA 02114, USA
| | - Rina Zelmann
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital and Harvard Medical School, 55 Fruit Street, Boston, MA 02114, USA
| | - Sydney S Cash
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital and Harvard Medical School, 55 Fruit Street, Boston, MA 02114, USA
| |
Collapse
|
9
|
Fan C, Hahn N, Kamdar F, Avansino D, Wilson GH, Hochberg L, Shenoy KV, Henderson JM, Willett FR. Plug-and-Play Stability for Intracortical Brain-Computer Interfaces: A One-Year Demonstration of Seamless Brain-to-Text Communication. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 2023; 36:42258-42270. [PMID: 38738213 PMCID: PMC11086983] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 05/14/2024]
Abstract
Intracortical brain-computer interfaces (iBCIs) have shown promise for restoring rapid communication to people with neurological disorders such as amyotrophic lateral sclerosis (ALS). However, to maintain high performance over time, iBCIs typically need frequent recalibration to combat changes in the neural recordings that accrue over days. This requires iBCI users to stop using the iBCI and engage in supervised data collection, making the iBCI system hard to use. In this paper, we propose a method that enables self-recalibration of communication iBCIs without interrupting the user. Our method leverages large language models (LMs) to automatically correct errors in iBCI outputs. The self-recalibration process uses these corrected outputs ("pseudo-labels") to continually update the iBCI decoder online. Over a period of more than one year (403 days), we evaluated our Continual Online Recalibration with Pseudo-labels (CORP) framework with one clinical trial participant. CORP achieved a stable decoding accuracy of 93.84% in an online handwriting iBCI task, significantly outperforming other baseline methods. Notably, this is the longest-running iBCI stability demonstration involving a human participant. Our results provide the first evidence for long-term stabilization of a plug-and-play, high-performance communication iBCI, addressing a major barrier for the clinical translation of iBCIs.
Collapse
Affiliation(s)
- Chaofei Fan
- Department of Computer Science, Stanford University
| | - Nick Hahn
- Department of Neurosurgery, Stanford University
| | | | | | | | - Leigh Hochberg
- School of Engineering and Carney Institute for Brain Science, Brown University
- VA RR&D Center for Neurorestoration and Neurotechnology, VA Providence Healthcare System
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Harvard Medical School
| | - Krishna V. Shenoy
- Bio-X Program, Stanford University
- Department of Neurobiology, Stanford University
- Department of Bioengineering, Stanford University
- Wu Tsai Neurosciences Institute, Stanford University
- Howard Hughes Medical Institute at Stanford University
- Department of Electrical Engineering, Stanford University
| | - Jaimie M. Henderson
- Department of Neurosurgery, Stanford University
- Wu Tsai Neurosciences Institute, Stanford University
| | | |
Collapse
|
10
|
Nair V, Dalrymple AN, Yu Z, Balakrishnan G, Bettinger CJ, Weber DJ, Yang K, Robinson JT. Miniature battery-free bioelectronics. Science 2023; 382:eabn4732. [PMID: 37943926 DOI: 10.1126/science.abn4732] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Accepted: 09/28/2023] [Indexed: 11/12/2023]
Abstract
Miniature wireless bioelectronic implants that can operate for extended periods of time can transform how we treat disorders by acting rapidly on precise nerves and organs in a way that drugs cannot. To reach this goal, materials and methods are needed to wirelessly transfer energy through the body or harvest energy from the body itself. We review some of the capabilities of emerging energy transfer methods to identify the performance envelope for existing technology and discover where opportunities lie to improve how much-and how efficiently-we can deliver energy to the tiny bioelectronic implants that can support emerging medical technologies.
Collapse
Affiliation(s)
- Vishnu Nair
- Rice Neuroengineering Initiative, Rice University, Houston, TX, USA
| | - Ashley N Dalrymple
- Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, USA
- Department of Physical Medicine and Rehabilitation, University of Utah, Salt Lake City, UT, USA
| | - Zhanghao Yu
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
| | - Gaurav Balakrishnan
- Department of Materials Science & Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Christopher J Bettinger
- Department of Materials Science & Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Douglas J Weber
- Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
- Center for Neural Basis of Cognition, Pittsburgh, PA, USA
| | - Kaiyuan Yang
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
| | - Jacob T Robinson
- Rice Neuroengineering Initiative, Rice University, Houston, TX, USA
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
| |
Collapse
|
11
|
Perna A, Angotzi GN, Berdondini L, Ribeiro JF. Advancing the interfacing performances of chronically implantable neural probes in the era of CMOS neuroelectronics. Front Neurosci 2023; 17:1275908. [PMID: 38027514 PMCID: PMC10644322 DOI: 10.3389/fnins.2023.1275908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Accepted: 10/10/2023] [Indexed: 12/01/2023] Open
Abstract
Tissue penetrating microelectrode neural probes can record electrophysiological brain signals at resolutions down to single neurons, making them invaluable tools for neuroscience research and Brain-Computer-Interfaces (BCIs). The known gradual decrease of their electrical interfacing performances in chronic settings, however, remains a major challenge. A key factor leading to such decay is Foreign Body Reaction (FBR), which is the cascade of biological responses that occurs in the brain in the presence of a tissue damaging artificial device. Interestingly, the recent adoption of Complementary Metal Oxide Semiconductor (CMOS) technology to realize implantable neural probes capable of monitoring hundreds to thousands of neurons simultaneously, may open new opportunities to face the FBR challenge. Indeed, this shift from passive Micro Electro-Mechanical Systems (MEMS) to active CMOS neural probe technologies creates important, yet unexplored, opportunities to tune probe features such as the mechanical properties of the probe, its layout, size, and surface physicochemical properties, to minimize tissue damage and consequently FBR. Here, we will first review relevant literature on FBR to provide a better understanding of the processes and sources underlying this tissue response. Methods to assess FBR will be described, including conventional approaches based on the imaging of biomarkers, and more recent transcriptomics technologies. Then, we will consider emerging opportunities offered by the features of CMOS probes. Finally, we will describe a prototypical neural probe that may meet the needs for advancing clinical BCIs, and we propose axial insertion force as a potential metric to assess the influence of probe features on acute tissue damage and to control the implantation procedure to minimize iatrogenic injury and subsequent FBR.
Collapse
Affiliation(s)
- Alberto Perna
- Microtechnology for Neuroelectronics Lab, Fondazione Istituto Italiano di Tecnologia, Neuroscience and Brain Technologies, Genova, Italy
- The Open University Affiliated Research Centre at Istituto Italiano di Tecnologia (ARC@IIT), Istituto Italiano di Tecnologia, Genova, Italy
| | - Gian Nicola Angotzi
- Microtechnology for Neuroelectronics Lab, Fondazione Istituto Italiano di Tecnologia, Neuroscience and Brain Technologies, Genova, Italy
| | - Luca Berdondini
- Microtechnology for Neuroelectronics Lab, Fondazione Istituto Italiano di Tecnologia, Neuroscience and Brain Technologies, Genova, Italy
| | - João Filipe Ribeiro
- Microtechnology for Neuroelectronics Lab, Fondazione Istituto Italiano di Tecnologia, Neuroscience and Brain Technologies, Genova, Italy
| |
Collapse
|
12
|
Coughlin B, Muñoz W, Kfir Y, Young MJ, Meszéna D, Jamali M, Caprara I, Hardstone R, Khanna A, Mustroph ML, Trautmann EM, Windolf C, Varol E, Soper DJ, Stavisky SD, Welkenhuysen M, Dutta B, Shenoy KV, Hochberg LR, Mark Richardson R, Williams ZM, Cash SS, Paulk AC. Modified Neuropixels probes for recording human neurophysiology in the operating room. Nat Protoc 2023; 18:2927-2953. [PMID: 37697108 DOI: 10.1038/s41596-023-00871-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 06/08/2023] [Indexed: 09/13/2023]
Abstract
Neuropixels are silicon-based electrophysiology-recording probes with high channel count and recording-site density. These probes offer a turnkey platform for measuring neural activity with single-cell resolution and at a scale that is beyond the capabilities of current clinically approved devices. Our team demonstrated the first-in-human use of these probes during resection surgery for epilepsy or tumors and deep brain stimulation electrode placement in patients with Parkinson's disease. Here, we provide a better understanding of the capabilities and challenges of using Neuropixels as a research tool to study human neurophysiology, with the hope that this information may inform future efforts toward regulatory approval of Neuropixels probes as research devices. In perioperative procedures, the major concerns are the initial sterility of the device, maintaining a sterile field during surgery, having multiple referencing and grounding schemes available to de-noise recordings (if necessary), protecting the silicon probe from accidental contact before insertion and obtaining high-quality action potential and local field potential recordings. The research team ensures that the device is fully operational while coordinating with the surgical team to remove sources of electrical noise that could otherwise substantially affect the signals recorded by the sensitive hardware. Prior preparation using the equipment and training in human clinical research and working in operating rooms maximize effective communication within and between the teams, ensuring high recording quality and minimizing the time added to the surgery. The perioperative procedure requires ~4 h, and the entire protocol requires multiple weeks.
Collapse
Affiliation(s)
- Brian Coughlin
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
- Department of Neurology, Harvard Medical School, Boston, MA, USA
| | - William Muñoz
- Department of Neurosurgery, Harvard Medical School and Massachusetts General Hospital, Boston, MA, USA
| | - Yoav Kfir
- Department of Neurosurgery, Harvard Medical School and Massachusetts General Hospital, Boston, MA, USA
| | - Michael J Young
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
- Department of Neurology, Harvard Medical School, Boston, MA, USA
| | - Domokos Meszéna
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
- Department of Neurology, Harvard Medical School, Boston, MA, USA
| | - Mohsen Jamali
- Department of Neurosurgery, Harvard Medical School and Massachusetts General Hospital, Boston, MA, USA
| | - Irene Caprara
- Department of Neurosurgery, Harvard Medical School and Massachusetts General Hospital, Boston, MA, USA
| | - Richard Hardstone
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
- Department of Neurology, Harvard Medical School, Boston, MA, USA
| | - Arjun Khanna
- Department of Neurosurgery, Harvard Medical School and Massachusetts General Hospital, Boston, MA, USA
| | - Martina L Mustroph
- Department of Neurosurgery, Harvard Medical School and Brigham & Women's Hospital, Boston, MA, USA
| | - Eric M Trautmann
- Department of Neuroscience, Columbia University Medical Center, New York, NY, USA
- Zuckerman Institute, Columbia University, New York, NY, USA
- Grossman Center for the Statistics of Mind, Columbia University Medical Center, New York, NY, USA
| | - Charlie Windolf
- Department of Statistics, Zuckerman Institute, Columbia University, New York, NY, USA
| | - Erdem Varol
- Department of Statistics, Zuckerman Institute, Columbia University, New York, NY, USA
- Department of Computer Science and Engineering, Zuckerman Institute, Columbia University, New York, NY, USA
| | - Dan J Soper
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
- Department of Neurology, Harvard Medical School, Boston, MA, USA
| | - Sergey D Stavisky
- Department of Neurological Surgery, University of California Davis, Davis, CA, USA
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute and Bio-X Institute, Stanford University, Stanford, CA, USA
- Howard Hughes Medical Institute at Stanford University, Stanford, CA, USA
| | | | | | - Krishna V Shenoy
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute and Bio-X Institute, Stanford University, Stanford, CA, USA
- Howard Hughes Medical Institute at Stanford University, Stanford, CA, USA
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
- Department of Bioengineering, Stanford University, Stanford, CA, USA
- Department of Neurobiology, Stanford University, Stanford, CA, USA
| | - Leigh R Hochberg
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
- Department of Neurology, Harvard Medical School, Boston, MA, USA
- VA RR&D Center for Neurorestoration and Neurotechnology, Rehabilitation R&D Service, Providence VA Medical Center, Providence, RI, USA
- School of Engineering and Carney Institute for Brain Science, Brown University, Providence, RI, USA
| | - R Mark Richardson
- Department of Neurosurgery, Harvard Medical School and Massachusetts General Hospital, Boston, MA, USA
| | - Ziv M Williams
- Department of Neurosurgery, Harvard Medical School and Massachusetts General Hospital, Boston, MA, USA.
| | - Sydney S Cash
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA.
- Department of Neurology, Harvard Medical School, Boston, MA, USA.
| | - Angelique C Paulk
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA.
- Department of Neurology, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
13
|
Willett FR, Kunz EM, Fan C, Avansino DT, Wilson GH, Choi EY, Kamdar F, Glasser MF, Hochberg LR, Druckmann S, Shenoy KV, Henderson JM. A high-performance speech neuroprosthesis. Nature 2023; 620:1031-1036. [PMID: 37612500 PMCID: PMC10468393 DOI: 10.1038/s41586-023-06377-x] [Citation(s) in RCA: 50] [Impact Index Per Article: 50.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2023] [Accepted: 06/27/2023] [Indexed: 08/25/2023]
Abstract
Speech brain-computer interfaces (BCIs) have the potential to restore rapid communication to people with paralysis by decoding neural activity evoked by attempted speech into text1,2 or sound3,4. Early demonstrations, although promising, have not yet achieved accuracies sufficiently high for communication of unconstrained sentences from a large vocabulary1-7. Here we demonstrate a speech-to-text BCI that records spiking activity from intracortical microelectrode arrays. Enabled by these high-resolution recordings, our study participant-who can no longer speak intelligibly owing to amyotrophic lateral sclerosis-achieved a 9.1% word error rate on a 50-word vocabulary (2.7 times fewer errors than the previous state-of-the-art speech BCI2) and a 23.8% word error rate on a 125,000-word vocabulary (the first successful demonstration, to our knowledge, of large-vocabulary decoding). Our participant's attempted speech was decoded at 62 words per minute, which is 3.4 times as fast as the previous record8 and begins to approach the speed of natural conversation (160 words per minute9). Finally, we highlight two aspects of the neural code for speech that are encouraging for speech BCIs: spatially intermixed tuning to speech articulators that makes accurate decoding possible from only a small region of cortex, and a detailed articulatory representation of phonemes that persists years after paralysis. These results show a feasible path forward for restoring rapid communication to people with paralysis who can no longer speak.
Collapse
Affiliation(s)
- Francis R Willett
- Howard Hughes Medical Institute at Stanford University, Stanford, CA, USA.
| | - Erin M Kunz
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Chaofei Fan
- Department of Computer Science, Stanford University, Stanford, CA, USA
| | - Donald T Avansino
- Howard Hughes Medical Institute at Stanford University, Stanford, CA, USA
| | - Guy H Wilson
- Department of Neuroscience, Stanford University, Stanford, CA, USA
| | - Eun Young Choi
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
| | - Foram Kamdar
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
| | - Matthew F Glasser
- Department of Neuroscience, Washington University in St. Louis, St. Louis, MO, USA
- Department of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | - Leigh R Hochberg
- VA RR&D Center for Neurorestoration and Neurotechnology, Rehabilitation R&D Service, Providence VA Medical Center, Providence, RI, USA
- School of Engineering and Carney Institute for Brain Science, Brown University, Providence, RI, USA
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Shaul Druckmann
- Department of Neurobiology, Stanford University, Stanford, CA, USA
| | - Krishna V Shenoy
- Howard Hughes Medical Institute at Stanford University, Stanford, CA, USA
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Neurobiology, Stanford University, Stanford, CA, USA
- Department of Bioengineering, Stanford University, Stanford, CA, USA
- Bio-X Program, Stanford University, Stanford, CA, USA
| | - Jaimie M Henderson
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
| |
Collapse
|
14
|
Costello JT, Temmar H, Cubillos LH, Mender MJ, Wallace DM, Willsey MS, Patil PG, Chestek CA. Balancing Memorization and Generalization in RNNs for High Performance Brain-Machine Interfaces. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.28.542435. [PMID: 37292755 PMCID: PMC10245969 DOI: 10.1101/2023.05.28.542435] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Brain-machine interfaces (BMIs) can restore motor function to people with paralysis but are currently limited by the accuracy of real-time decoding algorithms. Recurrent neural networks (RNNs) using modern training techniques have shown promise in accurately predicting movements from neural signals but have yet to be rigorously evaluated against other decoding algorithms in a closed-loop setting. Here we compared RNNs to other neural network architectures in real-time, continuous decoding of finger movements using intracortical signals from nonhuman primates. Across one and two finger online tasks, LSTMs (a type of RNN) outperformed convolutional and transformer-based neural networks, averaging 18% higher throughput than the convolution network. On simplified tasks with a reduced movement set, RNN decoders were allowed to memorize movement patterns and matched able-bodied control. Performance gradually dropped as the number of distinct movements increased but did not go below fully continuous decoder performance. Finally, in a two-finger task where one degree-of-freedom had poor input signals, we recovered functional control using RNNs trained to act both like a movement classifier and continuous decoder. Our results suggest that RNNs can enable functional real-time BMI control by learning and generating accurate movement patterns.
Collapse
|
15
|
Vatsyayan R, Lee J, Bourhis AM, Tchoe Y, Cleary DR, Tonsfeldt KJ, Lee K, Montgomery-Walsh R, Paulk AC, U HS, Cash SS, Dayeh SA. Electrochemical and electrophysiological considerations for clinical high channel count neural interfaces. MRS BULLETIN 2023; 48:531-546. [PMID: 37476355 PMCID: PMC10357958 DOI: 10.1557/s43577-023-00537-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 04/10/2023] [Indexed: 07/22/2023]
Abstract
Electrophysiological recording and stimulation are the gold standard for functional mapping during surgical and therapeutic interventions as well as capturing cellular activity in the intact human brain. A critical component probing human brain activity is the interface material at the electrode contact that electrochemically transduces brain signals to and from free charge carriers in the measurement system. Here, we summarize state-of-the-art electrode array systems in the context of translation for use in recording and stimulating human brain activity. We leverage parametric studies with multiple electrode materials to shed light on the varied levels of suitability to enable high signal-to-noise electrophysiological recordings as well as safe electrophysiological stimulation delivery. We discuss the effects of electrode scaling for recording and stimulation in pursuit of high spatial resolution, channel count electrode interfaces, delineating the electrode-tissue circuit components that dictate the electrode performance. Finally, we summarize recent efforts in the connectorization and packaging for high channel count electrode arrays and provide a brief account of efforts toward wireless neuronal monitoring systems.
Collapse
Affiliation(s)
- Ritwik Vatsyayan
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California, San Diego, San Diego, USA
| | - Jihwan Lee
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California, San Diego, San Diego, USA
| | - Andrew M. Bourhis
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California, San Diego, San Diego, USA
| | - Youngbin Tchoe
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California, San Diego, San Diego, USA
| | - Daniel R. Cleary
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California, San Diego, San Diego, USA; Department of Neurological Surgery, School of Medicine, Oregon Health & Science University, Portland, USA
| | - Karen J. Tonsfeldt
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California, San Diego, San Diego, USA; Department of Obstetrics, Gynecology, and Reproductive Sciences, Center for Reproductive Science and Medicine, University of California, San Diego, San Diego, USA
| | - Keundong Lee
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California, San Diego, San Diego, USA
| | - Rhea Montgomery-Walsh
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California, San Diego, San Diego, USA; Department of Bioengineering, University of California, San Diego, San Diego, USA
| | - Angelique C. Paulk
- Department of Neurology, Harvard Medical School, Boston, USA; Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, USA
| | - Hoi Sang U
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California, San Diego, San Diego, USA
| | - Sydney S. Cash
- Department of Neurology, Harvard Medical School, Boston, USA; Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, USA
| | - Shadi A. Dayeh
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California, San Diego, San Diego, USA; Department of Bioengineering, University of California, San Diego, San Diego, USA
| |
Collapse
|
16
|
Letner JG, Patel PR, Hsieh JC, Smith Flores IM, della Valle E, Walker LA, Weiland JD, Chestek CA, Cai D. Post-explant profiling of subcellular-scale carbon fiber intracortical electrodes and surrounding neurons enables modeling of recorded electrophysiology. J Neural Eng 2023; 20:026019. [PMID: 36848679 PMCID: PMC10022369 DOI: 10.1088/1741-2552/acbf78] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 01/12/2023] [Accepted: 02/27/2023] [Indexed: 03/01/2023]
Abstract
Objective.Characterizing the relationship between neuron spiking and the signals that electrodes record is vital to defining the neural circuits driving brain function and informing clinical brain-machine interface design. However, high electrode biocompatibility and precisely localizing neurons around the electrodes are critical to defining this relationship.Approach.Here, we demonstrate consistent localization of the recording site tips of subcellular-scale (6.8µm diameter) carbon fiber electrodes and the positions of surrounding neurons. We implanted male rats with carbon fiber electrode arrays for 6 or 12+ weeks targeting layer V motor cortex. After explanting the arrays, we immunostained the implant site and localized putative recording site tips with subcellular-cellular resolution. We then 3D segmented neuron somata within a 50µm radius from implanted tips to measure neuron positions and health and compare to healthy cortex with symmetric stereotaxic coordinates.Main results.Immunostaining of astrocyte, microglia, and neuron markers confirmed that overall tissue health was indicative of high biocompatibility near the tips. While neurons near implanted carbon fibers were stretched, their number and distribution were similar to hypothetical fibers placed in healthy contralateral brain. Such similar neuron distributions suggest that these minimally invasive electrodes demonstrate the potential to sample naturalistic neural populations. This motivated the prediction of spikes produced by nearby neurons using a simple point source model fit using recorded electrophysiology and the mean positions of the nearest neurons observed in histology. Comparing spike amplitudes suggests that the radius at which single units can be distinguished from others is near the fourth closest neuron (30.7 ± 4.6µm,X-± S) in layer V motor cortex.Significance.Collectively, these data and simulations provide the first direct evidence that neuron placement in the immediate vicinity of the recording site influences how many spike clusters can be reliably identified by spike sorting.
Collapse
Affiliation(s)
- Joseph G Letner
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Paras R Patel
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Jung-Chien Hsieh
- Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Israel M Smith Flores
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Elena della Valle
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Logan A Walker
- Biophysics Program, University of Michigan, Ann Arbor, MI 48109, United States of America
- Department of Computational Medicine and Bioinformatics, Michigan Medicine, Ann Arbor, MI 48109, United States of America
| | - James D Weiland
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI 48109, United States of America
- Department of Ophthalmology and Visual Sciences, Kellogg Eye Center, University of Michigan, Ann Arbor, MI 48105, United States of America
| | - Cynthia A Chestek
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI 48109, United States of America
- Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI 48109, United States of America
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI 48109, United States of America
- Robotics Department, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Dawen Cai
- Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI 48109, United States of America
- Biophysics Program, University of Michigan, Ann Arbor, MI 48109, United States of America
- Department of Cell and Developmental Biology, University of Michigan Medical School, Ann Arbor, MI 48109, United States of America
| |
Collapse
|
17
|
Erofeev A, Antifeev I, Bolshakova A, Bezprozvanny I, Vlasova O. In Vivo Penetrating Microelectrodes for Brain Electrophysiology. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22239085. [PMID: 36501805 PMCID: PMC9735502 DOI: 10.3390/s22239085] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 11/14/2022] [Accepted: 11/22/2022] [Indexed: 05/13/2023]
Abstract
In recent decades, microelectrodes have been widely used in neuroscience to understand the mechanisms behind brain functions, as well as the relationship between neural activity and behavior, perception and cognition. However, the recording of neuronal activity over a long period of time is limited for various reasons. In this review, we briefly consider the types of penetrating chronic microelectrodes, as well as the conductive and insulating materials for microelectrode manufacturing. Additionally, we consider the effects of penetrating microelectrode implantation on brain tissue. In conclusion, we review recent advances in the field of in vivo microelectrodes.
Collapse
Affiliation(s)
- Alexander Erofeev
- Laboratory of Molecular Neurodegeneration, Graduate School of Biomedical Systems and Technologies, Institute of Biomedical Systems and Biotechnology, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia
- Correspondence: (A.E.); (O.V.)
| | - Ivan Antifeev
- Laboratory of Methods and Instruments for Genetic and Immunoassay Analysis, Institute for Analytical Instrumentation of the Russian Academy of Sciences, 198095 Saint Petersburg, Russia
| | - Anastasia Bolshakova
- Laboratory of Molecular Neurodegeneration, Graduate School of Biomedical Systems and Technologies, Institute of Biomedical Systems and Biotechnology, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia
| | - Ilya Bezprozvanny
- Laboratory of Molecular Neurodegeneration, Graduate School of Biomedical Systems and Technologies, Institute of Biomedical Systems and Biotechnology, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia
- Department of Physiology, University of Texas Southwestern Medical Center at Dallas, Dallas, TX 75390, USA
| | - Olga Vlasova
- Laboratory of Molecular Neurodegeneration, Graduate School of Biomedical Systems and Technologies, Institute of Biomedical Systems and Biotechnology, Peter the Great St. Petersburg Polytechnic University, 195251 Saint Petersburg, Russia
- Correspondence: (A.E.); (O.V.)
| |
Collapse
|
18
|
Chiappalone M, Cota VR, Carè M, Di Florio M, Beaubois R, Buccelli S, Barban F, Brofiga M, Averna A, Bonacini F, Guggenmos DJ, Bornat Y, Massobrio P, Bonifazi P, Levi T. Neuromorphic-Based Neuroprostheses for Brain Rewiring: State-of-the-Art and Perspectives in Neuroengineering. Brain Sci 2022; 12:1578. [PMID: 36421904 PMCID: PMC9688667 DOI: 10.3390/brainsci12111578] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 11/09/2022] [Accepted: 11/17/2022] [Indexed: 08/27/2023] Open
Abstract
Neuroprostheses are neuroengineering devices that have an interface with the nervous system and supplement or substitute functionality in people with disabilities. In the collective imagination, neuroprostheses are mostly used to restore sensory or motor capabilities, but in recent years, new devices directly acting at the brain level have been proposed. In order to design the next-generation of neuroprosthetic devices for brain repair, we foresee the increasing exploitation of closed-loop systems enabled with neuromorphic elements due to their intrinsic energy efficiency, their capability to perform real-time data processing, and of mimicking neurobiological computation for an improved synergy between the technological and biological counterparts. In this manuscript, after providing definitions of key concepts, we reviewed the first exploitation of a real-time hardware neuromorphic prosthesis to restore the bidirectional communication between two neuronal populations in vitro. Starting from that 'case-study', we provide perspectives on the technological improvements for real-time interfacing and processing of neural signals and their potential usage for novel in vitro and in vivo experimental designs. The development of innovative neuroprosthetics for translational purposes is also presented and discussed. In our understanding, the pursuit of neuromorphic-based closed-loop neuroprostheses may spur the development of novel powerful technologies, such as 'brain-prostheses', capable of rewiring and/or substituting the injured nervous system.
Collapse
Affiliation(s)
- Michela Chiappalone
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
- Rehab Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| | - Vinicius R. Cota
- Rehab Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| | - Marta Carè
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
- Rehab Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| | - Mattia Di Florio
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
| | - Romain Beaubois
- IMS Laboratory, CNRS UMR 5218, University of Bordeaux, 33405 Talence, France
| | - Stefano Buccelli
- Rehab Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| | - Federico Barban
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
- Rehab Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| | - Martina Brofiga
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
| | - Alberto Averna
- Department of Neurology, Bern University Hospital, University of Bern, 3012 Bern, Switzerland
| | - Francesco Bonacini
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
| | - David J. Guggenmos
- Department of Rehabilitation Medicine, University of Kansas Medical Center, Kansas City, KS 66103, USA
- Landon Center on Aging, University of Kansas Medical Center, Kansas City, KS 66103, USA
| | - Yannick Bornat
- IMS Laboratory, CNRS UMR 5218, University of Bordeaux, 33405 Talence, France
| | - Paolo Massobrio
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
- National Institute for Nuclear Physics (INFN), 16146 Genova, Italy
| | - Paolo Bonifazi
- IKERBASQUE, The Basque Fundation, 48009 Bilbao, Spain
- Biocruces Health Research Institute, 48903 Barakaldo, Spain
| | - Timothée Levi
- IMS Laboratory, CNRS UMR 5218, University of Bordeaux, 33405 Talence, France
| |
Collapse
|
19
|
Lee SH, Thunemann M, Lee K, Cleary DR, Tonsfeldt KJ, Oh H, Azzazy F, Tchoe Y, Bourhis AM, Hossain L, Ro YG, Tanaka A, Kılıç K, Devor A, Dayeh SA. Scalable Thousand Channel Penetrating Microneedle Arrays on Flex for Multimodal and Large Area Coverage BrainMachine Interfaces. ADVANCED FUNCTIONAL MATERIALS 2022; 32:2112045. [PMID: 36381629 PMCID: PMC9648634 DOI: 10.1002/adfm.202112045] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Indexed: 05/29/2023]
Abstract
The Utah array powers cutting-edge projects for restoration of neurological function, such as BrainGate, but the underlying electrode technology has itself advanced little in the last three decades. Here, advanced dual-side lithographic microfabrication processes is exploited to demonstrate a 1024-channel penetrating silicon microneedle array (SiMNA) that is scalable in its recording capabilities and cortical coverage and is suitable for clinical translation. The SiMNA is the first penetrating microneedle array with a flexible backing that affords compliancy to brain movements. In addition, the SiMNA is optically transparent permitting simultaneous optical and electrophysiological interrogation of neuronal activity. The SiMNA is used to demonstrate reliable recordings of spontaneous and evoked field potentials and of single unit activity in chronically implanted mice for up to 196 days in response to optogenetic and to whisker air-puff stimuli. Significantly, the 1024-channel SiMNA establishes detailed spatiotemporal mapping of broadband brain activity in rats. This novel scalable and biocompatible SiMNA with its multimodal capability and sensitivity to broadband brain activity will accelerate the progress in fundamental neurophysiological investigations and establishes a new milestone for penetrating and large area coverage microelectrode arrays for brain-machine interfaces.
Collapse
Affiliation(s)
- Sang Heon Lee
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
| | - Martin Thunemann
- Biomedical Engineering Department, Boston University, Boston, MA 02215, USA
| | - Keundong Lee
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
| | - Daniel R Cleary
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
- Department of Neurological Surgery, University of California San Diego, La Jolla, CA 92093, USA
| | - Karen J Tonsfeldt
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
- Department of Obstetrics, Gynecology, and Reproductive Sciences, Center for Reproductive Science and Medicine, University of California San Diego, La Jolla, CA 92093, USA
| | - Hongseok Oh
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
| | - Farid Azzazy
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
| | - Youngbin Tchoe
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
| | - Andrew M Bourhis
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
| | - Lorraine Hossain
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
- Graduate Program of Materials Science and Engineering, University of California San Diego, La Jolla, CA 92093, USA
| | - Yun Goo Ro
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
| | - Atsunori Tanaka
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
- Graduate Program of Materials Science and Engineering, University of California San Diego, La Jolla, CA 92093, USA
| | - Kıvılcım Kılıç
- Biomedical Engineering Department, Boston University, Boston, MA 02215, USA
| | - Anna Devor
- Biomedical Engineering Department, Boston University, Boston, MA 02215, USA
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Harvard Medical School, Massachusetts General Hospital, Charlestown, MA 02129, USA
| | - Shadi A Dayeh
- Integrated Electronics and Biointerfaces Laboratory, Department of Electrical and Computer Engineering, University of California San Diego, CA 92093, USA
- Graduate Program of Materials Science and Engineering, University of California San Diego, La Jolla, CA 92093, USA
| |
Collapse
|
20
|
Bod RB, Rokai J, Meszéna D, Fiáth R, Ulbert I, Márton G. From End to End: Gaining, Sorting, and Employing High-Density Neural Single Unit Recordings. Front Neuroinform 2022; 16:851024. [PMID: 35769832 PMCID: PMC9236662 DOI: 10.3389/fninf.2022.851024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Accepted: 05/06/2022] [Indexed: 11/15/2022] Open
Abstract
The meaning behind neural single unit activity has constantly been a challenge, so it will persist in the foreseeable future. As one of the most sourced strategies, detecting neural activity in high-resolution neural sensor recordings and then attributing them to their corresponding source neurons correctly, namely the process of spike sorting, has been prevailing so far. Support from ever-improving recording techniques and sophisticated algorithms for extracting worthwhile information and abundance in clustering procedures turned spike sorting into an indispensable tool in electrophysiological analysis. This review attempts to illustrate that in all stages of spike sorting algorithms, the past 5 years innovations' brought about concepts, results, and questions worth sharing with even the non-expert user community. By thoroughly inspecting latest innovations in the field of neural sensors, recording procedures, and various spike sorting strategies, a skeletonization of relevant knowledge lays here, with an initiative to get one step closer to the original objective: deciphering and building in the sense of neural transcript.
Collapse
Affiliation(s)
- Réka Barbara Bod
- Laboratory of Experimental Neurophysiology, Department of Physiology, Faculty of Medicine, George Emil Palade University of Medicine, Pharmacy, Science and Technology of Târgu Mureş, Târgu Mureş, Romania
| | - János Rokai
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- School of PhD Studies, Semmelweis University, Budapest, Hungary
| | - Domokos Meszéna
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| | - Richárd Fiáth
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| | - István Ulbert
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| | - Gergely Márton
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| |
Collapse
|
21
|
Costello JT, Nason SR, An H, Lee J, Mender MJ, Temmar H, Wallace DM, Lim J, Willsey MS, Patil PG, Jang T, Phillips JD, Kim HS, Blaauw D, Chestek CA. A low-power communication scheme for wireless, 1000 channel brain-machine interfaces. J Neural Eng 2022; 19. [PMID: 35613546 DOI: 10.1088/1741-2552/ac7352] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Accepted: 05/24/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Brain-machine interfaces (BMIs) have the potential to restore motor function but are currently limited by electrode count and long-term recording stability. These challenges may be solved through the use of free-floating "motes" which wirelessly transmit recorded neural signals, if power consumption can be kept within safe levels when scaling to thousands of motes. Here, we evaluated a pulse-interval modulation (PIM) communication scheme for infrared (IR)-based motes that aims to reduce the wireless data rate and system power consumption. APPROACH To test PIM's ability to efficiently communicate neural information, we simulated the communication scheme in a real-time closed-loop BMI with non-human primates. Additionally, we performed circuit simulations of an IR-based 1000-mote system to calculate communication accuracy and total power consumption. MAIN RESULTS We found that PIM at 1kb/s per channel maintained strong correlations with true firing rate and matched online BMI performance of a traditional wired system. Closed-loop BMI tests suggest that lags as small as 30 ms can have significant performance effects. Finally, unlike other IR communication schemes, PIM is feasible in terms of power, and neural data can accurately be recovered on a receiver using 3mW for 1000 channels. SIGNIFICANCE These results suggest that PIM-based communication could significantly reduce power usage of wireless motes to enable higher channel-counts for high-performance BMIs.
Collapse
Affiliation(s)
- Joseph T Costello
- Electrical and Computer Engineering, University of Michigan, 2800 Plymouth Rd, B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Samuel R Nason
- Biomedical Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Hyochan An
- Electrical and Computer Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Jungho Lee
- Electrical and Computer Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Matthew J Mender
- Biomedical Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Hisham Temmar
- Biomedical Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Dylan M Wallace
- Robotics Institute, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, 48109-1382, UNITED STATES
| | - Jongyup Lim
- Electrical and Computer Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Matthew S Willsey
- Department of Neurosurgery, University of Michigan Medical School, 1500 E Medical Center Drive, Ann Arbor, 48109-0624, UNITED STATES
| | - Parag G Patil
- Neurosurgery, University of Michigan, 1500 E Medical Center Drive, Ann Arbor, Michigan, 48109, UNITED STATES
| | - Taekwang Jang
- Department of Information Technology and Electrical Engineering, ETH Zurich, ETH Zurich, Rämistrasse 101, Zurich, 8092, SWITZERLAND
| | - Jamie Dean Phillips
- Department of Electrical and Computer Engineering, University of Delaware, Evans Hall, 139 The Green,, Newark, Delaware, 19716-5600, UNITED STATES
| | - Hun-Seok Kim
- Electrical and Computer Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - David Blaauw
- University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Cynthia A Chestek
- Biomedical Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| |
Collapse
|
22
|
Neuromotor prosthetic to treat stroke-related paresis: N-of-1 trial. COMMUNICATIONS MEDICINE 2022; 2:37. [PMID: 35603289 PMCID: PMC9053238 DOI: 10.1038/s43856-022-00105-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2021] [Accepted: 03/18/2022] [Indexed: 11/25/2022] Open
Abstract
Background Functional recovery of arm movement typically plateaus following a stroke, leaving chronic motor deficits. Brain-computer interfaces (BCI) may be a potential treatment for post-stroke deficits Methods In this n-of-1 trial (NCT03913286), a person with chronic subcortical stroke with upper-limb motor impairment used a powered elbow-wrist-hand orthosis that opened and closed the affected hand using cortical activity, recorded from a percutaneous BCI comprised of four microelectrode arrays implanted in the ipsilesional precentral gyrus, based on decoding of spiking patterns and high frequency field potentials generated by imagined hand movements. The system was evaluated in a home setting for 12 weeks Results Robust single unit activity, modulating with attempted or imagined movement, was present throughout the precentral gyrus. The participant acquired voluntary control over a hand-orthosis, achieving 10 points on the Action Research Arm Test using the BCI, compared to 0 without any device, and 5 using myoelectric control. Strength, spasticity, the Fugl-Meyer scores improved. Conclusions We demonstrate in a human being that ensembles of individual neurons in the cortex overlying a chronic supratentorial, subcortical stroke remain active and engaged in motor representation and planning and can be used to electrically bypass the stroke and promote limb function. The participant’s ability to rapidly acquire control over otherwise paralyzed hand opening, more than 18 months after a stroke, may justify development of a fully implanted movement restoration system to expand the utility of fully implantable BCI to a clinical population that numbers in the tens of millions worldwide. Stroke is a restriction of blood flow to part of the brain and can lead to chronic issues with a person’s ability to control the limbs. The aim of this study was to see if a new type of device could restore movement in a person with arm weakness due to a stroke that occurred a year earlier. In our trial, a sensor was implanted into the surface of the brain, near the site of the stroke, and was connected to a computer that generated a command to open and close the hand with a motorized brace worn on the hand. This person was able to use their own brain activity to trigger the brace and pick up and move objects. This research could support the development of similar medical devices to restore movement in people who have had strokes. Serruya et al. test in an N-of-1 trial whether a wearable, powered exoskeletal orthosis, driven by a percutaneous, implanted brain–computer interface can restore voluntary upper extremity function following chronic hemiparesis subsequent to a cerebral subcortical stroke. Using this approach, voluntary opening of the paralyzed hand is restored.
Collapse
|
23
|
Kunigk NG, Urdaneta ME, Malone IG, Delgado F, Otto KJ. Reducing Behavioral Detection Thresholds per Electrode via Synchronous, Spatially-Dependent Intracortical Microstimulation. Front Neurosci 2022; 16:876142. [PMID: 35784835 PMCID: PMC9247280 DOI: 10.3389/fnins.2022.876142] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Accepted: 05/31/2022] [Indexed: 12/04/2022] Open
Abstract
Intracortical microstimulation (ICMS) has shown promise in restoring quality of life to patients suffering from paralysis, specifically when used in the primary somatosensory cortex (S1). However, these benefits can be hampered by long-term degradation of electrode performance due to the brain's foreign body response. Advances in microfabrication techniques have allowed for the development of neuroprostheses with subcellular electrodes, which are characterized by greater versatility and a less detrimental immune response during chronic use. These probes are hypothesized to enable more selective, higher-resolution stimulation of cortical tissue with long-term implants. However, microstimulation using physiologically relevant charges with these smaller-scale devices can damage electrode sites and reduce the efficacy of the overall device. Studies have shown promise in bypassing this limitation by spreading the stimulation charge between multiple channels in an implanted electrode array, but to our knowledge the usefulness of this strategy in laminar arrays with electrode sites spanning each layer of the cortex remains unexplored. To investigate the efficacy of simultaneous multi-channel ICMS in electrode arrays with stimulation sites spanning cortical depth, we implanted laminar electrode arrays in the primary somatosensory cortex of rats trained in a behavioral avoidance paradigm. By measuring detection thresholds, we were able to quantify improvements in ICMS performance using a simultaneous multi-channel stimulation paradigm. The charge required per site to elicit detection thresholds was halved when stimulating from two adjacent electrode sites, although the overall charge used by the implant was increased. This reduction in threshold charge was more pronounced when stimulating with more than two channels and lessened with greater distance between stimulating channels. Our findings suggest that these improvements are based on the synchronicity and polarity of each stimulus, leading us to conclude that these improvements in stimulation efficiency per electrode are due to charge summation as opposed to a summation of neural responses to stimulation. Additionally, the per-site charge reductions are seen regardless of the cortical depth of each utilized channel. This evocation of physiological detection thresholds with lower stimulation currents per electrode site has implications for the feasibility of stimulation regimes in future advanced neuroprosthetic devices, which could benefit from reducing the charge output per site.
Collapse
Affiliation(s)
- Nicolas G. Kunigk
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL, United States
| | - Morgan E. Urdaneta
- Department of Neuroscience, University of Florida, Gainesville, FL, United States
| | - Ian G. Malone
- Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, United States
| | - Francisco Delgado
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL, United States
| | - Kevin J. Otto
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL, United States
- Department of Neuroscience, University of Florida, Gainesville, FL, United States
- Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, United States
- Department of Materials Science and Engineering, University of Florida, Gainesville, FL, United States
- Department of Neurology, University of Florida, Gainesville, FL, United States
- McKnight Brain Institute, University of Florida, Gainesville, FL, United States
- *Correspondence: Kevin J. Otto,
| |
Collapse
|
24
|
Huan Y, Gill JP, Fritzinger JB, Patel PR, Richie JM, Valle ED, Weiland JD, Chestek CA, Chiel HJ. Carbon fiber electrodes for intracellular recording and stimulation. J Neural Eng 2021; 18:10.1088/1741-2552/ac3dd7. [PMID: 34826825 PMCID: PMC10729305 DOI: 10.1088/1741-2552/ac3dd7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Accepted: 11/26/2021] [Indexed: 01/18/2023]
Abstract
Objective.To understand neural circuit dynamics, it is critical to manipulate and record many individual neurons. Traditional recording methods, such as glass microelectrodes, can only control a small number of neurons. More recently, devices with high electrode density have been developed, but few of them can be used for intracellular recording or stimulation in intact nervous systems. Carbon fiber electrodes (CFEs) are 8µm-diameter electrodes that can be assembled into dense arrays (pitches ⩾ 80µm). They have good signal-to-noise ratios (SNRs) and provide stable extracellular recordings both acutely and chronically in neural tissuein vivo(e.g. rat motor cortex). The small fiber size suggests that arrays could be used for intracellular stimulation.Approach.We tested CFEs for intracellular stimulation using the large identified and electrically compact neurons of the marine molluskAplysia californica. Neuron cell bodies inAplysiarange from 30µm to over 250µm. We compared the efficacy of CFEs to glass microelectrodes by impaling the same neuron's cell body with both electrodes and connecting them to a DC coupled amplifier.Main results.We observed that intracellular waveforms were essentially identical, but the amplitude and SNR in the CFE were lower than in the glass microelectrode. CFE arrays could record from 3 to 8 neurons simultaneously for many hours, and many of these recordings were intracellular, as shown by simultaneous glass microelectrode recordings. CFEs coated with platinum-iridium could stimulate and had stable impedances over many hours. CFEs not within neurons could record local extracellular activity. Despite the lower SNR, the CFEs could record synaptic potentials. CFEs were less sensitive to mechanical perturbations than glass microelectrodes.Significance.The ability to do stable multi-channel recording while stimulating and recording intracellularly make CFEs a powerful new technology for studying neural circuit dynamics.
Collapse
Affiliation(s)
- Yu Huan
- Department of Biology, Case Western Reserve University, Cleveland, OH, United States of America
| | - Jeffrey P Gill
- Department of Biology, Case Western Reserve University, Cleveland, OH, United States of America
| | - Johanna B Fritzinger
- Department of Neurosciences, University of Rochester, Rochester, NY, United States of America
| | - Paras R Patel
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI, United States of America
| | - Julianna M Richie
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI, United States of America
| | - Elena Della Valle
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI, United States of America
| | - James D Weiland
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI, United States of America
- Department of Ophthalmology and Visual Sciences, University of Michigan, Ann Arbor, MI, United States of America
| | - Cynthia A Chestek
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Biointerfaces Institute, University of Michigan, Ann Arbor, MI, United States of America
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, United States of America
- Neurosciences Program, University of Michigan, Ann Arbor, MI, United States of America
- Robotics Program, University of Michigan, Ann Arbor, MI, United States of America
| | - Hillel J Chiel
- Department of Biology, Case Western Reserve University, Cleveland, OH, United States of America
- Department of Neurosciences, Case Western Reserve University, Cleveland, OH, United States of America
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, United States of America
| |
Collapse
|
25
|
Garg R, Roman DS, Wang Y, Cohen-Karni D, Cohen-Karni T. Graphene nanostructures for input-output bioelectronics. BIOPHYSICS REVIEWS 2021; 2:041304. [PMID: 35005709 PMCID: PMC8717360 DOI: 10.1063/5.0073870] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Accepted: 12/03/2021] [Indexed: 01/01/2023]
Abstract
The ability to manipulate the electrophysiology of electrically active cells and tissues has enabled a deeper understanding of healthy and diseased tissue states. This has primarily been achieved via input/output (I/O) bioelectronics that interface engineered materials with biological entities. Stable long-term application of conventional I/O bioelectronics advances as materials and processing techniques develop. Recent advancements have facilitated the development of graphene-based I/O bioelectronics with a wide variety of functional characteristics. Engineering the structural, physical, and chemical properties of graphene nanostructures and integration with modern microelectronics have enabled breakthrough high-density electrophysiological investigations. Here, we review recent advancements in 2D and 3D graphene-based I/O bioelectronics and highlight electrophysiological studies facilitated by these emerging platforms. Challenges and present potential breakthroughs that can be addressed via graphene bioelectronics are discussed. We emphasize the need for a multidisciplinary approach across materials science, micro-fabrication, and bioengineering to develop the next generation of I/O bioelectronics.
Collapse
Affiliation(s)
- Raghav Garg
- Department of Materials Science and Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, USA
| | - Daniel San Roman
- Department of Materials Science and Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, USA
| | - Yingqiao Wang
- Department of Materials Science and Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, USA
| | - Devora Cohen-Karni
- Preclinical education biochemistry, Lake Erie College of Osteopathic Medicine at Seton Hill, Greensburg, Pennsylvania 15601, USA
| | | |
Collapse
|
26
|
Massey TL, Gleick JR, Haque RUM. Automated Multiplexed Potentiostat System (AMPS) for High-Throughput Characterization of Neural Interfaces. IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE : HEALTHCARE TECHNOLOGY : [PROCEEDINGS]. IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE 2021; 2021:10.1109/biocas49922.2021.9644948. [PMID: 35211701 PMCID: PMC8862781 DOI: 10.1109/biocas49922.2021.9644948] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Neural interfaces with increasing channel counts require a scalable means of testing. While multiplexed potentiostats have long been the solution to this problem, most have been dedicated to one specific probe design or potentiostat, limited in the electrochemical techniques available, inordinately expensive, or they support multiplexing of too few channels. We present the design of an automated multiplexed potentiostat system that addresses these limitations-it is easily generalizable to any probe and potentiostat, supports any electrochemical technique available with the potentiostat, is low-cost, and can readily be expanded to hundreds of channels with support for multiple simultaneous potentiostats. This paper discusses the design philosophy and architecture of our 512-channel, 4-potentiostat system before demonstrating functionality with electrochemical impedance spectroscopy data, cyclic voltammetry curves, and an example of electrochemical surface modification, all on functional implantable microelectrode arrays currently being used for in vivo electrophysiological studies. Finally, we discuss the limitations to some sensitive or high-frequency impedance measurements due to reactive parasitics.
Collapse
Affiliation(s)
- Travis L. Massey
- Materials Engineering Division, Lawrence Livermore National Laboratory, Livermore, CA 94550, USA.,
| | - Jeremy R. Gleick
- Materials Engineering Division, Lawrence Livermore National Laboratory, Livermore, CA 94550, USA
| | - Razi-ul M. Haque
- Materials Engineering Division, Lawrence Livermore National Laboratory, Livermore, CA 94550, USA
| |
Collapse
|
27
|
Chandrasekaran S, Fifer M, Bickel S, Osborn L, Herrero J, Christie B, Xu J, Murphy RKJ, Singh S, Glasser MF, Collinger JL, Gaunt R, Mehta AD, Schwartz A, Bouton CE. Historical perspectives, challenges, and future directions of implantable brain-computer interfaces for sensorimotor applications. Bioelectron Med 2021; 7:14. [PMID: 34548098 PMCID: PMC8456563 DOI: 10.1186/s42234-021-00076-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Accepted: 08/29/2021] [Indexed: 11/10/2022] Open
Abstract
Almost 100 years ago experiments involving electrically stimulating and recording from the brain and the body launched new discoveries and debates on how electricity, movement, and thoughts are related. Decades later the development of brain-computer interface technology began, which now targets a wide range of applications. Potential uses include augmentative communication for locked-in patients and restoring sensorimotor function in those who are battling disease or have suffered traumatic injury. Technical and surgical challenges still surround the development of brain-computer technology, however, before it can be widely deployed. In this review we explore these challenges, historical perspectives, and the remarkable achievements of clinical study participants who have bravely forged new paths for future beneficiaries.
Collapse
Affiliation(s)
- Santosh Chandrasekaran
- Neural Bypass and Brain Computer Interface Laboratory, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
| | - Matthew Fifer
- Research and Exploratory Development Department, Johns Hopkins University Applied Physics Laboratory, Laurel, MD, USA
| | - Stephan Bickel
- The Human Brain Mapping Laboratory, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
- Department of Neurosurgery, Barbara Zucker School of Medicine at Hofstra/Northwell, Manhasset, NY, USA
- Department of Neurology, Donald and Barbara Zucker School of Medicine at Hofstra/Northwell, Manhasset, NY, USA
| | - Luke Osborn
- Research and Exploratory Development Department, Johns Hopkins University Applied Physics Laboratory, Laurel, MD, USA
| | - Jose Herrero
- The Human Brain Mapping Laboratory, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
| | - Breanne Christie
- Research and Exploratory Development Department, Johns Hopkins University Applied Physics Laboratory, Laurel, MD, USA
| | - Junqian Xu
- Departments of Radiology and Psychiatry, Baylor College of Medicine, Houston, TX, USA
| | - Rory K J Murphy
- Department of Neurosurgery, Barrow Neurological Institute, St. Joseph's Hospital and Medical Center, Phoenix, AZ, USA
| | - Sandeep Singh
- Good Shepherd Rehabilitation Hospital, Allentown, PA, USA
| | - Matthew F Glasser
- Departments of Radiology and Neuroscience, Washington University in St Louis, Saint Louis, MO, USA
| | - Jennifer L Collinger
- Rehabilitation Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA, USA
| | - Robert Gaunt
- Rehabilitation Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA, USA
| | - Ashesh D Mehta
- The Human Brain Mapping Laboratory, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
- Department of Neurosurgery, Barbara Zucker School of Medicine at Hofstra/Northwell, Manhasset, NY, USA
| | - Andrew Schwartz
- McGowan Institute of Regenerative Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Chad E Bouton
- Neural Bypass and Brain Computer Interface Laboratory, Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA.
- Department of Molecular Medicine, Donald and Barbara Zucker School of Medicine at Hofstra/Northwell, Manhasset, NY, USA.
| |
Collapse
|
28
|
Pérez-Prieto N, Delgado-Restituto M. Recording Strategies for High Channel Count, Densely Spaced Microelectrode Arrays. Front Neurosci 2021; 15:681085. [PMID: 34326718 PMCID: PMC8313871 DOI: 10.3389/fnins.2021.681085] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Accepted: 06/18/2021] [Indexed: 12/03/2022] Open
Abstract
Neuroscience research into how complex brain functions are implemented at an extra-cellular level requires in vivo neural recording interfaces, including microelectrodes and read-out circuitry, with increased observability and spatial resolution. The trend in neural recording interfaces toward employing high-channel-count probes or 2D microelectrodes arrays with densely spaced recording sites for recording large neuronal populations makes it harder to save on resources. The low-noise, low-power requirement specifications of the analog front-end usually requires large silicon occupation, making the problem even more challenging. One common approach to alleviating this consumption area burden relies on time-division multiplexing techniques in which read-out electronics are shared, either partially or totally, between channels while preserving the spatial and temporal resolution of the recordings. In this approach, shared elements have to operate over a shorter time slot per channel and active area is thus traded off against larger operating frequencies and signal bandwidths. As a result, power consumption is only mildly affected, although other performance metrics such as in-band noise or crosstalk may be degraded, particularly if the whole read-out circuit is multiplexed at the analog front-end input. In this article, we review the different implementation alternatives reported for time-division multiplexing neural recording systems, analyze their advantages and drawbacks, and suggest strategies for improving performance.
Collapse
Affiliation(s)
- Norberto Pérez-Prieto
- Institute of Microelectronics of Seville (IMSE-Centro Nacional de Microelectrónica), Spanish National Research Council, Seville, Spain
| | - Manuel Delgado-Restituto
- Institute of Microelectronics of Seville (IMSE-Centro Nacional de Microelectrónica), Spanish National Research Council, Seville, Spain
| |
Collapse
|
29
|
Boergens KM, Tadić A, Hopper MS, McNamara I, Fell D, Sahasrabuddhe K, Kong Y, Straka M, Sohal HS, Angle MR. Laser ablation of the pia mater for insertion of high-density microelectrode arrays in a translational sheep model. J Neural Eng 2021; 18. [PMID: 34038875 DOI: 10.1088/1741-2552/ac0585] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2020] [Accepted: 05/26/2021] [Indexed: 01/03/2023]
Abstract
Objective. The safe insertion of high density intracortical electrode arrays has been a long-standing practical challenge for neural interface engineering and applications such as brain-computer interfaces (BCIs). However, the pia mater can be difficult to penetrate and causes deformation of underlying cortical tissue during insertion of high-density intracortical arrays. This can lead to neuron damage or failed insertions. The development of a method to ease insertion through the pia mater would represent a significant step toward inserting high density intracortical arrays.Approach. Here we describe a surgical procedure, inspired by laser corneal ablation, that can be used in translational models to thin the pia mater.Main results. We demonstrate that controlled pia removal with laser ablation over a small area of cortex allows for microelectrode arrays to be inserted into the cortex with less force, thus reducing deformation of underlying tissue during placement of the microelectrodes. This procedure allows for insertion of high-density electrode arrays and subsequent acute recordings of spiking neuron activity in sheep cortex. We also show histological and electrophysiological evidence that laser removal of the pia does not acutely affect neuronal viability in the region.Significance. Laser ablation of the pia reduces insertion forces of high-density arrays with minimal to no acute damage to cortical neurons. This approach suggests a promising new path for clinical BCI with high-density microelectrode arrays.
Collapse
Affiliation(s)
| | | | | | | | - Devin Fell
- Paradromics, Inc., Austin, TX, United States of America
| | | | - Yifan Kong
- Paradromics, Inc., Austin, TX, United States of America
| | | | | | | |
Collapse
|
30
|
Analysis and Reduction of Nonlinear Distortion in AC-Coupled CMOS Neural Amplifiers with Tunable Cutoff Frequencies. SENSORS 2021; 21:s21093116. [PMID: 33946209 PMCID: PMC8125415 DOI: 10.3390/s21093116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2021] [Revised: 04/16/2021] [Accepted: 04/21/2021] [Indexed: 11/16/2022]
Abstract
Integrated CMOS neural amplifiers are key elements of modern large-scale neuroelectronic interfaces. The neural amplifiers are routinely AC-coupled to electrodes to remove the DC voltage. The large resistances required for the AC coupling circuit are usually realized using MOSFETs that are nonlinear. Specifically, designs with tunable cutoff frequency of the input high‑pass filter may suffer from excessive nonlinearity, since the gate-source voltages of the transistors forming the pseudoresistors vary following the signal being amplified. Consequently, the nonlinear distortion in such circuits may be high for signal frequencies close to the cutoff frequency of the input filter. Here we propose a simple modification of the architecture of a tunable AC-coupled amplifier, in which the bias voltages Vgs of the transistors forming the pseudoresistor are kept constant independently of the signal levels, what results in significantly improved linearity. Based on numerical simulations of the proposed circuit designed in 180 nm technology we analyze the Total Harmonic Distortion levels as a function of signal frequency and amplitude. We also investigate the impact of basic amplifier parameters—gain, cutoff frequency of the AC coupling circuit, and silicon area—on the distortion and noise performance. The post-layout simulations of the complete test ASIC show that the distortion is very significantly reduced at frequencies near the cutoff frequency, when compared to the commonly used circuits. The THD values are below 1.17% for signal frequencies 1 Hz–10 kHz and signal amplitudes up to 10 mV peak-to-peak. The preamplifier area is only 0.0046 mm2 and the noise is 8.3 µVrms in the 1 Hz–10 kHz range. To our knowledge this is the first report on a CMOS neural amplifier with systematic characterization of THD across complete range of frequencies and amplitudes of neuronal signals recorded by extracellular electrodes.
Collapse
|
31
|
Trumpis M, Chiang CH, Orsborn AL, Bent B, Li J, Rogers JA, Pesaran B, Cogan G, Viventi J. Sufficient sampling for kriging prediction of cortical potential in rat, monkey, and human µECoG. J Neural Eng 2021; 18. [PMID: 33326943 DOI: 10.1088/1741-2552/abd460] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Accepted: 12/16/2020] [Indexed: 12/22/2022]
Abstract
Objective. Large channel count surface-based electrophysiology arrays (e.g. µECoG) are high-throughput neural interfaces with good chronic stability. Electrode spacing remains ad hoc due to redundancy and nonstationarity of field dynamics. Here, we establish a criterion for electrode spacing based on the expected accuracy of predicting unsampled field potential from sampled sites.Approach. We applied spatial covariance modeling and field prediction techniques based on geospatial kriging to quantify sufficient sampling for thousands of 500 ms µECoG snapshots in human, monkey, and rat. We calculated a probably approximately correct (PAC) spacing based on kriging that would be required to predict µECoG fields at≤10% error for most cases (95% of observations).Main results. Kriging theory accurately explained the competing effects of electrode density and noise on predicting field potential. Across five frequency bands from 4-7 to 75-300 Hz, PAC spacing was sub-millimeter for auditory cortex in anesthetized and awake rats, and posterior superior temporal gyrus in anesthetized human. At 75-300 Hz, sub-millimeter PAC spacing was required in all species and cortical areas.Significance. PAC spacing accounted for the effect of signal-to-noise on prediction quality and was sensitive to the full distribution of non-stationary covariance states. Our results show that µECoG arrays should sample at sub-millimeter resolution for applications in diverse cortical areas and for noise resilience.
Collapse
Affiliation(s)
- Michael Trumpis
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, United States of America
| | - Chia-Han Chiang
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, United States of America
| | - Amy L Orsborn
- Center for Neural Science, New York University, New York, NY 10003, United States of America.,Department of Electrical & Computer Engineering, University of Washington, Seattle, WA 98195, United States of America.,Department of Bioengineering, University of Washington, Seattle, Washington 98105, United States of America.,Washington National Primate Research Center, Seattle, Washington 98195, United States of America
| | - Brinnae Bent
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, United States of America
| | - Jinghua Li
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL 60208, United States of America.,Department of Materials Science and Engineering, The Ohio State University, Columbus, OH 43210, United States of America.,Chronic Brain Injury Program, The Ohio State University, Columbus, OH 43210, United States of America
| | - John A Rogers
- Department of Materials Science and Engineering, Northwestern University, Evanston, IL 60208, United States of America.,Simpson Querrey Institute, Northwestern University, Chicago, IL 60611, United States of America.,Department of Biomedical Engineering, Northwestern University, Evanston, IL 60208, United States of America.,Department of Neurological Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, United States of America
| | - Bijan Pesaran
- Center for Neural Science, New York University, New York, NY 10003, United States of America
| | - Gregory Cogan
- Department of Neurosurgery, Duke School of Medicine, Durham, NC 27710, United States of America.,Department of Psychology and Neuroscience, Duke University, Durham, NC 27708, United States of America.,Center for Cognitive Neuroscience, Duke University, Durham, NC 27708, United States of America.,Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC 27710, United States of America
| | - Jonathan Viventi
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, United States of America.,Department of Neurosurgery, Duke School of Medicine, Durham, NC 27710, United States of America.,Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC 27710, United States of America.,Department of Neurobiology, Duke School of Medicine, Durham, NC 27710, United States of America
| |
Collapse
|