1
|
Wu X, Ye Y, Sun M, Mei Y, Ji B, Wang M, Song E. Recent Progress of Soft and Bioactive Materials in Flexible Bioelectronics. CYBORG AND BIONIC SYSTEMS 2025; 6:0192. [PMID: 40302943 PMCID: PMC12038164 DOI: 10.34133/cbsystems.0192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2024] [Revised: 08/22/2024] [Accepted: 09/22/2024] [Indexed: 05/02/2025] Open
Abstract
Materials that establish functional, stable interfaces to targeted tissues for long-term monitoring/stimulation equipped with diagnostic/therapeutic capabilities represent breakthroughs in biomedical research and clinical medicine. A fundamental challenge is the mechanical and chemical mismatch between tissues and implants that ultimately results in device failure for corrosion by biofluids and associated foreign body response. Of particular interest is in the development of bioactive materials at the level of chemistry and mechanics for high-performance, minimally invasive function, simultaneously with tissue-like compliance and in vivo biocompatibility. This review summarizes the most recent progress for these purposes, with an emphasis on material properties such as foreign body response, on integration schemes with biological tissues, and on their use as bioelectronic platforms. The article begins with an overview of emerging classes of material platforms for bio-integration with proven utility in live animal models, as high performance and stable interfaces with different form factors. Subsequent sections review various classes of flexible, soft tissue-like materials, ranging from self-healing hydrogel/elastomer to bio-adhesive composites and to bioactive materials. Additional discussions highlight examples of active bioelectronic systems that support electrophysiological mapping, stimulation, and drug delivery as treatments of related diseases, at spatiotemporal resolutions that span from the cellular level to organ-scale dimension. Envisioned applications involve advanced implants for brain, cardiac, and other organ systems, with capabilities of bioactive materials that offer stability for human subjects and live animal models. Results will inspire continuing advancements in functions and benign interfaces to biological systems, thus yielding therapy and diagnostics for human healthcare.
Collapse
Affiliation(s)
- Xiaojun Wu
- Institute of Optoelectronics & Department of Materials Science, Shanghai Frontiers Science Research Base of Intelligent Optoelectronics and Perception, State Key Laboratory of Integrated Chips and Systems (SKLICS),
Fudan University, Shanghai 200438, China
- State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, State Key Laboratory of Molecular Engineering of Polymer,
Fudan University, Shanghai 200438, China
| | - Yuanming Ye
- Unmanned System Research Institute, National Key Laboratory of Unmanned Aerial Vehicle Technology, Integrated Research and Development Platform of Unmanned Aerial Vehicle Technology, Northwestern Polytechnical University, Xi’an 710072, China
- Queen Mary University of London Engineering School, Northwestern Polytechnical University, Xi’an 710072, China
| | - Mubai Sun
- Institute of Optoelectronics & Department of Materials Science, Shanghai Frontiers Science Research Base of Intelligent Optoelectronics and Perception, State Key Laboratory of Integrated Chips and Systems (SKLICS),
Fudan University, Shanghai 200438, China
- Institute of Agro-food Technology, Jilin Academy of Agricultural Sciences (Northeast Agricultural Research Center of China), Changchun, China
| | - Yongfeng Mei
- Institute of Optoelectronics & Department of Materials Science, Shanghai Frontiers Science Research Base of Intelligent Optoelectronics and Perception, State Key Laboratory of Integrated Chips and Systems (SKLICS),
Fudan University, Shanghai 200438, China
- State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, State Key Laboratory of Molecular Engineering of Polymer,
Fudan University, Shanghai 200438, China
- International Institute for Intelligent Nanorobots and Nanosystems,
Neuromodulation and Brain-machine-interface Centre, Fudan University, Shanghai 200438, China
- Yiwu Research Institute of Fudan University, Yiwu, Zhejiang 322000, China
| | - Bowen Ji
- Unmanned System Research Institute, National Key Laboratory of Unmanned Aerial Vehicle Technology, Integrated Research and Development Platform of Unmanned Aerial Vehicle Technology, Northwestern Polytechnical University, Xi’an 710072, China
| | - Ming Wang
- Institute of Optoelectronics & Department of Materials Science, Shanghai Frontiers Science Research Base of Intelligent Optoelectronics and Perception, State Key Laboratory of Integrated Chips and Systems (SKLICS),
Fudan University, Shanghai 200438, China
- Frontier Institute of Chip and System,
Fudan University, Shanghai 200433, China
| | - Enming Song
- Institute of Optoelectronics & Department of Materials Science, Shanghai Frontiers Science Research Base of Intelligent Optoelectronics and Perception, State Key Laboratory of Integrated Chips and Systems (SKLICS),
Fudan University, Shanghai 200438, China
- State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, State Key Laboratory of Molecular Engineering of Polymer,
Fudan University, Shanghai 200438, China
- International Institute for Intelligent Nanorobots and Nanosystems,
Neuromodulation and Brain-machine-interface Centre, Fudan University, Shanghai 200438, China
| |
Collapse
|
2
|
Katlowitz KA, Shah S, Franch MC, Adkinson J, Belanger JL, Mathura RK, Meszéna D, Mickiewicz EA, McGinley M, Muñoz W, Banks GP, Cash SS, Hsu CW, Paulk AC, Provenza NR, Watrous A, Williams Z, Heilbronner SR, Kim R, Rungratsameetaweemana N, Hayden BY, Sheth SA. Learning and language in the unconscious human hippocampus. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2025:2025.04.09.648012. [PMID: 40291737 PMCID: PMC12027328 DOI: 10.1101/2025.04.09.648012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/30/2025]
Abstract
Consciousness is a fundamental component of cognition, 1 but the degree to which higher-order perception relies on it remains disputed. 2,3 Here we demonstrate the persistence of learning, semantic processing, and online prediction in individuals under general anesthesia-induced loss of consciousness. 4,5 Using high-density Neuropixels microelectrodes 6 to record neural activity in the human hippocampus while playing a series of tones to anesthetized patients, we found that hippocampal neurons could reliably detect oddball tones. This effect size grew over the course of the experiment (∼10 minutes), consistent with learning effects. A biologically plausible recurrent neural network model showed that learning and oddball representation are an emergent property of flexible tone discrimination. Last, when we played language stimuli, single units and ensembles carried information about the semantic and grammatical features of natural speech, even predicting semantic information about upcoming words. Together these results indicate that in the hippocampus, which is anatomically and functionally distant from primary sensory cortices, 7 complex processing of sensory stimuli occurs even in the unconscious state.
Collapse
|
3
|
Mattera A, Alfieri V, Granato G, Baldassarre G. Chaotic recurrent neural networks for brain modelling: A review. Neural Netw 2025; 184:107079. [PMID: 39756119 DOI: 10.1016/j.neunet.2024.107079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2024] [Revised: 11/25/2024] [Accepted: 12/19/2024] [Indexed: 01/07/2025]
Abstract
Even in the absence of external stimuli, the brain is spontaneously active. Indeed, most cortical activity is internally generated by recurrence. Both theoretical and experimental studies suggest that chaotic dynamics characterize this spontaneous activity. While the precise function of brain chaotic activity is still puzzling, we know that chaos confers many advantages. From a computational perspective, chaos enhances the complexity of network dynamics. From a behavioural point of view, chaotic activity could generate the variability required for exploration. Furthermore, information storage and transfer are maximized at the critical border between order and chaos. Despite these benefits, many computational brain models avoid incorporating spontaneous chaotic activity due to the challenges it poses for learning algorithms. In recent years, however, multiple approaches have been proposed to overcome this limitation. As a result, many different algorithms have been developed, initially within the reservoir computing paradigm. Over time, the field has evolved to increase the biological plausibility and performance of the algorithms, sometimes going beyond the reservoir computing framework. In this review article, we examine the computational benefits of chaos and the unique properties of chaotic recurrent neural networks, with a particular focus on those typically utilized in reservoir computing. We also provide a detailed analysis of the algorithms designed to train chaotic RNNs, tracing their historical evolution and highlighting key milestones in their development. Finally, we explore the applications and limitations of chaotic RNNs for brain modelling, consider their potential broader impacts beyond neuroscience, and outline promising directions for future research.
Collapse
Affiliation(s)
- Andrea Mattera
- Institute of Cognitive Sciences and Technology, National Research Council, Via Romagnosi 18a, I-00196, Rome, Italy.
| | - Valerio Alfieri
- Institute of Cognitive Sciences and Technology, National Research Council, Via Romagnosi 18a, I-00196, Rome, Italy; International School of Advanced Studies, Center for Neuroscience, University of Camerino, Via Gentile III Da Varano, 62032, Camerino, Italy
| | - Giovanni Granato
- Institute of Cognitive Sciences and Technology, National Research Council, Via Romagnosi 18a, I-00196, Rome, Italy
| | - Gianluca Baldassarre
- Institute of Cognitive Sciences and Technology, National Research Council, Via Romagnosi 18a, I-00196, Rome, Italy
| |
Collapse
|
4
|
Watters N, Buccino A, Jazayeri M. MEDiCINe: Motion Correction for Neural Electrophysiology Recordings. eNeuro 2025; 12:ENEURO.0529-24.2025. [PMID: 39933920 PMCID: PMC11896784 DOI: 10.1523/eneuro.0529-24.2025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2024] [Revised: 01/25/2025] [Accepted: 01/31/2025] [Indexed: 02/13/2025] Open
Abstract
Electrophysiology recordings from the brain using laminar multielectrode arrays allow researchers to measure the activity of many neurons simultaneously. However, laminar microelectrode arrays move relative to their surrounding neural tissue for a variety of reasons, such as pulsation, changes in intracranial pressure, and decompression of neural tissue after insertion. Inferring and correcting for this motion stabilizes the recording and is critical to identify and track single neurons across time. Such motion correction is a preprocessing step of standard spike-sorting methods. However, estimating motion robustly and accurately in electrophysiology recordings is challenging due to the stochasticity of the neural data. To tackle this problem, we introduce MEDiCINe (Motion Estimation by Distributional Contrastive Inference for Neurophysiology), a novel motion estimation method. We show that MEDiCINe outperforms existing motion estimation methods on an extensive suite of simulated neurophysiology recordings and leads to more accurate spike sorting. We also show that MEDiCINe accurately estimates the motion in primate and rodent electrophysiology recordings with a variety of motion and stability statistics. We open-source MEDiCINe, usage instructions, examples integrating MEDiCINe with common tools for spike sorting, and data and code for reproducing our results. This open software will enable other researchers to use MEDiCINe to improve spike sorting results and get the most out of their electrophysiology datasets.
Collapse
Affiliation(s)
- Nicholas Watters
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
- McGovern Institute of Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
| | - Alessio Buccino
- Allen Institute for Neural Dynamics, Seattle, Washington 98109
- CatalystNeuro, Benicia, California 94510
| | - Mehrdad Jazayeri
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
- McGovern Institute of Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
- Howard Hughes Medical Institute, Chevy Chase, Maryland 20815
| |
Collapse
|
5
|
Li J, Cao D, Li W, Sarnthein J, Jiang T. Re-evaluating human MTL in working memory: insights from intracranial recordings. Trends Cogn Sci 2024; 28:1132-1144. [PMID: 39174398 DOI: 10.1016/j.tics.2024.07.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 07/26/2024] [Accepted: 07/26/2024] [Indexed: 08/24/2024]
Abstract
The study of human working memory (WM) holds significant importance in neuroscience; yet, exploring the role of the medial temporal lobe (MTL) in WM has been limited by the technological constraints of noninvasive methods. Recent advancements in human intracranial neural recordings have indicated the involvement of the MTL in WM processes. These recordings show that different regions of the MTL are involved in distinct aspects of WM processing and also dynamically interact with each other and the broader brain network. These findings support incorporating the MTL into models of the neural basis of WM. This integration can better reflect the complex neural mechanisms underlying WM and enhance our understanding of WM's flexibility, adaptability, and precision.
Collapse
Affiliation(s)
- Jin Li
- School of Psychology, Capital Normal University, Beijing, 100048, China
| | - Dan Cao
- School of Psychology, Capital Normal University, Beijing, 100048, China; Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Wenlu Li
- Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Johannes Sarnthein
- Department of Neurosurgery, University Hospital Zurich, University of Zurich, 8091 Zurich, Switzerland; Zurich Neuroscience Center, ETH Zurich, 8057 Zurich, Switzerland
| | - Tianzi Jiang
- Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; Xiaoxiang Institute for Brain Health and Yongzhou Central Hospital, Yongzhou 425000, Hunan Province, China.
| |
Collapse
|
6
|
Zhang D, Wang Z, Qian Y, Zhao Z, Liu Y, Hao X, Li W, Lu S, Zhu H, Chen L, Xu K, Li Y, Lu J. A brain-to-text framework for decoding natural tonal sentences. Cell Rep 2024; 43:114924. [PMID: 39485790 DOI: 10.1016/j.celrep.2024.114924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Revised: 09/09/2024] [Accepted: 10/14/2024] [Indexed: 11/03/2024] Open
Abstract
Speech brain-computer interfaces (BCIs) directly translate brain activity into speech sound and text. Despite successful applications in non-tonal languages, the distinct syllabic structures and pivotal lexical information conveyed through tonal nuances present challenges in BCI decoding for tonal languages like Mandarin Chinese. Here, we designed a brain-to-text framework to decode Mandarin sentences from invasive neural recordings. Our framework dissects speech onset, base syllables, and lexical tones, integrating them with contextual information through Bayesian likelihood and a Viterbi decoder. The results demonstrate accurate tone and syllable decoding during naturalistic speech production. The overall word error rate (WER) for 10 offline-decoded tonal sentences with a vocabulary of 40 high-frequency Chinese characters is 21% (chance: 95.3%) averaged across five participants, and tone decoding accuracy reaches 93% (chance: 25%), surpassing previous intracranial Mandarin tonal syllable decoders. This study provides a robust and generalizable approach for brain-to-text decoding of continuous tonal speech sentences.
Collapse
Affiliation(s)
- Daohan Zhang
- Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai 200040, China; National Center for Neurological Disorders, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China
| | - Zhenjie Wang
- School of Biomedical Engineering, ShanghaiTech University, Shanghai 201210, China; State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University, Shanghai 201210, China
| | - Youkun Qian
- Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai 200040, China; National Center for Neurological Disorders, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China
| | - Zehao Zhao
- Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai 200040, China; National Center for Neurological Disorders, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China
| | - Yan Liu
- Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai 200040, China; National Center for Neurological Disorders, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China
| | - Xiaotao Hao
- Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai 200040, China; National Center for Neurological Disorders, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China
| | - Wanxin Li
- Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai 200040, China; National Center for Neurological Disorders, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China
| | - Shuo Lu
- Department of Chinese Language and Literature, Sun Yat-sen University, Guangzhou 510080, China
| | - Honglin Zhu
- Faculty of Life Sciences and Medicine, King's College London, London SE1 1UL, UK
| | - Luyao Chen
- School of International Chinese Language Education, Beijing Normal University, Beijing 100875, China
| | - Kunyu Xu
- Institute of Modern Languages and Linguistics, Fudan University, Shanghai 200433, China
| | - Yuanning Li
- School of Biomedical Engineering, ShanghaiTech University, Shanghai 201210, China; State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University, Shanghai 201210, China; Shanghai Clinical Research and Trial Center, Shanghai, 201210, China.
| | - Junfeng Lu
- Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai 200040, China; National Center for Neurological Disorders, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China; Institute of Modern Languages and Linguistics, Fudan University, Shanghai 200433, China; MOE Frontiers Center for Brain Science, Huashan Hospital, Fudan University, Shanghai 200040, China.
| |
Collapse
|
7
|
Oldroyd P, Hadwe SE, Barone DG, Malliaras GG. Thin-film implants for bioelectronic medicine. MRS BULLETIN 2024; 49:1045-1058. [PMID: 39397879 PMCID: PMC11469980 DOI: 10.1557/s43577-024-00786-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 08/01/2024] [Indexed: 10/15/2024]
Abstract
This article is based on the MRS Mid-Career Researcher Award "for outstanding contributions to the fundamentals and development of organic electronic materials and their application in biology and medicine" presentation given by George G. Malliaras, University of Cambridge, at the 2023 MRS Spring Meeting in San Francisco, Calif.Bioelectronic medicine offers a revolutionary approach to treating disease by stimulating the body with electricity. While current devices show safety and efficacy, limitations, including bulkiness, invasiveness, and scalability, hinder their wider application. Thin-film implants promise to overcome these limitations. Made using microfabrication technologies, these implants conform better to neural tissues, reduce tissue damage and foreign body response, and provide high-density, multimodal interfaces with the body. This article explores how thin-film implants using organic materials and novel designs may contribute to disease management, intraoperative monitoring, and brain mapping applications. Additionally, the technical challenges to be addressed for this technology to succeed are discussed. Graphical abstract
Collapse
Affiliation(s)
- Poppy Oldroyd
- Electrical Engineering Division, Department of Engineering, University of Cambridge, Cambridge, UK
| | - Salim El Hadwe
- Electrical Engineering Division, Department of Engineering, University of Cambridge, Cambridge, UK
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| | - Damiano G. Barone
- Electrical Engineering Division, Department of Engineering, University of Cambridge, Cambridge, UK
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| | - George G. Malliaras
- Electrical Engineering Division, Department of Engineering, University of Cambridge, Cambridge, UK
| |
Collapse
|
8
|
Manero A, Rivera V, Fu Q, Schwartzman JD, Prock-Gibbs H, Shah N, Gandhi D, White E, Crawford KE, Coathup MJ. Emerging Medical Technologies and Their Use in Bionic Repair and Human Augmentation. Bioengineering (Basel) 2024; 11:695. [PMID: 39061777 PMCID: PMC11274085 DOI: 10.3390/bioengineering11070695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Revised: 07/04/2024] [Accepted: 07/07/2024] [Indexed: 07/28/2024] Open
Abstract
As both the proportion of older people and the length of life increases globally, a rise in age-related degenerative diseases, disability, and prolonged dependency is projected. However, more sophisticated biomedical materials, as well as an improved understanding of human disease, is forecast to revolutionize the diagnosis and treatment of conditions ranging from osteoarthritis to Alzheimer's disease as well as impact disease prevention. Another, albeit quieter, revolution is also taking place within society: human augmentation. In this context, humans seek to improve themselves, metamorphosing through self-discipline or more recently, through use of emerging medical technologies, with the goal of transcending aging and mortality. In this review, and in the pursuit of improved medical care following aging, disease, disability, or injury, we first highlight cutting-edge and emerging materials-based neuroprosthetic technologies designed to restore limb or organ function. We highlight the potential for these technologies to be utilized to augment human performance beyond the range of natural performance. We discuss and explore the growing social movement of human augmentation and the idea that it is possible and desirable to use emerging technologies to push the boundaries of what it means to be a healthy human into the realm of superhuman performance and intelligence. This potential future capability is contrasted with limitations in the right-to-repair legislation, which may create challenges for patients. Now is the time for continued discussion of the ethical strategies for research, implementation, and long-term device sustainability or repair.
Collapse
Affiliation(s)
- Albert Manero
- Limbitless Solutions, University of Central Florida, 12703 Research Parkway, Suite 100, Orlando, FL 32826, USA (V.R.)
- Biionix Cluster, University of Central Florida, Orlando, FL 32827, USA; (Q.F.); (K.E.C.)
| | - Viviana Rivera
- Limbitless Solutions, University of Central Florida, 12703 Research Parkway, Suite 100, Orlando, FL 32826, USA (V.R.)
| | - Qiushi Fu
- Biionix Cluster, University of Central Florida, Orlando, FL 32827, USA; (Q.F.); (K.E.C.)
- Department of Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Jonathan D. Schwartzman
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| | - Hannah Prock-Gibbs
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| | - Neel Shah
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| | - Deep Gandhi
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| | - Evan White
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| | - Kaitlyn E. Crawford
- Biionix Cluster, University of Central Florida, Orlando, FL 32827, USA; (Q.F.); (K.E.C.)
- Department of Materials Science and Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Melanie J. Coathup
- Biionix Cluster, University of Central Florida, Orlando, FL 32827, USA; (Q.F.); (K.E.C.)
- College of Medicine, University of Central Florida, Orlando, FL 32827, USA; (J.D.S.); (H.P.-G.); (N.S.); (D.G.); (E.W.)
| |
Collapse
|
9
|
Jamali M, Grannan B, Cai J, Khanna AR, Muñoz W, Caprara I, Paulk AC, Cash SS, Fedorenko E, Williams ZM. Semantic encoding during language comprehension at single-cell resolution. Nature 2024; 631:610-616. [PMID: 38961302 PMCID: PMC11254762 DOI: 10.1038/s41586-024-07643-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2020] [Accepted: 05/31/2024] [Indexed: 07/05/2024]
Abstract
From sequences of speech sounds1,2 or letters3, humans can extract rich and nuanced meaning through language. This capacity is essential for human communication. Yet, despite a growing understanding of the brain areas that support linguistic and semantic processing4-12, the derivation of linguistic meaning in neural tissue at the cellular level and over the timescale of action potentials remains largely unknown. Here we recorded from single cells in the left language-dominant prefrontal cortex as participants listened to semantically diverse sentences and naturalistic stories. By tracking their activities during natural speech processing, we discover a fine-scale cortical representation of semantic information by individual neurons. These neurons responded selectively to specific word meanings and reliably distinguished words from nonwords. Moreover, rather than responding to the words as fixed memory representations, their activities were highly dynamic, reflecting the words' meanings based on their specific sentence contexts and independent of their phonetic form. Collectively, we show how these cell ensembles accurately predicted the broad semantic categories of the words as they were heard in real time during speech and how they tracked the sentences in which they appeared. We also show how they encoded the hierarchical structure of these meaning representations and how these representations mapped onto the cell population. Together, these findings reveal a finely detailed cortical organization of semantic representations at the neuron scale in humans and begin to illuminate the cellular-level processing of meaning during language comprehension.
Collapse
Affiliation(s)
- Mohsen Jamali
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Benjamin Grannan
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Jing Cai
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Arjun R Khanna
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - William Muñoz
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Irene Caprara
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Angelique C Paulk
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Sydney S Cash
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Ziv M Williams
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
- Harvard-MIT Division of Health Sciences and Technology, Boston, MA, USA.
- Harvard Medical School, Program in Neuroscience, Boston, MA, USA.
| |
Collapse
|
10
|
Free T. Recording the brain in vivo: emerging technologies for the exploration of mental health conditions. Biotechniques 2024; 76:121-124. [PMID: 38482795 DOI: 10.2144/btn-2024-0013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2024] Open
Abstract
Standfirst Mounting interest in mental health conditions over the last two decades has been coupled with the increasing sophistication of techniques to study the brain in vivo. [Formula: see text].
Collapse
Affiliation(s)
- Tristan Free
- Senior Digital Editor, Taylor & Francis, Unitec House, 2 Albert Place, London, N3 1QB, UK
| |
Collapse
|
11
|
Khanna AR, Muñoz W, Kim YJ, Kfir Y, Paulk AC, Jamali M, Cai J, Mustroph ML, Caprara I, Hardstone R, Mejdell M, Meszéna D, Zuckerman A, Schweitzer J, Cash S, Williams ZM. Single-neuronal elements of speech production in humans. Nature 2024; 626:603-610. [PMID: 38297120 PMCID: PMC10866697 DOI: 10.1038/s41586-023-06982-w] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Accepted: 12/14/2023] [Indexed: 02/02/2024]
Abstract
Humans are capable of generating extraordinarily diverse articulatory movement combinations to produce meaningful speech. This ability to orchestrate specific phonetic sequences, and their syllabification and inflection over subsecond timescales allows us to produce thousands of word sounds and is a core component of language1,2. The fundamental cellular units and constructs by which we plan and produce words during speech, however, remain largely unknown. Here, using acute ultrahigh-density Neuropixels recordings capable of sampling across the cortical column in humans, we discover neurons in the language-dominant prefrontal cortex that encoded detailed information about the phonetic arrangement and composition of planned words during the production of natural speech. These neurons represented the specific order and structure of articulatory events before utterance and reflected the segmentation of phonetic sequences into distinct syllables. They also accurately predicted the phonetic, syllabic and morphological components of upcoming words and showed a temporally ordered dynamic. Collectively, we show how these mixtures of cells are broadly organized along the cortical column and how their activity patterns transition from articulation planning to production. We also demonstrate how these cells reliably track the detailed composition of consonant and vowel sounds during perception and how they distinguish processes specifically related to speaking from those related to listening. Together, these findings reveal a remarkably structured organization and encoding cascade of phonetic representations by prefrontal neurons in humans and demonstrate a cellular process that can support the production of speech.
Collapse
Affiliation(s)
- Arjun R Khanna
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - William Muñoz
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | | | - Yoav Kfir
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Angelique C Paulk
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Mohsen Jamali
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Jing Cai
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Martina L Mustroph
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Irene Caprara
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Richard Hardstone
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Mackenna Mejdell
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Domokos Meszéna
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | | | - Jeffrey Schweitzer
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Sydney Cash
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Ziv M Williams
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
- Harvard-MIT Division of Health Sciences and Technology, Boston, MA, USA.
- Harvard Medical School, Program in Neuroscience, Boston, MA, USA.
| |
Collapse
|
12
|
Yuste R. Advocating for neurodata privacy and neurotechnology regulation. Nat Protoc 2023; 18:2869-2875. [PMID: 37697107 DOI: 10.1038/s41596-023-00873-0] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Accepted: 07/27/2023] [Indexed: 09/13/2023]
Abstract
The ability to record and alter brain activity by using implantable and nonimplantable neural devices, while poised to have significant scientific and clinical benefits, also raises complex ethical concerns. In this Perspective, we raise awareness of the ability of artificial intelligence algorithms and data-aggregation tools to decode and analyze data containing highly sensitive information, jeopardizing personal neuroprivacy. Voids in existing regulatory frameworks, in fact, allow unrestricted decoding and commerce of neurodata. We advocate for the implementation of proposed ethical and human rights guidelines, alongside technical options such as data encryption, differential privacy and federated learning to ensure the protection of neurodata privacy. We further encourage regulatory bodies to consider taking a position of responsibility by categorizing all brain-derived data as sensitive health data and apply existing medical regulations to all data gathered via pre-registered neural devices. Lastly, we propose that a technocratic oath may instill a deontology for neurotechnology practitioners akin to what the Hippocratic oath represents in medicine. A conscientious societal position that thoroughly rejects the misuse of neurodata would provide the moral compass for the future development of the neurotechnology field.
Collapse
Affiliation(s)
- Rafael Yuste
- Neurotechnology Center, Columbia University, New York, NY, USA.
| |
Collapse
|