Single-neuronal elements of speech production in humans

Learning and language in the unconscious human hippocampus

Consciousness is a fundamental component of cognition, 1 but the degree to which higher-order perception relies on it remains disputed. 2,3 Here we demonstrate the persistence of learning, semantic processing, and online prediction in individuals under general anesthesia-induced loss of consciousness. 4,5 Using high-density Neuropixels microelectrodes 6 to record neural activity in the human hippocampus while playing a series of tones to anesthetized patients, we found that hippocampal neurons could reliably detect oddball tones. This effect size grew over the course of the experiment (∼10 minutes), consistent with learning effects. A biologically plausible recurrent neural network model showed that learning and oddball representation are an emergent property of flexible tone discrimination. Last, when we played language stimuli, single units and ensembles carried information about the semantic and grammatical features of natural speech, even predicting semantic information about upcoming words. Together these results indicate that in the hippocampus, which is anatomically and functionally distant from primary sensory cortices, 7 complex processing of sensory stimuli occurs even in the unconscious state.

A magnitude-independent neural code for linguistic information during sentence production

Humans are the only species with the ability to convey an unbounded number of novel thoughts by combining words into sentences. This process is guided by complex syntactic and semantic processes. Despite their centrality to human cognition, the neural mechanisms underlying these systems remain obscured by inherent limitations of non-invasive brain measures and a near total focus on comprehension paradigms. Here, we address these limitations with high-resolution neurosurgical recordings (electrocorticography) and a controlled sentence production experiment. We uncover distinct cortical networks encoding word-level, semantic, and syntactic information. These networks are broadly distributed across traditional language areas, but with focal sensitivity to syntactic structure in middle and inferior frontal gyri. In contrast to previous findings from comprehension studies, we find that these networks are largely non-overlapping, each specialized for just one of the three linguistic constructs we investigate. Most strikingly, our data reveal an unexpected property of syntax and semantics: it is encoded independent of neural activity levels. We hypothesize that this "magnitude-independent" coding scheme likely reflects the distributed nature of these higher-order cognitive constructs.

Human motor cortex encodes complex handwriting through a sequence of stable neural states

How the human motor cortex (MC) orchestrates sophisticated sequences of fine movements such as handwriting remains a puzzle. Here we investigate this question through Utah array recordings from human MC during attempted handwriting of Chinese characters (n = 306, each consisting of 6.3 ± 2.0 strokes). We find that MC activity evolves through a sequence of states corresponding to the writing of stroke fragments during complicated handwriting. The directional tuning curve of MC neurons remains stable within states, but its gain or preferred direction strongly varies across states. By building models that can automatically infer the neural states and implement state-dependent directional tuning, we can significantly better explain the firing pattern of individual neurons and reconstruct recognizable handwriting trajectories with 69% improvement compared with baseline models. Our findings unveil that skilled and sophisticated movements are encoded through state-specific neural configurations.

Convergent vocal representations in parrot and human forebrain motor networks

Cortical networks for the production of spoken language in humans are organized by phonetic features1,2, such as articulatory parameters3,4 and vocal pitch5,6. Previous research has failed to find an equivalent forebrain representation in other species7-11. To investigate whether this functional organization is unique to humans, here we performed population recordings in the vocal production circuitry of the budgerigar (Melopsittacus undulatus), a small parrot that can generate flexible vocal output12-15, including mimicked speech sounds16. Using high-density silicon probes17, we measured the song-related activity of a forebrain region, the central nucleus of the anterior arcopallium (AAC), which directly projects to brainstem phonatory motor neurons18-20. We found that AAC neurons form a functional vocal motor map that reflects the spectral properties of ongoing vocalizations. We did not observe this organizing principle in the corresponding forebrain circuitry of the zebra finch, a songbird capable of more limited vocal learning21. We further demonstrated that the AAC represents the production of distinct vocal features (for example, harmonic structure and broadband energy). Furthermore, we discovered an orderly representation of vocal pitch at the population level, with single neurons systematically selective for different frequency values. Taken together, we have uncovered a functional representation in a vertebrate brain that displays unprecedented commonalities with speech-related motor cortices in humans. This work therefore establishes the parrot as an important animal model for investigating speech motor control and for developing therapeutic solutions for addressing a range of communication disorders22,23.

First-in-human experience performing high-resolution cortical mapping using a novel microelectrode array containing 1024 electrodes

Objective.Localization of function within the brain and central nervous system is an essential aspect of clinical neuroscience. Classical descriptions of functional neuroanatomy provide a foundation for understanding the functional significance of identifiable anatomic structures. However, individuals exhibit substantial variation, particularly in the presence of disorders that alter tissue structure or impact function. Furthermore, functional regions do not always correspond to identifiable structural features. Understanding function at the level of individual patients-and diagnosing and treating such patients-often requires techniques capable of correlating neural activity with cognition, behavior, and experience in anatomically precise ways.Approach. Recent advances in brain-computer interface technology have given rise to a new generation of electrophysiologic tools for scalable, nondestructive functional mapping with spatial precision in the range of tens to hundreds of micrometers, and temporal resolutions in the range of tens to hundreds of microseconds. Here we describe our initial intraoperative experience with novel, thin-film arrays containing 1024 surface microelectrodes for electrocorticographic mapping in a first-in-human study.Main results. Eight patients undergoing standard electrophysiologic cortical mapping during resection of eloquent-region brain tumors consented to brief sessions of concurrent mapping (micro-electrocorticography) using the novel arrays. Four patients underwent motor mapping using somatosensory evoked potentials (SSEPs) while under general anesthesia, and four underwent awake language mapping, using both standard paradigms and the novel microelectrode array. SSEP phase reversal was identified in the region predicted by conventional mapping, but at higher resolution (0.4 mm) and as a contour rather than as a point. In Broca's area (confirmed by direct cortical stimulation), speech planning was apparent in the micro-electrocorticogram as high-amplitude beta-band activity immediately prior to the articulatory event.Significance. These findings support the feasibility and potential clinical utility of incorporating micro-electrocorticography into the intraoperative workflow for systematic cortical mapping of functional brain regions.

Two-dimensional neural geometry underpins hierarchical organization of sequence in human working memory

Working memory (WM) is constructive in nature. Instead of passively retaining information, WM reorganizes complex sequences into hierarchically embedded chunks to overcome capacity limits and facilitate flexible behaviour. Here, to investigate the neural mechanisms underlying hierarchical reorganization in WM, we performed two electroencephalography and one magnetoencephalography experiments, wherein humans retain in WM a temporal sequence of items, that is, syllables, which are organized into chunks, that is, multisyllabic words. We demonstrate that the one-dimensional sequence is represented by two-dimensional neural representational geometry in WM arising from left prefrontal and temporoparietal regions, with separate dimensions encoding item position within a chunk and chunk position in the sequence. Critically, this two-dimensional geometry is observed consistently in different experimental settings, even during tasks not encouraging hierarchical reorganization in WM and correlates with WM behaviour. Overall, these findings strongly support that complex sequences are reorganized into factorized multidimensional neural representational geometry in WM, which also speaks to general structure-based organizational principles given WM's involvement in many cognitive functions.

Note similarities affect syntactic stability in zebra finches

The acquisition of an acoustic template is a fundamental component of vocal imitation learning, which is used to refine innate vocalizations and develop a species-specific song. In the absence of a model, birds fail to develop species typical songs. In zebra finches (Taeniopygia guttata), tutored birds produce songs with a stereotyped sequence of distinct acoustic elements, or notes, which form the song motif. Songs of untutored individuals feature atypical acoustic and temporal structure. Here we studied songs and associated respiratory patterns of tutored and untutored male zebra finches to investigate whether similar acoustic notes influence the sequence of song elements. A subgroup of animals developed songs with multiple acoustically similar notes that are produced with alike respiratory motor gestures. These birds also showed increased syntactic variability in their adult motif. Sequence variability tended to occur near song elements which showed high similarity in acoustic structure and underlying respiratory motor gestures. The duration and depth of the inspirations preceding the syllables where syntactic variation occurred did not allow prediction of the following sequence of notes, suggesting that the varying duration and air requirement of the following expiratory pulse is not predictively encoded in the motor program. This study provides a novel method for calculation of motor/acoustic similarity, and the results of this study suggest that the note is a fundamental acoustic unit in the organization of the motif and could play a role in the neural code for song syntax.

Analysis methods for large-scale neuronal recordings

Simultaneous recordings from hundreds or thousands of neurons are becoming routine because of innovations in instrumentation, molecular tools, and data processing software. Such recordings can be analyzed with data science methods, but it is not immediately clear what methods to use or how to adapt them for neuroscience applications. We review, categorize, and illustrate diverse analysis methods for neural population recordings and describe how these methods have been used to make progress on longstanding questions in neuroscience. We review a variety of approaches, ranging from the mathematically simple to the complex, from exploratory to hypothesis-driven, and from recently developed to more established methods. We also illustrate some of the common statistical pitfalls in analyzing large-scale neural data.

Representing the dynamics of natural marmoset vocal behaviors in frontal cortex

Here, we tested the respective contributions of primate premotor and prefrontal cortex to support vocal behavior. We applied a model-based generalized linear model (GLM) analysis that better accounts for the inherent variance in natural, continuous behaviors to characterize the activity of neurons throughout the frontal cortex as freely moving marmosets engaged in conversational exchanges. While analyses revealed functional clusters of neural activity related to the different processes involved in the vocal behavior, these clusters did not map to subfields of prefrontal or premotor cortex, as has been observed in more conventional task-based paradigms. Our results suggest a distributed functional organization for the myriad neural mechanisms underlying natural social interactions and have implications for our concepts of the role that frontal cortex plays in governing ethological behaviors in primates.

Cognitive synaptopathy: synaptic and dendritic spine dysfunction in age-related cognitive disorders

Cognitive impairment is a leading component of several neurodegenerative and neurodevelopmental diseases, profoundly impacting on the individual, the family, and society at large. Cognitive pathologies are driven by a multiplicity of factors, from genetic mutations and genetic risk factors, neurotransmitter-associated dysfunction, abnormal connectomics at the level of local neuronal circuits and broader brain networks, to environmental influences able to modulate some of the endogenous factors. Otherwise healthy older adults can be expected to experience some degree of mild cognitive impairment, some of which fall into the category of subjective cognitive deficits in clinical practice, while many neurodevelopmental and neurodegenerative diseases course with more profound alterations of cognition, particularly within the spectrum of the dementias. Our knowledge of the underlying neuropathological mechanisms at the root of this ample palette of clinical entities is far from complete. This review looks at current knowledge on synaptic modifications in the context of cognitive function along healthy ageing and cognitive dysfunction in disease, providing insight into differential diagnostic elements in the wide range of synapse alterations, from those associated with the mild cognitive changes of physiological senescence to the more profound abnormalities occurring at advanced clinical stages of dementia. I propose the term "cognitive synaptopathy" to encompass the wide spectrum of synaptic pathologies associated with higher brain function disorders.

Semantic encoding during language comprehension at single-cell resolution

From sequences of speech sounds1,2 or letters3, humans can extract rich and nuanced meaning through language. This capacity is essential for human communication. Yet, despite a growing understanding of the brain areas that support linguistic and semantic processing4-12, the derivation of linguistic meaning in neural tissue at the cellular level and over the timescale of action potentials remains largely unknown. Here we recorded from single cells in the left language-dominant prefrontal cortex as participants listened to semantically diverse sentences and naturalistic stories. By tracking their activities during natural speech processing, we discover a fine-scale cortical representation of semantic information by individual neurons. These neurons responded selectively to specific word meanings and reliably distinguished words from nonwords. Moreover, rather than responding to the words as fixed memory representations, their activities were highly dynamic, reflecting the words' meanings based on their specific sentence contexts and independent of their phonetic form. Collectively, we show how these cell ensembles accurately predicted the broad semantic categories of the words as they were heard in real time during speech and how they tracked the sentences in which they appeared. We also show how they encoded the hierarchical structure of these meaning representations and how these representations mapped onto the cell population. Together, these findings reveal a finely detailed cortical organization of semantic representations at the neuron scale in humans and begin to illuminate the cellular-level processing of meaning during language comprehension.

Large-scale neurophysiology and single-cell profiling in human neuroscience

Advances in large-scale single-unit human neurophysiology, single-cell RNA sequencing, spatial transcriptomics and long-term ex vivo tissue culture of surgically resected human brain tissue have provided an unprecedented opportunity to study human neuroscience. In this Perspective, we describe the development of these paradigms, including Neuropixels and recent brain-cell atlas efforts, and discuss how their convergence will further investigations into the cellular underpinnings of network-level activity in the human brain. Specifically, we introduce a workflow in which functionally mapped samples of human brain tissue resected during awake brain surgery can be cultured ex vivo for multi-modal cellular and functional profiling. We then explore how advances in human neuroscience will affect clinical practice, and conclude by discussing societal and ethical implications to consider. Potential findings from the field of human neuroscience will be vast, ranging from insights into human neurodiversity and evolution to providing cell-type-specific access to study and manipulate diseased circuits in pathology. This Perspective aims to provide a unifying framework for the field of human neuroscience as we welcome an exciting era for understanding the functional cytoarchitecture of the human brain.

Improving auditory attention decoding by classifying intracranial responses to glimpsed and masked acoustic events

Listeners with hearing loss have trouble following a conversation in multitalker environments. While modern hearing aids can generally amplify speech, these devices are unable to tune into a target speaker without first knowing to which speaker a user aims to attend. Brain-controlled hearing aids have been proposed using auditory attention decoding (AAD) methods, but current methods use the same model to compare the speech stimulus and neural response, regardless of the dynamic overlap between talkers which is known to influence neural encoding. Here, we propose a novel framework that directly classifies event-related potentials (ERPs) evoked by glimpsed and masked acoustic events to determine whether the source of the event was attended. We present a system that identifies auditory events using the local maxima in the envelope rate of change, assesses the temporal masking of auditory events relative to competing speakers, and utilizes masking-specific ERP classifiers to determine if the source of the event was attended. Using intracranial electrophysiological recordings, we showed that high gamma ERPs from recording sites in auditory cortex can effectively decode the attention of subjects. This method of AAD provides higher accuracy, shorter switch times, and more stable decoding results compared with traditional correlational methods, permitting the quick and accurate detection of changes in a listener's attentional focus. This framework also holds unique potential for detecting instances of divided attention and inattention. Overall, we extend the scope of AAD algorithms by introducing the first linear, direct-classification method for determining a listener's attentional focus that leverages the latest research in multitalker speech perception. This work represents another step toward informing the development of effective and intuitive brain-controlled hearing assistive devices.