1
|
Lu J, Surendralal S, Bouchard KE, Jin DZ. Partially Observable Markov Models Inferred Using Statistical Tests Reveal Context-Dependent Syllable Transitions in Bengalese Finch Songs. J Neurosci 2025; 45:e0522242024. [PMID: 39779376 PMCID: PMC11866996 DOI: 10.1523/jneurosci.0522-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Revised: 10/15/2024] [Accepted: 12/26/2024] [Indexed: 01/11/2025] Open
Abstract
Generative models have diverse applications, including language processing and birdsong analysis. In this study, we demonstrate how a statistical test, designed to prevent overgeneralization in sequence generation, can be used to infer minimal models for the syllable sequences in Bengalese finch songs. We focus on the partially observable Markov model (POMM), which consists of states and the probabilistic transitions between them. Each state is associated with a specific syllable, with the possibility that multiple states may correspond to the same syllable. This characteristic differentiates the POMM from a standard Markov model, where each syllable is linked to a single state. The presence of multiple states for a syllable suggests that transitions between syllables are influenced by the specific contexts in which these transitions occur. We apply this method to analyze the songs of six adult male Bengalese finches, both before and after they were deafened. Our results indicate that auditory feedback plays a crucial role in shaping the context-dependent syllable transitions characteristic of Bengalese finch songs.
Collapse
Affiliation(s)
- Jiali Lu
- Department of Physics, The Pennsylvania State University, University Park, Pennsylvania 16802, USA
| | - Sumithra Surendralal
- Symbiosis School for Liberal Arts, Symbiosis International (Deemed University), Pune 411014, Maharashtra, India
| | - Kristofer E Bouchard
- Scientific Data Division and Biological Systems & Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California 94720
- Helen Wills Neuroscience Institute & Redwood Center for Theoretical Neuroscience, University of California at Berkeley, Berkeley, California 94720
| | - Dezhe Z Jin
- Department of Physics, The Pennsylvania State University, University Park, Pennsylvania 16802, USA
| |
Collapse
|
2
|
Isola GR, Vochin A, Sakata JT. Manipulations of inhibition in cortical circuitry differentially affect spectral and temporal features of Bengalese finch song. J Neurophysiol 2020; 123:815-830. [PMID: 31967928 DOI: 10.1152/jn.00142.2019] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
The interplay between inhibition and excitation can regulate behavioral expression and control, including the expression of communicative behaviors like birdsong. Computational models postulate varying degrees to which inhibition within vocal motor circuitry influences birdsong, but few studies have tested these models by manipulating inhibition. Here we enhanced and attenuated inhibition in the cortical nucleus HVC (used as proper name) of Bengalese finches (Lonchura striata var. domestica). Enhancement of inhibition (with muscimol) in HVC dose-dependently reduced the amount of song produced. Infusions of higher concentrations of muscimol caused some birds to produce spectrally degraded songs, whereas infusions of lower doses of muscimol led to the production of relatively normal (nondegraded) songs. However, the spectral and temporal structures of these nondegraded songs were significantly different from songs produced under control conditions. In particular, muscimol infusions decreased the frequency and amplitude of syllables, increased various measures of acoustic entropy, and increased the variability of syllable structure. Muscimol also increased sequence durations and the variability of syllable timing and syllable sequencing. Attenuation of inhibition (with bicuculline) in HVC led to changes to song distinct from and often opposite to enhancing inhibition. For example, in contrast to muscimol, bicuculline infusions increased syllable amplitude, frequency, and duration and decreased the variability of acoustic features. However, like muscimol, bicuculline increased the variability of syllable sequencing. These data highlight the importance of inhibition to the production of stereotyped vocalizations and demonstrate that changes to neural dynamics within cortical circuitry can differentially affect spectral and temporal features of song.NEW & NOTEWORTHY We reveal that manipulations of inhibition in the cortical nucleus HVC affect the structure, timing, and sequencing of syllables in Bengalese finch song. Enhancing and blocking inhibition led to opposite changes to the acoustic structure and timing of vocalizations, but both caused similar changes to vocal sequencing. These data provide support for computational models of song control but also motivate refinement of existing models to account for differential effects on syllable structure, timing, and sequencing.
Collapse
Affiliation(s)
- Gaurav R Isola
- Department of Biology, McGill University, Montreal, Quebec, Canada
| | - Anca Vochin
- Integrated Program in Neuroscience, McGill University, Montreal, Quebec, Canada
| | - Jon T Sakata
- Department of Biology, McGill University, Montreal, Quebec, Canada.,Integrated Program in Neuroscience, McGill University, Montreal, Quebec, Canada.,Centre for Research on Brain, Language, and Music, Montreal, Quebec, Canada.,Center for Studies in Behavioral Neurobiology, Montreal, Quebec, Canada
| |
Collapse
|
3
|
Zhang YS, Wittenbach JD, Jin DZ, Kozhevnikov AA. Temperature Manipulation in Songbird Brain Implicates the Premotor Nucleus HVC in Birdsong Syntax. J Neurosci 2017; 37:2600-2611. [PMID: 28159910 PMCID: PMC6596640 DOI: 10.1523/jneurosci.1827-16.2017] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2016] [Revised: 01/03/2017] [Accepted: 01/17/2017] [Indexed: 01/04/2023] Open
Abstract
Variable motor sequences of animals are often structured and can be described by probabilistic transition rules between action elements. Examples include the songs of many songbird species such as the Bengalese finch, which consist of stereotypical syllables sequenced according to probabilistic rules (song syntax). The neural mechanisms behind such rules are poorly understood. Here, we investigate where the song syntax is encoded in the brain of the Bengalese finch by rapidly and reversibly manipulating the temperature in the song production pathway. Cooling the premotor nucleus HVC (proper name) slows down the song tempo, consistent with the idea that HVC controls moment-to-moment timings of acoustic features in the syllables. More importantly, cooling HVC alters the transition probabilities between syllables. Cooling HVC reduces the number of repetitions of long-repeated syllables and increases the randomness of syllable sequences. In contrast, cooling the downstream motor area RA (robust nucleus of the acropallium), which is critical for singing, does not affect the song syntax. Unilateral cooling of HVC shows that control of syllables is mostly lateralized to the left HVC, whereas transition probabilities between the syllables can be affected by cooling HVC in either hemisphere to varying degrees. These results show that HVC is a key site for encoding song syntax in the Bengalese finch. HVC is thus involved both in encoding timings within syllables and in sequencing probabilistic transitions between syllables. Our finding suggests that probabilistic selections and fine-grained timings of action elements can be integrated within the same neural circuits.SIGNIFICANCE STATEMENT Many animal behaviors such as birdsong consist of variable sequences of discrete actions. Where and how the probabilistic rules of such sequences are encoded in the brain is poorly understood. We locally and reversibly cooled brain areas in songbirds during singing. Mild cooling of area HVC in the Bengalese finch brain-a premotor area homologous to the mammalian premotor cortex-alters the statistics of the syllable sequences, suggesting that HVC is critical for birdsong sequences. HVC is also known for controlling moment-to-moment timings within syllables. Our results show that timing and probabilistic sequencing of actions can share the same neural circuits in local brain areas.
Collapse
Affiliation(s)
| | | | - Dezhe Z Jin
- Department of Physics,
- Center for Neural Engineering, Pennsylvania State University, University Park, Pennsylvania 16802
| | | |
Collapse
|
4
|
Neural Sequence Generation Using Spatiotemporal Patterns of Inhibition. PLoS Comput Biol 2015; 11:e1004581. [PMID: 26536029 PMCID: PMC4633124 DOI: 10.1371/journal.pcbi.1004581] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2015] [Accepted: 09/24/2015] [Indexed: 11/19/2022] Open
Abstract
Stereotyped sequences of neural activity are thought to underlie reproducible behaviors and cognitive processes ranging from memory recall to arm movement. One of the most prominent theoretical models of neural sequence generation is the synfire chain, in which pulses of synchronized spiking activity propagate robustly along a chain of cells connected by highly redundant feedforward excitation. But recent experimental observations in the avian song production pathway during song generation have shown excitatory activity interacting strongly with the firing patterns of inhibitory neurons, suggesting a process of sequence generation more complex than feedforward excitation. Here we propose a model of sequence generation inspired by these observations in which a pulse travels along a spatially recurrent excitatory chain, passing repeatedly through zones of local feedback inhibition. In this model, synchrony and robust timing are maintained not through redundant excitatory connections, but rather through the interaction between the pulse and the spatiotemporal pattern of inhibition that it creates as it circulates the network. These results suggest that spatially and temporally structured inhibition may play a key role in sequence generation.
Collapse
|
5
|
Wittenbach JD, Bouchard KE, Brainard MS, Jin DZ. An Adapting Auditory-motor Feedback Loop Can Contribute to Generating Vocal Repetition. PLoS Comput Biol 2015; 11:e1004471. [PMID: 26448054 PMCID: PMC4598084 DOI: 10.1371/journal.pcbi.1004471] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2015] [Accepted: 07/21/2015] [Indexed: 12/27/2022] Open
Abstract
Consecutive repetition of actions is common in behavioral sequences. Although integration of sensory feedback with internal motor programs is important for sequence generation, if and how feedback contributes to repetitive actions is poorly understood. Here we study how auditory feedback contributes to generating repetitive syllable sequences in songbirds. We propose that auditory signals provide positive feedback to ongoing motor commands, but this influence decays as feedback weakens from response adaptation during syllable repetitions. Computational models show that this mechanism explains repeat distributions observed in Bengalese finch song. We experimentally confirmed two predictions of this mechanism in Bengalese finches: removal of auditory feedback by deafening reduces syllable repetitions; and neural responses to auditory playback of repeated syllable sequences gradually adapt in sensory-motor nucleus HVC. Together, our results implicate a positive auditory-feedback loop with adaptation in generating repetitive vocalizations, and suggest sensory adaptation is important for feedback control of motor sequences. Repetitions are common in animal vocalizations. Songs of many songbirds contain syllables that repeat a variable number of times, with non-Markovian distributions of repeat counts. The neural mechanism underlying such syllable repetitions is unknown. In this work, we show that auditory feedback plays an important role in sustaining syllable repetitions in the Bengalese finch. Deafening reduces syllable repetitions and skews the repeat number distribution towards short repeats. These effects are explained with our computational model, which suggests that syllable repeats are initially sustained by auditory feedback to the neural networks that drive the syllable production. The feedback strength weakens as the syllable repeats, increasing the likelihood that the syllable repetition stops. Neural recordings confirm such adaptation of auditory feedback to the auditory-motor circuit in the Bengalese finch. Our results suggests that sensory feedback can directly impact repetitions in motor sequences, and may provide insights into neural mechanisms of speech disorders such as stuttering.
Collapse
Affiliation(s)
- Jason D. Wittenbach
- Department of Physics and Center for Neural Engineering, the Pennsylvania State University, University Park, Pennsylvania, United States of America
| | - Kristofer E. Bouchard
- Department of Physiology and Center for Integrative Neuroscience, University of California at San Francisco, San Francisco, California, United States of America
- Department of Neurosurgery and Center for Neural Engineering and Prosthesis, University of California at San Francisco, San Francisco, California, United States of America
| | - Michael S. Brainard
- Department of Physiology and Center for Integrative Neuroscience, University of California at San Francisco, San Francisco, California, United States of America
- Howard Hughes Medical Institute, San Francisco, California, United States of America
| | - Dezhe Z. Jin
- Department of Physics and Center for Neural Engineering, the Pennsylvania State University, University Park, Pennsylvania, United States of America
- * E-mail:
| |
Collapse
|
6
|
Abeles M, Diesmann M, Flash T, Geisel T, Herrmann M, Teicher M. Compositionality in neural control: an interdisciplinary study of scribbling movements in primates. Front Comput Neurosci 2013; 7:103. [PMID: 24062679 PMCID: PMC3771313 DOI: 10.3389/fncom.2013.00103] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2013] [Accepted: 07/11/2013] [Indexed: 01/22/2023] Open
Abstract
This article discusses the compositional structure of hand movements by analyzing and modeling neural and behavioral data obtained from experiments where a monkey (Macaca fascicularis) performed scribbling movements induced by a search task. Using geometrically based approaches to movement segmentation, it is shown that the hand trajectories are composed of elementary segments that are primarily parabolic in shape. The segments could be categorized into a small number of classes on the basis of decreasing intra-class variance over the course of training. A separate classification of the neural data employing a hidden Markov model showed a coincidence of the neural states with the behavioral categories. An additional analysis of both types of data by a data mining method provided evidence that the neural activity patterns underlying the behavioral primitives were formed by sets of specific and precise spike patterns. A geometric description of the movement trajectories, together with precise neural timing data indicates a compositional variant of a realistic synfire chain model. This model reproduces the typical shapes and temporal properties of the trajectories; hence the structure and composition of the primitives may reflect meaningful behavior.
Collapse
Affiliation(s)
- Moshe Abeles
- Gonda Brain Research Center, Bar Ilan University Ramat Gan, Israel ; Department of Physiology, The Hebrew University of Jerusalem Jerusalem, Israel
| | | | | | | | | | | |
Collapse
|
7
|
Hanuschkin A, Diesmann M, Morrison A. A reafferent and feed-forward model of song syntax generation in the Bengalese finch. J Comput Neurosci 2011; 31:509-32. [PMID: 21404048 PMCID: PMC3232349 DOI: 10.1007/s10827-011-0318-z] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2010] [Revised: 01/28/2011] [Accepted: 02/03/2011] [Indexed: 12/04/2022]
Abstract
Adult Bengalese finches generate a variable song that obeys a distinct and individual syntax. The syntax is gradually lost over a period of days after deafening and is recovered when hearing is restored. We present a spiking neuronal network model of the song syntax generation and its loss, based on the assumption that the syntax is stored in reafferent connections from the auditory to the motor control area. Propagating synfire activity in the HVC codes for individual syllables of the song and priming signals from the auditory network reduce the competition between syllables to allow only those transitions that are permitted by the syntax. Both imprinting of song syntax within HVC and the interaction of the reafferent signal with an efference copy of the motor command are sufficient to explain the gradual loss of syntax in the absence of auditory feedback. The model also reproduces for the first time experimental findings on the influence of altered auditory feedback on the song syntax generation, and predicts song- and species-specific low frequency components in the LFP. This study illustrates how sequential compositionality following a defined syntax can be realized in networks of spiking neurons.
Collapse
Affiliation(s)
- Alexander Hanuschkin
- Functional Neural Circuits Group, Faculty of Biology, Albert-Ludwig University of Freiburg, Schänzlestrasse 1, 79104 Freiburg, Germany.
| | | | | |
Collapse
|
8
|
A model for complex sequence learning and reproduction in neural populations. J Comput Neurosci 2011; 32:403-23. [DOI: 10.1007/s10827-011-0360-x] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2011] [Revised: 08/12/2011] [Accepted: 08/15/2011] [Indexed: 10/17/2022]
|
9
|
A compact statistical model of the song syntax in Bengalese finch. PLoS Comput Biol 2011; 7:e1001108. [PMID: 21445230 PMCID: PMC3060163 DOI: 10.1371/journal.pcbi.1001108] [Citation(s) in RCA: 51] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2010] [Accepted: 02/10/2011] [Indexed: 11/19/2022] Open
Abstract
Songs of many songbird species consist of variable sequences of a finite number of syllables. A common approach for characterizing the syntax of these complex syllable sequences is to use transition probabilities between the syllables. This is equivalent to the Markov model, in which each syllable is associated with one state, and the transition probabilities between the states do not depend on the state transition history. Here we analyze the song syntax in Bengalese finch. We show that the Markov model fails to capture the statistical properties of the syllable sequences. Instead, a state transition model that accurately describes the statistics of the syllable sequences includes adaptation of the self-transition probabilities when states are revisited consecutively, and allows associations of more than one state to a given syllable. Such a model does not increase the model complexity significantly. Mathematically, the model is a partially observable Markov model with adaptation (POMMA). The success of the POMMA supports the branching chain network model of how syntax is controlled within the premotor song nucleus HVC, but also suggests that adaptation and many-to-one mapping from the syllable-encoding chain networks in HVC to syllables should be included in the network model.
Collapse
|
10
|
Hanuschkin A, Herrmann JM, Morrison A, Diesmann M. Compositionality of arm movements can be realized by propagating synchrony. J Comput Neurosci 2010; 30:675-97. [PMID: 20953686 PMCID: PMC3108016 DOI: 10.1007/s10827-010-0285-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2010] [Revised: 09/02/2010] [Accepted: 09/30/2010] [Indexed: 11/29/2022]
Abstract
We present a biologically plausible spiking neuronal network model of free monkey scribbling that reproduces experimental findings on cortical activity and the properties of the scribbling trajectory. The model is based on the idea that synfire chains can encode movement primitives. Here, we map the propagation of activity in a chain to a linearly evolving preferred velocity, which results in parabolic segments that fulfill the two-thirds power law. Connections between chains that match the final velocity of one encoded primitive to the initial velocity of the next allow the composition of random sequences of primitives with smooth transitions. The model provides an explanation for the segmentation of the trajectory and the experimentally observed deviations of the trajectory from the parabolic shape at primitive transition sites. Furthermore, the model predicts low frequency oscillations (<10 Hz) of the motor cortex local field potential during ongoing movements and increasing firing rates of non-specific motor cortex neurons before movement onset.
Collapse
Affiliation(s)
- Alexander Hanuschkin
- Functional Neural Circuits Group, Faculty of Biology, Schänzlestrasse 1, 79104, Freiburg, Germany.
| | | | | | | |
Collapse
|
11
|
Jin DZ. Generating variable birdsong syllable sequences with branching chain networks in avian premotor nucleus HVC. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2009; 80:051902. [PMID: 20365001 DOI: 10.1103/physreve.80.051902] [Citation(s) in RCA: 48] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/22/2009] [Revised: 08/14/2009] [Indexed: 05/29/2023]
Abstract
Songs of songbird species such as Bengalese finch consist of sequences of syllables. While syllables are temporally stereotypical, syllable sequences can vary and follow complex, probabilistic transition rules. Recent experiments and computational models suggest that a syllable is encoded in a chain network of projection neurons in premotor nucleus HVC (proper name). Precisely timed spikes propagate along the chain, driving vocalization of the syllable through downstream nuclei. However, the neural basis of the probabilistic transitions between the syllables is not understood. Here we propose that variable syllable sequences are generated through spike propagations in a network in HVC in which the syllable-encoding chain networks are connected into a branching chain pattern. The neurons mutually inhibit each other through the inhibitory HVC interneurons, and are driven by external inputs from nuclei upstream of HVC. At a branching point that connects the final group of a chain to the first groups of several chains, the spike activity selects one branch to continue the propagation. The selection is probabilistic, and is due to the winner-take-all mechanism mediated by the inhibition and noise. The transitions between the chains are Markovian. If the same syllable can be driven by multiple chains, the generated syllable sequences are statistically described by partially observable Markov models. We suggest that the syntax of birdsong syllable sequences is embedded in the connection patterns of HVC projection neurons.
Collapse
Affiliation(s)
- Dezhe Z Jin
- Department of Physics, The Pennsylvania State University, University Park, Pennsylvania 16802, USA.
| |
Collapse
|