A neural circuit model for human sensorimotor timing

Pitch biases sensorimotor synchronization to auditory rhythms

Current models of rhythm perception propose that humans track musical beats using the phase, period, and amplitude of sound patterns. However, a growing body of evidence suggests that pitch can also influence the perceived timing of auditory signals. In the present study, we conducted two experiments to investigate whether pitch affects the phase and period of sensorimotor synchronization. To do so, we asked participants to synchronize with a repeating tone, whose pitch on each trial was drawn from one of six different octaves (110-3520 Hz). In Experiment 1, we observed U-shaped patterns in both mean asynchrony and continuation tapping rates, with participants tapping latest and slowest when synchronizing to low and extremely high (above 2000 Hz) pitches, and tapping earliest and fastest to moderately high pitches. In Experiment 2, we found that extremely high pitches still produced slower timing than moderately high pitches when participants were exposed to an exclusively high-pitched context. Based on our results, we advocate for the incorporation of pitch into models of rhythm perception and discuss possible origins of these effects.

Neural signatures of temporal anticipation in human cortex represent event probability density

Temporal prediction is a fundamental function of neural systems. Recent results show that humans anticipate future events by calculating probability density functions, rather than hazard rates. However, direct neural evidence for this hypothesized mechanism is lacking. We recorded neural activity using magnetoencephalography as participants anticipated auditory and visual events distributed in time. We show that temporal anticipation, measured as reaction times, approximates the event probability density function, but not hazard rate. Temporal anticipation manifests as spatiotemporally patterned activity in three anatomically and functionally distinct parieto-temporal and sensorimotor cortical areas. Each of these areas revealed a marked neural signature of anticipation: Prior to sensory cues, activity in a specific frequency range of neural oscillations, spanning alpha and beta ranges, encodes the event probability density function. These neural signals predicted reaction times to imminent sensory cues. These results demonstrate that supra-modal representations of probability density across cortex underlie the anticipation of future events.

Latent circuit inference from heterogeneous neural responses during cognitive tasks

Higher cortical areas carry a wide range of sensory, cognitive and motor signals mixed in heterogeneous responses of single neurons tuned to multiple task variables. Dimensionality reduction methods that rely on correlations between neural activity and task variables leave unknown how heterogeneous responses arise from connectivity to drive behavior. We develop the latent circuit model, a dimensionality reduction approach in which task variables interact via low-dimensional recurrent connectivity to produce behavioral output. We apply the latent circuit inference to recurrent neural networks trained to perform a context-dependent decision-making task and find a suppression mechanism in which contextual representations inhibit irrelevant sensory responses. We validate this mechanism by confirming the behavioral effects of patterned connectivity perturbations predicted by the latent circuit model. We find similar suppression of irrelevant sensory responses in the prefrontal cortex of monkeys performing the same task. We show that incorporating causal interactions among task variables is critical for identifying behaviorally relevant computations from neural response data.

Perturbation context in paced finger tapping tunes the error-correction mechanism

Sensorimotor synchronization (SMS) is the mainly specifically human ability to move in sync with a periodic external stimulus, as in keeping pace with music. The most common experimental paradigm to study its largely unknown underlying mechanism is the paced finger-tapping task, where a participant taps to a periodic sequence of brief stimuli. Contrary to reaction time, this task involves temporal prediction because the participant needs to trigger the motor action in advance for the tap and the stimulus to occur simultaneously, then an error-correction mechanism takes past performance as input to adjust the following prediction. In a different, simpler task, it has been shown that exposure to a distribution of individual temporal intervals creates a "temporal context" that can bias the estimation/production of a single target interval. As temporal estimation and production are also involved in SMS, we asked whether a paced finger-tapping task with period perturbations would show any time-related context effect. In this work we show that a perturbation context can indeed be generated by exposure to period perturbations during paced finger tapping, affecting the shape and size of the resynchronization curve. Response asymmetry is also affected, thus evidencing an interplay between context and intrinsic nonlinearities of the correction mechanism. We conclude that perturbation context calibrates the underlying error-correction mechanism in SMS.

Dynamical mechanisms of how an RNN keeps a beat, uncovered with a low-dimensional reduced model

Despite music's omnipresence, the specific neural mechanisms responsible for perceiving and anticipating temporal patterns in music are unknown. To study potential mechanisms for keeping time in rhythmic contexts, we train a biologically constrained RNN, with excitatory (E) and inhibitory (I) units, on seven different stimulus tempos (2-8 Hz) on a synchronization and continuation task, a standard experimental paradigm. Our trained RNN generates a network oscillator that uses an input current (context parameter) to control oscillation frequency and replicates key features of neural dynamics observed in neural recordings of monkeys performing the same task. We develop a reduced three-variable rate model of the RNN and analyze its dynamic properties. By treating our understanding of the mathematical structure for oscillations in the reduced model as predictive, we confirm that the dynamical mechanisms are found also in the RNN. Our neurally plausible reduced model reveals an E-I circuit with two distinct inhibitory sub-populations, of which one is tightly synchronized with the excitatory units.

Challenges and Approaches in the Study of Neural Entrainment

When exposed to rhythmic stimulation, the human brain displays rhythmic activity across sensory modalities and regions. Given the ubiquity of this phenomenon, how sensory rhythms are transformed into neural rhythms remains surprisingly inconclusive. An influential model posits that endogenous oscillations entrain to external rhythms, thereby encoding environmental dynamics and shaping perception. However, research on neural entrainment faces multiple challenges, from ambiguous definitions to methodological difficulties when endogenous oscillations need to be identified and disentangled from other stimulus-related mechanisms that can lead to similar phase-locked responses. Yet, recent years have seen novel approaches to overcome these challenges, including computational modeling, insights from dynamical systems theory, sophisticated stimulus designs, and study of neuropsychological impairments. This review outlines key challenges in neural entrainment research, delineates state-of-the-art approaches, and integrates findings from human and animal neurophysiology to provide a broad perspective on the usefulness, validity, and constraints of oscillatory models in brain-environment interaction.

Mechanism of Duration Perception in Artificial Brains Suggests New Model of Attentional Entrainment

While cognitive theory has advanced several candidate frameworks to explain attentional entrainment, the neural basis for the temporal allocation of attention is unknown. Here we present a new model of attentional entrainment guided by empirical evidence obtained using a cohort of 50 artificial brains. These brains were evolved in silico to perform a duration judgment task similar to one where human subjects perform duration judgments in auditory oddball paradigms. We found that the artificial brains display psychometric characteristics remarkably similar to those of human listeners and exhibit similar patterns of distortions of perception when presented with out-of-rhythm oddballs. A detailed analysis of mechanisms behind the duration distortion suggests that attention peaks at the end of the tone, which is inconsistent with previous attentional entrainment models. Instead, the new model of entrainment emphasizes increased attention to those aspects of the stimulus that the brain expects to be highly informative.

Adaptive oscillators support Bayesian prediction in temporal processing

Humans excel at predictively synchronizing their behavior with external rhythms, as in dance or music performance. The neural processes underlying rhythmic inferences are debated: whether predictive perception relies on high-level generative models or whether it can readily be implemented locally by hard-coded intrinsic oscillators synchronizing to rhythmic input remains unclear and different underlying computational mechanisms have been proposed. Here we explore human perception for tone sequences with some temporal regularity at varying rates, but with considerable variability. Next, using a dynamical systems perspective, we successfully model the participants behavior using an adaptive frequency oscillator which adjusts its spontaneous frequency based on the rate of stimuli. This model better reflects human behavior than a canonical nonlinear oscillator and a predictive ramping model-both widely used for temporal estimation and prediction-and demonstrate that the classical distinction between absolute and relative computational mechanisms can be unified under this framework. In addition, we show that neural oscillators may constitute hard-coded physiological priors-in a Bayesian sense-that reduce temporal uncertainty and facilitate the predictive processing of noisy rhythms. Together, the results show that adaptive oscillators provide an elegant and biologically plausible means to subserve rhythmic inference, reconciling previously incompatible frameworks for temporal inferential processes.

Context-specific and context-invariant computations of interval timing

Introduction

An accurate sense of time is crucial in flexible sensorimotor control and other cognitive functions. However, it remains unknown how multiple timing computations in different contexts interact to shape our behavior.

Methods

We asked 41 healthy human subjects to perform timing tasks that differed in the sensorimotor domain (sensory timing vs. motor timing) and effector (hand vs. saccadic eye movement). To understand how these different behavioral contexts contribute to timing behavior, we applied a three-stage Bayesian model to behavioral data.

Results

Our results demonstrate that the Bayesian model for each effector could not describe bias in the other effector. Similarly, in each task the model-predicted data could not describe bias in the other task. These findings suggest that the measurement stage of interval timing is context-specific in the sensorimotor and effector domains. We also showed that temporal precision is context-invariant in the effector domain, unlike temporal accuracy.

Discussion

This combination of context-specific and context-invariant computations across sensorimotor and effector domains suggests overlapping and distributed computations as the underlying mechanism of timing in different contexts.

Motor variability modulates calibration of precisely timed movements

Interacting with the environment often requires precisely timed movements, challenging the brain to minimize the detrimental impact of neural noise. Recent research demonstrates that the brain exploits the variability of its temporal estimates and recalibrates perception accordingly. Time-critical movements, however, contain a sensory measurement and a motor stage. The brain must have knowledge of both in order to avoid maladapted behavior. By manipulating sensory and motor variability, we show that the sensorimotor system recalibrates sensory and motor uncertainty separately. Serial dependencies between observed interval durations in the previous and motor reproductions in the current trial were weighted by the variability of movements. These serial dependencies generalized across different effectors, but not to a visual discrimination task. Our results suggest that the brain has accurate knowledge about contributions of motor uncertainty to errors in temporal movements. This knowledge about motor uncertainty seems to be processed separately from knowledge about sensory uncertainty.

Dynamic models for musical rhythm perception and coordination

Rhythmicity permeates large parts of human experience. Humans generate various motor and brain rhythms spanning a range of frequencies. We also experience and synchronize to externally imposed rhythmicity, for example from music and song or from the 24-h light-dark cycles of the sun. In the context of music, humans have the ability to perceive, generate, and anticipate rhythmic structures, for example, "the beat." Experimental and behavioral studies offer clues about the biophysical and neural mechanisms that underlie our rhythmic abilities, and about different brain areas that are involved but many open questions remain. In this paper, we review several theoretical and computational approaches, each centered at different levels of description, that address specific aspects of musical rhythmic generation, perception, attention, perception-action coordination, and learning. We survey methods and results from applications of dynamical systems theory, neuro-mechanistic modeling, and Bayesian inference. Some frameworks rely on synchronization of intrinsic brain rhythms that span the relevant frequency range; some formulations involve real-time adaptation schemes for error-correction to align the phase and frequency of a dedicated circuit; others involve learning and dynamically adjusting expectations to make rhythm tracking predictions. Each of the approaches, while initially designed to answer specific questions, offers the possibility of being integrated into a larger framework that provides insights into our ability to perceive and generate rhythmic patterns.

Functional architecture of executive control and associated event-related potentials in macaques

The medial frontal cortex (MFC) enables executive control by monitoring relevant information and using it to adapt behavior. In macaques performing a saccade countermanding (stop-signal) task, we simultaneously recorded electrical potentials over MFC and neural spiking across all layers of the supplementary eye field (SEF). We report the laminar organization of neurons enabling executive control by monitoring the conflict between incompatible responses, the timing of events, and sustaining goal maintenance. These neurons were a mix of narrow-spiking and broad-spiking found in all layers, but those predicting the duration of control and sustaining the task goal until the release of operant control were more commonly narrow-spiking neurons confined to layers 2 and 3 (L2/3). We complement these results with evidence for a monkey homolog of the N2/P3 event-related potential (ERP) complex associated with response inhibition. N2 polarization varied with error-likelihood and P3 polarization varied with the duration of expected control. The amplitude of the N2 and P3 were predicted by the spike rate of different classes of neurons located in L2/3 but not L5/6. These findings reveal features of the cortical microcircuitry supporting executive control and producing associated ERPs.

The EBRAINS Hodgkin-Huxley Neuron Builder: An online resource for building data-driven neuron models

In the last decades, brain modeling has been established as a fundamental tool for understanding neural mechanisms and information processing in individual cells and circuits at different scales of observation. Building data-driven brain models requires the availability of experimental data and analysis tools as well as neural simulation environments and, often, large scale computing facilities. All these components are rarely found in a comprehensive framework and usually require ad hoc programming. To address this, we developed the EBRAINS Hodgkin-Huxley Neuron Builder (HHNB), a web resource for building single cell neural models via the extraction of activity features from electrophysiological traces, the optimization of the model parameters via a genetic algorithm executed on high performance computing facilities and the simulation of the optimized model in an interactive framework. Thanks to its inherent characteristics, the HHNB facilitates the data-driven model building workflow and its reproducibility, hence fostering a collaborative approach to brain modeling.

A biophysical counting mechanism for keeping time

The ability to estimate and produce appropriately timed responses is central to many behaviors including speaking, dancing, and playing a musical instrument. A classical framework for estimating or producing a time interval is the pacemaker-accumulator model in which pulses of a pacemaker are counted and compared to a stored representation. However, the neural mechanisms for how these pulses are counted remain an open question. The presence of noise and stochasticity further complicates the picture. We present a biophysical model of how to keep count of a pacemaker in the presence of various forms of stochasticity using a system of bistable Wilson-Cowan units asymmetrically connected in a one-dimensional array; all units receive the same input pulses from a central clock but only one unit is active at any point in time. With each pulse from the clock, the position of the activated unit changes thereby encoding the total number of pulses emitted by the clock. This neural architecture maps the counting problem into the spatial domain, which in turn translates count to a time estimate. We further extend the model to a hierarchical structure to be able to robustly achieve higher counts.

Thunderstruck: The ACDC model of flexible sequences and rhythms in recurrent neural circuits

Adaptive sequential behavior is a hallmark of human cognition. In particular, humans can learn to produce precise spatiotemporal sequences given a certain context. For instance, musicians can not only reproduce learned action sequences in a context-dependent manner, they can also quickly and flexibly reapply them in any desired tempo or rhythm without overwriting previous learning. Existing neural network models fail to account for these properties. We argue that this limitation emerges from the fact that sequence information (i.e., the position of the action) and timing (i.e., the moment of response execution) are typically stored in the same neural network weights. Here, we augment a biologically plausible recurrent neural network of cortical dynamics to include a basal ganglia-thalamic module which uses reinforcement learning to dynamically modulate action. This “associative cluster-dependent chain” (ACDC) model modularly stores sequence and timing information in distinct loci of the network. This feature increases computational power and allows ACDC to display a wide range of temporal properties (e.g., multiple sequences, temporal shifting, rescaling, and compositionality), while still accounting for several behavioral and neurophysiological empirical observations. Finally, we apply this ACDC network to show how it can learn the famous “Thunderstruck” song intro and then flexibly play it in a “bossa nova” rhythm without further training.

How do humans flexibly adapt action sequences? For instance, musicians can learn a song and quickly speed up or slow down the tempo, or even play the song following a completely different rhythm (e.g., a rock song using a bossa nova rhythm). In this work, we build a biologically plausible network of cortico-basal ganglia interactions that explains how this temporal flexibility may emerge in the brain. Crucially, our model factorizes sequence order and action timing, respectively represented in cortical and basal ganglia dynamics. This factorization allows full temporal flexibility, i.e. the timing of a learned action sequence can be recomposed without interfering with the order of the sequence. As such, our model is capable of learning asynchronous action sequences, and flexibly shift, rescale, and recompose them, while accounting for biological data.

Neural implementations of Bayesian inference

Bayesian inference has emerged as a general framework that captures how organisms make decisions under uncertainty. Recent experimental findings reveal disparate mechanisms for how the brain generates behaviors predicted by normative Bayesian theories. Here, we identify two broad classes of neural implementations for Bayesian inference: a modular class, where each probabilistic component of Bayesian computation is independently encoded and a transform class, where uncertain measurements are converted to Bayesian estimates through latent processes. Many recent experimental neuroscience findings studying probabilistic inference broadly fall into these classes. We identify potential avenues for synthesis across these two classes and the disparities that, at present, cannot be reconciled. We conclude that to distinguish among implementation hypotheses for Bayesian inference, we require greater engagement among theoretical and experimental neuroscientists in an effort that spans different scales of analysis, circuits, tasks, and species.

Mapping between sound, brain and behaviour: four-level framework for understanding rhythm processing in humans and non-human primates

Humans perceive and spontaneously move to one or several levels of periodic pulses (a meter, for short) when listening to musical rhythm, even when the sensory input does not provide prominent periodic cues to their temporal location. Here, we review a multi-levelled framework to understanding how external rhythmic inputs are mapped onto internally represented metric pulses. This mapping is studied using an approach to quantify and directly compare representations of metric pulses in signals corresponding to sensory inputs, neural activity and behaviour (typically body movement). Based on this approach, recent empirical evidence can be drawn together into a conceptual framework that unpacks the phenomenon of meter into four levels. Each level highlights specific functional processes that critically enable and shape the mapping from sensory input to internal meter. We discuss the nature, constraints and neural substrates of these processes, starting with fundamental mechanisms investigated in macaque monkeys that enable basic forms of mapping between simple rhythmic stimuli and internally represented metric pulse. We propose that human evolution has gradually built a robust and flexible system upon these fundamental processes, allowing more complex levels of mapping to emerge in musical behaviours. This approach opens promising avenues to understand the many facets of rhythmic behaviours across individuals and species. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.

Two views on the cognitive brain

Cognition can be defined as computation over meaningful representations in the brain to produce adaptive behaviour. There are two views on the relationship between cognition and the brain that are largely implicit in the literature. The Sherringtonian view seeks to explain cognition as the result of operations on signals performed at nodes in a network and passed between them that are implemented by specific neurons and their connections in circuits in the brain. The contrasting Hopfieldian view explains cognition as the result of transformations between or movement within representational spaces that are implemented by neural populations. Thus, the Hopfieldian view relegates details regarding the identity of and connections between specific neurons to the status of secondary explainers. Only the Hopfieldian approach has the representational and computational resources needed to develop novel neurofunctional objects that can serve as primary explainers of cognition.

Cryptic transmission of SARS-CoV-2 and the first COVID-19 wave in Europe and the United States

Given the narrowness of the initial testing criteria, the SARS-CoV-2 virus spread through cryptic transmission in January and February, setting the stage for the epidemic wave experienced in March and April, 2020. We use a global metapopulation epidemic model to provide a mechanistic understanding of the global dynamic underlying the establishment of the COVID-19 pandemic in Europe and the United States (US). The model is calibrated on international case introductions at the early stage of the pandemic. We find that widespread community transmission of SARS-CoV-2 was likely in several areas of Europe and the US by January 2020, and estimate that by early March, only 1 - 3 in 100 SARS-CoV-2 infections were detected by surveillance systems. Modeling results indicate international travel as the key driver of the introduction of SARS-CoV-2 with possible importation and transmission events as early as December, 2019. We characterize the resulting heterogeneous spatio-temporal spread of SARS-CoV-2 and the burden of the first COVID-19 wave (February-July 2020). We estimate infection attack rates ranging from 0.78%-15.2% in the US and 0.19%-13.2% in Europe. The spatial modeling of SARS-CoV-2 introductions and spreading provides insights into the design of innovative, model-driven surveillance systems and preparedness plans that have a broader initial capacity and indication for testing.

Extracellular vimentin as a target against SARS-CoV-2 host cell invasion

Infection of human cells by pathogens, including SARS-CoV-2, typically proceeds by cell surface binding to a crucial receptor. In the case of SARS-CoV-2, angiotensin-converting enzyme 2 (ACE2) has been identified as a necessary receptor, but not all ACE2-expressing cells are equally infected, suggesting that other extracellular factors are involved in host cell invasion by SARS-CoV-2. Vimentin is an intermediate filament protein that is increasingly recognized as being present on the extracellular surface of a subset of cell types, where it can bind to and facilitate pathogens' cellular uptake. Here, we present evidence that extracellular vimentin might act as a critical component of the SARS-CoV-2 spike protein-ACE2 complex in mediating SARS-CoV-2 cell entry. We demonstrate direct binding between vimentin and SARS-CoV-2 pseudovirus coated with the SARS-CoV-2 spike protein and show that antibodies against vimentin block in vitro SARS-CoV-2 pseudovirus infection of ACE2-expressing cells. Our results suggest new therapeutic strategies for preventing and slowing SARS-CoV-2 infection, focusing on targeting cell host surface vimentin.

Temporal Prediction Signals for Periodic Sensory Events in the Primate Central Thalamus

Prediction of periodic event timing is an important function for everyday activities, while the exact neural mechanism remains unclear. Previous studies in nonhuman primates have demonstrated that neurons in the cerebellar dentate nucleus and those in the caudate nucleus exhibit periodic firing modulation when the animals attempt to detect a single omission of isochronous repetitive audiovisual stimuli. To understand how these subcortical signals are sent and processed through the thalamocortical pathways, we examined single-neuron activities in the central thalamus of two macaque monkeys (one female and one male). We found that three types of neurons responded to each stimulus in the sequence in the absence of movements. Reactive-type neurons showed sensory adaptation and gradually waned the transient response to each stimulus. Predictive-type neurons steadily increased the magnitude of the suppressive response, similar to neurons previously reported in the cerebellum. Switch-type neurons initially showed a transient response, but after several cycles, the direction of firing modulation reversed and the activity decreased for each repetitive stimulus. The time course of Switch-type activity was well explained by the weighted sum of activities of the other types of neurons. Furthermore, for only Switch-type neurons the activity just before stimulus omission significantly correlated with behavioral latency, indicating that this type of neuron may carry a more advanced signal in the system detecting stimulus omission. These results suggest that the central thalamus may transmit integrated signals to the cerebral cortex for temporal information processing, which are necessary to accurately predict rhythmic event timing.SIGNIFICANCE STATEMENT Several cortical and subcortical regions are involved in temporal information processing, and the thalamus will play a role in functionally linking them. The present study aimed to clarify how the paralaminar part of the thalamus transmits and modifies signals for temporal prediction of rhythmic events. Three types of thalamic neurons exhibited periodic activity when monkeys attempted to detect a single omission of isochronous repetitive stimuli. The activity of one type of neuron correlated with the behavioral latency and appeared to be generated by integrating the signals carried by the other types of neurons. Our results revealed the neuronal signals in the thalamus for temporal prediction of sensory events, providing a clue to elucidate information processing in the thalamocortical pathways.

A Network Perspective on Sensorimotor Learning

What happens in the brain when we learn? Ever since the foundational work of Cajal, the field has made numerous discoveries as to how experience could change the structure and function of individual synapses. However, more recent advances have highlighted the need for understanding learning in terms of complex interactions between populations of neurons and synapses. How should one think about learning at such a macroscopic level? Here, we develop a conceptual framework to bridge the gap between the different scales at which learning operates, from synapses to neurons to behavior. Using this framework, we explore the principles that guide sensorimotor learning across these scales, and set the stage for future experimental and theoretical work in the field.