Striatal dynamics explain duration judgments

Dorsal striatum coding for the timely execution of action sequences

The automatic initiation of actions can be highly functional. But occasionally these actions cannot be withheld and are released at inappropriate times, impulsively. Striatal activity has been shown to participate in the timing of action sequence initiation and it has been linked to impulsivity. Using a self-initiated task, we trained adult male rats to withhold a rewarded action sequence until a waiting time interval has elapsed. By analyzing neuronal activity we show that the striatal response preceding the initiation of the learned sequence is strongly modulated by the time subjects wait before eliciting the sequence. Interestingly, the modulation is steeper in adolescent rats, which show a strong prevalence of impulsive responses compared to adults. We hypothesize this anticipatory striatal activity reflects the animals’ subjective reward expectation, based on the elapsed waiting time, while the steeper waiting modulation in adolescence reflects age-related differences in temporal discounting, internal urgency states, or explore–exploit balance.

Distributed coding of duration in rodent prefrontal cortex during time reproduction

As we interact with the external world, we judge magnitudes from sensory information. The estimation of magnitudes has been characterized in primates, yet it is largely unexplored in nonprimate species. Here, we use time interval reproduction to study rodent behavior and its neural correlates in the context of magnitude estimation. We show that gerbils display primate-like magnitude estimation characteristics in time reproduction. Most prominently their behavioral responses show a systematic overestimation of small stimuli and an underestimation of large stimuli, often referred to as regression effect. We investigated the underlying neural mechanisms by recording from medial prefrontal cortex and show that the majority of neurons respond either during the measurement or the reproduction of a time interval. Cells that are active during both phases display distinct response patterns. We categorize the neural responses into multiple types and demonstrate that only populations with mixed responses can encode the bias of the regression effect. These results help unveil the organizing neural principles of time reproduction and perhaps magnitude estimation in general.

Time coding in rat dorsolateral striatum

To assess the role of dorsolateral striatum (DLS) in time coding, we recorded neuronal activity in rats tasked with comparing the durations of two sequential vibrations. Bayesian decoding of population activity revealed a representation of the unfolding of the trial across time. However, further analyses demonstrated a distinction between the encoding of trial time and perceived time. First, DLS did not show a privileged representation of the stimulus durations compared with other time spans. Second, higher intensity vibrations were perceived as longer; however, time decoded from DLS was unaffected by vibration intensity. Third, DLS did not encode stimulus duration differently on correct versus incorrect trials. Finally, in rats trained to compare the intensities of two sequential vibrations, stimulus duration was encoded even though it was a perceptually irrelevant feature. These findings lead us to posit that temporal information is inherent to DLS activity irrespective of the rat's ongoing percept.

Time in the brain: Encoding does not mean perceiving

The neural basis of time perception remains an enigma. In rats performing interval judgment tasks, striatal time coding has drawn attention as one potential substrate. Toso et al. (2021b) find that such time coding does not account for stimulus duration perception.

Dorsomedial Striatal Activity Tracks Completion of Behavioral Sequences in Rats

For proper execution of goal-directed behaviors, individuals require both a general representation of the goal and an ability to monitor their own progress toward that goal. Here, we examine how dorsomedial striatum (DMS), a region pivotal for forming associations among stimuli, actions, and outcomes, encodes the execution of goal-directed action sequences that require self-monitoring of behavior. We trained rats to complete a sequence of at least five consecutive lever presses (without visiting the reward port) to obtain a reward and recorded the activity of individual cells in DMS while rats performed the task. We found that the pattern of DMS activity gradually changed during the execution of the sequence, permitting accurate decoding of sequence progress from neural activity at a population level. Moreover, this sequence-related activity was blunted on trials where rats did not complete a sufficient number of presses. Overall, these data suggest a link between DMS activity and the execution of behavioral sequences that require monitoring of ongoing behavior.

A precise and adaptive neural mechanism for predictive temporal processing in the frontal cortex

The theory of predictive processing posits that the brain computes expectations to process information predictively. Empirical evidence in support of this theory, however, is scarce and largely limited to sensory areas. Here, we report a precise and adaptive mechanism in the frontal cortex of non-human primates consistent with predictive processing of temporal events. We found that the speed of neural dynamics is precisely adjusted according to the average time of an expected stimulus. This speed adjustment, in turn, enables neurons to encode stimuli in terms of deviations from expectation. This lawful relationship was evident across multiple experiments and held true during learning: when temporal statistics underwent covert changes, neural responses underwent predictable changes that reflected the new mean. Together, these results highlight a precise mathematical relationship between temporal statistics in the environment and neural activity in the frontal cortex that may serve as a mechanism for predictive temporal processing.

Imprinting on time-structured acoustic stimuli in ducklings

Filial imprinting is a dedicated learning process that lacks explicit reinforcement. The phenomenon itself is narrowly heritably canalized, but its content, the representation of the parental object, reflects the circumstances of the newborn. Imprinting has recently been shown to be even more subtle and complex than previously envisaged, since ducklings and chicks are now known to select and represent for later generalization abstract conceptual properties of the objects they perceive as neonates, including movement pattern, heterogeneity and inter-component relationships of same or different. Here, we investigate day-old Mallard (Anas platyrhynchos) ducklings' bias towards imprinting on acoustic stimuli made from mallards' vocalizations as opposed to white noise, whether they imprint on the temporal structure of brief acoustic stimuli of either kind, and whether they generalize timing information across the two sounds. Our data are consistent with a strong innate preference for natural sounds, but do not reliably establish sensitivity to temporal relations. This fits with the view that imprinting includes the establishment of representations of both primary percepts and selective abstract properties of their early perceptual input, meshing together genetically transmitted prior pre-dispositions with active selection and processing of the perceptual input.

Using focal cooling to link neural dynamics and behavior

Establishing a causal link between neural function and behavioral output has remained a challenging problem. Commonly used perturbation techniques enable unprecedented control over intrinsic activity patterns and can effectively identify crucial circuit elements important for specific behaviors. However, these approaches may severely disrupt activity, precluding an investigation into the behavioral relevance of moment-to-moment neural dynamics within a specified brain region. Here we discuss the application of mild focal cooling to slow down intrinsic neural circuit activity while preserving its overall structure. Using network modeling and examples from multiple species, we highlight the power and versatility of focal cooling for understanding how neural dynamics control behavior and argue for its wider adoption within the systems neuroscience community.

Dorsal striatum and the temporal expectancy of an aversive event in Pavlovian odor fear learning

Interval timing, the ability to encode and retrieve the memory of intervals from seconds to minutes, guides fundamental animal behaviors across the phylogenetic tree. In Pavlovian fear conditioning, an initially neutral stimulus (conditioned stimulus, CS) predicts the arrival of an aversive unconditioned stimulus (US, generally a mild foot-shock) at a fixed time interval. Although some studies showed that temporal relations between CS and US events are learned from the outset of conditioning, the question of the memory of time and its underlying neural network in fear conditioning is still poorly understood. The aim of the present study was to investigate the role of the dorsal striatum in timing intervals in odor fear conditioning in male rats. To assess the animal's interval timing ability in this paradigm, we used the respiratory frequency. This enabled us to detect the emergence of temporal patterns related to the odor-shock time interval from the early stage of learning, confirming that rats are able to encode the odor-shock time interval after few training trials. We carried out reversible inactivation of the dorsal striatum before the acquisition session and before a shift in the learned time interval, and measured the effects of this treatment on the temporal pattern of the respiratory rate. In addition, using intracerebral microdialysis, we monitored extracellular dopamine level in the dorsal striatum throughout odor-shock conditioning and in response to a shift of the odor-shock time interval. Contrary to our initial predictions based on the existing literature on interval timing, we found evidence suggesting that transient inactivation of the dorsal striatum may favor a more precocious buildup of the respiratory frequency's temporal pattern during the odor-shock interval in a manner that reflected the duration of the interval. Our data further suggest that the conditioning and the learning of a novel time interval were associated with a decrease in dopamine level in the dorsal striatum, but not in the nucleus accumbens. These findings prompt a reassessment of the role of the striatum and striatal dopamine in interval timing, at least when considering Pavlovian aversive conditioning.

A sensory integration account for time perception

The connection between stimulus perception and time perception remains unknown. The present study combines human and rat psychophysics with sensory cortical neuronal firing to construct a computational model for the percept of elapsed time embedded within sense of touch. When subjects judged the duration of a vibration applied to the fingertip (human) or whiskers (rat), increasing stimulus intensity led to increasing perceived duration. Symmetrically, increasing vibration duration led to increasing perceived intensity. We modeled real spike trains recorded from vibrissal somatosensory cortex as input to dual leaky integrators-an intensity integrator with short time constant and a duration integrator with long time constant-generating neurometric functions that replicated the actual psychophysical functions of rats. Returning to human psychophysics, we then confirmed specific predictions of the dual leaky integrator model. This study offers a framework, based on sensory coding and subsequent accumulation of sensory drive, to account for how a feeling of the passage of time accompanies the tactile sensory experience.

Striatal dopamine D1 receptors control motivation to respond, but not interval timing, during the timing task

Dopamine plays a critical role in behavioral tasks requiring interval timing (time perception in a seconds-to-minutes range). Although some studies demonstrate the role of dopamine receptors as a controller of the speed of the internal clock, other studies demonstrate their role as a controller of motivation. Both D1 dopamine receptors (D1DRs) and D2 dopamine receptors (D2DRs) within the dorsal striatum may play a role in interval timing because the dorsal striatum contains rich D1DRs and D2DRs. However, relative to D2DRs, the precise role of D1DRs within the dorsal striatum in interval timing is unclear. To address this issue, rats were trained on the peak-interval 20-sec procedure, and D1DR antagonist SCH23390 was infused into the bilateral dorsocentral striatum before behavioral sessions. Our results showed that the D1DR blockade drastically reduced the maximum response rate and increased the time to start responses with no effects on the time to terminate responses. These findings suggest that the D1DRs within the dorsal striatum are required for motivation to respond, but not for modulation of the internal clock speed.

Reinforcement regulates timing variability in thalamus

Learning reduces variability but variability can facilitate learning. This paradoxical relationship has made it challenging to tease apart sources of variability that degrade performance from those that improve it. We tackled this question in a context-dependent timing task requiring humans and monkeys to flexibly produce different time intervals with different effectors. We identified two opposing factors contributing to timing variability: slow memory fluctuation that degrades performance and reward-dependent exploratory behavior that improves performance. Signatures of these opposing factors were evident across populations of neurons in the dorsomedial frontal cortex (DMFC), DMFC-projecting neurons in the ventrolateral thalamus, and putative target of DMFC in the caudate. However, only in the thalamus were the performance-optimizing regulation of variability aligned to the slow performance-degrading memory fluctuations. These findings reveal how variability caused by exploratory behavior might help to mitigate other undesirable sources of variability and highlight a potential role for thalamocortical projections in this process.

Neural Sequences as an Optimal Dynamical Regime for the Readout of Time

Converging evidence suggests that the brain encodes time through dynamically changing patterns of neural activity, including neural sequences, ramping activity, and complex spatiotemporal dynamics. However, the potential computational significance and advantage of these different regimes have remained unaddressed. We combined large-scale recordings and modeling to compare population dynamics between premotor cortex and striatum in mice performing a two-interval timing task. Conventional decoders revealed that the dynamics within each area encoded time equally well; however, the dynamics in striatum exhibited a higher degree of sequentiality. Analysis of premotor and striatal dynamics, together with a large set of simulated prototypical dynamical regimes, revealed that regimes with higher sequentiality allowed a biologically constrained artificial downstream network to better read out time. These results suggest that, although different strategies exist for encoding time in the brain, neural sequences represent an ideal and flexible dynamical regime for enabling downstream areas to read out this information.

Low-dimensional dynamics for working memory and time encoding

Our decisions often depend on multiple sensory experiences separated by time delays. The brain can remember these experiences and, simultaneously, estimate the timing between events. To understand the mechanisms underlying working memory and time encoding, we analyze neural activity recorded during delays in four experiments on nonhuman primates. To disambiguate potential mechanisms, we propose two analyses, namely, decoding the passage of time from neural data and computing the cumulative dimensionality of the neural trajectory over time. Time can be decoded with high precision in tasks where timing information is relevant and with lower precision when irrelevant for performing the task. Neural trajectories are always observed to be low-dimensional. In addition, our results further constrain the mechanisms underlying time encoding as we find that the linear "ramping" component of each neuron's firing rate strongly contributes to the slow timescale variations that make decoding time possible. These constraints rule out working memory models that rely on constant, sustained activity and neural networks with high-dimensional trajectories, like reservoir networks. Instead, recurrent networks trained with backpropagation capture the time-encoding properties and the dimensionality observed in the data.

Temporal Learning Among Prefrontal and Striatal Ensembles

Behavioral flexibility requires the prefrontal cortex and striatum, but it is unclear if these structures play similar or distinct roles in adapting to novel circumstances. Here, we investigate neuronal ensembles in the medial frontal cortex (MFC) and the dorsomedial striatum (DMS) during one form of behavioral flexibility: learning a new temporal interval. We studied corticostriatal neuronal activity as rodents trained to respond after a 12-s fixed interval (FI12) learned to respond at a shorter 3-s fixed interval (FI3). On FI12 trials, we found that a key form of temporal processing—time-related ramping activity—decreased in the MFC but did not change in the DMS as animals learned to respond at a shorter interval. However, while MFC and DMS ramping was stable with successive days of two-interval performance, temporal decoding by DMS ensembles improved on FI3 trials. Finally, when comparing FI12 versus FI3 trials, we found that more DMS neurons than MFC neurons exhibited differential interval-related activity early in two-interval performance. These data suggest that the MFC and DMS play distinct roles during temporal learning and provide insight into corticostriatal circuits.

Prefrontal D1 Dopamine-Receptor Neurons and Delta Resonance in Interval Timing

Considerable evidence has shown that prefrontal neurons expressing D1-type dopamine receptors (D1DRs) are critical for working memory, flexibility, and timing. This line of work predicts that frontal neurons expressing D1DRs mediate cognitive processing. During timing tasks, one form this cognitive processing might take is time-dependent ramping activity-monotonic changes in firing rate over time. Thus, we hypothesized the prefrontal D1DR+ neurons would strongly exhibit time-dependent ramping during interval timing. We tested this idea using an interval-timing task in which we used optogenetics to tag D1DR+ neurons in the mouse medial frontal cortex (MFC). While 23% of MFC D1DR+ neurons exhibited ramping, this was significantly less than untagged MFC neurons. By contrast, MFC D1DR+ neurons had strong delta-frequency (1-4 Hz) coherence with other MFC ramping neurons. This coherence was phase-locked to cue onset and was strongest early in the interval. To test the significance of these interactions, we optogenetically stimulated MFC D1DR+ neurons early versus late in the interval. We found that 2-Hz stimulation early in the interval was particularly effective in rescuing timing-related behavioral performance deficits in dopamine-depleted animals. These findings provide insight into MFC networks and have relevance for disorders such as Parkinson's disease and schizophrenia.

Sequence Memory in the Hippocampal-Entorhinal Region

Episodic memories are constructed from sequences of events. When recalling such a memory, we not only recall individual events, but we also retrieve information about how the sequence of events unfolded. Here, we focus on the role of the hippocampal-entorhinal region in processing and remembering sequences of events, which are thought to be stored in relational networks. We summarize evidence that temporal relations are a central organizational principle for memories in the hippocampus. Importantly, we incorporate novel insights from recent studies about the role of the adjacent entorhinal cortex in sequence memory. In rodents, the lateral entorhinal subregion carries temporal information during ongoing behavior. The human homologue is recruited during memory recall where its representations reflect the temporal relationships between events encountered in a sequence. We further introduce the idea that the hippocampal-entorhinal region might enable temporal scaling of sequence representations. Flexible changes of sequence progression speed could underlie the traversal of episodic memories and mental simulations at different paces. In conclusion, we describe how the entorhinal cortex and hippocampus contribute to remembering event sequences-a core component of episodic memory.

Mediodorsal Thalamus Contributes to the Timing of Instrumental Actions

The perception of time is critical to adaptive behavior. While prefrontal cortex and basal ganglia have been implicated in interval timing in the seconds to minutes range, little is known about the role of the mediodorsal thalamus (MD), which is a key component of the limbic cortico-basal ganglia-thalamocortical loop. In this study, we tested the role of the MD in timing, using an operant temporal production task in male mice. In this task, that the expected timing of available rewards is indicated by lever pressing. Inactivation of the MD with muscimol produced rightward shifts in peak pressing on probe trials as well as increases in peak spread, thus significantly altering both temporal accuracy and precision. Optogenetic inhibition of glutamatergic projection neurons in the MD also resulted in similar changes in timing. The observed effects were found to be independent of significant changes in movement. Our findings suggest that the MD is a critical component of the neural circuit for interval timing, without playing a direct role in regulating ongoing performance.SIGNIFICANCE STATEMENT The mediodorsal nucleus (MD) of the thalamus is strongly connected with the prefrontal cortex and basal ganglia, areas which have been implicated in interval timing. Previous work has shown that the MD contributes to working memory and learning of action-outcome contingencies, but its role in behavioral timing is poorly understood. Using an operant temporal production task, we showed that inactivation of the MD significantly impaired timing behavior.

Opponent regulation of action performance and timing by striatonigral and striatopallidal pathways

The basal ganglia have been implicated in action selection and timing, but the relative contributions of the striatonigral (direct) and striatopallidal (indirect) pathways to these functions remain unclear. We investigated the effects of optogenetic stimulation of D1+ (direct) and A2A+ (indirect) neurons in the ventrolateral striatum in head-fixed mice on a fixed time reinforcement schedule. Direct pathway stimulation initiates licking, whereas indirect pathway stimulation suppresses licking and results in rebound licking after stimulation. Moreover, direct and indirect pathways also play distinct roles in timing. Direct pathway stimulation produced a resetting of the internal timing process, whereas indirect pathway stimulation transiently paused timing, and proportionally delayed the next bout of licking. Our results provide evidence for the continuous and opposing contributions of the direct and indirect pathways in the production and timing of reward-guided behavior.

Striatal network modeling in Huntington's Disease

Medium spiny neurons (MSNs) comprise over 90% of cells in the striatum. In vivo MSNs display coherent burst firing cell assembly activity patterns, even though isolated MSNs do not burst fire intrinsically. This activity is important for the learning and execution of action sequences and is characteristically dysregulated in Huntington's Disease (HD). However, how dysregulation is caused by the various neural pathologies affecting MSNs in HD is unknown. Previous modeling work using simple cell models has shown that cell assembly activity patterns can emerge as a result of MSN inhibitory network interactions. Here, by directly estimating MSN network model parameters from single unit spiking data, we show that a network composed of much more physiologically detailed MSNs provides an excellent quantitative fit to wild type (WT) mouse spiking data, but only when network parameters are appropriate for the striatum. We find the WT MSN network is situated in a regime close to a transition from stable to strongly fluctuating network dynamics. This regime facilitates the generation of low-dimensional slowly varying coherent activity patterns and confers high sensitivity to variations in cortical driving. By re-estimating the model on HD spiking data we discover network parameter modifications are consistent across three very different types of HD mutant mouse models (YAC128, Q175, R6/2). In striking agreement with the known pathophysiology we find feedforward excitatory drive is reduced in HD compared to WT mice, while recurrent inhibition also shows phenotype dependency. We show that these modifications shift the HD MSN network to a sub-optimal regime where higher dimensional incoherent rapidly fluctuating activity predominates. Our results provide insight into a diverse range of experimental findings in HD, including cognitive and motor symptoms, and may suggest new avenues for treatment.

The structure of non-human cognitive neuroscience: an epistemological critique

Every scientific practice rests on implicit unrevised theoretical assumptions. Neuroscience, in particular, focuses on a very controversial object of study-the brain and is therefore prone to tacitly embrace philosophical positions in its everyday workings. It is thus, of utmost importance, to develop a critique of the structure of neuroscientific investigation so as to understand what the uncovered pillars of the field are, what pitfalls they may implicate and how we can correct them. In this paper, I gather the first critiques in animal cognitive neuroscience and hope to establish the first step in a continuous process of revision. By applying a conceptual division of neuroscience into cognitive, behavioral and neurobiological theories, I point out the main problems in articulating the three, based on actual scientific practice rather than purely theoretical reasoning. I conclude by proposing developments on behavioral theory and set an initial critique on assumptions on both cognitive and neurobiological theories.

Believing in dopamine

Midbrain dopamine signals are widely thought to report reward prediction errors that drive learning in the basal ganglia. However, dopamine has also been implicated in various probabilistic computations, such as encoding uncertainty and controlling exploration. Here, we show how these different facets of dopamine signalling can be brought together under a common reinforcement learning framework. The key idea is that multiple sources of uncertainty impinge on reinforcement learning computations: uncertainty about the state of the environment, the parameters of the value function and the optimal action policy. Each of these sources plays a distinct role in the prefrontal cortex-basal ganglia circuit for reinforcement learning and is ultimately reflected in dopamine activity. The view that dopamine plays a central role in the encoding and updating of beliefs brings the classical prediction error theory into alignment with more recent theories of Bayesian reinforcement learning.

Time perception deficits and its dose-dependent effect in methamphetamine dependents with short-term abstinence

Intake of addictive substances acutely modifies dopaminergic transmission in the striatum and prefrontal cortex, which is the neural substrate underlying time processing. However, the persistent effects of methamphetamine (meth) abuse (e.g., during abstinence) on temporal processing have not been fully elucidated. Here, we recruited different samples in two experiments. We first compared the potential differences in motor timing between healthy controls and meth dependents with varied length of abstinence and then examined the ability of perceptual timing between the healthy subjects and the meth group at short abstinence. We found that motor timing, but not perceptual timing, was altered in meth dependents, which persisted for at least 3 months of abstinence. Dose-dependent effects on time perception were only observed when short-term abstinent meth abusers processed long time intervals. We conclude that time perception alteration in meth dependents is task specific and dose dependent.

Integrating Models of Interval Timing and Reinforcement Learning

We present an integrated view of interval timing and reinforcement learning (RL) in the brain. The computational goal of RL is to maximize future rewards, and this depends crucially on a representation of time. Different RL systems in the brain process time in distinct ways. A model-based system learns 'what happens when', employing this internal model to generate action plans, while a model-free system learns to predict reward directly from a set of temporal basis functions. We describe how these systems are subserved by a computational division of labor between several brain regions, with a focus on the basal ganglia and the hippocampus, as well as how these regions are influenced by the neuromodulator dopamine.

Contributions of the basal ganglia to action sequence learning and performance

Animals engage in intricately woven and choreographed action sequences that are constructed from trial-and-error learning. The mechanisms by which the brain links together individual actions which are later recalled as fluid chains of behavior are not fully understood, but there is broad consensus that the basal ganglia play a crucial role in this process. This paper presents a comprehensive review of the role of the basal ganglia in action sequencing, with a focus on whether the computational framework of reinforcement learning can capture key behavioral features of sequencing and the neural mechanisms that underlie them. While a simple neurocomputational model of reinforcement learning can capture key features of action sequence learning, this model is not sufficient to capture goal-directed control of sequences or their hierarchical representation. The hierarchical structure of action sequences, in particular, poses a challenge for building better models of action sequencing, and it is in this regard that further investigations into basal ganglia information processing may be informative.

Sensory representations in the striatum provide a temporal reference for learning and executing motor habits

Previous studies indicate that the dorsolateral striatum (DLS) integrates sensorimotor information from cortical and thalamic regions to learn and execute motor habits. However, the exact contribution of sensory representations to this process is still unknown. Here we explore the role of the forelimb somatosensory flow in the DLS during the learning and execution of motor habits. First, we compare rhythmic somesthetic representations in the DLS and primary somatosensory cortex in anesthetized rats, and find that sequential and temporal stimuli contents are more strongly represented in the DLS. Then, using a behavioral protocol in which rats developed a stereotyped motor sequence, functional disconnection experiments, and pharmacologic and optogenetic manipulations in apprentice and expert animals, we reveal that somatosensory thalamic- and cortical-striatal pathways are indispensable for the temporal component of execution. Our results indicate that the somatosensory flow in the DLS provides the temporal reference for the development and execution of motor habits.

The authors combine anatomical mapping, electrophysiological recordings, lesions, and pharmacological and optogenetic manipulations in rats to examine the role of forelimb somatosensory flow in the dorsolateral striatum in the learning and execution of motor habits.

Cerebellar D1DR-expressing neurons modulate the frontal cortex during timing tasks

Converging lines of evidence suggest that the cerebellum plays an integral role in cognitive function through its interactions with association cortices like the medial frontal cortex (MFC). It is unknown precisely how the cerebellum influences the frontal cortex and what type of information is reciprocally relayed between these two regions. A subset of neurons in the cerebellar dentate nuclei, or the homologous lateral cerebellar nuclei (LCN) in rodents, express D1 dopamine receptors (D1DRs) and may play a role in cognitive processes. We investigated how pharmacologically blocking LCN D1DRs influences performance in an interval timing task and impacts neuronal activity in the frontal cortex. Interval timing requires executive processes such as working memory, attention, and planning and is known to rely on both the frontal cortex and cerebellum. In our interval timing task, male rats indicated their estimates of the passage of a period of several seconds by making lever presses for a water reward. We have shown that a cue-evoked burst of low-frequency activity in the MFC initiates ramping activity (i.e., monotonic increases or decreases of firing rate over time) in single MFC neurons. These patterns of activity are associated with successful interval timing performance. Here we explored how blocking right LCN D1DRs with the D1DR antagonist SCH23390 influences timing performance and neural activity in the contralateral (left) MFC. Our results indicate that blocking LCN D1DRs impaired some measures of interval timing performance. Additionally, ramping activity of MFC single units was significantly attenuated. These data provide insight into how catecholamines in the LCN may drive MFC neuronal dynamics to influence cognitive function.

The Neural Basis of Timing: Distributed Mechanisms for Diverse Functions

Timing is critical to most forms of learning, behavior, and sensory-motor processing. Converging evidence supports the notion that, precisely because of its importance across a wide range of brain functions, timing relies on intrinsic and general properties of neurons and neural circuits; that is, the brain uses its natural cellular and network dynamics to solve a diversity of temporal computations. Many circuits have been shown to encode elapsed time in dynamically changing patterns of neural activity-so-called population clocks. But temporal processing encompasses a wide range of different computations, and just as there are different circuits and mechanisms underlying computations about space, there are a multitude of circuits and mechanisms underlying the ability to tell time and generate temporal patterns.

Probabilistic associative learning suffices for learning the temporal structure of multiple sequences

From memorizing a musical tune to navigating a well known route, many of our underlying behaviors have a strong temporal component. While the mechanisms behind the sequential nature of the underlying brain activity are likely multifarious and multi-scale, in this work we attempt to characterize to what degree some of this properties can be explained as a consequence of simple associative learning. To this end, we employ a parsimonious firing-rate attractor network equipped with the Hebbian-like Bayesian Confidence Propagating Neural Network (BCPNN) learning rule relying on synaptic traces with asymmetric temporal characteristics. The proposed network model is able to encode and reproduce temporal aspects of the input, and offers internal control of the recall dynamics by gain modulation. We provide an analytical characterisation of the relationship between the structure of the weight matrix, the dynamical network parameters and the temporal aspects of sequence recall. We also present a computational study of the performance of the system under the effects of noise for an extensive region of the parameter space. Finally, we show how the inclusion of modularity in our network structure facilitates the learning and recall of multiple overlapping sequences even in a noisy regime.

A Mechanism of Synaptic Clock Underlying Subjective Time Perception

Temporal resolution of visual information processing is thought to be an important factor in predator-prey interactions, shaped in the course of evolution by animals' particular ecology. Here I show that light can be considered to have a dual role of a source of information, which guides motor actions, and an environmental feedback for those actions. I consequently show how temporal perception might depend on feedback-based behavioral adaptations realized in the nervous system through activity-dependent synaptic plasticity. I propose an underlying mechanism of synaptic clock, with every synapse having its characteristic time unit, determined by the persistence of memory traces of synaptic inputs, which is used by the synapse to tell time, and postulate the existence of a specific brain-wide distribution of synaptic clocks with different time units. The present theory offers a simple, testable link between the fields of neurobiology of memory, time perception and ecology, which may account for numerous experimental findings, including the interspecies variation in the temporal resolution and the properties of subjective time perception in humans, specifically the variable speed of perceived time passage, depending on emotional or attentional states or tasks performed.

Core body temperature speeds up temporal processing and choice behavior under deadlines

Evidence suggests that human timing ability is compromised by heat. In particular, some studies suggest that increasing body temperature speeds up an internal clock, resulting in faster time perception. However, the consequences of this speed-up for other cognitive processes remain unknown. In the current study, we rigorously tested the speed-up hypothesis by inducing passive hyperthermia through immersion of participants in warm water. In addition, we tested how a change in time perception affects performance in decision making under deadline stress. We found that participants underestimate a prelearned temporal interval when body temperature increases, and that their performance in a two-alternative forced-choice task displays signatures of increased time pressure. These results show not only that timing plays an important role in decision-making, but also that this relationship is mediated by temperature. The consequences for decision-making in job environments that are demanding due to changes in body temperature may be considerable.

Modulation of Beta Oscillations for Implicit Motor Timing in Primate Sensorimotor Cortex during Movement Preparation

Motor timing is an important part of sensorimotor control. Previous studies have shown that beta oscillations embody the process of temporal perception in explicit timing tasks. In contrast, studies focusing on beta oscillations in implicit timing tasks are lacking. In this study, we set up an implicit motor timing task and found a modulation pattern of beta oscillations with temporal perception during movement preparation. We trained two macaques in a repetitive visually-guided reach-to-grasp task with different holding intervals. Spikes and local field potentials were recorded from microelectrode arrays in the primary motor cortex, primary somatosensory cortex, and posterior parietal cortex. We analyzed the association between beta oscillations and temporal interval in fixed-duration experiments (500 ms as the Short Group and 1500 ms as the Long Group) and random-duration experiments (500 ms to 1500 ms). The results showed that the peak beta frequencies in both experiments ranged from 15 Hz to 25 Hz. The beta power was higher during the hold period than the movement (reach and grasp) period. Further, in the fixed-duration experiments, the mean power as well as the maximum rate of change of beta power in the first 300 ms were higher in the Short Group than in the Long Group when aligned with the Center Hit event. In contrast, in the random-duration experiments, the corresponding values showed no statistical differences among groups. The peak latency of beta power was shorter in the Short Group than in the Long Group in the fixed-duration experiments, while no consistent modulation pattern was found in the random-duration experiments. These results indicate that beta oscillations can modulate with temporal interval in their power mode. The synchronization period of beta power could reflect the cognitive set maintaining working memory of the temporal structure and attention.

The amplitude in periodic neural state trajectories underlies the tempo of rhythmic tapping

Our motor commands can be exquisitely timed according to the demands of the environment, and the ability to generate rhythms of different tempos is a hallmark of musical cognition. Yet, the neuronal underpinnings behind rhythmic tapping remain elusive. Here, we found that the activity of hundreds of primate medial premotor cortices (MPCs; pre-supplementary motor area [preSMA] and supplementary motor area [SMA]) neurons show a strong periodic pattern that becomes evident when their responses are projected into a state space using dimensionality reduction analysis. We show that different tapping tempos are encoded by circular trajectories that travelled at a constant speed but with different radii, and that this neuronal code is highly resilient to the number of participating neurons. Crucially, the changes in the amplitude of the oscillatory dynamics in neuronal state space are a signature of duration encoding during rhythmic timing, regardless of whether it is guided by an external metronome or is internally controlled and is not the result of repetitive motor commands. This dynamic state signal predicted the duration of the rhythmically produced intervals on a trial-by-trial basis. Furthermore, the increase in variability of the neural trajectories accounted for the scalar property, a hallmark feature of temporal processing across tasks and species. Finally, we found that the interval-dependent increments in the radius of periodic neural trajectories are the result of a larger number of neurons engaged in the production of longer intervals. Our results support the notion that rhythmic timing during tapping behaviors is encoded in the radial curvature of periodic MPC neural population trajectories.

Why Do Durations in Musical Rhythms Conform to Small Integer Ratios?

One curious aspect of human timing is the organization of rhythmic patterns in small integer ratios. Behavioral and neural research has shown that adjacent time intervals in rhythms tend to be perceived and reproduced as approximate fractions of small numbers (e.g., 3/2). Recent work on iterated learning and reproduction further supports this: given a randomly timed drum pattern to reproduce, participants subconsciously transform it toward small integer ratios. The mechanisms accounting for this “attractor” phenomenon are little understood, but might be explained by combining two theoretical frameworks from psychophysics. The scalar expectancy theory describes time interval perception and reproduction in terms of Weber's law: just detectable durational differences equal a constant fraction of the reference duration. The notion of categorical perception emphasizes the tendency to perceive time intervals in categories, i.e., “short” vs. “long.” In this piece, we put forward the hypothesis that the integer-ratio bias in rhythm perception and production might arise from the interaction of the scalar property of timing with the categorical perception of time intervals, and that neurally it can plausibly be related to oscillatory activity. We support our integrative approach with mathematical derivations to formalize assumptions and provide testable predictions. We present equations to calculate durational ratios by: (i) parameterizing the relationship between durational categories, (ii) assuming a scalar timing constant, and (iii) specifying one (of K) category of ratios. Our derivations provide the basis for future computational, behavioral, and neurophysiological work to test our model.

Intertwined Facets of Subjective Time

For decades, researchers in the behavioral sciences have studied how humans judge time accurately. Now they are looking more closely at the conditions in which they fail to do so and why, with the aim of testing the limits of a potential internal timing system (i.e., an internal clock). Recent behavioral studies have thus focused on time distortions, in particular those caused by emotion. They have also begun to examine the awareness of the passage of time and its relation with the perception of durations in different temporal ranges, from a few seconds to several minutes.

Temporal Processing in Audition: Insights from Music

Music is a curious example of a temporally patterned acoustic stimulus, and a compelling pan-cultural phenomenon. This review strives to bring some insights from decades of music psychology and sensorimotor synchronization (SMS) literature into the mainstream auditory domain, arguing that musical rhythm perception is shaped in important ways by temporal processing mechanisms in the brain. The feature that unites these disparate disciplines is an appreciation of the central importance of timing, sequencing, and anticipation. Perception of musical rhythms relies on an ability to form temporal predictions, a general feature of temporal processing that is equally relevant to auditory scene analysis, pattern detection, and speech perception. By bringing together findings from the music and auditory literature, we hope to inspire researchers to look beyond the conventions of their respective fields and consider the cross-disciplinary implications of studying auditory temporal sequence processing. We begin by highlighting music as an interesting sound stimulus that may provide clues to how temporal patterning in sound drives perception. Next, we review the SMS literature and discuss possible neural substrates for the perception of, and synchronization to, musical beat. We then move away from music to explore the perceptual effects of rhythmic timing in pattern detection, auditory scene analysis, and speech perception. Finally, we review the neurophysiology of general timing processes that may underlie aspects of the perception of rhythmic patterns. We conclude with a brief summary and outlook for future research.

A Dynamical Systems Perspective on Flexible Motor Timing

A hallmark of higher brain function is the ability to rapidly and flexibly adjust behavioral responses based on internal and external cues. Here, we examine the computational principles that allow decisions and actions to unfold flexibly in time. We adopt a dynamical systems perspective and outline how temporal flexibility in such a system can be achieved through manipulations of inputs and initial conditions. We then review evidence from experiments in nonhuman primates that support this interpretation. Finally, we explore the broader utility and limitations of the dynamical systems perspective as a general framework for addressing open questions related to the temporal control of movements, as well as in the domains of learning and sequence generation.

Short-Term Synaptic Plasticity as a Mechanism for Sensory Timing

The ability to detect time intervals and temporal patterns is critical to some of the most fundamental computations the brain performs, including the ability to communicate and appraise a dynamically changing environment. Many of these computations take place on the scale of tens to hundreds of milliseconds. Electrophysiological evidence shows that some neurons respond selectively to duration, interval, rate, or order. Because the time constants of many time-varying neural and synaptic properties, including short-term synaptic plasticity (STP), are also in the range of tens to hundreds of milliseconds, they are strong candidates to underlie the formation of temporally selective neurons. Neurophysiological studies indicate that STP is indeed one of the mechanisms that contributes to temporal selectivity, and computational models demonstrate that neurons embedded in local microcircuits exhibit temporal selectivity if their synapses undergo STP. Converging evidence suggests that some forms of temporal selectivity emerge from the dynamic changes in the balance of excitation and inhibition imposed by STP.

Distinct Dynamics of Striatal and Prefrontal Neural Activity During Temporal Discrimination

The frontal cortex-basal ganglia circuit plays an important role in interval timing. We examined neuronal discharges in the dorsomedial and dorsolateral striatum (DMS and DLS) in rats performing a temporal categorization task and compared them with previously recorded neuronal activity in the medial prefrontal cortex (mPFC). All three structures conveyed significant temporal information, but striatal neurons seldom showed the prolonged, full-interval spanning ramping activity frequently observed in the mPFC. Instead, the majority fired briefly during sample intervals. Also, the precision of neural time decoding became progressively worse with increasing time duration in the mPFC, but not in the striatum. With the caveat that mPFC and striatal units were recorded from different animals, our results suggest that the striatum and mPFC convey temporal information via distinct neural processes.

Basolateral amygdala inactivation eliminates fear-induced underestimation of time in a temporal bisection task

We examined interval timing - time perception in the seconds-to-minutes range - of the fear-inducing stimulus and the role of the amygdala in this phenomenon. Rats were initially trained to perform a temporal bisection task, in which their responses to levers A and B were reinforced following 2-s and 8-s tones, respectively. After acquisition, the rats were also presented with tones of intermediate durations and pressed one of the two levers to indicate whether the tone duration was closer to 2 or 8 s. Subsequently, the rats underwent differential fear conditioning, in which one frequency tone (conditioned stimulus; CS+) was paired with an electric foot shock, whereas another frequency tone (CS-) was presented alone. The rats were then infused with artificial cerebrospinal fluid (aCSF) or the GABA_A agonist muscimol into the bilateral basolateral amygdala (BLA) before performing the bisection task with CS+ and CS-. In rats infused with aCSF, the psychophysical function shifted rightward in CS+ relative to that in CS-. Moreover, the point of subjective equality of the CS+ was higher than that of CS-, suggesting that the duration of the fear -CS was perceived as shorter than that of the neutral CS. However, muscimol infusion into the BLA abolished this difference, suggesting that BLA inactivation suppresses the effect of the fear -CS. Our results demonstrate that normal BLA activity is essential for fear-induced underestimation of time.

Insular cortex inactivation generalizes fear-induced underestimation of interval timing in a temporal bisection task

In this study, we investigated: (1) the effect of fear on interval timing-time perception in the seconds-to-minutes range-and (2) the role of the insular cortex in the modulation of this effect. Rats were first trained on a temporal bisection task in which their response to a lever A was reinforced following a 2.00-s tone, whereas their response to a lever B was reinforced following an 8.00-s tone. After acquisition, the rats were also presented with intermediate-duration tones and pressed one of two levers to indicate whether tone duration was closer to 2.00 or 8.00s. Subsequently, the rats underwent differential fear conditioning in which one pitch tone (conditioned stimulus; CS+) was paired with an electric foot shock, while the other pitch tone (CS-) was presented alone. Either artificial cerebrospinal fluid (aCSF) or the GABA_A agonist muscimol was then infused into the rats' bilateral insular cortex before the animals were tested on the bisection task using the CS+and CS- tones. We found that in the rats infused with aCSF, the point of subjective equality (PSE) of the CS+ was higher than that for CS-, suggesting that the duration for CS+ was perceived to be shorter than that of CS-. However, muscimol eliminated the difference in PSE between CS+ and CS- by generalizing of the effect from CS+to the CS-. Taken together, our results show that normal activity in the insular cortex is involved in fear-induced modulation of interval timing.

Methods matter: A primer on permanent and reversible interference techniques in animals for investigators of human neuropsychology

The study of patients with brain lesions has contributed greatly to our understanding of the biological bases of human cognition, but this approach also has several unavoidable limitations. Research that uses animal models complements and extends human neuropsychology by addressing many of these limitations. In this review, we provide an overview of permanent and reversible animal lesion techniques for researchers of human neuropsychology, with the aim of highlighting how these methods provide a valuable adjunct to behavioural, neuroimaging, physiological, and clinical investigations in humans. Research in animals has provided important lessons about how the limitations of one or more techniques, or differences in their mechanism of action, has impacted upon the understanding of brain organisation and function. These cautionary tales highlight the importance of striving for a thorough understanding of how any intereference technique works (whether in animal or human), and for how to best use animal research to clarify the precise mechanisms underlying temporary lesion methods in humans.

Striatal action-value neurons reconsidered

It is generally believed that during economic decisions, striatal neurons represent the values associated with different actions. This hypothesis is based on studies, in which the activity of striatal neurons was measured while the subject was learning to prefer the more rewarding action. Here we show that these publications are subject to at least one of two critical confounds. First, we show that even weak temporal correlations in the neuronal data may result in an erroneous identification of action-value representations. Second, we show that experiments and analyses designed to dissociate action-value representation from the representation of other decision variables cannot do so. We suggest solutions to identifying action-value representation that are not subject to these confounds. Applying one solution to previously identified action-value neurons in the basal ganglia we fail to detect action-value representations. We conclude that the claim that striatal neurons encode action-values must await new experiments and analyses.