The neural bases for timing of durations

Multi-timescale reinforcement learning in the brain

To thrive in complex environments, animals and artificial agents must learn to act adaptively to maximize fitness and rewards. Such adaptive behaviour can be learned through reinforcement learning1, a class of algorithms that has been successful at training artificial agents2-5 and at characterizing the firing of dopaminergic neurons in the midbrain6-8. In classical reinforcement learning, agents discount future rewards exponentially according to a single timescale, known as the discount factor. Here we explore the presence of multiple timescales in biological reinforcement learning. We first show that reinforcement agents learning at a multitude of timescales possess distinct computational benefits. Next, we report that dopaminergic neurons in mice performing two behavioural tasks encode reward prediction error with a diversity of discount time constants. Our model explains the heterogeneity of temporal discounting in both cue-evoked transient responses and slower timescale fluctuations known as dopamine ramps. Crucially, the measured discount factor of individual neurons is correlated across the two tasks, suggesting that it is a cell-specific property. Together, our results provide a new paradigm for understanding functional heterogeneity in dopaminergic neurons and a mechanistic basis for the empirical observation that humans and animals use non-exponential discounts in many situations9-12, and open new avenues for the design of more-efficient reinforcement learning algorithms.

Altering subjective time perception leads to correlated changes in neural activity and delay discounting

Several accounts of delay discounting suggest that subjective time perception contributes to individually varying discount rates. That is, one may seem impatient if their subjective perception of delay is longer than others' perception of it. Here we build upon the behavioral and neural research on time perception, and we investigate the effects of manipulating an individual's subjective time perception on their discount rates and neural activity. Using a novel time-counting task, we found that participants' discount rates are affected by our manipulation of time perception and that neural activity also correlates with our manipulation in brain regions, such as the anterior insula and the superior temporal gyri, which have been implicated in time perception. We link these behavioral and neural findings together by showing that the degree of neural activity change in response to our manipulation is predictive of the degree of change in the participants' discount rates.

Medium Spiny Neurons Mediate Timing Perception in Coordination with Prefrontal Neurons in Primates

Timing perception is a fundamental cognitive function that allows organisms to navigate their environment effectively, encompassing both prospective and retrospective timing. Despite significant advancements in understanding how the brain processes temporal information, the neural mechanisms underlying these two forms of timing remain largely unexplored. In this study, it aims to bridge this knowledge gap by elucidating the functional roles of various neuronal populations in the striatum and prefrontal cortex (PFC) in shaping subjective experiences of time. Utilizing a large-scale electrode array, it recorded responses from over 3000 neurons in the striatum and PFC of macaque monkeys during timing tasks. The analysis classified neurons into distinct groups and revealed that retrospective and prospective timings are governed by separate neural processes. Specifically, this study demonstrates that medium spiny neurons (MSNs) in the striatum play a crucial role in facilitating these timing processes. Through cell-type-specific manipulation, it identified D2-MSNs as the primary contributors to both forms of timing. Additionally, the findings indicate that effective processing of timing requires coordination between the PFC and the striatum. In summary, this study advances the understanding of the neural foundations of timing perception and highlights its behavioral implications.

Area-specific encoding of temporal information in the neocortex

Episodic memory requires remembering the temporal sequence of events, a process attributed to hippocampal "time cells." However, the distributed nature of brain areas supporting episodic memory suggests that temporal representations may extend beyond the hippocampus. To investigate this possibility, we trained mice to remember the identity of an odor for a specific duration. Using mesoscale two-photon imaging of neuronal activity across the neocortex, we reveal a striking area-specific temporal representation. The retrosplenial cortex (RSC), a hippocampal target area, exhibits time-dependent sequential neuronal firing that encodes both odor identity and elapsed time, with decreasing accuracy over time. By contrast, temporal coding is far less prominent in areas surrounding the RSC, including the posterior parietal cortex and visual, somatosensory, and motor areas, highlighting functional specialization. Our results establish the RSC as a key temporal processing hub for episodic memory, supporting conjunctive "what" and "when" coding models.

Neural signatures of temporal anticipation in human cortex represent event probability density

Temporal prediction is a fundamental function of neural systems. Recent results show that humans anticipate future events by calculating probability density functions, rather than hazard rates. However, direct neural evidence for this hypothesized mechanism is lacking. We recorded neural activity using magnetoencephalography as participants anticipated auditory and visual events distributed in time. We show that temporal anticipation, measured as reaction times, approximates the event probability density function, but not hazard rate. Temporal anticipation manifests as spatiotemporally patterned activity in three anatomically and functionally distinct parieto-temporal and sensorimotor cortical areas. Each of these areas revealed a marked neural signature of anticipation: Prior to sensory cues, activity in a specific frequency range of neural oscillations, spanning alpha and beta ranges, encodes the event probability density function. These neural signals predicted reaction times to imminent sensory cues. These results demonstrate that supra-modal representations of probability density across cortex underlie the anticipation of future events.

Common Neocortical and Hippocampal Correlates of Performance Errors in a Timing Task

We aimed to identify the neuronal correlates of performance errors in a difficult timing task. Male rats were trained to seek rewards and avoid shocks depending on the position of photic conditioned stimuli (CS-R and CS-S, respectively). Then, they were exposed to conflict trials where they had to time the interval between the CS-R and CS-S to obtain rewards while avoiding footshocks. There were pronounced individual differences in behavioral strategies on conflict trials. When presented with a CS-S, some rats quickly left the shock sector, forsaking the option of earning a reward, and rarely got shocked. Others earned rewards by delaying avoidance based on the interval between the CS-R and CS-S but were shocked more often. The probability rats would fail a given trial was not stable across trials as rats engaged in incorrect trial runs that were longer than expected by chance. Since this finding suggested that rats shift between two quasi-stable processing modes, we next examined the neuronal correlates of errors. Incorrect trials coincided with reduced firing rates in CA1 and sensory cortical neurons. Moreover, trial-to-trial variations in the firing rates of simultaneously recorded neurons were more strongly correlated on error than correct trials. Last, the power of low-frequency local field potential oscillations was higher during incorrect trials. The finding that the neuronal correlates of correct and error trials are similar in the hippocampus and neocortex lead us to hypothesize that they depend on changes in the activity of common afferents, such as neuromodulatory inputs.

Stable sequential dynamics in prefrontal cortex represents subjective estimation of time

Time estimation is an essential prerequisite underlying various cognitive functions. Previous studies identified 'sequential firing' and 'activity ramps' as the primary neuron activity patterns in the medial frontal cortex (mPFC) that could convey information regarding time. However, the relationship between these patterns and the timing behavior has not been fully understood. In this study, we utilized in vivo calcium imaging of mPFC in rats performing a timing task. We observed cells that showed selective activation at trial start, end, or during the timing interval. By aligning long-term time-lapse datasets, we discovered that sequential patterns of time coding were stable over weeks, while cells coding for trial start or end showed constant dynamism. Furthermore, with a novel behavior design that allowed the animal to determine individual trial interval, we were able to demonstrate that real-time adjustment in the sequence procession speed closely tracked the trial-to-trial interval variations. And errors in the rats' timing behavior can be primarily attributed to the premature ending of the time sequence. Together, our data suggest that sequential activity maybe a stable neural substrate that represents time under physiological conditions. Furthermore, our results imply the existence of a unique cell type in the mPFC that participates in the time-related sequences. Future characterization of this cell type could provide important insights in the neural mechanism of timing and related cognitive functions.

Multiplexing of temporal and spatial information in the lateral entorhinal cortex

Episodic memory involves the processing of spatial and temporal aspects of personal experiences. The lateral entorhinal cortex (LEC) plays an essential role in subserving memory. However, the mechanisms by which LEC integrates spatial and temporal information remain elusive. Here, we recorded LEC neurons while male rats performed one-dimensional tasks. Many LEC cells displayed spatial firing fields and demonstrated selectivity for traveling directions. Furthermore, some LEC neurons changed the firing rates of their spatial rate maps during a session (rate remapping). Importantly, this temporal modulation was consistent across sessions, even when the spatial environment was altered. Notably, the strength of temporal modulation was greater in LEC compared to other brain regions, such as the medial entorhinal cortex, CA1, and CA3. Thus, we demonstrate spatial rate mapping in LEC neurons, which may serve as a coding mechanism for temporal context, and allow for flexible multiplexing of spatial and temporal information.

Dissociation between area TE and rhinal cortex in accuracy vs. speed of visual categorization in rhesus monkeys

In real-world vision, objects may appear for a short period, such as in conjunction with visual search. Presumably, this puts a premium on rapid categorization. We designed a visual categorization task cued by briefly presented images to study how visual categorization is processed in an ethologically relevant context. We compared the performance of monkeys with bilateral area TE lesions, and those with bilateral rhinal cortex lesions, to control animals. TE lesions impaired the accuracy but not the speed of visual categorization. In contrast, rhinal cortex lesions did not affect the accuracy but reduced the speed of visual categorization. A generalized drift-diffusion model (GDDM) with collapsing bounds was fitted to the data. The drift rate was equivalent across all groups, but the decision bounds collapsed more slowly in the rhinal group than in the other two groups. This suggests that, although evidence is accumulated at the same rate in all groups, the rhinal lesion results in slower decision-making.

Common neural mechanisms supporting time judgements in humans and monkeys

There has been an increasing interest in identifying the biological underpinnings of human time perception, for which purpose research in non-human primates (NHP) is common. Although previous work, based on behaviour, suggests that similar mechanisms support time perception across species, the neural correlates of time estimation in humans and NHP have not been directly compared. In this study, we assess whether brain evoked responses during a time categorization task are similar across species. Specifically, we assess putative differences in post-interval evoked potentials as a function of perceived duration in human EEG (N = 24) and local field potential (LFP) and spike recordings in pre-supplementary motor area (pre-SMA) of one monkey. Event-related potentials (ERPs) differed significantly after the presentation of the temporal interval between "short" and "long" perceived durations in both species, even when the objective duration of the stimuli was the same. Interestingly, the polarity of the reported ERPs was reversed for incorrect trials (i.e., the ERP of a "long" stimulus looked like the ERP of a "short" stimulus when a time categorization error was made). Hence, our results show that post-interval potentials reflect the perceived (rather than the objective) duration of the presented time interval in both NHP and humans. In addition, firing rates in monkey's pre-SMA also differed significantly between short and long perceived durations and were reversed in incorrect trials. Together, our results show that common neural mechanisms support time categorization in NHP and humans, thereby suggesting that NHP are a good model for investigating human time perception.

Learned response dynamics reflect stimulus timing and encode temporal expectation violations in superficial layers of mouse V1

The ability to recognize ordered event sequences is a fundamental component of sensory cognition and underlies the capacity to generate temporally specific expectations of future events based on previous experience. Various lines of evidence suggest that the primary visual cortex participates in some form of predictive processing, though many details remain ambiguous. Here we use two-photon calcium imaging in layer 2/3 (L2/3) of the mouse primary visual cortex (V1) to study changes in neural activity under a multi-day sequence learning paradigm with respect to prediction error responses, stimulus encoding, and time. We find increased neural activity at the time an expected, but omitted, stimulus would have occurred but no significant prediction error responses following an unexpected stimulus substitution. Sequence representations became sparser and less correlated with training, although these changes had no effect on decoding accuracy of stimulus identity or timing. Additionally, we find that experience modifies the temporal structure of stimulus responses to produce a bias towards predictive stimulus-locked activity. Finally, we observe significant temporal structure during intersequence rest periods that was largely unchanged by training.

Perturbation context in paced finger tapping tunes the error-correction mechanism

Sensorimotor synchronization (SMS) is the mainly specifically human ability to move in sync with a periodic external stimulus, as in keeping pace with music. The most common experimental paradigm to study its largely unknown underlying mechanism is the paced finger-tapping task, where a participant taps to a periodic sequence of brief stimuli. Contrary to reaction time, this task involves temporal prediction because the participant needs to trigger the motor action in advance for the tap and the stimulus to occur simultaneously, then an error-correction mechanism takes past performance as input to adjust the following prediction. In a different, simpler task, it has been shown that exposure to a distribution of individual temporal intervals creates a "temporal context" that can bias the estimation/production of a single target interval. As temporal estimation and production are also involved in SMS, we asked whether a paced finger-tapping task with period perturbations would show any time-related context effect. In this work we show that a perturbation context can indeed be generated by exposure to period perturbations during paced finger tapping, affecting the shape and size of the resynchronization curve. Response asymmetry is also affected, thus evidencing an interplay between context and intrinsic nonlinearities of the correction mechanism. We conclude that perturbation context calibrates the underlying error-correction mechanism in SMS.

Interoceptive and Bodily Processing in Prospective and Retrospective Timing

This chapter reviews some directions along which Craig's proposal of subjective time as emergent from interoceptive and bodily dynamics allows to frame recent findings on prospective and retrospective time processing. Behavioral and neuroimaging evidence from prospective timing studies demonstrates that an interoceptive-insular system may support the development of a primary representation of time in the context of large-scale networks involved in duration processing. Studies showing a tight link between episodic memory and interoceptive, emotional, and sensorimotor states further provide insights on processes supporting retrospective timing. These lines of evidence show that acknowledging its dependence on bodily states is most likely a crucial step toward a mechanistic understanding of time perception.

Event as the central construal of psychological time in humans

Time is a fundamental dimension of our perception and mental construction of reality. It enables resolving changes in our environment without a direct sensory representation of elapsed time. Therefore, the concept of time is inferential by nature, but the units of subjective time that provide meaningful segmentation of the influx of sensory input remain to be determined. In this review, we posit that events are the construal instances of time perception as they provide a reproducible and consistent segmentation of the content. In that light, we discuss the implications of this proposal by looking at "events" and their role in subjective time experience from cultural anthropological and ontogenetic perspectives, as well as their relevance for episodic memory. Furthermore, we discuss the significance of "events" for the two critical aspects of subjective time-duration and order. Because segmentation involves parsing event streams according to causal sequences, we also consider the role of causality in developing the concept of directionality of mental timelines. We offer a fresh perspective on representing past and future events before age 5 by an egocentric bi-directional timeline model before acquiring the allocentric concept of absolute time. Finally, we illustrate how the relationship between events and durations can resolve contradictory experimental results. Although "time" warrants a comprehensive interdisciplinary approach, we focus this review on "time perception", the experience of time, without attempting to provide an all encompassing overview of the rich philosophical, physical, psychological, cognitive, linguistic, and neurophysiological context.

Integrator dynamics in the cortico-basal ganglia loop underlie flexible motor timing

Flexible control of motor timing is crucial for behavior. Before volitional movement begins, the frontal cortex and striatum exhibit ramping spiking activity, with variable ramp slopes anticipating movement onsets. This activity in the cortico-basal ganglia loop may function as an adjustable 'timer,' triggering actions at the desired timing. However, because the frontal cortex and striatum share similar ramping dynamics and are both necessary for timing behaviors, distinguishing their individual roles in this timer function remains challenging. To address this, we conducted perturbation experiments combined with multi-regional electrophysiology in mice performing a flexible lick-timing task. Following transient silencing of the frontal cortex, cortical and striatal activity swiftly returned to pre-silencing levels and resumed ramping, leading to a shift in lick timing close to the silencing duration. Conversely, briefly inhibiting the striatum caused a gradual decrease in ramping activity in both regions, with ramping resuming from post-inhibition levels, shifting lick timing beyond the inhibition duration. Thus, inhibiting the frontal cortex and striatum effectively paused and rewound the timer, respectively. These findings suggest the striatum is a part of the network that temporally integrates input from the frontal cortex and generates ramping activity that regulates motor timing.

Common neural mechanisms supporting time judgements in humans and monkeys

There has been an increasing interest in identifying the biological underpinnings of human time perception, for which purpose research in non-human primates (NHP) is common. Although previous work, based on behaviour, suggests that similar mechanisms support time perception across species, the neural correlates of time estimation in humans and NHP have not been directly compared. In this study, we assess whether brain evoked responses during a time categorization task are similar across species. Specifically, we assess putative differences in post-interval evoked potentials as a function of perceived duration in human EEG (N = 24) and local field potential (LFP) and spike recordings in pre-supplementary motor area (pre-SMA) of one monkey. Event-related potentials (ERPs) differed significantly after the presentation of the temporal interval between "short" and "long" perceived durations in both species, even when the objective duration of the stimuli was the same. Interestingly, the polarity of the reported ERPs was reversed for incorrect trials (i.e., the ERP of a "long" stimulus looked like the ERP of a "short" stimulus when a time categorization error was made). Hence, our results show that post-interval potentials reflect the perceived (rather than the objective) duration of the presented time interval in both NHP and humans. In addition, firing rates in monkey's pre-SMA also differed significantly between short and long perceived durations and were reversed in incorrect trials. Together, our results show that common neural mechanisms support time categorization in NHP and humans, thereby suggesting that NHP are a good model for investigating human time perception.

Measuring the perception and metacognition of time

The ability of humans to identify and reproduce short time intervals (in the region of a second) may be affected by many factors ranging from the gender and personality of the individual observer, through the attentional state, to the precise spatiotemporal structure of the stimulus. The relative roles of these very different factors are a challenge to describe and define; several methodological approaches have been used to achieve this to varying degrees of success. Here we describe and model the results of a paradigm affording not only a first-order measurement of the perceived duration of an interval but also a second-order metacognitive judgement of perceived time. This approach, we argue, expands the form of the data generally collected in duration-judgements and allows more detailed comparison of psychophysical behavior to the underlying theory. We also describe a hierarchical Bayesian measurement model that performs a quantitative analysis of the trial-by-trial data calculating the variability of the temporal estimates and the metacognitive judgments allowing direct comparison between an actual and an ideal observer. We fit the model to data collected for judgements of 750 ms (bisecting 1500 ms) and 1500 ms (bisecting 3000 ms) intervals across three stimulus modalities (visual, audio, and audiovisual). This enhanced form of data on a given interval judgement and the ability to track its progression on a trial-by-trial basis offers a way of looking at the different roles that subject-based, task-based and stimulus-based factors have on the perception of time.

Direct contribution of the sensory cortex to the judgment of stimulus duration

Decision making frequently depends on monitoring the duration of sensory events. To determine whether, and how, the perception of elapsed time derives from the neuronal representation of the stimulus itself, we recorded and optogenetically modulated vibrissal somatosensory cortical activity as male rats judged vibration duration. Perceived duration was dilated by optogenetic excitation. A second set of rats judged vibration intensity; here, optogenetic excitation amplified the intensity percept, demonstrating sensory cortex to be the common gateway both to time and to stimulus feature processing. A model beginning with the membrane currents evoked by vibrissal and optogenetic drive and culminating in the representation of perceived time successfully replicated rats' choices. Time perception is thus as deeply intermeshed within the sensory processing pathway as is the sense of touch itself, suggesting that the experience of time may be further investigated with the toolbox of sensory coding.

Multiplexing of temporal and spatial information in the lateral entorhinal cortex

Episodic memory involves the processing of spatial and temporal aspects of personal experiences. The lateral entorhinal cortex (LEC) plays an essential role in subserving memory. However, the specific mechanism by which LEC integrates spatial and temporal information remains elusive. Here, we recorded LEC neurons while rats performed foraging and shuttling behaviors on one-dimensional, linear or circular tracks. Unlike open-field foraging tasks, many LEC cells displayed spatial firing fields in these tasks and demonstrated selectivity for traveling directions. Furthermore, some LEC neurons displayed changes in the firing rates of their spatial rate maps during a session, a phenomenon referred to as rate remapping. Importantly, this temporal modulation was consistent across sessions, even when the spatial environment was altered. Notably, the strength of temporal modulation was found to be greater in LEC compared to other brain regions, such as the medial entorhinal cortex (MEC), CA1, and CA3. Thus, the spatial rate mapping observed in LEC neurons may serve as a coding mechanism for temporal context, allowing for flexible multiplexing of spatial and temporal information.

Distinctive features of experiential time: Duration, speed and event density

William James's use of "time in passing" and "stream of thoughts" may be two sides of the same coin that emerge from the brain segmenting the continuous flow of information into discrete events. Herein, we investigated how the density of events affects two temporal experiences: the felt duration and speed of time. Using a temporal bisection task, participants classified seconds-long videos of naturalistic scenes as short or long (duration), or slow or fast (passage of time). Videos contained a varying number and type of events. We found that a large number of events lengthened subjective duration and accelerated the felt passage of time. Surprisingly, participants were also faster at estimating their felt passage of time compared to duration. The perception of duration scaled with duration and event density, whereas the felt passage of time scaled with the rate of change. Altogether, our results suggest that distinct mechanisms underlie these two experiential times.

Neural mechanisms of sequential dependence in time perception: the impact of prior task and memory processing

Our perception and decision-making are susceptible to prior context. Such sequential dependence has been extensively studied in the visual domain, but less is known about its impact on time perception. Moreover, there are ongoing debates about whether these sequential biases occur at the perceptual stage or during subsequent post-perceptual processing. Using functional magnetic resonance imaging, we investigated neural mechanisms underlying temporal sequential dependence and the role of action in time judgments across trials. Participants performed a timing task where they had to remember the duration of green coherent motion and were cued to either actively reproduce its duration or simply view it passively. We found that sequential biases in time perception were only evident when the preceding task involved active duration reproduction. Merely encoding a prior duration without reproduction failed to induce such biases. Neurally, we observed activation in networks associated with timing, such as striato-thalamo-cortical circuits, and performance monitoring networks, particularly when a "Response" trial was anticipated. Importantly, the hippocampus showed sensitivity to these sequential biases, and its activation negatively correlated with the individual's sequential bias following active reproduction trials. These findings highlight the significant role of memory networks in shaping time-related sequential biases at the post-perceptual stages.

Brain mechanisms of temporal processing in impulsivity: Relevance to attention-deficit hyperactivity disorder

In this article, we critique the hypothesis that different varieties of impulsivity, including impulsiveness present in attention-deficit hyperactivity disorder, encompass an accelerated perception of time. This conceptualisation provides insights into how individuals with attention-deficit hyperactivity disorder have the capacity to maximise cognitive capabilities by more closely aligning themselves with appropriate environmental contexts (e.g. fast paced tasks that prevent boredom). We discuss the evidence for altered time perception in attention-deficit hyperactivity disorder alongside putative underlying neurobiological substrates, including a distributed brain network mediating time perception over multiple timescales. In particular, we explore the importance of temporal representations across the brain for time perception and symptom manifestation in attention-deficit hyperactivity disorder, including a prominent role of the hippocampus and other temporal lobe regions. We also reflect on how abnormalities in the perception of time may be relevant for understanding the aetiology of attention-deficit hyperactivity disorder and mechanism of action of existing medications.

Creating a Home for Timing Researchers: Then, Now, and the Future

Our ability to perceive event duration and order is critical in every aspect of our lives, from everyday tasks like coordinating our limbs to walk safely, to uniquely human activities like planning our children's future. Many theoretical accounts of timing have been proposed to explain the mechanisms underlying our ability to estimate time and unify events in time. Continuous progress is being met in further refining and extending current theories, with the aim not only to advance our understanding of timing and time perception, but also to make timing more accessible and applicable to daily life. For this to be possible, cross-disciplinary thinking is required, which is something one cannot easily attain in a scientific conference, rather it requires a community. Having a community with an interest and/or expertise in timing can allow for cross-fertilization of ideas. This chapter introduced the story of the Timing Research Forum or else TRF.

Diverse Time Encoding Strategies Within the Medial Premotor Areas of the Primate

The measurement of time in the subsecond scale is critical for many sophisticated behaviors, yet its neural underpinnings are largely unknown. Recent neurophysiological experiments from our laboratory have shown that the neural activity in the medial premotor areas (MPC) of macaques can represent different aspects of temporal processing. During single interval categorization, we found that preSMA encodes a subjective category limit by reaching a peak of activity at a time that divides the set of test intervals into short and long. We also observed neural signals associated with the category selected by the subjects and the reward outcomes of the perceptual decision. On the other hand, we have studied the behavioral and neurophysiological basis of rhythmic timing. First, we have shown in different tapping tasks that macaques are able to produce predictively and accurately intervals that are cued by auditory or visual metronomes or when intervals are produced internally without sensory guidance. In addition, we found that the rhythmic timing mechanism in MPC is governed by different layers of neural clocks. Next, the instantaneous activity of single cells shows ramping activity that encodes the elapsed or remaining time for a tapping movement. In addition, we found MPC neurons that build neural sequences, forming dynamic patterns of activation that flexibly cover all the produced interval depending on the tapping tempo. This rhythmic neural clock resets on every interval providing an internal representation of pulse. Furthermore, the MPC cells show mixed selectivity, encoding not only elapsed time, but also the tempo of the tapping and the serial order element in the rhythmic sequence. Hence, MPC can map different task parameters, including the passage of time, using different cell populations. Finally, the projection of the time varying activity of MPC hundreds of cells into a low dimensional state space showed circular neural trajectories whose geometry represented the internal pulse and the tapping tempo. Overall, these findings support the notion that MPC is part of the core timing mechanism for both single interval and rhythmic timing, using neural clocks with different encoding principles, probably to flexibly encode and mix the timing representation with other task parameters.

Core clock gene, Bmal1, is required for optimal second-level interval production

Perception and production of second-level temporal intervals are critical in several behavioral and cognitive processes, including adaptive anticipation, motor control, and social communication. These processes are impaired in several neurological and psychological disorders, such as Parkinson's disease and attention-deficit hyperactivity disorder. Although evidence indicates that second-level interval timing exhibit circadian patterns, it remains unclear whether the core clock machinery controls the circadian pattern of interval timing. To investigate the role of core clock molecules in interval timing capacity, we devised a behavioral assay called the interval timing task to examine prospective motor interval timing ability. In this task, the mouse produces two separate nose pokes in a pretrained second-level interval to obtain a sucrose solution as a reward. We discovered that interval perception in wild-type mice displayed a circadian pattern, with the best performance observed during the late active phase. To investigate whether the core molecular clock is involved in the circadian control of interval timing, we employed Bmal1 knockout mice (BKO) in the interval timing task. The interval production of BKO did not display any difference between early and late active phase, without reaching the optimal interval production level observed in wild-type. In summary, we report that the core clock gene Bmal1 is required for the optimal performance of prospective motor timing typically observed during the late part of the active period.

Multi-timescale reinforcement learning in the brain

To thrive in complex environments, animals and artificial agents must learn to act adaptively to maximize fitness and rewards. Such adaptive behavior can be learned through reinforcement learning1, a class of algorithms that has been successful at training artificial agents2-6 and at characterizing the firing of dopamine neurons in the midbrain7-9. In classical reinforcement learning, agents discount future rewards exponentially according to a single time scale, controlled by the discount factor. Here, we explore the presence of multiple timescales in biological reinforcement learning. We first show that reinforcement agents learning at a multitude of timescales possess distinct computational benefits. Next, we report that dopamine neurons in mice performing two behavioral tasks encode reward prediction error with a diversity of discount time constants. Our model explains the heterogeneity of temporal discounting in both cue-evoked transient responses and slower timescale fluctuations known as dopamine ramps. Crucially, the measured discount factor of individual neurons is correlated across the two tasks suggesting that it is a cell-specific property. Together, our results provide a new paradigm to understand functional heterogeneity in dopamine neurons, a mechanistic basis for the empirical observation that humans and animals use non-exponential discounts in many situations10-14, and open new avenues for the design of more efficient reinforcement learning algorithms.

Time for Memories

The ability to store information about the past to dynamically predict and prepare for the future is among the most fundamental tasks the brain performs. To date, the problems of understanding how the brain stores and organizes information about the past (memory) and how the brain represents and processes temporal information for adaptive behavior have generally been studied as distinct cognitive functions. This Symposium explores the inherent link between memory and temporal cognition, as well as the potential shared neural mechanisms between them. We suggest that working memory and implicit timing are interconnected and may share overlapping neural mechanisms. Additionally, we explore how temporal structure is encoded in associative and episodic memory and, conversely, the influences of episodic memory on subsequent temporal anticipation and the perception of time. We suggest that neural sequences provide a general computational motif that contributes to timing and working memory, as well as the spatiotemporal coding and recall of episodes.

Time processing in neurological and psychiatric conditions

A central question in understanding cognition and pathology-related cognitive changes is how we process time. However, time processing difficulties across several neurological and psychiatric conditions remain seldom investigated. The aim of this review is to develop a unifying taxonomy of time processing, and a neuropsychological perspective on temporal difficulties. Four main temporal judgments are discussed: duration processing, simultaneity and synchrony, passage of time, and mental time travel. We present an integrated theoretical framework of timing difficulties across psychiatric and neurological conditions based on selected patient populations. This framework provides new mechanistic insights on both (a) the processes involved in each temporal judgement, and (b) temporal difficulties across pathologies. By identifying underlying transdiagnostic time-processing mechanisms, this framework opens fruitful avenues for future research.

Spontaneous α Brain Dynamics Track the Episodic "When"

Across species, neurons track time over the course of seconds to minutes, which may feed the sense of time passing. Here, we asked whether neural signatures of time-tracking could be found in humans. Participants stayed quietly awake for a few minutes while being recorded with magnetoencephalography (MEG). They were unaware they would be asked how long the recording lasted (retrospective time) or instructed beforehand to estimate how long it will last (prospective timing). At rest, rhythmic brain activity is nonstationary and displays bursts of activity in the alpha range (α: 7-14 Hz). When participants were not instructed to attend to time, the relative duration of α bursts linearly predicted individuals' retrospective estimates of how long their quiet wakefulness lasted. The relative duration of α bursts was a better predictor than α power or burst amplitude. No other rhythmic or arrhythmic activity predicted retrospective duration. However, when participants timed prospectively, the relative duration of α bursts failed to predict their duration estimates. Consistent with this, the amount of α bursts was discriminant between prospective and retrospective timing. Last, with a control experiment, we demonstrate that the relation between α bursts and retrospective time is preserved even when participants are engaged in a visual counting task. Thus, at the time scale of minutes, we report that the relative time of spontaneous α burstiness predicts conscious retrospective time. We conclude that in the absence of overt attention to time, α bursts embody discrete states of awareness constitutive of episodic timing.SIGNIFICANCE STATEMENT The feeling that time passes is a core component of consciousness and episodic memory. A century ago, brain rhythms called "α" were hypothesized to embody an internal clock. However, rhythmic brain activity is nonstationary and displays on-and-off oscillatory bursts, which would serve irregular ticks to the hypothetical clock. Here, we discovered that in a given lapse of time, the relative bursting time of α rhythms is a good indicator of how much time an individual will report to have elapsed. Remarkably, this relation only holds true when the individual does not attend to time and vanishes when attending to it. Our observations suggest that at the scale of minutes, α brain activity tracks episodic time.

Context-specific and context-invariant computations of interval timing

Introduction

An accurate sense of time is crucial in flexible sensorimotor control and other cognitive functions. However, it remains unknown how multiple timing computations in different contexts interact to shape our behavior.

Methods

We asked 41 healthy human subjects to perform timing tasks that differed in the sensorimotor domain (sensory timing vs. motor timing) and effector (hand vs. saccadic eye movement). To understand how these different behavioral contexts contribute to timing behavior, we applied a three-stage Bayesian model to behavioral data.

Results

Our results demonstrate that the Bayesian model for each effector could not describe bias in the other effector. Similarly, in each task the model-predicted data could not describe bias in the other task. These findings suggest that the measurement stage of interval timing is context-specific in the sensorimotor and effector domains. We also showed that temporal precision is context-invariant in the effector domain, unlike temporal accuracy.

Discussion

This combination of context-specific and context-invariant computations across sensorimotor and effector domains suggests overlapping and distributed computations as the underlying mechanism of timing in different contexts.

Perceived time expands and contracts within each heartbeat

Perception of passing time can be distorted.¹ Emotional experiences, particularly arousal, can contract or expand experienced duration via their interactions with attentional and sensory processing mechanisms.^2,3 Current models suggest that perceived duration can be encoded from accumulation processes^4,5 and from temporally evolving neural dynamics.^6,7 Yet all neural dynamics and information processing ensue at the backdrop of continuous interoceptive signals originating from within the body. Indeed, phasic fluctuations within the cardiac cycle impact neural and information processing.^{8,9,10,11,12,13,14,15} Here, we show that these momentary cardiac fluctuations distort experienced time and that their effect interacts with subjectively experienced arousal. In a temporal bisection task, durations (200-400 ms) of an emotionally neutral visual shape or auditory tone (experiment 1) or of an image displaying happy or fearful facial expressions (experiment 2) were categorized as short or long.¹⁶ Across both experiments, stimulus presentation was time-locked to systole, when the heart contracts and baroreceptors fire signals to the brain, and to diastole, when the heart relaxes, and baroreceptors are quiescent. When participants judged the duration of emotionally neural stimuli (experiment 1), systole led to temporal contraction, whereas diastole led to temporal expansion. Such cardiac-led distortions were further modulated by the arousal ratings of the perceived facial expressions (experiment 2). At low arousal, systole contracted while diastole expanded time, but as arousal increased, this cardiac-led time distortion disappeared, shifting duration perception toward contraction. Thus, experienced time contracts and expands within each heartbeat-a balance that is disrupted under heightened arousal.

Intrinsic hippocampal connectivity is associated with individual differences in retrospective duration processing

The estimation of incidentally encoded durations of time intervals (retrospective duration processing) is thought to rely on the retrieval of contextual information associated with a sequence of events, automatically encoded in medial temporal lobe regions. "Time cells" have been described in the hippocampus (HC), encoding the temporal progression of events and their duration. However, whether the HC supports explicit retrospective duration judgments in humans, and which neural dynamics are involved, is still poorly understood. Here we used resting-state fMRI to test the relation between variations in intrinsic connectivity patterns of the HC, and individual differences in retrospective duration processing, assessed using a novel task involving the presentation of ecological stimuli. Results showed that retrospective duration discrimination performance predicted variations in the intrinsic connectivity of the bilateral HC with the right precentral gyrus; follow-up exploratory analyses suggested a role of the CA1 and CA4/DG subfields in driving the observed pattern. Findings provide insights on neural networks associated with implicit processing of durations in the second range.

Probing the nature of episodic memory in rodents

Episodic memory (EM) specifies the experience of retrieving information of an event at the place and time of occurrence. Whether non-human animals are capable of EM remains debated, whereas evidence suggests that they have a memory system akin to EM. We here trace the development of various behavioral paradigms designed to study EM in non-human animals, in particular the rat. We provide an in-depth description of the available behavioral tests which combine three spontaneous object exploration paradigms, namely novel object preference (for measuring memory for "what"), novel location preference (for measuring memory for "where") and temporal order memory (memory for "when"), into a single trial to gauge a memory akin to EM. Most important, we describe a variation of such a test in which each memory component interacts with the others, demonstrating an integration of diverse mnemonic information. We discuss why a behavioral model of EM must be able to assess the ability to integrate "what", "where" and "when" information into a single experience. We attempt an interpretation of the various tests and review the studies that have applied them in areas such as pharmacology, neuroanatomy, circuit analysis, and sleep. Finally, we anticipate future directions in the search for neural mechanisms of EM in the rat and outline model experiments and methodologies in this pursuit.