Minute-encoding neurons in hippocampal-striatal circuits

Cholinergic interneurons in the dorsal striatum play an important role in the acquisition of duration memory

The present study aimed to examine the effect of cholinergic interneuron lesions in the dorsal striatum on duration-memory formation. Cholinergic interneurons in the dorsal striatum may be involved in the formation of duration memory since they are among the main inputs to the dorsal striatal muscarinic acetylcholine-1 receptors, which play a role in the consolidation of duration memory. Rats were sufficiently trained using a peak-interval 20 s procedure and then infused with anti-choline acetyltransferase-saporin into the dorsal striatum to cause selective ablation of cholinergic interneurons. To make the rats acquire new duration-memories, we trained them with a peak interval 40 s after lesion. Before lesion, the peak times (an index of duration memory) for sham-lesioned and lesioned groups were similar at approximately 20 s. In the peak interval 40 s session, the peak times for the sham-lesioned and lesioned groups were approximately 30 and 20 s, respectively. After additional peak interval 40 s sessions, the peak times of both groups were shifted to approximately 40 s. Those results suggest that the cholinergic interneuron lesion delayed new duration-memory acquisition. Subsequent experiments showed that cholinergic interneuron lesions did not retard the shift of peak time to the original target time (20 s). Following experiment without changing the target time after lesion showed that cholinergic interneuron lesions did not change their peak times. Our findings suggest that cholinergic interneurons in the dorsal striatum are involved in new duration-memory acquisition but not in the utilization of already acquired duration memory and interval timing.

Distinct neural adaptations to time demand in the striatum and the hippocampus

How do neural codes adjust to track time across a range of resolutions, from milliseconds to multi-seconds, as a function of the temporal frequency at which events occur? To address this question, we studied time-modulated cells in the striatum and the hippocampus, while macaques categorized three nested intervals within the sub-second or the supra-second range (up to 1, 2, 4, or 8 s), thereby modifying the temporal resolution needed to solve the task. Time-modulated cells carried more information for intervals with explicit timing demand, than for any other interval. The striatum, particularly the caudate, supported the most accurate temporal prediction throughout all time ranges. Strikingly, its temporal readout adjusted non-linearly to the time range, suggesting that the striatal resolution shifted from a precise millisecond to a coarse multi-second range as a function of demand. This is in line with monkey's behavioral latencies, which indicated that they tracked time until 2 s but employed a coarse categorization strategy for durations beyond. By contrast, the hippocampus discriminated only the beginning from the end of intervals, regardless of the range. We propose that the hippocampus may provide an overall poor signal marking an event's beginning, whereas the striatum optimizes neural resources to process time throughout an interval adapting to the ongoing timing necessity.

Temporal encoding in deep reinforcement learning agents

Neuroscientists have observed both cells in the brain that fire at specific points in time, known as "time cells", and cells whose activity steadily increases or decreases over time, known as "ramping cells". It is speculated that time and ramping cells support temporal computations in the brain and carry mnemonic information. However, due to the limitations in animal experiments, it is difficult to determine how these cells really contribute to behavior. Here, we show that time cells and ramping cells naturally emerge in the recurrent neural networks of deep reinforcement learning models performing simulated interval timing and working memory tasks, which have learned to estimate expected rewards in the future. We show that these cells do indeed carry information about time and items stored in working memory, but they contribute to behavior in large part by providing a dynamic representation on which policy can be computed. Moreover, the information that they do carry depends on both the task demands and the variables provided to the models. Our results suggest that time cells and ramping cells could contribute to temporal and mnemonic calculations, but the way in which they do so may be complex and unintuitive to human observers.

Mesolimbic dopamine release precedes actively sought aversive stimuli in mice

In some models, animals approach aversive stimuli more than those housed in an enriched environment. Here, we found that male mice in an impoverished and unstimulating (i.e., boring) chamber without toys sought aversive air puffs more often than those in an enriched chamber. Using this animal model, we identified the insular cortex as a regulator of aversion-seeking behavior. Activation and inhibition of the insular cortex increased and decreased the frequencies of air-puff self-stimulation, respectively, and the firing patterns of insular neuron ensembles predicted the self-stimulation timing. Dopamine levels in the ventrolateral striatum decreased with passive air puffs but increased with actively sought puffs. Around 20% of mice developed intense self-stimulation despite being offered toys, which was prevented by administering opioid receptor antagonists. This study establishes a basis for comprehending the neural underpinnings of usually avoided stimulus-seeking behaviors.

Enhanced putamen functional connectivity underlies altered risky decision-making in age-related cognitive decline

Risky decision-making is critical to survival and development, which has been compromised in elderly populations. However, the neural substrates of altered financial risk-taking behavior in aging are still under-investigated. Here we examined the intrinsic putamen network in modulating risk-taking behaviors of Balloon Analogue Risk Task in healthy young and older adults using resting-state fMRI. Compared with the young group, the elderly group showed significantly different task performance. Based on the task performance, older adults were further subdivided into two subgroups, showing young-like and over-conservative risk behaviors, regardless of cognitive decline. Compared with young adults, the intrinsic pattern of putamen connectivity was significantly different in over-conservative older adults, but not in young-like older adults. Notably, age-effects on risk behaviors were mediated via the putamen functional connectivity. In addition, the putamen gray matter volume showed significantly different relationships with risk behaviors and functional connectivity in over-conservative older adults. Our findings suggest that reward-based risky behaviors might be a sensitive indicator of brain aging, highlighting the critical role of the putamen network in maintaining optimal risky decision-making in age-related cognitive decline.

Intrinsic hippocampal connectivity is associated with individual differences in retrospective duration processing

The estimation of incidentally encoded durations of time intervals (retrospective duration processing) is thought to rely on the retrieval of contextual information associated with a sequence of events, automatically encoded in medial temporal lobe regions. "Time cells" have been described in the hippocampus (HC), encoding the temporal progression of events and their duration. However, whether the HC supports explicit retrospective duration judgments in humans, and which neural dynamics are involved, is still poorly understood. Here we used resting-state fMRI to test the relation between variations in intrinsic connectivity patterns of the HC, and individual differences in retrospective duration processing, assessed using a novel task involving the presentation of ecological stimuli. Results showed that retrospective duration discrimination performance predicted variations in the intrinsic connectivity of the bilateral HC with the right precentral gyrus; follow-up exploratory analyses suggested a role of the CA1 and CA4/DG subfields in driving the observed pattern. Findings provide insights on neural networks associated with implicit processing of durations in the second range.

Temporal scaling and computing time in neural circuits: Should we stop watching the clock and look for its gears?

Timing underlies a variety of functions, from walking to perceiving causality. Neural timing models typically fall into one of two categories-"ramping" and "population-clock" theories. According to ramping models, individual neurons track time by gradually increasing or decreasing their activity as an event approaches. To time different intervals, ramping neurons adjust their slopes, ramping steeply for short intervals and vice versa. In contrast, according to "population-clock" models, multiple neurons track time as a group, and each neuron can fire nonlinearly. As each neuron changes its rate at each point in time, a distinct pattern of activity emerges across the population. To time different intervals, the brain learns the population patterns that coincide with key events. Both model categories have empirical support. However, they often differ in plausibility when applied to certain behavioral effects. Specifically, behavioral data indicate that the timing system has a rich computational capacity, allowing observers to spontaneously compute novel intervals from previously learned ones. In population-clock theories, population patterns map to time arbitrarily, making it difficult to explain how different patterns can be computationally combined. Ramping models are viewed as more plausible, assuming upstream circuits can set the slope of ramping neurons according to a given computation. Critically, recent studies suggest that neurons with nonlinear firing profiles often scale to time different intervals-compressing for shorter intervals and stretching for longer ones. This "temporal scaling" effect has led to a hybrid-theory where, like a population-clock model, population patterns encode time, yet like a ramping neuron adjusting its slope, the speed of each neuron's firing adapts to different intervals. Here, we argue that these "relative" population-clock models are as computationally plausible as ramping theories, viewing population-speed and ramp-slope adjustments as equivalent. Therefore, we view identifying these "speed-control" circuits as a key direction for evaluating how the timing system performs computations. Furthermore, temporal scaling highlights that a key distinction between different neural models is whether they propose an absolute or relative time-representation. However, we note that several behavioral studies suggest the brain processes both scales, cautioning against a dichotomy.

The dorsal hippocampus' role in context-based timing in rodents

To act proactively, we must predict when future events will occur. Individuals generate temporal predictions using cues that indicate an event will happen after a certain duration elapses. Neural models of timing focus on how the brain represents these cue-duration associations. However, these models often overlook the fact that situational factors frequently modulate temporal expectations. For example, in realistic environments, the intervals associated with different cues will often covary due to a common underlying cause. According to the 'common cause hypothesis,' observers anticipate this covariance such that, when one cue's interval changes, temporal expectations for other cues shift in the same direction. Furthermore, as conditions will often differ across environments, the same cue can mean different things in different contexts. Therefore, updates to temporal expectations should be context-specific. Behavioral work supports these predictions, yet their underlying neural mechanisms are unclear. Here, we asked whether the dorsal hippocampus mediates context-based timing, given its broad role in context-conditioning. Specifically, we trained rats with either hippocampal or sham lesions that two cues predicted reward after either a short or long duration elapsed (e.g., tone-8 s/light-16 s). Then, we moved rats to a new context and extended the long cue's interval (e.g., light-32 s). This caused rats to respond later to the short cue, despite never being trained to do so. Importantly, when returned to the initial training context, sham rats shifted back toward both cues' original intervals. In contrast, lesion rats continued to respond at the long cue's newer interval. Surprisingly, they still showed contextual modulation for the short cue, responding earlier like shams. These data suggest the hippocampus only mediates context-based timing if a cue is explicitly paired and/or rewarded across distinct contexts. Furthermore, as lesions did not impact timing measures at baseline or acquisition for the long cue's new interval, our data suggests that the hippocampus only modulates timing when context is relevant.

The neural bases for timing of durations

Durations are defined by a beginning and an end, and a major distinction is drawn between durations that start in the present and end in the future ('prospective timing') and durations that start in the past and end either in the past or the present ('retrospective timing'). Different psychological processes are thought to be engaged in each of these cases. The former is thought to engage a clock-like mechanism that accurately tracks the continuing passage of time, whereas the latter is thought to engage a reconstructive process that utilizes both temporal and non-temporal information from the memory of past events. We propose that, from a biological perspective, these two forms of duration 'estimation' are supported by computational processes that are both reliant on population state dynamics but are nevertheless distinct. Prospective timing is effectively carried out in a single step where the ongoing dynamics of population activity directly serve as the computation of duration, whereas retrospective timing is carried out in two steps: the initial generation of population state dynamics through the process of event segmentation and the subsequent computation of duration utilizing the memory of those dynamics.

Complementary roles of serotonergic and cholinergic systems in decisions about when to act

Decision-making not only involves deciding about which action to choose but when and whether to initiate an action in the first place. Macaque monkeys tracked number of dots on a screen and could choose when to make a response. The longer the animals waited before responding, the more dots appeared on the screen and the higher the probability of reward. Monkeys waited longer before making a response when a trial’s value was less than the environment’s average value. Recordings of brain activity with fMRI revealed that activity in dorsal raphe nucleus (DRN)—a key source of serotonin (5-HT)—tracked average value of the environment. By contrast, activity in the basal forebrain (BF)—an important source of acetylcholine (ACh)—was related to decision time to act as a function of immediate and recent past context. Interactions between DRN and BF and the anterior cingulate cortex (ACC), another region with action initiation-related activity, occurred as a function of the decision time to act. Next, we performed two psychopharmacological studies. Manipulating systemic 5-HT by citalopram prolonged the time macaques waited to respond for a given opportunity. This effect was more evident during blocks with long inter-trial intervals (ITIs) where good opportunities were sparse. Manipulating systemic acetylcholine (ACh) by rivastigmine reduced the time macaques waited to respond given the immediate and recent past context, a pattern opposite to the effect observed with 5-HT. These findings suggest complementary roles for serotonin/DRN and acetylcholine/BF in decisions about when to initiate an action.

•

Both immediate context and wider environment influence decisions about when to act

•

DRN and 5-HT mediate the influence of wider environment

•

BF and ACh mediate the influence of immediate context

Rapid encoding of task regularities in the human hippocampus guides sensorimotor timing

The brain encodes the statistical regularities of the environment in a task-specific yet flexible and generalizable format. Here, we seek to understand this process by bridging two parallel lines of research, one centered on sensorimotor timing, and the other on cognitive mapping in the hippocampal system. By combining functional magnetic resonance imaging (fMRI) with a fast-paced time-to-contact (TTC) estimation task, we found that the hippocampus signaled behavioral feedback received in each trial as well as performance improvements across trials along with reward-processing regions. Critically, it signaled performance improvements independent from the tested intervals, and its activity accounted for the trial-wise regression-to-the-mean biases in TTC estimation. This is in line with the idea that the hippocampus supports the rapid encoding of temporal context even on short time scales in a behavior-dependent manner. Our results emphasize the central role of the hippocampus in statistical learning and position it at the core of a brain-wide network updating sensorimotor representations in real time for flexible behavior.

The Hippocampal Horizon: Constructing and Segmenting Experience for Episodic Memory

How do we recollect specific events that have occurred during continuous ongoing experience? There is converging evidence from non-human animals that spatially modulated cellular activity of the hippocampal formation supports the construction of ongoing events. On the other hand, recent human oriented event cognition models have outlined that our experience is segmented into discrete units, and that such segmentation can operate on shorter or longer timescales. Here, we describe a unification of how these dynamic physiological mechanisms of the hippocampus relate to ongoing externally and internally driven event segmentation, facilitating the demarcation of specific moments during experience. Our cross-species interdisciplinary approach offers a novel perspective in the way we construct and remember specific events, leading to the generation of many new hypotheses for future research.