Distinct dynamics of ramping activity in the frontal cortex and caudate nucleus in monkeys

A multi-region recurrent circuit for evidence accumulation in rats

Decision-making based on noisy evidence requires accumulating evidence and categorizing it to form a choice. Here we evaluate a proposed feedforward and modular mapping of this process in rats: evidence accumulated in anterodorsal striatum (ADS) is categorized in prefrontal cortex (frontal orienting fields, FOF). Contrary to this, we show that both regions appear to be indistinguishable in their encoding/decoding of accumulator value and communicate this information bidirectionally. Consistent with a role for FOF in accumulation, silencing FOF to ADS projections impacted behavior throughout the accumulation period, even while nonselective FOF silencing did not. We synthesize these findings into a multi-region recurrent neural network trained with a novel approach. In-silico experiments reveal that multiple scales of recurrence in the cortico-striatal circuit rescue computation upon nonselective FOF perturbations. These results suggest that ADS and FOF accumulate evidence in a recurrent and distributed manner, yielding redundant representations and robustness to certain perturbations.

Neural Representations of Post-Decision Accuracy and Reward Expectation in the Caudate Nucleus and Frontal Eye Field

Performance monitoring that supports ongoing behavioral adjustments is often examined in the context of either choice confidence for perceptual decisions (i.e., "did I get it right?") or reward expectation for reward-based decisions (i.e., "what reward will I receive?"). However, our understanding of how the brain encodes these distinct evaluative signals remains limited because they are easily conflated, particularly in commonly used two-alternative tasks with symmetric rewards for correct choices. Previously we used a motion-discrimination task with asymmetric rewards to identify neural substrates of forming reward-biased perceptual decisions in the caudate nucleus (part of the striatum in the basal ganglia) and the frontal eye field (FEF, in prefrontal cortex). Here we leveraged this task design to partially decouple estimates of accuracy and reward expectation and examine their impacts on subsequent decisions and their representations in those two brain areas. We identified distinguishable representations of these two evaluative signals in individual caudate and FEF neurons, with regional differences in their distribution patterns and time courses. We observed that well-trained monkeys (both sexes) used both evaluative signals, infrequently but consistently, to adjust their subsequent decisions. We found further that these behavioral adjustments had reliable relationships with the neural representations of both evaluative signals in caudate, but not FEF. These results suggest that the cortico-striatal decision network may use diverse evaluative signals to monitor and adjust decision-making behaviors, adding to our understanding of the different roles that the FEF and caudate nucleus play in a diversity of decision-related computations.

Contributions of the Basal Ganglia to Visual Perceptual Decisions

The basal ganglia (BG) make up a prominent nexus between visual and motor-related brain regions. In contrast to the BG's well-established roles in movement control and value-based decision making, their contributions to the transformation of visual input into an action remain unclear, especially in the context of perceptual decisions based on uncertain visual evidence. This article reviews recent progress in our understanding of the BG's contributions to the formation, evaluation, and adjustment of such decisions. From theoretical and experimental perspectives, the review focuses on four key stations in the BG network, namely, the striatum, pallidum, subthalamic nucleus, and midbrain dopamine neurons, which can have different roles and together support the decision process.

Functional and structural brain differences in bipolar disorder: a multimodal meta-analysis of neuroimaging studies

BACKGROUND

Numerous studies of resting-state functional imaging and voxel-based morphometry (VBM) have revealed differences in specific brain regions of patients with bipolar disorder (BD), but the results have been inconsistent.

METHODS

A whole-brain voxel-wise meta-analysis was conducted on resting-state functional imaging and VBM studies that compared differences between patients with BD and healthy controls using Seed-based d Mapping with Permutation of Subject Images software.

RESULTS

A systematic literature search identified 51 functional imaging studies (1842 BD and 2190 controls) and 83 VBM studies (2790 BD and 3690 controls). Overall, patients with BD displayed increased resting-state functional activity in the left middle frontal gyrus, right inferior frontal gyrus (IFG) extending to the right insula, right superior frontal gyrus and bilateral striatum, as well as decreased resting-state functional activity in the left middle temporal gyrus extending to the left superior temporal gyrus and post-central gyrus, left cerebellum, and bilateral precuneus. The meta-analysis of VBM showed that patients with BD displayed decreased VBM in the right IFG extending to the right insula, temporal pole and superior temporal gyrus, left superior temporal gyrus extending to the left insula, temporal pole, and IFG, anterior cingulate cortex, left superior frontal gyrus (medial prefrontal cortex), left thalamus, and right fusiform gyrus.

CONCLUSIONS

The multimodal meta-analyses suggested that BD showed similar patterns of aberrant brain activity and structure in the insula extending to the temporal cortex, fronto-striatal-thalamic, and default-mode network regions, which provide useful insights for understanding the underlying pathophysiology of BD.

Variable Statistical Structure of Neuronal Spike Trains in Monkey Superior Colliculus

Popular models of decision-making propose that noisy sensory evidence accumulates until reaching a bound. Behavioral evidence as well as trial-averaged ramping of neuronal activity in sensorimotor regions of the brain support this idea. However, averaging activity across trials can mask other processes, such as rapid shifts in decision commitment, calling into question the hypothesis that evidence accumulation is encoded by delay period activity of individual neurons. We mined two sets of data from experiments in four monkeys in which we recorded from superior colliculus neurons during two different decision-making tasks and a delayed saccade task. We applied second-order statistical measures and spike train simulations to determine whether spiking statistics were similar or different in the different tasks and monkeys, despite similar trial-averaged activity across tasks and monkeys. During a motion direction discrimination task, single-trial delay period activity behaved statistically consistent with accumulation. During an orientation detection task, the activity behaved superficially like accumulation, but statistically consistent with stepping. Simulations confirmed both findings. Importantly, during a simple saccade task, with similar trial-averaged activity, neither process explained spiking activity, ruling out interpretations based on differences in attention, reward, or motor planning. These results highlight the need for exploring single-trial spiking dynamics to understand cognitive processing and raise the interesting hypothesis that the superior colliculus participates in different aspects of decision-making depending on task differences.SIGNIFICANCE STATEMENT How are decisions based on sensory information transformed into actions? We report that single-trial neuronal activity dynamics in the superior colliculus of monkeys show differences in decision-making tasks depending on task idiosyncrasies and requirements and despite similar trial-averaged ramping activity. These results highlight the importance of exploring single-trial spiking dynamics to understand cognitive processing and raise the interesting hypothesis that the superior colliculus participates in different aspects of decision-making depending on task requirements.

Frontal eye field and caudate neurons make different contributions to reward-biased perceptual decisions

Many decisions require trade-offs between sensory evidence and internal preferences. Potential neural substrates include the frontal eye field (FEF) and caudate nucleus, but their distinct roles are not understood. Previously we showed that monkeys’ decisions on a direction-discrimination task with asymmetric rewards reflected a biased accumulate-to-bound decision process (Fan et al., 2018) that was affected by caudate microstimulation (Doi et al., 2020). Here we compared single-neuron activity in FEF and caudate to each other and to accumulate-to-bound model predictions derived from behavior. Task-dependent neural modulations were similar in both regions. However, choice-selective neurons in FEF, but not caudate, encoded behaviorally derived biases in the accumulation process. Baseline activity in both regions was sensitive to reward context, but this sensitivity was not reliably associated with behavioral biases. These results imply distinct contributions of FEF and caudate neurons to reward-biased decision-making and put experimental constraints on the neural implementation of accumulation-to-bound-like computations.

Ongoing, rational calibration of reward-driven perceptual biases

Decision-making is often interpreted in terms of normative computations that maximize a particular reward function for stable, average behaviors. Aberrations from the reward-maximizing solutions, either across subjects or across different sessions for the same subject, are often interpreted as reflecting poor learning or physical limitations. Here we show that such aberrations may instead reflect the involvement of additional satisficing and heuristic principles. For an asymmetric-reward perceptual decision-making task, three monkeys produced adaptive biases in response to changes in reward asymmetries and perceptual sensitivity. Their choices and response times were consistent with a normative accumulate-to-bound process. However, their context-dependent adjustments to this process deviated slightly but systematically from the reward-maximizing solutions. These adjustments were instead consistent with a rational process to find satisficing solutions based on the gradient of each monkey's reward-rate function. These results suggest new dimensions for assessing the rational and idiosyncratic aspects of flexible decision-making.

Causal contribution and dynamical encoding in the striatum during evidence accumulation

A broad range of decision-making processes involve gradual accumulation of evidence over time, but the neural circuits responsible for this computation are not yet established. Recent data indicate that cortical regions that are prominently associated with accumulating evidence, such as the posterior parietal cortex and the frontal orienting fields, may not be directly involved in this computation. Which, then, are the regions involved? Regions that are directly involved in evidence accumulation should directly influence the accumulation-based decision-making behavior, have a graded neural encoding of accumulated evidence and contribute throughout the accumulation process. Here, we investigated the role of the anterior dorsal striatum (ADS) in a rodent auditory evidence accumulation task using a combination of behavioral, pharmacological, optogenetic, electrophysiological and computational approaches. We find that the ADS is the first brain region known to satisfy the three criteria. Thus, the ADS may be the first identified node in the network responsible for evidence accumulation.

Coordinated Ramping of Dorsal Striatal Pathways preceding Food Approach and Consumption

The striatum controls food-related actions and consumption and is linked to feeding disorders, including obesity and anorexia nervosa. Two populations of neurons project from the striatum: direct pathway medium spiny neurons and indirect pathway medium spiny neurons. The selective contribution of direct pathway medium spiny neurons and indirect pathway medium spiny neurons to food-related actions and consumption remains unknown. Here, we used in vivo electrophysiology and fiber photometry in mice (of both sexes) to record both spiking activity and pathway-specific calcium activity of dorsal striatal neurons during approach to and consumption of food pellets. While electrophysiology revealed complex task-related dynamics across neurons, population calcium was enhanced during approach and inhibited during consumption in both pathways. We also observed ramping changes in activity that preceded both pellet-directed actions and spontaneous movements. These signals were heterogeneous in the spiking units, with neurons exhibiting either increasing or decreasing ramps. In contrast, the population calcium signals were homogeneous, with both pathways having increasing ramps of activity for several seconds before actions were initiated. An analysis comparing population firing rates to population calcium signals also revealed stronger ramping dynamics in the calcium signals than in the spiking data. In a second experiment, we trained the mice to perform an action sequence to evaluate when the ramping signals terminated. We found that the ramping signals terminated at the beginning of the action sequence, suggesting they may reflect upcoming actions and not preconsumption activity. Plasticity of such mechanisms may underlie disorders that alter action selection, such as drug addiction or obesity.SIGNIFICANCE STATEMENT Alterations in striatal function have been linked to pathological consumption in disorders, such as obesity and drug addiction. We recorded spiking and population calcium activity from the dorsal striatum during ad libitum feeding and an operant task that resulted in mice obtaining food pellets. Dorsal striatal neurons exhibited long ramps in activity that preceded actions by several seconds, and may reflect upcoming actions. Understanding how the striatum controls the preparation and generation of actions may lead to improved therapies for disorders, such as drug addiction or obesity.

Dynamic Flexibility in Striatal-Cortical Circuits Supports Reinforcement Learning

Complex learned behaviors must involve the integrated action of distributed brain circuits. Although the contributions of individual regions to learning have been extensively investigated, much less is known about how distributed brain networks orchestrate their activity over the course of learning. To address this gap, we used fMRI combined with tools from dynamic network neuroscience to obtain time-resolved descriptions of network coordination during reinforcement learning in humans. We found that learning to associate visual cues with reward involves dynamic changes in network coupling between the striatum and distributed brain regions, including visual, orbitofrontal, and ventromedial prefrontal cortex (n = 22; 13 females). Moreover, we found that this flexibility in striatal network coupling correlates with participants' learning rate and inverse temperature, two parameters derived from reinforcement learning models. Finally, we found that episodic learning, measured separately in the same participants at the same time, was related to dynamic connectivity in distinct brain networks. These results suggest that dynamic changes in striatal-centered networks provide a mechanism for information integration during reinforcement learning.SIGNIFICANCE STATEMENT Learning from the outcomes of actions, referred to as reinforcement learning, is an essential part of life. The roles of individual brain regions in reinforcement learning have been well characterized in terms of updating values for actions or cues. Missing from this account, however, is an understanding of how different brain areas interact during learning to integrate sensory and value information. Here we characterize flexible striatal-cortical network dynamics that relate to reinforcement learning behavior.

Cortical Local Field Potential Power Is Associated with Behavioral Detection of Near-threshold Stimuli in the Rat Whisker System: Dissociation between Orbitofrontal and Somatosensory Cortices

There is growing evidence that ongoing brain oscillations may represent a key regulator of attentional processes and as such may contribute to behavioral performance in psychophysical tasks. OFC appears to be involved in the top-down modulation of sensory processing; however, the specific contribution of ongoing OFC oscillations to perception has not been characterized. Here we used the rat whiskers as a model system to further characterize the relationship between cortical state and tactile detection. Head-fixed rats were trained to report the presence of a vibrotactile stimulus (frequency = 60 Hz, duration = 2 sec, deflection amplitude = 0.01-0.5 mm) applied to a single vibrissa. We calculated power spectra of local field potentials preceding the onset of near-threshold stimuli from microelectrodes chronically implanted in OFC and somatosensory cortex. We found a dissociation between slow oscillation power in the two regions in relation to detection probability: Higher OFC but not somatosensory delta power was associated with increased detection probability. Furthermore, coherence between OFC and barrel cortex was reduced preceding successful detection. Consistent with the role of OFC in attention, our results identify a cortical network whose activity is differentially modulated before successful tactile detection.

Functional dissection of signal and noise in MT and LIP during decision-making

During perceptual decision making, responses in the middle temporal (MT) and lateral intraparietal (LIP) areas appear to map onto theoretically defined quantities, with MT representing instantaneous motion evidence and LIP reflecting the accumulated evidence. However, several aspects of the transformation between the two areas have not been empirically tested. We therefore performed multi-stage systems identification analyses of the simultaneous activity of MT and LIP during individual decisions. We found that monkeys based their choices on evidence presented in early epochs of the motion stimulus, and that substantial early weighting of motion was present in MT responses. LIP’s responses recapitulated MT’s early weighting and contained a choice-dependent buildup that was distinguishable from motion integration. Furthermore, trial-by-trial variability in LIP did not depend on MT activity. These results identify important deviations from the idealizations of MT and LIP and motivate inquiry into sensorimotor computations that may intervene between MT and LIP.

Decision Making and Sequential Sampling from Memory

Decisions take time, and as a rule more difficult decisions take more time. But this only raises the question of what consumes the time. For decisions informed by a sequence of samples of evidence, the answer is straightforward: more samples are available with more time. Indeed, the speed and accuracy of such decisions are explained by the accumulation of evidence to a threshold or bound. However, the same framework seems to apply to decisions that are not obviously informed by sequences of evidence samples. Here, we proffer the hypothesis that the sequential character of such tasks involves retrieval of evidence from memory. We explore this hypothesis by focusing on value-based decisions and argue that mnemonic processes can account for regularities in choice and decision time. We speculate on the neural mechanisms that link sampling of evidence from memory to circuits that represent the accumulated evidence bearing on a choice. We propose that memory processes may contribute to a wider class of decisions that conform to the regularities of choice-reaction time predicted by the sequential sampling framework.

Parsing Heterogeneous Striatal Activity

The striatum is an input channel of the basal ganglia and is well known to be involved in reward-based decision making and learning. At the macroscopic level, the striatum has been postulated to contain parallel functional modules, each of which includes neurons that perform similar computations to support selection of appropriate actions for different task contexts. At the single-neuron level, however, recent studies in monkeys and rodents have revealed heterogeneity in neuronal activity even within restricted modules of the striatum. Looking for generality in the complex striatal activity patterns, here we briefly survey several types of striatal activity, focusing on their usefulness for mediating behaviors. In particular, we focus on two types of behavioral tasks: reward-based tasks that use salient sensory cues and manipulate outcomes associated with the cues; and perceptual decision tasks that manipulate the quality of noisy sensory cues and associate all correct decisions with the same outcome. Guided by previous insights on the modular organization and general selection-related functions of the basal ganglia, we relate striatal activity patterns on these tasks to two types of computations: implementation of selection and evaluation. We suggest that a parsing with the selection/evaluation categories encourages a focus on the functional commonalities revealed by studies with different animal models and behavioral tasks, instead of a focus on aspects of striatal activity that may be specific to a particular task setting. We then highlight several questions in the selection-evaluation framework for future explorations.

Posterior Parietal Cortex Guides Visual Decisions in Rats

Neurons in putative decision-making structures can reflect both sensory and decision signals, making their causal role in decisions unclear. Here, we tested whether rat posterior parietal cortex (PPC) is causal for processing visual sensory signals or instead for accumulating evidence for decision alternatives. We disrupted PPC activity optogenetically during decision making and compared effects on decisions guided by auditory versus visual evidence. Deficits were largely restricted to visual decisions. To further test for visual dominance in PPC, we evaluated electrophysiological responses after individual sensory events and observed much larger response modulation after visual stimuli than auditory stimuli. Finally, we measured trial-to-trial spike count variability during stimulus presentation and decision formation. Variability decreased sharply, suggesting that the network is stabilized by inputs, unlike what would be expected if sensory signals were locally accumulated. Our findings suggest that PPC plays a causal role in processing visual signals that are accumulated elsewhere.SIGNIFICANCE STATEMENT Defining the neural circuits that support decision making bridges a gap between our understanding of simple sensorimotor reflexes and our understanding of truly complex behavior. However, identifying brain areas that play a causal role in decision making has proved challenging. We tested the causal role of a candidate component of decision circuits, the rat posterior parietal cortex (PPC). Our interpretation of the data benefited from our use of animals trained to make decisions guided by either visual or auditory evidence. Our results suggest that PPC plays a causal role specifically in visual decision making and may support sensory aspects of the decision, such as interpreting the visual signals so that evidence for a decision can be accumulated elsewhere.