Dissociable dopaminergic control of saccadic target selection and its implications for reward modulation

The Aversive Lens: Stress effects on the prefrontal-cingulate cortical pathways that regulate emotion

ARNSTEN, A.F.T., M.K.P. Joyce and A.C. Roberts. The Aversive Lens: Stress effects on the prefrontal-cingulate cortical pathways that regulate emotion. NEUROSCI BIOBEHAV REV XXX-XXX, 2022. The symptoms of major-depressive-disorder include psychic pain and anhedonia, i.e. seeing the world through an "aversive lens". The neurobiology underlying this shift in worldview is emerging. Here these data are reviewed, focusing on how activation of subgenual cingulate (BA25) induces an "aversive lens", and how higher prefrontal cortical (PFC) areas (BA46/10/32) provide top-down regulation of BA25 but are weakened by excessive dopamine and norepinephrine release during stress exposure, and dendritic spine loss with chronic stress exposure. These changes may generate an attractor state, which maintains the brain under the control of BA25, requiring medication or neuromodulatory treatments to return connectivity to a more flexible state. In line with this hypothesis, effective anti-depressant treatments reduce the activity of BA25 and restore top-down regulation by higher circuits, e.g. as seen with SSRI medications, ketamine, deep brain stimulation of BA25, or rTMS to strengthen dorsolateral PFC. This research has special relevance in an era of chronic stress caused by the COVID19 pandemic, political unrest and threat of climate change.

Dopamine influences attentional rate modulation in Macaque posterior parietal cortex

Cognitive neuroscience has made great strides in understanding the neural substrates of attention, but our understanding of its neuropharmacology remains incomplete. Although dopamine has historically been studied in relation to frontal functioning, emerging evidence suggests important dopaminergic influences in parietal cortex. We recorded single- and multi-unit activity whilst iontophoretically administering dopaminergic agonists and antagonists while rhesus macaques performed a spatial attention task. Out of 88 units, 50 revealed activity modulation by drug administration. Dopamine inhibited firing rates according to an inverted-U shaped dose-response curve and increased gain variability. D1 receptor antagonists diminished firing rates according to a monotonic function and interacted with attention modulating gain variability. Finally, both drugs decreased the pupil light reflex. These data show that dopamine shapes neuronal responses and modulates aspects of attentional processing in parietal cortex.

Attention improves information flow between neuronal populations without changing the communication subspace

Visual attention allows observers to change the influence of different parts of a visual scene on their behavior, suggesting that information can be flexibly shared between visual cortex and neurons involved in decision making. We investigated the neural substrate of flexible information routing by analyzing the activity of populations of visual neurons in the medial temporal area (MT) and oculo-motor neurons in the superior colliculus (SC) while rhesus monkeys switched spatial attention. We demonstrated that attention increases the efficacy of visuomotor communication: trial-to-trial variability in SC population activity could be better predicted by the activity of the MT population (and vice versa) when attention was directed toward their joint receptive fields. Surprisingly, this improvement in prediction was not explained by changes in the dimensionality of the shared subspace or in the magnitude of local or shared pairwise noise correlations. These results lay a foundation for future theoretical and experimental studies into how visual attention can flexibly change information flow between sensory and decision neurons.

Value-based cognition and drug dependency

Value-based decision-making is thought to play an important role in drug dependency. Achieving elevated levels of euphoria or ameliorating dysphoria/pain may motivate goal-directed drug consumption in both drug-naïve and long-time users. In other words, drugs become viewed as the preferred means of attaining a desired internal state. The bias towards choosing drugs may affect one's cognition. Observed biases in learning, attention and memory systems within the brain gradually focus one's cognitive functions towards drugs and related cues to the exclusion of other stimuli. In this narrative review, the effects of drug use on learning, attention and memory are discussed with a particular focus on changes across brain-wide functional networks and the subsequent impact on behaviour. These cognitive changes are then incorporated into the cycle of addiction, an established model outlining the transition from casual drug use to chronic dependency. If drug use results in the elevated salience of drugs and their cues, the studies highlighted in this review strongly suggest that this salience biases cognitive systems towards the motivated pursuit of addictive drugs. This bias is observed throughout the cycle of addiction, possibly contributing to the persistent hold that addictive drugs have over the dependent. Taken together, the excessive valuation of drugs as the preferred means of achieving a desired internal state affects more than just decision-making, but also learning, attentional and mnemonic systems. This eventually narrows the focus of one's thoughts towards the pursuit and consumption of addictive drugs.

Entropy-based metrics for predicting choice behavior based on local response to reward

For decades, behavioral scientists have used the matching law to quantify how animals distribute their choices between multiple options in response to reinforcement they receive. More recently, many reinforcement learning (RL) models have been developed to explain choice by integrating reward feedback over time. Despite reasonable success of RL models in capturing choice on a trial-by-trial basis, these models cannot capture variability in matching behavior. To address this, we developed metrics based on information theory and applied them to choice data from dynamic learning tasks in mice and monkeys. We found that a single entropy-based metric can explain 50% and 41% of variance in matching in mice and monkeys, respectively. We then used limitations of existing RL models in capturing entropy-based metrics to construct more accurate models of choice. Together, our entropy-based metrics provide a model-free tool to predict adaptive choice behavior and reveal underlying neural mechanisms.

Neurochemistry of Visual Attention

Visual attention is the cognitive process that mediates the selection of important information from the environment. This selection is usually controlled by bottom-up and top-down attentional biasing. Since for most humans vision is the dominant sense, visual attention is critically important for higher-order cognitive functions and related deficits are a core symptom of many neuropsychiatric and neurological disorders. Here, we summarize the importance and relative contributions of different neuromodulators and neurotransmitters to the neural mechanisms of top-down and bottom-up attentional control. We will not only review the roles of widely accepted neuromodulators, such as acetylcholine, dopamine and noradrenaline, but also the contributions of other modulatory substances. In doing so, we hope to shed some light on the current understanding of the role of neurochemistry in shaping neuron properties contributing to the allocation of attention in the visual field.

Frontotemporal coordination predicts working memory performance and its local neural signatures

Neurons in some sensory areas reflect the content of working memory (WM) in their spiking activity. However, this spiking activity is seldom related to behavioral performance. We studied the responses of inferotemporal (IT) neurons, which exhibit object-selective activity, along with Frontal Eye Field (FEF) neurons, which exhibit spatially selective activity, during the delay period of an object WM task. Unlike the spiking activity and local field potentials (LFPs) within these areas, which were poor predictors of behavioral performance, the phase-locking of IT spikes and LFPs with the beta band of FEF LFPs robustly predicted successful WM maintenance. In addition, IT neurons exhibited greater object-selective persistent activity when their spikes were locked to the phase of FEF LFPs. These results reveal that the coordination between prefrontal and temporal cortex predicts the successful maintenance of visual information during WM.

Separable Influences of Reward on Visual Processing and Choice

Primate vision is characterized by constant, sequential processing and selection of visual targets to fixate. Although expected reward is known to influence both processing and selection of visual targets, similarities and differences between these effects remain unclear mainly because they have been measured in separate tasks. Using a novel paradigm, we simultaneously measured the effects of reward outcomes and expected reward on target selection and sensitivity to visual motion in monkeys. Monkeys freely chose between two visual targets and received a juice reward with varying probability for eye movements made to either of them. Targets were stationary apertures of drifting gratings, causing the end points of eye movements to these targets to be systematically biased in the direction of motion. We used this motion-induced bias as a measure of sensitivity to visual motion on each trial. We then performed different analyses to explore effects of objective and subjective reward values on choice and sensitivity to visual motion to find similarities and differences between reward effects on these two processes. Specifically, we used different reinforcement learning models to fit choice behavior and estimate subjective reward values based on the integration of reward outcomes over multiple trials. Moreover, to compare the effects of subjective reward value on choice and sensitivity to motion directly, we considered correlations between each of these variables and integrated reward outcomes on a wide range of timescales. We found that, in addition to choice, sensitivity to visual motion was also influenced by subjective reward value, although the motion was irrelevant for receiving reward. Unlike choice, however, sensitivity to visual motion was not affected by objective measures of reward value. Moreover, choice was determined by the difference in subjective reward values of the two options, whereas sensitivity to motion was influenced by the sum of values. Finally, models that best predicted visual processing and choice used sets of estimated reward values based on different types of reward integration and timescales. Together, our results demonstrate separable influences of reward on visual processing and choice, and point to the presence of multiple brain circuits for the integration of reward outcomes.

Parietal Cortex Regulates Visual Salience and Salience-Driven Behavior

Unique stimuli stand out. Despite an abundance of competing sensory stimuli, the detection of the most salient ones occurs without effort, and that detection contributes to the guidance of adaptive behavior. Neurons sensitive to the salience of visual stimuli are widespread throughout the primate visual system and are thought to shape the selection of visual targets. However, a neural source of salience remains elusive. In an attempt to identify a source of visual salience, we reversibly inactivated parietal cortex and simultaneously recorded salience signals in prefrontal cortex. Inactivation of parietal cortex not only caused pronounced and selective reductions of salience signals in prefrontal cortex but also diminished the influence of salience on visually guided behavior. These observations demonstrate a causal role of parietal cortex in regulating salience signals within the brain and in controlling salience-driven behavior.

Hypomania and saccadic changes in Parkinson's disease: influence of D2 and D3 dopaminergic signalling

In order to understand the influence of two dopaminergic signalling pathways, TaqIA rs1800497 (influencing striatal D2 receptor density) and Ser9Gly rs6280 (influencing the striatal D3 dopamine-binding affinity), on saccade generation and psychiatric comorbidities in Parkinson’s disease, this study aimed to investigate the association of saccadic performance in hypomanic or impulsive behaviour in parkinsonian patients; besides we questioned whether variants of D2 (A1+/A1−) and D3 (B1+/B1−) receptor polymorphism influence saccadic parameters differently, and if clinical parameters or brain connectivity changes modulate this association in the nigro-caudatal and nigro-collicular tract. Initially, patients and controls were compared regarding saccadic performance and differed in the parameter duration in memory-guided saccades (MGS) and visually guided saccades (VGS) trials (p < 0.0001) and in the MGS trial (p < 0.03). We were able to find associations between hypomanic behaviour (HPS) and saccade parameters (duration, latency, gain and amplitude) for both conditions [MGS (p = 0.036); VGS (p = 0.033)], but not for impulsive behaviour. For the A1 variant duration was significantly associated with HPS [VGS (p = 0.024); MGS (p = 0.033)]. In patients with the B1 variant, HPS scores were more consistently associated with duration [VGS (p = 0.005); MGS (p = 0.015), latency [VGS (p = 0.022)]] and amplitude [MGS (p = 0.006); VGS (p = 0.005)]. The mediation analysis only revealed a significant indirect effect for amplitude in the MGS modality for the variable UPDRS-ON (p < 0.05). All other clinical scales and brain connectivity parameters were not associated with behavioural traits. Collectively, our findings stress the role of striatal D2 and D3 signalling mechanisms in saccade generation and suggest that saccadic performance is associated with the clinical psychiatric state in Parkinson’s disease.

Dopamine Receptor Expression Among Local and Visual Cortex-Projecting Frontal Eye Field Neurons

Dopaminergic modulation of prefrontal cortex plays an important role in numerous cognitive processes, including attention. The frontal eye field (FEF) is modulated by dopamine and has an established role in visual attention, yet the underlying circuitry upon which dopamine acts is not known. We compared the expression of D1 and D2 dopamine receptors (D1Rs and D2Rs) across different classes of FEF neurons, including those projecting to dorsal or ventral extrastriate cortex. First, we found that both D1Rs and D2Rs are more prevalent on pyramidal neurons than on several classes of interneurons and are particularly prevalent on putatively long-range projecting pyramidals. Second, higher proportions of pyramidal neurons express D1Rs than D2Rs. Third, overall a higher proportion of inhibitory neurons expresses D2Rs than D1Rs. Fourth, among inhibitory interneurons, a significantly higher proportion of parvalbumin+ neurons expresses D2Rs than D1Rs, and a significantly higher proportion of calbindin+ neurons expresses D1Rs than D2Rs. Finally, compared with D2Rs, virtually all of the neurons with identified projections to both dorsal and ventral extrastriate visual cortex expressed D1Rs. Our results demonstrate that dopamine tends to act directly on the output of the FEF and that dopaminergic modulation of top-down projections to visual cortex is achieved predominately via D1Rs.

Influence of Expected Reward on Temporal Order Judgment

Perceptual decision-making has been shown to be influenced by reward expected from alternative options or actions, but the underlying neural mechanisms are currently unknown. More specifically, it is debated whether reward effects are mediated through changes in sensory processing, later stages of decision-making, or both. To address this question, we conducted two experiments in which human participants made saccades to what they perceived to be either the first or second of two visually identical but asynchronously presented targets while we manipulated expected reward from correct and incorrect responses on each trial. By comparing reward-induced bias in target selection (i.e., reward bias) during the two experiments, we determined whether reward caused changes in sensory or decision-making processes. We found similar reward biases in the two experiments indicating that reward information mainly influenced later stages of decision-making. Moreover, the observed reward biases were independent of the individual's sensitivity to sensory signals. This suggests that reward effects were determined heuristically via modulation of decision-making processes instead of sensory processing. To further explain our findings and uncover plausible neural mechanisms, we simulated our experiments with a cortical network model and tested alternative mechanisms for how reward could exert its influence. We found that our experimental observations are more compatible with reward-dependent input to the output layer of the decision circuit. Together, our results suggest that, during a temporal judgment task, reward exerts its influence via changing later stages of decision-making (i.e., response bias) rather than early sensory processing (i.e., perceptual bias).

Contributions of anterior cingulate cortex and basolateral amygdala to decision confidence and learning under uncertainty

The subjective sense of certainty, or confidence, in ambiguous sensory cues can alter the interpretation of reward feedback and facilitate learning. We trained rats to report the orientation of ambiguous visual stimuli according to a spatial stimulus-response rule that must be learned. Following choice, rats could wait a self-timed delay for reward or initiate a new trial. Waiting times increase with discrimination accuracy, demonstrating that this measure can be used as a proxy for confidence. Chemogenetic silencing of BLA shortens waiting times overall whereas ACC inhibition renders waiting times insensitive to confidence-modulating attributes of visual stimuli, suggesting contribution of ACC but not BLA to confidence computations. Subsequent reversal learning is enhanced by confidence. Both ACC and BLA inhibition block this enhancement but via differential adjustments in learning strategies and consistent use of learned rules. Altogether, we demonstrate dissociable roles for ACC and BLA in transmitting confidence and learning under uncertainty.

Cell class-specific modulation of attentional signals by acetylcholine in macaque frontal eye field

Attention is critical to high-level cognition, and attentional deficits are a hallmark of cognitive dysfunction. A key transmitter for attentional control is acetylcholine, but its cellular actions in attention-controlling areas remain poorly understood. Here we delineate how muscarinic and nicotinic receptors affect basic neuronal excitability and attentional control signals in different cell types in macaque frontal eye field. We found that broad spiking and narrow spiking cells both require muscarinic and nicotinic receptors for normal excitability, thereby affecting ongoing or stimulus-driven activity. Attentional control signals depended on muscarinic, not nicotinic receptors in broad spiking cells, while they depended on both muscarinic and nicotinic receptors in narrow spiking cells. Cluster analysis revealed that muscarinic and nicotinic effects on attentional control signals were highly selective even for different subclasses of narrow spiking cells and of broad spiking cells. These results demonstrate that cholinergic receptors are critical to establish attentional control signals in the frontal eye field in a cell type-specific manner.

Neuromodulation of Attention

Attention is critical to high-level cognition and attention deficits are a hallmark of neurologic and neuropsychiatric disorders. Although years of research indicates that distinct neuromodulators influence attentional control, a mechanistic account that traverses levels of analysis (cells, circuits, behavior) is missing. However, such an account is critical to guide the development of next-generation pharmacotherapies aimed at forestalling or remediating the global burden associated with disorders of attention. Here, we summarize current neuroscientific understanding of how attention affects single neurons and networks of neurons. We then review key results that have informed our understanding of how neuromodulation shapes these neuron and network properties and thereby enables the appropriate allocation of attention to relevant external or internal events. Finally, we highlight areas where we believe hypotheses can be formulated and tackled experimentally in the near future, thereby critically increasing our mechanistic understanding of how attention is implemented at the cellular and network levels.

Dopamine and Cognitive Control in Prefrontal Cortex

Cognitive control, the ability to orchestrate behavior in accord with our goals, depends on the prefrontal cortex. These cognitive functions are heavily influenced by the neuromodulator dopamine. We review here recent insights exploring the influence of dopamine on neuronal response properties in prefrontal cortex (PFC) during ongoing behaviors in primates. This review suggests three major computational roles of dopamine in cognitive control: (i) gating sensory input, (ii) maintaining and manipulating working memory contents, and (iii) relaying motor commands. For each of these roles, we propose a neuronal microcircuit based on known mechanisms of action of dopamine in PFC, which are corroborated by computational network models. This conceptual approach accounts for the various roles of dopamine in prefrontal executive functioning.

Dopaminergic Modulation of Synaptic Plasticity, Its Role in Neuropsychiatric Disorders, and Its Computational Modeling

Neuromodulators modify intrinsic characteristics of the nervous system in order to reconfigure the functional properties of neural circuits. This reconfiguration is crucial for the flexibility of the nervous system to respond on an input-modulated basis. Such a functional rearrangement is realized by modification of intrinsic properties of the neural circuits including synaptic interactions. Dopamine is an important neuromodulator involved in motivation and stimulus-reward learning process, and adjusts synaptic dynamics in multiple time scales through different pathways. The modification of synaptic plasticity by dopamine underlies the change in synaptic transmission and integration mechanisms, which affects intrinsic properties of the neural system including membrane excitability, probability of neurotransmitters release, receptors’ response to neurotransmitters, protein trafficking, and gene transcription. Dopamine also plays a central role in behavioral control, whereas its malfunction can cause cognitive disorders. Impaired dopamine signaling is implicated in several neuropsychiatric disorders such as Parkinson’s disease, drug addiction, schizophrenia, attention-deficit/hyperactivity disorder, obsessive-compulsive disorder and Tourette’s syndrome. Therefore, dopamine plays a crucial role in the nervous system, where its proper modulation of neural circuits may enhance plasticity-related procedures, but disturbances in dopamine signaling might be involved in numerous neuropsychiatric disorders. In recent years, several computational models are proposed to formulate the involvement of dopamine in synaptic plasticity or neuropsychiatric disorders and address their connection based on the experimental findings.

Rodent Models of Adaptive Value Learning and Decision-Making

Real-world decisions are rarely as straightforward as choosing between clearly "good" vs. "bad" options. More often, options must be evaluated carefully because they differ in relative value. For example, we typically learn about (and make decisions between) options in comparison, where one outcome may be more costly or risky than the other. Several neuropsychiatric conditions are characterized by atypical evaluation of effort and risk costs, including major depression, schizophrenia, autism, obsessive-compulsive disorder, and substance use disorders. Aberrant value learning and decision-making have long been considered a cognitive-behavioral endophenotype of these disorders and can be modeled in rodents. This chapter presents two general methodological domains that the experimenter can manipulate in animal decision-making tasks: risk and effort. Here, we present detailed methods of rodent tasks frequently employed within these domains: probabilistic reversal learning (PRL) and effort choice. These tasks recruit regions within rodent frontal cortex, the amygdala, and the striatum, and performance is heavily modulated by dopamine, making these assays highly valid measures in the study of behavioral and substance addictions, in particular.

Prefrontal Contributions to Attention and Working Memory

The processes of attention and working memory are conspicuously interlinked, suggesting that they may involve overlapping neural mechanisms. Working memory (WM) is the ability to maintain information in the absence of sensory input. Attention is the process by which a specific target is selected for further processing, and neural resources directed toward that target. The content of WM can be used to direct attention, and attention can in turn determine which information is encoded into WM. Here we discuss the similarities between attention and WM and the role prefrontal cortex (PFC) plays in each. First, at the theoretical level, we describe how attention and WM can both rely on models based on attractor states. Then we review the evidence for an overlap between the areas involved in both functions, especially the frontal eye field (FEF) portion of the prefrontal cortex. We also discuss similarities between the neural changes in visual areas observed during attention and WM. At the cellular level, we review the literature on the role of prefrontal DA in both attention and WM at the behavioral and neural levels. Finally, we summarize the anatomical evidence for an overlap between prefrontal mechanisms involved in attention and WM. Altogether, a summary of pharmacological, electrophysiological, behavioral, and anatomical evidence for a contribution of the FEF part of prefrontal cortex to attention and WM is provided.

Functional Categories of Visuomotor Neurons in Macaque Frontal Eye Field

Frontal eye field (FEF) in macaque monkeys contributes to visual attention, visual-motor transformations and production of eye movements. Traditionally, neurons in FEF have been classified by the magnitude of increased discharge rates following visual stimulus presentation, during a waiting period, and associated with eye movement production. However, considerable heterogeneity remains within the traditional visual, visuomovement, and movement categories. Cluster analysis is a data-driven method of identifying self-segregating groups within a dataset. Because many cluster analysis techniques exist and outcomes vary with analysis assumptions, consensus clustering aggregates over multiple analyses, identifying robust groups. To describe more comprehensively the neuronal composition of FEF, we applied a consensus clustering technique for unsupervised categorization of patterns of spike rate modulation measured during a memory-guided saccade task. We report 10 functional categories, expanding on the traditional 3 categories. Categories were distinguished by latency, magnitude, and sign of visual response; the presence of sustained activity; and the dynamics, magnitude and sign of saccade-related modulation. Consensus clustering can include other metrics and can be applied to datasets from other brain regions to provide better information guiding microcircuit models of cortical function.

Volatility Facilitates Value Updating in the Prefrontal Cortex

Adaptation of learning and decision-making might depend on the regulation of activity in the prefrontal cortex. Here we examined how volatility of reward probabilities influences learning and neural activity in the primate prefrontal cortex. We found that animals selected recently rewarded targets more often when reward probabilities of different options fluctuated across trials than when they were fixed. Additionally, neurons in the orbitofrontal cortex displayed more sustained activity related to the outcomes of their previous choices when reward probabilities changed over time. Such volatility also enhanced signals in the dorsolateral prefrontal cortex related to the current but not the previous location of the previously rewarded target. These results suggest that prefrontal activity related to choice and reward is dynamically regulated by the volatility of the environment and underscore the role of the prefrontal cortex in identifying aspects of the environment that are responsible for previous outcomes and should be learned.

Neuromodulation of Prefrontal Cortex in Non-Human Primates by Dopaminergic Receptors during Rule-Guided Flexible Behavior and Cognitive Control

The prefrontal cortex (PFC) is indispensable for several higher-order cognitive and executive capacities of primates, including representation of salient stimuli in working memory (WM), maintenance of cognitive task set, inhibition of inappropriate responses and rule-guided flexible behavior. PFC networks are subject to robust neuromodulation from ascending catecholaminergic systems. Disruption of these systems in PFC has been implicated in cognitive deficits associated with several neuropsychiatric disorders. Over the past four decades, a considerable body of work has examined the influence of dopamine on macaque PFC activity representing spatial WM. There has also been burgeoning interest in neuromodulation of PFC circuits involved in other cognitive functions of PFC, including representation of rules to guide flexible behavior. Here, we review recent neuropharmacological investigations conducted in our laboratory and others of the role of PFC dopamine receptors in regulating rule-guided behavior in non-human primates. Employing iontophoresis, we examined the effects of local manipulation of dopaminergic subtypes on neuronal activity during performance of rule-guided pro- and antisaccades, an experimental paradigm sensitive to PFC integrity, wherein deficits in performance are reliably observed in many neuropsychiatric disorders. We found dissociable effects of dopamine receptors on neuronal activity for rule representation and oculomotor responses and discuss these findings in the context of prior studies that have examined the role of dopamine in spatial delayed response tasks, attention, target selection, abstract rules, visuomotor learning and reward. The findings we describe here highlight the common features, as well as heterogeneity and context dependence of dopaminergic neuromodulation in regulating the efficacy of cognitive functions of PFC in health and disease.

Does the Superior Colliculus Control Perceptual Sensitivity or Choice Bias during Attention? Evidence from a Multialternative Decision Framework

Distinct networks in the forebrain and the midbrain coordinate to control spatial attention. The critical involvement of the superior colliculus (SC)-the central structure in the midbrain network-in visuospatial attention has been shown by four seminal, published studies in monkeys (Macaca mulatta) performing multialternative tasks. However, due to the lack of a mechanistic framework for interpreting behavioral data in such tasks, the nature of the SC's contribution to attention remains unclear. Here we present and validate a novel decision framework for analyzing behavioral data in multialternative attention tasks. We apply this framework to re-examine the behavioral evidence from these published studies. Our model is a multidimensional extension to signal detection theory that distinguishes between two major classes of attentional mechanisms: those that alter the quality of sensory information or "sensitivity," and those that alter the selective gating of sensory information or "choice bias." Model-based simulations and model-based analyses of data from these published studies revealed a converging pattern of results that indicated that choice-bias changes, rather than sensitivity changes, were the primary outcome of SC manipulation. Our results suggest that the SC contributes to attentional performance predominantly by generating a spatial choice bias for stimuli at a selected location, and that this bias operates downstream of forebrain mechanisms that enhance sensitivity. The findings lead to a testable mechanistic framework of how the midbrain and forebrain networks interact to control spatial attention.

SIGNIFICANCE STATEMENT

Attention involves the selection of the most relevant information for differential sensory processing and decision making. While the mechanisms by which attention alters sensory encoding (sensitivity control) are well studied, the mechanisms by which attention alters decisional weighting of sensory evidence (choice-bias control) are poorly understood. Here, we introduce a model of multialternative decision making that distinguishes bias from sensitivity effects in attention tasks. With our model, we simulate experimental data from four seminal studies that microstimulated or inactivated a key attention-related midbrain structure, the superior colliculus (SC). We demonstrate that the experimental effects of SC manipulation are entirely consistent with the SC controlling attention by changing choice bias, thereby shedding new light on how the brain mediates attention.

The Roles of Dopamine D2 Receptor in the Social Hierarchy of Rodents and Primates

Dopamine (DA) plays significant roles in regulation of social behavior. In social groups of humans and other animals, social hierarchy exists, which is determined by several behavioral characteristics such as aggression and impulsivity as well as social affiliations. In this study, we investigated the effects of pharmacological blockade of DA D2 receptor on social hierarchy of Japanese macaque and mouse social groups. We found acute administration of the D2 antagonist, sulpiride, in socially housed Japanese macaques attenuated social dominance when the drug was given to high social class macaques. A similar attenuation of social dominance was observed in high social class mice with D2 antagonist administration. In contrast, D2 antagonist administration in low social class macaque resulted in more stable social hierarchy of the group, whereas such effect was not observed in mouse social group. These results suggest that D2 receptor signaling may play important roles in establishment and maintenance of social hierarchy in social groups of several species of animals.

Dopamine Alters the Fidelity of Working Memory Representations according to Attentional Demands

Capacity limitations in working memory (WM) necessitate the need to effectively control its contents. Here, we examined the effect of cabergoline, a dopamine D₂ receptor agonist, on WM using a continuous report paradigm that allowed us to assess the fidelity with which items are stored. We assessed recall performance under three different gating conditions: remembering only one item, being cued to remember one target among distractors, and having to remember all items. Cabergoline had differential effects on recall performance according to whether distractors had to be ignored and whether mnemonic resources could be deployed exclusively to the target. Compared with placebo, cabergoline improved mnemonic performance when there were no distractors but significantly reduced performance when distractors were presented in a precue condition. No significant difference in performance was observed under cabergoline when all items had to be remembered. By applying a stochastic model of response selection, we established that the causes of drug-induced changes in performance were due to changes in the precision with which items were stored in WM. However, there was no change in the extent to which distractors were mistaken for targets. Thus, D₂ agonism causes changes in the fidelity of mnemonic representations without altering interference between memoranda.

Dopamine's Actions in Primate Prefrontal Cortex: Challenges for Treating Cognitive Disorders

The prefrontal cortex (PFC) elaborates and differentiates in primates, and there is a corresponding elaboration in cortical dopamine (DA). DA cells that fire to both aversive and rewarding stimuli likely project to the dorsolateral PFC (dlPFC), signaling a salient event. Since 1979, we have known that DA has an essential influence on dlPFC working memory functions. DA has differing effects via D1 (D1R) versus D2 receptor (D2R) families. D1R are concentrated on dendritic spines, and D1/5R stimulation produces an inverted U-shaped dose response on visuospatial working memory performance and Delay cell firing, the neurons that generate representations of visual space. Optimal levels of D1R stimulation gate out "noise," whereas higher levels, e.g., during stress, suppress Delay cell firing. These effects likely involve hyperpolarization-activated cyclic nucleotide-gated channel opening, activation of GABA interneurons, and reduced glutamate release. Dysregulation of D1R has been related to cognitive deficits in schizophrenia, and there is a need for new, lower-affinity D1R agonists that may better mimic endogenous DA to enhance mental representations and improve cognition. In contrast to D1R, D2R are primarily localized on layer V pyramidal cell dendrites, and D2/3R stimulation speeds and magnifies the firing of Response cells, including Response Feedback cells. Altered firing of Feedback neurons may relate to positive symptoms in schizophrenia. Emerging research suggests that DA may have similar effects in the ventrolateral PFC and frontal eye fields. Research on the orbital PFC in monkeys is just beginning and could be a key area for future discoveries.

Visual attention: Linking prefrontal sources to neuronal and behavioral correlates

Attention is a means of flexibly selecting and enhancing a subset of sensory input based on the current behavioral goals. Numerous signatures of attention have been identified throughout the brain, and now experimenters are seeking to determine which of these signatures are causally related to the behavioral benefits of attention, and the source of these modulations within the brain. Here, we review the neural signatures of attention throughout the brain, their theoretical benefits for visual processing, and their experimental correlations with behavioral performance. We discuss the importance of measuring cue benefits as a way to distinguish between impairments on an attention task, which may instead be visual or motor impairments, and true attentional deficits. We examine evidence for various areas proposed as sources of attentional modulation within the brain, with a focus on the prefrontal cortex. Lastly, we look at studies that aim to link sources of attention to its neuronal signatures elsewhere in the brain.

Combined contributions of feedforward and feedback inputs to bottom-up attention

In order to deal with a large amount of information carried by visual inputs entering the brain at any given point in time, the brain swiftly uses the same inputs to enhance processing in one part of visual field at the expense of the others. These processes, collectively called bottom-up attentional selection, are assumed to solely rely on feedforward processing of the external inputs, as it is implied by the nomenclature. Nevertheless, evidence from recent experimental and modeling studies points to the role of feedback in bottom-up attention. Here, we review behavioral and neural evidence that feedback inputs are important for the formation of signals that could guide attentional selection based on exogenous inputs. Moreover, we review results from a modeling study elucidating mechanisms underlying the emergence of these signals in successive layers of neural populations and how they depend on feedback from higher visual areas. We use these results to interpret and discuss more recent findings that can further unravel feedforward and feedback neural mechanisms underlying bottom-up attention. We argue that while it is descriptively useful to separate feedforward and feedback processes underlying bottom-up attention, these processes cannot be mechanistically separated into two successive stages as they occur at almost the same time and affect neural activity within the same brain areas using similar neural mechanisms. Therefore, understanding the interaction and integration of feedforward and feedback inputs is crucial for better understanding of bottom-up attention.

Multiple influences of reward on perception and attention

Visual processing is influenced by stimulus-driven and goal-driven factors. Recent interest has centered on understanding how reward might provide additional contributions to visual perception and unraveling the underlying neural mechanisms. In this review, I suggest that the impact of reward on vision is not unitary and depends on the type of experimental manipulation. With this in mind, I outline a possible classification of the main paradigms employed in the literature and discuss potential brain processes that operate during some of the experimental manipulations described.

Phasic activation of ventral tegmental neurons increases response and pattern similarity in prefrontal cortex neurons

Dopamine is critical for higher neural processes and modifying the activity of the prefrontal cortex (PFC). However, the mechanism of dopamine contribution to the modification of neural representation is unclear. Using in vivo two-photon population Ca²⁺ imaging in awake mice, this study investigated how neural representation of visual input to PFC neurons is regulated by dopamine. Phasic stimulation of dopaminergic neurons in the ventral tegmental area (VTA) evoked prolonged Ca²⁺ transients, lasting ∼30 s in layer 2/3 neurons of the PFC, which are regulated by a dopamine D1 receptor-dependent pathway. Furthermore, only a conditioning protocol with visual sensory input applied 0.5 s before the VTA dopaminergic input could evoke enhanced Ca²⁺ transients and increased pattern similarity (or establish a neural representation) of PFC neurons to the same sensory input. By increasing both the level of neuronal response and pattern similarity, dopaminergic input may establish robust and reliable cortical representation.

DOI:http://dx.doi.org/10.7554/eLife.02726.001

Around 120 years ago, Ivan Pavlov unintentionally sparked a new field of psychology research. He did so by noting that his dogs had learned to associate the sound of the bell that he rang before feeding them with the food itself, such that they would salivate upon hearing the bell even when there was no food present. This form of learning—now known as associative learning—has since been demonstrated in species from honeybees to humans.

For the brain to associate two events, such as the sound of a bell and the delivery of food, it must encode the first event and keep that information available or ‘on-line’ until the occurrence of the second event, at which point the two can be linked together. This process takes place in part of the brain called the prefrontal cortex, but the mechanism by which it occurs is largely unclear.

Now, Iwashita has obtained new insights into the molecular basis of associative learning by studying how the activity of the prefrontal cortex is affected by the activity of a second region of the brain. This second region, called the ventral tegmental area, is part of the brain's reward circuit: it becomes active whenever an animal experiences a desirable event, such as receiving food, and supplies a neurotransmitter called dopamine to its target areas, which include the prefrontal cortex.

Electrodes were used to mimic the changes in brain activity that occur when a mouse learns to associate a visual stimulus with a reward: this involved repeatedly activating the visual cortex in a conscious mouse, followed by activation of the ventral tegmental area. Short-lived increases in calcium levels were seen in the prefrontal cortex, raising the possibility that these ‘calcium transients’ are the signal that enables the brain to link two events. Moreover, blocking proteins called dopamine D1 receptors in the prefrontal cortex reduced the calcium transients, which is consistent with existing evidence that dopamine from the ventral tegmental area is required for associative learning.

Intriguingly, the calcium transients lasted for roughly 30 s, which is also the maximum length of time by which a stimulus and a reward can be separated and still be associated. Given that the calcium transients could not be detected in anesthetized mice, a full understanding of the mechanisms underlying associative learning may require studies of the conscious brain.

DOI:http://dx.doi.org/10.7554/eLife.02726.002

The role of prefrontal catecholamines in attention and working memory

While much progress has been made in identifying the brain regions and neurochemical systems involved in the cognitive processes disrupted in mental illnesses, to date, the level of detail at which neurobiologists can describe the chain of events giving rise to cognitive functions is very rudimentary. Much of the intense interest in understanding cognitive functions is motivated by the hope that it might be possible to understand these complex functions at the level of neurons and neural circuits. Here, we review the current state of the literature regarding how modulations in catecholamine levels within the prefrontal cortex (PFC) alter the neuronal and behavioral correlates of cognitive functions, particularly attention and working memory.