Differential encoding in prefrontal cortex projection neuron classes across cognitive tasks

Single-cell transcriptomics has been widely applied to classify neurons in the mammalian brain, while systems neuroscience has historically analyzed the encoding properties of cortical neurons without considering cell types. Here we examine how specific transcriptomic types of mouse prefrontal cortex (PFC) projection neurons relate to axonal projections and encoding properties across multiple cognitive tasks. We found that most types projected to multiple targets, and most targets received projections from multiple types, except PFC→PAG (periaqueductal gray). By comparing Ca2+ activity of the molecularly homogeneous PFC→PAG type against two heterogeneous classes in several two-alternative choice tasks in freely moving mice, we found that all task-related signals assayed were qualitatively present in all examined classes. However, PAG-projecting neurons most potently encoded choice in cued tasks, whereas contralateral PFC-projecting neurons most potently encoded reward context in an uncued task. Thus, task signals are organized redundantly, but with clear quantitative biases across cells of specific molecular-anatomical characteristics.

Decoding and perturbing decision states in real time

In dynamic environments, subjects often integrate multiple samples of a signal and combine them to reach a categorical judgment¹. The process of deliberation can be described by a time-varying decision variable (DV), decoded from neural population activity, that predicts a subject's upcoming decision². Within single trials, however, there are large moment-to-moment fluctuations in the DV, the behavioural significance of which is unclear. Here, using real-time, neural feedback control of stimulus duration, we show that within-trial DV fluctuations, decoded from motor cortex, are tightly linked to decision state in macaques, predicting behavioural choices substantially better than the condition-averaged DV or the visual stimulus alone. Furthermore, robust changes in DV sign have the statistical regularities expected from behavioural studies of changes of mind³. Probing the decision process on single trials with weak stimulus pulses, we find evidence for time-varying absorbing decision bounds, enabling us to distinguish between specific models of decision making.

Opportunities and limitations of genetically modified nonhuman primate models for neuroscience research

The recently developed new genome-editing technologies, such as the CRISPR/Cas system, have opened the door for generating genetically modified nonhuman primate (NHP) models for basic neuroscience and brain disorders research. The complex circuit formation and experience-dependent refinement of the human brain are very difficult to model in vitro, and thus require use of in vivo whole-animal models. For many neurodevelopmental and psychiatric disorders, abnormal circuit formation and refinement might be at the center of their pathophysiology. Importantly, many of the critical circuits and regional cell populations implicated in higher human cognitive function and in many psychiatric disorders are not present in lower mammalian brains, while these analogous areas are replicated in NHP brains. Indeed, neuropsychiatric disorders represent a tremendous health and economic burden globally. The emerging field of genetically modified NHP models has the potential to transform our study of higher brain function and dramatically facilitate the development of effective treatment for human brain disorders. In this paper, we discuss the importance of developing such models, the infrastructure and training needed to maximize the impact of such models, and ethical standards required for using these models.

Value and choice as separable and stable representations in orbitofrontal cortex

Value-based decision-making requires different variables-including offer value, choice, expected outcome, and recent history-at different times in the decision process. Orbitofrontal cortex (OFC) is implicated in value-based decision-making, but it is unclear how downstream circuits read out complex OFC responses into separate representations of the relevant variables to support distinct functions at specific times. We recorded from single OFC neurons while macaque monkeys made cost-benefit decisions. Using a novel analysis, we find separable neural dimensions that selectively represent the value, choice, and expected reward of the present and previous offers. The representations are generally stable during periods of behavioral relevance, then transition abruptly at key task events and between trials. Applying new statistical methods, we show that the sensitivity, specificity and stability of the representations are greater than expected from the population's low-level features-dimensionality and temporal smoothness-alone. The separability and stability suggest a mechanism-linear summation over static synaptic weights-by which downstream circuits can select for specific variables at specific times.

Comment on "Single-trial spike trains in parietal cortex reveal discrete steps during decision-making"

Latimeret al (Reports, 10 July 2015, p. 184) claim that during perceptual decision formation, parietal neurons undergo one-time, discrete steps in firing rate instead of gradual changes that represent the accumulation of evidence. However, that conclusion rests on unsubstantiated assumptions about the time window of evidence accumulation, and their stepping model cannot explain existing data as effectively as evidence-accumulation models.

The BRAIN Initiative: developing technology to catalyse neuroscience discovery

The evolution of the field of neuroscience has been propelled by the advent of novel technological capabilities, and the pace at which these capabilities are being developed has accelerated dramatically in the past decade. Capitalizing on this momentum, the United States launched the Brain Research through Advancing Innovative Neurotechnologies (BRAIN) Initiative to develop and apply new tools and technologies for revolutionizing our understanding of the brain. In this article, we review the scientific vision for this initiative set forth by the National Institutes of Health and discuss its implications for the future of neuroscience research. Particular emphasis is given to its potential impact on the mapping and study of neural circuits, and how this knowledge will transform our understanding of the complexity of the human brain and its diverse array of behaviours, perceptions, thoughts and emotions.

Effects of cortical microstimulation on confidence in a perceptual decision

Decisions are often associated with a degree of certainty, or confidence--an estimate of the probability that the chosen option will be correct. Recent neurophysiological results suggest that the central processing of evidence leading to a perceptual decision also establishes a level of confidence. Here we provide a causal test of this hypothesis by electrically stimulating areas of the visual cortex involved in motion perception. Monkeys discriminated the direction of motion in a noisy display and were sometimes allowed to opt out of the direction choice if their confidence was low. Microstimulation did not reduce overall confidence in the decision but instead altered confidence in a manner that mimicked a change in visual motion, plus a small increase in sensory noise. The results suggest that the same sensory neural signals support choice, reaction time, and confidence in a decision and that artificial manipulation of these signals preserves the quantitative relationship between accumulated evidence and confidence.

Dynamics of neural population responses in prefrontal cortex indicate changes of mind on single trials

Decision making is a complex process in which different sources of information are combined into a decision variable (DV) that guides action [1, 2]. Neurophysiological studies have typically sought insight into the dynamics of the decision-making process and its neural mechanisms through statistical analysis of large numbers of trials from sequentially recorded single neurons or small groups of neurons [3-6]. However, detecting and analyzing the DV on individual trials has been challenging [7]. Here we show that by recording simultaneously from hundreds of units in prearcuate gyrus of macaque monkeys performing a direction discrimination task, we can predict the monkey's choices with high accuracy and decode DV dynamically as the decision unfolds on individual trials. This advance enabled us to study changes of mind (CoMs) that occasionally happen before the final commitment to a decision [8-10]. On individual trials, the decoded DV varied significantly over time and occasionally changed its sign, identifying a potential CoM. Interrogating the system by random stopping of the decision-making process during the delay period after stimulus presentation confirmed the validity of identified CoMs. Importantly, the properties of the candidate CoMs also conformed to expectations based on prior theoretical and behavioral studies [8]: they were more likely to go from an incorrect to a correct choice, they were more likely for weak and intermediate stimuli than for strong stimuli, and they were more likely earlier in the trial. We suggest that simultaneous recording of large neural populations provides a good estimate of DV and explains idiosyncratic aspects of the decision-making process that were inaccessible before.

Comment on "In monkeys making value-based decisions, LIP neurons encode cue salience and not action value"

Leathers and Olson (Reports, 5 October 2012, p. 132) draw the strong conclusion that neurons in the monkey lateral intraparietal (LIP) cortical area encode only cue salience, and not action value, during value-based decision-making. Although their findings regarding cue salience are interesting, their broader conclusions are problematic because (i) their primary conclusion is based on responses observed during a brief interval at the beginning of behavioral trials but is extended to all subsequent temporal epochs and (ii) the authors failed to replicate basic hallmarks of LIP physiology observed in those subsequent temporal epochs by many laboratories.

Effective parameters for ultrasound-induced in vivo neurostimulation

Ultrasound-induced neurostimulation has recently gained increasing attention, but little is known about the mechanisms by which it affects neural activity or about the range of acoustic parameters and stimulation protocols that elicit responses. We have established conditions for transcranial stimulation of the nervous system in vivo, using the mouse somatomotor response. We report that (1) continuous-wave stimuli are as effective as or more effective than pulsed stimuli in eliciting responses, and responses are elicited with stimulus onset rather than stimulus offset; (2) stimulation success increases as a function of both acoustic intensity and acoustic duration; (3) interactions of intensity and duration suggest that successful stimulation results from the integration of stimulus amplitude over a time interval of 50 to 150 ms; and (4) the motor response elicited appears to be an all-or-nothing phenomenon, meaning stronger stimulus intensities and durations increase the probability of a motor response without affecting the duration or strength of the response.

Tracking the eye non-invasively: simultaneous comparison of the scleral search coil and optical tracking techniques in the macaque monkey

From human perception to primate neurophysiology, monitoring eye position is critical to the study of vision, attention, oculomotor control, and behavior. Two principal techniques for the precise measurement of eye position—the long-standing sclera-embedded search coil and more recent optical tracking techniques—are in use in various laboratories, but no published study compares the performance of the two methods simultaneously in the same primates. Here we compare two popular systems—a sclera-embedded search coil from C-N-C Engineering and the EyeLink 1000 optical system from SR Research—by recording simultaneously from the same eye in the macaque monkey while the animal performed a simple oculomotor task. We found broad agreement between the two systems, particularly in positional accuracy during fixation, measurement of saccade amplitude, detection of fixational saccades, and sensitivity to subtle changes in eye position from trial to trial. Nonetheless, certain discrepancies persist, particularly elevated saccade peak velocities, post-saccadic ringing, influence of luminance change on reported position, and greater sample-to-sample variation in the optical system. Our study shows that optical performance now rivals that of the search coil, rendering optical systems appropriate for many if not most applications. This finding is consequential, especially for animal subjects, because the optical systems do not require invasive surgery for implantation and repair of search coils around the eye. Our data also allow laboratories using the optical system in human subjects to assess the strengths and limitations of the technique for their own applications.

Dissociation of neuronal and psychophysical responses to local and global motion

Most neurons in cortical area MT (V5) are strongly direction selective, and their activity is closely associated with the perception of visual motion. These neurons have large receptive fields built by combining inputs with smaller receptive fields that respond to local motion. Humans integrate motion over large areas and can perceive what has been referred to as global motion. The large size and direction selectivity of MT receptive fields suggests that MT neurons may represent global motion. We have explored this possibility by measuring responses to a stimulus in which the directions of simultaneously presented local and global motion are independently controlled. Surprisingly, MT responses depended only on the local motion and were unaffected by the global motion. Yet, under similar conditions, human observers perceive global motion and are impaired in discriminating local motion. Although local motion perception might depend on MT signals, global motion perception depends on mechanisms qualitatively different from those in MT. Motion perception therefore does not depend on a single cortical area but reflects the action and interaction of multiple brain systems.

Integration of sensory and reward information during perceptual decision-making in lateral intraparietal cortex (LIP) of the macaque monkey

Single neurons in cortical area LIP are known to carry information relevant to both sensory and value-based decisions that are reported by eye movements. It is not known, however, how sensory and value information are combined in LIP when individual decisions must be based on a combination of these variables. To investigate this issue, we conducted behavioral and electrophysiological experiments in rhesus monkeys during performance of a two-alternative, forced-choice discrimination of motion direction (sensory component). Monkeys reported each decision by making an eye movement to one of two visual targets associated with the two possible directions of motion. We introduced choice biases to the monkeys' decision process (value component) by randomly interleaving balanced reward conditions (equal reward value for the two choices) with unbalanced conditions (one alternative worth twice as much as the other). The monkeys' behavior, as well as that of most LIP neurons, reflected the influence of all relevant variables: the strength of the sensory information, the value of the target in the neuron's response field, and the value of the target outside the response field. Overall, detailed analysis and computer simulation reveal that our data are consistent with a two-stage drift diffusion model proposed by Diederich and Bussmeyer [1] for the effect of payoffs in the context of sensory discrimination tasks. Initial processing of payoff information strongly influences the starting point for the accumulation of sensory evidence, while exerting little if any effect on the rate of accumulation of sensory evidence.

Can monkeys choose optimally when faced with noisy stimuli and unequal rewards?

We review the leaky competing accumulator model for two-alternative forced-choice decisions with cued responses, and propose extensions to account for the influence of unequal rewards. Assuming that stimulus information is integrated until the cue to respond arrives and that firing rates of stimulus-selective neurons remain well within physiological bounds, the model reduces to an Ornstein-Uhlenbeck (OU) process that yields explicit expressions for the psychometric function that describes accuracy. From these we compute strategies that optimize the rewards expected over blocks of trials administered with mixed difficulty and reward contingencies. The psychometric function is characterized by two parameters: its midpoint slope, which quantifies a subject's ability to extract signal from noise, and its shift, which measures the bias applied to account for unequal rewards. We fit these to data from two monkeys performing the moving dots task with mixed coherences and reward schedules. We find that their behaviors averaged over multiple sessions are close to optimal, with shifts erring in the direction of smaller penalties. We propose two methods for biasing the OU process to produce such shifts.

The neuronal basis of motion perception

The central nervous system of humans supports a range of cognitive functions that contribute to conscious mental states. The neural systems underlying several of these cognitive functions, including perception, memory, planning and action, are proving susceptible to experimental analysis in lower primate species such as rhesus monkeys. In particular, recent investigations have generated striking new insights concerning the neural mechanisms that mediate visual perception. We briefly review the functional organization of the primate visual pathways and describe new experiments that demonstrate a causal link between neural activity in one of these pathways and a specific aspect of perceptual performance. The experiments illustrate an incisive method for linking perceptual abilities to their neural substrates. This approach may prove applicable to the analysis of other cognitive functions as well.

Brain stimulation: feeling the buzz

A recent study demonstrates that artificially generated patterns of brain activity are surprisingly easy to sense. Brain areas that differ substantially in their functional specialization are remarkably similar in their ability to support this awareness.

Linear-Nonlinear-Poisson models of primate choice dynamics

The equilibrium phenomenon of matching behavior traditionally has been studied in stationary environments. Here we attempt to uncover the local mechanism of choice that gives rise to matching by studying behavior in a highly dynamic foraging environment. In our experiments, 2 rhesus monkeys (Macacca mulatta) foraged for juice rewards by making eye movements to one of two colored icons presented on a computer monitor, each rewarded on dynamic variable-interval schedules. Using a generalization of Wiener kernel analysis, we recover a compact mechanistic description of the impact of past reward on future choice in the form of a Linear-Nonlinear-Poisson model. We validate this model through rigorous predictive and generative testing. Compared to our earlier work with this same data set, this model proves to be a better description of choice behavior and is more tightly correlated with putative neural value signals. Refinements over previous models include hyperbolic (as opposed to exponential) temporal discounting of past rewards, and differential (as opposed to fractional) comparisons of option value. Through numerical simulation we find that within this class of strategies, the model parameters employed by animals are very close to those that maximize reward harvesting efficiency.

Local field potential in cortical area MT: stimulus tuning and behavioral correlations

Low-frequency electrical signals like those that compose the local field potential (LFP) can be detected at substantial distances from their point of origin within the brain. It is thus unclear how useful the LFP might be for assessing local function, for example, on the spatial scale of cortical columns. We addressed this problem by comparing speed and direction tuning of LFPs obtained from middle temporal area MT with the tuning of multiunit (MU) activity recorded simultaneously. We found that the LFP can be well tuned for speed and direction and is highly correlated with that of MU activity, particularly for frequencies at and above the gamma band. LFP tuning is substantially poorer for lower frequencies, although tuning for direction extends to lower frequencies than does tuning for speed. Our data suggest that LFP signals at and above the gamma band reflect neural processing on the spatial scale of cortical columns, within a few hundred micrometers of the electrode tip. Consistent with this notion, we also found that frequencies at and above the gamma band measured during a speed discrimination task exhibit an effect known as "choice probability," which reveals a particularly close relationship between neural activity and behavioral choices. In the LFP, this signature of the perceptual choice comprises a shift in relative power from low-frequency bands (alpha and beta) to the gamma band. It remains to be determined how LFP choice probability, which is a temporal signature, is related to conventional choice probability effects observed in spike rates.

Correlation between speed perception and neural activity in the middle temporal visual area

We conducted electrophysiological recording and microstimulation experiments to test the hypothesis that the middle temporal visual area (MT) plays a direct role in perception of the speed of moving visual stimuli. We trained rhesus monkeys on a speed discrimination task in which monkeys chose the faster speed of two moving random dot patterns presented simultaneously in spatially segregated apertures. In electrophysiological experiments, we analyzed the activity of speed-tuned MT neurons and multiunit clusters during the discrimination task. Neural activity was correlated with the monkeys' behavioral choices on a trial-to-trial basis (choice probability), and the correlation was predicted by the speed-tuning properties of each unit. In microstimulation experiments, we activated clusters of MT neurons with homogeneous speed-tuning properties during the same speed discrimination task. In one monkey, microstimulation biased speed judgments toward the preferred speed of the stimulated neurons. Together, evidence from these two experiments suggests that MT neurons play a direct role in the perception of visual speed. Comparison of psychometric and neurometric thresholds revealed that single and multineuronal signals were, on average, considerably less sensitive than were the monkeys perceptually, suggesting that signals must be pooled across neurons to account for performance.

Cone signal interactions in direction-selective neurons in the middle temporal visual area (MT)

Many experimental measurements support the hypothesis that the middle temporal visual area (MT) of the rhesus monkey has a central role in processing visual motion. Most of these studies were performed using luminance stimuli, leaving open the question of how color information is used during motion processing. We investigated the specific question of how S-cone signals, an important source of color information, interact with L,M-cone signals, the dominant source of luminance information. In MT, S-cone-initiated signals combine synergistically with L,M-cone (luminance) signals over most of the stimulus range, regardless of whether the stimuli are added or subtracted. A quantitative analysis of the responses to the combination of S- and L,M-cone signals shows that for a significant minority of cells, these S-cone signals are carried to MT by a color-opponent ("blue-yellow") pathway, such that in certain limited contrast ranges, a small amount of S- and L,M-cone cancellation is observed. Both S- and L,M-cone responses are direction-selective, suggesting that MT processes a wide range of motion signals, including those carried by luminance and color. To investigate this possibility further, we measured MT responses while monkeys discriminated the direction of motion of luminance and S-cone-initiated gratings. The sensitivity of single MT neurons and the correlation between trial-to-trial variations in single neuron firing and perception are similar for S- and L,M-cone stimuli, further supporting a role for MT in processing chromatic motion.

Choosing the greater of two goods: neural currencies for valuation and decision making

To make adaptive decisions, animals must evaluate the costs and benefits of available options. The nascent field of neuroeconomics has set itself the ambitious goal of understanding the brain mechanisms that are responsible for these evaluative processes. A series of recent neurophysiological studies in monkeys has begun to address this challenge using novel methods to manipulate and measure an animal's internal valuation of competing alternatives. By emphasizing the behavioural mechanisms and neural signals that mediate decision making under conditions of uncertainty, these studies might lay the foundation for an emerging neurobiology of choice behaviour.

A general mechanism for decision-making in the human brain?

A new fMRI study by Heekeren and colleagues suggests that left dorsolateral prefrontal cortex (DLPFC) contains a region that integrates sensory evidence supporting perceptual decisions. DLPFC meets two criteria posited by Heekeren et al. for such a region: (1) its activity is correlated in time with the output of sensory areas of the visual cortex measured simultaneously, and (2) as expected of an integrator, its activity is greater on trials for which the sensory evidence is substantial than on trials for which the sensory evidence is weak. Complementary experiments in humans and monkeys now offer a realistic hope of elucidating decision-making networks in the primate brain.

Microstimulation of the superior colliculus focuses attention without moving the eyes

The superior colliculus (SC) is part of a network of brain areas that directs saccadic eye movements, overtly shifting both gaze and attention from position to position, in space. Here, we seek direct evidence that the SC also contributes to the control of covert spatial attention, a process that focuses attention on a region of space different from the point of gaze. While requiring monkeys to keep their gaze fixed, we tested whether microstimulation of a specific location in the SC spatial map would enhance visual performance at the corresponding region of space, a diagnostic measure of covert attention. We find that microstimulation improves performance in a spatially selective manner: thresholds decrease at the location in visual space represented by the stimulated SC site, but not at a control location in the opposite hemifield. Our data provide direct evidence that the SC contributes to the control of covert spatial attention.

Direction-selective visual responses in macaque superior colliculus induced by behavioral training

In a previous report, we described a heretofore undetected population of neurons in the intermediate and deep layers of the monkey superior colliculus (SC) that yielded directionally selective visual responses to stimuli presented within the central 4 degrees of the visual field. We observed these neurons in three monkeys that had been extensively trained to perform a visual direction discrimination task in this region of the visual field. The task required the monkeys to report the perceived direction of motion by making a saccadic eye movement to one of two targets aligned with the two possible directions of motion. We hypothesized that these neurons reflect a learned association between visual motion direction and saccade direction formed through extensive training on the direction discrimination task. We tested this hypothesis by searching for direction-selective visual responses in two monkeys that had been trained to perform a similar motion discrimination task in which the direction of stimulus motion was dissociated from the direction of the operant saccade. Strongly directional visual responses were absent in these monkeys, consistent with the notion that extensive training can induce highly specific visual responses in a subpopulation of SC neurons.

Matching behavior and the representation of value in the parietal cortex

Psychologists and economists have long appreciated the contribution of reward history and expectation to decision-making. Yet we know little about how specific histories of choice and reward lead to an internal representation of the "value" of possible actions. We approached this problem through an integrated application of behavioral, computational, and physiological techniques. Monkeys were placed in a dynamic foraging environment in which they had to track the changing values of alternative choices through time. In this context, the monkeys' foraging behavior provided a window into their subjective valuation. We found that a simple model based on reward history can duplicate this behavior and that neurons in the parietal cortex represent the relative value of competing actions predicted by this model.

What electrical microstimulation has revealed about the neural basis of cognition

Neurophysiologists have shown repeatedly that neural activity in different brain structures can be correlated with specific perceptual and cognitive functions, but the causal efficacy of the observed activity has generally been a matter of conjecture. By contrast, electrical microstimulation, which allows the experimenter to manipulate the activity of small groups of neurons with spatial and temporal precision, can now be used to demonstrate causal links between neural activity and specific cognitive functions. Here, we review this growing literature, including applications to the study of attention, visual and somatosensory perception, 'read-out' mechanisms for interpreting sensory maps, and contextual effects on perception. We also discuss potential applications of microstimulation to studies of higher cognitive functions such as decision-making and subjective experience.

Representation of an Abstract Perceptual Decision in Macaque Superior Colliculus

We recorded from neurons in the intermediate and deep layers of the superior colliculus (SC) while monkeys performed a novel direction discrimination task. In contrast to the task we used previously, the new version required the monkey to dissociate perceptual judgments from preparation to execute specific operant saccades. The monkey discriminated between 2 opposed directions of motion in a random-dot motion stimulus and was required to maintain the decision in memory throughout a delay period before the target of the required operant saccade was revealed. We hypothesized that perceptual decisions made in this paradigm would be represented in an “abstract” or “categorical” form within the brain, probably in the frontal cortex, and that decision-related neural activity would be eliminated from spatially organized preoculomotor structures such as the SC. To our surprise, however, a small population of neurons in the intermediate and deep layers of the SC fired in a choice-specific manner early in the trial well before the monkey could plan the operant saccade. Furthermore, the representation of the decision during the delay period appeared to be spatial: the active region in the SC map corresponded to the region of space toward which the perceptually discriminated stimulus motion flowed. Electrical microstimulation experiments suggested that these decision-related SC signals were not merely related to covert saccade planning. We conclude that monkeys may employ, in part, a spatially referenced mnemonic strategy for representing perceptual decisions, even when an abstract, categorical representation might appear more likely a priori.

Perceptual "read-out" of conjoined direction and disparity maps in extrastriate area MT

Cortical neurons are frequently tuned to several stimulus dimensions, and many cortical areas contain intercalated maps of multiple variables. Relatively little is known about how information is "read out" of these multidimensional maps. For example, how does an organism extract information relevant to the task at hand from neurons that are also tuned to other, irrelevant stimulus dimensions? We addressed this question by employing microstimulation techniques to examine the contribution of disparity-tuned neurons in the middle temporal (MT) visual area to performance on a direction discrimination task. Most MT neurons are tuned to both binocular disparity and the direction of stimulus motion, and MT contains topographic maps of both parameters. We assessed the effect of microstimulation on direction judgments after first characterizing the disparity tuning of each stimulation site. Although the disparity of the stimulus was irrelevant to the required task, we found that microstimulation effects were strongly modulated by the disparity tuning of the stimulated neurons. For two of three monkeys, microstimulation of nondisparity-selective sites produced large biases in direction judgments, whereas stimulation of disparity-selective sites had little or no effect. The binocular disparity was optimized for each stimulation site, and our result could not be explained by variations in direction tuning, response strength, or any other tuning property that we examined. When microstimulation of a disparity-tuned site did affect direction judgments, the effects tended to be stronger at the preferred disparity of a stimulation site than at the nonpreferred disparity, indicating that monkeys can selectively monitor direction columns that are best tuned to an appropriate conjunction of parameters. We conclude that the contribution of neurons to behavior can depend strongly upon tuning to stimulus dimensions that appear to be irrelevant to the current task, and we suggest that these findings are best explained in terms of the strategy used by animals to perform the task.

Functional organization of speed tuned neurons in visual area MT

We analyzed the functional organization of speed tuned neurons in extrastriate visual area MT. We sought to determine whether neurons tuned for particular speeds are clustered spatially and whether such spatial clusters are elongated normal to the cortical surface so as to form speed columns. Our data showed that MT neurons are indeed clustered according to preferred speed. Multiunit recordings were speed tuned, and the speed tuning of these signals was well correlated with the speed tuning of single neurons recorded simultaneously. To determine whether speed columns exist in MT, we compared the rates at which preferred speed changed in electrode tracks that traversed MT obliquely and normally to the cortical surface. If speed columns exist, the preferred speed should change at a faster rate during oblique electrode tracks. We found, however, that preferred speed changed at similar rates for either type of penetration. In the same data set, the rate of change of preferred direction and preferred disparity differed substantially in normal and oblique penetrations as expected from the known columnar organization of MT. Thus our results suggest that a columnar organization for speed tuned neurons does not exist in MT.

Middle temporal visual area microstimulation influences veridical judgments of motion direction

Microstimulation of direction columns in the middle temporal visual area (MT, or V5) provides a powerful tool for probing the relationship between cortical physiology and visual motion perception. In the current study we obtained "veridical" reports of perceived motion from rhesus monkeys by permitting a continuous range of possible responses that mapped isomorphically onto a continuous range of possible motion directions. In contrast to previous studies, therefore, the animals were freed from experimenter-imposed "categories" that typify forced choice tasks. We report three new findings: (1) MT neurons with widely disparate preferred directions can cooperate to shape direction estimates, inconsistent with a pure "winner-take-all" read-out algorithm and consistent with a distributed coding scheme like vector averaging, whereas neurons with nearly opposite preferred directions seem to compete in a manner consistent with the winner-take-all hypothesis, (2) microstimulation can influence direction estimates even when paired with the most powerful motion stimuli available, and (3) microstimulation effects can be elicited when a manual response (instead of our standard oculomotor response) is used to communicate the perceptual report.

Target selection for saccadic eye movements: prelude activity in the superior colliculus during a direction-discrimination task

We investigated the role of the superior colliculus (SC) in saccade target selection while macaque monkeys performed a direction-discrimination task. The monkeys selected one of two possible saccade targets based on the direction of motion in a stochastic random-dot display; the difficulty of the task was varied by adjusting the strength of the motion signal in the display. One of the two saccade targets was positioned within the movement field of the SC neuron under study while the other target was positioned well outside the movement field. Approximately 30% of the neurons in the intermediate and deep layers of the SC discharged target-specific preludes of activity that "predicted" target choices well before execution of the saccadic eye movement. Across the population of neurons, the strength of the motion signal in the display influenced the intensity of this "predictive" prelude activity: SC activity signaled the impending saccade more reliably when the motion signal was strong than when it was weak. The dependence of neural activity on motion strength could not be explained by small variations in the metrics of the saccadic eye movements. Predictive activity was particularly strong in a subpopulation of neurons with directional visual responses that we have described previously. For a subset of SC neurons, therefore, prelude activity reflects the difficulty of the direction discrimination in addition to the target of the impending saccade. These results are consistent with the notion that a restricted network of SC neurons plays a role in the process of saccade target selection.

Target selection for saccadic eye movements: direction-selective visual responses in the superior colliculus

We investigated the role of the superior colliculus (SC) in saccade target selection in rhesus monkeys who were trained to perform a direction-discrimination task. In this task, the monkey discriminated between opposed directions of visual motion and indicated its judgment by making a saccadic eye movement to one of two visual targets that were spatially aligned with the two possible directions of motion in the display. Thus the neural circuits that implement target selection in this task are likely to receive directionally selective visual inputs and be closely linked to the saccadic system. We therefore studied prelude neurons in the intermediate and deep layers of the SC that can discharge up to several seconds before an impending saccade, indicating a relatively high-level role in saccade planning. We used the direction-discrimination task to identify neurons whose prelude activity "predicted" the impending perceptual report several seconds before the animal actually executed the operant eye movement; these "choice predicting" cells comprised approximately 30% of the neurons we encountered in the intermediate and deep layers of the SC. Surprisingly, about half of these prelude cells yielded direction-selective responses to our motion stimulus during a passive fixation task. In general, these neurons responded to motion stimuli in many locations around the visual field including the center of gaze where the visual discriminanda were positioned during the direction-discrimination task. Preferred directions generally pointed toward the location of the movement field of the SC neuron in accordance with the sensorimotor demands of the discrimination task. Control experiments indicate that the directional responses do not simply reflect covertly planned saccades. Our results indicate that a small population of SC prelude neurons exhibits properties appropriate for linking stimulus cues to saccade target selection in the context of a visual discrimination task.

Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey

We recorded the activity of single neurons in the posterior parietal cortex (area LIP) of two rhesus monkeys while they discriminated the direction of motion in random-dot visual stimuli. The visual task was similar to a motion discrimination task that has been used in previous investigations of motion-sensitive regions of the extrastriate cortex. The monkeys were trained to decide whether the direction of motion was toward one of two choice targets that appeared on either side of the random-dot stimulus. At the end of the trial, the monkeys reported their direction judgment by making an eye movement to the appropriate target. We studied neurons in LIP that exhibited spatially selective persistent activity during delayed saccadic eye movement tasks. These neurons are thought to carry high-level signals appropriate for identifying salient visual targets and for guiding saccadic eye movements. We arranged the motion discrimination task so that one of the choice targets was in the LIP neuron's response field (RF) while the other target was positioned well away from the RF. During motion viewing, neurons in LIP altered their firing rate in a manner that predicted the saccadic eye movement that the monkey would make at the end of the trial. The activity thus predicted the monkey's judgment of motion direction. This predictive activity began early in the motion-viewing period and became increasingly reliable as the monkey viewed the random-dot motion. The neural activity predicted the monkey's direction judgment on both easy and difficult trials (strong and weak motion), whether or not the judgment was correct. In addition, the timing and magnitude of the response was affected by the strength of the motion signal in the stimulus. When the direction of motion was toward the RF, stronger motion led to larger neural responses earlier in the motion-viewing period. When motion was away from the RF, stronger motion led to greater suppression of ongoing activity. Thus the activity of single neurons in area LIP reflects both the direction of an impending gaze shift and the quality of the sensory information that instructs such a response. The time course of the neural response suggests that LIP accumulates sensory signals relevant to the selection of a target for an eye movement.

Correlated firing in macaque visual area MT: time scales and relationship to behavior

We studied the simultaneous activity of pairs of neurons recorded with a single electrode in visual cortical area MT while monkeys performed a direction discrimination task. Previously, we reported the strength of interneuronal correlation of spike count on the time scale of the behavioral epoch (2 sec) and noted its potential impact on signal pooling (Zohary et al., 1994). We have now examined correlation at longer and shorter time scales and found that pair-wise cross-correlation was predominantly short term (10-100 msec). Narrow, central peaks in the spike train cross-correlograms were largely responsible for correlated spike counts on the time scale of the behavioral epoch. Longer-term (many seconds to minutes) changes in the responsiveness of single neurons were observed in auto-correlations; however, these slow changes in time were on average uncorrelated between neurons. Knowledge of the limited time scale of correlation allowed the derivation of a more efficient metric for spike count correlation based on spike timing information, and it also revealed a potential relative advantage of larger neuronal pools for shorter integration times. Finally, correlation did not depend on the presence of the visual stimulus or the behavioral choice of the animal. It varied little with stimulus condition but was stronger between neurons with similar direction tuning curves. Taken together, our results strengthen the view that common input, common stimulus selectivity, and common noise are tightly linked in functioning cortical circuits.

Somatosensation: Touching the mind's fingers

Whether mental operations can be reduced to the biological properties of the brain has intrigued scientists and philosophers alike for millennia. New microstimulation experiments on awake, behaving monkeys establish causality between activity of specialized cortical neurons and a controlled behavior.

Visuo-motor control: giving the brain a hand

Sensory information is acquired in spatial coordinate systems linked to sense organs, yet movement must be executed in coordinate systems linked to motor effector organs. Neurophysiological experiments are yielding new insights into how the brain transforms coordinate systems to facilitate movement.

The neurobiology of cognition

Perhaps the deepest mysteries facing the natural sciences concern the higher functions of the central nervous system. Understanding how the brain gives rise to mental experiences looms as one of the central challenges for science in the new millennium.

Color signals in human motion-selective cortex

The neural basis for the effects of color and contrast on perceived speed was examined using functional magnetic resonance imaging (fMRI). Responses to S cone (blue-yellow) and L + M cone (luminance) patterns were measured in area V1 and in the motion area MT+. The MT+ responses were quantitatively similar to perceptual speed judgments of color patterns but not to color detection measures. We also measured cortical motion responses in individuals lacking L and M cone function (S cone monochromats). The S cone monochromats have clear motion-responsive regions in the conventional MT+ position, and their contrast-response functions there have twice the responsivity of S cone contrast-response functions in normal controls. But, their responsivity is far lower than the normals' responsivity to luminance contrast. Thus, the powerful magnocellular input to MT+ is either weak or silent during photopic vision in S cone monochromats.

Color signals in area MT of the macaque monkey

The relationship between the neural processing of color and motion information has been a contentious issue in visual neuroscience. We examined this relationship directly by measuring neural responses to isoluminant S cone signals in extrastriate area MT of the macaque monkey. S cone stimuli produced robust, direction-selective responses at most recording sites, indicating that color signals are present in MT. While these responses were unequivocal, S cone contrast sensitivity was, on average, 1.0-1.3 log units lower than luminance contrast sensitivity. The presence of S cone responses and the relative sensitivity of MT neurons to S cone and luminance signals agree with functional magnetic resonance imaging (fMRI) measurements in human MT+. The results are consistent with the hypothesis that color signals in MT influence behavior in speed judgment tasks.

Motion opponency in visual cortex

Perceptual studies suggest that visual motion perception is mediated by opponent mechanisms that correspond to mutually suppressive populations of neurons sensitive to motions in opposite directions. We tested for a neuronal correlate of motion opponency using functional magnetic resonance imaging (fMRI) to measure brain activity in human visual cortex. There was strong motion opponency in a secondary visual cortical area known as the human MT complex (MT+), but there was little evidence of motion opponency in primary visual cortex. To determine whether the level of opponency in human and monkey are comparable, a variant of these experiments was performed using multiunit electrophysiological recording in areas MT and MST of the macaque monkey brain. Although there was substantial variability in the degree of opponency between recording sites, the monkey and human data were qualitatively similar on average. These results provide further evidence that: (1) direction-selective signals underly human MT+ responses, (2) neuronal signals in human MT+ support visual motion perception, (3) human MT+ is homologous to macaque monkey MT and adjacent motion sensitive brain areas, and (4) that fMRI measurements are correlated with average spiking activity.

Separate signals for target selection and movement specification in the superior colliculus

At any given instant, multiple potential targets for saccades are present in the visual world, implying that a "selection process" within the brain determines the target of the next eye movement. Some superior colliculus (SC) neurons begin discharging seconds before saccade initiation, suggesting involvement in target selection or, alternatively, in postselectional saccade preparation. SC neurons were recorded in monkeys who selected saccade targets on the basis of motion direction in a visual display. Some neurons carried a direction-selective visual signal, consistent with a role in target selection in this task, whereas other SC neurons appeared to be more involved in postselection specification of saccade parameters.

Effect of spatial attention on the responses of area MT neurons

This study examines the influence of spatial attention on the responses of neurons in the middle temporal visual area (MT or V5) of extrastriate cortex. Two monkeys were trained to perform a direction-discrimination task. On each trial, two apertures of random-dot stimuli appeared simultaneously at two spatially separated locations; the monkeys were required to discriminate the direction of stimulus motion at one location while ignoring the stimulus at the other location. After extensive training, we recorded the responses of MT neurons in two configurations: 1) Both apertures placed "within" the neuron's receptive field (RF) and 2) one aperture covering the RF while the other was presented at a "remote" location. For each unit we compared the responses to identical stimulus displays when the monkey was instructed to attend to one or the other aperture. The responses of MT neurons were 8.7% stronger, on average, when the monkey attended to the spatial location that contained motion in the "preferred" direction. Attentional effects were equal, on average, in the within RF and remote configurations. The attentional modulations began approximately 300 ms after stimulus onset, gradually increased throughout the trial, and peaked near stimulus offset. An analysis of the neuronal responses on error trials suggests that the monkeys failed to attend to the appropriate spatial location on these trials. The relatively weak attentional effects that we observed contrast strikingly with recent results of Treue and Maunsell, who demonstrated very strong attentional modulations (median effect >80%) in MT in a task that shares many features with ours. Our results suggest that spatial attention alone is not sufficient to induce strong attentional effects in MT even when two competing motion stimuli appear within the RF of the recorded neuron. The difference between our results and those of Treue and Maunsell suggests that the magnitude of the attentional effects in MT may depend critically on how attention is directed to a particular stimulus and on the precise demands of the task.