A general mechanism for decision-making in the human brain?

A new fMRI study by Heekeren and colleagues suggests that left dorsolateral prefrontal cortex (DLPFC) contains a region that integrates sensory evidence supporting perceptual decisions. DLPFC meets two criteria posited by Heekeren et al. for such a region: (1) its activity is correlated in time with the output of sensory areas of the visual cortex measured simultaneously, and (2) as expected of an integrator, its activity is greater on trials for which the sensory evidence is substantial than on trials for which the sensory evidence is weak. Complementary experiments in humans and monkeys now offer a realistic hope of elucidating decision-making networks in the primate brain.

Microstimulation of the superior colliculus focuses attention without moving the eyes

The superior colliculus (SC) is part of a network of brain areas that directs saccadic eye movements, overtly shifting both gaze and attention from position to position, in space. Here, we seek direct evidence that the SC also contributes to the control of covert spatial attention, a process that focuses attention on a region of space different from the point of gaze. While requiring monkeys to keep their gaze fixed, we tested whether microstimulation of a specific location in the SC spatial map would enhance visual performance at the corresponding region of space, a diagnostic measure of covert attention. We find that microstimulation improves performance in a spatially selective manner: thresholds decrease at the location in visual space represented by the stimulated SC site, but not at a control location in the opposite hemifield. Our data provide direct evidence that the SC contributes to the control of covert spatial attention.

Direction-selective visual responses in macaque superior colliculus induced by behavioral training

In a previous report, we described a heretofore undetected population of neurons in the intermediate and deep layers of the monkey superior colliculus (SC) that yielded directionally selective visual responses to stimuli presented within the central 4 degrees of the visual field. We observed these neurons in three monkeys that had been extensively trained to perform a visual direction discrimination task in this region of the visual field. The task required the monkeys to report the perceived direction of motion by making a saccadic eye movement to one of two targets aligned with the two possible directions of motion. We hypothesized that these neurons reflect a learned association between visual motion direction and saccade direction formed through extensive training on the direction discrimination task. We tested this hypothesis by searching for direction-selective visual responses in two monkeys that had been trained to perform a similar motion discrimination task in which the direction of stimulus motion was dissociated from the direction of the operant saccade. Strongly directional visual responses were absent in these monkeys, consistent with the notion that extensive training can induce highly specific visual responses in a subpopulation of SC neurons.

Matching behavior and the representation of value in the parietal cortex

Psychologists and economists have long appreciated the contribution of reward history and expectation to decision-making. Yet we know little about how specific histories of choice and reward lead to an internal representation of the "value" of possible actions. We approached this problem through an integrated application of behavioral, computational, and physiological techniques. Monkeys were placed in a dynamic foraging environment in which they had to track the changing values of alternative choices through time. In this context, the monkeys' foraging behavior provided a window into their subjective valuation. We found that a simple model based on reward history can duplicate this behavior and that neurons in the parietal cortex represent the relative value of competing actions predicted by this model.

What electrical microstimulation has revealed about the neural basis of cognition

Neurophysiologists have shown repeatedly that neural activity in different brain structures can be correlated with specific perceptual and cognitive functions, but the causal efficacy of the observed activity has generally been a matter of conjecture. By contrast, electrical microstimulation, which allows the experimenter to manipulate the activity of small groups of neurons with spatial and temporal precision, can now be used to demonstrate causal links between neural activity and specific cognitive functions. Here, we review this growing literature, including applications to the study of attention, visual and somatosensory perception, 'read-out' mechanisms for interpreting sensory maps, and contextual effects on perception. We also discuss potential applications of microstimulation to studies of higher cognitive functions such as decision-making and subjective experience.

Representation of an Abstract Perceptual Decision in Macaque Superior Colliculus

We recorded from neurons in the intermediate and deep layers of the superior colliculus (SC) while monkeys performed a novel direction discrimination task. In contrast to the task we used previously, the new version required the monkey to dissociate perceptual judgments from preparation to execute specific operant saccades. The monkey discriminated between 2 opposed directions of motion in a random-dot motion stimulus and was required to maintain the decision in memory throughout a delay period before the target of the required operant saccade was revealed. We hypothesized that perceptual decisions made in this paradigm would be represented in an “abstract” or “categorical” form within the brain, probably in the frontal cortex, and that decision-related neural activity would be eliminated from spatially organized preoculomotor structures such as the SC. To our surprise, however, a small population of neurons in the intermediate and deep layers of the SC fired in a choice-specific manner early in the trial well before the monkey could plan the operant saccade. Furthermore, the representation of the decision during the delay period appeared to be spatial: the active region in the SC map corresponded to the region of space toward which the perceptually discriminated stimulus motion flowed. Electrical microstimulation experiments suggested that these decision-related SC signals were not merely related to covert saccade planning. We conclude that monkeys may employ, in part, a spatially referenced mnemonic strategy for representing perceptual decisions, even when an abstract, categorical representation might appear more likely a priori.

Perceptual "read-out" of conjoined direction and disparity maps in extrastriate area MT

Cortical neurons are frequently tuned to several stimulus dimensions, and many cortical areas contain intercalated maps of multiple variables. Relatively little is known about how information is "read out" of these multidimensional maps. For example, how does an organism extract information relevant to the task at hand from neurons that are also tuned to other, irrelevant stimulus dimensions? We addressed this question by employing microstimulation techniques to examine the contribution of disparity-tuned neurons in the middle temporal (MT) visual area to performance on a direction discrimination task. Most MT neurons are tuned to both binocular disparity and the direction of stimulus motion, and MT contains topographic maps of both parameters. We assessed the effect of microstimulation on direction judgments after first characterizing the disparity tuning of each stimulation site. Although the disparity of the stimulus was irrelevant to the required task, we found that microstimulation effects were strongly modulated by the disparity tuning of the stimulated neurons. For two of three monkeys, microstimulation of nondisparity-selective sites produced large biases in direction judgments, whereas stimulation of disparity-selective sites had little or no effect. The binocular disparity was optimized for each stimulation site, and our result could not be explained by variations in direction tuning, response strength, or any other tuning property that we examined. When microstimulation of a disparity-tuned site did affect direction judgments, the effects tended to be stronger at the preferred disparity of a stimulation site than at the nonpreferred disparity, indicating that monkeys can selectively monitor direction columns that are best tuned to an appropriate conjunction of parameters. We conclude that the contribution of neurons to behavior can depend strongly upon tuning to stimulus dimensions that appear to be irrelevant to the current task, and we suggest that these findings are best explained in terms of the strategy used by animals to perform the task.

Functional organization of speed tuned neurons in visual area MT

We analyzed the functional organization of speed tuned neurons in extrastriate visual area MT. We sought to determine whether neurons tuned for particular speeds are clustered spatially and whether such spatial clusters are elongated normal to the cortical surface so as to form speed columns. Our data showed that MT neurons are indeed clustered according to preferred speed. Multiunit recordings were speed tuned, and the speed tuning of these signals was well correlated with the speed tuning of single neurons recorded simultaneously. To determine whether speed columns exist in MT, we compared the rates at which preferred speed changed in electrode tracks that traversed MT obliquely and normally to the cortical surface. If speed columns exist, the preferred speed should change at a faster rate during oblique electrode tracks. We found, however, that preferred speed changed at similar rates for either type of penetration. In the same data set, the rate of change of preferred direction and preferred disparity differed substantially in normal and oblique penetrations as expected from the known columnar organization of MT. Thus our results suggest that a columnar organization for speed tuned neurons does not exist in MT.

Middle temporal visual area microstimulation influences veridical judgments of motion direction

Microstimulation of direction columns in the middle temporal visual area (MT, or V5) provides a powerful tool for probing the relationship between cortical physiology and visual motion perception. In the current study we obtained "veridical" reports of perceived motion from rhesus monkeys by permitting a continuous range of possible responses that mapped isomorphically onto a continuous range of possible motion directions. In contrast to previous studies, therefore, the animals were freed from experimenter-imposed "categories" that typify forced choice tasks. We report three new findings: (1) MT neurons with widely disparate preferred directions can cooperate to shape direction estimates, inconsistent with a pure "winner-take-all" read-out algorithm and consistent with a distributed coding scheme like vector averaging, whereas neurons with nearly opposite preferred directions seem to compete in a manner consistent with the winner-take-all hypothesis, (2) microstimulation can influence direction estimates even when paired with the most powerful motion stimuli available, and (3) microstimulation effects can be elicited when a manual response (instead of our standard oculomotor response) is used to communicate the perceptual report.

Target selection for saccadic eye movements: prelude activity in the superior colliculus during a direction-discrimination task

We investigated the role of the superior colliculus (SC) in saccade target selection while macaque monkeys performed a direction-discrimination task. The monkeys selected one of two possible saccade targets based on the direction of motion in a stochastic random-dot display; the difficulty of the task was varied by adjusting the strength of the motion signal in the display. One of the two saccade targets was positioned within the movement field of the SC neuron under study while the other target was positioned well outside the movement field. Approximately 30% of the neurons in the intermediate and deep layers of the SC discharged target-specific preludes of activity that "predicted" target choices well before execution of the saccadic eye movement. Across the population of neurons, the strength of the motion signal in the display influenced the intensity of this "predictive" prelude activity: SC activity signaled the impending saccade more reliably when the motion signal was strong than when it was weak. The dependence of neural activity on motion strength could not be explained by small variations in the metrics of the saccadic eye movements. Predictive activity was particularly strong in a subpopulation of neurons with directional visual responses that we have described previously. For a subset of SC neurons, therefore, prelude activity reflects the difficulty of the direction discrimination in addition to the target of the impending saccade. These results are consistent with the notion that a restricted network of SC neurons plays a role in the process of saccade target selection.

Target selection for saccadic eye movements: direction-selective visual responses in the superior colliculus

We investigated the role of the superior colliculus (SC) in saccade target selection in rhesus monkeys who were trained to perform a direction-discrimination task. In this task, the monkey discriminated between opposed directions of visual motion and indicated its judgment by making a saccadic eye movement to one of two visual targets that were spatially aligned with the two possible directions of motion in the display. Thus the neural circuits that implement target selection in this task are likely to receive directionally selective visual inputs and be closely linked to the saccadic system. We therefore studied prelude neurons in the intermediate and deep layers of the SC that can discharge up to several seconds before an impending saccade, indicating a relatively high-level role in saccade planning. We used the direction-discrimination task to identify neurons whose prelude activity "predicted" the impending perceptual report several seconds before the animal actually executed the operant eye movement; these "choice predicting" cells comprised approximately 30% of the neurons we encountered in the intermediate and deep layers of the SC. Surprisingly, about half of these prelude cells yielded direction-selective responses to our motion stimulus during a passive fixation task. In general, these neurons responded to motion stimuli in many locations around the visual field including the center of gaze where the visual discriminanda were positioned during the direction-discrimination task. Preferred directions generally pointed toward the location of the movement field of the SC neuron in accordance with the sensorimotor demands of the discrimination task. Control experiments indicate that the directional responses do not simply reflect covertly planned saccades. Our results indicate that a small population of SC prelude neurons exhibits properties appropriate for linking stimulus cues to saccade target selection in the context of a visual discrimination task.

Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey

We recorded the activity of single neurons in the posterior parietal cortex (area LIP) of two rhesus monkeys while they discriminated the direction of motion in random-dot visual stimuli. The visual task was similar to a motion discrimination task that has been used in previous investigations of motion-sensitive regions of the extrastriate cortex. The monkeys were trained to decide whether the direction of motion was toward one of two choice targets that appeared on either side of the random-dot stimulus. At the end of the trial, the monkeys reported their direction judgment by making an eye movement to the appropriate target. We studied neurons in LIP that exhibited spatially selective persistent activity during delayed saccadic eye movement tasks. These neurons are thought to carry high-level signals appropriate for identifying salient visual targets and for guiding saccadic eye movements. We arranged the motion discrimination task so that one of the choice targets was in the LIP neuron's response field (RF) while the other target was positioned well away from the RF. During motion viewing, neurons in LIP altered their firing rate in a manner that predicted the saccadic eye movement that the monkey would make at the end of the trial. The activity thus predicted the monkey's judgment of motion direction. This predictive activity began early in the motion-viewing period and became increasingly reliable as the monkey viewed the random-dot motion. The neural activity predicted the monkey's direction judgment on both easy and difficult trials (strong and weak motion), whether or not the judgment was correct. In addition, the timing and magnitude of the response was affected by the strength of the motion signal in the stimulus. When the direction of motion was toward the RF, stronger motion led to larger neural responses earlier in the motion-viewing period. When motion was away from the RF, stronger motion led to greater suppression of ongoing activity. Thus the activity of single neurons in area LIP reflects both the direction of an impending gaze shift and the quality of the sensory information that instructs such a response. The time course of the neural response suggests that LIP accumulates sensory signals relevant to the selection of a target for an eye movement.

Correlated firing in macaque visual area MT: time scales and relationship to behavior

We studied the simultaneous activity of pairs of neurons recorded with a single electrode in visual cortical area MT while monkeys performed a direction discrimination task. Previously, we reported the strength of interneuronal correlation of spike count on the time scale of the behavioral epoch (2 sec) and noted its potential impact on signal pooling (Zohary et al., 1994). We have now examined correlation at longer and shorter time scales and found that pair-wise cross-correlation was predominantly short term (10-100 msec). Narrow, central peaks in the spike train cross-correlograms were largely responsible for correlated spike counts on the time scale of the behavioral epoch. Longer-term (many seconds to minutes) changes in the responsiveness of single neurons were observed in auto-correlations; however, these slow changes in time were on average uncorrelated between neurons. Knowledge of the limited time scale of correlation allowed the derivation of a more efficient metric for spike count correlation based on spike timing information, and it also revealed a potential relative advantage of larger neuronal pools for shorter integration times. Finally, correlation did not depend on the presence of the visual stimulus or the behavioral choice of the animal. It varied little with stimulus condition but was stronger between neurons with similar direction tuning curves. Taken together, our results strengthen the view that common input, common stimulus selectivity, and common noise are tightly linked in functioning cortical circuits.

Somatosensation: Touching the mind's fingers

Whether mental operations can be reduced to the biological properties of the brain has intrigued scientists and philosophers alike for millennia. New microstimulation experiments on awake, behaving monkeys establish causality between activity of specialized cortical neurons and a controlled behavior.

Visuo-motor control: giving the brain a hand

Sensory information is acquired in spatial coordinate systems linked to sense organs, yet movement must be executed in coordinate systems linked to motor effector organs. Neurophysiological experiments are yielding new insights into how the brain transforms coordinate systems to facilitate movement.

The neurobiology of cognition

Perhaps the deepest mysteries facing the natural sciences concern the higher functions of the central nervous system. Understanding how the brain gives rise to mental experiences looms as one of the central challenges for science in the new millennium.

Color signals in human motion-selective cortex

The neural basis for the effects of color and contrast on perceived speed was examined using functional magnetic resonance imaging (fMRI). Responses to S cone (blue-yellow) and L + M cone (luminance) patterns were measured in area V1 and in the motion area MT+. The MT+ responses were quantitatively similar to perceptual speed judgments of color patterns but not to color detection measures. We also measured cortical motion responses in individuals lacking L and M cone function (S cone monochromats). The S cone monochromats have clear motion-responsive regions in the conventional MT+ position, and their contrast-response functions there have twice the responsivity of S cone contrast-response functions in normal controls. But, their responsivity is far lower than the normals' responsivity to luminance contrast. Thus, the powerful magnocellular input to MT+ is either weak or silent during photopic vision in S cone monochromats.

Color signals in area MT of the macaque monkey

The relationship between the neural processing of color and motion information has been a contentious issue in visual neuroscience. We examined this relationship directly by measuring neural responses to isoluminant S cone signals in extrastriate area MT of the macaque monkey. S cone stimuli produced robust, direction-selective responses at most recording sites, indicating that color signals are present in MT. While these responses were unequivocal, S cone contrast sensitivity was, on average, 1.0-1.3 log units lower than luminance contrast sensitivity. The presence of S cone responses and the relative sensitivity of MT neurons to S cone and luminance signals agree with functional magnetic resonance imaging (fMRI) measurements in human MT+. The results are consistent with the hypothesis that color signals in MT influence behavior in speed judgment tasks.

Motion opponency in visual cortex

Perceptual studies suggest that visual motion perception is mediated by opponent mechanisms that correspond to mutually suppressive populations of neurons sensitive to motions in opposite directions. We tested for a neuronal correlate of motion opponency using functional magnetic resonance imaging (fMRI) to measure brain activity in human visual cortex. There was strong motion opponency in a secondary visual cortical area known as the human MT complex (MT+), but there was little evidence of motion opponency in primary visual cortex. To determine whether the level of opponency in human and monkey are comparable, a variant of these experiments was performed using multiunit electrophysiological recording in areas MT and MST of the macaque monkey brain. Although there was substantial variability in the degree of opponency between recording sites, the monkey and human data were qualitatively similar on average. These results provide further evidence that: (1) direction-selective signals underly human MT+ responses, (2) neuronal signals in human MT+ support visual motion perception, (3) human MT+ is homologous to macaque monkey MT and adjacent motion sensitive brain areas, and (4) that fMRI measurements are correlated with average spiking activity.

Separate signals for target selection and movement specification in the superior colliculus

At any given instant, multiple potential targets for saccades are present in the visual world, implying that a "selection process" within the brain determines the target of the next eye movement. Some superior colliculus (SC) neurons begin discharging seconds before saccade initiation, suggesting involvement in target selection or, alternatively, in postselectional saccade preparation. SC neurons were recorded in monkeys who selected saccade targets on the basis of motion direction in a visual display. Some neurons carried a direction-selective visual signal, consistent with a role in target selection in this task, whereas other SC neurons appeared to be more involved in postselection specification of saccade parameters.

Effect of spatial attention on the responses of area MT neurons

This study examines the influence of spatial attention on the responses of neurons in the middle temporal visual area (MT or V5) of extrastriate cortex. Two monkeys were trained to perform a direction-discrimination task. On each trial, two apertures of random-dot stimuli appeared simultaneously at two spatially separated locations; the monkeys were required to discriminate the direction of stimulus motion at one location while ignoring the stimulus at the other location. After extensive training, we recorded the responses of MT neurons in two configurations: 1) Both apertures placed "within" the neuron's receptive field (RF) and 2) one aperture covering the RF while the other was presented at a "remote" location. For each unit we compared the responses to identical stimulus displays when the monkey was instructed to attend to one or the other aperture. The responses of MT neurons were 8.7% stronger, on average, when the monkey attended to the spatial location that contained motion in the "preferred" direction. Attentional effects were equal, on average, in the within RF and remote configurations. The attentional modulations began approximately 300 ms after stimulus onset, gradually increased throughout the trial, and peaked near stimulus offset. An analysis of the neuronal responses on error trials suggests that the monkeys failed to attend to the appropriate spatial location on these trials. The relatively weak attentional effects that we observed contrast strikingly with recent results of Treue and Maunsell, who demonstrated very strong attentional modulations (median effect >80%) in MT in a task that shares many features with ours. Our results suggest that spatial attention alone is not sufficient to induce strong attentional effects in MT even when two competing motion stimuli appear within the RF of the recorded neuron. The difference between our results and those of Treue and Maunsell suggests that the magnitude of the attentional effects in MT may depend critically on how attention is directed to a particular stimulus and on the precise demands of the task.