Attentional modulation in visual cortex depends on task timing

Neural mechanisms of resource allocation in working memory

To mitigate capacity limits of working memory, people allocate resources according to an item's relevance. However, the neural mechanisms supporting such a critical operation remain unknown. Here, we developed computational neuroimaging methods to decode and demix neural responses associated with multiple items in working memory with different priorities. In striate and extrastriate cortex, the gain of neural responses tracked the priority of memoranda. Higher-priority memoranda were decoded with smaller error and lower uncertainty. Moreover, these neural differences predicted behavioral differences in memory prioritization. Remarkably, trialwise variability in the magnitude of delay activity in frontal cortex predicted differences in decoded precision between low and high-priority items in visual cortex. These results suggest a model in which feedback signals broadcast from frontal cortex sculpt the gain of memory representations in visual cortex according to behavioral relevance, thus, identifying a neural mechanism for resource allocation.

Locus coeruleus norepinephrine contributes to visual-spatial attention by selectively enhancing perceptual sensitivity

Selectively focusing on a behaviorally relevant stimulus while ignoring irrelevant stimuli improves perception. Enhanced neuronal response gain is thought to support attention-related improvements in detection and discrimination. However, understanding of the neuronal pathways regulating perceptual sensitivity remains limited. Here, we report that responses of norepinephrine (NE) neurons in the locus coeruleus (LC) of non-human primates to behaviorally relevant sensory stimuli promote visual discrimination in a spatially selective way. LC-NE neurons spike in response to a visual stimulus appearing in the contralateral hemifield only when that stimulus is attended. This spiking is associated with enhanced behavioral sensitivity, is independent of motor control, and is absent on error trials. Furthermore, optogenetically activating LC-NE neurons selectively improves monkeys' contralateral stimulus detection without affecting motor criteria, supporting NE's causal role in granular cognitive control of selective attention at a cellular level, beyond its known diffuse and non-selective functions.

Tasks and their role in visual neuroscience

Vision is widely used as a model system to gain insights into how sensory inputs are processed and interpreted by the brain. Historically, careful quantification and control of visual stimuli have served as the backbone of visual neuroscience. There has been less emphasis, however, on how an observer's task influences the processing of sensory inputs. Motivated by diverse observations of task-dependent activity in the visual system, we propose a framework for thinking about tasks, their role in sensory processing, and how we might formally incorporate tasks into our models of vision.

Attention in flux

Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.

Sensory and Choice Responses in MT Distinct from Motion Encoding

The macaque middle temporal (MT) area is well known for its visual motion selectivity and relevance to motion perception, but the possibility of it also reflecting higher-level cognitive functions has largely been ignored. We tested for effects of task performance distinct from sensory encoding by manipulating subjects' temporal evidence-weighting strategy during a direction discrimination task while performing electrophysiological recordings from groups of MT neurons in rhesus macaques (one male, one female). This revealed multiple components of MT responses that were, surprisingly, not interpretable as behaviorally relevant modulations of motion encoding, or as bottom-up consequences of the readout of motion direction from MT. The time-varying motion-driven responses of MT were strongly affected by our strategic manipulation-but with time courses opposite the subjects' temporal weighting strategies. Furthermore, large choice-correlated signals were represented in population activity distinct from its motion responses, with multiple phases that lagged psychophysical readout and even continued after the stimulus (but which preceded motor responses). In summary, a novel experimental manipulation of strategy allowed us to control the time course of readout to challenge the correlation between sensory responses and choices, and population-level analyses of simultaneously recorded ensembles allowed us to identify strong signals that were so distinct from direction encoding that conventional, single-neuron-centric analyses could not have revealed or properly characterized them. Together, these approaches revealed multiple cognitive contributions to MT responses that are task related but not functionally relevant to encoding or decoding of motion for psychophysical direction discrimination, providing a new perspective on the assumed status of MT as a simple sensory area.SIGNIFICANCE STATEMENT This study extends understanding of the middle temporal (MT) area beyond its representation of visual motion. Combining multineuron recordings, population-level analyses, and controlled manipulation of task strategy, we exposed signals that depended on changes in temporal weighting strategy, but did not manifest as feedforward effects on behavior. This was demonstrated by (1) an inverse relationship between temporal dynamics of behavioral readout and sensory encoding, (2) a choice-correlated signal that always lagged the stimulus time points most correlated with decisions, and (3) a distinct choice-correlated signal after the stimulus. These findings invite re-evaluation of MT for functions outside of its established sensory role and highlight the power of experimenter-controlled changes in temporal strategy, coupled with recording and analysis approaches that transcend the single-neuron perspective.

Multiple Temporal and Object-Based Strategies Across Learning for a Selective Detection Task in Mice

Goal-directed behavior paradigms inevitably involve temporal processes, such as anticipation, expectation, timing, waiting, and withholding. And yet, amongst the vast use of object-based task paradigms, characterizations of temporal features are often neglected. Here, we longitudinally analyzed mice from naïve to expert performance in a somatosensory selective detection task. In addition to tracking standard measures from signal detection theory, we also characterized learning of temporal features. We find that mice transition from general sampling strategies to stimulus detection and stimulus discrimination. During these transitions, mice learn to wait as they anticipate an expected stimulus presentation and to time their response after a stimulus presentation. By establishing and implementing standardized measures, we show that the development of waiting and timing in the task overlaps with learning of stimulus detection and discrimination. We also investigated sex differences in temporal and object-based trajectories of learning, finding that males learn strategies idiosyncratically and that females learn strategies more sequentially and stereotypically. Overall, our findings emphasize multiple temporal strategies in learning for an object-based task and highlight the importance of considering diverse temporal and object-based features when characterizing behavioral and neuronal aspects of learning.

The effect of temporal expectation on the correlations of frontal neural activity with alpha oscillation and sensory-motor latency

In a dynamic environment, we seek to enhance behavioral responses by anticipating future events. Previous studies have shown that the probability distribution of the timing of future events could shape our expectation of event timing; furthermore, the modulation of alpha oscillation is known to be a critical neural factor. However, a link between the modulation of alpha oscillation by temporal expectation and single neural activity is missing. In this study, we investigated how temporal expectation modulated frontal neural activities and behavioral reaction time by recording neural activity from the frontal eye field smooth pursuit eye movement region of monkeys while they performed a smooth pursuit eye movement task. We found that the temporal expectation reduced the coherence between the neural spiking and alpha frequency of the local field potential, along with the trial-by-trial correlation between the neural spiking activity and pursuit latency. This result suggests that the desynchronization of alpha oscillation by temporal expectation would be related to the decorrelation of population neural activity, which could be the neural source of reaction time enhancement by temporal expectation.

Temporal expectation based on the duration variability modulates alpha oscillations during working memory retention

While maintaining information over a delay of time, working memory (WM) also allows individuals to prepare the mnemonic contents for prospective utilisation. However, it remains unclear whether the expectation of the time of WM test could modulate neural responses during the retention interval of WM and subsequent performance. Here, we investigated whether temporal expectations based on the variability of delay duration can modulate 9-13 Hz alpha oscillations during WM retention and whether the expectation-induced alpha activity was associated with WM performance. Participants performed a retro-cueing WM task with magnetoencephalography (MEG) (Experiment 1) and a standard WM task with electroencephalography (EEG) (Experiment 2). The expectation of the timing of the WM test was manipulated by the temporal structure of the tasks with small or large variability in the delay durations. We showed that alpha oscillations during retention interval and WM performance varied with duration variability in both of the MEG and EEG experiments. The novel finding was greater alpha-power attenuation over the left frontal and parietal regions during WM retention when the duration variability was small and the test onset was predictable, compared to when the duration variability was large and the test onset was less predictable. Importantly, we observed a positive relationship in variability difference between the response benefit and alpha-power attenuation in the left posterior parietal regions at both MEG-source and EEG-electrode levels. Finally, we confirmed the behavioural benefit when a condition with a fixed delay-duration was included in a behavioural experiment (Experiment 3). When conjoined, the delay duration enables individuals to anticipate when the relevant information would be put to work, and alpha oscillations track the anticipatory states during WM maintenance.

Temporal visual representation elicits early auditory-like responses in hearing but not in deaf individuals

It is evident that the brain is capable of large-scale reorganization following sensory deprivation, but the extent of such reorganization is to date, not clear. The auditory modality is the most accurate to represent temporal information, and deafness is an ideal clinical condition to study the reorganization of temporal representation when the audio signal is not available. Here we show that hearing, but not deaf individuals, show a strong ERP response to visual stimuli in temporal areas during a time-bisection task. This ERP response appears 50-90 ms after the flash and recalls some aspects of the N1 ERP component usually elicited by auditory stimuli. The same ERP is not evident for a visual space-bisection task, suggesting that the early recruitment of temporal cortex is specific for building a highly resolved temporal representation within the visual modality. These findings provide evidence that the lack of auditory input can interfere with typical development of complex visual temporal representations.

The neural bases for timing of durations

Durations are defined by a beginning and an end, and a major distinction is drawn between durations that start in the present and end in the future ('prospective timing') and durations that start in the past and end either in the past or the present ('retrospective timing'). Different psychological processes are thought to be engaged in each of these cases. The former is thought to engage a clock-like mechanism that accurately tracks the continuing passage of time, whereas the latter is thought to engage a reconstructive process that utilizes both temporal and non-temporal information from the memory of past events. We propose that, from a biological perspective, these two forms of duration 'estimation' are supported by computational processes that are both reliant on population state dynamics but are nevertheless distinct. Prospective timing is effectively carried out in a single step where the ongoing dynamics of population activity directly serve as the computation of duration, whereas retrospective timing is carried out in two steps: the initial generation of population state dynamics through the process of event segmentation and the subsequent computation of duration utilizing the memory of those dynamics.

Long-range cortical synchronization supports abrupt visual learning

Visual plasticity declines sharply after the critical period, yet we easily learn to recognize new faces and places, even as adults. Such learning is often characterized by a "moment of insight," an abrupt and dramatic improvement in recognition. The mechanisms that support abrupt learning are unknown, but one hypothesis is that they involve changes in synchronization between brain regions. To test this hypothesis, we used a behavioral task in which non-human primates rapidly learned to recognize novel images and to associate them with specific responses. Simultaneous recordings from inferotemporal and prefrontal cortices revealed a transient synchronization of neural activity between these areas that peaked around the moment of insight. Synchronization was strongest between inferotemporal sites that encoded images and reward-sensitive prefrontal sites. Moreover, its magnitude intensified gradually over image exposures, suggesting that abrupt learning is the culmination of a search for informative signals within a circuit linking sensory information to task demands.

Eyes wide open: Regulation of arousal by temporal expectations

Maintaining adequate levels of arousal is essential for sustaining performance on extended tasks. To investigate arousal in prolonged tasks such as driving studies have traditionally used monotonous task designs. Both ecological and experimental settings often contain embedded temporal regularities, but it is unknown whether these enable adaptive modulation of arousal. We explored whether temporal predictability can modulate arousal according to the timing of anticipated relevant events. In two experiments, we manipulated the temporal predictability of events to test for behavioural benefits and arousal modulation, using pupillometry as a proxy measure. High temporal predictability significantly lowered the tonic level of arousal briefly increased arousal in anticipation of upcoming stimuli, whereas low temporal predictability resulted in tonically elevated arousal. These novel findings suggest that arousal levels flexibly adapt to the temporal structures of events and bring about energy efficiencies in the context of high levels of behavioural performance.

Expectations of the timing and intensity of a stimulus propagate to the auditory periphery through the medial olivocochlear reflex

Expectations concerning the timing of a stimulus enhance attention at the time at which the event occurs, which confers significant sensory and behavioral benefits. Herein, we show that temporal expectations modulate even the sensory transduction in the auditory periphery via the descending pathway. We measured the medial olivocochlear reflex (MOCR), a sound-activated efferent feedback that controls outer hair cell motility and optimizes the dynamic range of the sensory system. MOCR was noninvasively assessed using otoacoustic emissions. We found that the MOCR was enhanced by a visual cue presented at a fixed interval before a sound but was unaffected if the interval was changing between trials. The MOCR was also observed to be stronger when the learned timing expectation matched with the timing of the sound but remained unvaried when these two factors did not match. This implies that the MOCR can be voluntarily controlled in a stimulus- and goal-directed manner. Moreover, we found that the MOCR was enhanced by the expectation of a strong but not a weak, sound intensity. This asymmetrical enhancement could facilitate antimasking and noise protective effects without disrupting the detection of faint signals. Therefore, the descending pathway conveys temporal and intensity expectations to modulate auditory processing.

Global, Low-Amplitude Cortical State Predicts Response Outcomes in a Selective Detection Task in Mice

Spontaneous neuronal activity strongly impacts stimulus encoding and behavioral responses. We sought to determine the effects of neocortical prestimulus activity on stimulus detection. We trained mice in a selective whisker detection task, in which they learned to respond (lick) to target stimuli in one whisker field and ignore distractor stimuli in the contralateral whisker field. During expert task performance, we used widefield Ca2+ imaging to assess prestimulus and post-stimulus neuronal activity broadly across frontal and parietal cortices. We found that lower prestimulus activity correlated with enhanced stimulus detection: lower prestimulus activity predicted response versus no response outcomes and faster reaction times. The activity predictive of trial outcome was distributed through dorsal neocortex, rather than being restricted to whisker or licking regions. Using principal component analysis, we demonstrate that response trials are associated with a distinct and less variable prestimulus neuronal subspace. For single units, prestimulus choice probability was weak yet distributed broadly, with lower than chance choice probability correlating with stronger sensory and motor encoding. These findings support low amplitude and low variability as an optimal prestimulus cortical state for stimulus detection that presents globally and predicts response outcomes for both target and distractor stimuli.

A precise and adaptive neural mechanism for predictive temporal processing in the frontal cortex

The theory of predictive processing posits that the brain computes expectations to process information predictively. Empirical evidence in support of this theory, however, is scarce and largely limited to sensory areas. Here, we report a precise and adaptive mechanism in the frontal cortex of non-human primates consistent with predictive processing of temporal events. We found that the speed of neural dynamics is precisely adjusted according to the average time of an expected stimulus. This speed adjustment, in turn, enables neurons to encode stimuli in terms of deviations from expectation. This lawful relationship was evident across multiple experiments and held true during learning: when temporal statistics underwent covert changes, neural responses underwent predictable changes that reflected the new mean. Together, these results highlight a precise mathematical relationship between temporal statistics in the environment and neural activity in the frontal cortex that may serve as a mechanism for predictive temporal processing.

Behavioral Approaches to Study Top-Down Influences on Active Listening

The massive network of descending corticofugal projections has been long-recognized by anatomists, but their functional contributions to sound processing and auditory-guided behaviors remain a mystery. Most efforts to characterize the auditory corticofugal system have been inductive; wherein function is inferred from a few studies employing a wide range of methods to manipulate varying limbs of the descending system in a variety of species and preparations. An alternative approach, which we focus on here, is to first establish auditory-guided behaviors that reflect the contribution of top-down influences on auditory perception. To this end, we postulate that auditory corticofugal systems may contribute to active listening behaviors in which the timing of bottom-up sound cues can be predicted from top-down signals arising from cross-modal cues, temporal integration, or self-initiated movements. Here, we describe a behavioral framework for investigating how auditory perceptual performance is enhanced when subjects can anticipate the timing of upcoming target sounds. Our first paradigm, studied both in human subjects and mice, reports species-specific differences in visually cued expectation of sound onset in a signal-in-noise detection task. A second paradigm performed in mice reveals the benefits of temporal regularity as a perceptual grouping cue when detecting repeating target tones in complex background noise. A final behavioral approach demonstrates significant improvements in frequency discrimination threshold and perceptual sensitivity when auditory targets are presented at a predictable temporal interval following motor self-initiation of the trial. Collectively, these three behavioral approaches identify paradigms to study top-down influences on sound perception that are amenable to head-fixed preparations in genetically tractable animals, where it is possible to monitor and manipulate particular nodes of the descending auditory pathway with unparalleled precision.

Attractor dynamics gate cortical information flow during decision-making

Decisions are held in memory until enacted, which makes them potentially vulnerable to distracting sensory input. Gating of information flow from sensory to motor areas could protect memory from interference during decision-making, but the underlying network mechanisms are not understood. Here, we trained mice to detect optogenetic stimulation of the somatosensory cortex, with a delay separating sensation and action. During the delay, distracting stimuli lost influence on behavior over time, even though distractor-evoked neural activity percolated through the cortex without attenuation. Instead, choice-encoding activity in the motor cortex became progressively less sensitive to the impact of distractors. Reverse engineering of neural networks trained to reproduce motor cortex activity revealed that the reduction in sensitivity to distractors was caused by a growing separation in the neural activity space between attractors that encode alternative decisions. Our results show that communication between brain regions can be gated via attractor dynamics, which control the degree of commitment to an action.

Attention differentially modulates multiunit activity in the lateral geniculate nucleus and V1 of macaque monkeys

Attention promotes the selection of behaviorally relevant sensory signals from the barrage of sensory information available. Visual attention modulates the gain of neuronal activity in all visual brain areas examined, although magnitudes of gain modulations vary across areas. For example, attention gain magnitudes in the dorsal lateral geniculate nucleus (LGN) and primary visual cortex (V1) vary tremendously across fMRI measurements in humans and electrophysiological recordings in behaving monkeys. We sought to determine whether these discrepancies are due simply to differences in species or measurement, or more nuanced properties unique to each visual brain area. We also explored whether robust and consistent attention effects, comparable to those measured in humans with fMRI, are observable in the LGN or V1 of monkeys. We measured attentional modulation of multiunit activity in the LGN and V1 of macaque monkeys engaged in a contrast change detection task requiring shifts in covert visual spatial attention. Rigorous analyses of LGN and V1 multiunit activity revealed robust and consistent attentional facilitation throughout V1, with magnitudes comparable to those observed with fMRI. Interestingly, attentional modulation in the LGN was consistently negligible. These findings demonstrate that discrepancies in attention effects are not simply due to species or measurement differences. We also examined whether attention effects correlated with the feature selectivity of recorded multiunits. Distinct relationships suggest that attentional modulation of multiunit activity depends upon the unique structure and function of visual brain areas.

Two sources of uncertainty independently modulate temporal expectancy

The environment is shaped by two sources of temporal uncertainty: the discrete probability of whether an event will occur and-if it does-the continuous probability of when it will happen. These two types of uncertainty are fundamental to every form of anticipatory behavior including learning, decision-making, and motor planning. It remains unknown how the brain models the two uncertainty parameters and how they interact in anticipation. It is commonly assumed that the discrete probability of whether an event will occur has a fixed effect on event expectancy over time. In contrast, we first demonstrate that this pattern is highly dynamic and monotonically increases across time. Intriguingly, this behavior is independent of the continuous probability of when an event will occur. The effect of this continuous probability on anticipation is commonly proposed to be driven by the hazard rate (HR) of events. We next show that the HR fails to account for behavior and propose a model of event expectancy based on the probability density function of events. Our results hold for both vision and audition, suggesting independence of the representation of the two uncertainties from sensory input modality. These findings enrich the understanding of fundamental anticipatory processes and have provocative implications for many aspects of behavior and its neural underpinnings.

Temporal Regularity May Not Improve Memory for Item-Specific Detail

Regularities in event timing allow for the allocation of attention to critical time-points when an event is most likely to occur, leading to improved visual perception. Results from recent studies indicate that similar benefits may extend to memory for scenes and objects. Here, we investigated whether benefits of temporal regularity are evident when detailed, item-specific representations are necessary for successful recognition memory performance. In Experiments 1 and 2, pictures of objects were presented with either predictable or randomized event timing, in separate encoding blocks. In the test phase, old and new objects were presented, intermixed with perceptually similar exemplars of encoded objects. In Experiment 3 we attempted to replicate previously reported memory enhancements for scenes. In contrast to predictions, temporal regularity did not affect response times (RT) or improve recognition memory accuracy in any of our experiments. These results suggest that any effects of temporal expectation on memory are subtle and may be sensitive to minor changes in task parameters. In sum, indirect upregulation of attention through imposed temporal structure may not be sufficient to have downstream effects on memory performance.

Spatial Attention and Saccade Preparation Both Independently Contribute to the Discrimination of Oblique Orientations

The extent to which the preparation of an eye movement and spatial attention both independently influence performance within the same task has long been debated. In a recent study that combined computational modelling with a dual-task, both saccade preparation and spatial cueing were revealed to separately contribute to the discrimination of targets oriented along the cardinal axis (horizontal and vertical). However, it remains to be seen whether and to what degree the same holds true when different perceptual stimuli are used. In the present study, we combined evidence accumulation modelling with a dual-task paradigm to assess the extent to which both saccade preparation and spatial attention contribute to the discrimination of full contrast targets oriented along the oblique axis (diagonal). The results revealed a separate and quantifiable contribution of both types of orienting to discrimination performance. Comparison of the magnitude of these effects to those obtained for cardinal orientation discrimination revealed the influence of saccade preparation and spatial attention to be six times smaller for oblique orientations. Importantly, the results revealed a separate and quantifiable contribution of both saccade preparation and spatial attention regardless of perceptual stimuli or stimulus contrast.

Neural mechanism of priming in visual search

Selective attention affords scrutinizing items in our environment. However, attentional selection changes over time and across space. Empirically, repetition of visual search conditions changes attentional processing. Priming of pop-out is a vivid example. Repeatedly searching for the same pop-out search feature is accomplished with faster response times and fewer errors. We review the psychophysical background of priming of pop-out, focusing on the hypothesis that it arises through changes in visual selective attention. We also describe research done with macaque monkeys to understand the neural mechanisms supporting visual selective attention and priming of pop-out, and survey research on priming of pop-out using noninvasive brain measures with humans. We conclude by hypothesizing three alternative neural mechanisms and highlighting open questions.

Mice Preferentially Use Increases in Cerebral Cortex Spiking to Detect Changes in Visual Stimuli

Whenever the retinal image changes, some neurons in visual cortex increase their rate of firing whereas others decrease their rate of firing. Linking specific sets of neuronal responses with perception and behavior is essential for understanding mechanisms of neural circuit computation. We trained mice of both sexes to perform visual detection tasks and used optogenetic perturbations to increase or decrease neuronal spiking primary visual cortex (V1). Perceptual reports were always enhanced by increments in V1 spike counts and impaired by decrements, even when increments and decrements in spiking were generated in the same neuronal populations. Moreover, detecting changes in cortical activity depended on spike count integration rather than instantaneous changes in spiking. Recurrent neural networks trained in the task similarly relied on increments in neuronal activity when activity has costs. This work clarifies neuronal decoding strategies used by cerebral cortex to translate cortical spiking into percepts that can be used to guide behavior.SIGNIFICANCE STATEMENT Visual responses in the primary visual cortex (V1) are diverse, in that neurons can be either excited or inhibited by the onset of a visual stimulus. We selectively potentiated or suppressed V1 spiking in mice while they performed contrast change detection tasks. In other experiments, excitation or inhibition was delivered to V1 independent of visual stimuli. Mice readily detected increases in V1 spiking while equivalent reductions in V1 spiking suppressed the probability of detection, even when increases and decreases in V1 spiking were generated in the same neuronal populations. Our data raise the striking possibility that only increments in spiking are used to render information to structures downstream of V1.

Purpose-Dependent Consequences of Temporal Expectations Serving Perception and Action

Temporal expectations enable anticipatory brain states that prepare us for upcoming perception and action. We investigated the purpose-dependent nature and consequences of cued temporal expectations on brain and behavior in male and female human volunteers, using two matched visual-motor tasks that stressed either response speed or visual accuracy. We show that the consequences of temporal expectations are fundamentally purpose dependent. Temporal expectations predominantly affected response times when visual demands were low and speed was more important, but perceptual accuracy when visual demands were more challenging. Using magnetoencephalography, we further show how temporal expectations latch onto anticipatory neural states associated with concurrent spatial expectations—modulating task-specific anticipatory neural lateralization of oscillatory brain activity in a modality- and frequency-specific manner. By relating these brain states to behavior, we finally reveal how the behavioral relevance of such anticipatory brain states is similarly purpose dependent.

SIGNIFICANCE STATEMENT Knowing when events may occur helps to prepare neural activity for upcoming perception and action. It is becoming increasingly clear that distinct sources of temporal expectations may facilitate performance via distinct mechanisms. Another relevant dimension to consider regards the distinct purposes that temporal expectations may serve. Here, we demonstrate that the consequences of temporal expectations on neurophysiological brain activity and behavior are fundamentally purpose dependent, and show how temporal expectations interact with task-relevant neural states in a modality- and frequency-specific manner. This brings the important insight that the ways in which temporal expectations influence brain and behavior, and how brain activity is related to behavior, are not fixed properties but rather depend on the task at hand.

Visual representations of time elicit early responses in human temporal cortex

Time perception is inherently part of human life. All human sensory modalities are always involved in the complex task of creating a temporal representation of the external world. However, when representing time, people primarily rely on auditory information. Since the auditory system prevails in many audio-visual temporal tasks, one may expect that the early recruitment of the auditory network is necessary for building a highly resolved and flexible temporal representation in the visual modality. To test this hypothesis, we asked 17 healthy participants to temporally bisect three consecutive flashes while we recorded EEG. We demonstrated that visual stimuli during temporal bisection elicit an early (50-90 ​ms) response of an extended area of the temporal cortex, likely including auditory cortex too. The same activation did not appear during an easier spatial bisection task. These findings suggest that the brain may use auditory representations to deal with complex temporal representation in the visual system.

Uncoupling Sensation and Perception in Human Time Processing

Timing emerges from a hierarchy of computations ranging from early encoding of physical duration (time sensation) to abstract time representations (time perception) suitable for storage and decisional processes. However, the neural basis of the perceptual experience of time remains elusive. To address this, we dissociate brain activity uniquely related to lower-level sensory and higher-order perceptual timing operations, using event-related fMRI. Participants compared subsecond (500 msec) sinusoidal gratings drifting with constant velocity (standard) against two probe stimuli: (1) control gratings drifting at constant velocity or (2) accelerating gratings, which induced illusory shortening of time. We tested two probe intervals: a 500-msec duration (Short) and a longer duration required for an accelerating probe to be perceived as long as the standard (Long—individually determined). On each trial, participants classified the probe as shorter or longer than the standard. This allowed for comparison of trials with an “Objective” (physical) or “Subjective” (perceived) difference in duration, based on participant classifications. Objective duration revealed responses in bilateral early extrastriate areas, extending to higher visual areas in the fusiform gyrus (at more lenient thresholds). By contrast, Subjective duration was reflected by distributed responses in a cortical/subcortical areas. This comprised the left superior frontal gyrus and the left cerebellum, and a wider set of common timing areas including the BG, parietal cortex, and posterior cingulate cortex. These results suggest two functionally independent timing stages: early extraction of duration information in sensory cortices and Subjective experience of duration in a higher-order cortical–subcortical timing areas.

Dissociating cholinergic influence on alertness and temporal attention in primates in a simple reaction time paradigm

The ability to promptly respond to behaviourally relevant events depends on both general alertness and phasic changes in attentional state driven by temporal expectations. Using a variable foreperiod simple reaction time (RT) task in four adult male rhesus macaques, we investigated the role of the cholinergic system in alertness and temporal expectation. Foreperiod effects on RT reflect temporal expectation, while alertness is quantified as overall response speed. We measured these RT parameters under vehicle treatment and systemic administration of the muscarinic receptor antagonist scopolamine. We also investigated whether and to what extent the effects of scopolamine were reversed by donepezil, a cholinesterase inhibitor widely used for the treatment of dementia. In the control condition, RT showed a continuous decrease as the foreperiod duration increased, which clearly indicated the effect of temporal expectation on RT. This foreperiod effect was mainly detectable on the faster tail of the RT distribution and was eliminated by scopolamine. Furthermore, scopolamine treatment slowed down the average RT. Donepezil treatment was efficient on the slower tail of the RT distribution and improved scopolamine-induced impairments only on the average RT reflecting a general beneficial effect on alertness without any improvement in temporal expectation. The present results highlight the role of the cholinergic system in temporal expectation and alertness in primates and help delineate the efficacy and scope of donepezil and other cholinomimetic agents as cognitive enhancers in present and future clinical practice.

Timing of response onset and offset in macaque V4: stimulus and task dependence

In the primate visual cortex, both the magnitude of the neuronal response and its timing can carry important information about the visual world, but studies typically focus only on response magnitude. Here, we examine the onset and offset latency of the responses of neurons in area V4 of awake, behaving macaques across several experiments in the context of a variety of stimuli and task paradigms. Our results highlight distinct contributions of stimuli and tasks to V4 response latency. We found that response onset latencies are shorter than typically cited (median = 75.5 ms), supporting a role for V4 neurons in rapid object and scene recognition functions. Moreover, onset latencies are longer for smaller stimuli and stimulus outlines, consistent with the hypothesis that longer latencies are associated with higher spatial frequency content. Strikingly, we found that onset latencies showed no significant dependence on stimulus occlusion, unlike in inferotemporal cortex, nor on task demands. Across the V4 population, onset latencies had a broad distribution, reflecting the diversity of feedforward, recurrent, and feedback connections that inform the responses of individual neurons. Response offset latencies, on the other hand, displayed the opposite tendency in their relationship to stimulus and task attributes: they are less influenced by stimulus appearance but are shorter in guided saccade tasks compared with fixation tasks. The observation that response latency is influenced by stimulus- and task-associated factors emphasizes a need to examine response timing alongside firing rate in determining the functional role of area V4.NEW & NOTEWORTHY Onset and offset timing of neuronal responses can provide information about visual environment and neuron's role in visual processing and its anatomical connectivity. In the first comprehensive examination of onset and offset latencies in the intermediate visual cortical area V4, we find neurons respond faster than previously reported, making them ideally suited to contribute to rapid object and scene recognition. While response onset reflects stimulus characteristics, timing of response offset is influenced more by behavioral task.

Temporal attention boosts perceptual effects of spatial attention and feature-based attention

Temporal attention, that is, the process of anticipating the occurrence of a stimulus at a given time point, has been shown to improve perceptual processing of visual stimuli. In the present study, we investigated whether and how temporal attention interacts with spatial attention and feature-based attention in visual selection. To monitor the influence of the three different attention dimensions on perceptual processing, we measured event-related potentials (ERPs). Our participants performed a visual search task, in which a colored singleton was presented amongst homogenous distractors. We manipulated spatial and feature-based attention by requiring participants to respond only to target singletons in a particular color and at a to-be-attended spatial location. We manipulated temporal attention by means of an explicit temporal cue that announced either validly or invalidly the occurrence of the search display. We obtained early ERP effects of spatial attention and feature-based attention at the validly cued but not at the invalidly cued time point. Taken together, our results suggest that temporal attention boosts early effects of spatial and feature-based attention.

Changes in Local Network Activity Approximated by Reverse Spike-Triggered Local Field Potentials Predict the Focus of Attention

The effects of visual spatial attention on neuronal firing rates have been well characterized for neurons throughout the visual processing hierarchy. Interestingly, the mechanisms by which attention generates more or fewer spikes in response to a visual stimulus remain unknown. One possibility is that attention boosts the likelihood that synaptic inputs to a neuron result in spikes. We performed a novel analysis to measure local field potentials (LFPs) just prior to spikes, or reverse spike-triggered LFP “wavelets,” for neurons recorded in primary visual cortex (V1) of monkeys performing a contrast change detection task requiring covert shifts in visual spatial attention. We used dimensionality reduction to define LFP wavelet shapes with single numerical values, and we found that LFP wavelet shape changes correlated with changes in neuronal firing rate. We then tested whether a simple classifier could predict monkeys’ focus of attention from LFP wavelet shape. LFP wavelet shapes sampled in discrete windows were predictive of the locus of attention for some neuronal types. These findings suggest that LFP wavelets are a useful proxy for local network activity influencing spike generation, and changes in LFP wavelet shape are predictive of the focus of attention.

Auditory Mismatch Negativity Under Predictive Coding Framework and Its Role in Psychotic Disorders

Traditional neuroscience sees sensory perception as a simple feedforward process. This view is challenged by the predictive coding model in recent years due to the robust evidence researchers had found on how our prediction could influence perception. In the first half of this article, we reviewed the concept of predictive brain and some empirical evidence of sensory prediction in visual and auditory processing. The predictive function along the auditory pathway was mainly studied by mismatch negativity (MMN)-a brain response to an unexpected disruption of regularity. We summarized a range of MMN paradigms and discussed how they could contribute to the theoretical development of the predictive coding neural network by the mechanism of adaptation and deviance detection. Such methodological and conceptual evolution sharpen MMN as a tool to better understand the structural and functional brain abnormality for neuropsychiatric disorder such as schizophrenia.

The anticipation of events in time

Humans anticipate events signaled by sensory cues. It is commonly assumed that two uncertainty parameters modulate the brain's capacity to predict: the hazard rate (HR) of event probability and the uncertainty in time estimation which increases with elapsed time. We investigate both assumptions by presenting event probability density functions (PDFs) in each of three sensory modalities. We show that perceptual systems use the reciprocal PDF and not the HR to model event probability density. We also demonstrate that temporal uncertainty does not necessarily grow with elapsed time but can also diminish, depending on the event PDF. Previous research identified neuronal activity related to event probability in multiple levels of the cortical hierarchy (sensory (V4), association (LIP), motor and other areas) proposing the HR as an elementary neuronal computation. Our results-consistent across vision, audition, and somatosensation-suggest that the neurobiological implementation of event anticipation is based on a different, simpler and more stable computation than HR: the reciprocal PDF of events in time.

Dissociable neural effects of temporal expectations due to passage of time and contextual probability

The human brain is equipped with complex mechanisms to track the changing probability of events in time. While the passage of time itself usually leads to a mounting expectation, context can provide additional information about when events are likely to happen. In this study we dissociate these two sources of temporal expectation in terms of their neural correlates and underlying brain connectivity patterns. We analysed magnetoencephalographic (MEG) data acquired from N = 24 healthy participants listening to auditory stimuli. These stimuli could be presented at different temporal intervals but occurred most often at intermediate intervals, forming a contextual probability distribution. Evoked MEG response amplitude was sensitive to both passage of time (time elapsed since the cue) and contextual probability, albeit at different latencies: the effects of passage of time were observed earlier than the effects of context. The underlying sources of MEG activity were also different across the two types of temporal prediction: the effects of passage of time were localised to early auditory regions and superior temporal gyri, while context was additionally linked to activity in inferior parietal cortices. Finally, these differences were modelled using biophysical (dynamic causal) modelling: passage of time was explained in terms of widespread gain modulation and decreased prediction error signalling at lower levels of the hierarchy, while contextual expectation led to more localised gain modulation and decreased prediction error signalling at higher levels of the hierarchy. These results present a comprehensive account of how independent sources of temporal prediction may be differentially expressed in cortical circuits.

Left parietal tACS at alpha frequency induces a shift of visuospatial attention

BACKGROUND

Voluntary shifts of visuospatial attention are associated with a lateralization of parieto-occipital alpha power (7-13Hz), i.e. higher power in the hemisphere ipsilateral and lower power contralateral to the locus of attention. Recent noninvasive neuromodulation studies demonstrated that alpha power can be experimentally increased using transcranial alternating current stimulation (tACS).

OBJECTIVE/HYPOTHESIS

We hypothesized that tACS at alpha frequency over the left parietal cortex induces shifts of attention to the left hemifield. However, spatial attention shifts not only occur voluntarily (endogenous/ top-down), but also stimulus-driven (exogenous/ bottom-up). To study the task-specificity of the potential effects of tACS on attentional processes, we administered three conceptually different spatial attention tasks.

METHODS

36 healthy volunteers were recruited from an academic environment. In two separate sessions, we applied either high-density tACS at 10Hz, or sham tACS, for 35-40 minutes to their left parietal cortex. We systematically compared performance on endogenous attention, exogenous attention, and stimulus detection tasks.

RESULTS

In the endogenous attention task, a greater leftward bias in reaction times was induced during left parietal 10Hz tACS as compared to sham. There were no stimulation effects in either the exogenous attention or the stimulus detection task.

CONCLUSION

The study demonstrates that high-density tACS at 10Hz can be used to modulate visuospatial attention performance. The tACS effect is task-specific, indicating that not all forms of attention are equally susceptible to the stimulation.

Parallel attentional facilitation of features and objects in early visual cortex

Selective attention can enhance the processing of attended features across the entire visual field. Attention also spreads within objects, enhancing all internal locations and task-irrelevant features of selected objects. Here, we examine the extent to which attentional enhancement of a feature spreads across attended and unattended objects. Two fully overlapping counter-rotating bicolored surfaces of light and dark random dots were presented on a gray background of intermediate luminance. This stimulus creates a percept of two separate semitransparent surfaces and allows the measurement of feature- and object-based selections while controlling spatial attention. On each trial, human participants attended to a subset of dots defined by feature (luminance polarity) and object (surface) in order to detect brief episodes of radial motion while ignoring any events in the unattended groups of dots. Attentional selection was assessed by means of steady-state visual evoked potentials (SSVEPs) and behavioral measures. SSVEP amplitudes recorded at medial occipital electrode sites were modulated both by surface-based and luminance polarity-based selection in a manner consistent with independent multiplicative enhancement of attentional effects in different dimensions in early visual cortex. This finding supports the view that feature-based attention spreads across object boundaries, at least at an early stage of processing. However, SSVEPs elicited at more lateral electrode sites showed a hierarchical pattern of selection, potentially reflecting the binding of surface-defining features with luminance features to enable surface-based attention.

Designing and Interpreting Psychophysical Investigations of Cognition

Scientific experimentation depends on the artificial control of natural phenomena. The inaccessibility of cognitive processes to direct manipulation can make such control difficult to realize. Here, we discuss approaches for overcoming this challenge. We advocate the incorporation of experimental techniques from sensory psychophysics into the study of cognitive processes such as decision making and executive control. These techniques include the use of simple parameterized stimuli to precisely manipulate available information and computational models to jointly quantify behavior and neural responses. We illustrate the potential for such techniques to drive theoretical development, and we examine important practical details of how to conduct controlled experiments when using them. Finally, we highlight principles guiding the use of computational models in studying the neural basis of cognition.

The tempos of performance

Human performance fluctuates over time. Rather than random, the complex time course of variation reflects, among other factors, influences from regular periodic processes operating at multiple time scales. In this review, we consider evidence for how our performance ebbs and flows over fractions of seconds as we engage with sensory objects, over minutes as we perform tasks, and over hours according to homeostatic factors. We propose that rhythms of performance at these multiple tempos arise from the interplay among three sources of influence: intrinsic fluctuations in brain activity, periodicity of external stimulation, and the anticipation of the temporal structure of external stimulation by the brain.

Local and Global Influences of Visual Spatial Selection and Locomotion in Mouse Primary Visual Cortex

Sensory selection and movement locally and globally modulate neural responses in seemingly similar ways. For example, locomotion enhances visual responses in mouse primary visual cortex (V1), resembling the effects of spatial attention on primate visual cortical activity. However, interactions between these local and global mechanisms and the resulting effects on perceptual behavior remain largely unknown. Here, we describe a novel mouse visual spatial selection task in which animals either monitor one of two locations for a contrast change ("selective mice") or monitor both ("non-selective mice") and can run at will. Selective mice perform well only when their selected stimulus changes, giving rise to local electrophysiological changes in the corresponding hemisphere of V1 including decreased noise correlations and increased visual information. Non-selective mice perform well when either stimulus changes, giving rise to global changes across both hemispheres of V1. During locomotion, selective mice have worse behavioral performance, increased noise correlations in V1, and decreased visual information, while non-selective mice have decreased noise correlations in V1 but no change in performance or visual information. Our findings demonstrate that mice can locally or globally enhance visual information, but the interaction of the global effect of locomotion with local selection impairs behavioral performance. Moving forward, this mouse model will facilitate future studies of local and global sensory modulatory mechanisms and their effects on behavior.

Task-related hemodynamic responses are modulated by reward and task engagement

Hemodynamic recordings from visual cortex contain powerful endogenous task-related responses that may reflect task-related arousal, or "task engagement" distinct from attention. We tested this hypothesis with hemodynamic measurements (intrinsic-signal optical imaging) from monkey primary visual cortex (V1) while the animals' engagement in a periodic fixation task over several hours was varied through reward size and as animals took breaks. With higher rewards, animals appeared more task-engaged; task-related responses were more temporally precise at the task period (approximately 10-20 seconds) and modestly stronger. The 2-5 minute blocks of high-reward trials led to ramp-like decreases in mean local blood volume; these reversed with ramp-like increases during low reward. The blood volume increased even more sharply when the animal shut his eyes and disengaged completely from the task (5-10 minutes). We propose a mechanism that controls vascular tone, likely along with local neural responses in a manner that reflects task engagement over the full range of timescales tested.

Temporal Dynamics of Visual Attention Allocation

We often temporally prepare our attention for an upcoming event such as a starter pistol. In such cases, our attention should be properly allocated around the expected moment of the event to process relevant sensory input efficiently. In this study, we examined the dynamic changes of attention levels near the expected moment by measuring contrast sensitivity to a target that was temporally cued by a five-second countdown. We found that the overall attention level decreased rapidly after the expected moment, while it stayed relatively constant before it. Results were not consistent with the predictions of existing explanations of temporal attention such as the hazard rate or the stimulus-driven oscillations. A control experiment ruled out the possibility that the observed pattern was due to biased time perception. In a further experiment with a wider range of cue-stimulus-intervals, we observed that attention level increased until the last 500 ms of the interval range, and thereafter, started to decrease. Based on the performances of a generative computational model, we suggest that our results reflect the nature of temporal attention that takes into account the subjectively estimated hazard rate and the probability of relevant events occurring in the near future.

Temporal cueing enhances neuronal and behavioral discrimination performance in rat whisker system

Since sensory systems operate with a finite quantity of processing resources, an animal would benefit from prioritizing processing of sensory stimuli within a time window that is expected to provide key information. This behavioral manifestation of such prioritization is known as attention. Here, we investigate attention with temporal cueing and its neuronal correlates in the rat primary vibrissal somatosensory (vS1) cortex. Rats were trained in a simple whisker vibration detection task. A vibration was presented at one of two spatial locations (left or right), sometimes after an unknown time interval and sometimes after receiving an auditory cue. The auditory cue provided temporal but not spatial information about the vibration. We found that for all rats ( n = 6), the auditory cue consistently enhanced detection of the vibration stimulus. Neuronal activity in vS1 cortex reflected the observed behavioral enhancement from temporal cueing with single units responded differentially to the whisker vibration stimulus when it was temporally predicted by the auditory cue, exhibiting an enhanced signal-to-noise ratio. Our findings indicate that rats are capable of prioritizing processing within a specified time window and provide evidence that the primary sensory cortex may participate in the temporal allocation of resources.

NEW & NOTEWORTHY We demonstrate a novel paradigm of temporal cueing in rats. In a two-alternative whisker detection task, an auditory cue provided information about the timing of the stimulus but not the correct choice. In the presence of cue, detection was faster and more accurate, and neuronal activity from the primary somatosensory cortex revealed enhanced representation of vibrations. These results thus establish the rat as an alternative model organism to primates for studying temporal attention.

Monocular channels have a functional role in phasic alertness and temporal expectancy

The literature has long emphasized the neocortex's role in the tangled phasic-alertness and temporal-expectancy processes. In this work, we examined whether subcortical, monocular mechanisms have a functional role in these processes. This was done by assessing phasic alertness and temporal expectancy independently using a cue-target eye-of-origin manipulation. Participants performed target detection tasks in which a central cue and its ensuing peripheral target were each presented either to the same eye or to a different eye. In Experiment 1, phasic alertness, independent of temporal expectancy, was manipulated by presenting an alerting cue prior to the target presentation. The alerting effect elicited by the cue lasted for a longer duration when the cue and target were presented to the same eye than when they were presented to different eyes, indicating the involvement of subcortical regions in phasic alertness. In Experiment 2, the cue's temporal predictability regarding the target's onset time was manipulated by changing the cue-target interval's foreperiod distribution. A modulation in temporal expectancy was found when both the cue and the target were presented to the same eye, demonstrating the importance of subcortical mechanisms in temporal expectancy. Together, the results demonstrate that monocular channels are functionally involved in both phasic alertness and temporal expectancy. This study suggests that both phasic alertness and temporal expectancy are functionally dependent on monocular channels of the visual stream, and highlights the importance of direct examination of primitive, subcortical regions in higher cognitive functioning (e.g., temporal expectancy).

Directing Voluntary Temporal Attention Increases Fixational Stability

Our visual input is constantly changing, but not all moments are equally relevant. Visual temporal attention, the prioritization of visual information at specific points in time, increases perceptual sensitivity at behaviorally relevant times. The dynamic processes underlying this increase are unclear. During fixation, humans make small eye movements called microsaccades, and inhibiting microsaccades improves perception of brief stimuli. Here, we investigated whether temporal attention changes the pattern of microsaccades in anticipation of brief stimuli. Human observers (female and male) judged stimuli presented within a short sequence. Observers were given either an informative precue to attend to one of the stimuli, which was likely to be probed, or an uninformative (neutral) precue. We found strong microsaccadic inhibition before the stimulus sequence, likely due to its predictable onset. Critically, this anticipatory inhibition was stronger when the first target in the sequence (T1) was precued (task-relevant) than when the precue was uninformative. Moreover, the timing of the last microsaccade before T1 and the first microsaccade after T1 shifted such that both occurred earlier when T1 was precued than when the precue was uninformative. Finally, the timing of the nearest pre- and post-T1 microsaccades affected task performance. Directing voluntary temporal attention therefore affects microsaccades, helping to stabilize fixation at the most relevant moments over and above the effect of predictability. Just as saccading to a relevant stimulus can be an overt correlate of the allocation of spatial attention, precisely timed gaze stabilization can be an overt correlate of the allocation of temporal attention.SIGNIFICANCE STATEMENT We pay attention at moments in time when a relevant event is likely to occur. Such temporal attention improves our visual perception, but how it does so is not well understood. Here, we discovered a new behavioral correlate of voluntary, or goal-directed, temporal attention. We found that the pattern of small fixational eye movements called microsaccades changes around behaviorally relevant moments in a way that stabilizes the position of the eyes. Microsaccades during a brief visual stimulus can impair perception of that stimulus. Therefore, such fixation stabilization may contribute to the improvement of visual perception at attended times. This link suggests that, in addition to cortical areas, subcortical areas mediating eye movements may be recruited with temporal attention.

Multiscale dynamics of interstimulus interval integration in visual cortex

Although the visual cortex receives information at multiple temporal patterns, much of the research in the field has focused only on intervals shorter than 1 second. Consequently, there is almost no information on what happens at longer temporal intervals. We have tried to address this question recording neuronal populations of the primary visual cortex during visual stimulation with repetitive grating stimuli and intervals ranging from 1 to 7 seconds. Our results showed that firing rate and response stability were dependent of interval duration. In addition, there were collective oscillations with different properties in response to changes in intervals duration. These results suggest that visual cortex could encode visual information at several time scales using oscillations at multiple frequencies.

Entrainment and maintenance of an internal metronome in supplementary motor area

To prepare timely motor actions, we constantly predict future events. Regularly repeating events are often perceived as a rhythm to which we can readily synchronize our movements, just as in dancing to music. However, the neuronal mechanisms underlying the capacity to encode and maintain rhythms are not understood. We trained nonhuman primates to maintain the rhythm of a visual metronome of diverse tempos and recorded neural activity in the supplementary motor area (SMA). SMA exhibited rhythmic bursts of gamma band (30–40 Hz) reflecting an internal tempo that matched the extinguished visual metronome. Moreover, gamma amplitude increased throughout the trial, providing an estimate of total elapsed time. Notably, the timing of gamma bursts and firing rate modulations allowed predicting whether monkeys were ahead or behind the correct tempo. Our results indicate that SMA uses dynamic motor plans to encode a metronome for rhythms and a stopwatch for total elapsed time.

A catchy tune on the radio, and suddenly we are tapping our foot and moving our bodies to the rhythm of the music. We can follow a beat because our motor neurons, the nerve cells that control movements, work together in circuits. During actions that require precise timing – such as dancing to a rhythm – the motor neurons within these circuits increase and decrease their activity in complex patterns.

But recent evidence shows that these motor neuron circuits also ‘switch on’ simply when we perceive a rhythm, even if we do not move to it. In fact, just imagining a rhythm triggers the same symphony of electrical activity in the brain. How do motor neurons generate coordinated patterns of activity without movement or even an external stimulus?

Cadena-Valencia et al. set out to answer this question by training monkeys to follow a rhythm. The animals learned to track a dot that appeared alternately on the left and right sides of a touchscreen with a regular tempo. After a few repeats, the dot disappeared. The monkeys then had to continue mentally tracking where the dot would have been. A group of neurons in a brain region called the supplementary motor area synchronized their activity with the dot. Whenever the dot was due to appear, the neurons in the area showed a burst of rapid firing. These spikes of activity, called gamma bursts, helped the motor neurons to communicate with one another within their circuits.

The gamma bursts thus acted as an internal metronome, making it easier for the monkeys to follow the rhythm. These results should be a starting point for other studies to pinpoint exactly where and how this rhythmic activity arises, and how the brain uses gamma bursts to synchronize our movements to a tempo.

Strategic and Dynamic Temporal Weighting for Perceptual Decisions in Humans and Macaques

Perceptual decision-making is often modeled as the accumulation of sensory evidence over time. Recent studies using psychophysical reverse correlation have shown that even though the sensory evidence is stationary over time, subjects may exhibit a time-varying weighting strategy, weighting some stimulus epochs more heavily than others. While previous work has explained time-varying weighting as a consequence of static decision mechanisms (e.g., decision bound or leak), here we show that time-varying weighting can reflect strategic adaptation to stimulus statistics, and thus can readily take a number of forms. We characterized the temporal weighting strategies of humans and macaques performing a motion discrimination task in which the amount of information carried by the motion stimulus was manipulated over time. Both species could adapt their temporal weighting strategy to match the time-varying statistics of the sensory stimulus. When early stimulus epochs had higher mean motion strength than late, subjects adopted a pronounced early weighting strategy, where early information was weighted more heavily in guiding perceptual decisions. When the mean motion strength was greater in later stimulus epochs, in contrast, subjects shifted to a marked late weighting strategy. These results demonstrate that perceptual decisions involve a temporally flexible weighting process in both humans and monkeys, and introduce a paradigm with which to manipulate sensory weighting in decision-making tasks.

State dependence of stimulus-induced variability tuning in macaque MT

Behavioral states marked by varying levels of arousal and attention modulate some properties of cortical responses (e.g. average firing rates or pairwise correlations), yet it is not fully understood what drives these response changes and how they might affect downstream stimulus decoding. Here we show that changes in state modulate the tuning of response variance-to-mean ratios (Fano factors) in a fashion that is neither predicted by a Poisson spiking model nor changes in the mean firing rate, with a substantial effect on stimulus discriminability. We recorded motion-sensitive neurons in middle temporal cortex (MT) in two states: alert fixation and light, opioid anesthesia. Anesthesia tended to lower average spike counts, without decreasing trial-to-trial variability compared to the alert state. Under anesthesia, within-trial fluctuations in excitability were correlated over longer time scales compared to the alert state, creating supra-Poisson Fano factors. In contrast, alert-state MT neurons have higher mean firing rates and largely sub-Poisson variability that is stimulus-dependent and cannot be explained by firing rate differences alone. The absence of such stimulus-induced variability tuning in the anesthetized state suggests different sources of variability between states. A simple model explains state-dependent shifts in the distribution of observed Fano factors via a suppression in the variance of gain fluctuations in the alert state. A population model with stimulus-induced variability tuning and behaviorally constrained information-limiting correlations explores the potential enhancement in stimulus discriminability by the cortical population in the alert state.

The brain controls behavior fluidly in a wide variety of cognitive contexts that alter the precision of neural responses. We examine how neural variability changes versus the mean response as a function of the stimulus and the behavioral state. We show that this scaled variability can have qualitatively different stimulus tuning in different behavioral contexts. In alert primates, scaled variability is tuned to the direction of motion of a visual stimulus and decreases around the preferred direction of each neuron. Under anesthesia, neurons show flat scaled variability tuning and, overall, responses are significantly more variable. We develop a simple model that includes a parameter describing firing rate gain fluctuations that can explain these changes. Our results suggest that tuned decreases in scaled variability during wakefulness may be mediated by an active process that suppresses synchronization and makes information transmission more reliable.

A Dynamical Systems Perspective on Flexible Motor Timing

A hallmark of higher brain function is the ability to rapidly and flexibly adjust behavioral responses based on internal and external cues. Here, we examine the computational principles that allow decisions and actions to unfold flexibly in time. We adopt a dynamical systems perspective and outline how temporal flexibility in such a system can be achieved through manipulations of inputs and initial conditions. We then review evidence from experiments in nonhuman primates that support this interpretation. Finally, we explore the broader utility and limitations of the dynamical systems perspective as a general framework for addressing open questions related to the temporal control of movements, as well as in the domains of learning and sequence generation.