Spatial attention decorrelates intrinsic activity fluctuations in macaque area V4

Top-down attention and Alzheimer's pathology affect cortical selectivity during learning, influencing episodic memory in older adults

Effective memory formation declines in human aging. Diminished neural selectivity-reduced differential responses to preferred versus nonpreferred stimuli-may contribute to memory decline, but its drivers remain unclear. We investigated the effects of top-down attention and preclinical Alzheimer's disease (AD) pathology on neural selectivity in 166 cognitively unimpaired older participants using functional magnetic resonance imaging during a word-face/word-place associative memory task. During learning, neural selectivity in place- and, to a lesser extent, face-selective regions was greater for subsequently remembered than forgotten events; positively scaled with variability in dorsal attention network activity, within and across individuals; and negatively related to AD pathology, evidenced by elevated plasma phosphorylated Tau181 (pTau181). Path analysis revealed that neural selectivity mediated the effects of age, attention, and pTau181 on memory. These data reveal multiple pathways that contribute to memory differences among older adults-AD-independent reductions in top-down attention and AD-related pathology alter the precision of cortical representations of events during experience, with consequences for remembering.

Unsupervised identification of internal perceptual states influencing psychomotor performance

When humans perform repetitive tasks over long periods, their performance is not constant. People drift in and out of states that might be loosely categorised as engagement, disengagement or 'flow' and these states will be reflected in aspects of their performance (for example, reaction time, accuracy, criteria shifts and potentially longer-term strategy). Until recently it has been challenging to relate these behavioural states to the underlying neural mechanisms that generate them. Here, we acquired magnetoencephalograpy recordings and contemporaneous, dense behavioural data from participants performing an engaging task (Tetris) that required rapid, strategic behavioural responses over the period of an entire game. We asked whether it was possible to infer the presence of distinct behavioural states from the behavioural data and, if so, whether these states would have distinct neural correlates. We used hidden Markov Modelling to segment the behavioural time series into states with unique behavioural signatures, finding that we could identify three distinct and robust behavioural states. We then computed occipital alpha power across each state. These within-participant differences in alpha power were statistically significant, suggesting that individuals shift between behaviourally and neurally distinct states during complex performance, and that visuo-spatial attention change across these states.

How distinct sources of nuisance variability in natural images and scenes limit human stereopsis

Stimulus variability-a form of nuisance variability-is a primary source of perceptual uncertainty in everyday natural tasks. How do different properties of natural images and scenes contribute to this uncertainty? Using binocular disparity as a model system, we report a systematic investigation of how various forms of natural stimulus variability impact performance in a stereo-depth discrimination task. With stimuli sampled from a stereo-image database of real-world scenes having pixel-by-pixel ground-truth distance data, three human observers completed two closely related double-pass psychophysical experiments. In the two experiments, each human observer responded twice to ten thousand unique trials, in which twenty thousand unique stimuli were presented. New analytical methods reveal, from this data, the specific and nearly dissociable effects of two distinct sources of natural stimulus variability-variation in luminance-contrast patterns and variation in local-depth structure-on discrimination performance, as well as the relative importance of stimulus-driven-variability and internal-noise in determining performance limits. Between-observer analyses show that both stimulus-driven sources of uncertainty are responsible for a large proportion of total variance, have strikingly similar effects on different people, and-surprisingly-make stimulus-by-stimulus responses more predictable (not less). The consistency across observers raises the intriguing prospect that image-computable models can make reasonably accurate performance predictions in natural viewing. Overall, the findings provide a rich picture of stimulus factors that contribute to human perceptual performance in natural scenes. The approach should have broad application to other animal models and other sensory-perceptual tasks with natural or naturalistic stimuli.

Environmental context influences visual processing in thalamus

Behavioral state modulates neural activity throughout the visual system.1,2,3 This is largely due to changes in arousal that alter internal brain states.4,5,6,7,8,9,10 Much is known about how these internal factors influence visual processing,7,8,9,10,11 but comparatively less is known about the role of external environmental contexts.12 Environmental contexts can promote or prevent certain actions,13 and it remains unclear if and how this affects visual processing. Here, we addressed this question in the thalamus of awake, head-fixed mice while they viewed stimuli but remained stationary in two different environmental contexts: either a cylindrical tube or a circular running wheel that enabled locomotion. We made silicon probe recordings in the dorsal lateral geniculate nucleus (dLGN) while simultaneously measuring multiple metrics of arousal changes so that we could control for these across contexts. We found surprising differences in spatial and temporal processing in dLGN across contexts. The wheel context (versus tube) showed elevated baseline activity and faster but less spatially selective visual responses; however, these visual processing differences disappeared if the wheel no longer enabled locomotion. Our results reveal an unexpected influence of the physical environmental context on fundamental aspects of early visual processing, even in otherwise identical states of alertness and stillness.

Gustatory cortex neurons perform reliability-dependent integration of multisensory flavor inputs

Flavor is the quintessential multisensory experience, combining gustatory, retronasal olfactory, and texture qualities to inform food perception and consumption behavior. However, the computations that govern multisensory integration of flavor components and their underlying neural mechanisms remain elusive. Here, we use rats as a model system to test the hypothesis that taste and smell components of flavor are integrated in a reliability-dependent manner to inform hedonic judgments and that this computation is performed by neurons in the primary taste cortex. Using a series of two-bottle preference tests, we demonstrate that hedonic judgments of taste + smell mixtures are a weighted average of the component judgments, and that the weight of the components depends on their relative reliability. Using extracellular recordings of single-neuron spiking and local field potential activity in combination with decoding analysis, we reveal a correlate of this computation in gustatory cortex (GC). GC neurons weigh bimodal taste and smell inputs based on their reliability, with more reliable inputs contributing more strongly to taste + smell mixture responses. Input reliability was associated with less variable responses and stronger network-level synchronization in the gamma band. Together, our findings establish a quantitative framework for understanding hedonic multisensory flavor judgments and identify the neural computations that underlie them.

Contributions of action potentials to scalp EEG: Theory and biophysical simulations

Differences in the apparent 1/f component of neural power spectra require correction depending on the underlying neural mechanisms, which remain incompletely understood. Past studies suggest that neuronal spiking produces broadband signals and shapes the spectral trend of invasive macroscopic recordings, but it is unclear to what extent action potentials (APs) influence scalp EEG. Here, we combined biophysical simulations with statistical modelling to examine the amplitude and spectral content of scalp potentials generated by the electric fields from spiking activity. In physiological parameter regimes, we found that APs contribute negligibly to the EEG spectral trend. Consistent with this, comparing our biophysical simulations with previously published data from pharmacologically paralyzed subjects suggested that the EEG spectral trend can be explained by a combination of synaptic timescales and electromyogram contamination. We also modelled rhythmic EEG generation, finding that APs can generate detectable narrowband power between approximately 60 and 1000 Hz, reaching frequencies much faster than would be possible from synaptic currents. Finally, we show that different spectral detrending strategies are required for AP generated oscillations compared to synaptically generated oscillations, suggesting that existing detrending methods for EEG spectra need to be modified for high frequency signals.

Decoding the hidden variabilities in mPFC descending pathways across emotional states

Effective emotional regulation, crucial for adaptive behavior, is mediated by the medial prefrontal cortex (mPFC) via connections to the basolateral amygdala (BLA) and nucleus accumbens (NAc), traditionally considered functionally similar in modulating reward and aversion responses. However, how the mPFC balances these descending pathways to control behavioral outcomes remains unclear. We found that while overall firing patterns appeared consistent across emotional states, deeper analysis revealed distinct variabilities. Specifically, mPFC→BLA neurons, especially "center-ON" neurons, exhibited heightened activity during anxiety-related behaviors, highlighting their role in anxiety encoding. Conversely, mPFC→NAc neurons were more active during exploratory behaviors, implicating them in processing positive emotional states. Notably, mPFC→NAc neurons showed significant pattern decorrelation during social interactions, suggesting a pivotal role in encoding social preference. Additionally, chronic emotional states affected these pathways differently: positive states enhanced mPFC→NAc activity, while negative states boosted mPFC→BLA activity. These findings challenge the assumed functional similarity and highlight distinct contributions to emotional regulation, suggesting new avenues for therapeutic interventions.

The claustrum and synchronized brain states

Cortical activity is constantly fluctuating between distinct spatiotemporal activity patterns denoted by changes in brain state. States of cortical desynchronization arise during motor generation, increased attention, and high cognitive load. Synchronized brain states comprise spatially widespread, coordinated low-frequency neural activity during rest and sleep when disengaged from the external environment or 'offline'. The claustrum is a small subcortical structure with dense reciprocal connections with the cortex suggesting modulation by, or participation in, brain state regulation. Here, we highlight recent work suggesting that neural activity in the claustrum supports cognitive processes associated with synchronized brain states characterized by increased low-frequency network activity. As an example, we outline how claustrum activity could support episodic memory consolidation during sleep.

Are neuronal mechanisms of attention universal across human sensory and motor brain maps?

One's experience of shifting attention from the color to the smell to the act of picking a flower seems like a unitary process applied, at will, to one modality after another. Yet, the unique and separable experiences of sight versus smell versus movement might suggest that the neural mechanisms of attention have been separately optimized to employ each modality to its greatest advantage. Moreover, addressing the issue of universality can be particularly difficult due to a paucity of existing cross-modal comparisons and a dearth of neurophysiological methods that can be applied equally well across disparate modalities. Here we outline some of the conceptual and methodological issues related to this problem and present an instructive example of an experimental approach that can be applied widely throughout the human brain to permit detailed, quantitative comparison of attentional mechanisms across modalities. The ultimate goal is to spur efforts across disciplines to provide a large and varied database of empirical observations that will either support the notion of a universal neural substrate for attention or more clearly identify the degree to which attentional mechanisms are specialized for each modality.

Running modulates primate and rodent visual cortex differently

When mice run, activity in their primary visual cortex (V1) is strongly modulated. This observation has altered conceptions of a brain region assumed to be a passive image processor. Extensive work has followed to dissect the circuits and functions of running-correlated modulation. However, it remains unclear whether visual processing in primates might similarly change during locomotion. We therefore measured V1 activity in marmosets while they viewed stimuli on a treadmill. In contrast to mouse, running-correlated modulations of marmoset V1 were small and tended to be slightly suppressive. Population-level analyses revealed trial-to-trial fluctuations of shared gain across V1 in both species, but while strongly correlated with running in mice, gain modulations were smaller and more often negatively correlated with running in marmosets. Thus, population-wide fluctuations of V1 may reflect a common feature of mammalian visual cortical function, but important quantitative differences point to distinct consequences for the relation between vision and action in primates versus rodents.

Brain state and cortical layer-specific mechanisms underlying perception at threshold

Identical stimuli can be perceived or go unnoticed across successive presentations, producing divergent behavioral outcomes despite similarities in sensory input. We sought to understand how fluctuations in behavioral state and cortical layer and cell class-specific neural activity underlie this perceptual variability. We analyzed physiological measurements of state and laminar electrophysiological activity in visual area V4 while monkeys were rewarded for correctly reporting a stimulus change at perceptual threshold. Hit trials were characterized by a behavioral state with heightened arousal, greater eye position stability, and enhanced decoding performance of stimulus identity from neural activity. Target stimuli evoked stronger responses in V4 in hit trials, and excitatory neurons in the superficial layers, the primary feed-forward output of the cortical column, exhibited lower variability. Feed-forward interlaminar population correlations were stronger on hits. Hit trials were further characterized by greater synchrony between the output layers of the cortex during spontaneous activity, while the stimulus-evoked period showed elevated synchrony in the feed-forward pathway. Taken together, these results suggest that a state of elevated arousal and stable retinal images allow enhanced processing of sensory stimuli, which contributes to hits at perceptual threshold.

Dissociation of Attentional State and Behavioral Outcome Using Local Field Potentials

Successful behavior depends on the attentional state and other factors related to decision-making, which may modulate neuronal activity differently. Here, we investigated whether attentional state and behavioral outcome (i.e., whether a target is detected or missed) are distinguishable using the power and phase of local field potential recorded bilaterally from area V4 of two male rhesus monkeys performing a cued visual attention task. To link each trial's outcome to pairwise measures of attention that are typically averaged across trials, we used several methods to obtain single-trial estimates of spike count correlation and phase consistency. Surprisingly, while attentional location was best discriminated using gamma and high-gamma power, behavioral outcome was best discriminated by alpha power and steady-state visually evoked potential. Power outperformed absolute phase in attentional/behavioral discriminability, although single-trial gamma phase consistency provided reasonably high attentional discriminability. Our results suggest a dissociation between the neuronal mechanisms that regulate attentional focus and behavioral outcome.

Synchrony dynamics underlie irregular neocortical spiking

Cortical neurons are characterized by their variable spiking patterns. We challenge prevalent theories for the origin of spiking variability. We examine the specific hypothesis that cortical synchrony drives spiking variability in vivo . Using dynamic clamp, we demonstrate that intrinsic neuronal properties do not contribute substantially to spiking variability, but rather spiking variability emerges from weakly synchronous network drive. With large-scale electrophysiology we quantify the degree of synchrony and its time scale in cortical networks in vivo . We demonstrate that physiological levels of synchrony are sufficient to generate irregular responses found in vivo . Further, this synchrony shifts over timescales ranging from 25 to 200 ms, depending on the presence of external sensory input. Such shifts occur when the network moves from spontaneous to driven modes, leading naturally to a decline in response variability as observed across cortical areas. Finally, while individual neurons exhibit reliable responses to physiological drive, different neurons respond in a distinct fashion according to their intrinsic properties, contributing to stable synchrony across the neural network.

Recent Visual Experience Reshapes V4 Neuronal Activity and Improves Perceptual Performance

Recent visual experience heavily influences our visual perception, but how neuronal activity is reshaped to alter and improve perceptual discrimination remains unknown. We recorded from populations of neurons in visual cortical area V4 while two male rhesus macaque monkeys performed a natural image change detection task under different experience conditions. We found that maximizing the recent experience with a particular image led to an improvement in the ability to detect a change in that image. This improvement was associated with decreased neural responses to the image, consistent with neuronal changes previously seen in studies of adaptation and expectation. We found that the magnitude of behavioral improvement was correlated with the magnitude of response suppression. Furthermore, this suppression of activity led to an increase in signal separation, providing evidence that a reduction in activity can improve stimulus encoding. Within populations of neurons, greater recent experience was associated with decreased trial-to-trial shared variability, indicating that a reduction in variability is a key means by which experience influences perception. Taken together, the results of our study contribute to an understanding of how recent visual experience can shape our perception and behavior through modulating activity patterns in the mid-level visual cortex.

Correlated variability and its attentional modulation depend on anatomical connectivity

Visual cortical neurons show variability in their responses to repeated presentations of a stimulus and a portion of this variability is shared across neurons. Attention may enhance visual perception by reducing shared spiking variability. However, shared variability and its attentional modulation are not consistent within or across cortical areas, and depend on additional factors such as neuronal type. A critical factor that has not been tested is actual anatomical connectivity. We measured spike count correlations among pairs of simultaneously recorded neurons in the primary visual cortex (V1) for which anatomical connectivity was inferred from spiking cross-correlations. Neurons were recorded in monkeys performing a contrast-change discrimination task requiring covert shifts in visual spatial attention. Accordingly, spike count correlations were compared across trials in which attention was directed toward or away from the visual stimulus overlapping recorded neuronal receptive fields. Consistent with prior findings, attention did not significantly alter spike count correlations among random pairings of unconnected V1 neurons. However, V1 neurons connected via excitatory synapses showed a significant reduction in spike count correlations with attention. Interestingly, V1 neurons connected via inhibitory synapses demonstrated high spike count correlations overall that were not modulated by attention. Correlated variability in excitatory circuits also depended upon neuronal tuning for contrast, the task-relevant stimulus feature. These results indicate that shared variability depends on the type of connectivity in neuronal circuits. Also, attention significantly reduces shared variability in excitatory circuits, even when attention effects on randomly sampled neurons within the same area are weak.

Neocortical inhibitory imbalance predicts successful sensory detection

Perceptual success depends on fast-spiking, parvalbumin-positive interneurons (FS/PVs). However, competing theories of optimal rate and correlation in pyramidal (PYR) firing make opposing predictions regarding the underlying FS/PV dynamics. We addressed this with population calcium imaging of FS/PVs and putative PYR neurons during threshold detection. In primary somatosensory and visual neocortex, a distinct PYR subset shows increased rate and spike-count correlations on detected trials ("hits"), while most show no rate change and decreased correlations. A larger fraction of FS/PVs predicts hits with either rate increases or decreases. Using computational modeling, we found that inhibitory imbalance, created by excitatory "feedback" and interactions between FS/PV pools, can account for the data. Rate-decreasing FS/PVs increase rate and correlation in a PYR subset, while rate-increasing FS/PVs reduce correlations and offset enhanced excitation in PYR neurons. These findings indicate that selection of informative PYR ensembles, through transient inhibitory imbalance, is a common motif of optimal neocortical processing.

Recent visual experience reshapes V4 neuronal activity and improves perceptual performance

Recent visual experience heavily influences our visual perception, but how this is mediated by the reshaping of neuronal activity to alter and improve perceptual discrimination remains unknown. We recorded from populations of neurons in visual cortical area V4 while monkeys performed a natural image change detection task under different experience conditions. We found that maximizing the recent experience with a particular image led to an improvement in the ability to detect a change in that image. This improvement was associated with decreased neural responses to the image, consistent with neuronal changes previously seen in studies of adaptation and expectation. We found that the magnitude of behavioral improvement was correlated with the magnitude of response suppression. Furthermore, this suppression of activity led to an increase in signal separation, providing evidence that a reduction in activity can improve stimulus encoding. Within populations of neurons, greater recent experience was associated with decreased trial-to-trial shared variability, indicating that a reduction in variability is a key means by which experience influences perception. Taken together, the results of our study contribute to an understanding of how recent visual experience can shape our perception and behavior through modulating activity patterns in mid-level visual cortex.

Probabilistic neural transfer function estimation with Bayesian system identification

Neural population responses in sensory systems are driven by external physical stimuli. This stimulus-response relationship is typically characterized by receptive fields, which have been estimated by neural system identification approaches. Such models usually require a large amount of training data, yet, the recording time for animal experiments is limited, giving rise to epistemic uncertainty for the learned neural transfer functions. While deep neural network models have demonstrated excellent power on neural prediction, they usually do not provide the uncertainty of the resulting neural representations and derived statistics, such as most exciting inputs (MEIs), from in silico experiments. Here, we present a Bayesian system identification approach to predict neural responses to visual stimuli, and explore whether explicitly modeling network weight variability can be beneficial for identifying neural response properties. To this end, we use variational inference to estimate the posterior distribution of each model weight given the training data. Tests with different neural datasets demonstrate that this method can achieve higher or comparable performance on neural prediction, with a much higher data efficiency compared to Monte Carlo dropout methods and traditional models using point estimates of the model parameters. At the same time, our variational method provides us with an effectively infinite ensemble, avoiding the idiosyncrasy of any single model, to generate MEIs. This allows us to estimate the uncertainty of stimulus-response function, which we have found to be negatively correlated with the predictive performance at model level and may serve to evaluate models. Furthermore, our approach enables us to identify response properties with credible intervals and to determine whether the inferred features are meaningful by performing statistical tests on MEIs. Finally, in silico experiments show that our model generates stimuli driving neuronal activity significantly better than traditional models in the limited-data regime.

Dissociation of attentional state and behavioral outcome using local field potentials

Successful behavior depends on attentional state and other factors related to decision-making, which may modulate neuronal activity differently. Here, we investigated whether attentional state and behavioral outcome (i.e., whether a target is detected or missed) are distinguishable using the power and phase of local field potential (LFP) recorded bilaterally from area V4 of monkeys performing a cued visual attention task. To link each trial's outcome to pairwise measures of attention that are typically averaged across trials, we used several methods to obtain single-trial estimates of spike count correlation and phase consistency. Surprisingly, while attentional location was best discriminated using gamma and high-gamma power, behavioral outcome was best discriminated by alpha power and steady-state visually evoked potential. Power outperformed absolute phase in attentional/behavioral discriminability, although single-trial gamma phase consistency provided reasonably high attentional discriminability. Our results suggest a dissociation between the neuronal mechanisms that regulate attentional focus and behavioral outcome.

Brain-state mediated modulation of inter-laminar dependencies in visual cortex

Spatial attention is critical for recognizing behaviorally relevant objects in a cluttered environment. How the deployment of spatial attention aids the hierarchical computations of object recognition remains unclear. We investigated this in the laminar cortical network of visual area V4, an area strongly modulated by attention. We found that deployment of attention strengthened unique dependencies in neural activity across cortical layers. On the other hand, shared dependencies were reduced within the excitatory population of a layer. Surprisingly, attention strengthened unique dependencies within a laminar population. Crucially, these modulation patterns were also observed during successful behavioral outcomes that are thought to be mediated by internal brain state fluctuations. Successful behavioral outcomes were also associated with phases of reduced neural excitability, suggesting a mechanism for enhanced information transfer during optimal states. Our results suggest common computation goals of optimal sensory states that are attained by either task demands or internal fluctuations.

Cholinergic Neuromodulation of Prefrontal Attractor Dynamics Controls Performance in Spatial Working Memory

The behavioral and neural effects of the endogenous release of acetylcholine following stimulation of the nucleus basalis (NB) of Meynert have been recently examined in two male monkeys (Qi et al., 2021). Counterintuitively, NB stimulation enhanced behavioral performance while broadening neural tuning in the prefrontal cortex (PFC). The mechanism by which a weaker mnemonic neural code could lead to better performance remains unclear. Here, we show that increased neural excitability in a simple continuous bump attractor model can induce broader neural tuning and decrease bump diffusion, provided neural rates are saturated. Increased memory precision in the model overrides memory accuracy, improving overall task performance. Moreover, we show that bump attractor dynamics can account for the nonuniform impact of neuromodulation on distractibility, depending on distractor distance from the target. Finally, we delve into the conditions under which bump attractor tuning and diffusion balance in biologically plausible heterogeneous network models. In these discrete bump attractor networks, we show that reducing spatial correlations or enhancing excitatory transmission can improve memory precision. Altogether, we provide a mechanistic understanding of how cholinergic neuromodulation controls spatial working memory through perturbed attractor dynamics in the PFC.

Decision-related activity and movement selection in primate visual cortex

Fluctuations in the activity of sensory neurons often predict perceptual decisions. This connection can be quantified with a metric called choice probability (CP), and there is a longstanding debate about whether CP reflects a causal influence on decisions or an echo of decision-making activity elsewhere in the brain. Here, we show that CP can reflect a third variable, namely, the movement used to indicate the decision. In a standard visual motion discrimination task, neurons in the middle temporal (MT) area of primate cortex responded more strongly during trials that involved a saccade toward their receptive fields. This variability accounted for much of the CP observed across the neuronal population, and it arose through training. Moreover, pharmacological inactivation of MT biased behavioral responses away from the corresponding visual field locations. These results demonstrate that training on a task with fixed sensorimotor contingencies introduces movement-related activity in sensory brain regions and that this plasticity can shape the neural circuitry of perceptual decision-making.

Distributed and dynamical communication: a mechanism for flexible cortico-cortical interactions and its functional roles in visual attention

Perceptual and cognitive processing relies on flexible communication among cortical areas; however, the underlying neural mechanism remains unclear. Here we report a mechanism based on the realistic spatiotemporal dynamics of propagating wave patterns in neural population activity. Using a biophysically plausible, multiarea spiking neural circuit model, we demonstrate that these wave patterns, characterized by their rich and complex dynamics, can account for a wide variety of empirically observed neural processes. The coordinated interactions of these wave patterns give rise to distributed and dynamic communication (DDC) that enables flexible and rapid routing of neural activity across cortical areas. We elucidate how DDC unifies the previously proposed oscillation synchronization-based and subspace-based views of interareal communication, offering experimentally testable predictions that we validate through the analysis of Allen Institute Neuropixels data. Furthermore, we demonstrate that DDC can be effectively modulated during attention tasks through the interplay of neuromodulators and cortical feedback loops. This modulation process explains many neural effects of attention, underscoring the fundamental functional role of DDC in cognition.

Response sub-additivity and variability quenching in visual cortex

Sub-additivity and variability are ubiquitous response motifs in the primary visual cortex (V1). Response sub-additivity enables the construction of useful interpretations of the visual environment, whereas response variability indicates the factors that limit the precision with which the brain can do this. There is increasing evidence that experimental manipulations that elicit response sub-additivity often also quench response variability. Here, we provide an overview of these phenomena and suggest that they may have common origins. We discuss empirical findings and recent model-based insights into the functional operations, computational objectives and circuit mechanisms underlying V1 activity. These different modelling approaches all predict that response sub-additivity and variability quenching often co-occur. The phenomenology of these two response motifs, as well as many of the insights obtained about them in V1, generalize to other cortical areas. Thus, the connection between response sub-additivity and variability quenching may be a canonical motif across the cortex.

Probing the Structure and Functional Properties of the Dropout-Induced Correlated Variability in Convolutional Neural Networks

Computational neuroscience studies have shown that the structure of neural variability to an unchanged stimulus affects the amount of information encoded. Some artificial deep neural networks, such as those with Monte Carlo dropout layers, also have variable responses when the input is fixed. However, the structure of the trial-by-trial neural covariance in neural networks with dropout has not been studied, and its role in decoding accuracy is unknown. We studied the above questions in a convolutional neural network model with dropout in both the training and testing phases. We found that trial-by-trial correlation between neurons (i.e., noise correlation) is positive and low dimensional. Neurons that are close in a feature map have larger noise correlation. These properties are surprisingly similar to the findings in the visual cortex. We further analyzed the alignment of the main axes of the covariance matrix. We found that different images share a common trial-by-trial noise covariance subspace, and they are aligned with the global signal covariance. This evidence that the noise covariance is aligned with signal covariance suggests that noise covariance in dropout neural networks reduces network accuracy, which we further verified directly with a trial-shuffling procedure commonly used in neuroscience. These findings highlight a previously overlooked aspect of dropout layers that can affect network performance. Such dropout networks could also potentially be a computational model of neural variability.

Irregularity of instantaneous gamma frequency in the motor control network characterize visuomotor and proprioceptive information processing

Objective.The study aims to characterize movements with different sensory goals, by contrasting the neural activity involved in processing proprioceptive and visuo-motor information. To accomplish this, we have developed a new methodology that utilizes the irregularity of the instantaneous gamma frequency parameter for characterization.Approach.In this study, eight essential tremor patients undergoing an awake deep brain stimulation implantation surgery repetitively touched the clinician's finger (forward visually-guided/FV movement) and then one's own chin (backward proprioceptively-guided/BP movement). Neural electrocorticographic recordings from the motor (M1), somatosensory (S1), and posterior parietal cortex (PPC) were obtained and band-pass filtered in the gamma range (30-80 Hz). The irregularity of the inter-event intervals (IEI; inverse of instantaneous gamma frequency) were examined as: (1) auto-information of the IEI time series and (2) correlation between the amplitude and its proceeding IEI. We further explored the network connectivity after segmenting the FV and BP movements by periods of accelerating and decelerating forces, and applying the IEI parameter to transfer entropy methods.Main results.Conceptualizing that the irregularity in IEI reflects active new information processing, we found the highest irregularity in M1 during BP movement, highest in PPC during FV movement, and the lowest during rest at all sites. Also, connectivity was the strongest from S1 to M1 and from S1 to PPC during FV movement with accelerating force and weakest during rest.Significance. We introduce a novel methodology that utilize the instantaneous gamma frequency (i.e. IEI) parameter in characterizing goal-oriented movements with different sensory goals, and demonstrate its use to inform the directional connectivity within the motor cortical network. This method successfully characterizes different movement types, while providing interpretations to the sensory-motor integration processes.

Disinhibition by VIP interneurons is orthogonal to cross-modal attentional modulation in primary visual cortex

Attentional modulation of sensory processing is a key feature of cognition; however, its neural circuit basis is poorly understood. A candidate mechanism is the disinhibition of pyramidal cells through vasoactive intestinal peptide (VIP) and somatostatin (SOM)-positive interneurons. However, the interaction of attentional modulation and VIP-SOM disinhibition has never been directly tested. We used all-optical methods to bi-directionally manipulate VIP interneuron activity as mice performed a cross-modal attention-switching task. We measured the activities of VIP, SOM, and parvalbumin (PV)-positive interneurons and pyramidal neurons identified in the same tissue and found that although activity in all cell classes was modulated by both attention and VIP manipulation, their effects were orthogonal. Attention and VIP-SOM disinhibition relied on distinct patterns of changes in activity and reorganization of interactions between inhibitory and excitatory cells. Circuit modeling revealed a precise network architecture consistent with multiplexing strong yet non-interacting modulations in the same neural population.

Primate neocortex performs balanced sensory amplification

The sensory cortex amplifies relevant features of external stimuli. This sensitivity and selectivity arise through the transformation of inputs by cortical circuitry. We characterize the circuit mechanisms and dynamics of cortical amplification by making large-scale simultaneous measurements of single cells in awake primates and testing computational models. By comparing network activity in both driven and spontaneous states with models, we identify the circuit as operating in a regime of non-normal balanced amplification. Incoming inputs are strongly but transiently amplified by strong recurrent feedback from the disruption of excitatory-inhibitory balance in the network. Strong inhibition rapidly quenches responses, thereby permitting the tracking of time-varying stimuli.

Brain-state mediated modulation of inter-laminar dependencies in visual cortex

Spatial attention is a quintessential example of adaptive information processing in the brain and is critical for recognizing behaviorally relevant objects in a cluttered environment. Object recognition is mediated by neural encoding along the ventral visual hierarchy. How the deployment of spatial attention aids these hierarchical computations is unclear. Prior studies point to two distinct mechanisms: an improvement in the efficacy of information directed from one encoding stage to another, and/or a suppression of shared information within encoding stages. To test these proposals, it is crucial to estimate the attentional modulation of unique information flow across and shared information within the encoding stages of the visual hierarchy. We investigated this in the multi-stage laminar network of visual area V4, an area strongly modulated by attention. Using network-based dependency estimation from multivariate data, we quantified the modulation of inter-layer information flow during a change detection task and found that deployment of attention indeed strengthened unique dependencies between the input and superficial layers. Using the partial information decomposition framework, we estimated the modulation of shared dependencies and found that they are reduced specifically in the putative excitatory subpopulations within a layer. Surprisingly, we found a strengthening of unique dependencies within the laminar populations, a finding not previously predicted. Crucially, these modulation patterns were also observed during successful behavioral outcomes (hits) that are thought to be mediated by endogenous brain state fluctuations, and not by experimentally imposed attentive states. Finally, phases of endogenous fluctuations that were optimal for 'hits' were associated with reduced neural excitability. A reduction in neural excitability, potentially mediated by diminished shared inputs, suggests a novel mechanism for enhancing unique information transmission during optimal states. By decomposing the modulation of multivariate information, and combined with prior theoretical work, our results suggest common computations of optimal sensory states that are attained by either task demands or endogenous fluctuations.

Dissociable components of attention exhibit distinct neuronal signatures in primate visual cortex

Attention can be deployed in multiple forms and facilitates behavior by influencing perceptual sensitivity and choice bias. Attention is also associated with a myriad of changes in sensory neural activity. Yet, the relationship between the behavioral components of attention and the accompanying changes in neural activity remains largely unresolved. We examined this relationship by quantifying sensitivity and bias in monkeys performing a task that dissociated eye movement responses from the focus of covert attention. Unexpectedly, bias, not sensitivity, increased at the focus of covert attention, whereas sensitivity increased at the location of planned eye movements. Furthermore, neuronal activity within visual area V4 varied robustly with bias, but not sensitivity, at the focus of covert attention. In contrast, correlated variability between neuronal pairs was lowest at the location of planned eye movements, and varied with sensitivity, but not bias. Thus, dissociable behavioral components of attention exhibit distinct neuronal signatures within the visual cortex.

Pre-saccadic Neural Enhancements in Marmoset Area MT

Each time we make an eye movement, attention moves before the eyes, resulting in a perceptual enhancement at the target. Recent psychophysical studies suggest that this pre-saccadic attention enhances the visual features at the saccade target, whereas covert attention causes only spatially selective enhancements. While previous nonhuman primate studies have found that pre-saccadic attention does enhance neural responses spatially, no studies have tested whether changes in neural tuning reflect an automatic feature enhancement. Here we examined pre-saccadic attention using a saccade foraging task developed for marmoset monkeys (one male and one female). We recorded from neurons in the middle temporal area with peripheral receptive fields that contained a motion stimulus, which would either be the target of a saccade or a distracter as a saccade was made to another location. We established that marmosets, like macaques, show enhanced pre-saccadic neural responses for saccades toward the receptive field, including increases in firing rate and motion information. We then examined if the specific changes in neural tuning might support feature enhancements for the target. Neurons exhibited diverse changes in tuning but predominantly showed additive and multiplicative increases that were uniformly applied across motion directions. These findings confirm that marmoset monkeys, like macaques, exhibit pre-saccadic neural enhancements during saccade foraging tasks with minimal training requirements. However, at the level of individual neurons, the lack of feature-tuned enhancements is similar to neural effects reported during covert spatial attention.

Cholinergic neuromodulation of prefrontal attractor dynamics controls performance in spatial working memory

The behavioral and neural effects of the endogenous release of acetylcholine following stimulation of the Nucleus Basalis of Meynert (NB) have been recently examined (Qi et al. 2021). Counterintuitively, NB stimulation enhanced behavioral performance while broadening neural tuning in the prefrontal cortex (PFC). The mechanism by which a weaker mnemonic neural code could lead to better performance remains unclear. Here, we show that increased neural excitability in a simple continuous bump attractor model can induce broader neural tuning and decrease bump diffusion, provided neural rates are saturated. Increased memory precision in the model overrides memory accuracy, improving overall task performance. Moreover, we show that bump attractor dynamics can account for the nonuniform impact of neuromodulation on distractibility, depending on distractor distance from the target. Finally, we delve into the conditions under which bump attractor tuning and diffusion balance in biologically plausible heterogeneous network models. In these discrete bump attractor networks, we show that reducing spatial correlations or enhancing excitatory transmission can improve memory precision. Altogether, we provide a mechanistic understanding of how cholinergic neuromodulation controls spatial working memory through perturbed attractor dynamics in PFC.

Silences, spikes and bursts: Three-part knot of the neural code

When a neuron breaks silence, it can emit action potentials in a number of patterns. Some responses are so sudden and intense that electrophysiologists felt the need to single them out, labelling action potentials emitted at a particularly high frequency with a metonym - bursts. Is there more to bursts than a figure of speech? After all, sudden bouts of high-frequency firing are expected to occur whenever inputs surge. The burst coding hypothesis advances that the neural code has three syllables: silences, spikes and bursts. We review evidence supporting this ternary code in terms of devoted mechanisms for burst generation, synaptic transmission and synaptic plasticity. We also review the learning and attention theories for which such a triad is beneficial.

Alpha-band oscillations and emotion: A review of studies on picture perception

Although alpha-band activity has long been a focus of psychophysiological research, its modulation by emotional value during picture perception has only recently been studied systematically. Here, we review these studies and report that the most consistent alpha oscillatory pattern indexing emotional processing is an enhanced desynchronization (ERD) over posterior sensors when viewing emotional compared with neutral pictures. This enhanced alpha ERD is not specific to unpleasant picture content, as previously proposed for other measures of affective response, but has also been observed for pleasant stimuli. Evidence suggests that this effect is not confined to the alpha band but that it also involves a desynchronization of the lower beta frequencies (8-20 Hz). The emotional modulation of alpha ERD occurs even after massive stimulus repetition and when emotional cues serve as task-irrelevant distractors, consistent with the hypothesis that evaluative processes are mandatory in emotional picture processing. A similar enhanced ERD has been observed for other significant cues (e.g., conditioned aversive stimuli, or in anticipation of a potential threat), suggesting that it reflects cortical excitability associated with the engagement of the motivational systems.

Targeted V1 comodulation supports task-adaptive sensory decisions

Sensory-guided behavior requires reliable encoding of stimulus information in neural populations, and flexible, task-specific readout. The former has been studied extensively, but the latter remains poorly understood. We introduce a theory for adaptive sensory processing based on functionally-targeted stochastic modulation. We show that responses of neurons in area V1 of monkeys performing a visual discrimination task exhibit low-dimensional, rapidly fluctuating gain modulation, which is stronger in task-informative neurons and can be used to decode from neural activity after few training trials, consistent with observed behavior. In a simulated hierarchical neural network model, such labels are learned quickly and can be used to adapt downstream readout, even after several intervening processing stages. Consistently, we find the modulatory signal estimated in V1 is also present in the activity of simultaneously recorded MT units, and is again strongest in task-informative neurons. These results support the idea that co-modulation facilitates task-adaptive hierarchical information routing.

Compact deep neural network models of visual cortex

A powerful approach to understanding the computations carried out in visual cortex is to develop models that predict neural responses to arbitrary images. Deep neural network (DNN) models have worked remarkably well at predicting neural responses [1, 2, 3], yet their underlying computations remain buried in millions of parameters. Have we simply replaced one complicated system in vivo with another in silico? Here, we train a data-driven deep ensemble model that predicts macaque V4 responses ~50% more accurately than currently-used task-driven DNN models. We then compress this deep ensemble to identify compact models that have 5,000x fewer parameters yet equivalent accuracy as the deep ensemble. We verified that the stimulus preferences of the compact models matched those of the real V4 neurons by measuring V4 responses to both 'maximizing' and adversarial images generated using compact models. We then analyzed the inner workings of the compact models and discovered a common circuit motif: Compact models share a similar set of filters in early stages of processing but then specialize by heavily consolidating this shared representation with a precise readout. This suggests that a V4 neuron's stimulus preference is determined entirely by its consolidation step. To demonstrate this, we investigated the compression step of a dot-detecting compact model and found a set of simple computations that may be carried out by dot-selective V4 neurons. Overall, our work demonstrates that the DNN models currently used in computational neuroscience are needlessly large; our approach provides a new way forward for obtaining explainable, high-accuracy models of visual cortical neurons.

Laminar compartmentalization of attention modulation in area V4 aligns with the demands of visual processing hierarchy in the cortex

Attention selectively enhances neural responses to low contrast stimuli in visual area V4, a critical hub that sends projections both up and down the visual hierarchy. Veridical encoding of contrast information is a key computation in early visual areas, while later stages encoding higher level features benefit from improved sensitivity to low contrast. How area V4 meets these distinct information processing demands in the attentive state is unknown. We found that attentional modulation in V4 is cortical layer and cell-class specific. Putative excitatory neurons in the superficial layers show enhanced boosting of low contrast information, while those of deep layers exhibit contrast-independent scaling. Computational modeling suggested the extent of spatial integration of inhibitory neurons as the mechanism behind such laminar differences. Considering that superficial neurons are known to project to higher areas and deep layers to early visual areas, our findings suggest that the interactions between attention and contrast in V4 are compartmentalized, in alignment with the demands of the visual processing hierarchy.

Modeling the diverse effects of divisive normalization on noise correlations

Divisive normalization, a prominent descriptive model of neural activity, is employed by theories of neural coding across many different brain areas. Yet, the relationship between normalization and the statistics of neural responses beyond single neurons remains largely unexplored. Here we focus on noise correlations, a widely studied pairwise statistic, because its stimulus and state dependence plays a central role in neural coding. Existing models of covariability typically ignore normalization despite empirical evidence suggesting it affects correlation structure in neural populations. We therefore propose a pairwise stochastic divisive normalization model that accounts for the effects of normalization and other factors on covariability. We first show that normalization modulates noise correlations in qualitatively different ways depending on whether normalization is shared between neurons, and we discuss how to infer when normalization signals are shared. We then apply our model to calcium imaging data from mouse primary visual cortex (V1), and find that it accurately fits the data, often outperforming a popular alternative model of correlations. Our analysis indicates that normalization signals are often shared between V1 neurons in this dataset. Our model will enable quantifying the relation between normalization and covariability in a broad range of neural systems, which could provide new constraints on circuit mechanisms of normalization and their role in information transmission and representation.

A competition framework for fixation-preference in strabismus

Strabismic subjects often develop the ability to fixate on a target with either eye. Previous studies have shown that fixation-preference behavior varies systematically depending on spatial location of the target. We hypothesized that, when an eccentric target is presented, oculomotor fixation-preference in strabismus may be accounted for in a competitive decision framework wherein the brain must choose between two possible retinal errors to prepare a conjugate saccade that results in one of the eyes acquiring the eccentric target. We tested this framework by recording from visuo-motor neurons in the superior colliculus (SC) of two strabismic rhesus macaque monkeys as they performed a delayed saccade task under binocular viewing conditions. In one experiment, visual targets were presented at one of two locations corresponding to the neuronal receptive field location with respect to either the viewing or the deviated eye. Robust visual sensory responses were observed when targets were presented at either location indicating the presence of competing sensory signals for eye-choice. In a second experiment, a single visual target was placed at the neuronal receptive field location where the animal switched fixation on some trials and did not on other trials. At such target locations where either eye could acquire the target, both visual and build-up activity was greater in trials when the saccade encoded by the neuron "won." These findings provide evidence for the influence of visual suppression within SC sensory activity and support the possible utilization of a competition framework, one that has been previously described for when a binocularly aligned animal chooses from among multiple targets, to drive fixation-preference behavior in strabismus.

Different roles of response covariability and its attentional modulation in the sensory cortex and posterior parietal cortex

The covariability of neural responses in the neuron population is highly relevant to the information encoding. Cognitive processes, such as attention, are found to modulate the covariability in the visual cortex to improve information encoding, suggesting the computational advantage of covariability modulation in the neural system. However, is the covariability modulation a general mechanism for enhanced information encoding throughout the information processing pathway, or only adopted in certain processing stages, depending on the property of neural representation? Here, with ultrahigh-field MRI, we examined the covariability, which was estimated by noise correlation, in different attention states in the early visual cortex and posterior parietal cortex (PPC) of the human brain, and its relationship to the quality of information encoding. Our results showed that while attention decreased the covariability to improve the stimulus encoding in the early visual cortex, covariability modulation was not observed in the PPC, where covariability had little impact on information encoding. Further, attention promoted the information flow between the early visual cortex and PPC, with an apparent emphasis on a flow from high- to low-dimensional representations, suggesting the existence of a reduction in the dimensionality of neural representation from the early visual cortex to PPC. Finally, the neural response patterns in the PPC could predict the amplitudes of covariability change in the early visual cortex, indicating a top-down control from the PPC to early visual cortex. Our findings reveal the specific roles of the sensory cortex and PPC during attentional modulation of covariability, determined by the complexity and fidelity of the neural representation in each cortical region.

Dissociable Neural Mechanisms Underlie the Effects of Attention on Visual Appearance and Response Bias

A prominent theoretical framework spanning philosophy, psychology, and neuroscience holds that selective attention penetrates early stages of perceptual processing to alter the subjective visual experience of behaviorally relevant stimuli. For example, searching for a red apple at the grocery store might make the relevant color appear brighter and more saturated compared with seeing the exact same red apple while searching for a yellow banana. In contrast, recent proposals argue that data supporting attention-related changes in appearance reflect decision- and motor-level response biases without concurrent changes in perceptual experience. Here, we tested these accounts by evaluating attentional modulations of EEG responses recorded from male and female human subjects while they compared the perceived contrast of attended and unattended visual stimuli rendered at different levels of physical contrast. We found that attention enhanced the amplitude of the P1 component, an early evoked potential measured over visual cortex. A linking model based on signal detection theory suggests that response gain modulations of the P1 component track attention-induced changes in perceived contrast as measured with behavior. In contrast, attentional cues induced changes in the baseline amplitude of posterior alpha band oscillations (∼9-12 Hz), an effect that best accounts for cue-induced response biases, particularly when no stimuli are presented or when competing stimuli are similar and decisional uncertainty is high. The observation of dissociable neural markers that are linked to changes in subjective appearance and response bias supports a more unified theoretical account and demonstrates an approach to isolate subjective aspects of selective information processing.SIGNIFICANCE STATEMENT Does attention alter visual appearance, or does it simply induce response bias? In the present study, we examined these competing accounts using EEG and linking models based on signal detection theory. We found that response gain modulations of the visually evoked P1 component best accounted for attention-induced changes in visual appearance. In contrast, cue-induced baseline shifts in alpha band activity better explained response biases. Together, these results suggest that attention concurrently impacts visual appearance and response bias, and that these processes can be experimentally isolated.

Laminar mechanisms of saccadic suppression in primate visual cortex

Saccadic eye movements are known to cause saccadic suppression, a temporary reduction in visual sensitivity and visual cortical firing rates. While saccadic suppression has been well characterized at the level of perception and single neurons, relatively little is known about the visual cortical networks governing this phenomenon. Here we examine the effects of saccadic suppression on distinct neural subpopulations within visual area V4. We find subpopulation-specific differences in the magnitude and timing of peri-saccadic modulation. Input-layer neurons show changes in firing rate and inter-neuronal correlations prior to saccade onset, and putative inhibitory interneurons in the input layer elevate their firing rate during saccades. A computational model of this circuit recapitulates our empirical observations and demonstrates that an input-layer-targeting pathway can initiate saccadic suppression by enhancing local inhibitory activity. Collectively, our results provide a mechanistic understanding of how eye movement signaling interacts with cortical circuitry to enforce visual stability.

Prior expectation enhances sensorimotor behavior by modulating population tuning and subspace activity in sensory cortex

Prior knowledge facilitates our perception and goal-directed behaviors, particularly when sensory input is lacking or noisy. However, the neural mechanisms underlying the improvement in sensorimotor behavior by prior expectations remain unknown. In this study, we examine the neural activity in the middle temporal (MT) area of visual cortex while monkeys perform a smooth pursuit eye movement task with prior expectation of the visual target's motion direction. Prior expectations discriminately reduce the MT neural responses depending on their preferred directions, when the sensory evidence is weak. This response reduction effectively sharpens neural population direction tuning. Simulations with a realistic MT population demonstrate that sharpening the tuning can explain the biases and variabilities in smooth pursuit, suggesting that neural computations in the sensory area alone can underpin the integration of prior knowledge and sensory evidence. State-space analysis further supports this by revealing neural signals of prior expectations in the MT population activity that correlate with behavioral changes.

Topological insights into the neural basis of flexible behavior

It is widely accepted that there is an inextricable link between neural computations, biological mechanisms, and behavior, but it is challenging to simultaneously relate all three. Here, we show that topological data analysis (TDA) provides an important bridge between these approaches to studying how brains mediate behavior. We demonstrate that cognitive processes change the topological description of the shared activity of populations of visual neurons. These topological changes constrain and distinguish between competing mechanistic models, are connected to subjects' performance on a visual change detection task, and, via a link with network control theory, reveal a tradeoff between improving sensitivity to subtle visual stimulus changes and increasing the chance that the subject will stray off task. These connections provide a blueprint for using TDA to uncover the biological and computational mechanisms by which cognition affects behavior in health and disease.

Spontaneous variations in arousal modulate subsequent visual processing and local field potential dynamics in the ferret during quiet wakefulness

Behavioral states affect neuronal responses throughout the cortex and influence visual processing. Quiet wakefulness (QW) is a behavioral state during which subjects are quiescent but awake and connected to the environment. Here, we examined the effects of pre-stimulus arousal variability on post-stimulus neural activity in the primary visual cortex and posterior parietal cortex in awake ferrets, using pupil diameter as an indicator of arousal. We observed that the power of stimuli-induced alpha (8-12 Hz) decreases when the arousal level increases. The peak of alpha power shifts depending on arousal. High arousal increases inter- and intra-areal coherence. Using a simplified model of laminar circuits, we show that this connectivity pattern is compatible with feedback signals targeting infragranular layers in area posterior parietal cortex and supragranular layers in V1. During high arousal, neurons in V1 displayed higher firing rates at their preferred orientations. Broad-spiking cells in V1 are entrained to high-frequency oscillations (>80 Hz), whereas narrow-spiking neurons are phase-locked to low- (12-18 Hz) and high-frequency (>80 Hz) rhythms. These results indicate that the variability and sensitivity of post-stimulus cortical responses and coherence depend on the pre-stimulus behavioral state and account for the neuronal response variability observed during repeated stimulation.

Correlated variability in primate superior colliculus depends on functional class

Correlated variability in neuronal activity (spike count correlations, r_SC) can constrain how information is read out from populations of neurons. Traditionally, r_SC is reported as a single value summarizing a brain area. However, single values, like summary statistics, stand to obscure underlying features of the constituent elements. We predict that in brain areas containing distinct neuronal subpopulations, different subpopulations will exhibit distinct levels of r_SC that are not captured by the population r_SC. We tested this idea in macaque superior colliculus (SC), a structure containing several functional classes (i.e., subpopulations) of neurons. We found that during saccade tasks, different functional classes exhibited differing degrees of r_SC. "Delay class" neurons displayed the highest r_SC, especially during saccades that relied on working memory. Such dependence of r_SC on functional class and cognitive demand underscores the importance of taking functional subpopulations into account when attempting to model or infer population coding principles.

Perceptual Difficulty Regulates Attentional Gain Modulations in Human Visual Cortex

Perceptual difficulty is sometimes used to manipulate selective attention. However, these two factors are logically distinct. Selective attention is defined by priority given to specific stimuli based on their behavioral relevance, whereas perceptual difficulty is often determined by perceptual demands required to discriminate relevant stimuli. That said, both perceptual difficulty and selective attention are thought to modulate the gain of neural responses in early sensory areas. Previous studies found that selectively attending to a stimulus or increasing perceptual difficulty enhanced the gain of neurons in visual cortex. However, some other studies suggest that perceptual difficulty can have either a null or even reversed effect on gain modulations in visual cortex. According to Yerkes-Dodson's Law, it is possible that this discrepancy arises because of an interaction between perceptual difficulty and attentional gain modulations yielding a nonlinear inverted-U function. Here, we used EEG to measure modulations in the visual cortex of male and female human participants performing an attention-cueing task where we systematically manipulated perceptual difficulty across blocks of trials. The behavioral and neural data implicate a nonlinear inverted-U relationship between selective attention and perceptual difficulty: a focused-attention cue led to larger response gain in both neural and behavioral data at intermediate difficulty levels compared with when the task was more or less difficult. Moreover, difficulty-related changes in attentional gain positively correlated with those predicted by quantitative modeling of the behavioral data. These findings suggest that perceptual difficulty mediates attention-related changes in perceptual performance via selective neural modulations in human visual cortex.SIGNIFICANCE STATEMENT Both perceptual difficulty and selective attention are thought to influence perceptual performance by modulating response gain in early sensory areas. That said, less is known about how selective attention interacts with perceptual difficulty. Here, we measured neural gain modulations in the visual cortex of human participants performing an attention-cueing task where perceptual difficulty was systematically manipulated. Consistent with Yerkes-Dodson's Law, our behavioral and neural data implicate a nonlinear inverted-U relationship between selective attention and perceptual difficulty. These results suggest that perceptual difficulty mediates attention-related changes in perceptual performance via selective neural modulations in visual cortex, extending our understanding of the attentional operation under different levels of perceptual demands.

Weak evidence for neural correlates of task-switching in macaque V1

A central goal of systems neuroscience is to understand how populations of sensory neurons encode and relay information to the rest of the brain. Three key quantities of interest are 1) how mean neural activity depends on the stimulus (sensitivity), 2) how neural activity (co)varies around the mean (noise correlations), and 3) how predictive these variations are of the subject's behavior (choice probability). Previous empirical work suggests that both choice probability and noise correlations are affected by task training, with decision-related information fed back to sensory areas and aligned to neural sensitivity on a task-by-task basis. We used Utah arrays to record activity from populations of primary visual cortex (V1) neurons from two macaque monkeys that were trained to switch between two coarse orientation-discrimination tasks. Surprisingly, we find no evidence for significant trial-by-trial changes in noise covariance between tasks, nor do we find a consistent relationship between neural sensitivity and choice probability, despite recording from well-tuned task-sensitive neurons, many of which were histologically confirmed to be in supragranular V1, and despite behavioral evidence that the monkeys switched their strategy between tasks. Thus our data at best provide weak support for the hypothesis that trial-by-trial task-switching induces changes to noise correlations and choice probabilities in V1. However, our data agree with a recent finding of a single "choice axis" across tasks. They also raise the intriguing possibility that choice-related signals in early sensory areas are less indicative of task learning per se and instead reflect perceptual learning that occurs in highly overtrained subjects.NEW & NOTEWORTHY Converging evidence suggests that decision processes affect sensory neural activity, and this has informed numerous theories of neural processing. We set out to replicate and extend previous results on decision-related information and noise correlations in V1 of macaque monkeys. However, in our data, we find little evidence for a number of expected effects. Our null results therefore call attention to differences in task training, stimulus design, recording, and analysis techniques between our and prior studies.

Intrinsic timescales in the visual cortex change with selective attention and reflect spatial connectivity

Intrinsic timescales characterize dynamics of endogenous fluctuations in neural activity. Variation of intrinsic timescales across the neocortex reflects functional specialization of cortical areas, but less is known about how intrinsic timescales change during cognitive tasks. We measured intrinsic timescales of local spiking activity within columns of area V4 in male monkeys performing spatial attention tasks. The ongoing spiking activity unfolded across at least two distinct timescales, fast and slow. The slow timescale increased when monkeys attended to the receptive fields location and correlated with reaction times. By evaluating predictions of several network models, we found that spatiotemporal correlations in V4 activity were best explained by the model in which multiple timescales arise from recurrent interactions shaped by spatially arranged connectivity, and attentional modulation of timescales results from an increase in the efficacy of recurrent interactions. Our results suggest that multiple timescales may arise from the spatial connectivity in the visual cortex and flexibly change with the cognitive state due to dynamic effective interactions between neurons.