Moving sensory adaptation beyond suppressive effects in single neurons

Feature-selective responses in macaque visual cortex follow eye movements during natural vision

In natural vision, primates actively move their eyes several times per second via saccades. It remains unclear whether, during this active looking, visual neurons exhibit classical retinotopic properties, anticipate gaze shifts or mirror the stable quality of perception, especially in complex natural scenes. Here, we let 13 monkeys freely view thousands of natural images across 4.6 million fixations, recorded 883 h of neuronal responses in six areas spanning primary visual to anterior inferior temporal cortex and analyzed spatial, temporal and featural selectivity in these responses. Face neurons tracked their receptive field contents, indicated by category-selective responses. Self-consistency analysis showed that general feature-selective responses also followed eye movements and remained gaze-dependent over seconds of viewing the same image. Computational models of feature-selective responses located retinotopic receptive fields during free viewing. We found limited evidence for feature-selective predictive remapping and no viewing-history integration. Thus, ventral visual neurons represent the world in a predominantly eye-centered reference frame during natural vision.

Tactile adaptation to orientation produces a robust tilt aftereffect and exhibits crossmodal transfer when tested in vision

Orientation processing is one of the most fundamental functions in both visual and somatosensory perception. Converging findings suggest that orientation processing in both modalities is closely linked: somatosensory neurons share a similar orientation organisation as visual neurons, and the visual cortex has been found to be heavily involved in tactile orientation perception. Hence, we hypothesized that somatosensation would exhibit a similar orientation adaptation effect, and this adaptation effect would be transferable between the two modalities, considering the above-mentioned connection. The tilt aftereffect (TAE) is a demonstration of orientation adaptation and is used widely in behavioural experiments to investigate orientation mechanisms in vision. By testing the classic TAE paradigm in both tactile and crossmodal orientation tasks between vision and touch, we were able to show that tactile perception of orientation shows a very robust TAE, similar to its visual counterpart. We further show that orientation adaptation in touch transfers to produce a TAE when tested in vision, but not vice versa. Additionally, when examining the test sequence following adaptation for serial effects, we observed another asymmetry between the two conditions where the visual test sequence displayed a repulsive intramodal serial dependence effect while the tactile test sequence exhibited an attractive serial dependence. These findings provide concrete evidence that vision and touch engage a similar orientation processing mechanism. However, the asymmetry in the crossmodal transfer of TAE and serial dependence points to a non-reciprocal connection between the two modalities, providing further insights into the underlying processing mechanism.

Feedforward and feedback mechanisms cooperatively regulate rapid experience-dependent response adaptation in a single thermosensory neuron type

Sensory adaptation allows neurons to adjust their sensitivity and responses based on recent experience. The mechanisms that mediate continuous adaptation to stimulus history over seconds- to hours-long timescales, and whether these mechanisms can operate within a single sensory neuron type, are unclear. The single pair of AFD thermosensory neurons in Caenorhabditis elegans exhibits experience-dependent plasticity in their temperature response thresholds on both minutes- and hours-long timescales upon a temperature upshift. While long-term response adaptation requires changes in gene expression in AFD, the mechanisms driving rapid response plasticity are unknown. Here, we show that rapid thermosensory response adaptation in AFD is mediated via cGMP and calcium-dependent feedforward and feedback mechanisms operating at the level of primary thermotransduction. We find that either of two thermosensor receptor guanylyl cyclases (rGCs) alone is sufficient to drive rapid adaptation, but that each rGC drives adaptation at different rates. rGC-driven adaptation is mediated in part via phosphorylation of their intracellular domains, and calcium-dependent feedback regulation of basal cGMP levels via a neuronal calcium sensor protein. In turn, cGMP levels feedforward via cGMP-dependent protein kinases to phosphorylate a specific subunit of the cGMP-gated thermotransduction channel to further regulate rapid adaptation. Our results identify multiple molecular pathways that act in AFD to ensure rapid adaptation to a temperature change and indicate that the deployment of both transcriptional and nontranscriptional mechanisms within a single sensory neuron type can contribute to continuous sensory adaptation.

The interplay of motor adaptation and groupitizing in numerosity perception: Insights from visual motion adaptation and proprioceptive motor adaptation

Groupitizing is a well-established strategy in numerosity perception that enhances speed and sensory precision. Building on the ATOM theory, Anobile proposed the sensorimotor numerosity system, which posits a strong link between number and action. Previous studies using motor adaptation technology have shown that high-frequency motor adaptation leads to underestimation of numerosity perception, while low-frequency adaptation leads to overestimation. However, the impact of motor adaptation on groupitizing, and whether visual motion adaptation produces similar effects, remain unclear. In this study, we investigate the persistence of the advantage of groupitizing after motor adaptation and explore the effects of visual motion adaptation. Surprisingly, our findings reveal that proprioceptive motor adaptation weakens the advantage of groupitizing, indicating a robust effect of motor adaptation even when groupitizing is employed. Moreover, we observe a bidirectional relationship, as groupitizing also weakens the adaptation effect. These results highlight the complex interplay between motor adaptation and groupitizing in numerosity perception. Furthermore, our study provides evidence that visual motion adaptation also has an adaptation effect, but does not fully replicate the effects of proprioceptive motor adaptation on groupitizing. In conclusion, our research underscores the importance of groupitizing as a valuable strategy in numerosity perception, and sheds light on the influence of motion adaptation on this strategy.

A human cortical adaptive mutual inhibition circuit underlying competition for perceptual decision and repetition suppression reversal

A model based on inhibitory coupling has been proposed to explain perceptual oscillations. This 'adapting reciprocal inhibition' model postulates that it is the strength of inhibitory coupling that determines the fate of competition between percepts. Here, we used an fMRI-based adaptation technique to reveal the influence of neighboring neuronal populations, such as reciprocal inhibition, in motion-selective hMT+/V5. If reciprocal inhibition exists in this region, the following predictions should hold: 1. stimulus-driven response would not simply decrease, as predicted by simple repetition-suppression of neuronal populations, but instead, increase due to the activity from adjacent populations; 2. perceptual decision involving competing representations, should reflect decreased reciprocal inhibition by adaptation; 3. neural activity for the competing percept should also later on increase upon adaptation. Our results confirm these three predictions, showing that a model of perceptual decision based on adapting reciprocal inhibition holds true. Finally, they also show that the net effect of the well-known repetition suppression phenomenon can be reversed by this mechanism.

Feedforward and feedback mechanisms cooperatively regulate rapid experience-dependent response adaptation in a single thermosensory neuron type

Sensory adaptation allows neurons to adjust their sensitivity and responses based on recent experience. The mechanisms that mediate continuous adaptation to stimulus history over seconds to hours long timescales, and whether these mechanisms can operate within a single sensory neuron type, are unclear. The single pair of AFD thermosensory neurons in C. elegans exhibits experience-dependent plasticity in their temperature response thresholds on both minutes- and hours-long timescales upon a temperature upshift. While long-term response adaptation requires changes in gene expression in AFD, the mechanisms driving rapid response plasticity are unknown. Here, we show that rapid thermosensory response adaptation in AFD is mediated via cGMP and calcium-dependent feedforward and feedback mechanisms operating at the level of primary thermotransduction. We find that either of two thermosensor receptor guanylyl cyclases (rGCs) alone is sufficient to drive rapid adaptation, but that each rGC drives adaptation at different rates. rGC-driven adaptation is mediated in part via phosphorylation of their intracellular domains, and calcium-dependent feedback regulation of basal cGMP levels via a neuronal calcium sensor protein. In turn, cGMP levels feedforward via cGMP-dependent protein kinases to phosphorylate a specific subunit of the cGMP-gated thermotransduction channel to further regulate rapid adaptation. Our results identify multiple molecular pathways that act in AFD to ensure rapid adaptation to a temperature change, and indicate that the deployment of both transcriptional and non-transcriptional mechanisms within a single sensory neuron type can contribute to continuous sensory adaptation.

Qualitatively Different Delay-Dependent Working Memory Distortions in People With Schizophrenia and Healthy Control Participants

BACKGROUND

Impairments in working memory (WM) have been well documented in people with schizophrenia (PSZ). However, these quantitative WM impairments can often be explained by nonspecific factors, such as impaired goal maintenance. Here, we used a spatial orientation delayed response task to explore a qualitative difference in WM dynamics between PSZ and healthy control participants (HCs). More specifically, we took advantage of the discovery that WM representations may drift either toward or away from previous trial targets (serial dependence). We tested the hypothesis that WM representations would drift toward the previous trial target in HCs but away from the previous trial target in PSZ.

METHODS

We assessed serial dependence in PSZ (n = 31) and HCs (n = 25) using orientation as the to-be-remembered feature and memory delays lasting from 0 to 8 seconds. Participants were asked to remember the orientation of a teardrop-shaped object and reproduce the orientation after a delay period of varying length.

RESULTS

Consistent with prior studies, we found that current trial memory representations were less precise in PSZ than in HCs. We also found that WM for the current trial orientation drifted toward the previous trial orientation in HCs (representational attraction) but drifted away from the previous trial orientation in PSZ (representational repulsion).

CONCLUSIONS

These results demonstrate a qualitative difference in WM dynamics between PSZ and HCs that cannot be easily explained by nuisance factors such as reduced effort. Most computational neuroscience models also fail to explain these results because they maintain information solely by means of sustained neural firing, which does not extend across trials. The results suggest a fundamental difference between PSZ and HCs in longer-term memory mechanisms that persist across trials, such as short-term potentiation and neuronal adaptation.

Repeated passive visual experience modulates spontaneous and non-familiar stimuli-evoked neural activity

Familiarity creates subjective memory of repeated innocuous experiences, reduces neural and behavioral responsiveness to those experiences, and enhances novelty detection. The neural correlates of the internal model of familiarity and the cellular mechanisms of enhanced novelty detection following multi-day repeated passive experience remain elusive. Using the mouse visual cortex as a model system, we test how the repeated passive experience of a 45° orientation-grating stimulus for multiple days alters spontaneous and non-familiar stimuli evoked neural activity in neurons tuned to familiar or non-familiar stimuli. We found that familiarity elicits stimulus competition such that stimulus selectivity reduces in neurons tuned to the familiar 45° stimulus; it increases in those tuned to the 90° stimulus but does not affect neurons tuned to the orthogonal 135° stimulus. Furthermore, neurons tuned to orientations 45° apart from the familiar stimulus dominate local functional connectivity. Interestingly, responsiveness to natural images, which consists of familiar and non-familiar orientations, increases subtly in neurons that exhibit stimulus competition. We also show the similarity between familiar grating stimulus-evoked and spontaneous activity increases, indicative of an internal model of altered experience.

A preference to look closer to the eyes is associated with a position-invariant face neural code

When looking at faces, humans invariably move their eyes to a consistent preferred first fixation location on the face. While most people have the preferred fixation location just below the eyes, a minority have it between the nose-tip and mouth. Not much is known about whether these long-term differences in the preferred fixation location are associated with distinct neural representations of faces. To study this, we used a gaze-contingent face adaptation aftereffect paradigm to test in two groups of observers, one with their mean preferred fixation location closer to the eyes (upper lookers) and the other closer to the mouth (lower lookers). In this task, participants were required to maintain their gaze at either their own group's mean preferred fixation location or that of the other group during adaptation and testing. The two possible fixation locations were 3.6° apart on the face. We measured the face adaptation aftereffects when the adaptation and testing happened while participants maintained fixation at either the same or different locations on the face. Both groups showed equally strong adaptation effects when the adaptation and testing happened at the same fixation location. Crucially, only the upper lookers showed a partial transfer of the FAE across the two fixation locations, when adaptation occurred at the eyes. Lower lookers showed no spatial transfer of the FAE irrespective of the adaptation position. Given the classic finding that neural tuning is increasingly position invariant as one moves higher in the visual hierarchy, this result suggests that differences in the preferred fixation location are associated with distinct neural representations of faces.

Input-specific synaptic depression shapes temporal integration in mouse visual cortex

Efficient sensory processing requires the nervous system to adjust to ongoing features of the environment. In primary visual cortex (V1), neuronal activity strongly depends on recent stimulus history. Existing models can explain effects of prolonged stimulus presentation but remain insufficient for explaining effects observed after shorter durations commonly encountered under natural conditions. We investigated the mechanisms driving adaptation in response to brief (100 ms) stimuli in L2/3 V1 neurons by performing in vivo whole-cell recordings to measure membrane potential and synaptic inputs. We find that rapid adaptation is generated by stimulus-specific suppression of excitatory and inhibitory synaptic inputs. Targeted optogenetic experiments reveal that these synaptic effects are due to input-specific short-term depression of transmission between layers 4 and 2/3. Thus, brief stimulus presentation engages a distinct adaptation mechanism from that previously reported in response to prolonged stimuli, enabling flexible control of sensory encoding across a wide range of timescales.

Stimulus expectations do not modulate visual event-related potentials in probabilistic cueing designs

Humans and other animals can learn and exploit repeating patterns that occur within their environments. These learned patterns can be used to form expectations about future sensory events. Several influential predictive coding models have been proposed to explain how learned expectations influence the activity of stimulus-selective neurons in the visual system. These models specify reductions in neural response measures when expectations are fulfilled (termed expectation suppression) and increases following surprising sensory events. However, there is currently scant evidence for expectation suppression in the visual system when confounding factors are taken into account. Effects of surprise have been observed in blood oxygen level dependent (BOLD) signals, but not when using electrophysiological measures. To provide a strong test for expectation suppression and surprise effects we performed a predictive cueing experiment while recording electroencephalographic (EEG) data. Participants (n=48) learned cue-face associations during a training session and were then exposed to these cue-face pairs in a subsequent experiment. Using univariate analyses of face-evoked event-related potentials (ERPs) we did not observe any differences across expected (90% probability), neutral (50%) and surprising (10%) face conditions. Across these comparisons, Bayes factors consistently favoured the null hypothesis throughout the time-course of the stimulus-evoked response. When using multivariate pattern analysis we did not observe above-chance classification of expected and surprising face-evoked ERPs. By contrast, we found robust within- and across-trial stimulus repetition effects. Our findings do not support predictive coding-based accounts that specify reduced prediction error signalling when perceptual expectations are fulfilled. They instead highlight the utility of other types of predictive processing models that describe expectation-related phenomena in the visual system without recourse to prediction error signalling.

Neuronal Population Activity in Macaque Visual Cortices Dynamically Changes through Repeated Fixations in Active Free Viewing

During free viewing, we move our eyes and fixate on objects to recognize the visual scene of our surroundings. To investigate the neural representation of objects in this process, we studied individual and population neuronal activity in three different visual regions of the brains of macaque monkeys (Macaca fuscata): the primary and secondary visual cortices (V1, V2) and the inferotemporal cortex (IT). We designed a task where the animal freely selected objects in a stimulus image to fixate on while we examined the relationship between spiking activity, the order of fixations, and the fixated objects. We found that activity changed across repeated fixations on the same object in all three recorded areas, with observed reductions in firing rates. Furthermore, the responses of individual neurons became sparser and more selective with individual objects. The population activity for individual objects also became distinct. These results suggest that visual neurons respond dynamically to repeated input stimuli through a smaller number of spikes, thereby allowing for discrimination between individual objects with smaller energy.

Expectation reshapes V4 neuronal activity and improves perceptual performance

Recent visual experience creates expectations that heavily influence our visual perception. How does expectation shape the activity of cortical neurons to allow for improved perceptual discrimination of visual inputs? We recorded from populations of neurons in visual cortical area V4 while monkeys performed a natural image change detection task under different expectation conditions. We found that higher expectation led to an improvement in the ability to detect a change in an image. This improvement was associated with decreased neural responses to the image, providing evidence that a reduction in activity can improve stimulus encoding. The decrease in response could not be fully explained by short-timescale adaptation, suggesting partially separate mechanisms of adaptation and expectation. Additionally, higher expectation was associated with decreased trial-to-trial shared variability, indicating that a reduction in variability is a key means by which expectation influences perception. Taken together, the results of our study contribute to an understanding of how visual experience and expectation can shape our perception and behavior through modulating activity patterns across the visual cortex.

Repeated passive visual experience modulates spontaneous and non-familiar stimulievoked neural activity

Familiarity creates subjective memory of repeated innocuous experiences, reduces neural and behavioral responsiveness to those experiences, and enhances novelty detection. The neural correlates of the internal model of familiarity and the cellular mechanisms of enhanced novelty detection following multi-day repeated passive experience remain elusive. Using the mouse visual cortex as a model system, we test how the repeated passive experience of a 45° orientation-grating stimulus for multiple days alters spontaneous and non-familiar stimuli evoked neural activity in neurons tuned to familiar or non-familiar stimuli. We found that familiarity elicits stimulus competition such that stimulus selectivity reduces in neurons tuned to the familiar 45° stimulus; it increases in those tuned to the 90° stimulus but does not affect neurons tuned to the orthogonal 135° stimulus. Furthermore, neurons tuned to orientations 45° apart from the familiar stimulus dominate local functional connectivity. Interestingly, responsiveness to natural images, which consists of familiar and non-familiar orientations, increases subtly in neurons that exhibit stimulus competition. We also show the similarity between familiar grating stimulus-evoked and spontaneous activity increases, indicative of an internal model of altered experience.

Neural Evidence for Boundary Updating as the Source of the Repulsive Bias in Classification

Binary classification, an act of sorting items into two classes by setting a boundary, is biased by recent history. One common form of such bias is repulsive bias, a tendency to sort an item into the class opposite to its preceding items. Sensory-adaptation and boundary-updating are considered as two contending sources of the repulsive bias, yet no neural support has been provided for either source. Here, we explored human brains of both men and women, using functional magnetic resonance imaging (fMRI), to find such support by relating the brain signals of sensory-adaptation and boundary-updating to human classification behavior. We found that the stimulus-encoding signal in the early visual cortex adapted to previous stimuli, yet its adaptation-related changes were dissociated from current choices. Contrastingly, the boundary-representing signals in the inferior-parietal and superior-temporal cortices shifted to previous stimuli and covaried with current choices. Our exploration points to boundary-updating, rather than sensory-adaptation, as the origin of the repulsive bias in binary classification.SIGNIFICANCE STATEMENT Many animal and human studies on perceptual decision-making have reported an intriguing history effect called "repulsive bias," a tendency to classify an item as the opposite class of its previous item. Regarding the origin of repulsive bias, two contending ideas have been proposed: "bias in stimulus representation because of sensory adaptation" versus "bias in class-boundary setting because of belief updating." By conducting model-based neuroimaging experiments, we verified their predictions about which brain signal should contribute to the trial-to-trial variability in choice behavior. We found that the brain signal of class boundary, but not stimulus representation, contributed to the choice variability associated with repulsive bias. Our study provides the first neural evidence supporting the boundary-based hypothesis of repulsive bias.

Mechanisms of human dynamic object recognition revealed by sequential deep neural networks

Humans can quickly recognize objects in a dynamically changing world. This ability is showcased by the fact that observers succeed at recognizing objects in rapidly changing image sequences, at up to 13 ms/image. To date, the mechanisms that govern dynamic object recognition remain poorly understood. Here, we developed deep learning models for dynamic recognition and compared different computational mechanisms, contrasting feedforward and recurrent, single-image and sequential processing as well as different forms of adaptation. We found that only models that integrate images sequentially via lateral recurrence mirrored human performance (N = 36) and were predictive of trial-by-trial responses across image durations (13-80 ms/image). Importantly, models with sequential lateral-recurrent integration also captured how human performance changes as a function of image presentation durations, with models processing images for a few time steps capturing human object recognition at shorter presentation durations and models processing images for more time steps capturing human object recognition at longer presentation durations. Furthermore, augmenting such a recurrent model with adaptation markedly improved dynamic recognition performance and accelerated its representational dynamics, thereby predicting human trial-by-trial responses using fewer processing resources. Together, these findings provide new insights into the mechanisms rendering object recognition so fast and effective in a dynamic visual world.

Rapid adaptation of primate LGN neurons to drifting grating stimulation

The visual system needs to dynamically adapt to changing environments. Much is known about the adaptive effects of constant stimulation over prolonged periods. However, there are open questions regarding adaptation to stimuli that are changing over time, interrupted, or repeated. Feature-specific adaptation to repeating stimuli has been shown to occur as early as primary visual cortex (V1), but there is also evidence for more generalized, fatigue-like adaptation that might occur at an earlier stage of processing. Here, we show adaptation in the lateral geniculate nucleus (LGN) of awake, fixating monkeys following brief (1 s) exposure to repeated cycles of a 4-Hz drifting grating. We examined the relative change of each neuron's response across successive (repeated) grating cycles. We found that neurons from all cell classes (parvocellular, magnocellular, and koniocellular) showed significant adaptation. However, only magnocellular neurons showed adaptation when responses were averaged to a population response. In contrast to firing rates, response variability was largely unaffected. Finally, adaptation was comparable between monocular and binocular stimulation, suggesting that rapid LGN adaptation is monocular in nature.NEW & NOTEWORTHY Neural adaptation can be defined as reduction of spiking responses following repeated or prolonged stimulation. Adaptation helps adjust neural responsiveness to avoid saturation and has been suggested to improve perceptual selectivity, information transmission, and predictive coding. Here, we report rapid adaptation to repeated cycles of gratings drifting over the receptive field of neurons at the earliest site of postretinal processing, the lateral geniculate nucleus of the thalamus.

Spike timing-dependent plasticity alters electrosensory neuron synaptic strength in vitro but does not consistently predict changes in sensory tuning in vivo

How do sensory systems optimize detection of behaviorally relevant stimuli when the sensory environment is constantly changing? We addressed the role of spike timing-dependent plasticity (STDP) in driving changes in synaptic strength in a sensory pathway and whether those changes in synaptic strength could alter sensory tuning. It is challenging to precisely control temporal patterns of synaptic activity in vivo and replicate those patterns in vitro in behaviorally relevant ways. This makes it difficult to make connections between STDP-induced changes in synaptic physiology and plasticity in sensory systems. Using the mormyrid species Brevimyrus niger and Brienomyrus brachyistius, which produce electric organ discharges for electrolocation and communication, we can precisely control the timing of synaptic input in vivo and replicate these same temporal patterns of synaptic input in vitro. In central electrosensory neurons in the electric communication pathway, using whole cell intracellular recordings in vitro, we paired presynaptic input with postsynaptic spiking at different delays. Using whole cell intracellular recordings in awake, behaving fish, we paired sensory stimulation with postsynaptic spiking using the same delays. We found that Hebbian STDP predictably alters sensory tuning in vitro and is mediated by NMDA receptors. However, the change in synaptic responses induced by sensory stimulation in vivo did not adhere to the direction predicted by the STDP observed in vitro. Further analysis suggests that this difference is influenced by polysynaptic activity, including inhibitory interneurons. Our findings suggest that STDP rules operating at identified synapses may not drive predictable changes in sensory responses at the circuit level.NEW & NOTEWORTHY We replicated behaviorally relevant temporal patterns of synaptic activity in vitro and used the same patterns during sensory stimulation in vivo. There was a Hebbian spike timing-dependent plasticity (STDP) pattern in vitro, but sensory responses in vivo did not shift according to STDP predictions. Analysis suggests that this disparity is influenced by differences in polysynaptic activity, including inhibitory interneurons. These results suggest that STDP rules at synapses in vitro do not necessarily apply to circuits in vivo.

Qualitatively different delay-dependent working memory distortions in people with schizophrenia and healthy control subjects

Background

Impairments in working memory(WM) have been well-documented in people with schizophrenia(PSZ). However, these quantitative WM impairments can often be explained by nonspecific factors, such as impaired goal maintenance. Here, we used a spatial orientation delayed-response task to explore a qualitative difference in WM dynamics between PSZ and healthy control subjects(HCS). Specifically, we took advantage of the discovery that WM representations may drift either toward or away from previous-trial targets(serial dependence). We tested the hypothesis that WM representations drift toward the previous-trial target in HCS but away from the previous-trial target in PSZ.

Methods

We assessed serial dependence in PSZ(N=31) and HCS(N=25), using orientation as the to-be-remembered feature and memory delays from 0 to 8s. Participants were asked to remember the orientation of a teardrop-shaped object and reproduce the orientation after a varying delay period.

Results

Consistent with prior studies, we found that current-trial memory representations were less precise in PSZ than in HCS. We also found that WM for the current-trial orientation drifted toward the previous-trial orientation in HCS(representational attraction) but drifted away from the previous-trial orientation in PSZ(representational repulsion).

Conclusions

These results demonstrate a qualitative difference in WM dynamics between PSZ and HCS that cannot easily be explained by nuisance factors such as reduced effort. Most computational neuroscience models also fail to explain these results, because they maintain information solely by means of sustained neural firing, which does not extend across trials. The results suggest a fundamental difference between PSZ and HCS in longer-term memory mechanisms that persist across trials, such as short-term potentiation and neuronal adaptation.

Sensory experience selectively reorganizes the late component of evoked responses

In response to sensory stimulation, the cortex exhibits an early transient response followed by late and slower activation. Recent studies suggest that the early component represents features of the stimulus while the late component is associated with stimulus perception. Although very informative, these studies only focus on the amplitude of the evoked responses to study its relationship with sensory perception. In this work, we expand upon the study of how patterns of evoked and spontaneous activity are modified by experience at the mesoscale level using voltage and extracellular glutamate transient recordings over widespread regions of mouse dorsal neocortex. We find that repeated tactile or auditory stimulation selectively modifies the spatiotemporal patterns of cortical activity, mainly of the late evoked response in anesthetized mice injected with amphetamine and also in awake mice. This modification lasted up to 60 min and results in an increase in the amplitude of the late response after repeated stimulation and in an increase in the similarity between the spatiotemporal patterns of the late early evoked response. This similarity increase occurs only for the evoked responses of the sensory modality that received the repeated stimulation. Thus, this selective long-lasting spatiotemporal modification of the cortical activity patterns might provide evidence that evoked responses are a cortex-wide phenomenon. This work opens new questions about how perception-related cortical activity changes with sensory experience across the cortex.

Varying test-pattern duration to explore the dynamics of contrast-comparison and contrast-normalization processes

In this paper, we examine the dynamics of contrast-comparison and contrast-normalization processes. Observers adapted (for 1 second) to a grid of Gabor patches at one contrast; then a test pattern (which varied in duration from 12 ms to 3012 ms) was shown; and then the adapt pattern was shown again (1 second). All the Gabor patches in all the adapt patterns had 50% contrast. The test pattern was the same as the adapt pattern except that the Gabor patches in the test pattern had two different contrasts; the test contrasts varied from row to row (horizontal test pattern) or column to column (vertical test pattern). The task was to identify the orientation of the contrast variation in the test pattern (in other words, the observer performed a second-order orientation identification task). The two contrasts in each test pattern were varied while keeping the difference between the two contrasts constant. We have previously found that the observer's performance is poor for test patterns containing contrasts both above and below the adapt patterns' contrast (what we have called the "straddle effect") when the test duration is approximately 100 ms. Here, we find the straddle effect persists at all test durations we used. Other features of the results varied dramatically with test duration. We find that a simple model containing contrast-comparison and contrast-normalization processes provides a good explanation for the psychophysical results. The results provide some insight into the dynamics of these processes.

Independent repetition suppression in macaque area V2 and inferotemporal cortex

When a complexly structured natural image is presented twice in succession, first as adapter and then as test, neurons in area TE of macaque inferotemporal cortex exhibit repetition suppression, responding less strongly to the second presentation than to the first. This phenomenon, which has been studied primarily in TE, might plausibly be argued to arise in TE because TE neurons respond selectively to complex images and thus carry information adequate for determining whether an image is or is not a repeat. However, the idea has never been put to a direct test. To resolve this issue, we monitored neuronal responses to sequences of complex natural images under identical conditions in areas V2 and TE. We found that repetition suppression occurs in both areas. Moreover, in each area, suppression takes the form of a dynamic alteration whereby the initial peak of excitation is followed by a trough and then a rebound of firing rate. To assess whether repetition suppression in either area is transmitted from the other area, we analyzed the timing of the phenomenon and its degree of spatial generalization. Suppression occurs at shorter latency in V2 than in TE. Therefore it is not simply fed back from TE. Suppression occurs in TE but not in V2 under conditions in which the test and adapter are presented in different visual field quadrants. Therefore it is not simply fed forward from V2. We conclude that repetition suppression occurs independently in V2 and TE.NEW & NOTEWORTHY When a complexly structured natural image is presented twice in rapid succession, neurons in inferotemporal area TE exhibit repetition suppression, responding less strongly to the second than to the first presentation. We have explored whether this phenomenon is confined to high-order areas where neurons respond selectively to such images and thus carry information relevant to recognizing a repeat. We have found surprisingly that repetition suppression occurs even in low-order visual area V2.

Calibrating Vision: Concepts and Questions

The idea that visual coding and perception are shaped by experience and adjust to changes in the environment or the observer is universally recognized as a cornerstone of visual processing, yet the functions and processes mediating these calibrations remain in many ways poorly understood. In this article we review a number of facets and issues surrounding the general notion of calibration, with a focus on plasticity within the encoding and representational stages of visual processing. These include how many types of calibrations there are - and how we decide; how plasticity for encoding is intertwined with other principles of sensory coding; how it is instantiated at the level of the dynamic networks mediating vision; how it varies with development or between individuals; and the factors that may limit the form or degree of the adjustments. Our goal is to give a small glimpse of an enormous and fundamental dimension of vision, and to point to some of the unresolved questions in our understanding of how and why ongoing calibrations are a pervasive and essential element of vision.

Attention to visual motion suppresses neuronal and behavioral sensitivity in nearby feature space

Background

Feature-based attention prioritizes the processing of the attended feature while strongly suppressing the processing of nearby ones. This creates a non-linearity or “attentional suppressive surround” predicted by the Selective Tuning model of visual attention. However, previously reported effects of feature-based attention on neuronal responses are linear, e.g., feature-similarity gain. Here, we investigated this apparent contradiction by neurophysiological and psychophysical approaches.

Results

Responses of motion direction-selective neurons in area MT/MST of monkeys were recorded during a motion task. When attention was allocated to a stimulus moving in the neurons’ preferred direction, response tuning curves showed its minimum for directions 60–90° away from the preferred direction, an attentional suppressive surround. This effect was modeled via the interaction of two Gaussian fields representing excitatory narrowly tuned and inhibitory widely tuned inputs into a neuron, with feature-based attention predominantly increasing the gain of inhibitory inputs. We further showed using a motion repulsion paradigm in humans that feature-based attention produces a similar non-linearity on motion discrimination performance.

Conclusions

Our results link the gain modulation of neuronal inputs and tuning curves examined through the feature-similarity gain lens to the attentional impact on neural population responses predicted by the Selective Tuning model, providing a unified framework for the documented effects of feature-based attention on neuronal responses and behavior.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12915-022-01428-7.

Magnetoencephalography contrast adaptation reflects perceptual adaptation

Contrast adaptation is a fundamental visual process that has been extensively investigated and used to infer the selectivity of visual cortex. We recently reported an apparent disconnect between the effects of contrast adaptation on perception and functional magnetic resonance imaging BOLD response adaptation, in which adaptation between chromatic and achromatic stimuli measured psychophysically showed greater selectivity than adaptation measured using BOLD signals. Here we used magnetoencephalography (MEG) recordings of neural responses to the same chromatic and achromatic adaptation conditions to characterize the neural effects of contrast adaptation and to determine whether BOLD adaptation or MEG better reflect the measured perceptual effects. Participants viewed achromatic, L-M isolating, or S-cone isolating radial sinusoids before adaptation and after adaptation to each of the three contrast directions. We measured adaptation-related changes in the neural response to a range of stimulus contrast amplitudes using two measures of the MEG response: the overall response amplitude, and a novel time-resolved measure of the contrast response function, derived from a classification analysis combined with multidimensional scaling. Within-stimulus adaptation effects on the contrast response functions in each case showed a pattern of contrast-gain or a combination of contrast-gain and response-gain effects. Cross-stimulus adaptation conditions showed that adaptation effects were highly stimulus selective across early, ventral, and dorsal visual cortical areas, consistent with the perceptual effects.

V1-Origin Bidirectional Plasticity in Visual Thalamo-Ventral Pathway and Its Contribution to Saliency Detection of Dynamic Visual Inputs

Visual neural plasticity and V1 saliency detection are vital for efficient coding of dynamically changing visual inputs. However, how does neural plasticity contribute to saliency detection of temporal statistically distributed visual stream remains unclear. Therefore, we adopted randomly presented but unevenly distributed stimuli with multiple orientations and examined the single-unit responses evoked by this biased orientation-adaptation protocol by single-unit recordings in the visual thalamo-ventral pathway of cats (of either sex). We found neuronal responses potentiated when the probability of biased orientation was slightly higher than other nonbiased ones and suppressed when the probability became much higher. This single neuronal short-term bidirectional plasticity is selectively induced by optimal stimuli but is interocularly transferable. It is inducible in LGN, Area 17, and Area 21a with distinct and hierarchically progressive patterns. With the results of latency analysis, receptive field structural test, cortical lesion, and simulations, we suggest this bidirectional plasticity may principally originate from the adaptation competition between excitatory and inhibitory components of V1 neuronal receptive field. In our simulation, above bidirectional plasticity could achieve saliency detection of dynamic visual inputs. These findings demonstrate a rapid probability dependent plasticity on the neural coding of visual stream and suggest its functional role in the efficient coding and saliency detection of dynamic environment.SIGNIFICANCE STATEMENT Novel elements within a dynamic visual stream can pop up from the context, which is vital for rapid response to a dynamically changing world. Saliency detection is a promising bottom-up mechanism contributing to efficient selection of visual inputs, wherein visual adaptation also plays a significant role. However, the saliency detection of dynamic visual stream is poorly understood. Here, we found a novel form of visual short-term bidirectional plasticity in multistages of the visual system that contributes to saliency detection of dynamic visual inputs. This bidirectional plasticity may principally originate from the local balance of excitation inhibition in primary visual cortex and propagates to lower and higher visual areas with progressive pattern change. Our findings suggest the excitation-inhibition balance within the visual system contributes to visual efficient coding.

Cascaded normalizations for spatial integration in the primary visual cortex of primates

Spatial integration of visual information is an important function in the brain. However, neural computation for spatial integration in the visual cortex remains unclear. In this study, we recorded laminar responses in V1 of awake monkeys driven by visual stimuli with grating patches and annuli of different sizes. We find three important response properties related to spatial integration that are significantly different between input and output layers: neurons in output layers have stronger surround suppression, smaller receptive field (RF), and higher sensitivity to grating annuli partially covering their RFs. These interlaminar differences can be explained by a descriptive model composed of two global divisions (normalization) and a local subtraction. Our results suggest suppressions with cascaded normalizations (CNs) are essential for spatial integration and laminar processing in the visual cortex. Interestingly, the features of spatial integration in convolutional neural networks, especially in lower layers, are different from our findings in V1.

Opposite forms of adaptation in mouse visual cortex are controlled by distinct inhibitory microcircuits

Sensory processing in the cortex adapts to the history of stimulation but the mechanisms are not understood. Imaging the primary visual cortex of mice we find here that an increase in stimulus contrast is not followed by a simple decrease in gain of pyramidal cells; as many cells increase gain to improve detection of a subsequent decrease in contrast. Depressing and sensitizing forms of adaptation also occur in different types of interneurons (PV, SST and VIP) and the net effect within individual pyramidal cells reflects the balance of PV inputs, driving depression, and a subset of SST interneurons driving sensitization. Changes in internal state associated with locomotion increase gain across the population of pyramidal cells while maintaining the balance between these opposite forms of plasticity, consistent with activation of both VIP->SST and SST->PV disinhibitory pathways. These results reveal how different inhibitory microcircuits adjust the gain of pyramidal cells signalling changes in stimulus strength.

The authors describe the role of inhibitory microcircuits in the visual cortex of mice in adaptation to contrast. They show how external stimuli and internal state interact to adjust processing in the visual cortex.

Explaining Orientation Adaptation in V1 by Updating the State of a Spatial Model

In this work, we extend an influential statistical model based on the spatial classical receptive field (CRF) and non-classical receptive field (nCRF) interactions (Coen-Cagli et al., 2012) to explain the typical orientation adaptation effects observed in V1. If we assume that the temporal adaptation modifies the “state” of the model, the spatial statistical model can explain all of the orientation adaptation effects in the context of neuronal output using small and large grating observed in neurophysiological experiments in V1. The “state” of the model represents the internal parameters such as the prior and the covariance trained on a mixed dataset that totally determine the response of the model. These two parameters, respectively, reflect the probability of the orientation component and the connectivity among neurons between CRF and nCRF. Specifically, we have two key findings: First, neural adapted results using a small grating that just covers the CRF can be predicted by the change of the prior of our model. Second, the change of the prior can also predict most of the observed results using a large grating that covers both CRF and nCRF of a neuron. However, the prediction of the novel attractive adaptation using large grating covering both CRF and nCRF also necessitates the involvement of a connectivity change of the center-surround RFs. In addition, our paper contributes a new prior-based winner-take-all (WTA) working mechanism derived from the statistical-based model to explain why and how all of these orientation adaptation effects can be predicted by relying on this spatial model without modifying its structure, a novel application of the spatial model. The research results show that adaptation may link time and space by changing the “state” of the neural system according to a specific adaptor. Furthermore, different forms of stimulus used for adaptation can cause various adaptation effects, such as an a priori shift or a connectivity change, depending on the specific stimulus size.

Novel stimuli evoke excess activity in the mouse primary visual cortex

Rapid detection and processing of stimulus novelty are key elements of adaptive behavior. Predictive coding theories postulate that novel stimuli should be encoded differently from familiar stimuli. Here, we show that the majority of neurons in layer 2/3 of the mouse primary visual cortex exhibit a significant excess response to novel visual stimuli. The distinction between novel and familiar images developed rapidly, requiring only a few repeated presentations. We show that this phenomenon can be described by a model of cascading adaptation. This ubiquitous mechanism makes it likely that similar computations could be carried out in many brain areas.

To explore how neural circuits represent novel versus familiar inputs, we presented mice with repeated sets of images with novel images sparsely substituted. Using two-photon calcium imaging to record from layer 2/3 neurons in the mouse primary visual cortex, we found that novel images evoked excess activity in the majority of neurons. This novelty response rapidly emerged, arising with a time constant of 2.6 ± 0.9 s. When a new image set was repeatedly presented, a majority of neurons had similarly elevated activity for the first few presentations, which decayed to steady state with a time constant of 1.4 ± 0.4 s. When we increased the number of images in the set, the novelty response’s amplitude decreased, defining a capacity to store ∼15 familiar images under our conditions. These results could be explained quantitatively using an adaptive subunit model in which presynaptic neurons have individual tuning and gain control. This result shows that local neural circuits can create different representations for novel versus familiar inputs using generic, widely available mechanisms.

Plasticity in visual cortex is disrupted in a mouse model of tauopathy

Alzheimer's disease and other dementias are thought to underlie a progressive impairment of neural plasticity. Previous work in mouse models of Alzheimer's disease shows pronounced changes in artificially-induced plasticity in hippocampus, perirhinal and prefrontal cortex. However, it is not known how degeneration disrupts intrinsic forms of brain plasticity. Here we characterised the impact of tauopathy on a simple form of intrinsic plasticity in the visual system, which allowed us to track plasticity at both long (days) and short (minutes) timescales. We studied rTg4510 transgenic mice at early stages of tauopathy (5 months) and a more advanced stage (8 months). We recorded local field potentials in the primary visual cortex while animals were repeatedly exposed to a stimulus over 9 days. We found that both short- and long-term visual plasticity were already disrupted at early stages of tauopathy, and further reduced in older animals, such that it was abolished in mice expressing mutant tau. Additionally, visually evoked behaviours were disrupted in both younger and older mice expressing mutant tau. Our results show that visual cortical plasticity and visually evoked behaviours are disrupted in the rTg4510 model of tauopathy. This simple measure of plasticity may help understand how tauopathy disrupts neural circuits, and offers a translatable platform for detection and tracking of the disease.

Stimulus-specific plasticity of macaque V1 spike rates and gamma

When a visual stimulus is repeated, average neuronal responses typically decrease, yet they might maintain or even increase their impact through increased synchronization. Previous work has found that many repetitions of a grating lead to increasing gamma-band synchronization. Here, we show in awake macaque area V1 that both repetition-related reductions in firing rate and increases in gamma are specific to the repeated stimulus. These effects show some persistence on the timescale of minutes. Gamma increases are specific to the presented stimulus location. Further, repetition effects on gamma and on firing rates generalize to images of natural objects. These findings support the notion that gamma-band synchronization subserves the adaptive processing of repeated stimulus encounters.

EEG-based visual deviance detection in freely behaving mice

The mouse is widely used as an experimental model to study visual processing. To probe how the visual system detects changes in the environment, functional paradigms in freely behaving mice are strongly needed. We developed and validated the first EEG-based method to investigate visual deviance detection in freely behaving mice. Mice with EEG implants were exposed to a visual deviant detection paradigm that involved changes in light intensity as standard and deviant stimuli. By subtracting the standard from the deviant evoked waveform, deviant detection was evident as bi-phasic negativity (starting around 70 ms) in the difference waveform. Additionally, deviance-associated evoked (beta/gamma) and induced (gamma) oscillatory responses were found. We showed that the results were stimulus-independent by applying a "flip-flop" design and the results showed good repeatability in an independent measurement. Together, we put forward a validated, easy-to-use paradigm to measure visual deviance processing in freely behaving mice.

Broadband Dynamics Rather than Frequency-Specific Rhythms Underlie Prediction Error in the Primate Auditory Cortex

Detection of statistical irregularities, measured as a prediction error response, is fundamental to the perceptual monitoring of the environment. We studied whether prediction error response is associated with neural oscillations or asynchronous broadband activity. Electrocorticography was conducted in three male monkeys, who passively listened to the auditory roving oddball stimuli. Local field potentials (LFPs) recorded over the auditory cortex underwent spectral principal component analysis, which decoupled broadband and rhythmic components of the LFP signal. We found that the broadband component captured the prediction error response, whereas none of the rhythmic components were associated with statistical irregularities of sounds. The broadband component displayed more stochastic, asymmetrical multifractal properties than the rhythmic components, which revealed more self-similar dynamics. We thus conclude that the prediction error response is captured by neuronal populations generating asynchronous broadband activity, defined by irregular dynamic states, which, unlike oscillatory rhythms, appear to enable the neural representation of auditory prediction error response.SIGNIFICANCE STATEMENT This study aimed to examine the contribution of oscillatory and asynchronous components of auditory local field potentials in the generation of prediction error responses to sensory irregularities, as this has not been directly addressed in the previous studies. Here, we show that mismatch negativity-an auditory prediction error response-is driven by the asynchronous broadband component of potentials recorded in the auditory cortex. This finding highlights the importance of nonoscillatory neural processes in the predictive monitoring of the environment. At a more general level, the study demonstrates that stochastic neural processes, which are often disregarded as neural noise, do have a functional role in the processing of sensory information.

Neural tuning and representational geometry

A central goal of neuroscience is to understand the representations formed by brain activity patterns and their connection to behaviour. The classic approach is to investigate how individual neurons encode stimuli and how their tuning determines the fidelity of the neural representation. Tuning analyses often use the Fisher information to characterize the sensitivity of neural responses to small changes of the stimulus. In recent decades, measurements of large populations of neurons have motivated a complementary approach, which focuses on the information available to linear decoders. The decodable information is captured by the geometry of the representational patterns in the multivariate response space. Here we review neural tuning and representational geometry with the goal of clarifying the relationship between them. The tuning induces the geometry, but different sets of tuned neurons can induce the same geometry. The geometry determines the Fisher information, the mutual information and the behavioural performance of an ideal observer in a range of psychophysical tasks. We argue that future studies can benefit from considering both tuning and geometry to understand neural codes and reveal the connections between stimuli, brain activity and behaviour.

Short-latency ocular following responses to motion stimuli are strongly affected by temporal modulations of the visual content during the initial fixation period

Neuronal and psychophysical responses to a visual stimulus are known to depend on the preceding history of visual stimulation, but the effect of stimulation history on reflexive eye movements has received less attention. Here, we quantify these effects using short-latency ocular following responses (OFRs), a valuable tool for studying early motion processing. We recorded, in human subjects, the horizontal OFRs induced by drifting vertical 1D pink noise. The stimulus was preceded by 600 to 1000 ms of maintained fixation (on a visible cross), and we explored the effect of different stimuli (“fixation patterns”) presented during the fixation period. We found that any temporal modulation present during the fixation period reduced the magnitude of the subsequent OFRs. Even changes in the overall luminance during the fixation period induced significant suppression. The magnitude of the effect was a function of both spatial and temporal structure of the fixation pattern. Suppression that was selective for both relative orientation and relative spatial frequency accounted for a considerable fraction of total suppression. Finally, changes in stimulus temporal structure alone (i.e. “flicker” versus “transparent motion”) led to changes in the spatial frequency tuning of suppression. In the time domain, the suppression developed quickly: 100 ms of temporal modulation in the fixation pattern produced up to 80% of maximal suppression. Recovery from suppression was instead more gradual, taking up to several seconds. By presenting transparent motion during the fixation period, with opposite motion signals having different spatial frequency content, we also discovered a direction-selective component of suppression, which depended on both the frequency and the direction of the moving stimulus.

Contrast adaptation and interocular transfer in cortical cells: A re-analysis & a two-stage gain-control model of binocular combination

How do V1 cells respond to, adapt to, and combine signals from the two eyes? We tested a simple functional model that has monocular and binocular stages of divisive contrast gain control (CGC) that sit before, and after, binocular summation respectively. Interocular suppression (IOS) was another potential influence on contrast gain. Howarth, Vorobyov & Sengpiel (2009, Cerebral Cortex, 19, 1835-1843) studied contrast adaptation and interocular transfer in cat V1 cells. In our re-analysis we found that ocular dominance (OD) and contrast adaptation at a fixed test contrast were well described by a re-scaling of the unadapted orientation tuning curve - a simple change in response gain. We compared six variants of the basic model, and one model fitted the gain data notably better than the others did. When the dominant eye was tested, adaptation reduced cell response gain more when that eye was adapted than when the other eye was adapted. But when the non-dominant eye was tested, adapting either eye gave about the same reduction in overall gain, and there was an interaction between OD and adapting eye that was well described by the best-fitting model. Two key features of this model are that signals driving IOS arise 'early', before attenuation due to OD, while suppressive CGC signals are 'late' and so affected by OD. We show that late CGC confers a functional advantage: it yields partial compensation for OD, which should reduce ocular imbalance at the input to binocular summation, and improve the cell's sensitivity to variation in stereo disparity.

Effect of receptor clustering on chemotactic performance of E. coli: Sensing versus adaptation

We show how the competition between sensing and adaptation can result in a performance peak in Escherichia coli chemotaxis using extensive numerical simulations in a detailed theoretical model. Receptor clustering amplifies the input signal coming from ligand binding which enhances chemotactic efficiency. But large clusters also induce large fluctuations in total activity since the number of clusters goes down. The activity and hence the run-tumble motility now gets controlled by methylation levels which are part of adaptation module rather than ligand binding. This reduces chemotactic efficiency.

Evaluating the evidence for expectation suppression in the visual system

Reports of expectation suppression have shaped the development of influential predictive coding-based theories of visual perception. However recent work has highlighted confounding factors that may mimic or inflate expectation suppression effects. In this review, we describe four confounds that are prevalent across experiments that tested for expectation suppression: effects of surprise, attention, stimulus repetition and adaptation, and stimulus novelty. With these confounds in mind we then critically review the evidence for expectation suppression across probabilistic cueing, statistical learning, oddball, action-outcome learning and apparent motion designs. We found evidence for expectation suppression within a specific subset of statistical learning designs that involved weeks of sequence learning prior to neural activity measurement. Across other experimental contexts, whereby stimulus appearance probabilities were learned within one or two testing sessions, there was inconsistent evidence for genuine expectation suppression. We discuss how an absence of expectation suppression could inform models of predictive processing, repetition suppression and perceptual decision-making. We also provide suggestions for designing experiments that may better test for expectation suppression in future work.

Limited Evidence for Sensory Prediction Error Responses in Visual Cortex of Macaques and Humans

A recent formulation of predictive coding theory proposes that a subset of neurons in each cortical area encodes sensory prediction errors, the difference between predictions relayed from higher cortex and the sensory input. Here, we test for evidence of prediction error responses in spiking responses and local field potentials (LFP) recorded in primary visual cortex and area V4 of macaque monkeys, and in complementary electroencephalographic (EEG) scalp recordings in human participants. We presented a fixed sequence of visual stimuli on most trials, and violated the expected ordering on a small subset of trials. Under predictive coding theory, pattern-violating stimuli should trigger robust prediction errors, but we found that spiking, LFP and EEG responses to expected and pattern-violating stimuli were nearly identical. Our results challenge the assertion that a fundamental computational motif in sensory cortex is to signal prediction errors, at least those based on predictions derived from temporal patterns of visual stimulation.

Inverted central auditory hierarchies for encoding local intervals and global temporal patterns

In sensory systems, representational features of increasing complexity emerge at successive stages of processing. In the mammalian auditory pathway, the clearest change from brainstem to cortex is defined by what is lost, not by what is gained, in that high-fidelity temporal coding becomes increasingly restricted to slower acoustic modulation rates.^1,2 Here, we explore the idea that sluggish temporal processing is more than just an inability for fast processing, but instead reflects an emergent specialization for encoding sound features that unfold on very slow timescales.^3,4 We performed simultaneous single unit ensemble recordings from three hierarchical stages of auditory processing in awake mice - the inferior colliculus (IC), medial geniculate body of the thalamus (MGB) and primary auditory cortex (A1). As expected, temporal coding of brief local intervals (0.001 - 0.1 s) separating consecutive noise bursts was robust in the IC and declined across MGB and A1. By contrast, slowly developing (∼1 s period) global rhythmic patterns of inter-burst interval sequences strongly modulated A1 spiking, were weakly captured by MGB neurons, and not at all by IC neurons. Shifts in stimulus regularity were not represented by changes in A1 spike rates, but rather in how the spikes were arranged in time. These findings show that low-level auditory neurons with fast timescales encode isolated sound features but not the longer gestalt, while the extended timescales in higher-level areas can facilitate sensitivity to slower contextual changes in the sensory environment.

High Contrast Allows the Retina to Compute More Than Just Contrast

The goal of sensory processing is to represent the environment of an animal. All sensory systems share a similar constraint: they need to encode a wide range of stimulus magnitudes within their narrow neuronal response range. The most efficient way, exploited by even the simplest nervous systems, is to encode relative changes in stimulus magnitude rather than the absolute magnitudes. For instance, the retina encodes contrast, which are the variations of light intensity occurring in time and in space. From this perspective, it is easy to understand why the bright plumage of a moving bird gains a lot of attention, while an octopus remains motionless and mimics its surroundings for concealment. Stronger contrasts simply cause stronger visual signals. However, the gains in retinal performance associated with higher contrast are far more than what can be attributed to just a trivial linear increase in signal strength. Here we discuss how this improvement in performance is reflected throughout different parts of the neural circuitry, within its neural code and how high contrast activates many non-linear mechanisms to unlock several sophisticated retinal computations that are virtually impossible in low contrast conditions.

Scrambling the skin: A psychophysical study of adaptation to scrambled tactile apparent motion

An age-old hypothesis proposes that object motion across the receptor surface organizes sensory maps (Lotze, 19th century). Skin patches learn their relative positions from the order in which they are stimulated during motion events. We propose that reversing the local motion within a global motion sequence ('motion scrambling') provides a good test for this idea, and present results of the first experiment implementing the paradigm. We used 6-point apparent motion along the forearm. In the Scrambled sequence, two middle locations were touched in reversed order (1-2-4-3-5-6, followed by 6-5-3-4-2-1, in a continuous loop). This created a double U-turn within an otherwise constant-velocity motion, as if skin patches 3 and 4 physically swapped locations. The control condition, Orderly, proceeded at constant velocity at inter-stimulus onset interval of 120 ms. The 26.4-minute conditioning (delivered in twenty-four 66-s bouts) was interspersed with testing of perceived motion direction between the two middle tactors presented on their own (sequence 3-4 or 4-3). Our twenty participants reported motion direction. Direction discrimination was degraded following exposure to Scrambled pattern and was 0.31 d' weaker than following Orderly conditioning (p = .007). Consistent with the proposed role of motion, this could be the beginning of re-learning of relative positions. An alternative explanation is that greater speed adaptation occurred in the Scrambled pattern, raising direction threshold. In future studies, longer conditioning should tease apart the two explanations: our re-mapping hypothesis predicts an overall reversal in perceived motion direction between critical locations (for either motion direction), whereas the speed adaptation alternative predicts chance-level performance at worst, without reversing.

Timing of repetition suppression of event-related potentials to unattended objects

Current theories of object perception emphasize the automatic nature of perceptual inference. Repetition suppression (RS), the successive decrease of brain responses to repeated stimuli, is thought to reflect the optimization of perceptual inference through neural plasticity. While functional imaging studies revealed brain regions that show suppressed responses to the repeated presentation of an object, little is known about the intra-trial time course of repetition effects to everyday objects. Here, we used event-related potentials (ERPs) to task-irrelevant line-drawn objects, while participants engaged in a distractor task. We quantified changes in ERPs over repetitions using three general linear models that modeled RS by an exponential, linear, or categorical "change detection" function in each subject. Our aim was to select the model with highest evidence and determine the within-trial time-course and scalp distribution of repetition effects using that model. Model comparison revealed the superiority of the exponential model indicating that repetition effects are observable for trials beyond the first repetition. Model parameter estimates revealed a sequence of RS effects in three time windows (86-140, 322-360, and 400-446 ms) and with occipital, temporoparietal, and frontotemporal distribution, respectively. An interval of repetition enhancement (RE) was also observed (320-340 ms) over occipitotemporal sensors. Our results show that automatic processing of task-irrelevant objects involves multiple intervals of RS with distinct scalp topographies. These sequential intervals of RS and RE might reflect the short-term plasticity required for optimization of perceptual inference and the associated changes in prediction errors and predictions, respectively, over stimulus repetitions during automatic object processing.

Low rank mechanisms underlying flexible visual representations

Neuronal population responses to sensory stimuli are remarkably flexible. The responses of neurons in visual cortex have heterogeneous dependence on stimulus properties (e.g., contrast), processes that affect all stages of visual processing (e.g., adaptation), and cognitive processes (e.g., attention or task switching). Understanding whether these processes affect similar neuronal populations and whether they have similar effects on entire populations can provide insight into whether they utilize analogous mechanisms. In particular, it has recently been demonstrated that attention has low rank effects on the covariability of populations of visual neurons, which impacts perception and strongly constrains mechanistic models. We hypothesized that measuring changes in population covariability associated with other sensory and cognitive processes could clarify whether they utilize similar mechanisms or computations. Our experimental design included measurements in multiple visual areas using four distinct sensory and cognitive processes. We found that contrast, adaptation, attention, and task switching affect the variability of responses of populations of neurons in primate visual cortex in a similarly low rank way. These results suggest that a given circuit may use similar mechanisms to perform many forms of modulation and likely reflects a general principle that applies to a wide range of brain areas and sensory, cognitive, and motor processes.

A Sensorimotor Numerosity System

Incoming sensory input provides information for the planning and execution of actions, which yield motor outcomes that are themselves sensory inputs. One dimension where action and perception strongly interact is numerosity perception. Many non-human animals can estimate approximately the number of external elements as well as their own actions, and neurons have been identified that respond to both. Recent psychophysical adaptation studies on humans also provide evidence for neural mechanisms responding to both the number of externally generated events and self-produced actions. Here we advance the idea that these strong connections may arise from dedicated sensorimotor mechanisms in the brain, part of a more generalized system interfacing action with the processing of other quantitative magnitudes such as space and time.

Plasticity in perception: insights from color vision deficiencies

Inherited color vision deficiencies typically result from a loss or alteration of the visual photopigments absorbing light and thus impact the very first step of seeing. There is growing interest in how subsequent steps in the visual pathway might be calibrated to compensate for the altered receptor signals, with the possibility that color coding and color percepts might be less severely impacted than the receptor differences predict. These compensatory adjustments provide important insights into general questions about sensory plasticity and the sensory and cognitive processes underlying how we experience color.

Fine-scale computations for adaptive processing in the human brain

Adapting to the environment statistics by reducing brain responses to repetitive sensory information is key for efficient information processing. Yet, the fine-scale computations that support this adaptive processing in the human brain remain largely unknown. Here, we capitalise on the sub-millimetre resolution of ultra-high field imaging to examine functional magnetic resonance imaging signals across cortical depth and discern competing hypotheses about the brain mechanisms (feedforward vs. feedback) that mediate adaptive processing. We demonstrate layer-specific suppressive processing within visual cortex, as indicated by stronger BOLD decrease in superficial and middle than deeper layers for gratings that were repeatedly presented at the same orientation. Further, we show altered functional connectivity for adaptation: enhanced feedforward connectivity from V1 to higher visual areas, short-range feedback connectivity between V1 and V2, and long-range feedback occipito-parietal connectivity. Our findings provide evidence for a circuit of local recurrent and feedback interactions that mediate rapid brain plasticity for adaptive information processing.