Visual cortex: Fatigue and adaptation

An improved SSVEP-based brain-computer interface with low-contrast visual stimulation and its application in UAV control

Efficient communication and regulation are crucial for advancing brain-computer interfaces (BCIs), with the steady-state visual-evoked potential (SSVEP) paradigm demonstrating high accuracy and information transfer rates. However, the conventional SSVEP paradigm encounters challenges related to visual occlusion and fatigue. In this study, we propose an improved SSVEP paradigm that addresses these issues by lowering the contrast of visual stimulation. The improved paradigms outperform the traditional paradigm in the experiments, significantly reducing the visual stimulation of the SSVEP paradigm. Furthermore, we apply this enhanced paradigm to a BCI navigation system, enabling two-dimensional navigation of unmanned aerial vehicles (UAVs) through a first-person perspective. Experimental results indicate the enhanced SSVEP-based BCI system's accuracy in performing navigation and search tasks. Our findings highlight the feasibility of the enhanced SSVEP paradigm in mitigating visual occlusion and fatigue issues, presenting a more intuitive and natural approach for BCIs to control external equipment.NEW & NOTEWORTHY In this article, we proposed an improved steady-state visual-evoked potential (SSVEP) paradigm and constructed an SSVEP-based brain-computer interface (BCI) system to navigate the unmanned aerial vehicle (UAV) in two-dimensional (2-D) physical space. We proposed a modified method for evaluating visual fatigue including subjective score and objective indices. The results indicated that the improved SSVEP paradigm could effectively reduce visual fatigue while maintaining high accuracy.

Conflicts between short- and long-term experiences affect visual perception through modulating sensory or motor response systems: Evidence from Bayesian inference models

The independent effects of short- and long-term experiences on visual perception have been discussed for decades. However, no study has investigated whether and how these experiences simultaneously affect our visual perception. To address this question, we asked participants to estimate their self-motion directions (i.e., headings) simulated from optic flow, in which a long-term experience learned in everyday life (i.e., straight-forward motion being more common than lateral motion) plays an important role. The headings were selected from three distributions that resembled a peak, a hill, and a flat line, creating different short-term experiences. Importantly, the proportions of headings deviating from the straight-forward motion gradually increased in the peak, hill, and flat distributions, leading to a greater conflict between long- and short-term experiences. The results showed that participants biased their heading estimates towards the straight-ahead direction and previously seen headings, which increased with the growing experience conflict. This suggests that both long- and short-term experiences simultaneously affect visual perception. Finally, we developed two Bayesian models (Model 1 vs. Model 2) based on two assumptions that the experience conflict altered the likelihood distribution of sensory representation or the motor response system. The results showed that both models accurately predicted participants' estimation biases. However, Model 1 predicted a higher variance of serial dependence compared to Model 2, while Model 2 predicted a higher variance of the bias towards the straight-ahead direction compared to Model 1. This suggests that the experience conflict can influence visual perception by affecting both sensory and motor response systems. Taken together, the current study systematically revealed the effects of long- and short-term experiences on visual perception and the underlying Bayesian processing mechanisms.

Feedforward attentional selection in sensory cortex

Salient objects grab attention because they stand out from their surroundings. Whether this phenomenon is accomplished by bottom-up sensory processing or requires top-down guidance is debated. We tested these alternative hypotheses by measuring how early and in which cortical layer(s) neural spiking distinguished a target from a distractor. We measured synaptic and spiking activity across cortical columns in mid-level area V4 of male macaque monkeys performing visual search for a color singleton. A neural signature of attentional capture was observed in the earliest response in the input layer 4. The magnitude of this response predicted response time and accuracy. Errant behavior followed errant selection. Because this response preceded top-down influences and arose in the cortical layer not targeted by top-down connections, these findings demonstrate that feedforward activation of sensory cortex can underlie attentional priority.

The influence of stimulus history on directional coding in the monarch butterfly brain

The central complex is a brain region in the insect brain that houses a neural network specialized to encode directional information. Directional coding has traditionally been investigated with compass cues that revolve in full rotations and at constant angular velocities around the insect's head. However, these stimulus conditions do not fully simulate an insect's sensory perception of compass cues during navigation. In nature, an insect flight is characterized by abrupt changes in moving direction as well as constant changes in velocity. The influence of such varying cue dynamics on compass coding remains unclear. We performed long-term tetrode recordings from the brain of monarch butterflies to study how central complex neurons respond to different stimulus velocities and directions. As these butterflies derive directional information from the sun during migration, we measured the neural response to a virtual sun. The virtual sun was either presented as a spot that appeared at random angular positions or was rotated around the butterfly at different angular velocities and directions. By specifically manipulating the stimulus velocity and trajectory, we dissociated the influence of angular velocity and direction on compass coding. While the angular velocity substantially affected the tuning directedness, the stimulus trajectory influenced the shape of the angular tuning curve. Taken together, our results suggest that the central complex flexibly adjusts its directional coding to the current stimulus dynamics ensuring a precise compass even under highly demanding conditions such as during rapid flight maneuvers.

Explaining Orientation Adaptation in V1 by Updating the State of a Spatial Model

In this work, we extend an influential statistical model based on the spatial classical receptive field (CRF) and non-classical receptive field (nCRF) interactions (Coen-Cagli et al., 2012) to explain the typical orientation adaptation effects observed in V1. If we assume that the temporal adaptation modifies the “state” of the model, the spatial statistical model can explain all of the orientation adaptation effects in the context of neuronal output using small and large grating observed in neurophysiological experiments in V1. The “state” of the model represents the internal parameters such as the prior and the covariance trained on a mixed dataset that totally determine the response of the model. These two parameters, respectively, reflect the probability of the orientation component and the connectivity among neurons between CRF and nCRF. Specifically, we have two key findings: First, neural adapted results using a small grating that just covers the CRF can be predicted by the change of the prior of our model. Second, the change of the prior can also predict most of the observed results using a large grating that covers both CRF and nCRF of a neuron. However, the prediction of the novel attractive adaptation using large grating covering both CRF and nCRF also necessitates the involvement of a connectivity change of the center-surround RFs. In addition, our paper contributes a new prior-based winner-take-all (WTA) working mechanism derived from the statistical-based model to explain why and how all of these orientation adaptation effects can be predicted by relying on this spatial model without modifying its structure, a novel application of the spatial model. The research results show that adaptation may link time and space by changing the “state” of the neural system according to a specific adaptor. Furthermore, different forms of stimulus used for adaptation can cause various adaptation effects, such as an a priori shift or a connectivity change, depending on the specific stimulus size.

Altered neuronal activity in the visual processing region of eye-fluke-infected fish

Fish, like most vertebrates, are dependent on vision to varying degrees for a variety of behaviours such as predator avoidance and foraging. Disruption of this key sensory system therefore should have some impact on the ability of fish to execute these tasks. Eye-flukes, such as Tylodelphys darbyi, often infect fish where they are known to inflict varying degrees of visual impairment. In New Zealand, T. darbyi infects the eyes of Gobiomorphus cotidianus, a freshwater fish, where it resides in the vitreous chamber between the lens and retina. Here, we investigate whether the presence of the parasite in the eye has an impact on neuronal information transfer using the c-Fos gene as a proxy for neuron activation. We hypothesized that the parasite would reduce visual information entering the eye and therefore result in lower c-Fos expression. Interestingly, however, c-Fos expression increased with T. darbyi intensity when fish were exposed to flashes of light. Our results suggest a mechanism for parasite-induced visual disruption when no obvious pathology is caused by infection. The more T. darbyi present the more visual stimuli the fish is presented with, and as such may experience difficulties in distinguishing various features of its external environment.

Top-down influence affects the response adaptation of V1 neurons in cats

The visual system lowers its perceptual sensitivity to a prolonged presentation of the same visual signal. This brain plasticity, called visual adaptation, is generally attributed to the response adaptation of neurons in the visual cortex. Although well-studied in the neurons of the primary visual cortex (V1), the contribution of high-level visual cortical regions to the response adaptation of V1 neurons is unclear. In the present study, we measured the response adaptation strength of V1 neurons before and after the top-down influence of the area 21a (A21a), a higher-order visual cortex homologous to the primate V4 area, was modulated with a noninvasive tool of transcranial direct current stimulation (tDCS). Our results showed that the response adaptation of V1 neurons enhanced significantly after applying anode (a-) tDCS in A21a when compared with that before a-tDCS, whereas the response adaptation of V1 neurons weakened after cathode (c-) tDCS relative to before c-tDCS in A21a. By contrast, sham (s-) tDCS in A21a had no significant impact on the response adaptation of V1 neurons. Further analysis indicated that a-tDCS in A21a significantly increased both the initial response (IR) of V1 neurons to the first several (five) trails of visual stimulation and the plateau response (PR) to the prolonged visual stimulation; the increase in PR was lower than in IR, which caused an enhancement in response adaptation. Conversely, c-tDCS significantly decreased both IR and PR of V1 neurons; the reduction in PR was smaller than in IR, which resulted in a weakness in response adaptation. Furthermore, the tDCS-induced changes of V1 neurons in response and response adaptation could recover after tDCS effect vanished, but did not occur after the neuronal activity in A21a was silenced by electrolytic lesions. These results suggest that the top-down influence of A21a may alter the response adaptation of V1 neurons through activation of local inhibitory circuitry, which enhances network inhibition in the V1 area upon an increased top-down input, weakens inhibition upon a decreased top-down input, and thus maintains homeostasis of V1 neurons in response to the long-presenting visual signals.

A saliency-specific and dimension-independent mechanism of distractor suppression

During everyday tasks, salient distractors may capture our attention. Recently, it was shown that through implicit learning, capture by a salient distractor is reduced by suppressing the location where a distractor is likely to appear. In the current study, we presented distractors of different saliency levels at the same specific location, asking the question whether there is always one suppression level for a particular location or whether, for one location, suppression depends on the actual saliency of the distractor appearing at that location. In three experiments, we demonstrate a saliency-specific mechanism of distractor suppression, which can be flexibly modulated by the overall probability of encountering distractors of different saliency levels to optimize behavior in a specific environment. The results also suggest that this mechanism has dimension-independent aspects, given that the saliency-specific suppression pattern is unaffected when saliency signals of distractors are generated by different dimensions. It is argued that suppression is saliency-dependent, implying that suppression is modulated on a trial-by-trial basis contingent on the saliency of the actual distractor presented.

Magnitude, time course, and specificity of rapid adaptation across mouse visual areas

Adaptation is a ubiquitous feature of sensory processing whereby recent experience shapes future responses. The mouse primary visual cortex (V1) is particularly sensitive to recent experience, where a brief stimulus can suppress subsequent responses for seconds. This rapid adaptation profoundly impacts perception, suggesting that its effects are propagated along the visual hierarchy. To understand how rapid adaptation influences sensory processing, we measured its effects at key nodes in the visual system: in V1, three higher visual areas (HVAs: lateromedial, anterolateral, and posteromedial), and the superior colliculus (SC) in awake mice of both sexes using single-unit recordings. Consistent with the feed-forward propagation of adaptation along the visual hierarchy, we find that neurons in layer 4 adapt less strongly than those in other layers of V1. Furthermore, neurons in the HVAs adapt more strongly, and recover more slowly, than those in V1. The magnitude and time course of adaptation was comparable in each of the HVAs and in the SC, suggesting that adaptation may not linearly accumulate along the feed-forward visual processing hierarchy. Despite the increase in adaptation in the HVAs compared with V1, the effects were similarly orientation specific across all areas. These data reveal that adaptation profoundly shapes cortical processing, with increasing impact at higher levels in the cortical hierarchy, and also strongly influencing computations in the SC. Thus, we find robust, brain-wide effects of rapid adaptation on sensory processing.NEW & NOTEWORTHY Rapid adaptation dynamically alters sensory signals to account for recent experience. To understand how adaptation affects sensory processing and perception, we must determine how it impacts the diverse set of cortical and subcortical areas along the hierarchy of the mouse visual system. We find that rapid adaptation strongly impacts neurons in primary visual cortex, the higher visual areas, and the colliculus, consistent with its profound effects on behavior.

Changes in event-related brain responses and habituation during child development - A systematic literature review

OBJECTIVE

This systematic review highlights the influence of developmental changes of the central nervous system on habituation assessment during child development. Therefore, studies on age dependant changes in event-related brain responses as well as studies on behavioural and neurophysiological habituation during child development are compiled and discussed.

METHODS

Two PubMed searches with terms "(development evoked brain response (fetus OR neonate OR children) (electroencephalography OR magnetoencephalography))" and with terms "(psychology habituation (fetal OR neonate OR children) (human brain))" were performed to identify studies on developmental changes in event-related brain responses as well as habituation studies during child development.

RESULTS

Both search results showed a wide diversity of subjects' ages, stimulation protocols and examined behaviour or components of event-related brain responses as well as a demand for more longitudinal study designs.

CONCLUSIONS

A conclusive statement about clear developmental trends in event-related brain responses or in neurophysiological habituation studies is difficult to draw. Future studies should implement longitudinal designs, combination of behavioural and neurophysiological habituation measurement and more complex habituation paradigms to assess several habituation criteria.

SIGNIFICANCE

This review emphasizes that event-related brain responses underlie certain changes during child development which should be more considered in the context of neurophysiological habituation studies.

Predictive Processing: A Canonical Cortical Computation

This perspective describes predictive processing as a computational framework for understanding cortical function in the context of emerging evidence, with a focus on sensory processing. We discuss how the predictive processing framework may be implemented at the level of cortical circuits and how its implementation could be falsified experimentally. Lastly, we summarize the general implications of predictive processing on cortical function in healthy and diseased states.

Relationship of Depth Adaptation Between Disparity-Specified Plaids and Their Components

In the luminance domain, studies show that perceived contrasts of plaids are a nonlinear summation of their components. In the disparity domain, perceived depth has been studied by using a depth adaptation paradigm with simple surfaces; however, the relationship between depth adaptation between plaids and their components has not been investigated. To clarify this, combinations of disparity-defined horizontal corrugation (marked as horizontal) and disparity-defined plaids as adaptor-probe pairs were used. Three experiments were performed: The first two compared the aftereffects between horizontal-horizontal and plaid-horizontal pairs (Comparison 1) and between horizontal-plaid and plaid-plaid pairs (Comparison 2). Experiments 1 and 2 controlled the plaids to have the same and doubled peak-to-trough amplitudes as the horizontal corrugation, respectively. In Comparison 1, the horizontal or horizontally oriented component of the plaids was adapted. In Comparison 2, the plaid adaptor or horizontally oriented component of the plaid test stimuli was adapted. Thus, depth adaptation may be linked to cyclopean-oriented depth-from-disparity bandpass filters. The depth adaptation degree was determined by the adaptation of amplitudes of the similar oriented channels between the adaptation and test stimuli. Experiment 3 compared the aftereffects between noise-horizontal and horizontal-horizontal pairs. Since the noise adaptor contained multispatial frequency channels, only the channels with similar spatial frequencies as the horizontal corrugation were adapted, thus causing smaller depth aftereffects.

Multiple timescales of normalized value coding underlie adaptive choice behavior

Adaptation is a fundamental process crucial for the efficient coding of sensory information. Recent evidence suggests that similar coding principles operate in decision-related brain areas, where neural value coding adapts to recent reward history. However, the circuit mechanism for value adaptation is unknown, and the link between changes in adaptive value coding and choice behavior is unclear. Here we show that choice behavior in nonhuman primates varies with the statistics of recent rewards. Consistent with efficient coding theory, decision-making shows increased choice sensitivity in lower variance reward environments. Both the average adaptation effect and across-session variability are explained by a novel multiple timescale dynamical model of value representation implementing divisive normalization. The model predicts empirical variance-driven changes in behavior despite having no explicit knowledge of environmental statistics, suggesting that distributional characteristics can be captured by dynamic model architectures. These findings highlight the importance of treating decision-making as a dynamic process and the role of normalization as a unifying computation for contextual phenomena in choice.

Adaptation to stimulus orientation in mouse primary visual cortex

Information processing in the visual system is shaped by recent stimulus history, such that prolonged viewing of an adapting stimulus can alter the perception of subsequently presented test stimuli. In the tilt-after-effect, the perceived orientation of a grating is often repelled away from the orientation of a previously viewed adapting grating. A possible neural correlate for the tilt-after-effect has been described in cat and macaque primary visual cortex (V1), where adaptation produces repulsive shifts in the orientation tuning curves of V1 neurons. We investigated adaptation to stimulus orientation in mouse V1 to determine whether known species differences in orientation processing, notably V1 functional architecture and proportion of tightly tuned cells, are important for these repulsive shifts. Unlike the consistent repulsion reported in other species, we found that repulsion was only about twice as common as attraction in our mouse data. Furthermore, adapted responses were attenuated across all orientations. A simple model that captured key physiological findings reported in cats and mice indicated that the greater proportion of broadly tuned neurons in mice may explain the observed species differences in adaptation.

Contour Integration in Dynamic Scenes: Impaired Detection Performance in Extended Presentations

Since scenes in nature are highly dynamic, perception requires an on-going and robust integration of local information into global representations. In vision, contour integration (CI) is one of these tasks, and it is performed by our brain in a seemingly effortless manner. Following the rule of good continuation, oriented line segments are linked into contour percepts, thus supporting important visual computations such as the detection of object boundaries. This process has been studied almost exclusively using static stimuli, raising the question of whether the observed robustness and "pop-out" quality of CI carries over to dynamic scenes. We investigate contour detection in dynamic stimuli where targets appear at random times by Gabor elements aligning themselves to form contours. In briefly presented displays (230 ms), a situation comparable to classical paradigms in CI, performance is about 87%. Surprisingly, we find that detection performance decreases to 67% in extended presentations (about 1.9-3.8 s) for the same target stimuli. In order to observe the same reduction with briefly presented stimuli, presentation time has to be drastically decreased to intervals as short as 50 ms. Cueing a specific contour position or shape helps in partially compensating this deterioration, and only in extended presentations combining a location and a shape cue was more efficient than providing a single cue. Our findings challenge the notion of CI as a mainly stimulus-driven process leading to pop-out percepts, indicating that top-down processes play a much larger role in supporting fundamental integration processes in dynamic scenes than previously thought.

Adaptive Processes in Thalamus and Cortex Revealed by Silencing of Primary Visual Cortex during Contrast Adaptation

Visual adaptation illusions indicate that our perception is influenced not only by the current stimulus but also by what we have seen in the recent past. Adaptation to stimulus contrast (the relative luminance created by edges or contours in a scene) induces the perception of the stimulus fading away and increases the contrast detection threshold in psychophysical tests [1, 2]. Neural correlates of contrast adaptation have been described throughout the visual system including the retina [3], dorsal lateral geniculate nucleus (dLGN) [4, 5], primary visual cortex (V1) [6], and parietal cortex [7]. The apparent ubiquity of adaptation at all stages raises the question of how this process cascades across brain regions [8]. Focusing on V1, adaptation could be inherited from pre-cortical stages, arise from synaptic depression at the thalamo-cortical synapse [9], or develop locally, but what is the weighting of these contributions? Because contrast adaptation in mouse V1 is similar to classical animal models [10, 11], we took advantage of the optogenetic tools available in mice to disentangle the processes contributing to adaptation in V1. We disrupted cortical adaptation by optogenetically silencing V1 and found that adaptation measured in V1 now resembled that observed in dLGN. Thus, the majority of adaptation seen in V1 neurons arises through local activity-dependent processes, with smaller contributions from dLGN inheritance and synaptic depression at the thalamo-cortical synapse. Furthermore, modeling indicates that divisive scaling of the weakly adapted dLGN input can predict some of the emerging features of V1 adaptation.

Non-monotonic Temporal-Weighting Indicates a Dynamically Modulated Evidence-Integration Mechanism

Perceptual decisions are thought to be mediated by a mechanism of sequential sampling and integration of noisy evidence whose temporal weighting profile affects the decision quality. To examine temporal weighting, participants were presented with two brightness-fluctuating disks for 1, 2 or 3 seconds and were requested to choose the overall brighter disk at the end of each trial. By employing a signal-perturbation method, which deploys across trials a set of systematically controlled temporal dispersions of the same overall signal, we were able to quantify the participants' temporal weighting profile. Results indicate that, for intervals of 1 or 2 sec, participants exhibit a primacy-bias. However, for longer stimuli (3-sec) the temporal weighting profile is non-monotonic, with concurrent primacy and recency, which is inconsistent with the predictions of previously suggested computational models of perceptual decision-making (drift-diffusion and Ornstein-Uhlenbeck processes). We propose a novel, dynamic variant of the leaky-competing accumulator model as a potential account for this finding, and we discuss potential neural mechanisms.

Contrast adaptation is spatial frequency specific in mouse primary visual cortex

Contrast adaptation, generated by prolonged viewing of a high contrast spatial pattern, is known to reduce perceptual sensitivity to subsequently presented stimuli of similar spatial frequency (SF). Neural correlates of this pattern-specific contrast adaptation have been described in several classic studies in cat primary visual cortex (V1). These results have also recently been extended to mice, which is a genetically manipulable animal model. Here we attempt to parse the potential mechanisms contributing to this phenomenon by determining whether the SF specificity of contrast adaptation observed in mouse V1 neurons depends on the spike rate elicited by the adapting gratings. We found that adapting stimuli that drove a neuron more strongly generally produced more adaptation, implicating an intrinsic or fatigue-like process. Importantly, we also observed that slightly stronger contrast adaptation was produced when the adapting SF matched the test SF even when matched and nonmatched adapting gratings elicited similar spike rates indicating extrinsic or network processes contribute as well.

Effects of surround suppression on response adaptation of V1 neurons to visual stimuli

The influence of intracortical inhibition on the response adaptation of visual cortical neurons remains in debate. To clarify this issue, in the present study the influence of surround suppression evoked through the local inhibitory interneurons on the adaptation effects of neurons in the primary visual cortex (V1) were observed. Moreover, the adaptations of V1 neurons to both the high-contrast visual stimuli presented in the classical receptive field (CRF) and to the costimulation presented in the CRF and the surrounding nonclassical receptive field (nCRF) were compared. The intensities of surround suppression were modulated with different sized grating stimuli. The results showed that the response adaptation of V1 neurons decreased significantly with the increase of surround suppression and this adaptation decrease was due to the reduction of the initial response of V1 neurons to visual stimuli. However, the plateau response during adaptation showed no significant changes. These findings indicate that the adaptation effects of V1 neurons may not be directly affected by surround suppression, but may be dynamically regulated by a negative feedback network and be finely adjusted by its initial spiking response to stimulus. This adaptive regulation is not only energy efficient for the central nervous system, but also beneficially acts to maintain the homeostasis of neuronal response to long-presenting visual signals.

Transcranial Magnetic Stimulation Changes Response Selectivity of Neurons in the Visual Cortex

BACKGROUND

Transcranial magnetic stimulation (TMS) is used to selectively alter neuronal activity of specific regions in the cerebral cortex. TMS is reported to induce either transient disruption or enhancement of different neural functions. However, its effects on tuning properties of sensory neurons have not been studied quantitatively.

OBJECTIVE/HYPOTHESIS

Here, we use specific TMS application parameters to determine how they may alter tuning characteristics (orientation, spatial frequency, and contrast sensitivity) of single neurons in the cat's visual cortex.

METHODS

Single unit spikes were recorded with tungsten microelectrodes from the visual cortex of anesthetized and paralyzed cats (12 males). Repetitive TMS (4 Hz, 4 s) was delivered with a 70 mm figure-8 coil. We quantified basic tuning parameters of individual neurons for each pre- and post-TMS condition. The statistical significance of changes for each tuning parameter between the two conditions was evaluated with a Wilcoxon signed-rank test.

RESULTS

We generally find long-lasting suppression which persists well beyond the stimulation period. Pre- and post-TMS orientation tuning curves show constant peak values. However, strong suppression at non-preferred orientations tends to narrow the widths of tuning curves. Spatial frequency tuning exhibits an asymmetric change in overall shape, which results in an emphasis on higher frequencies. Contrast tuning curves show nonlinear changes consistent with a gain control mechanism.

CONCLUSIONS

These findings suggest that TMS causes extended interruption of the balance between sub-cortical and intra-cortical inputs.

Cascaded effects of spatial adaptation in the early visual system

Virtually all stages of the visual system exhibit adaptation: neurons adjust their responses based on the recent stimulus history. While some of these adjustments occur at specific stages, others may be inherited from earlier stages. How do adaptation effects cascade along the visual system? We measured spatially selective adaptation at two successive stages in the mouse visual system: visual thalamus (LGN) and primary visual cortex (V1). This form of adaptation affected both stages but in drastically different ways: in LGN it only changed response gain, while in V1 it also shifted spatial tuning away from the adaptor. These effects, however, are reconciled by a simple model whereby V1 neurons summate LGN inputs with a fixed, unadaptable weighting profile. These results indicate that adaptation effects cascade through the visual system, that this cascading can shape selectivity, and that the rules of integration from one stage to the next are not themselves adaptable.

•

Different stages of the visual system show different forms of spatial adaptation

•

In LGN, adaptation controls only response gain; in V1, it also controls tuning

•

These disparate effects are reconciled by a summation model with fixed weights

•

The cascade of adaptation shapes tuning without affecting the summation rules

Blood oxygen level-dependent activation of the primary visual cortex predicts size adaptation illusion

In natural scenes, objects rarely occur in isolation but appear within a spatiotemporal context. Here, we show that the perceived size of a stimulus is significantly affected by the context of the scene: brief previous presentation of larger or smaller adapting stimuli at the same region of space changes the perceived size of a test stimulus, with larger adapting stimuli causing the test to appear smaller than veridical and vice versa. In a human fMRI study, we measured the blood oxygen level-dependent activation (BOLD) responses of the primary visual cortex (V1) to the contours of large-diameter stimuli and found that activation closely matched the perceptual rather than the retinal stimulus size: the activated area of V1 increased or decreased, depending on the size of the preceding stimulus. A model based on local inhibitory V1 mechanisms simulated the inward or outward shifts of the stimulus contours and hence the perceptual effects. Our findings suggest that area V1 is actively involved in reshaping our perception to match the short-term statistics of the visual scene.

Dynamical adaptation in photoreceptors

Adaptation is at the heart of sensation and nowhere is it more salient than in early visual processing. Light adaptation in photoreceptors is doubly dynamical: it depends upon the temporal structure of the input and it affects the temporal structure of the response. We introduce a non-linear dynamical adaptation model of photoreceptors. It is simple enough that it can be solved exactly and simulated with ease; analytical and numerical approaches combined provide both intuition on the behavior of dynamical adaptation and quantitative results to be compared with data. Yet the model is rich enough to capture intricate phenomenology. First, we show that it reproduces the known phenomenology of light response and short-term adaptation. Second, we present new recordings and demonstrate that the model reproduces cone response with great precision. Third, we derive a number of predictions on the response of photoreceptors to sophisticated stimuli such as periodic inputs, various forms of flickering inputs, and natural inputs. In particular, we demonstrate that photoreceptors undergo rapid adaptation of response gain and time scale, over ∼ 300[Formula: see text] ms-i. e., over the time scale of the response itself-and we confirm this prediction with data. For natural inputs, this fast adaptation can modulate the response gain more than tenfold and is hence physiologically relevant.

Spatiotemporal specificity of contrast adaptation in mouse primary visual cortex

Prolonged viewing of high contrast gratings alters perceived stimulus contrast, and produces characteristic changes in the contrast response functions of neurons in the primary visual cortex (V1). This is referred to as contrast adaptation. Although contrast adaptation has been well-studied, its underlying neural mechanisms are not well-understood. Therefore, we investigated contrast adaptation in mouse V1 with the goal of establishing a quantitative description of this phenomenon in a genetically manipulable animal model. One interesting aspect of contrast adaptation that has been observed both perceptually and in single unit studies is its specificity for the spatial and temporal characteristics of the stimulus. Therefore, in the present work we determined if the magnitude of contrast adaptation in mouse V1 neurons was dependent on the spatial frequency and temporal frequency of the adapting grating. We used protocols that were readily comparable with previous studies in cats and primates, and also a novel contrast ramp stimulus that characterized the spatial and temporal specificity of contrast adaptation simultaneously. Similar to previous work in higher mammals, we found that contrast adaptation was strongest when the spatial frequency and temporal frequency of the adapting grating matched the test stimulus. This suggests similar mechanisms underlying contrast adaptation across animal models and indicates that the rapidly advancing genetic tools available in mice could be used to provide insights into this phenomenon.

Individual and age-related variation in chromatic contrast adaptation

Precortical color channels are tuned primarily to the LvsM (stimulation of L and M cones varied, but S cone stimulation held constant) or SvsLM (stimulation of S cones varied, but L and M cone stimulation held constant) cone-opponent (cardinal) axes, but appear elaborated in the cortex to form higher-order mechanisms tuned to both cardinal and intermediate directions. One source of evidence for these higher-order mechanisms has been the selectivity of color contrast adaptation for noncardinal directions, yet the degree of this selectivity has varied widely across the small sample of observers tested in previous studies. This study explored the possible bases for this variation, and in particular tested whether it reflected age-related changes in the distribution or tuning of color mechanisms. Observers included 15 younger (18-22 years of age) and 15 older individuals (66-82), who adapted to temporal modulations along one of four chromatic axes (two cardinal and two intermediate axes) and then matched the hue and contrast of test stimuli lying along eight different directions in the equiluminant plane. All observers exhibited aftereffects that were selective for both the cardinal and intermediate directions, although selectivity was weaker for the intermediate axes. The degree of selectivity increased with the magnitude of adaptation for all axes, and thus adaptation strength alone may account for much of the variance in selectivity among observers. Older observers showed a stronger magnitude of adaptation thus, surprisingly, more conspicuous evidence for higher-order mechanisms. For both age groups the aftereffects were well predicted by response changes in chromatic channels with linear spectral sensitivities, and there was no evidence for weakened channel tuning with aging. The results suggest that higher-order mechanisms may become more exposed in observers or conditions in which the strength of adaptation is greater, and that both chromatic contrast adaptation and the cortical color coding it reflects remain largely intact in the aging visual system.

Tuned with a Tune: Talker Normalization via General Auditory Processes

Voices have unique acoustic signatures, contributing to the acoustic variability listeners must contend with in perceiving speech, and it has long been proposed that listeners normalize speech perception to information extracted from a talker's speech. Initial attempts to explain talker normalization relied on extraction of articulatory referents, but recent studies of context-dependent auditory perception suggest that general auditory referents such as the long-term average spectrum (LTAS) of a talker's speech similarly affect speech perception. The present study aimed to differentiate the contributions of articulatory/linguistic versus auditory referents for context-driven talker normalization effects and, more specifically, to identify the specific constraints under which such contexts impact speech perception. Synthesized sentences manipulated to sound like different talkers influenced categorization of a subsequent speech target only when differences in the sentences' LTAS were in the frequency range of the acoustic cues relevant for the target phonemic contrast. This effect was true both for speech targets preceded by spoken sentence contexts and for targets preceded by non-speech tone sequences that were LTAS-matched to the spoken sentence contexts. Specific LTAS characteristics, rather than perceived talker, predicted the results suggesting that general auditory mechanisms play an important role in effects considered to be instances of perceptual talker normalization.

GABA(A)-mediated inhibition modulates stimulus-specific adaptation in the inferior colliculus

The ability to detect novel sounds in a complex acoustic context is crucial for survival. Neurons from midbrain through cortical levels adapt to repetitive stimuli, while maintaining responsiveness to rare stimuli, a phenomenon called stimulus-specific adaptation (SSA). The site of origin and mechanism of SSA are currently unknown. We used microiontophoretic application of gabazine to examine the role of GABA(A)-mediated inhibition in SSA in the inferior colliculus, the midbrain center for auditory processing. We found that gabazine slowed down the process of adaptation to high probability stimuli but did not abolish it, with response magnitude and latency still depending on the probability of the stimulus. Blocking GABA(A) receptors increased the firing rate to high and low probability stimuli, but did not completely equalize the responses. Together, these findings suggest that GABA(A)-mediated inhibition acts as a gain control mechanism that enhances SSA by modifying the responsiveness of the neuron.

Peri-ictal changes of cortical excitability in children suffering from migraine without aura

In adult patients with migraine, transcranial magnetic stimulation (TMS) has been used to examine cortical excitability between attacks, but there have been discrepant results. No TMS study has examined cortical excitability in children or adolescents with migraine. Here, we employed TMS to study regional excitability of the occipital (phosphene threshold [PT] and suppression of visual perception) and motor (resting motor threshold and cortical silent period) cortex in ten children suffering from migraine without aura and ten healthy age-matched controls. Patients were studied 1-2 days before and after a migraine attack as well as during the inter-migraine interval. The motion aftereffect was also investigated at each time-point as an index of cortical reactivity to moving visual stimuli. Migraineurs had lower PTs compared to healthy participants at each time-point, indicating increased occipital excitability. This increase in occipital excitability was attenuated 1-2 days before a migraine attack as indicated by a relative increase in PTs. The increase in PTs before the next attack was associated with a stronger TMS-induced suppression of visual perception and a prolongation of the motion aftereffect. Motor cortex excitability was not altered in patients and did not change during the migraine cycle. These findings show that pediatric migraine without aura is associated with a systematic shift in occipital excitability preceding the migraine attack. Similar systematic fluctuations in cortical excitability might be present in adult migraineurs and may reflect either a protective mechanism or an abnormal decrease in cortical excitability that predisposes an individual to a migraine attack.

Time course and stimulus dependence of repetition-induced response suppression in inferotemporal cortex

Neural responses throughout the sensory system are affected by stimulus history. In the inferotemporal cortex (IT)--an area important for processing information about object shape--there is a substantially reduced response to the second presentation of an image. Understanding the mechanisms underlying repetition suppression may provide important insights into the circuitry that generates responses in IT. In addition, repetition suppression may have important perceptual consequences. The characteristics of repetition suppression in IT are poorly understood, and the details, including the interaction between the content of the first and second stimulus and the time course of suppression, are not clear. Here, we examined the time course of suppression in IT by varying both the duration and stimulus content of two stimuli presented in sequence. The data show that the degree of suppression does not depend directly on the response evoked by the first stimulus in the recorded neuron. Repetition suppression was also limited in duration, peaking at approximately 200 ms after the onset of the second (test) image and disappearing before the end of the response. Neural selectivity to a continuum of related images was enhanced if the first stimulus produced a weak response in the cell. The dynamics of the response suggests that different parts of the input and recurrent circuitry that gives rise to neural responses in IT are differentially modulated by repetition suppression. The selectivity of the sustained response was preserved in spite of substantial suppression of the early part of the response. The data suggest that suppression in IT is a property of the input and recurrent circuitry in IT and is not directly related to the degree of response in the recorded neuron itself.

Adaptation and selective information transmission in the cricket auditory neuron AN2

Sensory systems adapt their neural code to changes in the sensory environment, often on multiple time scales. Here, we report a new form of adaptation in a first-order auditory interneuron (AN2) of crickets. We characterize the response of the AN2 neuron to amplitude-modulated sound stimuli and find that adaptation shifts the stimulus–response curves toward higher stimulus intensities, with a time constant of 1.5 s for adaptation and recovery. The spike responses were thus reduced for low-intensity sounds. We then address the question whether adaptation leads to an improvement of the signal's representation and compare the experimental results with the predictions of two competing hypotheses: infomax, which predicts that information conveyed about the entire signal range should be maximized, and selective coding, which predicts that “foreground” signals should be enhanced while “background” signals should be selectively suppressed. We test how adaptation changes the input–response curve when presenting signals with two or three peaks in their amplitude distributions, for which selective coding and infomax predict conflicting changes. By means of Bayesian data analysis, we quantify the shifts of the measured response curves and also find a slight reduction of their slopes. These decreases in slopes are smaller, and the absolute response thresholds are higher than those predicted by infomax. Most remarkably, and in contrast to the infomax principle, adaptation actually reduces the amount of encoded information when considering the whole range of input signals. The response curve changes are also not consistent with the selective coding hypothesis, because the amount of information conveyed about the loudest part of the signal does not increase as predicted but remains nearly constant. Less information is transmitted about signals with lower intensity.

Sensory systems have the ability to adapt to changes in the environment. In a quiet room, the nervous system is very responsive, so that even a whisper can be easily understood. In contrast, the perceived loudness on a crowded street will be reduced to prevent an overload of the nervous system. Two different hypotheses have been proposed to explain how the nervous system achieves this adaptation. According to one idea, all present sensory signals are equally enhanced, so that the whole range of input signals is reliably represented. On the other hand, the aim of the nervous system may be to extract the most important parts of the acoustic signal, for example, an approaching car, and thus abolish the irrelevant rest. To address which of these two principles is implemented in the auditory system of the cricket, we investigated the responses of a single auditory neuron, called interneuron AN2, to different sound signals. We found that adaptation actually reduces the amount of encoded information when considering the whole range of input signals. However, the changes were also not in agreement with the idea that only the most important signal is transmitted, because the amount of information conveyed about the loudest part of the signal does not increase. Thus, we here report the unusual case of a reduction of information transfer by adaptation, while in most other systems reported of so far adaptation actually enhances coding of sensory information.

A sparse generative model of V1 simple cells with intrinsic plasticity

Current models for learning feature detectors work on two timescales: on a fast timescale, the internal neurons' activations adapt to the current stimulus; on a slow timescale, the weights adapt to the statistics of the set of stimuli. Here we explore the adaptation of a neuron's intrinsic excitability, termed intrinsic plasticity, which occurs on a separate timescale. Here, a neuron maintains homeostasis of an exponentially distributed firing rate in a dynamic environment. We exploit this in the context of a generative model to impose sparse coding. With natural image input, localized edge detectors emerge as models of V1 simple cells. An intermediate timescale for the intrinsic plasticity parameters allows modeling aftereffects. In the tilt aftereffect, after a viewer adapts to a grid of a certain orientation, grids of a nearby orientation will be perceived as tilted away from the adapted orientation. Our results show that adapting the neurons' gain-parameter but not the threshold-parameter accounts for this effect. It occurs because neurons coding for the adapting stimulus attenuate their gain, while others increase it. Despite its simplicity and low maintenance, the intrinsic plasticity model accounts for more experimental details than previous models without this mechanism.

Space and time in visual context

No sensory stimulus is an island unto itself; rather, it can only properly be interpreted in light of the stimuli that surround it in space and time. This can result in entertaining illusions and puzzling results in psychological and neurophysiological experiments. We concentrate on perhaps the best studied test case, namely orientation or tilt, which gives rise to the notorious tilt illusion and the adaptation tilt after-effect. We review the empirical literature and discuss the computational and statistical ideas that are battling to explain these conundrums, and thereby gain favour as more general accounts of cortical processing.

Spatial Frequency-Specific Contrast Adaptation Originates in the Primary Visual Cortex

Adaptation to a high-contrast grating stimulus causes reduced sensitivity to subsequent presentation of a visual stimulus with similar spatial characteristics. This behavioral finding has been attributed by neurophysiological studies to processes within the visual cortex. However, some evidence indicates that contrast adaptation phenomena are also found in early visual pathways. Adaptation effects have been reported in retina and lateral geniculation nucleus (LGN). It is possible that these early pathways could be the physiological origin of the cortical adaptation effect. To study this, we recorded from single neurons in the cat's LGN. We find that contrast adaptation in the LGN, unlike that in the visual cortex, is not spatial frequency specific, i.e., adaptation effects apply to a broad range of spatial frequencies. In addition, aside from the amplitude attenuation, the shape of spatial frequency tuning curves of LGN cells is not affected by contrast adaptation. Again, these findings are unlike those found for cells in the visual cortex. Together, these results demonstrate that pattern specific contrast adaptation is a cortical process.

Characterizing contrast adaptation in a population of cat primary visual cortical neurons using Fisher information

When cat V1/V2 cells are adapted to contrast at their optimal orientation, a reduction in gain and/or a shift in the contrast response function is found. We investigated how these factors combine at the population level to affect the accuracy for detecting variations in contrast. Using the contrast response function parameters from a physiologically measured population, we model the population accuracy (using Fisher information) for contrast discrimination. Adaptation at 16%, 32%, and 100% contrast causes a shift in peak accuracy. Despite an overall drop in firing rate over the whole population, accuracy is enhanced around the adapted contrast and at higher contrasts, leading to greater efficiency of contrast coding at these levels. The estimated contrast discrimination threshold curve becomes elevated and shifted toward higher contrasts after adaptation, as has been found previously in human psychophysical experiments.

Cognitive fatigue of executive processes: interaction between interference resolution tasks

A resource depletion framework motivated a novel strategy for investigating whether the central executive is unitary or separable into relatively independent subprocesses. The idea that tasks with overlapping neural representations may involve similar executive components was also critical to our approach. Of particular interest were tasks requiring resolution of interference among competing representations. Within a single experimental session intensive training reduced the ability to resolve interference on a transfer task if the training task placed high demands on interference resolution. Negative transfer was absent when interference resolution was minimally required by the task, or when the training and transfer tasks did not rely on overlapping neural representations. These results suggest a nonunitary central executive composed of separable subcomponents, at least one of which mediates interference resolution. Our results are consistent with an executive control process specialized for the selection of task-relevant representations from competitors. The results also agree with the view that higher cognitive processes are resource limited and can be temporarily depleted.

Aging and blur adaptation

Color appearance remains remarkably stable in the aging visual system despite large changes in the spectral distribution of the retinal stimulus and losses in chromatic sensitivity (P. B. Delahunt, J. L. Hardy, K. Okajima, & J. S. Werner, 2005; J. S. Werner, 1996). This stability could reflect adaptive adjustments in peripheral or central chromatic mechanisms that compensate for sensitivity losses in senescence. We asked whether similar compensatory adjustments play a role in maintaining spatial vision--and whether the adaptation itself shows changes with aging-by examining the effects of adaptation on judgments of image focus. Perceptual aftereffects following adaptation to a uniform field and blurred or sharpened images were compared between younger adults and older observers. Subjects adapted to a sequence of blurred or sharpened images for 120 s, and a two-alternative forced-choice staircase task was used to vary the filter exponent of the test to define the subjective point of best focus. There was a small but significant difference between younger and older observers in the level perceived as best focused in all three adaptation conditions, possibly reflecting differences in the ambient blur level the groups are routinely exposed to. However, the magnitude of the blur aftereffect did not differ between the two age groups. These results suggest that although there may be small differences in the long-term adaptation to blur, younger and older observers do not differ in the strength of adaptation to transient changes in blur. The neural processes mediating adaptation to blur thus appear to remain largely intact with aging.

Direction-selective adaptation in fly visual motion-sensitive neurons is generated by an intrinsic conductance-based mechanism

Motion-sensitive neurons in the blowfly brain present an ideal model system to study the cellular mechanisms and functional significance of adaptation to visual motion. Various adaptation processes have been described, but it is still largely unknown which of these processes are generated in the motion-sensitive neurons themselves and which originate at more peripheral processing stages. By input resistance measurements I demonstrate that direction-selective adaptation is generated by an activity-dependent conductance increase in the motion-sensitive neurons. Based on correlations between dendritic Ca(2+) accumulation and slow hyperpolarizing after-potentials following excitatory stimulation, a regulation of direction-selective adaptation by Ca(2+) has previously been suggested. In the present study, however, adaptation phenomena are not evoked when the cytosolic Ca(2+) concentration is elevated by ultraviolet photolysis of caged Ca(2+) in single neurons rather than by motion stimulation. This result renders it unlikely, that adaptation in fly motion-sensitive neurons is regulated by bulk cytosolic Ca(2+).

The mean matters: effects of statistically defined nonspeech spectral distributions on speech categorization

Adjacent speech, and even nonspeech, contexts influence phonetic categorization. Four experiments investigated how preceding sequences of sine-wave tones influence phonetic categorization. This experimental paradigm provides a means of investigating the statistical regularities of acoustic events that influence online speech categorization and, reciprocally, reveals regularities of the sound environment tracked by auditory processing. The tones comprising the sequences were drawn from distributions sampling different acoustic frequencies. Results indicate that whereas the mean of the distributions predicts contrastive shifts in speech categorization, variability of the distributions has little effect. Moreover, speech categorization is influenced by the global mean of the tone sequence, without significant influence of local statistical regularities within the tone sequence. Further arguing that the effect is strongly related to the average spectrum of the sequence, notched noise spectral complements of the tone sequences produce a complementary effect on speech categorization. Lastly, these effects are modulated by the number of tones in the acoustic history and the overall duration of the sequence, but not by the density with which the distribution defining the sequence is sampled. Results are discussed in light of stimulus-specific adaptation to statistical regularity in the acoustic input and a speculative link to talker normalization is postulated.

A Simple Hebbian/Anti-Hebbian Network Learns the Sparse, Independent Components of Natural Images

Slightly modified versions of an early Hebbian/anti-Hebbian neural network are shown to be capable of extracting the sparse, independent linear components of a prefiltered natural image set. An explanation for this capability in terms of a coupling between two hypothetical networks is presented. The simple networks presented here provide alternative, biologically plausible mechanisms for sparse, factorial coding in early primate vision.

Neural codes for perceptual discrimination in primary somatosensory cortex

We sought to determine the neural code(s) for frequency discrimination of vibrotactile stimuli. We tested five possible candidate codes by analyzing the responses of single neurons recorded in primary somatosensory cortex of trained monkeys while they discriminated between two consecutive vibrotactile stimuli. Differences in the frequency of two stimuli could be discriminated using information from (i) time intervals between spikes, (ii) average spiking rate during each stimulus, (iii) absolute number of spikes elicited by each stimulus, (iv) average rate of bursts of spikes or (v) absolute number of spike bursts elicited by each stimulus. However, only a spike count code, in which spikes are integrated over a time window that has most of its mass in the first 250 ms of each stimulus period, covaried with behavior on a trial-by-trial basis, was consistent with psychophysical biases induced by manipulation of stimulus duration, and produced neurometric discrimination thresholds similar to behavioral psychophysical thresholds.

Bottom-up and top-down dynamics in visual cortex

A key emergent property of the primary visual cortex (V1) is the orientation selectivity of its neurons. Recent experiments demonstrate remarkable bottom-up and top-down plasticity in orientation networks of the adult cortex. The basis for such dynamics is the mechanism by which orientation tuning is created and maintained, by integration of thalamocortical and intracortical inputs. Intracellular measurements of excitatory and inhibitory synaptic conductances reveal that excitation and inhibition balance each other at all locations in the cortex. This balance is particularly critical at pinwheel centers of the orientation map, where neurons receive intracortical input from a wide diversity of local orientations. The orientation tuning of neurons in adult V1 changes systematically after short-term exposure to one stimulus orientation. Such reversible physiological shifts in tuning parallel the orientation tilt aftereffect observed psychophysically. Neurons at or near pinwheel centers show pronounced changes in orientation preference after adaptation with an oriented stimulus, while neurons in iso-orientation domains show minimal changes. Neurons in V1 of alert, behaving monkeys also exhibit short-term orientation plasticity after very brief adaptation with an oriented stimulus, on the time scale of visual fixation. Adaptation with stimuli that are orthogonal to a neuron's preferred orientation does not alter the preferred orientation but sharpens orientation tuning. Thus, successive fixation on dissimilar image patches, as happens during natural vision, combined with mechanisms of rapid cortical plasticity, actually improves orientation discrimination. Finally, natural vision involves judgements about where to look next, based on an internal model of the visual world. Experiments in behaving monkeys in which information about future stimulus locations can be acquired in one set of trials but not in another demonstrate that V1 neurons signal the acquisition of internal representations. Such Bayesian updating of responses based on statistical learning is fundamental for higher level vision, for deriving inferences about the structure of the visual world, and for the regulation of eye movements.