Two what, two where, visual cortical streams in humans

ROLLS, E. T. Two What, Two Where, Visual Cortical Streams in Humans. NEUROSCI BIOBEHAV REV 2024. Recent cortical connectivity investigations lead to new concepts about 'What' and 'Where' visual cortical streams in humans, and how they connect to other cortical systems. A ventrolateral 'What' visual stream leads to the inferior temporal visual cortex for object and face identity, and provides 'What' information to the hippocampal episodic memory system, the anterior temporal lobe semantic system, and the orbitofrontal cortex emotion system. A superior temporal sulcus (STS) 'What' visual stream utilising connectivity from the temporal and parietal visual cortex responds to moving objects and faces, and face expression, and connects to the orbitofrontal cortex for emotion and social behaviour. A ventromedial 'Where' visual stream builds feature combinations for scenes, and provides 'Where' inputs via the parahippocampal scene area to the hippocampal episodic memory system that are also useful for landmark-based navigation. The dorsal 'Where' visual pathway to the parietal cortex provides for actions in space, but also provides coordinate transforms to provide inputs to the parahippocampal scene area for self-motion update of locations in scenes in the dark or when the view is obscured.

An analysis of information segregation in parallel streams of a multi-stream convolutional neural network

Visual information is processed in hierarchically organized parallel streams in the primate brain. In the present study, information segregation in parallel streams was examined by constructing a convolutional neural network with parallel architecture in all of the convolutional layers. Although filter weights for convolution were initially set to random values, color information was segregated from shape information in most model instances after training. Deletion of the color-related stream decreased recognition accuracy of animate images, whereas deletion of the shape-related stream decreased recognition accuracy of both animate and inanimate images. The results suggest that properties of filters and functions of a stream are spontaneously segregated in parallel streams of neural networks.

Convolutional neural networks develop major organizational principles of early visual cortex when enhanced with retinal sampling

Primate visual cortex exhibits key organizational principles: cortical magnification, eccentricity-dependent receptive field size and spatial frequency tuning as well as radial bias. We provide compelling evidence that these principles arise from the interplay of the non-uniform distribution of retinal ganglion cells, and a quasi-uniform convergence rate from the retina to the cortex. We show that convolutional neural networks outfitted with a retinal sampling layer, which resamples images according to retinal ganglion cell density, develop these organizational principles. Surprisingly, our results indicate that radial bias is spatial-frequency dependent and only manifests for high spatial frequencies. For low spatial frequencies, the bias shifts towards orthogonal orientations. These findings introduce a novel hypothesis about the origin of radial bias. Quasi-uniform convergence limits the range of spatial frequencies (in retinal space) that can be resolved, while retinal sampling determines the spatial frequency content throughout the retina.

Mnemonic But Not Contextual Feedback Signals Defy Dedifferentiation in the Aging Early Visual Cortex

Perception is an intricate interplay between feedforward visual input and internally generated feedback signals that comprise concurrent contextual and time-distant mnemonic (episodic and semantic) information. Yet, an unresolved question is how the composition of feedback signals changes across the lifespan and to what extent feedback signals undergo age-related dedifferentiation, that is, a decline in neural specificity. Previous research on this topic has focused on feedforward perceptual representation and episodic memory reinstatement, suggesting reduced fidelity of neural representations at the item and category levels. In this fMRI study, we combined an occlusion paradigm that filters feedforward input to the visual cortex and multivariate analysis techniques to investigate the information content in cortical feedback, focusing on age-related differences in its composition. We further asked to what extent differentiation in feedback signals (in the occluded region) is correlated to differentiation in feedforward signals. Comparing younger (18-30 years) and older female and male adults (65-75 years), we found that contextual but not mnemonic feedback was prone to age-related dedifferentiation. Semantic feedback signals were even better differentiated in older adults, highlighting the growing importance of generalized knowledge across ages. We also found that differentiation in feedforward signals was correlated with differentiation in episodic but not semantic feedback signals. Our results provide evidence for age-related adjustments in the composition of feedback signals and underscore the importance of examining dedifferentiation in aging for both feedforward and feedback processing.

Activation and depression of neural and hemodynamic responses induced by the intracortical microstimulation and visual stimulation in the mouse visual cortex

Objective. Intracortical microstimulation (ICMS) can be an effective method for restoring sensory perception in contemporary brain-machine interfaces. However, the mechanisms underlying better control of neuronal responses remain poorly understood, as well as the relationship between neuronal activity and other concomitant phenomena occurring around the stimulation site.Approach. Different microstimulation frequencies were investigatedin vivoon Thy1-GCaMP6s mice using widefield and two-photon imaging to evaluate the evoked excitatory neural responses across multiple spatial scales as well as the induced hemodynamic responses. Specifically, we quantified stimulation-induced neuronal activation and depression in the mouse visual cortex and measured hemodynamic oxyhemoglobin and deoxyhemoglobin signals using mesoscopic-scale widefield imaging.Main results. Our calcium imaging findings revealed a preference for lower-frequency stimulation in driving stronger neuronal activation. A depressive response following the neural activation preferred a slightly higher frequency stimulation compared to the activation. Hemodynamic signals exhibited a comparable spatial spread to neural calcium signals. Oxyhemoglobin concentration around the stimulation site remained elevated during the post-activation (depression) period. Somatic and neuropil calcium responses measured by two-photon microscopy showed similar dependence on stimulation parameters, although the magnitudes measured in soma was greater than in neuropil. Furthermore, higher-frequency stimulation induced a more pronounced activation in soma compared to neuropil, while depression was predominantly induced in soma irrespective of stimulation frequencies.Significance. These results suggest that the mechanism underlying depression differs from activation, requiring ample oxygen supply, and affecting neurons. Our findings provide a novel understanding of evoked excitatory neuronal activity induced by ICMS and offer insights into neuro-devices that utilize both activation and depression phenomena to achieve desired neural responses.

Immunocytochemical localization of nitric oxide synthase-containing neurons in the visual cortex of the Mongolian gerbil

INTRODUCTION

Nitric oxide (NO) is present in various cell types in the central nervous system and plays a crucial role in the control of various cellular functions. The diurnal Mongolian gerbil is a member of the rodent family Muridae that exhibits unique physiological, anatomical, and behavioral differences from the nocturnal rat and mouse, which render it a useful model for studying the visual system. The purpose of this study was to confirm the distribution and morphology of neurons that contain nitric oxide synthase (NOS) and their pattern of co-expressing NOS with neuropeptide Y (NPY), somatostatin (SST), and gamma-aminobutyric acid (GABA) in the visual cortex of Mongolian gerbils.

MATERIALS AND METHODS

Mongolian gerbils were used in the study. We confirmed the localization of NOS in the visual cortex of Mongolian gerbils using horseradish peroxidase immunocytochemistry, fluorescent immunocytochemistry, and conventional confocal microscopy.

RESULTS

NOS-immunoreactive (IR) neurons were present in all layers of the visual cortex of the Mongolian gerbil, with the exception of layer I, with the highest density observed in layer V (50.00%). The predominant type of NOS-IR neurons was multipolar round/oval cells (60.96%). Two-color immunofluorescence revealed that 100% NOS-IR neurons were co-labeled with NPY and SST and 34.55% were co-labeled with GABA.

CONCLUSIONS

Our findings of the laminar distribution and morphological characteristics of NOS-IR neurons, as well as the colocalization patterns of NOS-IR neurons with NPY, SST, and GABA, indicated the presence of species-specific differences, suggesting the functional diversity of NO in the visual cortex. This study provides valuable data on the anatomical organization of NOS-IR neurons and, consequently, a better understanding of the functional aspects of NO and species diversity.

How to study subjective experience in an animal model of blindsight?

The nature of subjective conscious experience, which accompanies us throughout our waking lives, and how it is generated, remain elusive. One of the challenges in studying subjective experience is disentangling the brain activity related to the sensory stimulus processing and stimulus-guided behavior from those associated with subjective perception. Blindsight, a phenomenon characterized by the retained visual discrimination performance but impaired visual consciousness due to damage to the primary visual cortex, becomes a special entry point to address this question. However, to fully understand the underlying neural mechanism, relying on studies involving human patients alone is insufficient. In this paper, we tried to address this issue, by first introducing the well-known cases of blindsight, especially the reports on subjective experience in both human and monkey subjects. And then we described how the impaired visual awareness of blindsight monkeys has been discovered and further studied by specifically designed tasks, as verbal reporting is not possible for these animals. Our previous studies also demonstrated that many complex visually guided cognitive processes were still retained despite the impairment of visual awareness. Further investigation needs to be conducted to explore the relationship between visually guided behavior, visual awareness and brain activity in blindsight subjects.

Intersubject representational similarity analysis uncovers the impact of state anxiety on brain activation patterns in the human extrastriate cortex

The current study used functional magnetic resonance imaging (fMRI) and showed that state anxiety modulated extrastriate cortex activity in response to emotionally-charged visual images. State anxiety and neuroimaging data from 53 individuals were subjected to an intersubject representational similarity analysis (ISRSA), wherein the geometries between neural and behavioral data were compared. This analysis identified the extrastriate cortex (fusiform gyrus and area MT) to be the sole regions whose activity patterns covaried with state anxiety. Importantly, we show that this brain-behavior association is revealed when treating state anxiety data as a multidimensional response pattern, rather than a single composite score. This suggests that ISRSA using multivariate distances may be more sensitive in identifying the shared geometries between self-report questionnaires and brain imaging data. Overall, our findings demonstrate that a transient state of anxiety may influence how visual information - especially those relevant to the valence dimension - is processed in the extrastriate cortex.

Peripheral vision is mainly for looking rather than seeing

Vision includes looking and seeing. Looking, mainly via gaze shifts, selects a fraction of visual input information for passage through the brain's information bottleneck. The selected input is placed within the attentional spotlight, typically in the central visual field. Seeing decodes, i.e., recognizes and discriminates, the selected inputs. Hence, peripheral vision should be mainly devoted to looking, in particular, deciding where to shift the gaze. Looking is often guided exogenously by a saliency map created by the primary visual cortex (V1), and can be effective with no seeing and limited awareness. In seeing, peripheral vision not only suffers from poor spatial resolution, but is also subject to crowding and is more vulnerable to illusions by misleading, ambiguous, and impoverished visual inputs. Central vision, mainly for seeing, enjoys the top-down feedback that aids seeing in light of the bottleneck which is hypothesized to starts from V1 to higher areas. This feedback queries for additional information from lower visual cortical areas such as V1 for ongoing recognition. Peripheral vision is deficient in this feedback according to the Central-peripheral Dichotomy (CPD) theory. The saccades engendered by peripheral vision allows looking to combine with seeing to give human observers the impression of seeing the whole scene clearly despite inattentional blindness.

Alpha Oscillations Create the Illusion of Time

Recent neuroscience experiments have brought inconsistent findings to light about the influence of neural activity in the alpha-frequency band (at ≈10 Hz) on the temporal dynamics of visual perception. Whereas strong alpha effects were found when perception was more based on endogenous factors, there were null-effects for alpha when perception relied more on objective physical parameters. In this Perspective, I open up a new view on neural alpha activity that resolves some important aspects of this controversy by interpreting alpha not as temporal processing of sensory inputs per se but above all as the observer's internal processing dynamics, their so-called perception sets. Perception sets reflect internally stored knowledge for how to organize and build up perceptual processes. They result from previous sensory experiences, are under top-down control to support goal-directed behavior, and root in pre-established neural networks that communicate through alpha frequency channels. I present three example cases from the recent neuroscience literature that show an influence of alpha-driven perception sets on the observer's visual-temporal resolution, object processing, and the processing of behaviorally relevant image content. Because alpha-driven perception sets can structure perception from its high-level aspects, like categories, down to its basic building blocks, like objects and time samples, they may have a fundamental impact on our conscious experience of the sensory world, including our perception of time itself.

Probing the Structure and Functional Properties of the Dropout-Induced Correlated Variability in Convolutional Neural Networks

Computational neuroscience studies have shown that the structure of neural variability to an unchanged stimulus affects the amount of information encoded. Some artificial deep neural networks, such as those with Monte Carlo dropout layers, also have variable responses when the input is fixed. However, the structure of the trial-by-trial neural covariance in neural networks with dropout has not been studied, and its role in decoding accuracy is unknown. We studied the above questions in a convolutional neural network model with dropout in both the training and testing phases. We found that trial-by-trial correlation between neurons (i.e., noise correlation) is positive and low dimensional. Neurons that are close in a feature map have larger noise correlation. These properties are surprisingly similar to the findings in the visual cortex. We further analyzed the alignment of the main axes of the covariance matrix. We found that different images share a common trial-by-trial noise covariance subspace, and they are aligned with the global signal covariance. This evidence that the noise covariance is aligned with signal covariance suggests that noise covariance in dropout neural networks reduces network accuracy, which we further verified directly with a trial-shuffling procedure commonly used in neuroscience. These findings highlight a previously overlooked aspect of dropout layers that can affect network performance. Such dropout networks could also potentially be a computational model of neural variability.

3D Visual Discomfort Assessment With a Weakly Supervised Graph Convolution Neural Network Based on Inaccurately Labeled EEG

Visual discomfort significantly limits the broader application of stereoscopic display technology. Hence, the accurate assessment of stereoscopic visual discomfort is a crucial topic in this field. Electroencephalography (EEG) data, which can reflect changes in brain activity, have received increasing attention in objective assessment research. However, inaccurately labeled data, resulting from the presence of individual differences, restrict the effectiveness of the widely used supervised learning methods in visual discomfort assessment tasks. Simultaneously, visual discomfort assessment methods should pay greater attention to the information provided by the visual cortical areas of the brain. To tackle these challenges, we need to consider two key aspects: maximizing the utilization of inaccurately labeled data for enhanced learning and integrating information from the brain's visual cortex for feature representation purposes. Therefore, we propose the weakly supervised graph convolution neural network for visual discomfort (WSGCN-VD). In the classification part, a center correction loss serves as a weakly supervised loss, employing a progressive selection strategy to identify accurately labeled data while constraining the involvement of inaccurately labeled data that are influenced by individual differences during the model learning process. In the feature extraction part, a feature graph module pays particular attention to the construction of spatial connections among the channels in the visual regions of the brain and combines them with high-dimensional temporal features to obtain visually dependent spatio-temporal representations. Through extensive experiments conducted in various scenarios, we demonstrate the effectiveness of our proposed model. Further analysis reveals that the proposed model mitigates the impact of inaccurately labeled data on the accuracy of assessment.

Top-down generation of low-resolution representations improves visual perception and imagination

Perception or imagination requires top-down signals from high-level cortex to primary visual cortex (V1) to reconstruct or simulate the representations bottom-up stimulated by the seen images. Interestingly, top-down signals in V1 have lower spatial resolution than bottom-up representations. It is unclear why the brain uses low-resolution signals to reconstruct or simulate high-resolution representations. By modeling the top-down pathway of the visual system using the decoder of a variational auto-encoder (VAE), we reveal that low-resolution top-down signals can better reconstruct or simulate the information contained in the sparse activities of V1 simple cells, which facilitates perception and imagination. This advantage of low-resolution generation is related to facilitating high-level cortex to form geometry-respecting representations observed in experiments. Furthermore, we present two findings regarding this phenomenon in the context of AI-generated sketches, a style of drawings made of lines. First, we found that the quality of the generated sketches critically depends on the thickness of the lines in the sketches: thin-line sketches are harder to generate than thick-line sketches. Second, we propose a technique to generate high-quality thin-line sketches: instead of directly using original thin-line sketches, we use blurred sketches to train VAE or GAN (generative adversarial network), and then infer the thin-line sketches from the VAE- or GAN-generated blurred sketches. Collectively, our work suggests that low-resolution top-down generation is a strategy the brain uses to improve visual perception and imagination, which inspires new sketch-generation AI techniques.

Perception of visual variance is mediated by subcortical mechanisms

Variance characterizes the structure of the environment. This statistical concept plays a critical role in evaluating the reliability of evidence for human decision-making. The present study examined the involvement of subcortical structures in the processing of visual variance. To this end, we used a stereoscope to sequentially present two circle arrays in a dichoptic or monocular fashion while participants compared the perceived variance of the two arrays. In Experiment 1, two arrays were presented monocularly to the same eye, dichopticly to different eyes, or binocularly to both eyes. The variance judgment was less accurate in different-eye condition than the other conditions. In Experiment 2, the first circle array was split into a large-variance and a small-variance set, with either the large-variance or small-variance set preceding the presentation of the second circle array in the same eye. The variance of the first array was judged larger when the second array was preceded by the large-variance set in the same eye, showing that the perception of variance was modulated by the visual variance processed in the same eye. Taken together, these findings provide evidence for monocular processing of visual variance, suggesting that subcortical structures capture the statistical structure of the visual world.

Single-trial EEG analysis reveals burst structure during photic driving

OBJECTIVE

Photic driving in the human visual cortex evoked by intermittent photic stimulation is usually characterized in averaged data by an ongoing oscillation showing frequency entrainment and resonance phenomena during the course of stimulation. We challenge this view of an ongoing oscillation by analyzing unaveraged data.

METHODS

64-channel EEGs were recorded during visual stimulation with light flashes at eight stimulation frequencies between 7.8 and 23 Hz for fourteen healthy volunteers. Time-frequency analyses were performed in averaged and unaveraged data.

RESULTS

While we find ongoing oscillations in the averaged data during intermittent photic stimulation, we find transient events (bursts) of activity in the unaveraged data. Both resonance and entrainment occur for the ongoing oscillations in the averaged data and the bursts in the unaveraged data.

CONCLUSIONS

We argue that the continuous oscillations in the averaged signal may be composed of brief, transient bursts in single trials. Our results can also explain previously observed amplitude fluctuations in averaged photic driving data.

SIGNIFICANCE

Single-trial analyses might consequently improve our understanding of resonance and entrainment phenomena in the brain.

Knocking out the LRRK2 gene increases sensitivity to wavelength information in rats

Leucine-rich repeat kinase 2 (LRRK2) is a gene related to familial Parkinson's disease (PD). It has been associated with nonmotor symptoms such as disturbances in the visual system affecting colour discrimination and contrast sensitivity. This study examined how deficiency of LRRK2 impacts visual processing in adult rats. Additionally, we investigated whether these changes can be modelled in wild-type rats by administering the LRRK2 inhibitor PFE360. Visual evoked potentials (VEPs) and steady-state visual evoked potentials (SSVEPs) were recorded in the visual cortex and superior colliculus of female LRRK2-knockout and wild-type rats to study how the innate absence of LRRK2 changes visual processing. Exposing the animals to stimulation at five different wavelengths revealed an interaction between genotype and the response to stimulation at different wavelengths. Differences in VEP amplitudes and latencies were robust and barely impacted by the presence of the LRRK2 inhibitor PFE360, suggesting a developmental effect. Taken together, these results indicate that alterations in visual processing were related to developmental deficiency of LRRK2 and not acute deficiency of LRRK2, indicating a role of LRRK2 in the functional development of the visual system and synaptic transmission.

Frequency-specific and periodic masking of peripheral characters by delayed foveal input

The foveal-feedback mechanism supports peripheral object recognition by processing information about peripheral objects in foveal retinotopic visual cortex. When a foveal object is asynchronously presented with a peripheral target, peripheral discrimination performance is affected differently depending on the relationship between the foveal and peripheral objects. However, it is not clear whether the delayed foveal input competes for foveal resources with the information processed by foveal-feedback or masks it. In the current study, we tested these hypotheses by measuring the effect of foveal noise at different spatial frequencies on peripheral discrimination of familiar and novel characters. Our results showed that the impairment of foveal-feedback was strongest for low-spatial frequency noise. A control experiment revealed that for spatially overlapping noise, low-spatial frequencies were more effective than medium-spatial frequencies in the periphery, but vice versa in the fovea. This suggests that the delayed foveal input selectively masks foveal-feedback when it is sufficiently similar to the peripheral information. Additionally, this foveal masking was periodic as evidenced by behavioral oscillations at around 5 Hz. Thus, we conclude that foveal-feedback supports peripheral discrimination of familiar and novel objects by periodically processing peripheral object information.

Bounded contribution of human early visual cortex to the topographic anisotropy in spatial extent perception

To interact successfully with objects, it is crucial to accurately perceive their spatial extent, an enclosed region they occupy in space. Although the topographic representation of space in the early visual cortex (EVC) has been favored as a neural correlate of spatial extent perception, its exact nature and contribution to perception remain unclear. Here, we inspect the topographic representations of human individuals' EVC and perception in terms of how much their anisotropy is influenced by the orientation (co-axiality) and radial position (radiality) of stimuli. We report that while the anisotropy is influenced by both factors, its direction is primarily determined by radiality in EVC but by co-axiality in perception. Despite this mismatch, the individual differences in both radial and co-axial anisotropy are substantially shared between EVC and perception. Our findings suggest that spatial extent perception builds on EVC's spatial representation but requires an additional mechanism to transform its topographic bias.

Neural waves and computation in a neural net model I: Convolutional hierarchies

The computational resources of a neuromorphic network model introduced earlier are investigated in the context of such hierarchical systems as the mammalian visual cortex. It is argued that a form of ubiquitous spontaneous local convolution, driven by spontaneously arising wave-like activity-which itself promotes local Hebbian modulation-enables logical gate-like neural motifs to form into hierarchical feed-forward structures of the Hubel-Wiesel type. Extra-synaptic effects are shown to play a significant rôle in these processes. The type of logic that emerges is not Boolean, confirming and extending earlier findings on the logic of schizophrenia.

Flash Suppression Reveals an Additional Nonvisual Extrastriate Contribution for Amblyopic Suppression

Purpose

A growing body of evidence suggests that anomalous binocular interactions underlie the deficits in amblyopia, but their nature and neural basis are still not fully understood.

Methods

We examined the behavioral and neural correlates of interocular suppression in 13 adult amblyopes and 13 matched controls using a flash suppression paradigm while recording steady-state visual evoked potentials. The strength of suppression was manipulated by changing the contrast (10%, 20%, 30%, or 100%) of the flash stimulus, or the suppressor, presented either in the dominant (fellow) or nondominant (amblyopic) eye.

Results

At the behavioral level, interocular suppression in normal observers was found, regardless of the eye origin of the flash onset. However, the pattern of suppression in the amblyopes was not symmetric, meaning that the suppression from the dominant eye was stronger, supporting a putative chronic suppression of the amblyopic eye. Interestingly, the amblyopic eye was able to suppress the dominant eye but only at the highest contrast level. At the electrophysiology level, suppression of the steady-state visual evoked potential responses in both groups in all conditions was similar over the occipital region, but differed over the frontal region.

Conclusions

Our findings suggest that, although suppression in amblyopia involves an imbalanced interaction between the inputs to the two eyes in the visual cortex, there is also involvement of nonvisual extrastriate areas.

Two Disparity Channels in Human Visual Cortex With Different Contrast and Blur Sensitivity

Purpose

Our goal is to describe the contrast and blur sensitivity of multiple horizontal disparity subsystems and to relate them to the contrast and spatial sensitivities of their monocular inputs.

Methods

Steady-state visual evoked potential (SSVEP) amplitudes were recorded in response to dynamic random dot stereograms (DRDSs) alternating at 2 Hz between zero disparity and varying magnitudes of crossed disparity for disparity plane and disparity grating stimuli. Half-image contrasts ranged between 2.5% and 80% and over a range of Gaussian blurs from 1.4 to 12 arcmin. Separate experiments measured contrast and blur sensitivity for the monocular half-images.

Results

The first and second harmonics disparity responses were maximal for disparity gratings and for the disparity plane condition, respectively. The first harmonic of the disparity grating response was more affected by both contrast and blur than was the second harmonic of the disparity plane response, which had higher contrast sensitivity than the first harmonic.

Conclusions

The corrugation frequency, contrast, and blur tuning of the first harmonic suggest that it reflects activity of neurons tuned to higher luminance spatial frequencies that are selective for relative disparity, whereas the second harmonic reflects the activity of neurons sensitive to absolute disparity that are driven by low monocular spatial frequencies.

Translational Relevance

SSVEPs to DRDSs provide two objective neural measures of disparity processing, the first harmonic-whose stimulus preferences are similar to those of behavioral stereoacuity-and the second harmonic that represents an independent disparity-specific but not necessarily stereoscopic mechanism.

Enhancement of low gamma oscillations by volitional conditioning of local field potential in the primary motor and visual cortex of mice

Volitional control of local field potential oscillations in low gamma band via brain machine interface can not only uncover the relationship between low gamma oscillation and neural synchrony but also suggest a therapeutic potential to reverse abnormal local field potential oscillation in neurocognitive disorders. In nonhuman primates, the volitional control of low gamma oscillations has been demonstrated by brain machine interface techniques in the primary motor and visual cortex. However, it is not clear whether this holds in other brain regions and other species, for which gamma rhythms might involve in highly different neural processes. Here, we established a closed-loop brain-machine interface and succeeded in training mice to volitionally elevate low gamma power of local field potential in the primary motor and visual cortex. We found that the mice accomplished the task in a goal-directed manner and spiking activity exhibited phase-locking to the oscillation in local field potential in both areas. Moreover, long-term training made the power enhancement specific to direct and adjacent channel, and increased the transcriptional levels of NMDA receptors as well as that of hypoxia-inducible factor relevant to metabolism. Our results suggest that volitionally generated low gamma rhythms in different brain regions share similar mechanisms and pave the way for employing brain machine interface in therapy of neurocognitive disorders.

Visual hallucinations induced by Ganzflicker and Ganzfeld differ in frequency, complexity, and content

Visual hallucinations can be phenomenologically divided into those of a simple or complex nature. Both simple and complex hallucinations can occur in pathological and non-pathological states, and can also be induced experimentally by visual stimulation or deprivation-for example using a high-frequency, eyes-open flicker (Ganzflicker) and perceptual deprivation (Ganzfeld). Here we leverage the differences in visual stimulation that these two techniques involve to investigate the role of bottom-up and top-down processes in shifting the complexity of visual hallucinations, and to assess whether these techniques involve a shared underlying hallucinatory mechanism despite their differences. For each technique, we measured the frequency and complexity of the hallucinations produced, utilising button presses, retrospective drawing, interviews, and questionnaires. For both experimental techniques, simple hallucinations were more common than complex hallucinations. Crucially, we found that Ganzflicker was more effective than Ganzfeld at eliciting simple hallucinations, while complex hallucinations remained equivalent across the two conditions. As a result, the likelihood that an experienced hallucination was complex was higher during Ganzfeld. Despite these differences, we found a correlation between the frequency and total time spent hallucinating in Ganzflicker and Ganzfeld conditions, suggesting some shared mechanisms between the two methodologies. We attribute the tendency to experience frequent simple hallucinations in both conditions to a shared low-level core hallucinatory mechanism, such as excitability of visual cortex, potentially amplified in Ganzflicker compared to Ganzfeld due to heightened bottom-up input. The tendency to experience complex hallucinations, in contrast, may be related to top-down processes less affected by visual stimulation.

Involvement of superior colliculus in complex figure detection of mice

Object detection is an essential function of the visual system. Although the visual cortex plays an important role in object detection, the superior colliculus can support detection when the visual cortex is ablated or silenced. Moreover, it has been shown that superficial layers of mouse SC (sSC) encode visual features of complex objects, and that this code is not inherited from the primary visual cortex. This suggests that mouse sSC may provide a significant contribution to complex object vision. Here, we use optogenetics to show that mouse sSC is involved in figure detection based on differences in figure contrast, orientation, and phase. Additionally, our neural recordings show that in mouse sSC, image elements that belong to a figure elicit stronger activity than those same elements when they are part of the background. The discriminability of this neural code is higher for correct trials than for incorrect trials. Our results provide new insight into the behavioral relevance of the visual processing that takes place in sSC.

Sound suppresses earliest visual cortical processing after sight recovery in congenitally blind humans

Neuroscientific research has consistently shown more extensive non-visual activity in the visual cortex of congenitally blind humans compared to sighted controls; a phenomenon known as crossmodal plasticity. Whether or not crossmodal activation of the visual cortex retracts if sight can be restored is still unknown. The present study, involving a rare group of sight-recovery individuals who were born pattern vision blind, employed visual event-related potentials to investigate persisting crossmodal modulation of the initial visual cortical processing stages. Here we report that the earliest, stimulus-driven retinotopic visual cortical activity (<100 ms) was suppressed in a spatially specific manner in sight-recovery individuals when concomitant sounds accompanied visual stimulation. In contrast, sounds did not modulate the earliest visual cortical response in two groups of typically sighted controls, nor in a third control group of sight-recovery individuals who had suffered a transient phase of later (rather than congenital) visual impairment. These results provide strong evidence for persisting crossmodal activity in the visual cortex after sight recovery following a period of congenital visual deprivation. Based on the time course of this modulation, we speculate on a role of exuberant crossmodal thalamic input which may arise during a sensitive phase of brain development.

Category Learning Selectively Enhances Representations of Boundary-Adjacent Exemplars in Early Visual Cortex

Category learning and visual perception are fundamentally interactive processes, such that successful categorization often depends on the ability to make fine visual discriminations between stimuli that vary on continuously valued dimensions. Research suggests that category learning can improve perceptual discrimination along the stimulus dimensions that predict category membership and that these perceptual enhancements are a byproduct of functional plasticity in the visual system. However, the precise mechanisms underlying learning-dependent sensory modulation in categorization are not well understood. We hypothesized that category learning leads to a representational sharpening of underlying sensory populations tuned to values at or near the category boundary. Furthermore, such sharpening should occur largely during active learning of new categories. These hypotheses were tested using fMRI and a theoretically constrained model of vision to quantify changes in the shape of orientation representations while human adult subjects learned to categorize physically identical stimuli based on either an orientation rule (N = 12) or an orthogonal spatial frequency rule (N = 13). Consistent with our predictions, modeling results revealed relatively enhanced reconstructed representations of stimulus orientation in visual cortex (V1-V3) only for orientation rule learners. Moreover, these reconstructed representations varied as a function of distance from the category boundary, such that representations for challenging stimuli near the boundary were significantly sharper than those for stimuli at the category centers. These results support an efficient model of plasticity wherein only the sensory populations tuned to the most behaviorally relevant regions of feature space are enhanced during category learning.

Pathway-selective optogenetics reveals the functional anatomy of top-down attentional modulation in the macaque visual cortex

Spatial attention represents a powerful top-down influence on sensory responses in primate visual cortical areas. The frontal eye field (FEF) has emerged as a key candidate area for the source of this modulation. However, it is unclear whether the FEF exerts its effects via its direct axonal projections to visual areas or indirectly through other brain areas and whether the FEF affects both the enhancement of attended and the suppression of unattended sensory responses. We used pathway-selective optogenetics in rhesus macaques performing a spatial attention task to inhibit the direct input from the FEF to area MT, an area along the dorsal visual pathway specialized for the processing of visual motion information. Our results show that the optogenetic inhibition of the FEF input specifically reduces attentional modulation in MT by about a third without affecting the neurons' sensory response component. We find that the direct FEF-to-MT pathway contributes to both the enhanced processing of target stimuli and the suppression of distractors. The FEF, thus, selectively modulates firing rates in visual area MT, and it does so via its direct axonal projections.

Experience shapes chandelier cell function and structure in the visual cortex

Detailed characterization of interneuron types in primary visual cortex (V1) has greatly contributed to understanding visual perception, yet the role of chandelier cells (ChCs) in visual processing remains poorly characterized. Using viral tracing we found that V1 ChCs predominantly receive monosynaptic input from local layer 5 pyramidal cells and higher-order cortical regions. Two-photon calcium imaging and convolutional neural network modeling revealed that ChCs are visually responsive but weakly selective for stimulus content. In mice running in a virtual tunnel, ChCs respond strongly to events known to elicit arousal, including locomotion and visuomotor mismatch. Repeated exposure of the mice to the virtual tunnel was accompanied by reduced visual responses of ChCs and structural plasticity of ChC boutons and axon initial segment length. Finally, ChCs only weakly inhibited pyramidal cells. These findings suggest that ChCs provide an arousal-related signal to layer 2/3 pyramidal cells that may modulate their activity and/or gate plasticity of their axon initial segments during behaviorally relevant events.

Asymmetric stimulus representations bias visual perceptual learning

The primate visual cortex contains various regions that exhibit specialization for different stimulus properties, such as motion, shape, and color. Within each region, there is often further specialization, such that particular stimulus features, such as horizontal and vertical orientations, are over-represented. These asymmetries are associated with well-known perceptual biases, but little is known about how they influence visual learning. Most theories would predict that learning is optimal, in the sense that it is unaffected by these asymmetries. However, other approaches to learning would result in specific patterns of perceptual biases. To distinguish between these possibilities, we trained human observers to discriminate between expanding and contracting motion patterns, which have a highly asymmetrical representation in the visual cortex. Observers exhibited biased percepts of these stimuli, and these biases were affected by training in ways that were often suboptimal. We simulated different neural network models and found that a learning rule that involved only adjustments to decision criteria, rather than connection weights, could account for our data. These results suggest that cortical asymmetries influence visual perception and that human observers often rely on suboptimal strategies for learning.

Visual Neuroprosthesis - Stimulation of Visual Cortical Centers in The Brain. Design of Non-Invasive Transcranial Stimulation of Functional Neurons

PURPOSE

The purpose of the article is to present the history and current status of visual cortical neuroprostheses, and to present a new method of stimulating intact visual cortex cells.

METHODS

This paper contains an overview of the history and current status of visual cortex stimulation in severe visual impairment, but also highlights its shortcomings. These include mainly the stimulation of currently damaged cortical cells over a small area and, from a morphological point of view, possible damage to the stimulated neurons by the electrodes and their encapsulation by gliotic tissue.

RESULTS

The paper also presents a proposal for a new technology of image processing and its transformation into a form of non-invasive transcranial stimulation of undamaged parts of the brain, which is protected by a national and international patent.

CONCLUSION

The paper presents a comprehensive review of the current options for compensating for lost vision at the level of the cerebral cortex and a proposal for a new non-invasive method of stimulating the functional neurons of the visual cortex.

Pupil-linked arousal correlates with neural activity prior to sensorimotor decisions

Objective.Sensorimotor decisions require the brain to process external information and combine it with relevant knowledge prior to actions. In this study, we explore the neural predictors of motor actions in a novel, realistic driving task designed to study decisions while driving.Approach.Through a spatiospectral assessment of functional connectivity during the premotor period, we identified the organization of visual cortex regions of interest into a distinct scene processing network. Additionally, we identified a motor action selection network characterized by coherence between the anterior cingulate cortex (ACC) and dorsolateral prefrontal cortex (DLPFC).Main results.We show that steering behavior can be predicted from oscillatory power in the visual cortex, DLPFC, and ACC. Power during the premotor periods (specific to the theta and beta bands) correlates with pupil-linked arousal and saccade duration.Significance.We interpret our findings in the context of network-level correlations with saccade-related behavior and show that the DLPFC is a key node in arousal circuitry and in sensorimotor decisions.

Serial attentional resource allocation during parallel feature value tracking

The visual system has evolved the ability to track features like color and orientation in parallel. This property aligns with the specialization of processing these feature dimensions in the visual cortex. But what if we ask to track changing feature-values within the same feature dimension? Parallel tracking would then have to share the same cortical representation, which would set strong limitations on tracking performance. We address this question by measuring the precision of color representations when human observers track the color of two superimposed dot clouds that simultaneously change color along independent trajectories in color-space. We find that tracking precision is highly imbalanced between streams and that tracking precision changes over time by alternating between streams at a rate of ~1 Hz. These observations suggest that, while parallel color tracking is possible, it is highly limited, essentially allowing for only one color-stream to be tracked with precision at a given time.

There is a fundamental, unbridgeable gap between DNNs and the visual cortex

Deep neural networks (DNNs) are not just inadequate models of the visual system but are so different in their structure and functionality that they are not even on the same playing field. DNN units have almost nothing in common with neurons, and, unlike visual neurons, they are often fully connected. At best, DNNs can label inputs, while our object perception is both holistic and detail preserving. A feat that no computational system can achieve.

Hierarchical organization of social action features along the lateral visual pathway

Recent theoretical work has argued that in addition to the classical ventral (what) and dorsal (where/how) visual streams, there is a third visual stream on the lateral surface of the brain specialized for processing social information. Like visual representations in the ventral and dorsal streams, representations in the lateral stream are thought to be hierarchically organized. However, no prior studies have comprehensively investigated the organization of naturalistic, social visual content in the lateral stream. To address this question, we curated a naturalistic stimulus set of 250 3-s videos of two people engaged in everyday actions. Each clip was richly annotated for its low-level visual features, mid-level scene and object properties, visual social primitives (including the distance between people and the extent to which they were facing), and high-level information about social interactions and affective content. Using a condition-rich fMRI experiment and a within-subject encoding model approach, we found that low-level visual features are represented in early visual cortex (EVC) and middle temporal (MT) area, mid-level visual social features in extrastriate body area (EBA) and lateral occipital complex (LOC), and high-level social interaction information along the superior temporal sulcus (STS). Communicative interactions, in particular, explained unique variance in regions of the STS after accounting for variance explained by all other labeled features. Taken together, these results provide support for representation of increasingly abstract social visual content-consistent with hierarchical organization-along the lateral visual stream and suggest that recognizing communicative actions may be a key computational goal of the lateral visual pathway.

Contributed Session III: Active vision shapes ocular dominance

Ocular dominance is a basic visual property that shows short-term plasticity in adult humans, where 2h of monocular deprivation leads to a homeostatic shift of ocular dominance in favour of the deprived eye. Using an altered reality setting, we found that this homeostatic plasticity can be triggered without depriving one eye of visual input, but merely perturbing the temporal correspondence between voluntary actions and vision in one eye. Participants wore a VR set; its monocular screens were connected with cameras monitoring the front space, which participants used to perform a complex visuomotor task. During a 60 minute period, the input to the dominant eye was delayed by 333 ms, making it useless for visuomotor coordination. Following this, ocular dominance (quantified by binocular rivalry) was systematically shifted in favour of the delayed eye, a similar effect as that produced by monocular contrast-deprivation. The shift was only observed when participants actively engaged in the visuomotor task, not when they passively watched a confederate perform the same task. We interpret these results in the light of parallel fMRI experiments where monocular deprivation is associated with a global system reconfiguration that pivots around a key area for sensorimotor integration, the Pulvinar. Based on our findings, we suggest that active vision is foundational to weighting sensory information, even at the level of simple visual processes as those setting ocular dominance.

Visual statistical learning of naturalistic textures

The visual system continuously adapts to the statistical properties of the environment. In this study, we demonstrated that training significantly enhanced subjects' perceptual sensitivity to co-occurrence statistics in naturalistic textures. The learning effect was specific to the statistical component and spatial location. By examining the time course of learning, we found that learning was accelerated at an untrained location. Our findings establish a link between statistical learning and visual perception, indicating multistage plasticity beyond V1 in the visual hierarchy. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Multi-layered maps of neuropil with segmentation-guided contrastive learning

Maps of the nervous system that identify individual cells along with their type, subcellular components and connectivity have the potential to elucidate fundamental organizational principles of neural circuits. Nanometer-resolution imaging of brain tissue provides the necessary raw data, but inferring cellular and subcellular annotation layers is challenging. We present segmentation-guided contrastive learning of representations (SegCLR), a self-supervised machine learning technique that produces representations of cells directly from 3D imagery and segmentations. When applied to volumes of human and mouse cortex, SegCLR enables accurate classification of cellular subcompartments and achieves performance equivalent to a supervised approach while requiring 400-fold fewer labeled examples. SegCLR also enables inference of cell types from fragments as small as 10 μm, which enhances the utility of volumes in which many neurites are truncated at boundaries. Finally, SegCLR enables exploration of layer 5 pyramidal cell subtypes and automated large-scale analysis of synaptic partners in mouse visual cortex.

Bartolomeo Panizza (1785-1867) and his contribution to the discovery of the visual cortex

Bartolomeo Panizza (1785-1867) was an eminent anatomist and a pupil of Antonio Scarpa (1752-1832) at the University of Pavia. In 1855, before the revolutionary studies of Paul Broca (1824-1880) on aphasia that supported the theory of cortical localizations, Panizza delivered a lecture in Milan on the anatomy of the visual system, Osservazioni sul Nervo Ottico ("Observations on the optic nerve"). This lecture contains the first description of the cortical projection of the visual pathways in the occipital lobe, anticipating the revolutionary studies performed by Hermann Munk (1839-1912) in the late 19th century. The findings of Panizza questioned the assumption of the French physiologist, Marie-Jean-Pierre Flourens (1794-1867) who was defending the holistic concept of cerebral equipotentiality, which was widely accepted among the scientific community in the early 19th century. The present essay highlights the life and the scientific studies of Bartolomeo Panizza, with emphasis on the issue of cerebral localization that was simmering in the scientific community at that time.

Behavioral examination of the role of the primary visual cortex in the perceived size representation

Previous research has shown that neural activity in the primary visual cortex (V1) and V1 surface area may be linked with subjective experience of size illusions. Here, we behaviorally measured the hallway illusion with experimental manipulations as a proxy of V1's influence on size perception. We first tested whether the hallway illusion can persist without further recurrent processing by using backward masking. Next, we examined relations among the hallway illusion magnitude and other perceptual measures that have been suggested to be correlated with V1 surface area. In Experiment 1, the magnitude of the hallway illusion was not affected by the stimulus duration and visual masking when the hallway context was previewed (i.e., complex depth information is already processed). It suggests that V1 activity could support the size illusion to some extent even when recurrent processing between V1 and higher areas is disturbed. In Experiment 2, the hallway illusion magnitude was correlated with the Vernier acuity threshold, but not with physical size discriminability. Our results provide converging evidence with the previous findings in that neural activity in V1 may contribute to size illusions and that V1 surface area is not the sole factor that mediates size perception and visual precision.

Repeated passive visual experience modulates spontaneous and non-familiar stimuli-evoked neural activity

Familiarity creates subjective memory of repeated innocuous experiences, reduces neural and behavioral responsiveness to those experiences, and enhances novelty detection. The neural correlates of the internal model of familiarity and the cellular mechanisms of enhanced novelty detection following multi-day repeated passive experience remain elusive. Using the mouse visual cortex as a model system, we test how the repeated passive experience of a 45° orientation-grating stimulus for multiple days alters spontaneous and non-familiar stimuli evoked neural activity in neurons tuned to familiar or non-familiar stimuli. We found that familiarity elicits stimulus competition such that stimulus selectivity reduces in neurons tuned to the familiar 45° stimulus; it increases in those tuned to the 90° stimulus but does not affect neurons tuned to the orthogonal 135° stimulus. Furthermore, neurons tuned to orientations 45° apart from the familiar stimulus dominate local functional connectivity. Interestingly, responsiveness to natural images, which consists of familiar and non-familiar orientations, increases subtly in neurons that exhibit stimulus competition. We also show the similarity between familiar grating stimulus-evoked and spontaneous activity increases, indicative of an internal model of altered experience.

Expectation Cues and False Percepts Generate Stimulus-Specific Activity in Distinct Layers of the Early Visual Cortex

Perception has been proposed to result from the integration of feedforward sensory signals with internally generated feedback signals. Feedback signals are believed to play an important role in driving false percepts, that is, seeing things that are not actually there. Feedforward and feedback influences on perception can be studied using layer-specific fMRI, which we used here to interrogate neural activity underlying high-confidence false percepts while healthy human participants (N = 25, male and female) performed a perceptual orientation discrimination task. Auditory cues implicitly signaled the most likely upcoming orientation (referred to here as expectations). These expectations induced orientation-specific templates in the deep and superficial layers of V2, without affecting perception. In contrast, the orientation of falsely perceived stimuli with high confidence was reflected in the middle input layers of V2, suggesting a feedforward signal contributing to false percepts. The prevalence of high-confidence false percepts was related to everyday hallucination severity in a separate online sample (N = 100), suggesting a possible link with abnormal perceptual experiences. These results reveal a potential feedforward mechanism underlying false percepts, reflected by spontaneous stimulus-like activity in the input layers of the visual cortex, independent of top-down signals reflecting cued orientations.SIGNIFICANCE STATEMENT False percepts have been suggested to arise through excessive feedback signals. However, feedforward contributions to false percepts have remained largely understudied. Laminar fMRI has been shown to be useful in distinguishing feedforward from feedback activity as it allows the imaging of different cortical layers. In the present study we demonstrate that although cued orientations are encoded in the feedback layers of the visual cortex, the content of the false percepts are encoded in the feedforward layers and did not rely on these cued orientations. This shows that false percepts can in principle emerge from random feedforward signals in the visual cortex, with possible implications for disorders hallmarked by hallucinations like schizophrenia and Parkinson's disease.

Early visual experience refines the retinotopic organization within and across visual cortical regions

Early visual areas are retinotopically organized in human and non-human primates. Population receptive field (pRF) size increases with eccentricity and from lower- to higher-level visual areas. Furthermore, the cortical magnification factor (CMF), a measure of how much cortical space is devoted to each degree of visual angle, is typically larger for foveal as opposed to peripheral regions of the visual field. Whether this fine-scale organization within and across visual areas depends on early visual experience has yet been unknown. Here, we employed 7T functional magnetic resonance imaging pRF mapping to assess the retinotopic organization of early visual regions (i.e., V1, V2, and V3) in eight sight recovery individuals with a history of congenital blindness until a maximum of 4 years of age. Compared with sighted controls, foveal pRF sizes in these individuals were larger, and pRF sizes did not show the typical increase with eccentricity and down the visual cortical processing stream (V1-V2-V3). Cortical magnification was overall diminished and decreased less from foveal to parafoveal visual field locations. Furthermore, cortical magnification correlated with visual acuity in sight recovery individuals. The results of this study suggest that early visual experience is essential for refining a presumably innate prototypical retinotopic organization in humans within and across visual areas, which seems to be crucial for acquiring full visual capabilities.

Reconstructing visual illusory experiences from human brain activity

Visual illusions provide valuable insights into the brain's interpretation of the world given sensory inputs. However, the precise manner in which brain activity translates into illusory experiences remains largely unknown. Here, we leverage a brain decoding technique combined with deep neural network (DNN) representations to reconstruct illusory percepts as images from brain activity. The reconstruction model was trained on natural images to establish a link between brain activity and perceptual features and then tested on two types of illusions: illusory lines and neon color spreading. Reconstructions revealed lines and colors consistent with illusory experiences, which varied across the source visual cortical areas. This framework offers a way to materialize subjective experiences, shedding light on the brain's internal representations of the world.

The possible protective role of selenium on the visual cortex of adult albino rat on exposure to potassium dichromate

The visual cortex is very important in mammals for processing of visual information. Exposure to heavy metals such as potassium dichromate poses serious health threat to human beings. The aim of this work is to study the effect of potassium dichromate on the visual cortex of adult albino rat and also to identify the possibility of selenium as protective agent against toxicity of potassium dichromate. A total number of 40 adult albino rats weighting (200-250) gm were used. They divided into four groups: control group, potassium dichromate received group, potassium dichromate and selenium received group and selenium received group. The rats received treatment for 6 weeks. After 6 weeks, they were sacrificed. The present study showed that potassium dichromate causes degeneration of granular neurons in layer IV and pyramidal neurons in layer V. Morphometric results revealed statistically significant decrease in the number of granule and pyramidal cells in potassium dichromate received group as compared with control group. Most of degenerative changes are improved by selenium.

Nodal properties of the resting-state brain functional network in childhood and adolescence

BACKGROUND AND PURPOSE

Changes in the topological properties of brain functional network nodes during childhood and adolescence can provide more detailed and intuitive information on the rules of brain development. This study aims to explore the characteristics of nodal attributes in child and adolescent brain functional networks and analyze the correlation between nodal attributes in different brain regions and age.

METHODS

Forty-two healthy volunteers aged 6-18 years who were right-handed primary and middle school students were recruited, and the subgroup analysis included children (6-12 years, n = 19) and adolescents (13-18 years, n = 23). Resting-state functional magnetic resonance imaging data were collected using a 3.0 Tesla MRI scanner. The topological properties of the functional brain network were analyzed using graph theory.

RESULTS

Compared with the children group, the degree centrality and nodal efficiency of multiple brain regions in the adolescent group were significantly increased, and the nodal shortest path was reduced (q<0.05, false discovery rate corrected). These brain regions were widely distributed in the whole brain and significantly correlated with age. Compared with the children group, reduced degree centralities were observed in the left dorsolateral fusiform gyrus, left rostral cuneus gyrus, and right medial superior occipital gyrus.

CONCLUSION

The transmission efficiency of the brain's core network gradually increased, and the subnetwork function gradually improved in children and adolescents with age. The functional development of each brain area in the occipital visual cortex was uneven and there was functional differentiation within the occipital visual cortex.

Resilience of FEF neuronal saccade code to V4 perturbations

The frontal eye field (FEF) plays a key role in initiating rapid eye movements known as saccades. Accumulation models have been proposed to explain the dynamic of these neurons and how they may enable the initiation of saccades. To update the scope of the viability of this model, we studied single neurons recorded from the FEF of two rhesus monkeys while they performed a memory-guided saccade task. We evaluated the degree to which each type of FEF neuron complied with these models by quantifying how precisely their discharge predicted an imminent saccade based on their immediate presaccadic activity. We found that decoders trained on single neurons with a stronger motor component performed better than decoders trained on neurons with a stronger visual component in predicting the saccade. Importantly, despite a dramatic effect on the reaction times, the perturbations delivered to the FEF neurons via area V4 did not impact their saccade predictability. Our results demonstrate a high degree of resilience of the FEF neuronal presaccadic discharge patterns, fulfilling the predictions of accumulation models.NEW & NOTEWORTHY We studied neurons in the brain's frontal eye field (FEF) to understand how these neurons predict swift eye shifts called saccades. We found that neurons with more movement-related activity were better at predicting saccades than those with sensory-related activity. Interestingly, electrical disruptions of this region strongly impacted saccade onset times but did not affect the individual neuron's saccade predictability, consistent with models suggesting that a specific threshold in neural activity triggers the saccade.

Distinct Patterns of Connectivity between Brain Regions Underlie the Intra-Modal and Cross-Modal Value-Driven Modulations of the Visual Cortex

Past reward associations may be signaled from different sensory modalities; however, it remains unclear how different types of reward-associated stimuli modulate sensory perception. In this human fMRI study (female and male participants), a visual target was simultaneously presented with either an intra- (visual) or a cross-modal (auditory) cue that was previously associated with rewards. We hypothesized that, depending on the sensory modality of the cues, distinct neural mechanisms underlie the value-driven modulation of visual processing. Using a multivariate approach, we confirmed that reward-associated cues enhanced the target representation in early visual areas and identified the brain valuation regions. Then, using an effective connectivity analysis, we tested three possible patterns of connectivity that could underlie the modulation of the visual cortex: a direct pathway from the frontal valuation areas to the visual areas, a mediated pathway through the attention-related areas, and a mediated pathway that additionally involved sensory association areas. We found evidence for the third model demonstrating that the reward-related information in both sensory modalities is communicated across the valuation and attention-related brain regions. Additionally, the superior temporal areas were recruited when reward was cued cross-modally. The strongest dissociation between the intra- and cross-modal reward-driven effects was observed at the level of the feedforward and feedback connections of the visual cortex estimated from the winning model. These results suggest that, in the presence of previously rewarded stimuli from different sensory modalities, a combination of domain-general and domain-specific mechanisms are recruited across the brain to adjust the visual perception.SIGNIFICANCE STATEMENT Reward has a profound effect on perception, but it is not known whether shared or disparate mechanisms underlie the reward-driven effects across sensory modalities. In this human fMRI study, we examined the reward-driven modulation of the visual cortex by visual (intra-modal) and auditory (cross-modal) reward-associated cues. Using a model-based approach to identify the most plausible pattern of inter-regional effective connectivity, we found that higher-order areas involved in the valuation and attentional processing were recruited by both types of rewards. However, the pattern of connectivity between these areas and the early visual cortex was distinct between the intra- and cross-modal rewards. This evidence suggests that, to effectively adapt to the environment, reward signals may recruit both domain-general and domain-specific mechanisms.

Activation of p38 MAPK hinders the reactivation of visual cortical plasticity in adult amblyopic mice

OBJECTIVE

To investigate the impact of p38 mitogen-activated protein kinase (MAPK) signaling on reactivating visual cortical plasticity in adult amblyopic mice.

MATERIALS AND METHODS

Reverse suture (RS), environment enrichment (EE), and combined with left intracerebroventricular injection of p38 MAPK inhibitor (SB203580, SB) or p38 MAPK agonist (dehydrocorydaline hydrochloride, DHC) were utilized to treat adult amblyopic mice with monocular deprivation (MD). The visual water task, visual cliff test, and Flash visual-evoked potential were used to measure the visual function. Then, Golgi staining and transmission electron microscopy were used to assess the reactivation of structural plasticity in adult amblyopic mice. Western blot and immunohistochemistry detected the expression of ATF2, PSD-95, p38 MAPK, and phospho-p38 MAPK in the left visual cortex.

RESULTS

No statistically significant difference was observed in the visual function in each pre-intervention group. Compared to pre-intervention, the visual acuity of deprived eyes was improved significantly, the impairment of visual depth perception was alleviated, and the P wave amplitude and C/I ratio were increased in the EE + RS, the EE + RS + SB, and the EE + RS + DMSO groups, but no significant difference was detected in the EE + RS + DHC group. Compared to EE + RS + DHC group, the density of dendritic spines was significantly higher, the synaptic density of the left visual cortex increased significantly, the length of the active synaptic zone increased, and the thickness of post-synaptic density (PSD) thickened in the left visual cortex of EE + RS, EE + RS + SB, and EE + RS + DMSO groups. And that, the protein expression of p-p38 MAPK increased while that of PSD-95 and ATF2 decreased significantly in the left visual cortex of the EE + RS + DHC group mice.

CONCLUSION

RS and EE intervention improved the visual function and synaptic plasticity of the visual cortex in adult amblyopic mice. However, activating p38 MAPK hinders the recovery of visual function by upregulating the phosphorylation of p38 MAPK and decreasing the ATF2 protein expression.

Neural representation of gestalt grouping and attention effect in human visual cortex

BACKGROUND

The brain aggregates meaningless local sensory elements to form meaningful global patterns in a process called perceptual grouping. Current brain imaging studies have found that neural activities in V1 are modulated during visual grouping. However, how grouping is represented in each of the early visual areas, and how attention alters these representations, is still unknown.

NEW METHOD

We adopted MVPA to decode the specific content of perceptual grouping by comparing neural activity patterns between gratings and dot lattice stimuli which can be grouped with proximity law. Furthermore, we quantified the grouping effect by defining the strength of grouping, and assessed the effect of attention on grouping.

RESULTS

We found that activity patterns to proximity grouped stimuli in early visual areas resemble these to grating stimuli with the same orientations. This similarity exists even when there is no attention focused on the stimuli. The results also showed a progressive increase of representational strength of grouping from V1 to V3, and attention modulation to grouping is only significant in V3 among all the visual areas.

COMPARISON WITH EXISTING METHODS

Most of the previous work on perceptual grouping has focused on how activity amplitudes are modulated by grouping. Using MVPA, the present work successfully decoded the contents of neural activity patterns corresponding to proximity grouping stimuli, thus shed light on the availability of content-decoding approach in the research on perceptual grouping.

CONCLUSIONS

Our work found that the content of the neural activity patterns during perceptual grouping can be decoded in the early visual areas under both attended and unattended task, and provide novel evidence that there is a cascade processing for proximity grouping through V1 to V3. The strength of grouping was larger in V3 than in any other visual areas, and the attention modulation to the strength of grouping was only significant in V3 among all the visual areas, implying that V3 plays an important role in proximity grouping.

Activity in primate visual cortex is minimally driven by spontaneous movements

Organisms process sensory information in the context of their own moving bodies, an idea referred to as embodiment. This idea is important for developmental neuroscience, robotics and systems neuroscience. The mechanisms supporting embodiment are unknown, but a manifestation could be the observation in mice of brain-wide neuromodulation, including in the primary visual cortex, driven by task-irrelevant spontaneous body movements. We tested this hypothesis in macaque monkeys (Macaca mulatta), a primate model for human vision, by simultaneously recording visual cortex activity and facial and body movements. We also sought a direct comparison using an analogous approach to those used in mouse studies. Here we found that activity in the primate visual cortex (V1, V2 and V3/V3A) was associated with the animals' own movements, but this modulation was largely explained by the impact of the movements on the retinal image, that is, by changes in visual input. These results indicate that visual cortex in primates is minimally driven by spontaneous movements and may reflect species-specific sensorimotor strategies.