Increased Visual Stimulation Systematically Decreases Activity in Lateral Intermediate Cortex

Computational assessment of visual coding across mouse brain areas and behavioural states

Introduction

Our brain is bombarded by a diverse range of visual stimuli, which are converted into corresponding neuronal responses and processed throughout the visual system. The neural activity patterns that result from these external stimuli vary depending on the object or scene being observed, but they also change as a result of internal or behavioural states. This raises the question of to what extent it is possible to predict the presented visual stimuli from neural activity across behavioural states, and how this varies in different brain regions.

Methods

To address this question, we assessed the computational capacity of decoders to extract visual information in awake behaving mice, by analysing publicly available standardised datasets from the Allen Brain Institute. We evaluated how natural movie frames can be distinguished based on the activity of units recorded in distinct brain regions and under different behavioural states. This analysis revealed the spectrum of visual information present in different brain regions in response to binary and multiclass classification tasks.

Results

Visual cortical areas showed highest classification accuracies, followed by thalamic and midbrain regions, with hippocampal regions showing close to chance accuracy. In addition, we found that behavioural variability led to a decrease in decoding accuracy, whereby large behavioural changes between train and test sessions reduced the classification performance of the decoders. A generalised linear model analysis suggested that this deterioration in classification might be due to an independent modulation of neural activity by stimulus and behaviour. Finally, we reconstructed the natural movie frames from optimal linear classifiers, and observed a strong similarity between reconstructed and actual movie frames. However, the similarity was significantly higher when the decoders were trained and tested on sessions with similar behavioural states.

Conclusion

Our analysis provides a systematic assessment of visual coding in the mouse brain, and sheds light on the spectrum of visual information present across brain areas and behavioural states.

Two fine-scale channels for encoding motion and stereopsis within the human magnocellular stream

In humans and non-human primates (NHPs), motion and stereopsis are processed within fine-scale cortical sites, including V2 thick stripes and their extensions into areas V3 and V3A that are believed to be under the influence of magnocellular stream. However, in both species, the relative functional organization (overlapping vs. none overlapping) of these sites remains unclear. Using high-resolution functional MRI (fMRI), we found evidence for two minimally-overlapping channels within human extrastriate areas that contribute to processing motion and stereopsis. Across multiple experiments that included different stimuli (random dots, gratings, and natural scenes), the functional selectivity of these channels for motion vs. stereopsis remained consistent. Furthermore, an analysis of resting-state functional connectivity revealed stronger functional connectivity within the two channels rather than between them. This finding provides a new perspective toward the mesoscale organization of the magnocellular stream within the human extrastriate visual cortex, beyond our previous understanding based on animal models.

Topographic signatures of global object perception in human visual cortex

Our visual system readily groups dynamic fragmented input into global objects. How the brain represents global object perception remains however unclear. To address this question, we recorded brain responses using functional magnetic resonance imaging whilst observers viewed a dynamic bistable stimulus that could either be perceived globally (i.e., as a grouped and coherently moving shape) or locally (i.e., as ungrouped and incoherently moving elements). We further estimated population receptive fields and used these to back-project the brain activity measured during stimulus perception into visual space via a searchlight procedure. Global perception resulted in universal suppression of responses in lower visual cortex accompanied by wide-spread enhancement in higher object-sensitive cortex. However, follow-up experiments indicated that higher object-sensitive cortex is suppressed if global perception lacks shape grouping, and that grouping-related suppression can be diffusely confined to stimulated sites and accompanied by background enhancement once stimulus size is reduced. These results speak to a non-generic involvement of higher object-sensitive cortex in perceptual grouping and point to an enhancement-suppression mechanism mediating the perception of figure and ground.

•

Lower visual cortex activity to grouped vs ungrouped dynamic stimuli is suppressed.

•

When grouping a shape, activity in higher object-sensitive cortex is enhanced.

•

Without shape grouping, activity in higher object-sensitive cortex is suppressed.

•

Grouping-related suppression can be diffusely confined to stimulated cortical sites.

Identification of Visual Attentional Regions of the Temporoparietal Junction in Individual Subjects using a Vivid, Novel Oddball Paradigm

The Temporoparietal Junction (TPJ) of the cerebral cortex is a functionally heterogeneous region that also exhibits substantial anatomical variability across individuals. As a result, the precise functional organization of TPJ remains controversial. One or more regions within TPJ support visual attention processes, but the "attention TPJ" is difficult to functionally observe in individual subjects, and thus is typically identified by averaging across a large group of subjects. However, group-averaging also blurs localization and can obscure functional organization. Here, we develop and test an individual-subject approach to identifying attentional TPJ. This paradigm employs novel oddball images with a strong visual drive to produce robust TPJ responses in individuals. Vivid, novel oddballs drive responses in two TPJ regions bilaterally, a posterior region centered in posterior Superior Temporal Sulcus (TPJ_STS) and an anterior region in ventral Supramarginal Gyrus (TPJ_SMG). Although an attentional reorienting task fails to drive TPJ activation in individuals, group analysis of the attentional reorienting contrast reveals recruitment of right TPJ_STS, but not right TPJ_SMG. Similarly, right TPJ_STS, as identified in individual subjects by the vivid, novel oddball contrast, is activated by attentional reorienting, but right TPJ_SMG is not. These findings advance an individual-subject based approach to understanding the functional organization of TPJ.

Impact of Visual Corticostriatal Loop Disruption on Neural Processing within the Parahippocampal Place Area

The caudate nucleus is a part of the visual corticostriatal loop (VCSL), receiving input from different visual areas and projecting back to the same cortical areas via globus pallidus, substantia nigra, and thalamus. Despite perceptual and navigation impairments in patients with VCSL disruption due to caudate atrophy (e.g., Huntington's disease, HD), the relevance of the caudate nucleus and VCSL on cortical visual processing is not fully understood. In a series of fMRI experiments, we found that the caudate showed a stronger functional connection to parahippocampal place area (PPA) compared with adjacent regions (e.g., fusiform face area, FFA) within the temporal visual cortex. Consistent with this functional link, the caudate showed a higher response to scenes compared with faces, similar to the PPA. Testing the impact of VCSL disruption on neural processes within PPA, HD patients showed reduced scene-selective activity within PPA compared with healthy matched controls. In contrast, the level of selective activity in adjacent cortical and subcortical face-selective areas (i.e., FFA and amygdala) remained intact. These results show some of the first evidence for the direct impact and potential clinical significance of VCSL on the generation of "selective" activity within PPA.

SIGNIFICANCE STATEMENT

Visual perception is often considered the product of a multistage feedforward neural processing between visual cortical areas, ignoring the likely impact of corticosubcortical loops on this process. Here, we provide evidence for the contribution of visual corticostriatal loop and the caudate nucleus on generating selective response within parahippocampal place area (PPA). Our results show that disruption of this loop in Huntington's disease patients reduces the level of selective activity within PPA, which may lead to related perceptual impairments in these patients.

Columnar Segregation of Magnocellular and Parvocellular Streams in Human Extrastriate Cortex

Magnocellular versus parvocellular (M-P) streams are fundamental to the organization of macaque visual cortex. Segregated, paired M-P streams extend from retina through LGN into V1. The M stream extends further into area V5/MT, and parts of V2. However, elsewhere in visual cortex, it remains unclear whether M-P-derived information (1) becomes intermixed or (2) remains segregated in M-P-dominated columns and neurons. Here we tested whether M-P streams exist in extrastriate cortical columns, in 8 human subjects (4 female). We acquired high-resolution fMRI at high field (7T), testing for M- and P-influenced columns within each of four cortical areas (V2, V3, V3A, and V4), based on known functional distinctions in M-P streams in macaque: (1) color versus luminance, (2) binocular disparity, (3) luminance contrast sensitivity, (4) peak spatial frequency, and (5) color/spatial interactions. Additional measurements of resting state activity (eyes closed) tested for segregated functional connections between these columns. We found M- and P-like functions and connections within and between segregated cortical columns in V2, V3, and (in most experiments) area V4. Area V3A was dominated by the M stream, without significant influence from the P stream. These results suggest that M-P streams exist, and extend through, specific columns in early/middle stages of human extrastriate cortex.SIGNIFICANCE STATEMENT The magnocellular and parvocellular (M-P) streams are fundamental components of primate visual cortical organization. These streams segregate both anatomical and functional properties in parallel, from retina through primary visual cortex. However, in most higher-order cortical sites, it is unknown whether such M-P streams exist and/or what form those streams would take. Moreover, it is unknown whether M-P streams exist in human cortex. Here, fMRI evidence measured at high field (7T) and high resolution revealed segregated M-P streams in four areas of human extrastriate cortex. These results suggest that M-P information is processed in segregated parallel channels throughout much of human visual cortex; the M-P streams are more than a convenient sorting property in earlier stages of the visual system.

High frequency spectral changes induced by single-pulse electric stimulation: Comparison between physiologic and pathologic networks

OBJECTIVE

To investigate functional coupling between brain networks using spectral changes induced by single-pulse electric stimulation (SPES).

METHOD

We analyzed 20 patients with focal epilepsy, implanted with depth electrodes. SPES was applied to each pair of adjacent contacts, and responses were recorded from all other contacts. The mean response amplitude value was quantified in three time-periods after stimulation (10-60, 60-255, 255-500ms) for three frequency-ranges (Gamma, Ripples, Fast-Ripples), and compared to baseline. A total of 30,755 responses were analyzed, taking into consideration three dichotomous pairs: stimulating in primary sensory areas (S1-V1) vs. outside them, to test the interaction in physiologic networks; stimulating in seizure onset zone (SOZ) vs. non-SOZ, to test pathologic interactions; recording in default mode network (DMN) vs. non-DMN.

RESULTS

Overall, we observed an early excitation (10-60ms) and a delayed inhibition (60-500ms). More specifically, in the delayed period, stimulation in S1-V1 produced a higher gamma-inhibition in the DMN, while stimulation in the SOZ induced a higher inhibition in the epilepsy-related higher frequencies (Ripples and Fast-Ripples).

CONCLUSION

Physiologic and pathologic interactions can be assessed using spectral changes induced by SPES.

SIGNIFICANCE

This is a promising method for connectivity studies in patients with drug-resistant focal epilepsy.

Smooth versus Textured Surfaces: Feature-Based Category Selectivity in Human Visual Cortex

In fMRI studies, human lateral occipital (LO) cortex is thought to respond selectively to images of objects, compared with nonobjects. However, it remains unresolved whether all objects evoke equivalent levels of activity in LO, and, if not, which image features produce stronger activation. Here, we used an unbiased parametric texture model to predict preferred versus nonpreferred stimuli in LO. Observation and psychophysical results showed that predicted preferred stimuli (both objects and nonobjects) had smooth (rather than textured) surfaces. These predictions were confirmed using fMRI, for objects and nonobjects. Similar preferences were also found in the fusiform face area (FFA). Consistent with this: (1) FFA and LO responded more strongly to nonfreckled (smooth) faces, compared with otherwise identical freckled (textured) faces; and (2) strong functional connections were found between LO and FFA. Thus, LO and FFA may be part of an information-processing stream distinguished by feature-based category selectivity (smooth > textured).

On the domain-specificity of the visual and non-visual face-selective regions

What happens in our brains when we see a face? The neural mechanisms of face processing - namely, the face-selective regions - have been extensively explored. Research has traditionally focused on visual cortex face-regions; more recently, the role of face-regions outside the visual cortex (i.e., non-visual-cortex face-regions) has been acknowledged as well. The major quest today is to reveal the functional role of each this region in face processing. To make progress in this direction, it is essential to understand the extent to which the face-regions, and particularly the non-visual-cortex face-regions, process only faces (i.e., face-specific, domain-specific processing) or rather are involved in a more domain-general cognitive processing. In the current functional MRI study, we systematically examined the activity of the whole face-network during face-unrelated reading task (i.e., written meaningful sentences with content unrelated to faces/people and non-words). We found that the non-visual-cortex (i.e., right lateral prefrontal cortex and posterior superior temporal sulcus), but not the visual cortex face-regions, responded significantly stronger to sentences than to non-words. In general, some degree of sentence selectivity was found in all non-visual-cortex cortex. Present result highlights the possibility that the processing in the non-visual-cortex face-selective regions might not be exclusively face-specific, but rather more or even fully domain-general. In this paper, we illustrate how the knowledge about domain-general processing in face-regions can help to advance our general understanding of face processing mechanisms. Our results therefore suggest that the problem of face processing should be approached in the broader scope of cognition in general.

Interdigitated Color- and Disparity-Selective Columns within Human Visual Cortical Areas V2 and V3

In nonhuman primates (NHPs), secondary visual cortex (V2) is composed of repeating columnar stripes, which are evident in histological variations of cytochrome oxidase (CO) levels. Distinctive "thin" and "thick" stripes of dark CO staining reportedly respond selectively to stimulus variations in color and binocular disparity, respectively. Here, we first tested whether similar color-selective or disparity-selective stripes exist in human V2. If so, available evidence predicts that such stripes should (1) radiate "outward" from the V1-V2 border, (2) interdigitate, (3) differ from each other in both thickness and length, (4) be spaced ∼3.5-4 mm apart (center-to-center), and, perhaps, (5) have segregated functional connections. Second, we tested whether analogous segregated columns exist in a "next-higher" tier area, V3. To answer these questions, we used high-resolution fMRI (1 × 1 × 1 mm(3)) at high field (7 T), presenting color-selective or disparity-selective stimuli, plus extensive signal averaging across multiple scan sessions and cortical surface-based analysis. All hypotheses were confirmed. V2 stripes and V3 columns were reliably localized in all subjects. The two stripe/column types were largely interdigitated (e.g., nonoverlapping) in both V2 and V3. Color-selective stripes differed from disparity-selective stripes in both width (thickness) and length. Analysis of resting-state functional connections (eyes closed) showed a stronger correlation between functionally alike (compared with functionally unlike) stripes/columns in V2 and V3. These results revealed a fine-scale segregation of color-selective or disparity-selective streams within human areas V2 and V3. Together with prior evidence from NHPs, this suggests that two parallel processing streams extend from visual subcortical regions through V1, V2, and V3.

SIGNIFICANCE STATEMENT

In current textbooks and reviews, diagrams of cortical visual processing highlight two distinct neural-processing streams within the first and second cortical areas in monkeys. Two major streams consist of segregated cortical columns that are selectively activated by either color or ocular interactions. Because such cortical columns are so small, they were not revealed previously by conventional imaging techniques in humans. Here we demonstrate that such segregated columnar systems exist in humans. We find that, in humans, color versus binocular disparity columns extend one full area further, into the third visual area. Our approach can be extended to reveal and study additional types of columns in human cortex, perhaps including columns underlying more cognitive functions.

The occipital place area represents the local elements of scenes

Neuroimaging studies have identified three scene-selective regions in human cortex: parahippocampal place area (PPA), retrosplenial complex (RSC), and occipital place area (OPA). However, precisely what scene information each region represents is not clear, especially for the least studied, more posterior OPA. Here we hypothesized that OPA represents local elements of scenes within two independent, yet complementary scene descriptors: spatial boundary (i.e., the layout of external surfaces) and scene content (e.g., internal objects). If OPA processes the local elements of spatial boundary information, then it should respond to these local elements (e.g., walls) themselves, regardless of their spatial arrangement. Indeed, we found that OPA, but not PPA or RSC, responded similarly to images of intact rooms and these same rooms in which the surfaces were fractured and rearranged, disrupting the spatial boundary. Next, if OPA represents the local elements of scene content information, then it should respond more when more such local elements (e.g., furniture) are present. Indeed, we found that OPA, but not PPA or RSC, responded more to multiple than single pieces of furniture. Taken together, these findings reveal that OPA analyzes local scene elements - both in spatial boundary and scene content representation - while PPA and RSC represent global scene properties.