Interactions between feedback and lateral connections in the primary visual cortex

Dependence of Contextual Modulation in Macaque V1 on Interlaminar Signal Flow

In visual cortex, neural correlates of subjective perception can be generated by modulation of activity from beyond the classical receptive field (CRF). In macaque V1, activity generated by nonclassical receptive field (nCRF) stimulation involves different intracortical circuitry than activity generated by CRF stimulation, suggesting that interactions between neurons across V1 layers differ under CRF and nCRF stimulus conditions. We measured border ownership modulation within large populations of V1 neurons. We found that neurons in single columns preferred the same side of objects located outside of the CRF. In addition, we found that interactions between pairs of neurons situated across feedback/horizontal and input layers differed between CRF and nCRF stimulation. Furthermore, the magnitude of border ownership modulation was predicted by greater information flow from feedback/horizontal to input layers. These results demonstrate that the flow of signals between layers covaries with the degree to which neurons integrate information from beyond the CRF.

Modular horizontal network within mouse primary visual cortex

Interactions between feedback connections from higher cortical areas and local horizontal connections within primary visual cortex (V1) were shown to play a role in contextual processing in different behavioral states. Layer 1 (L1) is an important part of the underlying network. This cell-sparse layer is a target of feedback and local inputs, and nexus for contacts onto apical dendrites of projection neurons in the layers below. Importantly, L1 is a site for coupling inputs from the outside world with internal information. To determine whether all of these circuit elements overlap in L1, we labeled the horizontal network within mouse V1 with anterograde and retrograde viral tracers. We found two types of local horizontal connections: short ones that were tangentially limited to the representation of the point image, and long ones which reached beyond the receptive field center, deep into its surround. The long connections were patchy and terminated preferentially in M2 muscarinic acetylcholine receptor-negative (M2-) interpatches. Anterogradely labeled inputs overlapped in M2-interpatches with apical dendrites of retrogradely labeled L2/3 and L5 cells, forming module-selective loops between topographically distant locations. Previous work showed that L1 of M2-interpatches receive inputs from the lateral posterior thalamic nucleus (LP) and from a feedback network from areas of the medial dorsal stream, including the secondary motor cortex. Together, these findings suggest that interactions in M2-interpatches play a role in processing visual inputs produced by object-and self-motion.

Paying attention to natural scenes in area V1

Natural scene responses in the primary visual cortex are modulated simultaneously by attention and by contextual signals about scene statistics stored across the connectivity of the visual processing hierarchy. We hypothesized that attentional and contextual signals interact in V1 in a manner that primarily benefits the representation of natural stimuli, rich in high-order statistical structure. Recording from two macaques engaged in a spatial attention task, we found that attention enhanced the decodability of stimulus identity from population responses evoked by natural scenes, but not by synthetic stimuli lacking higher-order statistical regularities. Population analysis revealed that neuronal responses converged to a low-dimensional subspace only for natural stimuli. Critically, we determined that the attentional enhancement in stimulus decodability was captured by the natural-scene subspace, indicating an alignment between the attentional and natural stimulus variance. These results suggest that attentional and contextual signals interact in V1 in a manner optimized for natural vision.

A CODE model bridging crowding in sparse and dense displays

Visual crowding is arguably the strongest limitation imposed on extrafoveal vision, and is a relatively well-understood phenomenon. However, most investigations and theories are based on sparse displays consisting of a target and at most a handful of flanker objects. Recent findings suggest that the laws thought to govern crowding may not hold for densely cluttered displays, and that grouping and nearest neighbour effects may be more important. Here we present a computational model that accounts for crowding effects in both sparse and dense displays. The model is an adaptation and extension of an earlier model that has previously successfully accounted for spatial clustering, numerosity and object-based attention phenomena. Our model combines grouping by proximity and similarity with a nearest neighbour rule, and defines crowding as the extent to which target and flankers fail to segment. We show that when the model is optimized for explaining crowding phenomena in classic, sparse displays, it also does a good job in capturing novel crowding patterns in dense displays, in both existing and new data sets. The model thus ties together different principles governing crowding, specifically Bouma's law, grouping, and nearest neighbour similarity effects.

Involvement of superior colliculus in complex figure detection of mice

Object detection is an essential function of the visual system. Although the visual cortex plays an important role in object detection, the superior colliculus can support detection when the visual cortex is ablated or silenced. Moreover, it has been shown that superficial layers of mouse SC (sSC) encode visual features of complex objects, and that this code is not inherited from the primary visual cortex. This suggests that mouse sSC may provide a significant contribution to complex object vision. Here, we use optogenetics to show that mouse sSC is involved in figure detection based on differences in figure contrast, orientation, and phase. Additionally, our neural recordings show that in mouse sSC, image elements that belong to a figure elicit stronger activity than those same elements when they are part of the background. The discriminability of this neural code is higher for correct trials than for incorrect trials. Our results provide new insight into the behavioral relevance of the visual processing that takes place in sSC.

Modeling the Role of Contour Integration in Visual Inference

Under difficult viewing conditions, the brain's visual system uses a variety of recurrent modulatory mechanisms to augment feedforward processing. One resulting phenomenon is contour integration, which occurs in the primary visual (V1) cortex and strengthens neural responses to edges if they belong to a larger smooth contour. Computational models have contributed to an understanding of the circuit mechanisms of contour integration, but less is known about its role in visual perception. To address this gap, we embedded a biologically grounded model of contour integration in a task-driven artificial neural network and trained it using a gradient-descent variant. We used this model to explore how brain-like contour integration may be optimized for high-level visual objectives as well as its potential roles in perception. When the model was trained to detect contours in a background of random edges, a task commonly used to examine contour integration in the brain, it closely mirrored the brain in terms of behavior, neural responses, and lateral connection patterns. When trained on natural images, the model enhanced weaker contours and distinguished whether two points lay on the same versus different contours. The model learned robust features that generalized well to out-of-training-distribution stimuli. Surprisingly, and in contrast with the synthetic task, a parameter-matched control network without recurrence performed the same as or better than the model on the natural-image tasks. Thus, a contour integration mechanism is not essential to perform these more naturalistic contour-related tasks. Finally, the best performance in all tasks was achieved by a modified contour integration model that did not distinguish between excitatory and inhibitory neurons.

Influences of local and global context on local orientation perception

Visual context modulates perception of local orientation attributes. These spatially very localised effects are considered to correspond to specific excitatory-inhibitory connectivity patterns of early visual areas as V1, creating perceptual tilt repulsion and attraction effects. Here, orientation misperception of small Gabor stimuli was used as a probe of this computational structure by sampling a large spatio-orientation space to reveal expected asymmetries due to the underlying neuronal processing. Surprisingly, the results showed a regular iso-orientation pattern of nearby location effects whose reference point was globally modulated by the spatial structure, without any complex interactions between local positions and orientation. This pattern of results was confirmed by the two perceptual parameters of bias and discrimination ability. Furthermore, the response times to stimulus configuration displayed variations that further provided evidence of how multiple early visual stages affect perception of simple stimuli.

Contour integration deficits at high spatial frequencies in children treated for anisometropic amblyopia

Purpose

This study was conducted to reexamine the question of whether children treated for anisometropic amblyopia have contour integration deficits. To do so, we used psychophysical methods that require global contour processing while minimizing the influence of low-level deficits: visibility, shape perception, and positional uncertainty.

Methods

Thirteen children with anisometropic amblyopia (age: 10.1 ± 1.8 years) and thirteen visually normal children (age: 10.8 ± 2.0 years) participated in this study. The stimuli were closed figures made up of Gabor patches either in noise or on a blank field. The contrast thresholds to detect a circular contour on a blank field, as well as the thresholds of aspect ratio and contour element number to discriminate a circular or elliptical contour in noise, were measured at Gabor spatial frequencies of 1.5, 3, and 6 cpd for amblyopic eyes (AEs), fellow eyes (FEs), and normal control eyes. Visual acuities and contrast sensitivity functions for AEs and FEs and the Randot stereoacuity were measured before testing.

Results

The AEs showed contrast deficits and degraded shape perception compared to the FEs at higher spatial frequencies (6 cpd). When the influence of abnormal contrast sensitivity and shape perception were minimized, the AEs showed contour integration deficits at spatial frequencies 3 and 6 cpd. These deficits were not related to basic losses in contrast sensitivity and acuity, stereoacuity, and visual crowding. Besides, no significant difference was found between the fellow eyes of the amblyopic children and the normal control eyes in the performance of contour integration.

Conclusion

After eliminating or compensating for the low-level deficits, children treated for anisometropic amblyopia still show contour integration deficits, primarily at higher spatial frequencies, which might reflect the deficits in global processing caused by amblyopia. Contour integration deficits are likely independent of spatial vision deficits. Refractive correction and/or occlusion therapies may not be sufficient to fully restore contour integration deficits, which indicates the need for the development of clinical treatments to recover these deficits.

Spatial Attention Modulates Neuronal Interactions between Simple and Complex Cells in V1

Visual perception is profoundly modulated by spatial attention, which can selectively prioritize goal-related information. Previous studies found spatial attention facilitated the efficacy of neuronal communication between visual cortices with hierarchical organizations. In the primary visual cortex (V1), there is also a hierarchical connection between simple (S) and complex (C) cells. We wonder whether and how spatial attention modulates neuronal communication within V1, especially for neuronal pairs with heterogeneous visual input. We simultaneously recorded the pairs' activity from macaque monkeys when they performed a spatial-attention-involved task, then applied likelihood-based Granger causality analysis to explore attentional modulation of neuronal interactions. First, a significant attention-related decrease in Granger causality was found in S-C pairs, which primarily displayed in the S-to-C feedforward connection. Second, the interaction strength of the feedforward connection was significantly higher than that of the feedback under attend toward (AT) conditions. Although information flow did not alter as the attentional focus shifted, the strength of communications between target- and distractor-stimuli-covered neurons differed only when attending to complex cells' receptive fields (RFs). Furthermore, pairs' communications depended on the attentional modulation of neurons' firing rates. Our findings demonstrate spatial attention does not induce specific information flow but rather amplifies directed communication within V1.

Cortico-cortical feedback engages active dendrites in visual cortex

Sensory processing in the neocortex requires both feedforward and feedback information flow between cortical areas¹. In feedback processing, higher-level representations provide contextual information to lower levels, and facilitate perceptual functions such as contour integration and figure-ground segmentation^2,3. However, we have limited understanding of the circuit and cellular mechanisms that mediate feedback influence. Here we use long-range all-optical connectivity mapping in mice to show that feedback influence from the lateromedial higher visual area (LM) to the primary visual cortex (V1) is spatially organized. When the source and target of feedback represent the same area of visual space, feedback is relatively suppressive. By contrast, when the source is offset from the target in visual space, feedback is relatively facilitating. Two-photon calcium imaging data show that this facilitating feedback is nonlinearly integrated in the apical tuft dendrites of V1 pyramidal neurons: retinotopically offset (surround) visual stimuli drive local dendritic calcium signals indicative of regenerative events, and two-photon optogenetic activation of LM neurons projecting to identified feedback-recipient spines in V1 can drive similar branch-specific local calcium signals. Our results show how neocortical feedback connectivity and nonlinear dendritic integration can together form a substrate to support both predictive and cooperative contextual interactions.

Attention along the cortical hierarchy: Development matters

We build on the existing biased competition view to argue that attention is an emergent property of neural computations within and across hierarchically embedded and structurally connected cortical pathways. Critically then, one must ask, what is attention emergent from? Within this framework, developmental changes in the quality of sensory input and feedforward-feedback information flow shape the emergence and efficiency of attention. Several gradients of developing structural and functional cortical architecture across the caudal-to-rostral axis provide the substrate for attention to emerge. Neural activity within visual areas depends on neuronal density, receptive field size, tuning properties of neurons, and the location of and competition between features and objects in the visual field. These visual cortical properties highlight the information processing bottleneck attention needs to resolve. Recurrent feedforward and feedback connections convey sensory information through a series of steps at each level of the cortical hierarchy, integrating sensory information across the entire extent of the cortical hierarchy and linking sensory processing to higher-order brain regions. Higher-order regions concurrently provide input conveying behavioral context and goals. Thus, attention reflects the output of a series of complex biased competition neural computations that occur within and across hierarchically embedded cortical regions. Cortical development proceeds along the caudal-to-rostral axis, mirroring the flow in sensory information from caudal to rostral regions, and visual processing continues to develop into childhood. Examining both typical and atypical development will offer critical mechanistic insight not otherwise available in the adult stable state. This article is categorized under: Psychology > Attention.

Where is the error? Hierarchical predictive coding through dendritic error computation

Top-down feedback in cortex is critical for guiding sensory processing, which has prominently been formalized in the theory of hierarchical predictive coding (hPC). However, experimental evidence for error units, which are central to the theory, is inconclusive and it remains unclear how hPC can be implemented with spiking neurons. To address this, we connect hPC to existing work on efficient coding in balanced networks with lateral inhibition and predictive computation at apical dendrites. Together, this work points to an efficient implementation of hPC with spiking neurons, where prediction errors are computed not in separate units, but locally in dendritic compartments. We then discuss the correspondence of this model to experimentally observed connectivity patterns, plasticity, and dynamics in cortex.

Neural regeneration therapy after spinal cord injury induces unique brain functional reorganizations in rhesus monkeys

PURPOSE

Spinal cord injury (SCI) destroys the sensorimotor pathway and induces brain plasticity. However, the effect of treatment-induced spinal cord tissue regeneration on brain functional reorganization remains unclear. This study was designed to investigate the large-scale functional interactions in the brains of adult female Rhesus monkeys with injured and regenerated thoracic spinal cord.

MATERIALS AND METHODS

Resting-state functional magnetic resonance imaging (fMRI) combined with Granger Causality analysis (GCA) and motor behaviour analysis were used to assess the causal interaction between sensorimotor cortices, and calculate the relationship between causal interaction and hindlimb stepping in nine Rhesus monkeys undergoing lesion-induced spontaneous recovery (injured, n = 4) and neurotrophin-3/chitosan transplantation-induced regeneration (NT3-chitosan, n = 5) after SCI.

RESULTS

The results showed that the injured and NT3-chitosan-treated animals had distinct spatiotemporal features of brain functional reorganization. The spontaneous recovery followed the model of "early intra-hemispheric reorganization dominant, late inter-hemispheric reorganization dominant", whereas regenerative therapy animals showed the opposite trend. Although the variation degree of information flow intensity was consistent, the tendency and the relationship between local neuronal activity properties and coupling strength were different between the two groups. In addition, the injured and NT3-chitosan-treated animals had similar motor adjustments but various relationship modes between motor performance and information flow intensity.

CONCLUSIONS

Our findings show that brain functional reorganization induced by regeneration therapy differed from spontaneous recovery after SCI. The influence of unique changes in brain plasticity on the therapeutic effects of future regeneration therapy strategies should be considered. Key messagesNeural regeneration elicited a unique spatiotemporal mode of brain functional reorganization in the spinal cord injured monkeys, and that regeneration does not simply reverse the process of brain plasticity induced by spinal cord injury (SCI).Independent "properties of local activity - intensity of information flow" relationships between the injured and treated animals indicating that spontaneous recovery and regenerative therapy exerted different effects on the reorganization of the motor network after SCI.A specific information flow from the left thalamus to the right insular can serve as an indicator to reflect a heterogeneous "information flow - motor performance" relationship between injured and treated animals at similar motor adjustments.

The spatial properties of adaptation-induced distance compression

Exposure to a dynamic texture reduces the perceived separation between objects, altering the mapping between physical relations in the environment and their neural representations. Here we investigated the spatial tuning and spatial frame of reference of this aftereffect to understand the stage(s) of processing where adaptation-induced changes occur. In Experiment 1, we measured apparent separation at different positions relative to the adapted area, revealing a strong but tightly tuned compression effect. We next tested the spatial frame of reference of the effect, either by introducing a gaze shift between adaptation and test phase (Experiment 2) or by decoupling the spatial selectivity of adaptation in retinotopic and world-centered coordinates (Experiment 3). Results across the two experiments indicated that both retinotopic and world-centered adaptation effects can occur independently. Spatial attention to the location of the adaptor alone could not account for the world-centered transfer we observed, and retinotopic adaptation did not transfer to world-centered coordinates after a saccade (Experiment 4). Finally, we found that aftereffects in different reference frames have a similar, narrow spatial tuning profile (Experiment 5). Together, our results suggest that the neural representation of local separation resides early in the visual cortex, but it can also be modulated by activity in higher visual areas.

From remembering to reconstruction: The transformative neural representation of episodic memory

Although memory has long been recognized as a generative process, neural research of memory in recent decades has been predominantly influenced by Tulving's "mental time traveling" perspective and focused on the reactivation and consolidation of encoded memory representations. With the development of multiple powerful analytical approaches to characterize the contents and formats of neural representations, recent studies are able to provide detailed examinations of the representations at various processing stages and have provided exciting new insights into the transformative nature of episodic memory. These studies have revealed the rapid, substantial, and continuous transformation of memory representation during the encoding, maintenance, consolidation, and retrieval of both single and multiple events, as well as event sequences. These transformations are characterized by the abstraction, integration, differentiation, and reorganization of memory representations, enabling the long-term retention and generalization of memory. These studies mark a significant shift in perspective from remembering to reconstruction, which might better reveal the nature of memory and its roles in supporting more effective learning, adaptive decision-making, and creative problem solving.

Spatial Attention Modulates Spike Count Correlations and Granger Causality in the Primary Visual Cortex

The influence of spatial attention on neural interactions has been revealed even in early visual information processing stages. It resolves the process of competing for sensory information about objects perceived as targets and distractors. However, the attentional modulation of the interaction between pairs of neurons with non-overlapping receptive fields (RFs) is not well known. Here, we investigated the activity of anatomically distant neurons in two behaving monkeys’ primary visual cortex (V1), when they performed a spatial attention task detecting color change. We compared attentional modulation from the perspective of spike count correlations and Granger causality among simple and complex cells. An attention-related increase in spike count correlations and a decrease in Granger causality were found. The results showed that spatial attention significantly influenced only the interactions between rather than within simple and complex cells. Furthermore, we found that the attentional modulation of neuronal interactions changed with neuronal pairs’ preferred directions differences. Thus, we found that spatial attention increased the functional communications and competing connectivities when attending to the neurons’ RFs, which impacts the interactions only between simple and complex cells. Our findings enrich the model of simple and complex cells and further understand the way that attention influences the neurons’ activities.

Visual illusion susceptibility in autism: A neural model

While atypical sensory perception is reported among individuals with autism spectrum disorder (ASD), the underlying neural mechanisms of autism that give rise to disruptions in sensory perception remain unclear. We developed a neural model with key physiological, functional and neuroanatomical parameters to investigate mechanisms underlying the range of representations of visual illusions related to orientation perception in typically developed subjects compared to individuals with ASD. Our results showed that two theorized autistic traits, excitation/inhibition imbalance and weakening of top‐down modulation, could be potential candidates for reduced susceptibility to some visual illusions. Parametric correlation between cortical suppression, balance of excitation/inhibition, feedback from higher visual areas on one hand and susceptibility to a class of visual illusions related to orientation perception on the other hand provide the opportunity to investigate the contribution and complex interactions of distinct sensory processing mechanisms in ASD. The novel approach used in this study can be used to link behavioural, functional and neuropathological studies; estimate and predict perceptual and cognitive heterogeneity in ASD; and form a basis for the development of novel diagnostics and therapeutics.

The neural coding framework for learning generative models

Neural generative models can be used to learn complex probability distributions from data, to sample from them, and to produce probability density estimates. We propose a computational framework for developing neural generative models inspired by the theory of predictive processing in the brain. According to predictive processing theory, the neurons in the brain form a hierarchy in which neurons in one level form expectations about sensory inputs from another level. These neurons update their local models based on differences between their expectations and the observed signals. In a similar way, artificial neurons in our generative models predict what neighboring neurons will do, and adjust their parameters based on how well the predictions matched reality. In this work, we show that the neural generative models learned within our framework perform well in practice across several benchmark datasets and metrics and either remain competitive with or significantly outperform other generative models with similar functionality (such as the variational auto-encoder).

The Global Configuration of Visual Stimuli Alters Co-Fluctuations of Cross-Hemispheric Human Brain Activity

We tested how a stimulus gestalt, defined by the neuronal interaction between local and global features of a stimulus, is represented within human primary visual cortex (V1). We used high-resolution fMRI, which serves as a surrogate of neuronal activation, to measure co-fluctuations within subregions of V1 as (male and female) subjects were presented with peripheral stimuli, each with different global configurations. We found stronger cross-hemisphere correlations when fine-scale V1 cortical subregions represented parts of the same object compared with different objects. This result was consistent with the vertical bias in global processing and, critically, was independent of the task and local discontinuities within objects. Thus, despite the relatively small receptive fields of neurons within V1, global stimulus configuration affects neuronal processing via correlated fluctuations between regions that represent different sectors of the visual field.SIGNIFICANCE STATEMENT We provide the first evidence for the impact of global stimulus configuration on cross-hemispheric fMRI fluctuations, measured in human primary visual cortex. Our results are consistent with changes in the level of γ-band synchrony, which has been shown to be affected by global stimulus configuration, being reflected in the level fMRI co-fluctuations. These data help narrow the gap between knowledge of global stimulus configuration encoding at the single-neuron level versus at the behavioral level.

Neurophysiological considerations for visual implants

Neural implants have the potential to restore visual capabilities in blind individuals by electrically stimulating the neurons of the visual system. This stimulation can produce visual percepts known as phosphenes. The ideal location of electrical stimulation for achieving vision restoration is widely debated and dependent on the physiological properties of the targeted tissue. Here, the neurophysiology of several potential target structures within the visual system will be explored regarding their benefits and downfalls in producing phosphenes. These regions will include the lateral geniculate nucleus, primary visual cortex, visual area 2, visual area 3, visual area 4 and the middle temporal area. Based on the existing engineering limitations of neural prostheses, we anticipate that electrical stimulation of any singular brain region will be incapable of achieving high-resolution naturalistic perception including color, texture, shape and motion. As improvements in visual acuity facilitate improvements in quality of life, emulating naturalistic vision should be one of the ultimate goals of visual prostheses. To achieve this goal, we propose that multiple brain areas will need to be targeted in unison enabling different aspects of vision to be recreated.

Spared perilesional V1 activity underlies training-induced recovery of luminance detection sensitivity in cortically-blind patients

Damage to the primary visual cortex (V1) causes homonymous visual-field loss long considered intractable. Multiple studies now show that perceptual training can restore visual functions in chronic cortically-induced blindness (CB). A popular hypothesis is that training can harness residual visual functions by recruiting intact extrageniculostriate pathways. Training may also induce plastic changes within spared regions of the damaged V1. Here, we link changes in luminance detection sensitivity with retinotopic fMRI activity before and after visual discrimination training in eleven patients with chronic, stroke-induced CB. We show that spared V1 activity representing perimetrically-blind locations prior to training predicts the amount of training-induced recovery of luminance detection sensitivity. Additionally, training results in an enlargement of population receptive fields in perilesional V1, which increases blind-field coverage and may support further recovery with subsequent training. These findings uncover fundamental changes in perilesional V1 cortex underlying training-induced restoration of conscious luminance detection sensitivity in CB.

In humans, stroke damage to V1 causes large visual field defects. Spared V1 activity prior to training predicts the amount of training-induced recovery in luminance detection sensitivity. Moreover, visual training changes population receptive field properties within residual V1 circuits.

Transformative neural representations support long-term episodic memory

Memory is often conceived as a dynamic process that involves substantial transformations of mental representations. However, the neural mechanisms underlying these transformations and their role in memory formation and retrieval have only started to be elucidated. Combining intracranial EEG recordings with deep neural network models, we provide a detailed picture of the representational transformations from encoding to short-term memory maintenance and long-term memory retrieval that underlie successful episodic memory. We observed substantial representational transformations during encoding. Critically, more pronounced semantic representational formats predicted better subsequent long-term memory, and this effect was mediated by more consistent item-specific representations across encoding events. The representations were further transformed right after stimulus offset, and the representations during long-term memory retrieval were more similar to those during short-term maintenance than during encoding. Our results suggest that memory representations pass through multiple stages of transformations to achieve successful long-term memory formation and recall.

Effects of muscarinic and nicotinic receptors on contextual modulation in macaque area V1

Context affects the salience and visibility of image elements in visual scenes. Collinear flankers can enhance or decrease the perceptual and neuronal sensitivity to flanked stimuli. These effects are mediated through lateral interactions between neurons in the primary visual cortex (area V1), in conjunction with feedback from higher visual areas. The strength of lateral interactions is affected by cholinergic neuromodulation. Blockade of muscarinic receptors should increase the strength of lateral intracortical interactions, while nicotinic blockade should reduce thalamocortical feed-forward drive. Here we test this proposal through local iontophoretic application of the muscarinic receptor antagonist scopolamine and the nicotinic receptor antagonist mecamylamine, while recording single cells in parafoveal representations in awake fixating macaque V1. Collinear flankers generally reduced neuronal contrast sensitivity. Muscarinic and nicotinic receptor blockade equally reduced neuronal contrast sensitivity. Contrary to our hypothesis, flanker interactions were not systematically affected by either receptor blockade.

Characterization of Feedback Neurons in the High-Level Visual Cortical Areas That Project Directly to the Primary Visual Cortex in the Cat

Previous studies indicate that top-down influence plays a critical role in visual information processing and perceptual detection. However, the substrate that carries top-down influence remains poorly understood. Using a combined technique of retrograde neuronal tracing and immunofluorescent double labeling, we characterized the distribution and cell type of feedback neurons in cat's high-level visual cortical areas that send direct connections to the primary visual cortex (V1: area 17). Our results showed: (1) the high-level visual cortex of area 21a at the ventral stream and PMLS area at the dorsal stream have a similar proportion of feedback neurons back projecting to the V1 area, (2) the distribution of feedback neurons in the higher-order visual area 21a and PMLS was significantly denser than in the intermediate visual cortex of area 19 and 18, (3) feedback neurons in all observed high-level visual cortex were found in layer II-III, IV, V, and VI, with a higher proportion in layer II-III, V, and VI than in layer IV, and (4) most feedback neurons were CaMKII-positive excitatory neurons, and few of them were identified as inhibitory GABAergic neurons. These results may argue against the segregation of ventral and dorsal streams during visual information processing, and support "reverse hierarchy theory" or interactive model proposing that recurrent connections between V1 and higher-order visual areas constitute the functional circuits that mediate visual perception. Also, the corticocortical feedback neurons from high-level visual cortical areas to the V1 area are mostly excitatory in nature.

Sparse deep predictive coding captures contour integration capabilities of the early visual system

Both neurophysiological and psychophysical experiments have pointed out the crucial role of recurrent and feedback connections to process context-dependent information in the early visual cortex. While numerous models have accounted for feedback effects at either neural or representational level, none of them were able to bind those two levels of analysis. Is it possible to describe feedback effects at both levels using the same model? We answer this question by combining Predictive Coding (PC) and Sparse Coding (SC) into a hierarchical and convolutional framework applied to realistic problems. In the Sparse Deep Predictive Coding (SDPC) model, the SC component models the internal recurrent processing within each layer, and the PC component describes the interactions between layers using feedforward and feedback connections. Here, we train a 2-layered SDPC on two different databases of images, and we interpret it as a model of the early visual system (V1 & V2). We first demonstrate that once the training has converged, SDPC exhibits oriented and localized receptive fields in V1 and more complex features in V2. Second, we analyze the effects of feedback on the neural organization beyond the classical receptive field of V1 neurons using interaction maps. These maps are similar to association fields and reflect the Gestalt principle of good continuation. We demonstrate that feedback signals reorganize interaction maps and modulate neural activity to promote contour integration. Third, we demonstrate at the representational level that the SDPC feedback connections are able to overcome noise in input images. Therefore, the SDPC captures the association field principle at the neural level which results in a better reconstruction of blurred images at the representational level.

Anatomic and functional asymmetries interactively shape human early visual cortex responses

Early visual processing is surprisingly flexible even in the adult brain. This flexibility involves both long-term structural plasticity and online adaptations conveyed by top-down feedback. Although this view is supported by rich evidence from both human behavioral studies and invasive electrophysiology in nonhuman models, it has proven difficult to close the gap between species. In particular, it remains debated whether noninvasive measures of neural activity can capture top-down modulations of the earliest stages of processing in the human visual cortex. We previously reported modulations of retinotopic C1, the earliest component of the human visual evoked potential. However, these effects were selectively observed in the upper visual field (UVF). Here we test whether this asymmetry is linked to an interaction between differences in spatial resolution across the visual field and the specific stimuli used in previous studies. We measured visual evoked potentials in response to task-irrelevant, high-contrast textures of different densities in a comparatively large sample of healthy volunteers (N = 31) using high-density electroencephalogram. Our results show differential response profiles for upper and lower hemifields, with UVF responses saturating at higher stimulus densities. In contrast, lower visual field responses did not increase, and even showed a tendency toward a decrease at the highest density tested. We propose that these findings reflect feature- and task-specific pooling of signals from retinotopic regions with different sensitivity profiles. Such complex interactions between anatomic and functional asymmetries need to be considered to resolve whether human early visual cortex activity is modulated by top-down factors.

Inferring neural information flow from spiking data

The brain can be regarded as an information processing system in which neurons store and propagate information about external stimuli and internal processes. Therefore, estimating interactions between neural activity at the cellular scale has significant implications in understanding how neuronal circuits encode and communicate information across brain areas to generate behavior. While the number of simultaneously recorded neurons is growing exponentially, current methods relying only on pairwise statistical dependencies still suffer from a number of conceptual and technical challenges that preclude experimental breakthroughs describing neural information flows. In this review, we examine the evolution of the field over the years, starting from descriptive statistics to model-based and model-free approaches. Then, we discuss in detail the Granger Causality framework, which includes many popular state-of-the-art methods and we highlight some of its limitations from a conceptual and practical estimation perspective. Finally, we discuss directions for future research, including the development of theoretical information flow models and the use of dimensionality reduction techniques to extract relevant interactions from large-scale recording datasets.

Role of Feedback Connections in Central Visual Processing

The physiological response properties of neurons in the visual system are inherited mainly from feedforward inputs. Interestingly, feedback inputs often outnumber feedforward inputs. Although they are numerous, feedback connections are weaker, slower, and considered to be modulatory, in contrast to fast, high-efficacy feedforward connections. Accordingly, the functional role of feedback in visual processing has remained a fundamental mystery in vision science. At the core of this mystery are questions about whether feedback circuits regulate spatial receptive field properties versus temporal responses among target neurons, or whether feedback serves a more global role in arousal or attention. These proposed functions are not mutually exclusive, and there is compelling evidence to support multiple functional roles for feedback. In this review, the role of feedback in vision will be explored mainly from the perspective of corticothalamic feedback. Further generalized principles of feedback applicable to corticocortical connections will also be considered.

Development and Evaluation of a Visual Remediation Intervention for People with Schizophrenia

It is now well documented that schizophrenia is associated with impairments in visual processing at all levels of vision, and that these disturbances are related to deficits in multiple higher-level cognitive and social cognitive functions. Visual remediation methods have been slow to appear in the literature as a potential treatment strategy to target these impairments, however, in contrast to interventions that aim to improve auditory and higher cognitive functions in schizophrenia. In this report, we describe a National Institute of Mental Health (NIMH)-funded R61/R33 grant that uses a phased approach to optimize and evaluate a novel visual remediation intervention for people with schizophrenia. The goals of this project are: (1) in the R61 phase, to establish the optimal components and dose (number of sessions) of a visual remediation intervention from among two specific visual training strategies (and their combination) for improving low and mid-level visual functions in schizophrenia; and (2) in the R33 phase, to determine the extent to which the optimal intervention improves not only visual processing but also higher-level cognitive and role functions. Here we present the scientific background for and innovation of the study, along with our methods, hypotheses, and preliminary data. The results of this study will help determine the utility of this novel intervention approach for targeting visual perceptual, cognitive, and functional impairments in schizophrenia.

Postnatal Development of Visual Cortical Function in the Mammalian Brain

This review aims to discuss (1) the refinement of mammalian visual cortical circuits and the maturation of visual functions they subserve in primary visual cortex (V1) and other visual cortical areas, and (2) existing evidence supporting the notion of differential rates of maturation of visual functions in different species. It is well known that different visual functions and their underlying circuitry mature and attain adultlike characteristics at different stages in postnatal development with varying growth rates. The developmental timecourse and duration of refinement varies significantly both in V1 of various species and among different visual cortical areas; while basic visual functions like spatial acuity mature earlier requiring less time, higher form perception such as contour integration is more complex and requires longer postnatal time to refine. This review will highlight the importance of systematic comparative analysis of the differential rates of refinement of visual circuitry and function as that may help reveal underlying key mechanisms necessary for healthy visual development during infancy and adulthood. This type of approach will help future studies to establish direct links between various developmental aspects of different visual cortical areas in both human and animal models; thus enhancing our understanding of vision related neurological disorders and their potential therapeutic remedies.

Rapid topographic reorganization in adult human primary visual cortex (V1) during noninvasive and reversible deprivation

Can the primary visual cortex (V1), once wired up in development, change in adulthood? Although numerous studies have demonstrated topographic reorganization in adult V1 following the loss of bottom-up input, others have challenged such findings, offering alternative explanations. Here we use a noninvasive and reversible deprivation paradigm and converging neural and behavioral approaches to address these alternatives in the experimental test case of short-term topographic reorganization in adult human V1. Specifically, we patched one eye in typical adults, thereby depriving the cortical representation of the other eye's blind spot (BS), and immediately tested for topographic reorganization using functional magnetic resonance imaging and psychophysics. Strikingly, within just minutes of eye-patching, the BS representation in V1 began responding to stimuli presented outside of the BS, and these same stimuli were perceived as elongated toward the BS. Thus, we provide converging neural and behavioral evidence of rapid topographic reorganization in adult human V1, and the strongest evidence yet that visual deprivation produces bona fide cortical change.

Improved fidelity of orientation perception: a learning effect dissociable from enhanced discriminability

Visual perception can be influenced by stimulus context, selective attention, and prior experience. Many previous studies have shown complex interactions among these influencing factors, but it remains unclear whether context-induced illusions could be reduced by perceptual training and whether such a change in perceptual fidelity is linked to improved perceptual discriminability. To address this question, we introduced a context-induced tilt illusion into an orientation discrimination training paradigm. This resulted in parallel and long-term improvements in the discriminability and fidelity of orientation perception. The improved discriminability was specific to the task-relevant target stimulus but nonspecific to the task-irrelevant context. By contrast, the improved perceptual fidelity was specific to the task-irrelevant contextual stimulus that induced the illusion, but not specific to the task-relevant target stimulus or task performed on one of its features. These results indicate two dissociable learning effects associated with the same training procedure. Such a dissociation was further supported by the observation that the sizes of the two learning effects were uncorrelated across the subjects. Our findings suggest two parallel learning processes: a task-dependent process giving rise to enhanced discriminability for the task-relevant stimulus attribute, and a context-dependent process leading to improved perceptual fidelity for the attended stimuli.

Top-Down Feedback Controls the Cortical Representation of Illusory Contours in Mouse Primary Visual Cortex

Visual systems have evolved to recognize and extract features from complex scenes using limited sensory information. Contour perception is essential to this process and can occur despite breaks in the continuity of neighboring features. Such robustness of the animal visual system to degraded or occluded shapes may also give rise to an interesting phenomenon of optical illusions. These illusions provide a great opportunity to decipher neural computations underlying contour integration and object detection. Kanizsa illusory contours have been shown to evoke responses in the early visual cortex despite the lack of direct receptive field activation. Recurrent processing between visual areas has been proposed to be involved in this process. However, it is unclear whether higher visual areas directly contribute to the generation of illusory responses in the early visual cortex. Using behavior, in vivo electrophysiology, and optogenetics, we first show that the primary visual cortex (V1) of male mice responds to Kanizsa illusory contours. Responses to Kanizsa illusions emerge later than the responses to the contrast-defined real contours in V1. Second, we demonstrate that illusory responses are orientation-selective. Finally, we show that top-down feedback controls the neural correlates of illusory contour perception in V1. Our results suggest that higher-order visual areas may fill in the missing information in the early visual cortex necessary for illusory contour perception.SIGNIFICANCE STATEMENT Perception of the Kanizsa illusory contours is impaired in neurodevelopmental disorders such as schizophrenia, autism, and Williams syndrome. However, the mechanism of the illusory contour perception is poorly understood. Here we describe the behavioral and neural correlates of Kanizsa illusory contours perception in mice, a genetically tractable model system. We show that top-down feedback controls the neural responses to Kanizsa illusion in V1. To our knowledge, this is the first description of the neural correlates of the Kanizsa illusion in mice and the first causal demonstration of their regulation by top-down feedback.

Smaller visual arrays are harder to integrate in schizophrenia: Evidence for impaired lateral connections in early vision

Long-range horizontal connections in early vision undergird a well-studied "collinear facilitation" effect, wherein a central low-contrast target becomes more detectable when flanked by collinear elements. Collinear facilitation is weaker in schizophrenia. Might lateral connections be responsible? To consider the possibility, we had 38 schizophrenia patients and 49 well-matched healthy controls judge the presence of a central low-contrast element flanked by collinear or orthogonal high-contrast elements.   The display (target+flankers) was scaled in size to produce a lower and higher spatial frequency ("SF") condition (4 and 10 cycles/deg, respectively).  Larger stimulus arrays bias processing towards feedback connections from higher-order visual areas; smaller arrays bias processing toward lateral connections. Patients had impaired facilitation relative to controls at higher but not lower SFs. Combining data from a past study on "contour integration" (in which subjects sought to detect chains of co-circular elements), we found correlated integration and facilitation performance at the higher SF and a similar effect of spatial scaling across SF, suggesting a common mechanism. In an exploratory analysis, worse contrast thresholds (without facilitation) correlated strongly with more premorbid dysfunction. In schizophrenia, inter-element filling-in worsens at smaller spatial scales potentially because of its increased reliance on impaired lateral connections in early vision.

Scene Representations Conveyed by Cortical Feedback to Early Visual Cortex Can Be Described by Line Drawings

Human behavior is dependent on the ability of neuronal circuits to predict the outside world. Neuronal circuits in early visual areas make these predictions based on internal models that are delivered via non-feedforward connections. Despite our extensive knowledge of the feedforward sensory features that drive cortical neurons, we have a limited grasp on the structure of the brain's internal models. Progress in neuroscience therefore depends on our ability to replicate the models that the brain creates internally. Here we record human fMRI data while presenting partially occluded visual scenes. Visual occlusion allows us to experimentally control sensory input to subregions of visual cortex while internal models continue to influence activity in these regions. Because the observed activity is dependent on internal models, but not on sensory input, we have the opportunity to map visual features conveyed by the brain's internal models. Our results show that activity related to internal models in early visual cortex are more related to scene-specific features than to categorical or depth features. We further demonstrate that behavioral line drawings provide a good description of internal model structure representing scene-specific features. These findings extend our understanding of internal models, showing that line drawings provide a window into our brains' internal models of vision.

SIGNIFICANCE STATEMENT We find that fMRI activity patterns corresponding to occluded visual information in early visual cortex fill in scene-specific features. Line drawings of the missing scene information correlate with our recorded activity patterns, and thus to internal models. Despite our extensive knowledge of the sensory features that drive cortical neurons, we have a limited grasp on the structure of our brains' internal models. These results therefore constitute an advance to the field of neuroscience by extending our knowledge about the models that our brains construct to efficiently represent and predict the world. Moreover, they link a behavioral measure to these internal models, which play an active role in many components of human behavior, including visual predictions, action planning, and decision making.

Spike-field Granger causality for hybrid neural data analysis

Neurotechnological innovations allow for simultaneous recording at various scales, ranging from spiking activity of individual neurons to large neural populations’ local field potentials (LFPs). This capability necessitates developing multiscale analysis of spike-field activity. A joint analysis of the hybrid neural data is crucial for bridging the scales between single neurons and local networks. Granger causality is a fundamental measure to evaluate directional influences among neural signals. However, it is mainly limited to inferring causal influence between the same type of signals—either LFPs or spike trains—and not well developed between two different signal types. Here we propose a model-free, nonparametric spike-field Granger causality measure for hybrid data analysis. Our measure is distinct from existing methods in that we use “binless” spikes (precise spike timing) rather than “binned” spikes (spike counts within small consecutive time windows). The latter clearly distort the information in the mixed analysis of spikes and LFP. Therefore, our spectral estimate of spike trains is directly applied to the neural point process itself, i.e., sequences of spike times rather than spike counts. Our measure is validated by an extensive set of simulated data. When the measure is applied to LFPs and spiking activity simultaneously recorded from visual areas V1 and V4 of monkeys performing a contour detection task, we are able to confirm computationally the long-standing experimental finding of the input-output relationship between LFPs and spikes. Importantly, we demonstrate that spike-field Granger causality can be used to reveal the modulatory effects that are inaccessible by traditional methods, such that spike→LFP Granger causality is modulated by the behavioral task, whereas LFP→spike Granger causality is mainly related to the average synaptic input.

NEW & NOTEWORTHY It is a pressing question to study the directional interactions between local field potential (LFP) and spiking activity. In this report, we propose a model-free, nonparametric spike-field Granger causality measure that can be used to reveal directional influences between spikes and LFPs. This new measure is crucial for bridging the scales between single neurons and neural networks; hence it represents an important step to explicate how the brain orchestrates information processing.

Dynamic Neural Representations: An Inferential Challenge for fMRI

Measures of brain activity with high temporal resolution have shown that the information represented in a single brain region undergoes dynamic changes on the scale of milliseconds. This dynamic process presents a unique inferential challenge to low temporal resolution neural measures, such as BOLD fMRI. Potential solutions for fMRI requiring further investigation and development are discussed.

Optical intrinsic signal imaging with optogenetics reveals functional cortico-cortical connectivity at the columnar level in living macaques

Despite extensive research on primate cognitive function, understanding how anatomical connectivity at a neural circuit level relates to information transformation across different cortical areas remains primitive. New technology is needed to visualize inter-areal anatomical connectivity in living monkeys and to tie this directly to neurophysiological function. Here, we developed a novel method to investigate this structure-function relationship, by combining optical intrinsic signal imaging (OISI) with optogenetic stimulation in living monkeys (opto-OISI). The method involves expressing channelrhodophsin-2 in one area (source) followed by optical imaging of optogenetic activations in the other area (target). We successfully demonstrated the potential of the method with interhemispheric columnar projection patterns between V1/V2 border regions. Unlike the combination of optogenetics and functional magnetic resonance imaging (opto-fMRI), opto-OISI has the advantage of enabling us to detect responses of small clusters of neurons, even if the clusters are sparsely distributed. We suggest that opto-OISI can be a powerful approach to understanding cognitive function at the neural circuit level, directly linking inter-areal circuitry to fine-scale structure and function.

Surface color and predictability determine contextual modulation of V1 firing and gamma oscillations

The integration of direct bottom-up inputs with contextual information is a core feature of neocortical circuits. In area V1, neurons may reduce their firing rates when their receptive field input can be predicted by spatial context. Gamma-synchronized (30–80 Hz) firing may provide a complementary signal to rates, reflecting stronger synchronization between neuronal populations receiving mutually predictable inputs. We show that large uniform surfaces, which have high spatial predictability, strongly suppressed firing yet induced prominent gamma synchronization in macaque V1, particularly when they were colored. Yet, chromatic mismatches between center and surround, breaking predictability, strongly reduced gamma synchronization while increasing firing rates. Differences between responses to different colors, including strong gamma-responses to red, arose from stimulus adaptation to a full-screen background, suggesting prominent differences in adaptation between M- and L-cone signaling pathways. Thus, synchrony signaled whether RF inputs were predicted from spatial context, while firing rates increased when stimuli were unpredicted from context.

Layer 3 Dynamically Coordinates Columnar Activity According to Spatial Context

To reduce statistical redundancy of natural inputs and increase the sparseness of coding, neurons in primary visual cortex (V1) show tuning for stimulus size and surround suppression. This integration of spatial information is a fundamental, context-dependent neural operation involving extensive neural circuits that span across all cortical layers of a V1 column, and reflects both feedforward and feedback processing. However, how spatial integration is dynamically coordinated across cortical layers remains poorly understood. We recorded single- and multiunit activity and local field potentials across V1 layers of awake mice (both sexes) while they viewed stimuli of varying size and used dynamic Bayesian model comparisons to identify when laminar activity and interlaminar functional interactions showed surround suppression, the hallmark of spatial integration. We found that surround suppression is strongest in layer 3 (L3) and L4 activity, where suppression is established within ∼10 ms after response onset, and receptive fields dynamically sharpen while suppression strength increases. Importantly, we also found that specific directed functional connections were strongest for intermediate stimulus sizes and suppressed for larger ones, particularly for connections from L3 targeting L5 and L1. Together, the results shed light on the different functional roles of cortical layers in spatial integration and on how L3 dynamically coordinates activity across a cortical column depending on spatial context.SIGNIFICANCE STATEMENT Neurons in primary visual cortex (V1) show tuning for stimulus size, where responses to stimuli exceeding the receptive field can be suppressed (surround suppression). We demonstrate that functional connectivity between V1 layers can also have a surround-suppressed profile. A particularly prominent role seems to have layer 3, the functional connections to layers 5 and 1 of which are strongest for stimuli of optimal size and decreased for large stimuli. Our results therefore point toward a key role of layer 3 in coordinating activity across the cortical column according to spatial context.

Recurrent Processing of Contour Integration in the Human Visual Cortex as Revealed By fMRI-Guided TMS

Contour integration is a critical step in visual perception because it groups discretely local elements into perceptually global contours. Previous investigations have suggested that striate and extrastriate visual areas are involved in this mid-level processing of visual perception. However, the temporal dynamics of these areas in the human brain during contour integration is less understood. The present study used functional magnetic resonance imaging-guided transcranial magnetic stimulation (TMS) to briefly disrupt 1 of 2 visual areas (V1/V2 and V3B) and examined the causal contributions of these areas to contour detection. The results demonstrated that the earliest critical time window at which behavioral detection performance was impaired by TMS pluses differed between V1/V2 and V3B. The first critical window of V3B (90-110 ms after stimulus onset) was earlier than that of V1/V2 (120-140 ms after stimulus onset), thus indicating that feedback connection from higher to lower area was necessary for complete contour integration. These results suggested that the fine processing of contour-related information in V1/V2 follows the generation of a coarse template in the higher visual areas, such as V3B. Our findings provide direct causal evidence that a recurrent mechanism is necessary for the integration of contours from cluttered background in the human brain.

Intact illusory contour formation but equivalently impaired visual shape completion in first- and later-episode schizophrenia

Visual shape completion is a fundamental process that constructs contours and shapes on the basis of the geometric relations between spatially separated edge elements. People with schizophrenia are impaired at distinguishing visually completed shapes, but when does the impairment emerge and how does it evolve with illness duration? The question bears on the debate as to whether cognition declines after illness onset. To address the issue, we tested healthy controls (n = 48), first-episode psychosis patients (n = 23), and chronic schizophrenia patients (n = 49) on a classic psychophysical task in which subjects discriminated the relative orientations of four sectored circles that either formed or did not form visually completed shapes (illusory and fragmented conditions, respectively). Visual shape completion was quantified as the extent to which performance in the illusory condition exceeded that of the fragmented. Half of the trials incorporated wire edge elements, which augment contour salience and improve shape completion. Each patient group exhibited large visual shape completion deficits that could not be explained by differences in age, motivation, or orientation tuning. Patients responded normally to changes in illusory contour salience, indicating that they were forming but not adequately employing such contours for discriminating shapes. Shape completion deficits were most apparent for patients with cognitive disorganization, poor premorbid early adolescent functioning, and normal orientation discrimination. Visual shape completion deficits emerge maximally by the first psychotic episode and arise from higher-level disturbances that are related to premorbid functioning and disorganization. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Axonal plasticity associated with perceptual learning in adult macaque primary visual cortex

Perceptual learning is associated with changes in the functional properties of neurons even in primary sensory areas. In macaque monkeys trained to perform a contour detection task, we have observed changes in contour-related facilitation of neuronal responses in primary visual cortex that track their improvement in performance on a contour detection task. We have previously explored the anatomical substrate of experience-dependent changes in the visual cortex based on a retinal lesion model, where we find sprouting and pruning of the axon collaterals in the cortical lesion projection zone. Here, we attempted to determine whether similar changes occur under normal visual experience, such as that associated with perceptual learning. We labeled the long-range horizontal connections in visual cortex by virally mediated transfer of genes expressing fluorescent probes, which enabled us to do longitudinal two-photon imaging of axonal arbors over the period during which animals improve in contour detection performance. We found that there are substantial changes in the axonal arbors of neurons in cortical regions representing the trained part of the visual field, with sprouting of new axon collaterals and pruning of preexisting axon collaterals. Our findings indicate that changes in the structure of axonal arbors are part of the circuit-level mechanism of perceptual learning, and further support the idea that the learned information is encoded at least in part in primary visual cortex.

Neural Correlate of Visual Familiarity in Macaque Area V2

Neurons in macaque inferotemporal cortex (ITC) respond less strongly to familiar than to novel images. It is commonly assumed that this effect arises within ITC because its neurons respond selectively to complex images and thus encode in an explicit form information sufficient for identifying a particular image as familiar. However, no prior study has examined whether neurons in low-order visual areas selective for local features also exhibit familiarity suppression. To address this issue, we recorded from neurons in macaque area V2 with semichronic microelectrode arrays while monkeys repeatedly viewed a set of large complex natural images. We report here that V2 neurons exhibit familiarity suppression. The effect develops over several days with a trajectory well fitted by an exponential function with a rate constant of ∼100 exposures. Suppression occurs in V2 at a latency following image onset shorter than its reported latency in ITC.SIGNIFICANCE STATEMENT Familiarity suppression, the tendency for neurons to respond less strongly to familiar than novel images, is well known in monkey inferotemporal cortex. Suppression has been thought to arise in inferotemporal cortex because its neurons respond selectively to large complex images and thus explicitly to encode information sufficient for identifying a particular image as familiar. No previous study has explored the possibility that familiarity suppression occurs even in early-stage visual areas where neurons are selective for simple features in confined receptive fields. We now report that neurons in area V2 exhibit familiarity suppression. This finding challenges our current understanding of information processing in V2 as well as our understanding of the mechanisms that underlie familiarity suppression.

Time-varying MVAR algorithms for directed connectivity analysis: Critical comparison in simulations and benchmark EEG data

Human brain function depends on directed interactions between multiple areas that evolve in the subsecond range. Time-varying multivariate autoregressive (tvMVAR) modeling has been proposed as a way to help quantify directed functional connectivity strengths with high temporal resolution. While several tvMVAR approaches are currently available, there is a lack of unbiased systematic comparative analyses of their performance and of their sensitivity to parameter choices. Here, we critically compare four recursive tvMVAR algorithms and assess their performance while systematically varying adaptation coefficients, model order, and signal sampling rate. We also compared two ways of exploiting repeated observations: single-trial modeling followed by averaging, and multi-trial modeling where one tvMVAR model is fitted across all trials. Results from numerical simulations and from benchmark EEG recordings showed that: i) across a broad range of model orders all algorithms correctly reproduced patterns of interactions; ii) signal downsampling degraded connectivity estimation accuracy for most algorithms, although in some cases downsampling was shown to reduce variability in the estimates by lowering the number of parameters in the model; iii) single-trial modeling followed by averaging showed optimal performance with larger adaptation coefficients than previously suggested, and showed slower adaptation speeds than multi-trial modeling. Overall, our findings identify strengths and weaknesses of existing tvMVAR approaches and provide practical recommendations for their application to modeling dynamic directed interactions from electrophysiological signals.

Contour interpolation: A case study in Modularity of Mind

In his monograph Modularity of Mind (1983), philosopher Jerry Fodor argued that mental architecture can be partly decomposed into computational organs termed modules, which were characterized as having nine co-occurring features such as automaticity, domain specificity, and informational encapsulation. Do modules exist? Debates thus far have been framed very generally with few, if any, detailed case studies. The topic is important because it has direct implications on current debates in cognitive science and because it potentially provides a viable framework from which to further understand and make hypotheses about the mind's structure and function. Here, the case is made for the modularity of contour interpolation, which is a perceptual process that represents non-visible edges on the basis of how surrounding visible edges are spatiotemporally configured. There is substantial evidence that interpolation is domain specific, mandatory, fast, and developmentally well-sequenced; that it produces representationally impoverished outputs; that it relies upon a relatively fixed neural architecture that can be selectively impaired; that it is encapsulated from belief and expectation; and that its inner workings cannot be fathomed through conscious introspection. Upon differentiating contour interpolation from a higher-order contour representational ability ("contour abstraction") and upon accommodating seemingly inconsistent experimental results, it is argued that interpolation is modular to the extent that the initiating conditions for interpolation are strong. As interpolated contours become more salient, the modularity features emerge. The empirical data, taken as a whole, show that at least certain parts of the mind are modularly organized.