Human cortical magnification factor and its relation to visual acuity

Sustained attention operates via dissociable neural mechanisms across different eccentric locations

In primates, foveal and peripheral vision have distinct neural architectures and functions. However, it has been debated if selective attention operates via the same or different neural mechanisms across eccentricities. We tested these alternative accounts by examining the effects of selective attention on the steady-state visually evoked potential (SSVEP) and the fronto-parietal signal measured via EEG from human subjects performing a sustained visuospatial attention task. With a negligible level of eye movements, both SSVEP and SND exhibited the heterogeneous patterns of attentional modulations across eccentricities. Specifically, the attentional modulations of these signals peaked at the parafoveal locations and such modulations wore off as visual stimuli appeared closer to the fovea or further away towards the periphery. However, with a relatively higher level of eye movements, the heterogeneous patterns of attentional modulations of these neural signals were less robust. These data demonstrate that the top-down influence of covert visuospatial attention on early sensory processing in human cortex depends on eccentricity and the level of saccadic responses. Taken together, the results suggest that sustained visuospatial attention operates differently across different eccentric locations, providing new understanding of how attention augments sensory representations regardless of where the attended stimulus appears.

Convolutional neural networks develop major organizational principles of early visual cortex when enhanced with retinal sampling

Primate visual cortex exhibits key organizational principles: cortical magnification, eccentricity-dependent receptive field size and spatial frequency tuning as well as radial bias. We provide compelling evidence that these principles arise from the interplay of the non-uniform distribution of retinal ganglion cells, and a quasi-uniform convergence rate from the retina to the cortex. We show that convolutional neural networks outfitted with a retinal sampling layer, which resamples images according to retinal ganglion cell density, develop these organizational principles. Surprisingly, our results indicate that radial bias is spatial-frequency dependent and only manifests for high spatial frequencies. For low spatial frequencies, the bias shifts towards orthogonal orientations. These findings introduce a novel hypothesis about the origin of radial bias. Quasi-uniform convergence limits the range of spatial frequencies (in retinal space) that can be resolved, while retinal sampling determines the spatial frequency content throughout the retina.

Adaptive smoothing of retinotopic maps based on Teichmüller parametrization

Retinotopic mapping, the mapping between visual inputs on the retina and neural responses on the cortical surface, is one of the fundamental topics in visual neuroscience. In human studies, retinotopic maps are conventionally constructed and processed by decoding blood oxygenation-level dependent (BOLD) functional magnetic resonance imaging (fMRI) responses to designed visual stimuli on the cortical surface. However, these methods frequently generate retinotopic maps that do not preserve topology, contradicting a fundamental property of retinotopic maps observed in neurophysiology. To address this problem, we propose an integrated approach to simultaneously refine the flattening from the 3D cortical surface to the 2D parametric space and adaptively smooth retinotopic perception centers in the visual space to make the retinotopic maps topological. One key element of the approach is the enhanced error tolerant Teichmüller mapping, which refines the parametrization by minimizing angle distortions and maximizing alignment to noisy landmarks. We validated our overall approach with synthetic and real retinotopic mapping datasets and applied it to compute cortical magnification factor (CMF). The results showed that the proposed approach was superior to other conventional retinotopic mapping methods in predicting BOLD fMRI time series and preserving topology.

Does crowding predict conjunction search? An individual differences approach

Searching for objects in the visual environment is an integral part of human behavior. Most of the information used during such visual search comes from the periphery of our vision, and understanding the basic mechanisms of search therefore requires taking into account the inherent limitations of peripheral vision. Our previous work using an individual differences approach has shown that one of the major factors limiting peripheral vision (crowding) is predictive of single feature search, as reflected in response time and eye movement measures. Here we extended this work, by testing the relationship between crowding and visual search in a conjunction-search paradigm. Given that conjunction search involves more fine-grained discrimination and more serial behavior, we predicted it would be strongly affected by crowding. We tested sixty participants with regard to their sensitivity to both orientation and color-based crowding (as measured by critical spacing) and their efficiency in searching for a color/orientation conjunction (as indicated by manual response times and eye movements). While the correlations between the different crowding tasks were high, the correlations between the different crowding measures and search performance were relatively modest, and no higher than those previously observed for single-feature search. Instead, observers showed very strong color selectivity during search. The results suggest that conjunction search behavior relies more on top-down guidance (here by color) and is therefore relatively less determined by individual differences in sensory limitations as caused by crowding.

Parafoveal vision reveals qualitative differences between fusiform face area and parahippocampal place area

The center-periphery visual field axis guides early visual system organization with enhanced resources devoted to central vision leading to reduced peripheral performance relative to that of central vision (i.e., behavioral eccentricity effect) for many visual functions. The center-periphery organization extends to high-order visual cortex where, for example, the well-studied face-sensitive fusiform face area (FFA) shows sensitivity to central vision and the place-sensitive parahippocampal place area (PPA) shows sensitivity to peripheral vision. As we have recently found that face perception is more sensitive to eccentricity than place perception, here we examined whether these behavioral findings reflect differences in FFA's and PPA's sensitivities to eccentricity. We assumed FFA would show higher sensitivity to eccentricity than PPA would, but that both regions' modulation by eccentricity would be invariant to the viewed category. We parametrically investigated (fMRI, n = 32) how FFA's and PPA's activations are modulated by eccentricity (≤8°) and category (upright/inverted faces/houses) while keeping stimulus size constant. As expected, FFA showed an overall higher sensitivity to eccentricity than PPA. However, both regions' activation modulations by eccentricity were dependent on the viewed category. In FFA, a reduction of activation with growing eccentricity ("BOLD eccentricity effect") was found (with different amplitudes) for all categories. In PPA however, qualitatively different BOLD eccentricity effect modulations were found (e.g., at 8° mild BOLD eccentricity effect for houses but a reverse BOLD eccentricity effect for faces and no modulation for inverted faces). Our results emphasize that peripheral vision investigations are critical to further our understanding of visual processing.

Network dynamics underlying alterations in apparent object size

A target circle surrounded by small circles looks larger than an identical circle surrounded by large circles (termed as the Ebbinghaus illusion). While previous research has shown that both early and high-level visual regions are involved in the generation of the illusion, it remains unclear how these regions work together to modulate the illusion effect. Here, we used functional MRI and dynamic causal modelling to investigate the neural networks underlying the illusion in conditions where the focus of attention was manipulated via participants directing their attention to and maintain fixation on only one of the two illusory configurations at a time. Behavioural findings confirmed the presence of the illusion. Accordingly, functional MRI activity in the extrastriate cortex accounted for the illusory effects: apparently larger circles elicited greater activation than apparently smaller circles. Interestingly, this spread of activity for size overestimation was accompanied by a decrease in the inhibitory self-connection in the extrastriate region, and an increase in the feedback connectivity from the precuneus to the extrastriate region. These findings demonstrate that the representation of apparent object size relies on feedback projections from higher- to lower-level visual areas, highlighting the crucial role of top-down signals in conscious visual perception.

Early visual experience refines the retinotopic organization within and across visual cortical regions

Early visual areas are retinotopically organized in human and non-human primates. Population receptive field (pRF) size increases with eccentricity and from lower- to higher-level visual areas. Furthermore, the cortical magnification factor (CMF), a measure of how much cortical space is devoted to each degree of visual angle, is typically larger for foveal as opposed to peripheral regions of the visual field. Whether this fine-scale organization within and across visual areas depends on early visual experience has yet been unknown. Here, we employed 7T functional magnetic resonance imaging pRF mapping to assess the retinotopic organization of early visual regions (i.e., V1, V2, and V3) in eight sight recovery individuals with a history of congenital blindness until a maximum of 4 years of age. Compared with sighted controls, foveal pRF sizes in these individuals were larger, and pRF sizes did not show the typical increase with eccentricity and down the visual cortical processing stream (V1-V2-V3). Cortical magnification was overall diminished and decreased less from foveal to parafoveal visual field locations. Furthermore, cortical magnification correlated with visual acuity in sight recovery individuals. The results of this study suggest that early visual experience is essential for refining a presumably innate prototypical retinotopic organization in humans within and across visual areas, which seems to be crucial for acquiring full visual capabilities.

Sustained attention operates via dissociable neural mechanisms across different eccentric locations

In primates, foveal and peripheral vision have distinct neural architectures and functions. However, it has been debated if selective attention operates via the same or different neural mechanisms across eccentricities. We tested these alternative accounts by examining the effects of selective attention on the steady-state visually evoked potential (SSVEP) and the fronto-parietal signal measured via EEG from human subjects performing a sustained visuospatial attention task. With a negligible level of eye movements, both SSVEP and SND exhibited the heterogeneous patterns of attentional modulations across eccentricities. Specifically, the attentional modulations of these signals peaked at the parafoveal locations and such modulations wore off as visual stimuli appeared closer to the fovea or further away towards the periphery. However, with a relatively higher level of eye movements, the heterogeneous patterns of attentional modulations of these neural signals were less robust. These data demonstrate that the top-down influence of covert visuospatial attention on early sensory processing in human cortex depends on eccentricity and the level of saccadic responses. Taken together, the results suggest that sustained visuospatial attention operates differently across different eccentric locations, providing new understanding of how attention augments sensory representations regardless of where the attended stimulus appears.

Visual short-term memory-related EEG components in a virtual reality setup

Virtual reality (VR) offers a powerful tool for investigating cognitive processes, as it allows researchers to gauge behaviors and mental states in complex, yet highly controlled, scenarios. The use of VR head-mounted displays in combination with physiological measures such as EEG presents new challenges and raises the question whether established findings also generalize to a VR setup. Here, we used a VR headset to assess the spatial constraints underlying two well-established EEG correlates of visual short-term memory: the amplitude of the contralateral delay activity (CDA) and the lateralization of induced alpha power during memory retention. We tested observers' visual memory in a change detection task with bilateral stimulus arrays of either two or four items while varying the horizontal eccentricity of the memory arrays (4, 9, or 14 degrees of visual angle). The CDA amplitude differed between high and low memory load at the two smaller eccentricities, but not at the largest eccentricity. Neither memory load nor eccentricity significantly influenced the observed alpha lateralization. We further fitted time-resolved spatial filters to decode memory load from the event-related potential as well as from its time-frequency decomposition. Classification performance during the retention interval was above-chance level for both approaches and did not vary significantly across eccentricities. We conclude that commercial VR hardware can be utilized to study the CDA and lateralized alpha power, and we provide caveats for future studies targeting these EEG markers of visual memory in a VR setup.

Altered Eye Movements During Reading With Simulated Central and Peripheral Visual Field Defects

Purpose

Although foveal vision provides fine spatial information, parafoveal and peripheral vision are also known to be important for efficient reading behaviors. Here we systematically investigate how different types and sizes of visual field defects affect the way visual information is acquired via eye movements during reading.

Methods

Using gaze-contingent displays, simulated scotomas were induced in 24 adults with normal or corrected-to-normal vision during a reading task. The study design included peripheral and central scotomas of varying sizes (aperture or scotoma size of 2°, 4°, 6°, 8°, and 10°) and no-scotoma conditions. Eye movements (e.g., forward/backward saccades, fixations, microsaccades) were plotted as a function of either the aperture or scotoma size, and their relationships were characterized by the best fitting model.

Results

When the aperture size of the peripheral scotoma decreased below 6° (11 visible letters), there were significant decreases in saccade amplitude and velocity, as well as substantial increases in fixation duration and the number of fixations. Its dependency on the aperture size is best characterized by an exponential decay or growth function in log-linear coordinates. However, saccade amplitude and velocity, fixation duration, and forward/regressive saccades increased more or less linearly with increasing central scotoma size in log-linear coordinates.

Conclusions

Our results showed differential impacts of central and peripheral vision loss on reading behaviors while lending further support for the importance of foveal and parafoveal vision in reading. These apparently deviated oculomotor behaviors may in part reflect optimal reading strategies to compensate for the loss of visual information.

Increased neuron density in the midbrain of a foveate bird, pigeon, results from profound change in tissue morphogenesis

The increase of brain neuron number in relation with brain size is currently considered to be the major evolutionary path to high cognitive power in amniotes. However, how changes in neuron density did contribute to the evolution of the information-processing capacity of the brain remains unanswered. High neuron densities are seen as the main reason why the fovea located at the visual center of the retina is responsible for sharp vision in birds and primates. The emergence of foveal vision is considered as a breakthrough innovation in visual system evolution. We found that neuron densities in the largest visual center of the midbrain - i.e., the optic tectum - are two to four times higher in modern birds with one or two foveae compared to birds deprived of this specialty. Interspecies comparisons enabled us to identify elements of a hitherto unknown developmental process set up by foveate birds for increasing neuron density in the upper layers of their optic tectum. The late progenitor cells that generate these neurons proliferate in a ventricular zone that can expand only radially. In this particular context, the number of cells in ontogenetic columns increases, thereby setting the conditions for higher cell densities in the upper layers once neurons did migrate.

Optic radiations representing different eccentricities age differently

The neural pathways that carry information from the foveal, macular, and peripheral visual fields have distinct biological properties. The optic radiations (OR) carry foveal and peripheral information from the thalamus to the primary visual cortex (V1) through adjacent but separate pathways in the white matter. Here, we perform white matter tractometry using pyAFQ on a large sample of diffusion MRI (dMRI) data from subjects with healthy vision in the U.K. Biobank dataset (UKBB; N = 5382; age 45-81). We use pyAFQ to characterize white matter tissue properties in parts of the OR that transmit information about the foveal, macular, and peripheral visual fields, and to characterize the changes in these tissue properties with age. We find that (1) independent of age there is higher fractional anisotropy, lower mean diffusivity, and higher mean kurtosis in the foveal and macular OR than in peripheral OR, consistent with denser, more organized nerve fiber populations in foveal/parafoveal pathways, and (2) age is associated with increased diffusivity and decreased anisotropy and kurtosis, consistent with decreased density and tissue organization with aging. However, anisotropy in foveal OR decreases faster with age than in peripheral OR, while diffusivity increases faster in peripheral OR, suggesting foveal/peri-foveal OR and peripheral OR differ in how they age.

Polar angle asymmetries in visual perception and neural architecture

Human visual performance changes with visual field location. It is best at the center of gaze and declines with eccentricity, and also varies markedly with polar angle. These perceptual polar angle asymmetries are linked to asymmetries in the organization of the visual system. We review and integrate research quantifying how performance changes with visual field location and how this relates to neural organization at multiple stages of the visual system. We first briefly review how performance varies with eccentricity and the neural foundations of this effect. We then focus on perceptual polar angle asymmetries and their neural foundations. Characterizing perceptual and neural variations across and around the visual field contributes to our understanding of how the brain translates visual signals into neural representations which form the basis of visual perception.

Eye Tracking in Virtual Reality: a Broad Review of Applications and Challenges

Eye tracking is becoming increasingly available in head-mounted virtual reality displays with various headsets with integrated eye trackers already commercially available. The applications of eye tracking in virtual reality are highly diversified and span multiple disciplines. As a result, the number of peer-reviewed publications that study eye tracking applications has surged in recent years. We performed a broad review to comprehensively search academic literature databases with the aim of assessing the extent of published research dealing with applications of eye tracking in virtual reality, and highlighting challenges, limitations and areas for future research.

Perceptual Difficulty Regulates Attentional Gain Modulations in Human Visual Cortex

Perceptual difficulty is sometimes used to manipulate selective attention. However, these two factors are logically distinct. Selective attention is defined by priority given to specific stimuli based on their behavioral relevance, whereas perceptual difficulty is often determined by perceptual demands required to discriminate relevant stimuli. That said, both perceptual difficulty and selective attention are thought to modulate the gain of neural responses in early sensory areas. Previous studies found that selectively attending to a stimulus or increasing perceptual difficulty enhanced the gain of neurons in visual cortex. However, some other studies suggest that perceptual difficulty can have either a null or even reversed effect on gain modulations in visual cortex. According to Yerkes-Dodson's Law, it is possible that this discrepancy arises because of an interaction between perceptual difficulty and attentional gain modulations yielding a nonlinear inverted-U function. Here, we used EEG to measure modulations in the visual cortex of male and female human participants performing an attention-cueing task where we systematically manipulated perceptual difficulty across blocks of trials. The behavioral and neural data implicate a nonlinear inverted-U relationship between selective attention and perceptual difficulty: a focused-attention cue led to larger response gain in both neural and behavioral data at intermediate difficulty levels compared with when the task was more or less difficult. Moreover, difficulty-related changes in attentional gain positively correlated with those predicted by quantitative modeling of the behavioral data. These findings suggest that perceptual difficulty mediates attention-related changes in perceptual performance via selective neural modulations in human visual cortex.SIGNIFICANCE STATEMENT Both perceptual difficulty and selective attention are thought to influence perceptual performance by modulating response gain in early sensory areas. That said, less is known about how selective attention interacts with perceptual difficulty. Here, we measured neural gain modulations in the visual cortex of human participants performing an attention-cueing task where perceptual difficulty was systematically manipulated. Consistent with Yerkes-Dodson's Law, our behavioral and neural data implicate a nonlinear inverted-U relationship between selective attention and perceptual difficulty. These results suggest that perceptual difficulty mediates attention-related changes in perceptual performance via selective neural modulations in visual cortex, extending our understanding of the attentional operation under different levels of perceptual demands.

Interaction between spatial perception and temporal perception enables preservation of cause-effect relationship: Visual psychophysics and neuronal dynamics

INTRODUCTION

Visual perception of moving objects is integral to our day-to-day life, integrating visual spatial and temporal perception. Most research studies have focused on finding the brain regions activated during motion perception. However, an empirically validated general mathematical model is required to understand the modulation of the motion perception. Here, we develop a mathematical formulation of the modulation of the perception of a moving object due to a change in speed, under the formulation of the invariance of causality.

METHODS

We formulated the perception of a moving object as the coordinate transformation from a retinotopic space onto perceptual space and derived a quantitative relationship between spatiotemporal coordinates. To validate our model, we undertook the analysis of two experiments: (i) the perceived length of the moving arc, and (ii) the perceived time while observing moving stimuli. We performed a magnetic resonance imaging (MRI) tractography investigation of subjects to demarcate the anatomical correlation of the modulation of the perception of moving objects.

RESULTS

Our theoretical model shows that the interaction between visual-spatial and temporal perception, during the perception of moving object is described by coupled linear equations; and experimental observations validate our model. We observed that cerebral area V5 may be an anatomical correlate for this interaction. The physiological basis of interaction is shown by a Lotka-Volterra system delineating interplay between acetylcholine and dopamine neurotransmitters, whose concentrations vary periodically with the orthogonal phase shift between them, occurring at the axodendritic synapse of complex cells at area V5.

CONCLUSION

Under the invariance of causality in the representation of events in retinotopic space and perceptual space, the speed modulates the perception of a moving object. This modulation may be due to variations of the tuning properties of complex cells at area V5 due to the dynamic interaction between acetylcholine and dopamine. Our analysis is the first significant study, to our knowledge, that establishes a mathematical linkage between motion perception and causality invariance.

Figure–Ground Segmentation and Biological Motion Perception in Peripheral Visual Field

Biological motion perception is a specific type of perceptual organization, during which a clear image of a moving human body is perceptually generated in virtue of certain core light dots representing the major joint movements. While the processes of biological motion perception have been studied extensively for almost a century, there is still a debate on whether biological motion task performance can be equally precise across all visual field or is central visual field specified for biological motion perception. The current study explores the processes of biological motion perception and figure–ground segmentation in the central and peripheral visual field, expanding the understanding of perceptual organization across different eccentricities. The method involved three different tasks of visual grouping: (1) a static visual grouping task, (2) a dynamic visual grouping task, and (3) a biological motion detection task. The stimuli in (1) and (2) were generated from 12–13 dots grouped by proximity and common fate, and, in (3), light dots representing human motion. All stimuli were embedded in static or dynamics visual noise and the threshold value for the number of noise dots in which the elements could still be grouped by proximity and/or common fate was determined. The results demonstrate that biological motion can be differentiated from the scrambled set of moving dots in a more intensive visual noise than static and dynamic visual grouping tasks. Furthermore, in all three visual tasks (static and dynamic grouping, and biological motion detection) the performance was significantly worse in the periphery than in the central visual field, and object magnification could not compensate for the reduced performance in any of the three grouping tasks. The preliminary results of nine participants indicate that (a) human motion perception involves specific perceptual processes, providing the high-accuracy perception of the human body and (b) the processes of figure–ground segmentation are governed by the bottom-up processes and the best performance can be achieved only when the object is demonstrated in the central visual field.

Quantifying visual acuity for pre-clinical testing of visual prostheses

Objective.Visual prostheses currently restore only limited vision. More research and pre-clinical work are required to improve the devices and stimulation strategies that are used to induce neural activity that results in visual perception. Evaluation of candidate strategies and devices requires an objective way to convert measured and modelled patterns of neural activity into a quantitative measure of visual acuity.Approach.This study presents an approach that compares evoked patterns of neural activation with target and reference patterns. A d-prime measure of discriminability determines whether the evoked neural activation pattern is sufficient to discriminate between the target and reference patterns and thus provides a quantified level of visual perception in the clinical Snellen and MAR scales. The magnitude of the resulting value was demonstrated using scaled standardized 'C' and 'E' optotypes.Main results.The approach was used to assess the visual acuity provided by two alternative stimulation strategies applied to simulated retinal implants with different electrode pitch configurations and differently sized spreads of neural activity. It was found that when there is substantial overlap in neural activity generated by different electrodes, an estimate of acuity based only upon electrode pitch is incorrect; our proposed method gives an accurate result in both circumstances.Significance.Quantification of visual acuity using this approach in pre-clinical development will allow for more rapid and accurate prototyping of improved devices and neural stimulation strategies.

Variability of the Surface Area of the V1, V2, and V3 Maps in a Large Sample of Human Observers

How variable is the functionally defined structure of early visual areas in human cortex and how much variability is shared between twins? Here we quantify individual differences in the best understood functionally defined regions of cortex: V1, V2, V3. The Human Connectome Project 7T Retinotopy Dataset includes retinotopic measurements from 181 subjects (109 female, 72 male), including many twins. We trained four "anatomists" to manually define V1-V3 using retinotopic features. These definitions were more accurate than automated anatomical templates and showed that surface areas for these maps varied more than threefold across individuals. This threefold variation was little changed when normalizing visual area size by the surface area of the entire cerebral cortex. In addition to varying in size, we find that visual areas vary in how they sample the visual field. Specifically, the cortical magnification function differed substantially among individuals, with the relative amount of cortex devoted to central vision varying by more than a factor of 2. To complement the variability analysis, we examined the similarity of visual area size and structure across twins. Whereas the twin sample sizes are too small to make precise heritability estimates (50 monozygotic pairs, 34 dizygotic pairs), they nonetheless reveal high correlations, consistent with strong effects of the combination of shared genes and environment on visual area size. Collectively, these results provide the most comprehensive account of individual variability in visual area structure to date, and provide a robust population benchmark against which new individuals and developmental and clinical populations can be compared.SIGNIFICANCE STATEMENT Areas V1, V2, and V3 are among the best studied functionally defined regions in human cortex. Using the largest retinotopy dataset to date, we characterized the variability of these regions across individuals and the similarity between twin pairs. We find that the size of visual areas varies dramatically (up to 3.5×) across healthy young adults, far more than the variability of the cerebral cortex size as a whole. Much of this variability appears to arise from inherited factors, as we find very high correlations in visual area size between monozygotic twin pairs, and lower but still substantial correlations between dizygotic twin pairs. These results provide the most comprehensive assessment of how functionally defined visual cortex varies across the population to date.

How central and peripheral vision influence focal and ambient processing during scene viewing

Central and peripheral vision carry out different functions during scene processing. The ambient mode of visual processing is more likely to involve peripheral visual processes, whereas the focal mode of visual processing is more likely to involve central visual processes. Although the ambient mode is responsible for navigating space and comprehending scene layout, the focal mode gathers detailed information as central vision is oriented to salient areas of the visual field. Previous work suggests that during the time course of scene viewing, there is a transition from ambient processing during the first few seconds to focal processing during later time intervals, characterized by longer fixations and shorter saccades. In this study, we identify the influence of central and peripheral vision on changes in eye movements and the transition from ambient to focal processing during the time course of scene processing. Using a gaze-contingent protocol, we restricted the visual field to central or peripheral vision while participants freely viewed scenes for 20 seconds. Results indicated that fixation durations are shorter when vision is restricted to central vision compared to normal vision. During late visual processing, fixations in peripheral vision were longer than those in central vision. We show that a transition from more ambient to more focal processing during scene viewing will occur even when vision is restricted to only central vision or peripheral vision.

Motion adaptation improves acuity (but perceived size doesn't matter)

Recognition acuity—the minimum size of a high-contrast object that allows us to recognize it—is limited by optical and neural elements of the eye and by processing within the visual cortex. The perceived size of objects can be changed by motion-adaptation. Viewing receding or looming motion makes subsequently viewed stimuli appear to grow or shrink, respectively. It has been reported that resulting changes in perceived size impact recognition acuity. We set out to determine if such acuity changes are reliable and what drives this phenomenon. We measured the effect of adaptation to receding and looming motion on acuity for crowded tumbling-T stimuli (). We quantified the role of crowding, individuals’ susceptibility to motion-adaptation, and potentially confounding effects of pupil size and eye movements. Adaptation to receding motion made targets appear larger and improved acuity (–0.037 logMAR). Although adaptation to looming motion made targets appear smaller, it induced not the expected decrease in acuity but a modest acuity improvement (–0.018 logMAR). Further, each observer's magnitude of acuity change was not correlated with their individual perceived-size change following adaptation. Finally, we found no evidence that adaptation-induced acuity gains were related to crowding, fixation stability, or pupil size. Adaptation to motion modestly enhances visual acuity, but unintuitively, this is dissociated from perceived size. Ruling out fixation and pupillary behavior, we suggest that motion adaptation may improve acuity via incidental effects on sensitivity—akin to those arising from blur adaptation—which shift sensitivity to higher spatial frequency-tuned channels.

Horizontal connectivity in V1: Prediction of coherence in contour and motion integration

This study demonstrates the functional importance of the Surround context relayed laterally in V1 by the horizontal connectivity, in controlling the latency and the gain of the cortical response to the feedforward visual drive. We report here four main findings: 1) a centripetal apparent motion sequence results in a shortening of the spiking latency of V1 cells, when the orientation of the local inducer and the global motion axis are both co-aligned with the RF orientation preference; 2) this contextual effects grows with visual flow speed, peaking at 150–250°/s when it matches the propagation speed of horizontal connectivity (0.15–0.25 mm/ms); 3) For this speed range, the axial sensitivity of V1 cells is tilted by 90° to become co-aligned with the orientation preference axis; 4) the strength of modulation by the surround context correlates with the spatiotemporal coherence of the apparent motion flow. Our results suggest an internally-generated binding process, linking local (orientation /position) and global (motion/direction) features as early as V1. This long-range diffusion process constitutes a plausible substrate in V1 of the human psychophysical bias in speed estimation for collinear motion. Since it is demonstrated in the anesthetized cat, this novel form of contextual control of the cortical gain and phase is a built-in property in V1, whose expression does not require behavioral attention and top-down control from higher cortical areas. We propose that horizontal connectivity participates in the propagation of an internal “prediction” wave, shaped by visual experience, which links contour co-alignment and global axial motion at an apparent speed in the range of saccade-like eye movements.

How much can we differentiate at a brief glance: revealing the truer limit in conscious contents through the massive report paradigm (MRP)

Upon a brief glance, how well can we differentiate what we see from what we do not? Previous studies answered this question as 'poorly'. This is in stark contrast with our everyday experience. Here, we consider the possibility that previous restriction in stimulus variability and response alternatives reduced what participants could express from what they consciously experienced. We introduce a novel massive report paradigm that probes the ability to differentiate what we see from what we do not. In each trial, participants viewed a natural scene image and judged whether a small image patch was a part of the original image. To examine the limit of discriminability, we also included subtler changes in the image as modification of objects. Neither the images nor patches were repeated per participant. Our results showed that participants were highly accurate (accuracy greater than 80%) in differentiating patches from the viewed images from patches that are not present. Additionally, the differentiation between original and modified objects was influenced by object sizes and/or the congruence between objects and the scene gists. Our massive report paradigm opens a door to quantitatively measure the limit of immense informativeness of a moment of consciousness.

On the cortical mapping function - Visual space, cortical space, and crowding

The retino-cortical visual pathway is retinotopically organized: Neighbourhood relationships on the retina are preserved in the mapping. Size relationships in that mapping are also highly regular: The size of a patch in the visual field that maps onto a cortical patch of fixed size follows, along any radius and over a wide range, simply a linear function with retinal eccentricity. As a consequence, the mapping of retinal to cortical locations follows a logarithmic function along that radius. While this has already been shown by Fischer (1973, Vision Research, 13, 2113-2120), the link between the linear function - which describes the local behaviour by the cortical magnification factor M - and the logarithmic location function for the global behaviour, has never been made explicit. The present paper provides such a link as a set of ready-to-use equations using Levi and Klein's E₂ nomenclature, and examples for their validity and applicability in the mapping literature are discussed. The equations allow estimating M in the retinotopic centre; values thus derived from the literature show enormous, hitherto unnoticed, variability. A new structural parameter, d₂, is proposed to characterize the cortical map, as a counterpart to E₂; it shows much more stability. One pitfall is discussed and spelt out, namely the common myth that a pure logarithmic function, without constant term, will give an adequate map. The correct equations are finally extended to describe the cortical map of Bouma's law on visual crowding. The result contradicts recent suggestions that critical crowding distance corresponds to constant cortical distance.

Spatial tuning of face part representations within face-selective areas revealed by high-field fMRI

Regions sensitive to specific object categories as well as organized spatial patterns sensitive to different features have been found across the whole ventral temporal cortex (VTC). However, it is unclear that within each object category region, how specific feature representations are organized to support object identification. Would object features, such as object parts, be represented in fine-scale spatial tuning within object category-specific regions? Here, we used high-field 7T fMRI to examine the spatial tuning to different face parts within each face-selective region. Our results show consistent spatial tuning of face parts across individuals that within right posterior fusiform face area (pFFA) and right occipital face area (OFA), the posterior portion of each region was biased to eyes, while the anterior portion was biased to mouth and chin stimuli. Our results demonstrate that within the occipital and fusiform face processing regions, there exist systematic spatial tuning to different face parts that support further computation combining them.

Visual field differences in temporal synchrony processing for audio-visual stimuli

Audio-visual integration relies on temporal synchrony between visual and auditory inputs. However, differences in traveling and transmitting speeds between visual and auditory stimuli exist; therefore, audio-visual synchrony perception exhibits flexible functions. The processing speed of visual stimuli affects the perception of audio-visual synchrony. The present study examined the effects of visual fields, in which visual stimuli are presented, for the processing of audio-visual temporal synchrony. The point of subjective simultaneity, the temporal binding window, and the rapid recalibration effect were measured using temporal order judgment, simultaneity judgment, and stream/bounce perception, because different mechanisms of temporal processing have been suggested among these three paradigms. The results indicate that auditory stimuli should be presented earlier for visual stimuli in the central visual field than in the peripheral visual field condition in order to perceive subjective simultaneity in the temporal order judgment task conducted in this study. Meanwhile, the subjective simultaneity bandwidth was broader in the central visual field than in the peripheral visual field during the simultaneity judgment task. In the stream/bounce perception task, neither the point of subjective simultaneity nor the temporal binding window differed between the two types of visual fields. Moreover, rapid recalibration occurred in both visual fields during the simultaneity judgment tasks. However, during the temporal order judgment task and stream/bounce perception, rapid recalibration occurred only in the central visual field. These results suggest that differences in visual processing speed based on the visual field modulate the temporal processing of audio-visual stimuli. Furthermore, these three tasks, temporal order judgment, simultaneity judgment, and stream/bounce perception, each have distinct functional characteristics for audio-visual synchrony perception. Future studies are necessary to confirm the effects of compensation regarding differences in the temporal resolution of the visual field in later cortical visual pathways on visual field differences in audio-visual temporal synchrony.

Biologically Inspired Deep Learning Model for Efficient Foveal-Peripheral Vision

While abundant in biology, foveated vision is nearly absent from computational models and especially deep learning architectures. Despite considerable hardware improvements, training deep neural networks still presents a challenge and constraints complexity of models. Here we propose an end-to-end neural model for foveal-peripheral vision, inspired by retino-cortical mapping in primates and humans. Our model has an efficient sampling technique for compressing the visual signal such that a small portion of the scene is perceived in high resolution while a large field of view is maintained in low resolution. An attention mechanism for performing "eye-movements" assists the agent in collecting detailed information incrementally from the observed scene. Our model achieves comparable results to a similar neural architecture trained on full-resolution data for image classification and outperforms it at video classification tasks. At the same time, because of the smaller size of its input, it can reduce computational effort tenfold and uses several times less memory. Moreover, we present an easy to implement bottom-up and top-down attention mechanism which relies on task-relevant features and is therefore a convenient byproduct of the main architecture. Apart from its computational efficiency, the presented work provides means for exploring active vision for agent training in simulated environments and anthropomorphic robotics.

Predicting the retinotopic organization of human visual cortex from anatomy using geometric deep learning

Whether it be in a single neuron or a more complex biological system like the human brain, form and function are often directly related. The functional organization of human visual cortex, for instance, is tightly coupled with the underlying anatomy with cortical shape having been shown to be a useful predictor of the retinotopic organization in early visual cortex. Although the current state-of-the-art in predicting retinotopic maps is able to account for gross individual differences, such models are unable to account for any idiosyncratic differences in the structure-function relationship from anatomical information alone due to their initial assumption of a template. Here we developed a geometric deep learning model capable of exploiting the actual structure of the cortex to learn the complex relationship between brain function and anatomy in human visual cortex such that more realistic and idiosyncratic maps could be predicted. We show that our neural network was not only able to predict the functional organization throughout the visual cortical hierarchy, but that it was also able to predict nuanced variations across individuals. Although we demonstrate its utility for modeling the relationship between structure and function in human visual cortex, our approach is flexible and well-suited for a range of other applications involving data structured in non-Euclidean spaces.

Mechanoreceptor synapses in the brainstem shape the central representation of touch

Mammals use glabrous (hairless) skin of their hands and feet to navigate and manipulate their environment. Cortical maps of the body surface across species contain disproportionately large numbers of neurons dedicated to glabrous skin sensation, in part reflecting a higher density of mechanoreceptors that innervate these skin regions. Here, we find that disproportionate representation of glabrous skin emerges over postnatal development at the first synapse between peripheral mechanoreceptors and their central targets in the brainstem. Mechanoreceptor synapses undergo developmental refinement that depends on proximity of their terminals to glabrous skin, such that those innervating glabrous skin make synaptic connections that expand their central representation. In mice incapable of sensing gentle touch, mechanoreceptors innervating glabrous skin still make more powerful synapses in the brainstem. We propose that the skin region a mechanoreceptor innervates controls the developmental refinement of its central synapses to shape the representation of touch in the brain.

Shape discrimination in peripheral vision: Addressing pragmatic limitations of M-scaling radial frequency patterns

Peripheral worsening in shape discrimination (SD) can be compensated by size-scaling of peripheral stimuli. However, such scaling results in production of large stimuli that occupy a vast range of eccentricities. We used six proportionally decreasing spatial scales to address this pragmatic limitation and to explore how shape discrimination varies with radius in the nasal visual field. Five participants with normal vision discriminated circles and radial frequency (RF) patterns presented nasally to the fixation point at 5°, 10°, 15° and 20°. Stimuli were scaled with the nasal cortical magnification factor (nCMF) from a central stimulus in six spatial scales, which varied from 0.125 to 1, where 1 corresponded to 1.2° radius. Thresholds expressed in Weber fractions remained constant at eccentricities up to 20° regardless of the spatial scale. Weber fractions for the smaller spatial scales (0.125-0.5) were higher and more variable than for the larger spatial scales (0.75-1), yet still constant across periphery. The results provide evidence that peripheral shape discrimination is constrained by low-level properties, such as eccentricity, and can be predicted by the cortical magnification theory. However, above the peripheral modulation resolution limits, RF shape discrimination is based on the proportion between the modulation amplitude and the radius for larger scales (0.75-1), and demonstrates peripheral scale invariance for these stimuli. For eccentric shape discrimination tests, stimuli with low spatial frequency, high contrast, and radii corresponding to SS 0.75-0.875 should be used to ensure constant Weber fractions, small variability, and peripheral stimuli that are not excessively magnified.

Learning Invariant Object and Spatial View Representations in the Brain Using Slow Unsupervised Learning

First, neurophysiological evidence for the learning of invariant representations in the inferior temporal visual cortex is described. This includes object and face representations with invariance for position, size, lighting, view and morphological transforms in the temporal lobe visual cortex; global object motion in the cortex in the superior temporal sulcus; and spatial view representations in the hippocampus that are invariant with respect to eye position, head direction, and place. Second, computational mechanisms that enable the brain to learn these invariant representations are proposed. For the ventral visual system, one key adaptation is the use of information available in the statistics of the environment in slow unsupervised learning to learn transform-invariant representations of objects. This contrasts with deep supervised learning in artificial neural networks, which uses training with thousands of exemplars forced into different categories by neuronal teachers. Similar slow learning principles apply to the learning of global object motion in the dorsal visual system leading to the cortex in the superior temporal sulcus. The learning rule that has been explored in VisNet is an associative rule with a short-term memory trace. The feed-forward architecture has four stages, with convergence from stage to stage. This type of slow learning is implemented in the brain in hierarchically organized competitive neuronal networks with convergence from stage to stage, with only 4-5 stages in the hierarchy. Slow learning is also shown to help the learning of coordinate transforms using gain modulation in the dorsal visual system extending into the parietal cortex and retrosplenial cortex. Representations are learned that are in allocentric spatial view coordinates of locations in the world and that are independent of eye position, head direction, and the place where the individual is located. This enables hippocampal spatial view cells to use idiothetic, self-motion, signals for navigation when the view details are obscured for short periods.

Errors in visuospatial working memory across space and time

Visuospatial working memory (VSWM) involves cortical regions along the dorsal visual pathway, which are topographically organized with respect to the visual space. However, it remains unclear how such functional organization may constrain VSWM behavior across space and time. Here, we systematically mapped VSWM performance across the 2-dimensional (2D) space in various retention intervals in human subjects using the memory-guided and visually guided saccade tasks in two experiments. Relative to visually guided saccades, memory-guided saccades showed significant increases in unsystematic errors, or response variability, with increasing target eccentricity (3°–13° of visual angle). Unsystematic errors also increased with increasing delay (1.5–3 s, Experiment 1; 0.5–5 s, Experiment 2), while there was little or no interaction between delay and eccentricity. Continuous bump attractor modeling suggested neurophysiological and functional organization factors in the increasing unsystematic errors in VSWM across space and time. These findings indicate that: (1) VSWM representation may be limited by the functional topology of the visual pathway for the 2D space; (2) Unsystematic errors may reflect accumulated noise from memory maintenance while systematic errors may originate from non-mnemonic processes such as noisy sensorimotor transformation; (3) There may be independent mechanisms supporting the spatial and temporal processing of VSWM.

Combining stimulus types for improved coverage in population receptive field mapping

Retinotopy experiments using population receptive field (pRF) mapping are ideal for assigning regions in the visual field to cortical brain areas. While various designs for visual stimulation were suggested in the literature, all have specific shortcomings regarding visual field coverage. Here we acquired high-resolution 7 Tesla fMRI data to compare pRF-based coverage maps obtained with the two most commonly used stimulus variants: moving bars; rotating wedges and expanding rings. We find that stimulus selection biases the spatial distribution of pRF centres. In addition, eccentricity values and pRF sizes obtained from wedge/ring or bar stimulation runs show systematic differences. Wedge/ring stimulation results show lower eccentricity values and strongly reduced pRF sizes compared to bar stimulation runs. Statistical comparison shows significantly higher pRF centre numbers in the foveal 2° region of the visual field for wedge/ring compared to bar stimuli. We suggest and evaluate approaches for combining pRF data from different visual stimulus patterns to obtain improved mapping results.

Functional MRI of visual cortex predicts training-induced recovery in stroke patients with homonymous visual field defects

•

Damage to the visual brain typically leads to vision loss.

•

Vision loss may be partially recovered with visual restitution training (VRT)

•

Cortical responses to visual stimulation do not always lead to visual awareness.

•

A mismatch between Humphrey and neural perimetry predicts training outcome.

•

This finding has important implications for better rehabilitation strategies.

Post-chiasmatic damage to the visual system leads to homonymous visual field defects (HVDs), which can severely interfere with daily life activities. Visual Restitution Training (VRT) can recover parts of the affected visual field in patients with chronic HVDs, but training outcome is variable. An untested hypothesis suggests that training potential may be largest in regions with ‘neural reserve’, where cortical responses to visual stimulation do not lead to visual awareness as assessed by Humphrey perimetry—a standard behavioural visual field test. Here, we tested this hypothesis in a sample of twenty-seven hemianopic stroke patients, who participated in an assiduous 80-hour VRT program. For each patient, we collected Humphrey perimetry and wide-field fMRI-based retinotopic mapping data prior to training. In addition, we used Goal Attainment Scaling to assess whether personal activities in daily living improved. After training, we assessed with a second Humphrey perimetry measurement whether the visual field was improved and evaluated which personal goals were attained. Confirming the hypothesis, we found significantly larger improvements of visual sensitivity at field locations with neural reserve. These visual field improvements implicated both regions in primary visual cortex and higher order visual areas. In addition, improvement in daily life activities correlated with the extent of visual field enlargement. Our findings are an important step toward understanding the mechanisms of visual restitution as well as predicting training efficacy in stroke patients with chronic hemianopia.

Parallel Channels for Motion Feature Extraction in the Pretectum and Tectum of Larval Zebrafish

Non-cortical visual areas in vertebrate brains extract relevant stimulus features, such as motion, object size, and location, to support diverse behavioral tasks. The optic tectum and pretectum, two primary visual areas in zebrafish, are involved in motion processing, and yet their differential neural representation of behaviorally relevant visual features is unclear. Here, we characterize receptive fields (RFs) of motion-sensitive neurons in the diencephalon and midbrain. We show that RFs of many pretectal neurons are large and sample the lower visual field, whereas RFs of tectal neurons are mostly small-size selective and sample the upper nasal visual field more densely. Furthermore, optomotor swimming can reliably be evoked by presenting forward motion in the lower temporal visual field alone, matching the lower visual field bias of the pretectum. Thus, tectum and pretectum extract different visual features from distinct regions of visual space, which is likely a result of their adaptations to hunting and optomotor behavior, respectively.

Themes of advanced information processing in the primate brain

Here is a review of several empirical examples of information processing that occur in the primate cerebral cortex. These include visual processing, object identification and perception, information encoding, and memory. Also, there is a discussion of the higher scale neural organization, mainly theoretical, which suggests hypotheses on how the brain internally represents objects. Altogether they support the general attributes of the mechanisms of brain computation, such as efficiency, resiliency, data compression, and a modularization of neural function and their pathways. Moreover, the specific neural encoding schemes are expectedly stochastic, abstract and not easily decoded by theoretical or empirical approaches.

The relationship between retinal cone density and cortical magnification in human albinism

The human fovea lies at the center of the retina and supports high-acuity vision. In normal visual system development, the highest acuity is correlated with both a high density of cone photoreceptors in the fovea and a magnified retinotopic representation of the fovea in the visual cortex. Both cone density and the cortical area dedicated to each degree of visual space—the latter describing cortical magnification (CM)—steadily decrease with increasing eccentricity from the fovea. In albinism, peak cone density at the fovea and visual acuity are decreased, but seem to be within normal limits in the periphery, thus providing a model to explore the correlation between retinal structure, cortical structure, and behavior. Here, we used adaptive optics scanning light ophthalmoscopy to assess retinal cone density and functional magnetic resonance imaging to measure CM in the primary visual cortex of normal controls and individuals with albinism. We find that retinotopic organization is more varied among individuals with albinism than previously appreciated. Additionally, CM outside the fovea is similar to that in controls, but also more variable. CM in albinism and controls exceeds that which might be predicted based on cone density alone, but is more accurately predicted by retinal ganglion cell density. This finding suggests that decreased foveal cone density in albinism may be partially counteracted by nonuniform connectivity between cones and their downstream signaling partners. Together, these results emphasize that central as well as retinal factors must be included to provide a complete picture of aberrant structure and function in albinism.

Contextual encoder-decoder network for visual saliency prediction

Predicting salient regions in natural images requires the detection of objects that are present in a scene. To develop robust representations for this challenging task, high-level visual features at multiple spatial scales must be extracted and augmented with contextual information. However, existing models aimed at explaining human fixation maps do not incorporate such a mechanism explicitly. Here we propose an approach based on a convolutional neural network pre-trained on a large-scale image classification task. The architecture forms an encoder-decoder structure and includes a module with multiple convolutional layers at different dilation rates to capture multi-scale features in parallel. Moreover, we combine the resulting representations with global scene information for accurately predicting visual saliency. Our model achieves competitive and consistent results across multiple evaluation metrics on two public saliency benchmarks and we demonstrate the effectiveness of the suggested approach on five datasets and selected examples. Compared to state of the art approaches, the network is based on a lightweight image classification backbone and hence presents a suitable choice for applications with limited computational resources, such as (virtual) robotic systems, to estimate human fixations across complex natural scenes. Our TensorFlow implementation is openly available at https://github.com/alexanderkroner/saliency.

Shaping the visual system: cortical and subcortical plasticity in the intact and the lesioned brain

Visual system is endowed with an incredibly complex organization composed of multiple visual pathway affording both hierarchical and parallel processing. Even if most of the visual information is conveyed by the retina to the lateral geniculate nucleus of the thalamus and then to primary visual cortex, a wealth of alternative subcortical pathways is present. This complex organization is experience dependent and retains plastic properties throughout the lifespan enabling the system with a continuous update of its functions in response to variable external needs. Changes can be induced by several factors including learning and experience but can also be promoted by the use non-invasive brain stimulation techniques. Furthermore, besides the astonishing ability of our visual system to spontaneously reorganize after injuries, we now know that the exposure to specific rehabilitative training can produce not only important functional modifications but also long-lasting changes within cortical and subcortical structures. The present review aims to update and address the current state of the art on these topics gathering studies that reported relevant modifications of visual functioning together with plastic changes within cortical and subcortical structures both in the healthy and in the lesioned visual system.

Center-surround velocity-based segmentation: Speed, eccentricity, and timing of visual stimuli interact to determine interocular dominance

We used a novel method to capture the spatial dominance pattern of competing motion fields at rivalry onset. When rivaling velocities were different, the participants reported center-surround segmentation: The slower stimuli often dominated in the center while faster motion persisted along the borders. The size of the central static/slow field scaled with the stimulus size. The central dominance was time-locked to the static stimulus onset but was disrupted if the dynamic stimulus was presented later. We then used the same stimuli as masks in an interocular suppression paradigm. The local suppression strengths were probed with targets at different eccentricities. Consistent with the center-surround segmentation, target speed and location interacted with mask velocities. Specifically, suppression power of the slower masks was nonhomogenous with eccentricity, providing a potential explanation for center-surround velocity-based segmentation. This interaction of speed, eccentricity, and timing has implications for motion processing and interocular suppression. The influence of different masks on which target features get suppressed predicts that some "unconscious effects" are not generalizable across masks and, thus, need to be replicated under various masking conditions.

Reading in the presence of macular disease: a mini-review

Purpose

Reading is vital to full participation in modern society. To millions of people suffering from macular disease that results in a central scotoma, reading is difficult and inefficient, rendering reading as the primary goal for most patients seeking low vision rehabilitation. The goals of this review paper are to summarize the dependence of reading speed on several key visual and typographical factors and the current methods or technologies for improving reading performance for people with macular disease.

Important findings

In general, reading speed for people with macular disease depends on print size, text contrast, size of the visual span, temporal processing of letters and oculomotor control. Attempts at improving reading speed by reducing the crowding effect between letters, words or lines; or optimizing properties of typeface such as the presence of serifs or stroke‐width thickness proved to be futile, with any improvement being modest at best. Currently, the most promising method to improve reading speed for people with macular disease is training, including perceptual learning or oculomotor training.

Summary

The limitation on reading speed for people with macular disease is likely to be multi‐factorial. Future studies should try to understand how different factors interact to limit reading speed, and whether different methods could be combined to produce a much greater benefit.

A novel EEG paradigm to simultaneously and rapidly assess the functioning of auditory and visual pathways

Objective assessment of the sensory pathways is crucial for understanding their development across the life span and how they may be affected by neurodevelopmental disorders (e.g., autism spectrum) and neurological pathologies (e.g., stroke, multiple sclerosis, etc.). Quick and passive measurements, for example, using electroencephalography (EEG), are especially important when working with infants and young children and with patient populations having communication deficits (e.g., aphasia). However, many EEG paradigms are limited to measuring activity from one sensory domain at a time, may be time consuming, and target only a subset of possible responses from that particular sensory domain (e.g., only auditory brainstem responses or only auditory P1-N1-P2 evoked potentials). Thus we developed a new multisensory paradigm that enables simultaneous, robust, and rapid (6-12 min) measurements of both auditory and visual EEG activity, including auditory brainstem responses, auditory and visual evoked potentials, as well as auditory and visual steady-state responses. This novel method allows us to examine neural activity at various stations along the auditory and visual hierarchies with an ecologically valid continuous speech stimulus, while an unrelated video is playing. Both the speech stimulus and the video can be customized for any population of interest. Furthermore, by using two simultaneous visual steady-state stimulation rates, we demonstrate the ability of this paradigm to track both parafoveal and peripheral visual processing concurrently. We report results from 25 healthy young adults, which validate this new paradigm.NEW & NOTEWORTHY A novel electroencephalography paradigm enables the rapid, reliable, and noninvasive assessment of neural activity along both auditory and visual pathways concurrently. The paradigm uses an ecologically valid continuous speech stimulus for auditory evaluation and can simultaneously track visual activity to both parafoveal and peripheral visual space. This new methodology may be particularly appealing to researchers and clinicians working with infants and young children and with patient populations with limited communication abilities.

Peripheral visual localization is degraded by globally incongruent auditory-spatial attention cues

Global auditory-spatial orienting cues help the detection of weak visual stimuli, but it is not clear whether crossmodal attention cues also enhance the resolution of visuospatial discrimination. Here, we hypothesized that if anywhere, crossmodal modulations of visual localization should emerge in the periphery where the receptive fields are large. Subjects were presented with trials where a Visual Target, defined by a cluster of low-luminance dots, was shown for 220 ms at 25°-35° eccentricity in either the left or right hemifield. The Visual Target was either Uncued or it was presented 250 ms after a crossmodal Auditory Cue that was simulated either from the same or the opposite hemifield than the Visual Target location. After a whole-screen visual mask displayed for 800 ms, a pair of vertical Reference Bars was presented ipsilateral to the Visual Target. In a two-alternative forced choice task, subjects were asked to determine which of these two bars was closer to the center of the Visual Target. When the Auditory Cue and Visual Target were hemispatially incongruent, the speed and accuracy of visual localization performance was significantly impaired. However, hemispatially congruent Auditory Cues did not improve the localization of Visual Targets when compared to the Uncued condition. Further analyses suggested that the crossmodal Auditory Cues decreased the sensitivity (d') of the Visual Target localization without affecting post-perceptual decision biases. Our results suggest that in the visual periphery, the detrimental effect of hemispatially incongruent Auditory Cues is far greater than the benefit produced by hemispatially congruent cues. Our working hypothesis for future studies is that auditory-spatial attention cues suppress irrelevant visual locations in a global fashion, without modulating the local visual precision at relevant sites.

Running Large-Scale Simulations on the Neurorobotics Platform to Understand Vision - The Case of Visual Crowding

Traditionally, human vision research has focused on specific paradigms and proposed models to explain very specific properties of visual perception. However, the complexity and scope of modern psychophysical paradigms undermine the success of this approach. For example, perception of an element strongly deteriorates when neighboring elements are presented in addition (visual crowding). As it was shown recently, the magnitude of deterioration depends not only on the directly neighboring elements but on almost all elements and their specific configuration. Hence, to fully explain human visual perception, one needs to take large parts of the visual field into account and combine all the aspects of vision that become relevant at such scale. These efforts require sophisticated and collaborative modeling. The Neurorobotics Platform (NRP) of the Human Brain Project offers a unique opportunity to connect models of all sorts of visual functions, even those developed by different research groups, into a coherently functioning system. Here, we describe how we used the NRP to connect and simulate a segmentation model, a retina model, and a saliency model to explain complex results about visual perception. The combination of models highlights the versatility of the NRP and provides novel explanations for inward-outward anisotropy in visual crowding.

Human V2A: A map of the peripheral visual hemifield with functional connections to scene-selective cortex

Humans can recognize a scene in the blink of an eye. This gist-based visual scene perception is thought to be underpinned by specialized visual processing emphasizing the visual periphery at a cortical locus relatively low in the visual processing hierarchy. Using wide-field retinotopic mapping and population receptive field (pRF) modeling, we identified a new visual hemifield map anterior of area V2d and inferior to area V6, which we propose to call area V2A. Based on its location relative to other visual areas, V2A may correspond to area 23V described in nonhuman primates. The pRF analysis revealed unique receptive field properties for V2A: a large (FWHM ∼23°) and constant receptive field size across the central ∼70° of the visual field. Resting-state fMRI connectivity analysis further suggests that V2A is ideally suited to quickly feed the scene-processing network with information that is not biased towards the center of the visual field. Our findings not only indicate a likely cortical locus for the initial stages of gist-based visual scene perception, but also suggest a reappraisal of the organization of human dorsomedial occipital cortex with a strip of separate hemifield representations anterior to the early visual areas (V1, V2d, and V3d).

Studying the role of 10-2 visual field test in different stages of glaucoma

Objective:

To assess the role of 10-2 visual field (VF) test in different stages of glaucoma.

Methods:

In our prospective comparative study, 24-2 and 10-2 VF tests were done for 115 eyes with different stages of glaucomatous damage or glaucoma suspects. Optical coherence tomography (OCT) was performed in 79 eyes. We compared field changes of the central 10° on 10-2 and 24-2 tests and studied the correlation between the mean deviation (MD) measured by the two tests.

Results:

In seven glaucoma suspects, glaucoma diagnosis was missed by 24-2 test but was detected by 10-2 test and confirmed by OCT. In the eyes with early damage, there was no correlation between 10-2 and 24-2 tests regarding the MD of the central 10º. In moderate and severe stages, there was a significant correlation between the results of 24-2 and 10-2 tests.

Conclusion:

We concluded that 10-2 test could help confirm glaucoma diagnosis in glaucoma suspects missed by 24-2 test before resorting to the more expensive OCT. In early glaucoma, we noted that 10-2, as confirmed by OCT, was a beneficial addition to 24-2 test for precise measurement of the MD and detection of defects of the central 10º missed by 24-2 test, where more intense treatment should be considered to preserve the threatened central visual function. In moderate and severe cases, the role of 10-2 test was not as pivotal as in early cases, but still it was useful for assessment of residual central visual function in severe cases with absolute central 10º defects on 24-2 test for proper management.

Independent working memory resources for egocentric and allocentric spatial information

Visuospatial working memory enables us to maintain access to visual information for processing even when a stimulus is no longer present, due to occlusion, our own movements, or transience of the stimulus. Here we show that, when localizing remembered stimuli, the precision of spatial recall does not rely solely on memory for individual stimuli, but additionally depends on the relative distances between stimuli and visual landmarks in the surroundings. Across three separate experiments, we consistently observed a spatially selective improvement in the precision of recall for items located near a persistent landmark. While the results did not require that the landmark be visible throughout the memory delay period, it was essential that it was visible both during encoding and response. We present a simple model that can accurately capture human performance by considering relative (allocentric) spatial information as an independent localization estimate which degrades with distance and is optimally integrated with egocentric spatial information. Critically, allocentric information was encoded without cost to egocentric estimation, demonstrating independent storage of the two sources of information. Finally, when egocentric and allocentric estimates were put in conflict, the model successfully predicted the resulting localization errors. We suggest that the relative distance between stimuli represents an additional, independent spatial cue for memory recall. This cue information is likely to be critical for spatial localization in natural settings which contain an abundance of visual landmarks.

Linkage between retinal ganglion cell density and the nonuniform spatial integration across the visual field

The integration of visual information over space is critical to human pattern vision. For either luminance detection or object recognition, the position of the target in the visual field governs the size of a window within which visual information is integrated. Here we analyze the relationship between the topographic distribution of ganglion cell density and the nonuniform spatial integration across the visual field. We find that the variation in the retinal ganglion cell (RGC) density across the human retina is closely matched to the variation in the extent of spatial integration. Our study suggests that a fixed number of RGCs subserves spatial integration of visual input, independent of the visual-field location.

The ability to integrate visual information over space is a fundamental component of human pattern vision. Regardless of whether it is for detecting luminance contrast or for recognizing objects in a cluttered scene, the position of the target in the visual field governs the size of a window within which visual information is integrated. Here we analyze the relationship between the topographic distribution of ganglion cell density and the nonuniform spatial integration across the visual field. The extent of spatial integration for luminance detection (Ricco’s area) and object recognition (crowding zone) are measured at various target locations. The number of retinal ganglion cells (RGCs) underlying Ricco’s area or crowding zone is estimated by computing the product of Ricco’s area (or crowding zone) and RGC density for a given target location. We find a quantitative agreement between the behavioral data and the RGC density: The variation in the sampling density of RGCs across the human retina is closely matched to the variation in the extent of spatial integration required for either luminance detection or object recognition. Our empirical data combined with the simulation results of computational models suggest that a fixed number of RGCs subserves spatial integration of visual input, independent of the visual-field location.

CMOS stimulating chips capable of wirelessly driving 473 electrodes for a cortical vision prosthesis

OBJECTIVE

Implantable neural stimulating and recording devices have the potential to restore capabilities such as vision or motor control to disabled patients, improving quality of life. Implants with a large number of stimulating electrodes typically utilize implanted batteries and/or subcutaneous wiring to deal with their high-power consumption and high data throughput needed to address all electrodes with low latency. The use of batteries places severe limitations on the implant's size, usable duty cycle, device longevity while subcutaneous wiring increases the risk of infection and mechanical damage due to device movement.

APPROACH

To overcome these limitations, we have designed and implemented a system that supports up to 473 implanted stimulating microelectrodes, all wirelessly powered and individually controlled by micropower application specific integrated circuits (ASICs).

MAIN RESULTS

Each ASIC controls 43 electrodes and draws 3.18 mW of power when stimulating through 24 channels. We measured the linearity of the digital-to-analog convertors (DACs) to be 0.21 LSB (integrated non-linearity) and the variability in timing of stimulation pulses across ASICs to be 172 ns.

SIGNIFICANCE

This work demonstrates the feasibility of a new low power ASIC designed to be implanted in the visual cortex of humans. The fully implantable device will greatly reduce the risks of infection and damage due to mechanical issues.