Eccentricity-dependent temporal contrast tuning in human visual cortex measured with fMRI

Temporal Sensitivity for Achromatic and Chromatic Flicker across the Visual Cortex

The retinal ganglion cells (RGCs) receive different combinations of L, M, and S cone inputs and give rise to one achromatic and two chromatic postreceptoral channels. The goal of the current study was to determine temporal sensitivity across the three postreceptoral channels in subcortical and cortical regions involved in human vision. We measured functional magnetic resonance imaging (fMRI) responses at 7 T from three participants (two males, one female) viewing a high-contrast, flickering, spatially uniform wide field (∼140°). Stimulus flicker frequency varied logarithmically between 2 and 64 Hz and targeted the L + M + S, L - M, and S - (L + M) cone combinations. These measurements were used to create temporal sensitivity functions of the primary visual cortex (V1) across eccentricity and spatially averaged responses from the lateral geniculate nucleus (LGN), and the V2/V3, hV4, and V3A/B regions. fMRI responses reflected the known properties of the visual system, including higher peak temporal sensitivity to achromatic versus chromatic stimuli and low-pass filtering between the LGN and V1. Peak temporal sensitivity increased across levels of the cortical visual hierarchy. Unexpectedly, peak temporal sensitivity varied little across eccentricity within area V1. Measures of adaptation and distributed pattern activity revealed a subtle influence of 64 Hz achromatic flicker in area V1, despite this stimulus evoking only a minimal overall response. The comparison of measured cortical responses to a model of the integrated retinal output to our stimuli demonstrates that extensive filtering and amplification are applied to postretinal signals.

Temporal sensitivity for achromatic and chromatic flicker across the visual cortex

The retinal ganglion cells (RGCs) receive different combinations of L, M, and S cone inputs and give rise to one achromatic and two chromatic post-receptoral channels. Beyond the retina, RGC outputs are subject to filtering and normalization along the geniculo-striate pathway, ultimately producing the properties of human vision. The goal of the current study was to determine temporal sensitivity across the three post-receptoral channels in subcortical and cortical regions involved in vision. We measured functional magnetic resonance imaging (MRI) responses at 7 Tesla from three participants (two males, one female) viewing a high-contrast, flickering, spatially-uniform wide field (~140°). Stimulus flicker frequency varied logarithmically between 2 and 64 Hz and targeted the L+M+S, L-M, and S-[L+M] cone combinations. These measurements were used to create temporal sensitivity functions of primary visual cortex (V1) across eccentricity, and spatially averaged responses from lateral geniculate nucleus (LGN), V2/V3, hV4, and V3A/B. Functional MRI responses reflected known properties of the visual system, including higher peak temporal sensitivity to achromatic vs. chromatic stimuli, and low-pass filtering between the LGN and V1. Peak temporal sensitivity increased across levels of the cortical visual hierarchy. Unexpectedly, peak temporal sensitivity varied little across eccentricity within area V1. Measures of adaptation and distributed pattern activity revealed a subtle influence of 64 Hz achromatic flicker in area V1, despite this stimulus evoking only a minimal overall response. Comparison of measured cortical responses to a model of integrated retinal output to our stimuli demonstrates that extensive filtering and amplification is applied to post-retinal signals.

Characterizing Spatiotemporal Population Receptive Fields in Human Visual Cortex with fMRI

The use of fMRI and computational modeling has advanced understanding of spatial characteristics of population receptive fields (pRFs) in human visual cortex. However, we know relatively little about the spatiotemporal characteristics of pRFs because neurons' temporal properties are one to two orders of magnitude faster than fMRI BOLD responses. Here, we developed an image-computable framework to estimate spatiotemporal pRFs from fMRI data. First, we developed a simulation software that predicts fMRI responses to a time-varying visual input given a spatiotemporal pRF model and solves the model parameters. The simulator revealed that ground-truth spatiotemporal parameters can be accurately recovered at the millisecond resolution from synthesized fMRI responses. Then, using fMRI and a novel stimulus paradigm, we mapped spatiotemporal pRFs in individual voxels across human visual cortex in 10 participants (both females and males). We find that a compressive spatiotemporal (CST) pRF model better explains fMRI responses than a conventional spatial pRF model across visual areas spanning the dorsal, lateral, and ventral streams. Further, we find three organizational principles of spatiotemporal pRFs: (1) from early to later areas within a visual stream, spatial and temporal windows of pRFs progressively increase in size and show greater compressive nonlinearities, (2) later visual areas show diverging spatial and temporal windows across streams, and (3) within early visual areas (V1-V3), both spatial and temporal windows systematically increase with eccentricity. Together, this computational framework and empirical results open exciting new possibilities for modeling and measuring fine-grained spatiotemporal dynamics of neural responses using fMRI.

Electrophysiological model of human temporal contrast sensitivity based on SSVEP

The present study aims to connect the psychophysical research on the human visual perception of flicker with the neurophysiological research on steady-state visual evoked potentials (SSVEPs) in the context of their application needs and current technological developments. In four experiments, we investigated whether a temporal contrast sensitivity model could be established based on the electrophysiological responses to repetitive visual stimulation and, if so, how this model compares to the psychophysical models of flicker visibility. We used data from 62 observers viewing periodic flicker at a range of frequencies and modulation depths sampled around the perceptual visibility thresholds. The resulting temporal contrast sensitivity curve (TCSC) was similar in shape to its psychophysical counterpart, confirming that the human visual system is most sensitive to repetitive visual stimulation at frequencies between 10 and 20 Hz. The electrophysiological TCSC, however, was below the psychophysical TCSC measured in our experiments for lower frequencies (1-50 Hz), crossed it when the frequency was 50 Hz, and stayed above while decreasing at a slower rate for frequencies in the gamma range (40-60 Hz). This finding provides evidence that SSVEPs could be measured even without the conscious perception of flicker, particularly at frequencies above 50 Hz. The cortical and perceptual mechanisms that apply at higher temporal frequencies, however, do not seem to directly translate to lower frequencies. The presence of harmonics, which show better response for many frequencies, suggests non-linear processing in the visual system. These findings are important for the potential applications of SSVEPs in studying, assisting, or augmenting human cognitive and sensorimotor functions.

Polar angle asymmetries in visual perception and neural architecture

Human visual performance changes with visual field location. It is best at the center of gaze and declines with eccentricity, and also varies markedly with polar angle. These perceptual polar angle asymmetries are linked to asymmetries in the organization of the visual system. We review and integrate research quantifying how performance changes with visual field location and how this relates to neural organization at multiple stages of the visual system. We first briefly review how performance varies with eccentricity and the neural foundations of this effect. We then focus on perceptual polar angle asymmetries and their neural foundations. Characterizing perceptual and neural variations across and around the visual field contributes to our understanding of how the brain translates visual signals into neural representations which form the basis of visual perception.

Mechanisms of speed encoding in the human middle temporal cortex measured by 7T fMRI

Perception of dynamic scenes in our environment results from the evaluation of visual features such as the fundamental spatial and temporal frequency components of a moving object. The ratio between these two components represents the object's speed of motion. The human middle temporal cortex hMT+ has a crucial biological role in the direct encoding of object speed. However, the link between hMT+ speed encoding and the spatiotemporal frequency components of a moving object is still under explored. Here, we recorded high resolution 7T blood oxygen level-dependent BOLD responses to different visual motion stimuli as a function of their fundamental spatial and temporal frequency components. We fitted each hMT+ BOLD response with a 2D Gaussian model allowing for two different speed encoding mechanisms: (1) distinct and independent selectivity for the spatial and temporal frequencies of the visual motion stimuli; (2) pure tuning for the speed of motion. We show that both mechanisms occur but in different neuronal groups within hMT+, with the largest subregion of the complex showing separable tuning for the spatial and temporal frequency of the visual stimuli. Both mechanisms were highly reproducible within participants, reconciling single cell recordings from MT in animals that have showed both encoding mechanisms. Our findings confirm that a more complex process is involved in the perception of speed than initially thought and suggest that hMT+ plays a primary role in the evaluation of the spatial features of the moving visual input.

Cortical magnification eliminates differences in contrast sensitivity across but not around the visual field

Human visual performance changes dramatically both across (eccentricity) and around (polar angle) the visual field. Performance is better at the fovea, decreases with eccentricity, and is better along the horizontal than vertical meridian and along the lower than the upper vertical meridian. However, all neurophysiological and virtually all behavioral studies of cortical magnification have investigated eccentricity effects without considering polar angle. Most performance differences due to eccentricity are eliminated when stimulus size is cortically magnified (M-scaled) to equate the size of its cortical representation in primary visual cortex (V1). But does cortical magnification underlie performance differences around the visual field? Here, to assess contrast sensitivity, human adult observers performed an orientation discrimination task with constant stimulus size at different locations as well as when stimulus size was M-scaled according to stimulus eccentricity and polar angle location. We found that although M-scaling stimulus size eliminates differences across eccentricity, it does not eliminate differences around the polar angle. This finding indicates that limits in contrast sensitivity across eccentricity and around polar angle of the visual field are mediated by different anatomical and computational constraints.

Linking individual differences in human primary visual cortex to contrast sensitivity around the visual field

A central question in neuroscience is how the organization of cortical maps relates to perception, for which human primary visual cortex (V1) is an ideal model system. V1 nonuniformly samples the retinal image, with greater cortical magnification (surface area per degree of visual field) at the fovea than periphery and at the horizontal than vertical meridian. Moreover, the size and cortical magnification of V1 varies greatly across individuals. Here, we used fMRI and psychophysics in the same observers to quantify individual differences in V1 cortical magnification and contrast sensitivity at the four polar angle meridians. Across observers, the overall size of V1 and localized cortical magnification positively correlated with contrast sensitivity. Moreover, greater cortical magnification and higher contrast sensitivity at the horizontal than the vertical meridian were strongly correlated. These data reveal a link between cortical anatomy and visual perception at the level of individual observer and stimulus location.

Visual field differences in temporal synchrony processing for audio-visual stimuli

Audio-visual integration relies on temporal synchrony between visual and auditory inputs. However, differences in traveling and transmitting speeds between visual and auditory stimuli exist; therefore, audio-visual synchrony perception exhibits flexible functions. The processing speed of visual stimuli affects the perception of audio-visual synchrony. The present study examined the effects of visual fields, in which visual stimuli are presented, for the processing of audio-visual temporal synchrony. The point of subjective simultaneity, the temporal binding window, and the rapid recalibration effect were measured using temporal order judgment, simultaneity judgment, and stream/bounce perception, because different mechanisms of temporal processing have been suggested among these three paradigms. The results indicate that auditory stimuli should be presented earlier for visual stimuli in the central visual field than in the peripheral visual field condition in order to perceive subjective simultaneity in the temporal order judgment task conducted in this study. Meanwhile, the subjective simultaneity bandwidth was broader in the central visual field than in the peripheral visual field during the simultaneity judgment task. In the stream/bounce perception task, neither the point of subjective simultaneity nor the temporal binding window differed between the two types of visual fields. Moreover, rapid recalibration occurred in both visual fields during the simultaneity judgment tasks. However, during the temporal order judgment task and stream/bounce perception, rapid recalibration occurred only in the central visual field. These results suggest that differences in visual processing speed based on the visual field modulate the temporal processing of audio-visual stimuli. Furthermore, these three tasks, temporal order judgment, simultaneity judgment, and stream/bounce perception, each have distinct functional characteristics for audio-visual synchrony perception. Future studies are necessary to confirm the effects of compensation regarding differences in the temporal resolution of the visual field in later cortical visual pathways on visual field differences in audio-visual temporal synchrony.

Is Developmental Dyslexia Due to a Visual and Not a Phonological Impairment?

It is a widely held belief that developmental dyslexia (DD) is a phonological disorder in which readers have difficulty associating graphemes with their corresponding phonemes. In contrast, the magnocellular theory of dyslexia assumes that DD is a visual disorder caused by dysfunctional magnocellular neural pathways. The review explores arguments for and against these theories. Recent results have shown that DD is caused by (1) a reduced ability to simultaneously recognize sequences of letters that make up words, (2) longer fixation times required to simultaneously recognize strings of letters, and (3) amplitudes of saccades that do not match the number of simultaneously recognized letters. It was shown that pseudowords that could not be recognized simultaneously were recognized almost without errors when the fixation time was extended. However, there is an individual maximum number of letters that each reader with DD can recognize simultaneously. Findings on the neurobiological basis of temporal summation have shown that a necessary prolongation of fixation times is due to impaired processing mechanisms of the visual system, presumably involving magnocells and parvocells. An area in the mid-fusiform gyrus also appears to play a significant role in the ability to simultaneously recognize words and pseudowords. The results also contradict the assumption that DD is due to a lack of eye movement control. The present research does not support the assumption that DD is caused by a phonological disorder but shows that DD is due to a visual processing dysfunction.

Defective Temporal Window of the Foveal Visual Processing in High Myopia

Purpose

To investigate the temporal characteristics of visual processing at the fovea and the periphery in high myopia.

Methods

Eighteen low (LM, ≤ -0.50 and > -6.00 D) and 18 high myopic (HM, ≤ -6.00 D) participants took part in this study. The contrast thresholds in an orientation discrimination task under various stimulus onset asynchrony (SOA) masking conditions were measured at the fovea and a more peripheral area (7°) for the two groups. An elaborated perceptual template model (ePTM) was fit to the behavioral data for each participant.

Results

An analysis of variance with three factors (SOA, degree of myopia and eccentricity) was performed on the threshold data. The interaction between SOA and degree of myopia in the fovea was significant (F (4, 128) = 2.66, P = 0.036), suggesting that the masking effect had different temporal patterns between the two groups. The temporal profiles for the two groups were derived based on the ePTM model. The peak and the spread of the temporal window in the fovea were much lower and wider, respectively, in the HM group than that in the LM group (both Ps < 0.05). There was no significant difference in the peripheral temporal window between the two groups.

Conclusions

High myopia is associated with defective temporal processing in the fovea, captured by a flattened temporal window.

Stimulus-dependent contrast sensitivity asymmetries around the visual field

Asymmetries in visual performance at isoeccentric locations are well-documented and functionally important. At a fixed eccentricity, visual performance is best along the horizontal, intermediate along the lower vertical, and poorest along the upper vertical meridian. These performance fields are pervasive across a range of visual tasks, including those mediated by contrast sensitivity. However, contrast performance fields have not been characterized with a systematic manipulation of stimulus spatial frequency, eccentricity, and size; three parameters that constrain contrast sensitivity. Further, individual differences in performance fields measurements have not been assessed. Here, we use an orientation discrimination task to characterize the pattern of contrast sensitivity across four isoeccentric locations along the cardinal meridians, and to examine whether and how this asymmetry pattern changes with systematic manipulation of stimulus spatial frequency (4 cpd to 8 cpd), eccentricity (4.5 degrees to 9 degrees), and size (3 degrees visual angle to 6 degrees visual angle). Our data demonstrate that contrast sensitivity is highest along the horizontal, intermediate along the lower vertical, and poorest along the upper vertical meridian. This pattern is consistent across stimulus parameter manipulations, even though they cause profound shifts in contrast sensitivity. Eccentricity-dependent decreases in contrast sensitivity can be compensated for by scaling stimulus size alone. Moreover, we find that individual variability in the strength of performance field asymmetries is consistent across conditions. This study is the first to systematically and jointly manipulate, and compare, contrast performance fields across spatial frequency, eccentricity, and size, and to address individual variability in performance fields.

Concomitant modulation of BOLD responses in white matter pathways and cortex

In response to a flickering visual stimulus, the BOLD response in primary visual cortex varies with the flickering frequency and is maximal when it is close to 8Hz. In previous studies we demonstrated that BOLD signals in specific white matter (WM) pathways covary with the alternations between stimulus conditions in a block design in similar manner to gray matter (GM) regions. Here we investigated whether WM tracts show varying responses to changes in flicker frequency and are modulated in the same manner as cortical areas. We used a Fourier analysis of BOLD signals to measure the signal amplitude and phase at the fundamental frequency of a block-design task in which flickering visual stimuli alternated with blank presentations, avoiding the assumption of any specific hemodynamic response function. The BOLD responses in WM pathways and the primary visual cortex were evaluated for flicker frequencies varying between 2 and 14Hz. The variations with frequency of BOLD signals in specific WM tracts followed closely those in primary visual cortex, suggesting that variations in cortical activation are directly coupled to corresponding BOLD signals in connected WM tracts. Statistically significant differences in the timings of BOLD responses were also measured between visual cortex and specific WM bundles. These results confirm that when cortical BOLD responses are modulated by selecting different task parameters, relevant WM tracts exhibit corresponding BOLD signals that are also affected.

Center-surround velocity-based segmentation: Speed, eccentricity, and timing of visual stimuli interact to determine interocular dominance

We used a novel method to capture the spatial dominance pattern of competing motion fields at rivalry onset. When rivaling velocities were different, the participants reported center-surround segmentation: The slower stimuli often dominated in the center while faster motion persisted along the borders. The size of the central static/slow field scaled with the stimulus size. The central dominance was time-locked to the static stimulus onset but was disrupted if the dynamic stimulus was presented later. We then used the same stimuli as masks in an interocular suppression paradigm. The local suppression strengths were probed with targets at different eccentricities. Consistent with the center-surround segmentation, target speed and location interacted with mask velocities. Specifically, suppression power of the slower masks was nonhomogenous with eccentricity, providing a potential explanation for center-surround velocity-based segmentation. This interaction of speed, eccentricity, and timing has implications for motion processing and interocular suppression. The influence of different masks on which target features get suppressed predicts that some "unconscious effects" are not generalizable across masks and, thus, need to be replicated under various masking conditions.

Resolving the Spatial Profile of Figure Enhancement in Human V1 through Population Receptive Field Modeling

The detection and segmentation of meaningful figures from their background is one of the primary functions of vision. While work in nonhuman primates has implicated early visual mechanisms in this figure-ground modulation, neuroimaging in humans has instead largely ascribed the processing of figures and objects to higher stages of the visual hierarchy. Here, we used high-field fMRI at 7 Tesla to measure BOLD responses to task-irrelevant orientation-defined figures in human early visual cortex (N = 6, four females). We used a novel population receptive field mapping-based approach to resolve the spatial profiles of two constituent mechanisms of figure-ground modulation: a local boundary response, and a further enhancement spanning the full extent of the figure region that is driven by global differences in features. Reconstructing the distinct spatial profiles of these effects reveals that figure enhancement modulates responses in human early visual cortex in a manner consistent with a mechanism of automatic, contextually driven feedback from higher visual areas.SIGNIFICANCE STATEMENT A core function of the visual system is to parse complex 2D input into meaningful figures. We do so constantly and seamlessly, both by processing information about visible edges and by analyzing large-scale differences between figure and background. While influential neurophysiology work has characterized an intriguing mechanism that enhances V1 responses to perceptual figures, we have a poor understanding of how the early visual system contributes to figure-ground processing in humans. Here, we use advanced computational analysis methods and high-field human fMRI data to resolve the distinct spatial profiles of local edge and global figure enhancement in the early visual system (V1 and LGN); the latter is distinct and consistent with a mechanism of automatic, stimulus-driven feedback from higher-level visual areas.

Visual temporal frequency preference shows a distinct cortical architecture using fMRI

Studies of visual temporal frequency preference typically examine frequencies under 20 Hz and measure local activity to evaluate the sensitivity of different cortical areas to variations in temporal frequencies. Most of these studies have not attempted to map preferred temporal frequency within and across visual areas, nor have they explored in detail, stimuli at gamma frequency, which recent research suggests may have potential clinical utility. In this study, we address this gap by using functional magnetic resonance imaging (fMRI) to measure response to flickering visual stimuli varying in frequency from 1 to 40 Hz. We apply stimulation in both a block design to examine task response and a steady-state design to examine functional connectivity. We observed distinct activation patterns between 1 Hz and 40 Hz stimuli. We also found that the correlation between medial thalamus and visual cortex was modulated by the temporal frequency. The modulation functions and tuned frequencies are different for the visual activity and thalamo-visual correlations. Using both fMRI activity and connectivity measurements, we show evidence for a temporal frequency specific organization across the human visual system.

Dissociable laminar profiles of concurrent bottom-up and top-down modulation in the human visual cortex

Recent developments in human neuroimaging make it possible to non-invasively measure neural activity from different cortical layers. This can potentially reveal not only which brain areas are engaged by a task, but also how. Specifically, bottom-up and top-down responses are associated with distinct laminar profiles. Here, we measured lamina-resolved fMRI responses during a visual task designed to induce concurrent bottom-up and top-down modulations via orthogonal manipulations of stimulus contrast and feature-based attention. BOLD responses were modulated by both stimulus contrast (bottom-up) and by engaging feature-based attention (top-down). Crucially, these effects operated at different cortical depths: Bottom-up modulations were strongest in the middle cortical layer and weaker in deep and superficial layers, while top-down modulations were strongest in the superficial layers. As such, we demonstrate that laminar activity profiles can discriminate between concurrent top-down and bottom-up processing, and are diagnostic of how a brain region is activated.