Separate spatial and temporal frequency tuning to visual motion in human MT+ measured with ECoG

Competing Visual Cues Revealed by Electroencephalography: Sensitivity to Motion Speed and Direction

Motion speed and direction are two fundamental cues for the mammalian visual system. Neurons in various places of the neocortex show tuning properties in term of firing frequency to both speed and direction. The present study applied a 32-channel electroencephalograph (EEG) system to 13 human subjects while they were observing a single object moving with different speeds in various directions from the center of view to the periphery on a computer monitor. Depending on the experimental condition, the subjects were either required to fix their gaze at the center of the monitor while the object was moving or to track the movement with their gaze; eye-tracking glasses were used to ensure that they followed instructions. In each trial, motion speed and direction varied randomly and independently, forming two competing visual features. EEG signal classification was performed for each cue separately (e.g., 11 speed values or 11 directions), regardless of variations in the other cue. Under the eye-fixed condition, multiple subjects showed distinct preferences to motion direction over speed; however, two outliers showed superb sensitivity to speed. Under the eye-tracking condition, in which the EEG signals presumably contained ocular movement signals, all subjects showed predominantly better classification for motion direction. There was a trend that speed and direction were encoded by different electrode sites. Since EEG is a noninvasive and portable approach suitable for brain-computer interfaces (BCIs), this study provides insights on fundamental knowledge of the visual system as well as BCI applications based on visual stimulation.

Mechanisms of speed encoding in the human middle temporal cortex measured by 7T fMRI

Perception of dynamic scenes in our environment results from the evaluation of visual features such as the fundamental spatial and temporal frequency components of a moving object. The ratio between these two components represents the object's speed of motion. The human middle temporal cortex hMT+ has a crucial biological role in the direct encoding of object speed. However, the link between hMT+ speed encoding and the spatiotemporal frequency components of a moving object is still under explored. Here, we recorded high resolution 7T blood oxygen level-dependent BOLD responses to different visual motion stimuli as a function of their fundamental spatial and temporal frequency components. We fitted each hMT+ BOLD response with a 2D Gaussian model allowing for two different speed encoding mechanisms: (1) distinct and independent selectivity for the spatial and temporal frequencies of the visual motion stimuli; (2) pure tuning for the speed of motion. We show that both mechanisms occur but in different neuronal groups within hMT+, with the largest subregion of the complex showing separable tuning for the spatial and temporal frequency of the visual stimuli. Both mechanisms were highly reproducible within participants, reconciling single cell recordings from MT in animals that have showed both encoding mechanisms. Our findings confirm that a more complex process is involved in the perception of speed than initially thought and suggest that hMT+ plays a primary role in the evaluation of the spatial features of the moving visual input.

FMRI and intra-cranial electrocorticography recordings in the same human subjects reveals negative BOLD signal coupled with silenced neuronal activity

Positive blood oxygenation level-dependent (BOLD) responses (PBR), as measured by functional Magnetic Resonance Imaging (fMRI), are the most utilized measurements to non-invasively map activity in the brain. Recent studies have consistently shown that BOLD responses are not exclusively positive. Negative BOLD responses (NBR) have been reported in response to specific sensory stimulations and tasks. However, the exact relationship between NBR and the underlying metabolic and neuronal demand is still under debate. In this study, we investigated the neurophysiological basis of negative BOLD using fMRI and intra-cranial electrophysiology (electrocorticography, ECoG) measurements from the same human participants. We show that, for those electrodes that responded to visual stimulation, PBR are correlated with high-frequency band (HFB) responses. Crucially, NBR were associated with an absence of HFB power responses and an unpredicted decrease in the alpha power responses.

Electrocorticography Evidence of Tactile Responses in Visual Cortices

There is ongoing debate regarding the extent to which human cortices are specialized for processing a given sensory input versus a given type of information, independently of the sensory source. Many neuroimaging and electrophysiological studies have reported that primary and extrastriate visual cortices respond to tactile and auditory stimulation, in addition to visual inputs, suggesting these cortices are intrinsically multisensory. In particular for tactile responses, few studies have proven neuronal processes in visual cortex in humans. Here, we assessed tactile responses in both low-level and extrastriate visual cortices using electrocorticography recordings in a human participant. Specifically, we observed significant spectral power increases in the high frequency band (30-100 Hz) in response to tactile stimuli, reportedly associated with spiking neuronal activity, in both low-level visual cortex (i.e. V2) and in the anterior part of the lateral occipital-temporal cortex. These sites were both involved in processing tactile information and responsive to visual stimulation. More generally, the present results add to a mounting literature in support of task-sensitive and sensory-independent mechanisms underlying functions like spatial, motion, and self-processing in the brain and extending from higher-level as well as to low-level cortices.

Cortical network responses map onto data-driven features that capture visual semantics of movie fragments

Research on how the human brain extracts meaning from sensory input relies in principle on methodological reductionism. In the present study, we adopt a more holistic approach by modeling the cortical responses to semantic information that was extracted from the visual stream of a feature film, employing artificial neural network models. Advances in both computer vision and natural language processing were utilized to extract the semantic representations from the film by combining perceptual and linguistic information. We tested whether these representations were useful in studying the human brain data. To this end, we collected electrocorticography responses to a short movie from 37 subjects and fitted their cortical patterns across multiple regions using the semantic components extracted from film frames. We found that individual semantic components reflected fundamental semantic distinctions in the visual input, such as presence or absence of people, human movement, landscape scenes, human faces, etc. Moreover, each semantic component mapped onto a distinct functional cortical network involving high-level cognitive regions in occipitotemporal, frontal and parietal cortices. The present work demonstrates the potential of the data-driven methods from information processing fields to explain patterns of cortical responses, and contributes to the overall discussion about the encoding of high-level perceptual information in the human brain.

Correspondence between fMRI and electrophysiology during visual motion processing in human MT

Changes in brain neuronal activity are reflected by hemodynamic responses mapped through Blood Oxygenation Level Dependent (BOLD) functional magnetic resonance imaging (fMRI), a primary tool to measure brain functioning non-invasively. However, the exact relationship between hemodynamics and neuronal function is still a matter of debate. Here, we combine 3T BOLD fMRI and High Frequency Band (HFB) electrocorticography (ECoG) signals to investigate the relationship between neuronal activity and hemodynamic responses in the human Middle Temporal complex (hMT+), a higher order brain area involved in visual motion processing. We modulated the ECoG HFB and fMRI BOLD responses with a visual stimulus moving at different temporal frequencies, and compared measured BOLD responses to estimated BOLD responses that were predicted from the temporal profile of the HFB power change. We show that BOLD responses under an electrode over hMT+ can be well predicted not only be the strength of the neuronal response but also by the temporal profile of the HFB responses recorded by this electrode. Our results point to a linear relationship between BOLD and neuronal activity in hMT+, extending previous findings on primary cortex to higher order cortex.